2021-11-15T17:38:09.328 INFO:root:teuthology version: 1.1.0-d4737010 2021-11-15T17:38:09.330 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --lock --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --archive /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820 --owner scheduled_teuthology@teuthology --block --name teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba -- /tmp/teuthology-worker._kxnr66z.tmp 2021-11-15T17:38:09.363 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-15T17:38:09.439 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820 branch: octopus description: fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6498820' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: gibba name: teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: octopus ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd op complaint time: 180 osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff workunit: branch: octopus sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: d4737010a85099043cf081dc05b4069d301b23fb timestamp: 2021-11-12_04:10:03 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.gibba.12704 2021-11-15T17:38:09.440 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa; will attempt to use it 2021-11-15T17:38:09.441 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks 2021-11-15T17:38:09.441 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-15T17:38:09.443 INFO:teuthology.task.internal:Checking packages... 2021-11-15T17:38:09.463 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b0aaed0fe8cdfe99c82a70b230004934b51091ff' 2021-11-15T17:38:09.463 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-15T17:38:09.464 INFO:teuthology.packaging:ref: None 2021-11-15T17:38:09.464 INFO:teuthology.packaging:tag: None 2021-11-15T17:38:09.464 INFO:teuthology.packaging:branch: octopus 2021-11-15T17:38:09.465 INFO:teuthology.packaging:sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T17:38:09.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-11-15T17:38:09.762 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-32-gb0aaed0f-1focal 2021-11-15T17:38:09.762 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-15T17:38:09.774 INFO:teuthology.task.internal:no buildpackages task found 2021-11-15T17:38:09.774 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-11-15T17:38:09.810 INFO:teuthology.lock.ops:Locking machines... 2021-11-15T17:38:09.812 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-15T17:38:09.879 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:38:19.902 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:38:29.923 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:38:39.943 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:38:49.958 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:38:59.979 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:39:09.998 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:39:20.020 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:39:30.042 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T17:39:40.056 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:39:50.078 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:40:00.098 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:40:10.120 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:40:20.133 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:40:30.146 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:40:40.172 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:40:50.190 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:41:00.210 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:41:10.229 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:41:20.250 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:41:30.265 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:41:40.288 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:41:50.310 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:42:00.331 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:42:10.353 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:42:20.375 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:42:30.398 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:42:40.420 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:42:50.442 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:43:00.462 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:43:10.479 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:43:20.500 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:43:30.517 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:43:40.539 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:43:50.559 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:44:00.578 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:44:10.598 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:44:20.628 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:44:30.650 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:44:40.672 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:44:50.691 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T17:45:00.710 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:45:10.729 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:45:20.751 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:45:30.771 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:45:40.794 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:45:50.815 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:46:00.834 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:46:10.855 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:46:20.880 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:46:30.900 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:46:40.917 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:46:50.941 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:47:00.957 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:47:10.979 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:47:21.002 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:47:31.023 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:47:41.041 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:47:51.063 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:48:01.086 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:48:11.107 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:48:21.121 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:48:31.138 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:48:41.157 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:48:51.179 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:49:01.199 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:49:11.217 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:49:21.241 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:49:31.264 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:49:41.280 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:49:51.294 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:50:01.313 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:50:11.333 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:50:21.357 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:50:31.376 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:50:41.394 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:50:51.416 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:51:01.436 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:51:11.461 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:51:21.482 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:51:31.503 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:51:41.522 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:51:51.542 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:52:01.564 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:52:11.580 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:52:21.599 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:52:31.618 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:52:41.637 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:52:51.651 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:53:01.670 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:53:11.689 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:53:21.710 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:53:31.731 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:53:41.751 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:53:51.775 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:54:01.794 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:54:11.819 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T17:54:21.838 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:54:31.857 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T17:54:41.878 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:54:51.901 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:55:01.922 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:55:11.943 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:55:21.965 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:55:31.988 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:55:42.011 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:55:52.038 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:56:02.063 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:56:12.086 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:56:22.116 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:56:32.140 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:56:42.162 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:56:52.186 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:57:02.210 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:57:12.230 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:57:22.251 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:57:32.273 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:57:42.294 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:57:52.317 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:58:02.338 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:58:12.360 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:58:22.382 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:58:32.402 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:58:42.423 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:58:52.442 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:59:02.463 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:59:12.486 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:59:22.509 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:59:32.531 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:59:42.551 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T17:59:52.571 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:00:02.590 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:00:12.614 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:00:22.634 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:00:32.659 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T18:00:42.680 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:00:52.702 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:01:02.724 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:01:12.742 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:01:22.763 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:01:32.785 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:01:42.806 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:01:52.826 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:02:02.848 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:02:12.870 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:02:22.891 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:02:32.910 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:02:42.931 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:02:52.950 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:03:02.970 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:03:12.990 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:03:23.007 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:03:33.027 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:03:43.049 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:03:53.070 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:04:03.094 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:04:13.115 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:04:23.137 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:04:33.158 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:04:43.177 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:04:53.192 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:05:03.211 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:05:13.230 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:05:23.249 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:05:33.269 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:05:43.293 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:05:53.709 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:06:03.729 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:06:13.752 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:06:23.770 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:06:33.790 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:06:43.808 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:06:53.831 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:07:03.852 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:07:13.873 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:07:23.895 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:07:33.910 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:07:43.933 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:07:53.955 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:08:03.975 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:08:13.997 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:08:24.017 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:08:34.038 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:08:44.057 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:08:54.078 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:09:04.097 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:09:14.111 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:09:24.127 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:09:34.148 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:09:44.168 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:09:54.190 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:10:04.213 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:10:14.234 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:10:24.256 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:10:34.275 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:10:44.297 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:10:54.318 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:11:04.339 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:11:14.353 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:11:24.375 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:11:34.397 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:11:44.418 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:11:54.438 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:12:04.462 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:12:14.483 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:12:24.504 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:12:34.528 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:12:44.544 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:12:54.565 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:13:04.587 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:13:14.607 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:13:24.626 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:13:34.649 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:13:44.670 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:13:54.690 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:14:04.710 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:14:14.729 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:14:24.752 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:14:34.775 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:14:44.794 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:14:54.818 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:15:04.837 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:15:14.858 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T18:15:24.879 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:15:34.898 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:15:44.911 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:15:54.930 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:16:04.950 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:16:14.970 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:16:24.986 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:16:35.007 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:16:45.027 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:16:55.046 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:17:05.069 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:17:15.091 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:17:25.113 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:17:35.131 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:17:45.152 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:17:55.174 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:18:05.189 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:18:15.214 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:18:25.235 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:18:35.257 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:18:45.279 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:18:55.301 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:19:05.320 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:19:15.340 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:19:25.362 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:19:35.382 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:19:45.403 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:19:55.422 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:20:05.442 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:20:15.462 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:20:25.482 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:20:35.503 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:20:45.522 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:20:55.544 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:21:05.569 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:21:15.591 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:21:25.613 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:21:35.634 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:21:45.656 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:21:55.679 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:22:05.698 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:22:15.721 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:22:25.742 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:22:35.764 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:22:45.787 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:22:55.806 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:23:05.825 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:23:15.846 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:23:25.866 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:23:35.886 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:23:45.910 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:23:55.931 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:24:05.952 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:24:15.974 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:24:25.995 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:24:36.019 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:24:46.038 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:24:56.062 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:25:06.082 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:25:16.103 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:25:26.129 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:25:36.150 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:25:46.170 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:25:56.190 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:26:06.210 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:26:16.231 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:26:26.254 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:26:36.276 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:26:46.298 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:26:56.319 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:27:06.337 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:27:16.360 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:27:26.382 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:27:36.403 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:27:46.423 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:27:56.444 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:28:06.466 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:28:16.489 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:28:26.510 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:28:36.529 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:28:46.549 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:28:56.570 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:29:06.589 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:29:16.610 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:29:26.633 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:29:36.653 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:29:46.676 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:29:56.697 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:30:06.718 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:30:16.739 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:30:26.758 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:30:36.777 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:30:46.799 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:30:56.817 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:31:06.840 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:31:16.862 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:31:26.885 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:31:36.905 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:31:46.922 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:31:56.943 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:32:06.965 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:32:16.986 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:32:27.006 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:32:37.029 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:32:47.049 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:32:57.071 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:33:07.090 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:33:17.110 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:33:27.129 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:33:37.151 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:33:47.173 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:33:57.194 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:34:07.214 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:34:17.234 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:34:27.256 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:34:37.278 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:34:47.297 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:34:57.318 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:35:07.341 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:35:17.364 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:35:27.386 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:35:37.402 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:35:47.423 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:35:57.442 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:36:07.458 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:36:17.478 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:36:27.498 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:36:37.517 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:36:47.540 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:36:57.562 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:37:07.581 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:37:17.602 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:37:27.624 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:37:37.639 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:37:47.658 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:37:57.679 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:38:07.698 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:38:17.720 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:38:27.742 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:38:37.762 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:38:47.783 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:38:57.806 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:39:07.827 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:39:17.848 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:39:27.871 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:39:37.890 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:39:47.909 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:39:57.930 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:40:07.953 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:40:17.975 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:40:27.995 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:40:38.014 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:40:48.036 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:40:58.058 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:41:08.078 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:41:18.099 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:41:28.118 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:41:38.137 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:41:48.160 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:41:58.184 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:42:08.204 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:42:18.228 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:42:28.250 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:42:38.268 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:42:48.290 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:42:58.312 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:43:08.334 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:43:18.356 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:43:28.378 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:43:38.400 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:43:48.423 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:43:58.442 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:44:08.467 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:44:18.489 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:44:28.510 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:44:38.529 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:44:48.547 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:44:58.567 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:45:08.589 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:45:18.610 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:45:28.630 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:45:38.650 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:45:48.671 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:45:58.692 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:46:08.714 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:46:18.737 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:46:28.758 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:46:38.779 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:46:48.798 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:46:58.818 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:47:08.838 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:47:18.857 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:47:28.879 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:47:38.898 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:47:48.921 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:47:58.942 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:48:08.964 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:48:18.982 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:48:29.004 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:48:39.024 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:48:49.045 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:48:59.067 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:49:09.128 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:49:19.151 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:49:29.172 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:49:39.193 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:49:49.214 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:49:59.233 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:50:09.254 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:50:19.268 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:50:29.290 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:50:39.311 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:50:49.329 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:50:59.350 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:51:09.370 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:51:19.391 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:51:29.413 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:51:39.436 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:51:49.456 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:51:59.479 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:52:09.504 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:52:19.523 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:52:29.542 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:52:39.561 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:52:49.577 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:52:59.598 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:53:09.617 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:53:19.631 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:53:29.656 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:53:39.678 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:53:49.699 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:53:59.715 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:54:09.736 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:54:19.756 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:54:29.778 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:54:39.800 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:54:49.822 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:54:59.843 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:55:09.865 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:55:19.886 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:55:29.907 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:55:39.923 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:55:49.942 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 0)... 2021-11-15T18:55:59.963 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:56:09.982 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:56:20.005 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 4)... 2021-11-15T18:56:30.026 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:56:40.047 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:56:50.066 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:57:00.087 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:57:10.106 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:57:20.128 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:57:30.150 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:57:40.171 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:57:50.190 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:58:00.202 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:58:10.225 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:58:20.247 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:58:30.267 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:58:40.284 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T18:58:50.306 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:59:00.326 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:59:10.346 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:59:20.367 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:59:30.386 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:59:40.406 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T18:59:50.426 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:00:00.445 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:00:10.465 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:00:20.486 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:00:30.506 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:00:40.527 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:00:50.550 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:01:00.572 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:01:10.591 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:01:20.612 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:01:30.634 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:01:40.653 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:01:50.673 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:02:00.691 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:02:10.714 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:02:20.736 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:02:30.758 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:02:40.778 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:02:50.798 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:03:00.818 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:03:10.839 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 2)... 2021-11-15T19:03:20.859 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T19:03:30.881 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 1)... 2021-11-15T19:03:40.903 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:03:50.918 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:04:00.938 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:04:10.961 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:04:20.983 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:04:31.003 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:04:41.023 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:04:51.044 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:05:01.062 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:05:11.083 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:05:21.099 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:05:31.122 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:05:41.143 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:05:51.159 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:06:01.175 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:06:11.198 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:06:21.222 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:06:31.242 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:06:41.263 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:06:51.283 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:07:01.302 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:07:11.326 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 5, have 3)... 2021-11-15T19:07:21.350 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 5, 'machine_type': 'gibba', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820'} 2021-11-15T19:07:21.383 DEBUG:teuthology.lock.ops:locked ubuntu@gibba037.front.sepia.ceph.com, ubuntu@gibba011.front.sepia.ceph.com, ubuntu@gibba031.front.sepia.ceph.com, ubuntu@gibba018.front.sepia.ceph.com, ubuntu@gibba017.front.sepia.ceph.com 2021-11-15T19:07:21.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4a2b379d8>, signals=[15]) 2021-11-15T19:07:21.551 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba037.front.sepia.ceph.com' reimaging 2021-11-15T19:07:21.551 INFO:teuthology.lock.ops:Updating [ubuntu@gibba037.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T19:07:21.552 INFO:teuthology.lock.ops:Updating gibba037.front.sepia.ceph.com on lock server 2021-11-15T19:07:21.574 INFO:teuthology.lock.ops:Node 'ubuntu@gibba037.front.sepia.ceph.com' reimaging is complete 2021-11-15T19:07:21.575 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba011.front.sepia.ceph.com' reimaging 2021-11-15T19:07:21.576 INFO:teuthology.lock.ops:Updating [ubuntu@gibba011.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T19:07:21.576 INFO:teuthology.lock.ops:Updating gibba011.front.sepia.ceph.com on lock server 2021-11-15T19:07:21.600 INFO:teuthology.lock.ops:Node 'ubuntu@gibba011.front.sepia.ceph.com' reimaging is complete 2021-11-15T19:07:21.601 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba031.front.sepia.ceph.com' reimaging 2021-11-15T19:07:21.601 INFO:teuthology.lock.ops:Updating [ubuntu@gibba031.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T19:07:21.601 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server 2021-11-15T19:07:21.621 INFO:teuthology.lock.ops:Node 'ubuntu@gibba031.front.sepia.ceph.com' reimaging is complete 2021-11-15T19:07:21.622 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba018.front.sepia.ceph.com' reimaging 2021-11-15T19:07:21.623 INFO:teuthology.lock.ops:Updating [ubuntu@gibba018.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T19:07:21.623 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server 2021-11-15T19:07:21.641 INFO:teuthology.lock.ops:Node 'ubuntu@gibba018.front.sepia.ceph.com' reimaging is complete 2021-11-15T19:07:21.642 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba017.front.sepia.ceph.com' reimaging 2021-11-15T19:07:21.642 INFO:teuthology.lock.ops:Updating [ubuntu@gibba017.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T19:07:21.643 INFO:teuthology.lock.ops:Updating gibba017.front.sepia.ceph.com on lock server 2021-11-15T19:07:21.661 INFO:teuthology.lock.ops:Node 'ubuntu@gibba017.front.sepia.ceph.com' reimaging is complete 2021-11-15T19:07:21.808 INFO:teuthology.provision.fog.gibba037:Scheduling deploy of ubuntu 20.04 2021-11-15T19:07:21.818 INFO:teuthology.provision.fog.gibba011:Scheduling deploy of ubuntu 20.04 2021-11-15T19:07:21.853 INFO:teuthology.provision.fog.gibba031:Scheduling deploy of ubuntu 20.04 2021-11-15T19:07:21.891 INFO:teuthology.provision.fog.gibba018:Scheduling deploy of ubuntu 20.04 2021-11-15T19:07:21.896 INFO:teuthology.provision.fog.gibba017:Scheduling deploy of ubuntu 20.04 2021-11-15T19:07:22.147 INFO:teuthology.orchestra.console:Power off gibba011 2021-11-15T19:07:22.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T19:07:22.166 INFO:teuthology.orchestra.console:Power off gibba031 2021-11-15T19:07:22.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T19:07:22.179 INFO:teuthology.orchestra.console:Power off gibba037 2021-11-15T19:07:22.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T19:07:22.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:22.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:22.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:22.232 INFO:teuthology.orchestra.console:Power off gibba018 2021-11-15T19:07:22.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T19:07:22.258 INFO:teuthology.orchestra.console:Power off gibba017 2021-11-15T19:07:22.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T19:07:22.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:22.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:26.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:26.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:26.297 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:26.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:26.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.556 INFO:teuthology.orchestra.console:Power off for gibba031 completed 2021-11-15T19:07:30.618 INFO:teuthology.orchestra.console:Power off for gibba011 completed 2021-11-15T19:07:30.626 INFO:teuthology.orchestra.console:Power off for gibba018 completed 2021-11-15T19:07:30.640 INFO:teuthology.orchestra.console:Power off for gibba017 completed 2021-11-15T19:07:30.658 INFO:teuthology.orchestra.console:Power on gibba031 2021-11-15T19:07:30.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T19:07:30.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.719 INFO:teuthology.orchestra.console:Power on gibba011 2021-11-15T19:07:30.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T19:07:30.727 INFO:teuthology.orchestra.console:Power on gibba018 2021-11-15T19:07:30.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T19:07:30.741 INFO:teuthology.orchestra.console:Power on gibba017 2021-11-15T19:07:30.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T19:07:30.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:30.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:34.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:34.701 INFO:teuthology.orchestra.console:Power off for gibba037 completed 2021-11-15T19:07:34.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:34.775 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:34.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:34.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:34.803 INFO:teuthology.orchestra.console:Power on gibba037 2021-11-15T19:07:34.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T19:07:34.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:38.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:38.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:38.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:38.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:38.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:39.078 INFO:teuthology.orchestra.console:Power on for gibba031 completed 2021-11-15T19:07:39.095 INFO:teuthology.orchestra.console:Power on for gibba011 completed 2021-11-15T19:07:39.106 INFO:teuthology.orchestra.console:Power on for gibba018 completed 2021-11-15T19:07:39.113 INFO:teuthology.orchestra.console:Power on for gibba017 completed 2021-11-15T19:07:39.180 INFO:teuthology.provision.fog.gibba031:Waiting for deploy to finish 2021-11-15T19:07:39.196 INFO:teuthology.provision.fog.gibba011:Waiting for deploy to finish 2021-11-15T19:07:39.207 INFO:teuthology.provision.fog.gibba018:Waiting for deploy to finish 2021-11-15T19:07:39.215 INFO:teuthology.provision.fog.gibba017:Waiting for deploy to finish 2021-11-15T19:07:42.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T19:07:43.182 INFO:teuthology.orchestra.console:Power on for gibba037 completed 2021-11-15T19:07:43.471 INFO:teuthology.provision.fog.gibba037:Waiting for deploy to finish 2021-11-15T19:10:25.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:10:25.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:10:25.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:10:25.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:10:29.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:11:34.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:11:34.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:11:34.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:11:34.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:11:38.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:11.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:11.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:11.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:11.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:12.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T19:13:12.138 DEBUG:teuthology.orchestra.run.gibba018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T19:13:12.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T19:13:12.141 DEBUG:teuthology.orchestra.run.gibba031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T19:13:12.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T19:13:12.168 DEBUG:teuthology.orchestra.run.gibba017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T19:13:12.200 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T19:13:12.200 DEBUG:teuthology.orchestra.run.gibba011:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T19:13:12.599 INFO:teuthology.provision.fog.gibba031:Node is ready 2021-11-15T19:13:12.599 DEBUG:teuthology.orchestra.run.gibba031:> hostname 2021-11-15T19:13:12.602 INFO:teuthology.provision.fog.gibba018:Node is ready 2021-11-15T19:13:12.602 DEBUG:teuthology.orchestra.run.gibba018:> hostname 2021-11-15T19:13:12.607 INFO:teuthology.provision.fog.gibba017:Node is ready 2021-11-15T19:13:12.607 DEBUG:teuthology.orchestra.run.gibba017:> hostname 2021-11-15T19:13:12.611 INFO:teuthology.orchestra.run.gibba017.stdout:gibba017.front.sepia.ceph.com 2021-11-15T19:13:12.611 DEBUG:teuthology.orchestra.run.gibba017:> grep gibba017.front.sepia.ceph.com /etc/hosts 2021-11-15T19:13:12.616 INFO:teuthology.orchestra.run.gibba017.stdout:172.21.2.117 gibba017.front.sepia.ceph.com gibba017 2021-11-15T19:13:12.616 DEBUG:teuthology.orchestra.run.gibba017:> sudo hostname gibba017 2021-11-15T19:13:12.649 INFO:teuthology.orchestra.run.gibba031.stdout:gibba031.front.sepia.ceph.com 2021-11-15T19:13:12.649 DEBUG:teuthology.orchestra.run.gibba031:> grep gibba031.front.sepia.ceph.com /etc/hosts 2021-11-15T19:13:12.653 INFO:teuthology.orchestra.run.gibba018.stdout:gibba018.front.sepia.ceph.com 2021-11-15T19:13:12.653 DEBUG:teuthology.orchestra.run.gibba018:> grep gibba018.front.sepia.ceph.com /etc/hosts 2021-11-15T19:13:12.658 INFO:teuthology.orchestra.run.gibba031.stdout:172.21.2.131 gibba031.front.sepia.ceph.com gibba031 2021-11-15T19:13:12.658 DEBUG:teuthology.orchestra.run.gibba031:> sudo hostname gibba031 2021-11-15T19:13:12.662 INFO:teuthology.orchestra.run.gibba018.stdout:172.21.2.118 gibba018.front.sepia.ceph.com gibba018 2021-11-15T19:13:12.663 DEBUG:teuthology.orchestra.run.gibba018:> sudo hostname gibba018 2021-11-15T19:13:12.707 DEBUG:teuthology.orchestra.run.gibba031:> sudo sed -i -e 's/gibba031.front.sepia.ceph.com/gibba031/g' /etc/hosts 2021-11-15T19:13:12.713 INFO:teuthology.provision.fog.gibba011:Node is ready 2021-11-15T19:13:12.714 DEBUG:teuthology.orchestra.run.gibba011:> hostname 2021-11-15T19:13:12.715 DEBUG:teuthology.orchestra.run.gibba031:> sudo sed -i -e 's/172.21.2.131/172.21.2.131/g' /etc/hosts 2021-11-15T19:13:12.722 INFO:teuthology.orchestra.run.gibba011.stdout:gibba011.front.sepia.ceph.com 2021-11-15T19:13:12.723 DEBUG:teuthology.orchestra.run.gibba011:> grep gibba011.front.sepia.ceph.com /etc/hosts 2021-11-15T19:13:12.739 DEBUG:teuthology.orchestra.run.gibba017:> sudo sed -i -e 's/gibba017.front.sepia.ceph.com/gibba017/g' /etc/hosts 2021-11-15T19:13:12.743 DEBUG:teuthology.orchestra.run.gibba018:> sudo sed -i -e 's/gibba018.front.sepia.ceph.com/gibba018/g' /etc/hosts 2021-11-15T19:13:12.749 DEBUG:teuthology.orchestra.run.gibba017:> sudo sed -i -e 's/172.21.2.117/172.21.2.117/g' /etc/hosts 2021-11-15T19:13:12.755 DEBUG:teuthology.orchestra.run.gibba017:> sudo sed -i -e 's/gibba017.front.sepia.ceph.com/gibba017/g' /etc/hostname 2021-11-15T19:13:12.761 DEBUG:teuthology.orchestra.run.gibba017:> sudo hostname gibba017 2021-11-15T19:13:12.765 DEBUG:teuthology.orchestra.run.gibba018:> sudo sed -i -e 's/172.21.2.118/172.21.2.118/g' /etc/hosts 2021-11-15T19:13:12.767 DEBUG:teuthology.orchestra.run.gibba031:> sudo sed -i -e 's/gibba031.front.sepia.ceph.com/gibba031/g' /etc/hostname 2021-11-15T19:13:12.774 DEBUG:teuthology.orchestra.run.gibba031:> sudo hostname gibba031 2021-11-15T19:13:12.777 INFO:teuthology.orchestra.run.gibba011.stdout:172.21.2.111 gibba011.front.sepia.ceph.com gibba011 2021-11-15T19:13:12.777 DEBUG:teuthology.orchestra.run.gibba011:> sudo hostname gibba011 2021-11-15T19:13:12.779 INFO:teuthology.provision.fog.gibba031:Deploy complete! 2021-11-15T19:13:12.780 DEBUG:teuthology.parallel:result is None 2021-11-15T19:13:12.785 DEBUG:teuthology.orchestra.run.gibba018:> sudo sed -i -e 's/gibba018.front.sepia.ceph.com/gibba018/g' /etc/hostname 2021-11-15T19:13:12.812 INFO:teuthology.provision.fog.gibba017:Deploy complete! 2021-11-15T19:13:12.812 DEBUG:teuthology.parallel:result is None 2021-11-15T19:13:12.839 DEBUG:teuthology.orchestra.run.gibba018:> sudo hostname gibba018 2021-11-15T19:13:12.846 INFO:teuthology.provision.fog.gibba018:Deploy complete! 2021-11-15T19:13:12.847 DEBUG:teuthology.parallel:result is None 2021-11-15T19:13:12.863 DEBUG:teuthology.orchestra.run.gibba011:> sudo sed -i -e 's/gibba011.front.sepia.ceph.com/gibba011/g' /etc/hosts 2021-11-15T19:13:12.885 DEBUG:teuthology.orchestra.run.gibba011:> sudo sed -i -e 's/172.21.2.111/172.21.2.111/g' /etc/hosts 2021-11-15T19:13:12.895 DEBUG:teuthology.orchestra.run.gibba011:> sudo sed -i -e 's/gibba011.front.sepia.ceph.com/gibba011/g' /etc/hostname 2021-11-15T19:13:12.901 DEBUG:teuthology.orchestra.run.gibba011:> sudo hostname gibba011 2021-11-15T19:13:12.957 INFO:teuthology.provision.fog.gibba011:Deploy complete! 2021-11-15T19:13:12.957 DEBUG:teuthology.parallel:result is None 2021-11-15T19:13:15.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:16.243 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T19:13:16.244 DEBUG:teuthology.orchestra.run.gibba037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T19:13:16.749 INFO:teuthology.provision.fog.gibba037:Node is ready 2021-11-15T19:13:16.750 DEBUG:teuthology.orchestra.run.gibba037:> hostname 2021-11-15T19:13:16.755 INFO:teuthology.orchestra.run.gibba037.stdout:gibba037.front.sepia.ceph.com 2021-11-15T19:13:16.755 DEBUG:teuthology.orchestra.run.gibba037:> grep gibba037.front.sepia.ceph.com /etc/hosts 2021-11-15T19:13:16.804 INFO:teuthology.orchestra.run.gibba037.stdout:172.21.2.137 gibba037.front.sepia.ceph.com gibba037 2021-11-15T19:13:16.804 DEBUG:teuthology.orchestra.run.gibba037:> sudo hostname gibba037 2021-11-15T19:13:16.874 DEBUG:teuthology.orchestra.run.gibba037:> sudo sed -i -e 's/gibba037.front.sepia.ceph.com/gibba037/g' /etc/hosts 2021-11-15T19:13:16.893 DEBUG:teuthology.orchestra.run.gibba037:> sudo sed -i -e 's/172.21.2.137/172.21.2.137/g' /etc/hosts 2021-11-15T19:13:16.903 DEBUG:teuthology.orchestra.run.gibba037:> sudo sed -i -e 's/gibba037.front.sepia.ceph.com/gibba037/g' /etc/hostname 2021-11-15T19:13:16.968 DEBUG:teuthology.orchestra.run.gibba037:> sudo hostname gibba037 2021-11-15T19:13:16.979 INFO:teuthology.provision.fog.gibba037:Deploy complete! 2021-11-15T19:13:16.979 DEBUG:teuthology.parallel:result is None 2021-11-15T19:13:17.195 INFO:teuthology.lock.ops:Checking gibba037.front.sepia.ceph.com 2021-11-15T19:13:17.196 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T19:13:17.222 INFO:teuthology.lock.ops:Checking gibba011.front.sepia.ceph.com 2021-11-15T19:13:17.222 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T19:13:17.239 INFO:teuthology.lock.ops:Checking gibba031.front.sepia.ceph.com 2021-11-15T19:13:17.239 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T19:13:17.255 INFO:teuthology.lock.ops:Checking gibba018.front.sepia.ceph.com 2021-11-15T19:13:17.255 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T19:13:17.271 INFO:teuthology.lock.ops:Checking gibba017.front.sepia.ceph.com 2021-11-15T19:13:17.271 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T19:13:17.289 INFO:teuthology.lock.ops:Updating [gibba037.front.sepia.ceph.com]: set os type and version on server 2021-11-15T19:13:17.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba037.front.sepia.ceph.com' 2021-11-15T19:13:17.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:17.323 DEBUG:teuthology.orchestra.run.gibba037:> true 2021-11-15T19:13:17.401 DEBUG:teuthology.orchestra.run.gibba037:> uname -m 2021-11-15T19:13:17.450 INFO:teuthology.orchestra.run.gibba037.stdout:x86_64 2021-11-15T19:13:17.451 DEBUG:teuthology.orchestra.run.gibba037:> cat /etc/os-release 2021-11-15T19:13:17.454 INFO:teuthology.orchestra.run.gibba037.stdout:NAME="Ubuntu" 2021-11-15T19:13:17.454 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:17.454 INFO:teuthology.orchestra.run.gibba037.stdout:ID=ubuntu 2021-11-15T19:13:17.455 INFO:teuthology.orchestra.run.gibba037.stdout:ID_LIKE=debian 2021-11-15T19:13:17.455 INFO:teuthology.orchestra.run.gibba037.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:17.455 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION_ID="20.04" 2021-11-15T19:13:17.455 INFO:teuthology.orchestra.run.gibba037.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:17.456 INFO:teuthology.orchestra.run.gibba037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:17.456 INFO:teuthology.orchestra.run.gibba037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:17.456 INFO:teuthology.orchestra.run.gibba037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:17.456 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:17.456 INFO:teuthology.orchestra.run.gibba037.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:17.457 INFO:teuthology.lock.ops:Updating gibba037.front.sepia.ceph.com on lock server 2021-11-15T19:13:17.475 INFO:teuthology.lock.ops:Updating [gibba011.front.sepia.ceph.com]: set os type and version on server 2021-11-15T19:13:17.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba011.front.sepia.ceph.com' 2021-11-15T19:13:17.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:17.509 DEBUG:teuthology.orchestra.run.gibba011:> true 2021-11-15T19:13:17.590 DEBUG:teuthology.orchestra.run.gibba011:> uname -m 2021-11-15T19:13:17.638 INFO:teuthology.orchestra.run.gibba011.stdout:x86_64 2021-11-15T19:13:17.639 DEBUG:teuthology.orchestra.run.gibba011:> cat /etc/os-release 2021-11-15T19:13:17.647 INFO:teuthology.orchestra.run.gibba011.stdout:NAME="Ubuntu" 2021-11-15T19:13:17.648 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:17.648 INFO:teuthology.orchestra.run.gibba011.stdout:ID=ubuntu 2021-11-15T19:13:17.648 INFO:teuthology.orchestra.run.gibba011.stdout:ID_LIKE=debian 2021-11-15T19:13:17.648 INFO:teuthology.orchestra.run.gibba011.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:17.649 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION_ID="20.04" 2021-11-15T19:13:17.649 INFO:teuthology.orchestra.run.gibba011.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:17.649 INFO:teuthology.orchestra.run.gibba011.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:17.649 INFO:teuthology.orchestra.run.gibba011.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:17.650 INFO:teuthology.orchestra.run.gibba011.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:17.650 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:17.650 INFO:teuthology.orchestra.run.gibba011.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:17.651 INFO:teuthology.lock.ops:Updating gibba011.front.sepia.ceph.com on lock server 2021-11-15T19:13:17.668 INFO:teuthology.lock.ops:Updating [gibba031.front.sepia.ceph.com]: set os type and version on server 2021-11-15T19:13:17.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba031.front.sepia.ceph.com' 2021-11-15T19:13:17.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:17.701 DEBUG:teuthology.orchestra.run.gibba031:> true 2021-11-15T19:13:17.781 DEBUG:teuthology.orchestra.run.gibba031:> uname -m 2021-11-15T19:13:17.786 INFO:teuthology.orchestra.run.gibba031.stdout:x86_64 2021-11-15T19:13:17.786 DEBUG:teuthology.orchestra.run.gibba031:> cat /etc/os-release 2021-11-15T19:13:17.837 INFO:teuthology.orchestra.run.gibba031.stdout:NAME="Ubuntu" 2021-11-15T19:13:17.837 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:17.837 INFO:teuthology.orchestra.run.gibba031.stdout:ID=ubuntu 2021-11-15T19:13:17.837 INFO:teuthology.orchestra.run.gibba031.stdout:ID_LIKE=debian 2021-11-15T19:13:17.838 INFO:teuthology.orchestra.run.gibba031.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:17.838 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_ID="20.04" 2021-11-15T19:13:17.838 INFO:teuthology.orchestra.run.gibba031.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:17.838 INFO:teuthology.orchestra.run.gibba031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:17.838 INFO:teuthology.orchestra.run.gibba031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:17.839 INFO:teuthology.orchestra.run.gibba031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:17.839 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:17.839 INFO:teuthology.orchestra.run.gibba031.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:17.840 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server 2021-11-15T19:13:17.859 INFO:teuthology.lock.ops:Updating [gibba018.front.sepia.ceph.com]: set os type and version on server 2021-11-15T19:13:17.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba018.front.sepia.ceph.com' 2021-11-15T19:13:17.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:17.891 DEBUG:teuthology.orchestra.run.gibba018:> true 2021-11-15T19:13:17.974 DEBUG:teuthology.orchestra.run.gibba018:> uname -m 2021-11-15T19:13:17.978 INFO:teuthology.orchestra.run.gibba018.stdout:x86_64 2021-11-15T19:13:17.978 DEBUG:teuthology.orchestra.run.gibba018:> cat /etc/os-release 2021-11-15T19:13:17.982 INFO:teuthology.orchestra.run.gibba018.stdout:NAME="Ubuntu" 2021-11-15T19:13:17.983 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:17.983 INFO:teuthology.orchestra.run.gibba018.stdout:ID=ubuntu 2021-11-15T19:13:17.983 INFO:teuthology.orchestra.run.gibba018.stdout:ID_LIKE=debian 2021-11-15T19:13:17.983 INFO:teuthology.orchestra.run.gibba018.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:17.984 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_ID="20.04" 2021-11-15T19:13:17.984 INFO:teuthology.orchestra.run.gibba018.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:17.984 INFO:teuthology.orchestra.run.gibba018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:17.984 INFO:teuthology.orchestra.run.gibba018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:17.985 INFO:teuthology.orchestra.run.gibba018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:17.985 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:17.985 INFO:teuthology.orchestra.run.gibba018.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:17.985 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server 2021-11-15T19:13:18.002 INFO:teuthology.lock.ops:Updating [gibba017.front.sepia.ceph.com]: set os type and version on server 2021-11-15T19:13:18.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba017.front.sepia.ceph.com' 2021-11-15T19:13:18.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:18.035 DEBUG:teuthology.orchestra.run.gibba017:> true 2021-11-15T19:13:18.114 DEBUG:teuthology.orchestra.run.gibba017:> uname -m 2021-11-15T19:13:18.162 INFO:teuthology.orchestra.run.gibba017.stdout:x86_64 2021-11-15T19:13:18.163 DEBUG:teuthology.orchestra.run.gibba017:> cat /etc/os-release 2021-11-15T19:13:18.169 INFO:teuthology.orchestra.run.gibba017.stdout:NAME="Ubuntu" 2021-11-15T19:13:18.170 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:18.170 INFO:teuthology.orchestra.run.gibba017.stdout:ID=ubuntu 2021-11-15T19:13:18.170 INFO:teuthology.orchestra.run.gibba017.stdout:ID_LIKE=debian 2021-11-15T19:13:18.171 INFO:teuthology.orchestra.run.gibba017.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:18.171 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION_ID="20.04" 2021-11-15T19:13:18.171 INFO:teuthology.orchestra.run.gibba017.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:18.171 INFO:teuthology.orchestra.run.gibba017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:18.171 INFO:teuthology.orchestra.run.gibba017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:18.172 INFO:teuthology.orchestra.run.gibba017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:18.172 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:18.172 INFO:teuthology.orchestra.run.gibba017.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:18.173 INFO:teuthology.lock.ops:Updating gibba017.front.sepia.ceph.com on lock server 2021-11-15T19:13:18.190 INFO:teuthology.lock.ops:5 gibba machines locked this try, 5/5 locked so far 2021-11-15T19:13:18.293 INFO:teuthology.lock.ops:Locked targets: gibba011.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl5uafO4UcWYVW61MSXFb5+uByn6pBkku4GhqfNGBN0bDjHU/eS6xFfAiV3prJ5ohG5NOm6N7kNdBMQdoDQxyNTpHlGsrFxk5zivNDFlEeXsJCi1QG6uygIQw3yqYMyCjrxq7U6l5KAHBIAq4FlE0LggLAOgh8IcyOUHbx0WTQA4+ff+XA6X3eQk3x44H5F8V4+zxQPYFNKkNH1Jovo4bzSakghoMprRDN+mOavuwxfnQqkqZqf96yQ7HljbUqvrmmNE3Cos4RE2c+GI55HE0lDO0do8kQ2FVx29efxGIik8TVVaoNJRiBdBKSIKal2+nJ7bbvFj6u1fSKlQ/Bxi0pMqJ1Iq2XV0NXYrf6GbCZJOTgQZyXuxOfGuK/fcqwoTzfbFLBHhZRaG6h9Ur0EOVB3kmSQiQY3b69qmKNH23tU93PxaWGp2WMnT/rrKzJSVuZIp6ZfXHKcPEVi4eGVD3DD/7in+dxkC/SbZvIEhFxSVoa5ttTWpWfCI7jRB1hk18= gibba017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJXtzTxqYAXaBkPdXit8LUjwSqWXmsBPJhLrlHLFQTWmXJaaG5IRkTJU7vAWsQLEbZNJVwVNQFlrRgZUVWiQCi7PSCXzqKlmow1HO7Psw1FRbHnKHGDn1AOfbkEIfLf9B7Of6W8tmJjdC8B0wdx5hK0huG3OK0DatRaH2mJ7yJKQEhKNjeIZMs4xLJG1l5kHG2Baf1mr0pnSUt1/vOAZSr27mVDiYOcQPmL/BeaX6tQubf0U2lBVsjjetUQ/I4lD8VjSjvR9uzb9AT9BWS7lO/3PBsJA+CtK9AOWDz9+Fra7XJuY/E505PdaWqvJkQXZqPGA/CTVIJlNBn0KCbwxlSJxgVj4RG4fHYc7QQ1pA9WU3YThstwT1tTNxTfeMpV+4/HRYlpwHaBDRw5aQ2S/F1wgDMB49sG5b/N6SxcMIo33V9JlBujOoqnobSh+3oIewukhluBj9CDgpVMsXB8IDmnyfEM9zrZ4wm2bspiYLAhFwAfDL7wYIEHT9k0Ovlq/c= gibba018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoxdc0yhKf0cqE96BuESIgek2iBR7rwnA3V8ZfPV+QHeKizzo966M+UQ2M2wQIBaAOUoaCnQZL0TkbxWDd+PeCaldPpgTj4uQh5eYt5D8Fn8kxJSKeTjT8Z50uUX0cHXxRDosYA8riBf8MatL3AZ4fEL5CTCErH61iD+qUV/zVGTsvViPvU363Qn79/f+hkrRccpZFQeqYfnovfqaiFJbNIGNUljQ/rYbHswnI731fQji15gYlTij0rQqtwKjnj7B+8mwJSlpz4p+u9Dp/zc8b+MlurWyH0lWHkrDietV59evt3eMN5iARz1L+qrB0WujDYj1IwQwoqC8H5OHk9zJfPqJv3/5QReokpIbPeAJYQ1iv/IpyiLjETuYMxKabaRPmvAVNDPJwa+JmIE4lplWUdgnXbbYmC8SrDw2uo7iZQ6Zc6dt5Fq3Gex+FU7UYk1ZuiPIbtPgBy1xIZYGUgXgjgbqIzfWATYacCalFW8WiY8+Se6jGEkn5/WcapiDQX60= gibba031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo8+UA2eYlienvEFwsB7a/CQyVkiuBLcsTwmcgg4EN/Gt9x/ZqEYX9JAtl3ht3mMMmTvvCdcIb0mO/ek9UJ8HPfkdD70H7voibPaKtVfHKEflzL+czRpuyNWHWDe75kNfKZ4tDp0TV1nf26bPEqg4P+dqjkxvGrgj4ewgYoIxrmtY/9awOjndwgbNTLRdKmyLKG8TaEi2UktETjHZ+KFR6EHy0yhe+Uq50VZFJYvaLPlmzkU746fXkeq/AQmy2+bmcQ7cxhNCQsIpfCWLdAWkd3oAYxGCCK13oOed6/lHn2am3RYHwtZ1jM7lkkh+8SUn1HIs7rebQ+jAS3YpwQC4jrLWp5cYD+SIkHZcget3XFVBOozts2jB5FQ/uVPn9HgKkR6ErL0DP2R/HuQFePg0lyahHEFshEXqbb93p7K+bgucP7HbBpSrDbZpNUhkj5v6oSXROpl0av2i2osLnxf06cpiXroJOC37CWsoR/vDhAxx44w5avtzC9hY4bGua+B8= gibba037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNgP4nUwCLJwHk5U5RzuMOLZKQlyCwce2x1RB8Oxr52JTiimFJaZaTXEcDHoZHuL2B/8v8c91SzfesSpACFIofqtaIVzQniHN4Ldsv6rXlZ3LIMLF3eT/B1BNv7OxZROrAra550eyC1nVbCBnjzZxz3yCpNnAXEuW2iB1F3CAVTiKZe7zqpHod2HrGn5Vvq0fhxIz6IGjUBOMz1lMaQ0brkU5lpBWYryMwRBrdbQMk5rTHv3R3fsKwksZb4qhXNtdOts+CNWRIyc1Iy80kwYyAA0Y5kHZMWmW6VJbDsXNO82bCHSV0Y7vRSSqrt3KsZidPlJYHkFfXJJ5sCIpSVDsuWtENGX4Lqc/ZI3p5PKXy0SO1VihLzT8Mq2LavmXq1b/UZND1rEkxoWQgzulkUeCbGC81PFm1Cob7KNCzLJgzcfi5HbnzZkOdep3/677fwISKLWB1xueXR1CFnI4KlQ/hngCTufzDGrpW4P7Il9M0Zkatd9k5gMO/CLWgOdXyYZ0= 2021-11-15T19:13:18.294 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-15T19:13:18.371 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-15T19:13:18.378 INFO:teuthology.task.internal:Saving configuration 2021-11-15T19:13:18.395 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-15T19:13:18.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-15T19:13:18.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 19:07:21.359510', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN34/CugKfGQxCYIHtJXWlVM8qHLIm3zYxRn8CgmzfAq'} 2021-11-15T19:13:18.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba011.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 19:07:21.360866', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE8djHoeX/jHjTXaCHmHG6f4No3rCsofF6V599aPLiXo'} 2021-11-15T19:13:18.503 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 19:07:21.361826', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICzAdM6R3Ua/hE8nwbE7AKce9GSJEF8R2kXqj7HGKoPt'} 2021-11-15T19:13:18.525 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 19:07:21.362880', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKKbu8VTFGq4ijS7zRCDPAEHeFerPA2yfTSVf+ioeYKW'} 2021-11-15T19:13:18.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 19:07:21.363999', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGwg+ZfsIczJvAbS0OHVMKGcdeSNI7ORo0rm6jKjIc7q'} 2021-11-15T19:13:18.546 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-15T19:13:18.557 INFO:teuthology.task.internal:roles: ubuntu@gibba037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-11-15T19:13:18.558 INFO:teuthology.task.internal:roles: ubuntu@gibba011.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-11-15T19:13:18.558 INFO:teuthology.task.internal:roles: ubuntu@gibba031.front.sepia.ceph.com - ['client.0'] 2021-11-15T19:13:18.558 INFO:teuthology.task.internal:roles: ubuntu@gibba018.front.sepia.ceph.com - ['client.1'] 2021-11-15T19:13:18.559 INFO:teuthology.task.internal:roles: ubuntu@gibba017.front.sepia.ceph.com - ['client.2'] 2021-11-15T19:13:18.559 INFO:teuthology.run_tasks:Running task console_log... 2021-11-15T19:13:18.790 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4a2ab3ea0>, signals=[15]) 2021-11-15T19:13:18.791 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-15T19:13:18.802 INFO:teuthology.task.internal:Opening connections... 2021-11-15T19:13:18.802 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:13:18.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:18.838 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:13:18.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:18.873 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba031.front.sepia.ceph.com 2021-11-15T19:13:18.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:18.907 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba018.front.sepia.ceph.com 2021-11-15T19:13:18.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:18.940 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba017.front.sepia.ceph.com 2021-11-15T19:13:18.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:13:18.975 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-15T19:13:18.985 DEBUG:teuthology.orchestra.run.gibba037:> uname -m 2021-11-15T19:13:18.994 INFO:teuthology.orchestra.run.gibba037.stdout:x86_64 2021-11-15T19:13:18.995 DEBUG:teuthology.orchestra.run.gibba037:> cat /etc/os-release 2021-11-15T19:13:19.039 INFO:teuthology.orchestra.run.gibba037.stdout:NAME="Ubuntu" 2021-11-15T19:13:19.039 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:19.040 INFO:teuthology.orchestra.run.gibba037.stdout:ID=ubuntu 2021-11-15T19:13:19.040 INFO:teuthology.orchestra.run.gibba037.stdout:ID_LIKE=debian 2021-11-15T19:13:19.040 INFO:teuthology.orchestra.run.gibba037.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:19.040 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION_ID="20.04" 2021-11-15T19:13:19.040 INFO:teuthology.orchestra.run.gibba037.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:19.041 INFO:teuthology.orchestra.run.gibba037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:19.041 INFO:teuthology.orchestra.run.gibba037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:19.041 INFO:teuthology.orchestra.run.gibba037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:19.041 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:19.041 INFO:teuthology.orchestra.run.gibba037.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:19.042 INFO:teuthology.lock.ops:Updating gibba037.front.sepia.ceph.com on lock server 2021-11-15T19:13:19.061 DEBUG:teuthology.orchestra.run.gibba011:> uname -m 2021-11-15T19:13:19.069 INFO:teuthology.orchestra.run.gibba011.stdout:x86_64 2021-11-15T19:13:19.070 DEBUG:teuthology.orchestra.run.gibba011:> cat /etc/os-release 2021-11-15T19:13:19.120 INFO:teuthology.orchestra.run.gibba011.stdout:NAME="Ubuntu" 2021-11-15T19:13:19.120 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:19.121 INFO:teuthology.orchestra.run.gibba011.stdout:ID=ubuntu 2021-11-15T19:13:19.121 INFO:teuthology.orchestra.run.gibba011.stdout:ID_LIKE=debian 2021-11-15T19:13:19.121 INFO:teuthology.orchestra.run.gibba011.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:19.121 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION_ID="20.04" 2021-11-15T19:13:19.122 INFO:teuthology.orchestra.run.gibba011.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:19.122 INFO:teuthology.orchestra.run.gibba011.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:19.122 INFO:teuthology.orchestra.run.gibba011.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:19.122 INFO:teuthology.orchestra.run.gibba011.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:19.122 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:19.123 INFO:teuthology.orchestra.run.gibba011.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:19.123 INFO:teuthology.lock.ops:Updating gibba011.front.sepia.ceph.com on lock server 2021-11-15T19:13:19.139 DEBUG:teuthology.orchestra.run.gibba031:> uname -m 2021-11-15T19:13:19.148 INFO:teuthology.orchestra.run.gibba031.stdout:x86_64 2021-11-15T19:13:19.149 DEBUG:teuthology.orchestra.run.gibba031:> cat /etc/os-release 2021-11-15T19:13:19.197 INFO:teuthology.orchestra.run.gibba031.stdout:NAME="Ubuntu" 2021-11-15T19:13:19.197 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:19.198 INFO:teuthology.orchestra.run.gibba031.stdout:ID=ubuntu 2021-11-15T19:13:19.198 INFO:teuthology.orchestra.run.gibba031.stdout:ID_LIKE=debian 2021-11-15T19:13:19.198 INFO:teuthology.orchestra.run.gibba031.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:19.198 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_ID="20.04" 2021-11-15T19:13:19.198 INFO:teuthology.orchestra.run.gibba031.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:19.199 INFO:teuthology.orchestra.run.gibba031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:19.199 INFO:teuthology.orchestra.run.gibba031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:19.199 INFO:teuthology.orchestra.run.gibba031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:19.199 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:19.200 INFO:teuthology.orchestra.run.gibba031.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:19.200 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server 2021-11-15T19:13:19.216 DEBUG:teuthology.orchestra.run.gibba018:> uname -m 2021-11-15T19:13:19.225 INFO:teuthology.orchestra.run.gibba018.stdout:x86_64 2021-11-15T19:13:19.225 DEBUG:teuthology.orchestra.run.gibba018:> cat /etc/os-release 2021-11-15T19:13:19.269 INFO:teuthology.orchestra.run.gibba018.stdout:NAME="Ubuntu" 2021-11-15T19:13:19.269 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:19.269 INFO:teuthology.orchestra.run.gibba018.stdout:ID=ubuntu 2021-11-15T19:13:19.270 INFO:teuthology.orchestra.run.gibba018.stdout:ID_LIKE=debian 2021-11-15T19:13:19.270 INFO:teuthology.orchestra.run.gibba018.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:19.270 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_ID="20.04" 2021-11-15T19:13:19.270 INFO:teuthology.orchestra.run.gibba018.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:19.271 INFO:teuthology.orchestra.run.gibba018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:19.271 INFO:teuthology.orchestra.run.gibba018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:19.271 INFO:teuthology.orchestra.run.gibba018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:19.271 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:19.271 INFO:teuthology.orchestra.run.gibba018.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:19.272 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server 2021-11-15T19:13:19.288 DEBUG:teuthology.orchestra.run.gibba017:> uname -m 2021-11-15T19:13:19.297 INFO:teuthology.orchestra.run.gibba017.stdout:x86_64 2021-11-15T19:13:19.298 DEBUG:teuthology.orchestra.run.gibba017:> cat /etc/os-release 2021-11-15T19:13:19.349 INFO:teuthology.orchestra.run.gibba017.stdout:NAME="Ubuntu" 2021-11-15T19:13:19.349 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T19:13:19.349 INFO:teuthology.orchestra.run.gibba017.stdout:ID=ubuntu 2021-11-15T19:13:19.350 INFO:teuthology.orchestra.run.gibba017.stdout:ID_LIKE=debian 2021-11-15T19:13:19.350 INFO:teuthology.orchestra.run.gibba017.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T19:13:19.350 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION_ID="20.04" 2021-11-15T19:13:19.350 INFO:teuthology.orchestra.run.gibba017.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T19:13:19.351 INFO:teuthology.orchestra.run.gibba017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T19:13:19.351 INFO:teuthology.orchestra.run.gibba017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T19:13:19.351 INFO:teuthology.orchestra.run.gibba017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T19:13:19.351 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION_CODENAME=focal 2021-11-15T19:13:19.351 INFO:teuthology.orchestra.run.gibba017.stdout:UBUNTU_CODENAME=focal 2021-11-15T19:13:19.352 INFO:teuthology.lock.ops:Updating gibba017.front.sepia.ceph.com on lock server 2021-11-15T19:13:19.368 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-15T19:13:19.413 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-15T19:13:19.550 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-15T19:13:19.551 DEBUG:teuthology.orchestra.run.gibba011:> test '!' -e /home/ubuntu/cephtest 2021-11-15T19:13:19.555 DEBUG:teuthology.orchestra.run.gibba017:> test '!' -e /home/ubuntu/cephtest 2021-11-15T19:13:19.558 DEBUG:teuthology.orchestra.run.gibba018:> test '!' -e /home/ubuntu/cephtest 2021-11-15T19:13:19.562 DEBUG:teuthology.orchestra.run.gibba031:> test '!' -e /home/ubuntu/cephtest 2021-11-15T19:13:19.565 DEBUG:teuthology.orchestra.run.gibba037:> test '!' -e /home/ubuntu/cephtest 2021-11-15T19:13:19.573 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-15T19:13:19.641 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-15T19:13:19.641 DEBUG:teuthology.orchestra.run.gibba011:> test -z $(ls -A /var/lib/ceph) 2021-11-15T19:13:19.644 DEBUG:teuthology.orchestra.run.gibba017:> test -z $(ls -A /var/lib/ceph) 2021-11-15T19:13:19.647 DEBUG:teuthology.orchestra.run.gibba018:> test -z $(ls -A /var/lib/ceph) 2021-11-15T19:13:19.650 DEBUG:teuthology.orchestra.run.gibba031:> test -z $(ls -A /var/lib/ceph) 2021-11-15T19:13:19.653 DEBUG:teuthology.orchestra.run.gibba037:> test -z $(ls -A /var/lib/ceph) 2021-11-15T19:13:19.671 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-15T19:13:19.829 INFO:teuthology.run_tasks:Running task kernel... 2021-11-15T19:13:19.850 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-15T19:13:19.851 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-15T19:13:19.851 DEBUG:teuthology.orchestra.run.gibba037:> uname -r 2021-11-15T19:13:19.860 INFO:teuthology.orchestra.run.gibba037.stdout:5.4.0-88-generic 2021-11-15T19:13:19.860 INFO:teuthology.task.kernel:Running kernel on gibba037: 5.4.0-88-generic 2021-11-15T19:13:19.861 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get clean 2021-11-15T19:13:19.970 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get update 2021-11-15T19:13:20.159 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T19:13:20.357 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:13:20.368 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T19:13:20.439 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T19:13:20.455 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T19:13:20.459 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T19:13:20.461 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T19:13:20.461 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T19:13:20.467 INFO:teuthology.orchestra.run.gibba037.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T19:13:20.468 INFO:teuthology.orchestra.run.gibba037.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T19:13:20.472 INFO:teuthology.orchestra.run.gibba037.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:13:20.473 INFO:teuthology.orchestra.run.gibba037.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T19:13:20.478 INFO:teuthology.orchestra.run.gibba037.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T19:13:20.485 INFO:teuthology.orchestra.run.gibba037.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T19:13:20.486 INFO:teuthology.orchestra.run.gibba037.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T19:13:20.495 INFO:teuthology.orchestra.run.gibba037.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T19:13:20.495 INFO:teuthology.orchestra.run.gibba037.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T19:13:20.495 INFO:teuthology.orchestra.run.gibba037.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T19:13:20.778 INFO:teuthology.orchestra.run.gibba037.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T19:13:20.889 INFO:teuthology.orchestra.run.gibba037.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [563 kB] 2021-11-15T19:13:21.059 INFO:teuthology.orchestra.run.gibba037.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T19:13:21.193 INFO:teuthology.orchestra.run.gibba037.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T19:13:21.207 INFO:teuthology.orchestra.run.gibba037.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T19:13:21.207 INFO:teuthology.orchestra.run.gibba037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T19:13:21.208 INFO:teuthology.orchestra.run.gibba037.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T19:13:21.234 INFO:teuthology.orchestra.run.gibba037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T19:13:21.238 INFO:teuthology.orchestra.run.gibba037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:13:21.238 INFO:teuthology.orchestra.run.gibba037.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T19:13:21.279 INFO:teuthology.orchestra.run.gibba037.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T19:13:21.304 INFO:teuthology.orchestra.run.gibba037.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T19:13:21.307 INFO:teuthology.orchestra.run.gibba037.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T19:13:21.321 INFO:teuthology.orchestra.run.gibba037.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T19:13:21.321 INFO:teuthology.orchestra.run.gibba037.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T19:13:21.321 INFO:teuthology.orchestra.run.gibba037.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T19:13:21.321 INFO:teuthology.orchestra.run.gibba037.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T19:13:21.322 INFO:teuthology.orchestra.run.gibba037.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T19:13:21.360 INFO:teuthology.orchestra.run.gibba037.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T19:13:21.444 INFO:teuthology.orchestra.run.gibba037.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T19:13:21.444 INFO:teuthology.orchestra.run.gibba037.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T19:13:23.313 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 8,407 kB in 2s (5,492 kB/s) 2021-11-15T19:13:24.261 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:13:24.272 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:13:24.308 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:13:24.409 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-11-15T19:13:24.409 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-11-15T19:13:24.491 INFO:teuthology.orchestra.run.gibba037.stdout:The following package was automatically installed and is no longer required: 2021-11-15T19:13:24.491 INFO:teuthology.orchestra.run.gibba037.stdout: libllvm11 2021-11-15T19:13:24.492 INFO:teuthology.orchestra.run.gibba037.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T19:13:24.492 INFO:teuthology.orchestra.run.gibba037.stdout:The following additional packages will be installed: 2021-11-15T19:13:24.492 INFO:teuthology.orchestra.run.gibba037.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:13:24.492 INFO:teuthology.orchestra.run.gibba037.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T19:13:24.493 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T19:13:24.494 INFO:teuthology.orchestra.run.gibba037.stdout:Suggested packages: 2021-11-15T19:13:24.494 INFO:teuthology.orchestra.run.gibba037.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T19:13:24.494 INFO:teuthology.orchestra.run.gibba037.stdout:Recommended packages: 2021-11-15T19:13:24.495 INFO:teuthology.orchestra.run.gibba037.stdout: thermald 2021-11-15T19:13:24.545 INFO:teuthology.orchestra.run.gibba037.stdout:The following NEW packages will be installed: 2021-11-15T19:13:24.545 INFO:teuthology.orchestra.run.gibba037.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:13:24.545 INFO:teuthology.orchestra.run.gibba037.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T19:13:24.545 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T19:13:24.546 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages will be upgraded: 2021-11-15T19:13:24.546 INFO:teuthology.orchestra.run.gibba037.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T19:13:24.722 INFO:teuthology.orchestra.run.gibba037.stdout:3 upgraded, 5 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:13:24.723 INFO:teuthology.orchestra.run.gibba037.stdout:Need to get 75.6 MB of archives. 2021-11-15T19:13:24.723 INFO:teuthology.orchestra.run.gibba037.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T19:13:24.723 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T19:13:25.824 INFO:teuthology.orchestra.run.gibba037.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T19:13:26.076 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T19:13:27.381 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T19:13:27.382 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T19:13:27.383 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T19:13:27.859 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T19:13:28.505 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T19:13:28.739 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 75.6 MB in 4s (19.1 MB/s) 2021-11-15T19:13:28.876 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T19:13:30.994 INFO:teuthology.orchestra.run.gibba037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T19:13:31.004 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:13:31.050 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:32.333 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T19:13:32.342 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:13:32.438 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:33.310 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T19:13:33.336 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:13:33.377 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:36.267 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:13:36.411 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:13:36.724 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:13:36.848 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:13:37.175 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T19:13:37.184 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T19:13:37.224 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:13:40.904 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T19:13:40.943 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:13:40.987 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:42.555 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:13:42.682 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:13:43.012 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:13:43.119 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:43.904 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:44.030 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T19:13:44.156 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:44.859 INFO:teuthology.orchestra.run.gibba037.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:13:44.859 INFO:teuthology.orchestra.run.gibba037.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T19:13:44.859 INFO:teuthology.orchestra.run.gibba037.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:13:44.860 INFO:teuthology.orchestra.run.gibba037.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T19:13:44.967 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:45.709 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T19:13:45.819 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T19:13:45.945 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:13:46.089 INFO:teuthology.orchestra.run.gibba037.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T19:13:46.089 INFO:teuthology.orchestra.run.gibba037.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:14:05.669 INFO:teuthology.orchestra.run.gibba037.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T19:14:05.669 INFO:teuthology.orchestra.run.gibba037.stdout:Sourcing file `/etc/default/grub' 2021-11-15T19:14:05.683 INFO:teuthology.orchestra.run.gibba037.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:14:05.719 INFO:teuthology.orchestra.run.gibba037.stdout:Generating grub configuration file ... 2021-11-15T19:14:06.074 INFO:teuthology.orchestra.run.gibba037.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:14:06.104 INFO:teuthology.orchestra.run.gibba037.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:14:06.530 INFO:teuthology.orchestra.run.gibba037.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:14:06.544 INFO:teuthology.orchestra.run.gibba037.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:14:06.679 INFO:teuthology.orchestra.run.gibba037.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:14:06.693 INFO:teuthology.orchestra.run.gibba037.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:14:09.424 INFO:teuthology.orchestra.run.gibba037.stdout:done 2021-11-15T19:14:09.661 DEBUG:teuthology.orchestra.run.gibba037:> dpkg -s linux-image-generic 2021-11-15T19:14:09.675 INFO:teuthology.orchestra.run.gibba037.stdout:Package: linux-image-generic 2021-11-15T19:14:09.676 INFO:teuthology.orchestra.run.gibba037.stdout:Status: install ok installed 2021-11-15T19:14:09.676 INFO:teuthology.orchestra.run.gibba037.stdout:Priority: optional 2021-11-15T19:14:09.676 INFO:teuthology.orchestra.run.gibba037.stdout:Section: kernel 2021-11-15T19:14:09.676 INFO:teuthology.orchestra.run.gibba037.stdout:Installed-Size: 18 2021-11-15T19:14:09.676 INFO:teuthology.orchestra.run.gibba037.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:14:09.677 INFO:teuthology.orchestra.run.gibba037.stdout:Architecture: amd64 2021-11-15T19:14:09.677 INFO:teuthology.orchestra.run.gibba037.stdout:Source: linux-meta 2021-11-15T19:14:09.677 INFO:teuthology.orchestra.run.gibba037.stdout:Version: 5.4.0.90.94 2021-11-15T19:14:09.677 INFO:teuthology.orchestra.run.gibba037.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:14:09.678 INFO:teuthology.orchestra.run.gibba037.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:14:09.678 INFO:teuthology.orchestra.run.gibba037.stdout:Recommends: thermald 2021-11-15T19:14:09.678 INFO:teuthology.orchestra.run.gibba037.stdout:Description: Generic Linux kernel image 2021-11-15T19:14:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:14:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: available. 2021-11-15T19:14:09.679 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T19:14:09.679 DEBUG:teuthology.orchestra.run.gibba011:> uname -r 2021-11-15T19:14:09.683 INFO:teuthology.orchestra.run.gibba011.stdout:5.4.0-88-generic 2021-11-15T19:14:09.684 INFO:teuthology.task.kernel:Running kernel on gibba011: 5.4.0-88-generic 2021-11-15T19:14:09.684 DEBUG:teuthology.orchestra.run.gibba011:> sudo apt-get clean 2021-11-15T19:14:09.771 DEBUG:teuthology.orchestra.run.gibba011:> sudo apt-get update 2021-11-15T19:14:09.972 INFO:teuthology.orchestra.run.gibba011.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T19:14:10.005 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:14:10.077 INFO:teuthology.orchestra.run.gibba011.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T19:14:10.266 INFO:teuthology.orchestra.run.gibba011.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T19:14:10.325 INFO:teuthology.orchestra.run.gibba011.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T19:14:10.360 INFO:teuthology.orchestra.run.gibba011.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T19:14:10.362 INFO:teuthology.orchestra.run.gibba011.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T19:14:10.363 INFO:teuthology.orchestra.run.gibba011.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T19:14:10.363 INFO:teuthology.orchestra.run.gibba011.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T19:14:10.371 INFO:teuthology.orchestra.run.gibba011.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T19:14:10.372 INFO:teuthology.orchestra.run.gibba011.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:14:10.372 INFO:teuthology.orchestra.run.gibba011.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T19:14:10.380 INFO:teuthology.orchestra.run.gibba011.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T19:14:10.384 INFO:teuthology.orchestra.run.gibba011.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T19:14:10.385 INFO:teuthology.orchestra.run.gibba011.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T19:14:10.396 INFO:teuthology.orchestra.run.gibba011.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T19:14:10.396 INFO:teuthology.orchestra.run.gibba011.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T19:14:10.396 INFO:teuthology.orchestra.run.gibba011.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T19:14:10.420 INFO:teuthology.orchestra.run.gibba011.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T19:14:10.528 INFO:teuthology.orchestra.run.gibba011.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [563 kB] 2021-11-15T19:14:10.692 INFO:teuthology.orchestra.run.gibba011.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T19:14:10.815 INFO:teuthology.orchestra.run.gibba011.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T19:14:10.830 INFO:teuthology.orchestra.run.gibba011.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T19:14:10.831 INFO:teuthology.orchestra.run.gibba011.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T19:14:10.832 INFO:teuthology.orchestra.run.gibba011.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T19:14:10.863 INFO:teuthology.orchestra.run.gibba011.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T19:14:10.866 INFO:teuthology.orchestra.run.gibba011.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:14:10.866 INFO:teuthology.orchestra.run.gibba011.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T19:14:10.894 INFO:teuthology.orchestra.run.gibba011.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T19:14:10.929 INFO:teuthology.orchestra.run.gibba011.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T19:14:10.933 INFO:teuthology.orchestra.run.gibba011.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T19:14:10.961 INFO:teuthology.orchestra.run.gibba011.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T19:14:10.962 INFO:teuthology.orchestra.run.gibba011.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T19:14:10.963 INFO:teuthology.orchestra.run.gibba011.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T19:14:10.963 INFO:teuthology.orchestra.run.gibba011.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T19:14:10.963 INFO:teuthology.orchestra.run.gibba011.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T19:14:10.982 INFO:teuthology.orchestra.run.gibba011.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T19:14:10.982 INFO:teuthology.orchestra.run.gibba011.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T19:14:11.064 INFO:teuthology.orchestra.run.gibba011.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T19:14:13.070 INFO:teuthology.orchestra.run.gibba011.stdout:Fetched 8,407 kB in 1s (6,213 kB/s) 2021-11-15T19:14:14.049 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:14:14.060 DEBUG:teuthology.orchestra.run.gibba011:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:14:14.096 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:14:14.200 INFO:teuthology.orchestra.run.gibba011.stdout:Building dependency tree... 2021-11-15T19:14:14.201 INFO:teuthology.orchestra.run.gibba011.stdout:Reading state information... 2021-11-15T19:14:14.284 INFO:teuthology.orchestra.run.gibba011.stdout:The following package was automatically installed and is no longer required: 2021-11-15T19:14:14.284 INFO:teuthology.orchestra.run.gibba011.stdout: libllvm11 2021-11-15T19:14:14.285 INFO:teuthology.orchestra.run.gibba011.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T19:14:14.285 INFO:teuthology.orchestra.run.gibba011.stdout:The following additional packages will be installed: 2021-11-15T19:14:14.286 INFO:teuthology.orchestra.run.gibba011.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:14:14.286 INFO:teuthology.orchestra.run.gibba011.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T19:14:14.286 INFO:teuthology.orchestra.run.gibba011.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T19:14:14.286 INFO:teuthology.orchestra.run.gibba011.stdout:Suggested packages: 2021-11-15T19:14:14.287 INFO:teuthology.orchestra.run.gibba011.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T19:14:14.287 INFO:teuthology.orchestra.run.gibba011.stdout:Recommended packages: 2021-11-15T19:14:14.287 INFO:teuthology.orchestra.run.gibba011.stdout: thermald 2021-11-15T19:14:14.318 INFO:teuthology.orchestra.run.gibba011.stdout:The following NEW packages will be installed: 2021-11-15T19:14:14.318 INFO:teuthology.orchestra.run.gibba011.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:14:14.318 INFO:teuthology.orchestra.run.gibba011.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T19:14:14.318 INFO:teuthology.orchestra.run.gibba011.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T19:14:14.319 INFO:teuthology.orchestra.run.gibba011.stdout:The following packages will be upgraded: 2021-11-15T19:14:14.319 INFO:teuthology.orchestra.run.gibba011.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T19:14:14.491 INFO:teuthology.orchestra.run.gibba011.stdout:3 upgraded, 5 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:14:14.492 INFO:teuthology.orchestra.run.gibba011.stdout:Need to get 75.6 MB of archives. 2021-11-15T19:14:14.492 INFO:teuthology.orchestra.run.gibba011.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T19:14:14.492 INFO:teuthology.orchestra.run.gibba011.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T19:14:15.626 INFO:teuthology.orchestra.run.gibba011.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T19:14:15.881 INFO:teuthology.orchestra.run.gibba011.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T19:14:17.160 INFO:teuthology.orchestra.run.gibba011.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T19:14:17.161 INFO:teuthology.orchestra.run.gibba011.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T19:14:17.161 INFO:teuthology.orchestra.run.gibba011.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T19:14:17.507 INFO:teuthology.orchestra.run.gibba011.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T19:14:17.516 INFO:teuthology.orchestra.run.gibba011.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T19:14:17.760 INFO:teuthology.orchestra.run.gibba011.stdout:Fetched 75.6 MB in 3s (23.7 MB/s) 2021-11-15T19:14:17.916 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T19:14:19.878 INFO:teuthology.orchestra.run.gibba011.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T19:14:19.888 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:14:19.948 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:21.371 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T19:14:21.378 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:14:21.481 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:22.374 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T19:14:22.399 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:14:22.440 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:25.396 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:14:25.523 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:14:25.903 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:14:26.045 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:14:26.379 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T19:14:26.388 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T19:14:26.445 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:14:30.111 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T19:14:30.150 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:14:30.193 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:31.738 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:14:31.884 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:14:32.245 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:14:32.354 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:33.139 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:33.265 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T19:14:33.424 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:34.142 INFO:teuthology.orchestra.run.gibba011.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:14:34.142 INFO:teuthology.orchestra.run.gibba011.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T19:14:34.142 INFO:teuthology.orchestra.run.gibba011.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:14:34.143 INFO:teuthology.orchestra.run.gibba011.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T19:14:34.285 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:35.019 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T19:14:35.120 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T19:14:35.221 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:14:35.372 INFO:teuthology.orchestra.run.gibba011.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T19:14:35.373 INFO:teuthology.orchestra.run.gibba011.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:14:54.304 INFO:teuthology.orchestra.run.gibba011.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T19:14:54.305 INFO:teuthology.orchestra.run.gibba011.stdout:Sourcing file `/etc/default/grub' 2021-11-15T19:14:54.314 INFO:teuthology.orchestra.run.gibba011.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:14:54.337 INFO:teuthology.orchestra.run.gibba011.stdout:Generating grub configuration file ... 2021-11-15T19:14:54.714 INFO:teuthology.orchestra.run.gibba011.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:14:54.749 INFO:teuthology.orchestra.run.gibba011.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:14:55.213 INFO:teuthology.orchestra.run.gibba011.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:14:55.227 INFO:teuthology.orchestra.run.gibba011.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:14:55.370 INFO:teuthology.orchestra.run.gibba011.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:14:55.384 INFO:teuthology.orchestra.run.gibba011.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:14:58.138 INFO:teuthology.orchestra.run.gibba011.stdout:done 2021-11-15T19:14:58.415 DEBUG:teuthology.orchestra.run.gibba011:> dpkg -s linux-image-generic 2021-11-15T19:14:58.434 INFO:teuthology.orchestra.run.gibba011.stdout:Package: linux-image-generic 2021-11-15T19:14:58.434 INFO:teuthology.orchestra.run.gibba011.stdout:Status: install ok installed 2021-11-15T19:14:58.434 INFO:teuthology.orchestra.run.gibba011.stdout:Priority: optional 2021-11-15T19:14:58.434 INFO:teuthology.orchestra.run.gibba011.stdout:Section: kernel 2021-11-15T19:14:58.435 INFO:teuthology.orchestra.run.gibba011.stdout:Installed-Size: 18 2021-11-15T19:14:58.435 INFO:teuthology.orchestra.run.gibba011.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:14:58.435 INFO:teuthology.orchestra.run.gibba011.stdout:Architecture: amd64 2021-11-15T19:14:58.436 INFO:teuthology.orchestra.run.gibba011.stdout:Source: linux-meta 2021-11-15T19:14:58.436 INFO:teuthology.orchestra.run.gibba011.stdout:Version: 5.4.0.90.94 2021-11-15T19:14:58.437 INFO:teuthology.orchestra.run.gibba011.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:14:58.437 INFO:teuthology.orchestra.run.gibba011.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:14:58.437 INFO:teuthology.orchestra.run.gibba011.stdout:Recommends: thermald 2021-11-15T19:14:58.437 INFO:teuthology.orchestra.run.gibba011.stdout:Description: Generic Linux kernel image 2021-11-15T19:14:58.438 INFO:teuthology.orchestra.run.gibba011.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:14:58.438 INFO:teuthology.orchestra.run.gibba011.stdout: available. 2021-11-15T19:14:58.438 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T19:14:58.438 DEBUG:teuthology.orchestra.run.gibba031:> uname -r 2021-11-15T19:14:58.447 INFO:teuthology.orchestra.run.gibba031.stdout:5.4.0-88-generic 2021-11-15T19:14:58.448 INFO:teuthology.task.kernel:Running kernel on gibba031: 5.4.0-88-generic 2021-11-15T19:14:58.448 DEBUG:teuthology.orchestra.run.gibba031:> sudo apt-get clean 2021-11-15T19:14:58.584 DEBUG:teuthology.orchestra.run.gibba031:> sudo apt-get update 2021-11-15T19:14:58.876 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:14:58.876 INFO:teuthology.orchestra.run.gibba031.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T19:14:58.946 INFO:teuthology.orchestra.run.gibba031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T19:14:59.260 INFO:teuthology.orchestra.run.gibba031.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T19:14:59.287 INFO:teuthology.orchestra.run.gibba031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T19:14:59.407 INFO:teuthology.orchestra.run.gibba031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T19:14:59.621 INFO:teuthology.orchestra.run.gibba031.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T19:14:59.637 INFO:teuthology.orchestra.run.gibba031.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T19:14:59.646 INFO:teuthology.orchestra.run.gibba031.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T19:14:59.647 INFO:teuthology.orchestra.run.gibba031.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T19:14:59.648 INFO:teuthology.orchestra.run.gibba031.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T19:14:59.676 INFO:teuthology.orchestra.run.gibba031.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [563 kB] 2021-11-15T19:14:59.677 INFO:teuthology.orchestra.run.gibba031.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T19:14:59.704 INFO:teuthology.orchestra.run.gibba031.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:14:59.705 INFO:teuthology.orchestra.run.gibba031.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T19:14:59.714 INFO:teuthology.orchestra.run.gibba031.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T19:14:59.726 INFO:teuthology.orchestra.run.gibba031.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T19:14:59.727 INFO:teuthology.orchestra.run.gibba031.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T19:14:59.728 INFO:teuthology.orchestra.run.gibba031.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T19:14:59.732 INFO:teuthology.orchestra.run.gibba031.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T19:14:59.752 INFO:teuthology.orchestra.run.gibba031.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T19:14:59.760 INFO:teuthology.orchestra.run.gibba031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:14:59.761 INFO:teuthology.orchestra.run.gibba031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T19:14:59.764 INFO:teuthology.orchestra.run.gibba031.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T19:14:59.769 INFO:teuthology.orchestra.run.gibba031.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T19:14:59.783 INFO:teuthology.orchestra.run.gibba031.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T19:14:59.804 INFO:teuthology.orchestra.run.gibba031.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T19:14:59.804 INFO:teuthology.orchestra.run.gibba031.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T19:14:59.805 INFO:teuthology.orchestra.run.gibba031.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T19:14:59.809 INFO:teuthology.orchestra.run.gibba031.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T19:14:59.840 INFO:teuthology.orchestra.run.gibba031.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T19:14:59.841 INFO:teuthology.orchestra.run.gibba031.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T19:14:59.841 INFO:teuthology.orchestra.run.gibba031.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T19:14:59.842 INFO:teuthology.orchestra.run.gibba031.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T19:14:59.842 INFO:teuthology.orchestra.run.gibba031.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T19:14:59.923 INFO:teuthology.orchestra.run.gibba031.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T19:14:59.923 INFO:teuthology.orchestra.run.gibba031.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T19:14:59.923 INFO:teuthology.orchestra.run.gibba031.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T19:14:59.923 INFO:teuthology.orchestra.run.gibba031.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T19:15:01.975 INFO:teuthology.orchestra.run.gibba031.stdout:Fetched 8,407 kB in 2s (5,251 kB/s) 2021-11-15T19:15:02.943 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:15:02.954 DEBUG:teuthology.orchestra.run.gibba031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:15:02.990 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:15:03.094 INFO:teuthology.orchestra.run.gibba031.stdout:Building dependency tree... 2021-11-15T19:15:03.095 INFO:teuthology.orchestra.run.gibba031.stdout:Reading state information... 2021-11-15T19:15:03.175 INFO:teuthology.orchestra.run.gibba031.stdout:The following package was automatically installed and is no longer required: 2021-11-15T19:15:03.176 INFO:teuthology.orchestra.run.gibba031.stdout: libllvm11 2021-11-15T19:15:03.176 INFO:teuthology.orchestra.run.gibba031.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T19:15:03.176 INFO:teuthology.orchestra.run.gibba031.stdout:The following additional packages will be installed: 2021-11-15T19:15:03.177 INFO:teuthology.orchestra.run.gibba031.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:15:03.177 INFO:teuthology.orchestra.run.gibba031.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T19:15:03.177 INFO:teuthology.orchestra.run.gibba031.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T19:15:03.178 INFO:teuthology.orchestra.run.gibba031.stdout:Suggested packages: 2021-11-15T19:15:03.178 INFO:teuthology.orchestra.run.gibba031.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T19:15:03.178 INFO:teuthology.orchestra.run.gibba031.stdout:Recommended packages: 2021-11-15T19:15:03.178 INFO:teuthology.orchestra.run.gibba031.stdout: thermald 2021-11-15T19:15:03.200 INFO:teuthology.orchestra.run.gibba031.stdout:The following NEW packages will be installed: 2021-11-15T19:15:03.201 INFO:teuthology.orchestra.run.gibba031.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:15:03.201 INFO:teuthology.orchestra.run.gibba031.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T19:15:03.201 INFO:teuthology.orchestra.run.gibba031.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T19:15:03.201 INFO:teuthology.orchestra.run.gibba031.stdout:The following packages will be upgraded: 2021-11-15T19:15:03.202 INFO:teuthology.orchestra.run.gibba031.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T19:15:03.385 INFO:teuthology.orchestra.run.gibba031.stdout:3 upgraded, 5 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:15:03.385 INFO:teuthology.orchestra.run.gibba031.stdout:Need to get 75.6 MB of archives. 2021-11-15T19:15:03.385 INFO:teuthology.orchestra.run.gibba031.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T19:15:03.386 INFO:teuthology.orchestra.run.gibba031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T19:15:04.507 INFO:teuthology.orchestra.run.gibba031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T19:15:04.723 INFO:teuthology.orchestra.run.gibba031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T19:15:05.976 INFO:teuthology.orchestra.run.gibba031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T19:15:05.976 INFO:teuthology.orchestra.run.gibba031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T19:15:05.977 INFO:teuthology.orchestra.run.gibba031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T19:15:06.294 INFO:teuthology.orchestra.run.gibba031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T19:15:06.303 INFO:teuthology.orchestra.run.gibba031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T19:15:06.522 INFO:teuthology.orchestra.run.gibba031.stdout:Fetched 75.6 MB in 3s (24.4 MB/s) 2021-11-15T19:15:06.668 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T19:15:08.716 INFO:teuthology.orchestra.run.gibba031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T19:15:08.725 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:08.775 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:10.166 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T19:15:10.174 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:10.266 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:11.128 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T19:15:11.150 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:11.194 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:14.093 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:15:14.213 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:15:14.492 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:15:14.617 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:15:14.961 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T19:15:14.985 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T19:15:15.028 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:15:18.436 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T19:15:18.476 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:18.519 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:20.205 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:15:20.333 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:15:20.673 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:15:20.796 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:21.598 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:21.741 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T19:15:21.866 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:22.567 INFO:teuthology.orchestra.run.gibba031.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:15:22.567 INFO:teuthology.orchestra.run.gibba031.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T19:15:22.567 INFO:teuthology.orchestra.run.gibba031.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:15:22.568 INFO:teuthology.orchestra.run.gibba031.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T19:15:22.685 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:23.462 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T19:15:23.588 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T19:15:23.715 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:23.829 INFO:teuthology.orchestra.run.gibba031.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T19:15:23.829 INFO:teuthology.orchestra.run.gibba031.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:15:41.450 INFO:teuthology.orchestra.run.gibba031.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T19:15:41.450 INFO:teuthology.orchestra.run.gibba031.stdout:Sourcing file `/etc/default/grub' 2021-11-15T19:15:41.464 INFO:teuthology.orchestra.run.gibba031.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:15:41.497 INFO:teuthology.orchestra.run.gibba031.stdout:Generating grub configuration file ... 2021-11-15T19:15:41.838 INFO:teuthology.orchestra.run.gibba031.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:15:41.870 INFO:teuthology.orchestra.run.gibba031.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:15:42.251 INFO:teuthology.orchestra.run.gibba031.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:15:42.261 INFO:teuthology.orchestra.run.gibba031.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:15:42.363 INFO:teuthology.orchestra.run.gibba031.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:15:42.374 INFO:teuthology.orchestra.run.gibba031.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:15:44.971 INFO:teuthology.orchestra.run.gibba031.stdout:done 2021-11-15T19:15:45.303 DEBUG:teuthology.orchestra.run.gibba031:> dpkg -s linux-image-generic 2021-11-15T19:15:45.315 INFO:teuthology.orchestra.run.gibba031.stdout:Package: linux-image-generic 2021-11-15T19:15:45.315 INFO:teuthology.orchestra.run.gibba031.stdout:Status: install ok installed 2021-11-15T19:15:45.316 INFO:teuthology.orchestra.run.gibba031.stdout:Priority: optional 2021-11-15T19:15:45.316 INFO:teuthology.orchestra.run.gibba031.stdout:Section: kernel 2021-11-15T19:15:45.316 INFO:teuthology.orchestra.run.gibba031.stdout:Installed-Size: 18 2021-11-15T19:15:45.316 INFO:teuthology.orchestra.run.gibba031.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:15:45.316 INFO:teuthology.orchestra.run.gibba031.stdout:Architecture: amd64 2021-11-15T19:15:45.317 INFO:teuthology.orchestra.run.gibba031.stdout:Source: linux-meta 2021-11-15T19:15:45.317 INFO:teuthology.orchestra.run.gibba031.stdout:Version: 5.4.0.90.94 2021-11-15T19:15:45.317 INFO:teuthology.orchestra.run.gibba031.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:15:45.317 INFO:teuthology.orchestra.run.gibba031.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:15:45.318 INFO:teuthology.orchestra.run.gibba031.stdout:Recommends: thermald 2021-11-15T19:15:45.318 INFO:teuthology.orchestra.run.gibba031.stdout:Description: Generic Linux kernel image 2021-11-15T19:15:45.318 INFO:teuthology.orchestra.run.gibba031.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:15:45.318 INFO:teuthology.orchestra.run.gibba031.stdout: available. 2021-11-15T19:15:45.319 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T19:15:45.320 DEBUG:teuthology.orchestra.run.gibba018:> uname -r 2021-11-15T19:15:45.329 INFO:teuthology.orchestra.run.gibba018.stdout:5.4.0-88-generic 2021-11-15T19:15:45.329 INFO:teuthology.task.kernel:Running kernel on gibba018: 5.4.0-88-generic 2021-11-15T19:15:45.329 DEBUG:teuthology.orchestra.run.gibba018:> sudo apt-get clean 2021-11-15T19:15:45.413 DEBUG:teuthology.orchestra.run.gibba018:> sudo apt-get update 2021-11-15T19:15:45.676 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:15:45.682 INFO:teuthology.orchestra.run.gibba018.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T19:15:45.737 INFO:teuthology.orchestra.run.gibba018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T19:15:46.065 INFO:teuthology.orchestra.run.gibba018.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T19:15:46.084 INFO:teuthology.orchestra.run.gibba018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T19:15:46.207 INFO:teuthology.orchestra.run.gibba018.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T19:15:46.276 INFO:teuthology.orchestra.run.gibba018.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T19:15:46.438 INFO:teuthology.orchestra.run.gibba018.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T19:15:46.450 INFO:teuthology.orchestra.run.gibba018.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T19:15:46.452 INFO:teuthology.orchestra.run.gibba018.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T19:15:46.453 INFO:teuthology.orchestra.run.gibba018.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T19:15:46.465 INFO:teuthology.orchestra.run.gibba018.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [563 kB] 2021-11-15T19:15:46.489 INFO:teuthology.orchestra.run.gibba018.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T19:15:46.494 INFO:teuthology.orchestra.run.gibba018.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:15:46.494 INFO:teuthology.orchestra.run.gibba018.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T19:15:46.503 INFO:teuthology.orchestra.run.gibba018.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T19:15:46.519 INFO:teuthology.orchestra.run.gibba018.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T19:15:46.520 INFO:teuthology.orchestra.run.gibba018.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T19:15:46.530 INFO:teuthology.orchestra.run.gibba018.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T19:15:46.547 INFO:teuthology.orchestra.run.gibba018.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T19:15:46.548 INFO:teuthology.orchestra.run.gibba018.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T19:15:46.549 INFO:teuthology.orchestra.run.gibba018.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T19:15:46.550 INFO:teuthology.orchestra.run.gibba018.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T19:15:46.552 INFO:teuthology.orchestra.run.gibba018.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:15:46.552 INFO:teuthology.orchestra.run.gibba018.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T19:15:46.571 INFO:teuthology.orchestra.run.gibba018.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T19:15:46.600 INFO:teuthology.orchestra.run.gibba018.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T19:15:46.605 INFO:teuthology.orchestra.run.gibba018.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T19:15:46.605 INFO:teuthology.orchestra.run.gibba018.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T19:15:46.606 INFO:teuthology.orchestra.run.gibba018.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T19:15:46.633 INFO:teuthology.orchestra.run.gibba018.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T19:15:46.633 INFO:teuthology.orchestra.run.gibba018.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T19:15:46.634 INFO:teuthology.orchestra.run.gibba018.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T19:15:46.634 INFO:teuthology.orchestra.run.gibba018.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T19:15:46.634 INFO:teuthology.orchestra.run.gibba018.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T19:15:46.715 INFO:teuthology.orchestra.run.gibba018.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T19:15:46.715 INFO:teuthology.orchestra.run.gibba018.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T19:15:46.716 INFO:teuthology.orchestra.run.gibba018.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T19:15:46.716 INFO:teuthology.orchestra.run.gibba018.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T19:15:48.992 INFO:teuthology.orchestra.run.gibba018.stdout:Fetched 8,407 kB in 2s (5,020 kB/s) 2021-11-15T19:15:50.092 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:15:50.103 DEBUG:teuthology.orchestra.run.gibba018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:15:50.139 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:15:50.240 INFO:teuthology.orchestra.run.gibba018.stdout:Building dependency tree... 2021-11-15T19:15:50.241 INFO:teuthology.orchestra.run.gibba018.stdout:Reading state information... 2021-11-15T19:15:50.319 INFO:teuthology.orchestra.run.gibba018.stdout:The following package was automatically installed and is no longer required: 2021-11-15T19:15:50.319 INFO:teuthology.orchestra.run.gibba018.stdout: libllvm11 2021-11-15T19:15:50.320 INFO:teuthology.orchestra.run.gibba018.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T19:15:50.320 INFO:teuthology.orchestra.run.gibba018.stdout:The following additional packages will be installed: 2021-11-15T19:15:50.320 INFO:teuthology.orchestra.run.gibba018.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:15:50.320 INFO:teuthology.orchestra.run.gibba018.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T19:15:50.321 INFO:teuthology.orchestra.run.gibba018.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T19:15:50.321 INFO:teuthology.orchestra.run.gibba018.stdout:Suggested packages: 2021-11-15T19:15:50.321 INFO:teuthology.orchestra.run.gibba018.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T19:15:50.321 INFO:teuthology.orchestra.run.gibba018.stdout:Recommended packages: 2021-11-15T19:15:50.321 INFO:teuthology.orchestra.run.gibba018.stdout: thermald 2021-11-15T19:15:50.352 INFO:teuthology.orchestra.run.gibba018.stdout:The following NEW packages will be installed: 2021-11-15T19:15:50.352 INFO:teuthology.orchestra.run.gibba018.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:15:50.353 INFO:teuthology.orchestra.run.gibba018.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T19:15:50.353 INFO:teuthology.orchestra.run.gibba018.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T19:15:50.354 INFO:teuthology.orchestra.run.gibba018.stdout:The following packages will be upgraded: 2021-11-15T19:15:50.354 INFO:teuthology.orchestra.run.gibba018.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T19:15:50.525 INFO:teuthology.orchestra.run.gibba018.stdout:3 upgraded, 5 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:15:50.526 INFO:teuthology.orchestra.run.gibba018.stdout:Need to get 75.6 MB of archives. 2021-11-15T19:15:50.526 INFO:teuthology.orchestra.run.gibba018.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T19:15:50.526 INFO:teuthology.orchestra.run.gibba018.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T19:15:51.651 INFO:teuthology.orchestra.run.gibba018.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T19:15:51.906 INFO:teuthology.orchestra.run.gibba018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T19:15:53.168 INFO:teuthology.orchestra.run.gibba018.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T19:15:53.233 INFO:teuthology.orchestra.run.gibba018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T19:15:53.234 INFO:teuthology.orchestra.run.gibba018.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T19:15:53.549 INFO:teuthology.orchestra.run.gibba018.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T19:15:53.570 INFO:teuthology.orchestra.run.gibba018.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T19:15:53.812 INFO:teuthology.orchestra.run.gibba018.stdout:Fetched 75.6 MB in 3s (23.5 MB/s) 2021-11-15T19:15:53.938 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T19:15:56.014 INFO:teuthology.orchestra.run.gibba018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T19:15:56.023 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:56.093 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:57.419 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T19:15:57.428 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:57.510 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:15:58.389 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T19:15:58.414 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:15:58.455 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:01.679 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:16:01.806 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:16:02.160 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:16:02.301 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:16:02.646 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T19:16:02.655 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T19:16:02.695 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:16:06.211 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T19:16:06.252 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:16:06.295 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:07.977 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:16:08.139 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:16:08.493 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:16:08.593 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:09.378 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:09.496 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T19:16:09.655 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:10.368 INFO:teuthology.orchestra.run.gibba018.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:16:10.368 INFO:teuthology.orchestra.run.gibba018.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T19:16:10.368 INFO:teuthology.orchestra.run.gibba018.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:16:10.368 INFO:teuthology.orchestra.run.gibba018.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T19:16:10.523 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:11.350 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T19:16:11.467 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T19:16:11.569 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:11.685 INFO:teuthology.orchestra.run.gibba018.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T19:16:11.685 INFO:teuthology.orchestra.run.gibba018.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:16:30.934 INFO:teuthology.orchestra.run.gibba018.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T19:16:30.934 INFO:teuthology.orchestra.run.gibba018.stdout:Sourcing file `/etc/default/grub' 2021-11-15T19:16:30.938 INFO:teuthology.orchestra.run.gibba018.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:16:30.968 INFO:teuthology.orchestra.run.gibba018.stdout:Generating grub configuration file ... 2021-11-15T19:16:31.365 INFO:teuthology.orchestra.run.gibba018.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:16:31.407 INFO:teuthology.orchestra.run.gibba018.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:16:31.951 INFO:teuthology.orchestra.run.gibba018.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:16:31.965 INFO:teuthology.orchestra.run.gibba018.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:16:32.088 INFO:teuthology.orchestra.run.gibba018.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:16:32.101 INFO:teuthology.orchestra.run.gibba018.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:16:35.079 INFO:teuthology.orchestra.run.gibba018.stdout:done 2021-11-15T19:16:35.372 DEBUG:teuthology.orchestra.run.gibba018:> dpkg -s linux-image-generic 2021-11-15T19:16:35.396 INFO:teuthology.orchestra.run.gibba018.stdout:Package: linux-image-generic 2021-11-15T19:16:35.396 INFO:teuthology.orchestra.run.gibba018.stdout:Status: install ok installed 2021-11-15T19:16:35.396 INFO:teuthology.orchestra.run.gibba018.stdout:Priority: optional 2021-11-15T19:16:35.397 INFO:teuthology.orchestra.run.gibba018.stdout:Section: kernel 2021-11-15T19:16:35.397 INFO:teuthology.orchestra.run.gibba018.stdout:Installed-Size: 18 2021-11-15T19:16:35.397 INFO:teuthology.orchestra.run.gibba018.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:16:35.397 INFO:teuthology.orchestra.run.gibba018.stdout:Architecture: amd64 2021-11-15T19:16:35.397 INFO:teuthology.orchestra.run.gibba018.stdout:Source: linux-meta 2021-11-15T19:16:35.398 INFO:teuthology.orchestra.run.gibba018.stdout:Version: 5.4.0.90.94 2021-11-15T19:16:35.398 INFO:teuthology.orchestra.run.gibba018.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:16:35.398 INFO:teuthology.orchestra.run.gibba018.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:16:35.398 INFO:teuthology.orchestra.run.gibba018.stdout:Recommends: thermald 2021-11-15T19:16:35.399 INFO:teuthology.orchestra.run.gibba018.stdout:Description: Generic Linux kernel image 2021-11-15T19:16:35.399 INFO:teuthology.orchestra.run.gibba018.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:16:35.399 INFO:teuthology.orchestra.run.gibba018.stdout: available. 2021-11-15T19:16:35.399 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T19:16:35.400 DEBUG:teuthology.orchestra.run.gibba017:> uname -r 2021-11-15T19:16:35.409 INFO:teuthology.orchestra.run.gibba017.stdout:5.4.0-88-generic 2021-11-15T19:16:35.409 INFO:teuthology.task.kernel:Running kernel on gibba017: 5.4.0-88-generic 2021-11-15T19:16:35.409 DEBUG:teuthology.orchestra.run.gibba017:> sudo apt-get clean 2021-11-15T19:16:35.496 DEBUG:teuthology.orchestra.run.gibba017:> sudo apt-get update 2021-11-15T19:16:35.659 INFO:teuthology.orchestra.run.gibba017.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T19:16:35.765 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:16:35.848 INFO:teuthology.orchestra.run.gibba017.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T19:16:35.887 INFO:teuthology.orchestra.run.gibba017.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T19:16:35.950 INFO:teuthology.orchestra.run.gibba017.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T19:16:35.990 INFO:teuthology.orchestra.run.gibba017.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T19:16:35.992 INFO:teuthology.orchestra.run.gibba017.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T19:16:35.992 INFO:teuthology.orchestra.run.gibba017.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T19:16:36.001 INFO:teuthology.orchestra.run.gibba017.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T19:16:36.002 INFO:teuthology.orchestra.run.gibba017.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T19:16:36.002 INFO:teuthology.orchestra.run.gibba017.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:16:36.002 INFO:teuthology.orchestra.run.gibba017.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T19:16:36.011 INFO:teuthology.orchestra.run.gibba017.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T19:16:36.017 INFO:teuthology.orchestra.run.gibba017.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T19:16:36.018 INFO:teuthology.orchestra.run.gibba017.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T19:16:36.031 INFO:teuthology.orchestra.run.gibba017.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T19:16:36.031 INFO:teuthology.orchestra.run.gibba017.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T19:16:36.031 INFO:teuthology.orchestra.run.gibba017.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T19:16:36.186 INFO:teuthology.orchestra.run.gibba017.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T19:16:36.271 INFO:teuthology.orchestra.run.gibba017.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T19:16:36.524 INFO:teuthology.orchestra.run.gibba017.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [563 kB] 2021-11-15T19:16:36.556 INFO:teuthology.orchestra.run.gibba017.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T19:16:36.575 INFO:teuthology.orchestra.run.gibba017.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T19:16:36.575 INFO:teuthology.orchestra.run.gibba017.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T19:16:36.603 INFO:teuthology.orchestra.run.gibba017.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T19:16:36.603 INFO:teuthology.orchestra.run.gibba017.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T19:16:36.607 INFO:teuthology.orchestra.run.gibba017.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T19:16:36.607 INFO:teuthology.orchestra.run.gibba017.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T19:16:36.640 INFO:teuthology.orchestra.run.gibba017.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T19:16:36.663 INFO:teuthology.orchestra.run.gibba017.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T19:16:36.689 INFO:teuthology.orchestra.run.gibba017.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T19:16:36.690 INFO:teuthology.orchestra.run.gibba017.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T19:16:36.690 INFO:teuthology.orchestra.run.gibba017.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T19:16:36.690 INFO:teuthology.orchestra.run.gibba017.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T19:16:36.699 INFO:teuthology.orchestra.run.gibba017.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T19:16:36.699 INFO:teuthology.orchestra.run.gibba017.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T19:16:36.700 INFO:teuthology.orchestra.run.gibba017.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T19:16:36.781 INFO:teuthology.orchestra.run.gibba017.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T19:16:36.781 INFO:teuthology.orchestra.run.gibba017.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T19:16:38.787 INFO:teuthology.orchestra.run.gibba017.stdout:Fetched 8,407 kB in 1s (6,031 kB/s) 2021-11-15T19:16:39.878 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:16:39.889 DEBUG:teuthology.orchestra.run.gibba017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:16:39.925 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:16:40.025 INFO:teuthology.orchestra.run.gibba017.stdout:Building dependency tree... 2021-11-15T19:16:40.025 INFO:teuthology.orchestra.run.gibba017.stdout:Reading state information... 2021-11-15T19:16:40.105 INFO:teuthology.orchestra.run.gibba017.stdout:The following package was automatically installed and is no longer required: 2021-11-15T19:16:40.105 INFO:teuthology.orchestra.run.gibba017.stdout: libllvm11 2021-11-15T19:16:40.105 INFO:teuthology.orchestra.run.gibba017.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T19:16:40.106 INFO:teuthology.orchestra.run.gibba017.stdout:The following additional packages will be installed: 2021-11-15T19:16:40.106 INFO:teuthology.orchestra.run.gibba017.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:16:40.107 INFO:teuthology.orchestra.run.gibba017.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T19:16:40.107 INFO:teuthology.orchestra.run.gibba017.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T19:16:40.107 INFO:teuthology.orchestra.run.gibba017.stdout:Suggested packages: 2021-11-15T19:16:40.107 INFO:teuthology.orchestra.run.gibba017.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T19:16:40.107 INFO:teuthology.orchestra.run.gibba017.stdout:Recommended packages: 2021-11-15T19:16:40.108 INFO:teuthology.orchestra.run.gibba017.stdout: thermald 2021-11-15T19:16:40.140 INFO:teuthology.orchestra.run.gibba017.stdout:The following NEW packages will be installed: 2021-11-15T19:16:40.141 INFO:teuthology.orchestra.run.gibba017.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T19:16:40.141 INFO:teuthology.orchestra.run.gibba017.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T19:16:40.141 INFO:teuthology.orchestra.run.gibba017.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T19:16:40.142 INFO:teuthology.orchestra.run.gibba017.stdout:The following packages will be upgraded: 2021-11-15T19:16:40.142 INFO:teuthology.orchestra.run.gibba017.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T19:16:40.314 INFO:teuthology.orchestra.run.gibba017.stdout:3 upgraded, 5 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:16:40.314 INFO:teuthology.orchestra.run.gibba017.stdout:Need to get 75.6 MB of archives. 2021-11-15T19:16:40.315 INFO:teuthology.orchestra.run.gibba017.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T19:16:40.315 INFO:teuthology.orchestra.run.gibba017.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T19:16:41.387 INFO:teuthology.orchestra.run.gibba017.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T19:16:41.627 INFO:teuthology.orchestra.run.gibba017.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T19:16:42.898 INFO:teuthology.orchestra.run.gibba017.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T19:16:42.898 INFO:teuthology.orchestra.run.gibba017.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T19:16:42.899 INFO:teuthology.orchestra.run.gibba017.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T19:16:43.229 INFO:teuthology.orchestra.run.gibba017.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T19:16:43.269 INFO:teuthology.orchestra.run.gibba017.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T19:16:43.554 INFO:teuthology.orchestra.run.gibba017.stdout:Fetched 75.6 MB in 3s (24.2 MB/s) 2021-11-15T19:16:43.726 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T19:16:45.774 INFO:teuthology.orchestra.run.gibba017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T19:16:45.783 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:16:45.833 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:47.300 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T19:16:47.309 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:16:47.396 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:48.261 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T19:16:48.286 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:16:48.327 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:51.403 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:16:51.513 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:16:51.852 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:16:51.975 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:16:52.361 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T19:16:52.369 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T19:16:52.410 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:16:56.212 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T19:16:56.251 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T19:16:56.311 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:58.046 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T19:16:58.190 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T19:16:58.546 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T19:16:58.669 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:59.554 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:16:59.714 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T19:16:59.815 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:17:00.551 INFO:teuthology.orchestra.run.gibba017.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:00.551 INFO:teuthology.orchestra.run.gibba017.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:00.552 INFO:teuthology.orchestra.run.gibba017.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:00.552 INFO:teuthology.orchestra.run.gibba017.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:00.675 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:17:01.518 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T19:17:01.644 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T19:17:01.796 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T19:17:01.930 INFO:teuthology.orchestra.run.gibba017.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T19:17:01.931 INFO:teuthology.orchestra.run.gibba017.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:21.301 INFO:teuthology.orchestra.run.gibba017.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T19:17:21.302 INFO:teuthology.orchestra.run.gibba017.stdout:Sourcing file `/etc/default/grub' 2021-11-15T19:17:21.307 INFO:teuthology.orchestra.run.gibba017.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:17:21.365 INFO:teuthology.orchestra.run.gibba017.stdout:Generating grub configuration file ... 2021-11-15T19:17:21.723 INFO:teuthology.orchestra.run.gibba017.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:21.759 INFO:teuthology.orchestra.run.gibba017.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:22.216 INFO:teuthology.orchestra.run.gibba017.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:22.232 INFO:teuthology.orchestra.run.gibba017.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:22.354 INFO:teuthology.orchestra.run.gibba017.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:17:22.367 INFO:teuthology.orchestra.run.gibba017.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:17:25.278 INFO:teuthology.orchestra.run.gibba017.stdout:done 2021-11-15T19:17:25.620 DEBUG:teuthology.orchestra.run.gibba017:> dpkg -s linux-image-generic 2021-11-15T19:17:25.635 INFO:teuthology.orchestra.run.gibba017.stdout:Package: linux-image-generic 2021-11-15T19:17:25.635 INFO:teuthology.orchestra.run.gibba017.stdout:Status: install ok installed 2021-11-15T19:17:25.635 INFO:teuthology.orchestra.run.gibba017.stdout:Priority: optional 2021-11-15T19:17:25.636 INFO:teuthology.orchestra.run.gibba017.stdout:Section: kernel 2021-11-15T19:17:25.636 INFO:teuthology.orchestra.run.gibba017.stdout:Installed-Size: 18 2021-11-15T19:17:25.636 INFO:teuthology.orchestra.run.gibba017.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:17:25.636 INFO:teuthology.orchestra.run.gibba017.stdout:Architecture: amd64 2021-11-15T19:17:25.637 INFO:teuthology.orchestra.run.gibba017.stdout:Source: linux-meta 2021-11-15T19:17:25.637 INFO:teuthology.orchestra.run.gibba017.stdout:Version: 5.4.0.90.94 2021-11-15T19:17:25.637 INFO:teuthology.orchestra.run.gibba017.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:17:25.637 INFO:teuthology.orchestra.run.gibba017.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:17:25.638 INFO:teuthology.orchestra.run.gibba017.stdout:Recommends: thermald 2021-11-15T19:17:25.638 INFO:teuthology.orchestra.run.gibba017.stdout:Description: Generic Linux kernel image 2021-11-15T19:17:25.638 INFO:teuthology.orchestra.run.gibba017.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:17:25.638 INFO:teuthology.orchestra.run.gibba017.stdout: available. 2021-11-15T19:17:25.639 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T19:17:25.639 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-15T19:17:25.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T19:17:25.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T19:17:25.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T19:17:25.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T19:17:25.641 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T19:17:25.641 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-11-15T19:17:25.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba037.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T19:17:25.642 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get clean 2021-11-15T19:17:25.766 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get update 2021-11-15T19:17:25.852 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:17:25.973 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:17:26.055 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:17:26.138 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:17:26.971 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:17:26.983 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:17:27.018 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:17:27.122 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-11-15T19:17:27.123 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-11-15T19:17:27.200 INFO:teuthology.orchestra.run.gibba037.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T19:17:27.200 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:17:27.200 INFO:teuthology.orchestra.run.gibba037.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:17:27.201 INFO:teuthology.orchestra.run.gibba037.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:17:27.201 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:17:27.201 INFO:teuthology.orchestra.run.gibba037.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:17:27.215 INFO:teuthology.orchestra.run.gibba037.stdout:0 upgraded, 0 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:17:27.216 DEBUG:teuthology.orchestra.run.gibba037:> dpkg -s linux-image-generic 2021-11-15T19:17:27.227 INFO:teuthology.orchestra.run.gibba037.stdout:Package: linux-image-generic 2021-11-15T19:17:27.227 INFO:teuthology.orchestra.run.gibba037.stdout:Status: install ok installed 2021-11-15T19:17:27.227 INFO:teuthology.orchestra.run.gibba037.stdout:Priority: optional 2021-11-15T19:17:27.227 INFO:teuthology.orchestra.run.gibba037.stdout:Section: kernel 2021-11-15T19:17:27.228 INFO:teuthology.orchestra.run.gibba037.stdout:Installed-Size: 18 2021-11-15T19:17:27.228 INFO:teuthology.orchestra.run.gibba037.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:17:27.228 INFO:teuthology.orchestra.run.gibba037.stdout:Architecture: amd64 2021-11-15T19:17:27.228 INFO:teuthology.orchestra.run.gibba037.stdout:Source: linux-meta 2021-11-15T19:17:27.228 INFO:teuthology.orchestra.run.gibba037.stdout:Version: 5.4.0.90.94 2021-11-15T19:17:27.229 INFO:teuthology.orchestra.run.gibba037.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:17:27.229 INFO:teuthology.orchestra.run.gibba037.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:17:27.229 INFO:teuthology.orchestra.run.gibba037.stdout:Recommends: thermald 2021-11-15T19:17:27.229 INFO:teuthology.orchestra.run.gibba037.stdout:Description: Generic Linux kernel image 2021-11-15T19:17:27.229 INFO:teuthology.orchestra.run.gibba037.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:17:27.230 INFO:teuthology.orchestra.run.gibba037.stdout: available. 2021-11-15T19:17:27.230 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:17:27.235 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.oWwj00bPn0 2021-11-15T19:17:27.235 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /boot/grub/grub.cfg /tmp/tmp.oWwj00bPn0 2021-11-15T19:17:27.283 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.oWwj00bPn0 2021-11-15T19:17:27.311 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.oWwj00bPn0 is 10KB 2021-11-15T19:17:27.324 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.oWwj00bPn0 2021-11-15T19:17:27.332 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:27.383 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:17:27.383 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T19:17:27.384 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:27.416 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T19:17:27.416 DEBUG:teuthology.orchestra.run.gibba037:> sudo update-grub 2021-11-15T19:17:28.668 INFO:teuthology.orchestra.run.gibba037.stderr:Sourcing file `/etc/default/grub' 2021-11-15T19:17:28.670 INFO:teuthology.orchestra.run.gibba037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:17:28.703 INFO:teuthology.orchestra.run.gibba037.stderr:Generating grub configuration file ... 2021-11-15T19:17:28.982 INFO:teuthology.orchestra.run.gibba037.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:28.997 INFO:teuthology.orchestra.run.gibba037.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:29.418 INFO:teuthology.orchestra.run.gibba037.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:29.432 INFO:teuthology.orchestra.run.gibba037.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:29.546 INFO:teuthology.orchestra.run.gibba037.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:17:29.561 INFO:teuthology.orchestra.run.gibba037.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:17:31.275 INFO:teuthology.orchestra.run.gibba037.stderr:done 2021-11-15T19:17:31.276 DEBUG:teuthology.orchestra.run.gibba037:> sudo shutdown -r now 2021-11-15T19:17:31.279 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-11-15T19:17:31.279 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba011.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T19:17:31.280 DEBUG:teuthology.orchestra.run.gibba011:> sudo apt-get clean 2021-11-15T19:17:31.398 DEBUG:teuthology.orchestra.run.gibba011:> sudo apt-get update 2021-11-15T19:17:31.500 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:17:31.616 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:17:31.699 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:17:31.781 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:17:32.617 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:17:32.628 DEBUG:teuthology.orchestra.run.gibba011:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:17:32.664 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:17:32.768 INFO:teuthology.orchestra.run.gibba011.stdout:Building dependency tree... 2021-11-15T19:17:32.768 INFO:teuthology.orchestra.run.gibba011.stdout:Reading state information... 2021-11-15T19:17:32.846 INFO:teuthology.orchestra.run.gibba011.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T19:17:32.847 INFO:teuthology.orchestra.run.gibba011.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:17:32.847 INFO:teuthology.orchestra.run.gibba011.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:17:32.847 INFO:teuthology.orchestra.run.gibba011.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:17:32.847 INFO:teuthology.orchestra.run.gibba011.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:17:32.848 INFO:teuthology.orchestra.run.gibba011.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:17:32.862 INFO:teuthology.orchestra.run.gibba011.stdout:0 upgraded, 0 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:17:32.863 DEBUG:teuthology.orchestra.run.gibba011:> dpkg -s linux-image-generic 2021-11-15T19:17:32.873 INFO:teuthology.orchestra.run.gibba011.stdout:Package: linux-image-generic 2021-11-15T19:17:32.873 INFO:teuthology.orchestra.run.gibba011.stdout:Status: install ok installed 2021-11-15T19:17:32.873 INFO:teuthology.orchestra.run.gibba011.stdout:Priority: optional 2021-11-15T19:17:32.874 INFO:teuthology.orchestra.run.gibba011.stdout:Section: kernel 2021-11-15T19:17:32.874 INFO:teuthology.orchestra.run.gibba011.stdout:Installed-Size: 18 2021-11-15T19:17:32.874 INFO:teuthology.orchestra.run.gibba011.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:17:32.874 INFO:teuthology.orchestra.run.gibba011.stdout:Architecture: amd64 2021-11-15T19:17:32.874 INFO:teuthology.orchestra.run.gibba011.stdout:Source: linux-meta 2021-11-15T19:17:32.875 INFO:teuthology.orchestra.run.gibba011.stdout:Version: 5.4.0.90.94 2021-11-15T19:17:32.875 INFO:teuthology.orchestra.run.gibba011.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:17:32.875 INFO:teuthology.orchestra.run.gibba011.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:17:32.875 INFO:teuthology.orchestra.run.gibba011.stdout:Recommends: thermald 2021-11-15T19:17:32.876 INFO:teuthology.orchestra.run.gibba011.stdout:Description: Generic Linux kernel image 2021-11-15T19:17:32.876 INFO:teuthology.orchestra.run.gibba011.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:17:32.876 INFO:teuthology.orchestra.run.gibba011.stdout: available. 2021-11-15T19:17:32.876 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:17:32.880 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.HNUoogfU4y 2021-11-15T19:17:32.881 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HNUoogfU4y 2021-11-15T19:17:32.934 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.HNUoogfU4y 2021-11-15T19:17:32.978 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.HNUoogfU4y is 10KB 2021-11-15T19:17:32.992 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.HNUoogfU4y 2021-11-15T19:17:32.996 DEBUG:teuthology.orchestra.run.gibba011:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:33.046 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:17:33.046 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T19:17:33.047 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:33.092 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T19:17:33.093 DEBUG:teuthology.orchestra.run.gibba011:> sudo update-grub 2021-11-15T19:17:34.513 INFO:teuthology.orchestra.run.gibba011.stderr:Sourcing file `/etc/default/grub' 2021-11-15T19:17:34.522 INFO:teuthology.orchestra.run.gibba011.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:17:34.552 INFO:teuthology.orchestra.run.gibba011.stderr:Generating grub configuration file ... 2021-11-15T19:17:34.839 INFO:teuthology.orchestra.run.gibba011.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:34.853 INFO:teuthology.orchestra.run.gibba011.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:35.318 INFO:teuthology.orchestra.run.gibba011.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:35.332 INFO:teuthology.orchestra.run.gibba011.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:35.446 INFO:teuthology.orchestra.run.gibba011.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:17:35.460 INFO:teuthology.orchestra.run.gibba011.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:17:37.213 INFO:teuthology.orchestra.run.gibba011.stderr:done 2021-11-15T19:17:37.215 DEBUG:teuthology.orchestra.run.gibba011:> sudo shutdown -r now 2021-11-15T19:17:37.218 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-11-15T19:17:37.218 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba031.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T19:17:37.219 DEBUG:teuthology.orchestra.run.gibba031:> sudo apt-get clean 2021-11-15T19:17:37.378 DEBUG:teuthology.orchestra.run.gibba031:> sudo apt-get update 2021-11-15T19:17:37.495 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:17:37.615 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:17:37.697 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:17:37.780 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:17:38.594 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:17:38.605 DEBUG:teuthology.orchestra.run.gibba031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:17:38.641 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:17:38.741 INFO:teuthology.orchestra.run.gibba031.stdout:Building dependency tree... 2021-11-15T19:17:38.741 INFO:teuthology.orchestra.run.gibba031.stdout:Reading state information... 2021-11-15T19:17:38.817 INFO:teuthology.orchestra.run.gibba031.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T19:17:38.817 INFO:teuthology.orchestra.run.gibba031.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:17:38.817 INFO:teuthology.orchestra.run.gibba031.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:17:38.818 INFO:teuthology.orchestra.run.gibba031.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:17:38.818 INFO:teuthology.orchestra.run.gibba031.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:17:38.818 INFO:teuthology.orchestra.run.gibba031.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:17:38.832 INFO:teuthology.orchestra.run.gibba031.stdout:0 upgraded, 0 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:17:38.833 DEBUG:teuthology.orchestra.run.gibba031:> dpkg -s linux-image-generic 2021-11-15T19:17:38.887 INFO:teuthology.orchestra.run.gibba031.stdout:Package: linux-image-generic 2021-11-15T19:17:38.887 INFO:teuthology.orchestra.run.gibba031.stdout:Status: install ok installed 2021-11-15T19:17:38.887 INFO:teuthology.orchestra.run.gibba031.stdout:Priority: optional 2021-11-15T19:17:38.887 INFO:teuthology.orchestra.run.gibba031.stdout:Section: kernel 2021-11-15T19:17:38.887 INFO:teuthology.orchestra.run.gibba031.stdout:Installed-Size: 18 2021-11-15T19:17:38.888 INFO:teuthology.orchestra.run.gibba031.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:17:38.888 INFO:teuthology.orchestra.run.gibba031.stdout:Architecture: amd64 2021-11-15T19:17:38.888 INFO:teuthology.orchestra.run.gibba031.stdout:Source: linux-meta 2021-11-15T19:17:38.888 INFO:teuthology.orchestra.run.gibba031.stdout:Version: 5.4.0.90.94 2021-11-15T19:17:38.889 INFO:teuthology.orchestra.run.gibba031.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:17:38.889 INFO:teuthology.orchestra.run.gibba031.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:17:38.889 INFO:teuthology.orchestra.run.gibba031.stdout:Recommends: thermald 2021-11-15T19:17:38.889 INFO:teuthology.orchestra.run.gibba031.stdout:Description: Generic Linux kernel image 2021-11-15T19:17:38.889 INFO:teuthology.orchestra.run.gibba031.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:17:38.890 INFO:teuthology.orchestra.run.gibba031.stdout: available. 2021-11-15T19:17:38.890 DEBUG:teuthology.orchestra.run.gibba031:> mktemp 2021-11-15T19:17:38.894 INFO:teuthology.orchestra.run.gibba031.stdout:/tmp/tmp.kweVVRq5FG 2021-11-15T19:17:38.894 DEBUG:teuthology.orchestra.run.gibba031:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kweVVRq5FG 2021-11-15T19:17:38.945 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod 0666 /tmp/tmp.kweVVRq5FG 2021-11-15T19:17:38.987 DEBUG:teuthology.orchestra.remote:gibba031:/tmp/tmp.kweVVRq5FG is 10KB 2021-11-15T19:17:39.003 DEBUG:teuthology.orchestra.run.gibba031:> rm -fr /tmp/tmp.kweVVRq5FG 2021-11-15T19:17:39.010 DEBUG:teuthology.orchestra.run.gibba031:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:39.070 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:17:39.071 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T19:17:39.071 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:39.125 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T19:17:39.126 DEBUG:teuthology.orchestra.run.gibba031:> sudo update-grub 2021-11-15T19:17:40.428 INFO:teuthology.orchestra.run.gibba031.stderr:Sourcing file `/etc/default/grub' 2021-11-15T19:17:40.439 INFO:teuthology.orchestra.run.gibba031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:17:40.463 INFO:teuthology.orchestra.run.gibba031.stderr:Generating grub configuration file ... 2021-11-15T19:17:40.746 INFO:teuthology.orchestra.run.gibba031.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:40.758 INFO:teuthology.orchestra.run.gibba031.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:41.193 INFO:teuthology.orchestra.run.gibba031.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:41.205 INFO:teuthology.orchestra.run.gibba031.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:41.302 INFO:teuthology.orchestra.run.gibba031.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:17:41.314 INFO:teuthology.orchestra.run.gibba031.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:17:42.988 INFO:teuthology.orchestra.run.gibba031.stderr:done 2021-11-15T19:17:42.989 DEBUG:teuthology.orchestra.run.gibba031:> sudo shutdown -r now 2021-11-15T19:17:42.991 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-11-15T19:17:42.992 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba018.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T19:17:42.992 DEBUG:teuthology.orchestra.run.gibba018:> sudo apt-get clean 2021-11-15T19:17:43.153 DEBUG:teuthology.orchestra.run.gibba018:> sudo apt-get update 2021-11-15T19:17:43.373 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:17:43.373 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:17:43.447 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:17:43.529 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:17:44.297 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:17:44.308 DEBUG:teuthology.orchestra.run.gibba018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:17:44.344 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:17:44.444 INFO:teuthology.orchestra.run.gibba018.stdout:Building dependency tree... 2021-11-15T19:17:44.445 INFO:teuthology.orchestra.run.gibba018.stdout:Reading state information... 2021-11-15T19:17:44.520 INFO:teuthology.orchestra.run.gibba018.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T19:17:44.521 INFO:teuthology.orchestra.run.gibba018.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:17:44.521 INFO:teuthology.orchestra.run.gibba018.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:17:44.521 INFO:teuthology.orchestra.run.gibba018.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:17:44.521 INFO:teuthology.orchestra.run.gibba018.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:17:44.522 INFO:teuthology.orchestra.run.gibba018.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:17:44.536 INFO:teuthology.orchestra.run.gibba018.stdout:0 upgraded, 0 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:17:44.537 DEBUG:teuthology.orchestra.run.gibba018:> dpkg -s linux-image-generic 2021-11-15T19:17:44.547 INFO:teuthology.orchestra.run.gibba018.stdout:Package: linux-image-generic 2021-11-15T19:17:44.547 INFO:teuthology.orchestra.run.gibba018.stdout:Status: install ok installed 2021-11-15T19:17:44.548 INFO:teuthology.orchestra.run.gibba018.stdout:Priority: optional 2021-11-15T19:17:44.548 INFO:teuthology.orchestra.run.gibba018.stdout:Section: kernel 2021-11-15T19:17:44.548 INFO:teuthology.orchestra.run.gibba018.stdout:Installed-Size: 18 2021-11-15T19:17:44.548 INFO:teuthology.orchestra.run.gibba018.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:17:44.548 INFO:teuthology.orchestra.run.gibba018.stdout:Architecture: amd64 2021-11-15T19:17:44.549 INFO:teuthology.orchestra.run.gibba018.stdout:Source: linux-meta 2021-11-15T19:17:44.549 INFO:teuthology.orchestra.run.gibba018.stdout:Version: 5.4.0.90.94 2021-11-15T19:17:44.549 INFO:teuthology.orchestra.run.gibba018.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:17:44.549 INFO:teuthology.orchestra.run.gibba018.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:17:44.550 INFO:teuthology.orchestra.run.gibba018.stdout:Recommends: thermald 2021-11-15T19:17:44.550 INFO:teuthology.orchestra.run.gibba018.stdout:Description: Generic Linux kernel image 2021-11-15T19:17:44.550 INFO:teuthology.orchestra.run.gibba018.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:17:44.550 INFO:teuthology.orchestra.run.gibba018.stdout: available. 2021-11-15T19:17:44.551 DEBUG:teuthology.orchestra.run.gibba018:> mktemp 2021-11-15T19:17:44.554 INFO:teuthology.orchestra.run.gibba018.stdout:/tmp/tmp.ImK0Va7Fp5 2021-11-15T19:17:44.555 DEBUG:teuthology.orchestra.run.gibba018:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ImK0Va7Fp5 2021-11-15T19:17:44.612 DEBUG:teuthology.orchestra.run.gibba018:> sudo chmod 0666 /tmp/tmp.ImK0Va7Fp5 2021-11-15T19:17:44.657 DEBUG:teuthology.orchestra.remote:gibba018:/tmp/tmp.ImK0Va7Fp5 is 10KB 2021-11-15T19:17:44.675 DEBUG:teuthology.orchestra.run.gibba018:> rm -fr /tmp/tmp.ImK0Va7Fp5 2021-11-15T19:17:44.683 DEBUG:teuthology.orchestra.run.gibba018:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:44.742 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:17:44.743 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T19:17:44.743 DEBUG:teuthology.orchestra.run.gibba018:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:44.800 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T19:17:44.801 DEBUG:teuthology.orchestra.run.gibba018:> sudo update-grub 2021-11-15T19:17:46.227 INFO:teuthology.orchestra.run.gibba018.stderr:Sourcing file `/etc/default/grub' 2021-11-15T19:17:46.233 INFO:teuthology.orchestra.run.gibba018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:17:46.252 INFO:teuthology.orchestra.run.gibba018.stderr:Generating grub configuration file ... 2021-11-15T19:17:46.562 INFO:teuthology.orchestra.run.gibba018.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:46.576 INFO:teuthology.orchestra.run.gibba018.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:47.040 INFO:teuthology.orchestra.run.gibba018.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:47.054 INFO:teuthology.orchestra.run.gibba018.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:47.168 INFO:teuthology.orchestra.run.gibba018.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:17:47.182 INFO:teuthology.orchestra.run.gibba018.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:17:48.892 INFO:teuthology.orchestra.run.gibba018.stderr:done 2021-11-15T19:17:48.895 DEBUG:teuthology.orchestra.run.gibba018:> sudo shutdown -r now 2021-11-15T19:17:48.897 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2021-11-15T19:17:48.898 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba017.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T19:17:48.898 DEBUG:teuthology.orchestra.run.gibba017:> sudo apt-get clean 2021-11-15T19:17:48.973 DEBUG:teuthology.orchestra.run.gibba017:> sudo apt-get update 2021-11-15T19:17:49.195 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:17:49.196 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:17:49.262 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:17:49.344 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:17:50.181 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:17:50.192 DEBUG:teuthology.orchestra.run.gibba017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T19:17:50.228 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:17:50.334 INFO:teuthology.orchestra.run.gibba017.stdout:Building dependency tree... 2021-11-15T19:17:50.334 INFO:teuthology.orchestra.run.gibba017.stdout:Reading state information... 2021-11-15T19:17:50.414 INFO:teuthology.orchestra.run.gibba017.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T19:17:50.415 INFO:teuthology.orchestra.run.gibba017.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:17:50.415 INFO:teuthology.orchestra.run.gibba017.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:17:50.415 INFO:teuthology.orchestra.run.gibba017.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:17:50.415 INFO:teuthology.orchestra.run.gibba017.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:17:50.415 INFO:teuthology.orchestra.run.gibba017.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:17:50.430 INFO:teuthology.orchestra.run.gibba017.stdout:0 upgraded, 0 newly installed, 0 to remove and 62 not upgraded. 2021-11-15T19:17:50.431 DEBUG:teuthology.orchestra.run.gibba017:> dpkg -s linux-image-generic 2021-11-15T19:17:50.441 INFO:teuthology.orchestra.run.gibba017.stdout:Package: linux-image-generic 2021-11-15T19:17:50.441 INFO:teuthology.orchestra.run.gibba017.stdout:Status: install ok installed 2021-11-15T19:17:50.441 INFO:teuthology.orchestra.run.gibba017.stdout:Priority: optional 2021-11-15T19:17:50.442 INFO:teuthology.orchestra.run.gibba017.stdout:Section: kernel 2021-11-15T19:17:50.442 INFO:teuthology.orchestra.run.gibba017.stdout:Installed-Size: 18 2021-11-15T19:17:50.442 INFO:teuthology.orchestra.run.gibba017.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T19:17:50.442 INFO:teuthology.orchestra.run.gibba017.stdout:Architecture: amd64 2021-11-15T19:17:50.442 INFO:teuthology.orchestra.run.gibba017.stdout:Source: linux-meta 2021-11-15T19:17:50.443 INFO:teuthology.orchestra.run.gibba017.stdout:Version: 5.4.0.90.94 2021-11-15T19:17:50.443 INFO:teuthology.orchestra.run.gibba017.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T19:17:50.443 INFO:teuthology.orchestra.run.gibba017.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T19:17:50.443 INFO:teuthology.orchestra.run.gibba017.stdout:Recommends: thermald 2021-11-15T19:17:50.443 INFO:teuthology.orchestra.run.gibba017.stdout:Description: Generic Linux kernel image 2021-11-15T19:17:50.444 INFO:teuthology.orchestra.run.gibba017.stdout: This package will always depend on the latest generic kernel image 2021-11-15T19:17:50.444 INFO:teuthology.orchestra.run.gibba017.stdout: available. 2021-11-15T19:17:50.444 DEBUG:teuthology.orchestra.run.gibba017:> mktemp 2021-11-15T19:17:50.448 INFO:teuthology.orchestra.run.gibba017.stdout:/tmp/tmp.fZsg4jhgO4 2021-11-15T19:17:50.448 DEBUG:teuthology.orchestra.run.gibba017:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fZsg4jhgO4 2021-11-15T19:17:50.501 DEBUG:teuthology.orchestra.run.gibba017:> sudo chmod 0666 /tmp/tmp.fZsg4jhgO4 2021-11-15T19:17:50.533 DEBUG:teuthology.orchestra.remote:gibba017:/tmp/tmp.fZsg4jhgO4 is 10KB 2021-11-15T19:17:50.548 DEBUG:teuthology.orchestra.run.gibba017:> rm -fr /tmp/tmp.fZsg4jhgO4 2021-11-15T19:17:50.551 DEBUG:teuthology.orchestra.run.gibba017:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:50.602 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:17:50.602 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T19:17:50.602 DEBUG:teuthology.orchestra.run.gibba017:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T19:17:50.658 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T19:17:50.658 DEBUG:teuthology.orchestra.run.gibba017:> sudo update-grub 2021-11-15T19:17:52.104 INFO:teuthology.orchestra.run.gibba017.stderr:Sourcing file `/etc/default/grub' 2021-11-15T19:17:52.107 INFO:teuthology.orchestra.run.gibba017.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T19:17:52.132 INFO:teuthology.orchestra.run.gibba017.stderr:Generating grub configuration file ... 2021-11-15T19:17:52.406 INFO:teuthology.orchestra.run.gibba017.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T19:17:52.420 INFO:teuthology.orchestra.run.gibba017.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T19:17:52.857 INFO:teuthology.orchestra.run.gibba017.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T19:17:52.871 INFO:teuthology.orchestra.run.gibba017.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T19:17:52.985 INFO:teuthology.orchestra.run.gibba017.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T19:17:52.999 INFO:teuthology.orchestra.run.gibba017.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T19:17:54.794 INFO:teuthology.orchestra.run.gibba017.stderr:done 2021-11-15T19:17:54.795 DEBUG:teuthology.orchestra.run.gibba017:> sudo shutdown -r now 2021-11-15T19:18:24.827 INFO:teuthology.misc:Re-opening connections... 2021-11-15T19:18:24.828 INFO:teuthology.misc:trying to connect to ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:18:24.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba037.front.sepia.ceph.com' 2021-11-15T19:18:24.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:19:43.201 DEBUG:teuthology.orchestra.remote:timed out 2021-11-15T19:19:43.203 INFO:teuthology.misc:trying to connect to ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:19:43.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba011.front.sepia.ceph.com' 2021-11-15T19:19:43.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:20:43.257 DEBUG:teuthology.orchestra.remote:timed out 2021-11-15T19:20:43.259 INFO:teuthology.misc:trying to connect to ubuntu@gibba031.front.sepia.ceph.com 2021-11-15T19:20:43.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba031.front.sepia.ceph.com' 2021-11-15T19:20:43.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:20:43.525 DEBUG:teuthology.orchestra.run.gibba031:> true 2021-11-15T19:20:44.032 INFO:teuthology.misc:trying to connect to ubuntu@gibba017.front.sepia.ceph.com 2021-11-15T19:20:44.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba017.front.sepia.ceph.com' 2021-11-15T19:20:44.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:20:44.318 DEBUG:teuthology.orchestra.run.gibba017:> true 2021-11-15T19:20:44.833 DEBUG:teuthology.misc:waited 140.00495958328247 2021-11-15T19:20:45.834 INFO:teuthology.misc:trying to connect to ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:20:45.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba037.front.sepia.ceph.com' 2021-11-15T19:20:45.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:20:46.119 DEBUG:teuthology.orchestra.run.gibba037:> true 2021-11-15T19:20:46.608 INFO:teuthology.misc:trying to connect to ubuntu@gibba018.front.sepia.ceph.com 2021-11-15T19:20:46.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba018.front.sepia.ceph.com' 2021-11-15T19:20:46.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:20:46.886 DEBUG:teuthology.orchestra.run.gibba018:> true 2021-11-15T19:20:47.435 DEBUG:teuthology.misc:waited 142.60764002799988 2021-11-15T19:20:48.437 INFO:teuthology.misc:trying to connect to ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:20:48.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba011.front.sepia.ceph.com' 2021-11-15T19:20:48.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:20:48.627 DEBUG:teuthology.orchestra.run.gibba011:> true 2021-11-15T19:20:49.124 DEBUG:teuthology.misc:waited 144.29641008377075 2021-11-15T19:20:50.125 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-11-15T19:20:50.126 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-90-generic"... 2021-11-15T19:20:50.126 DEBUG:teuthology.orchestra.run.gibba037:> uname -r 2021-11-15T19:20:50.132 INFO:teuthology.orchestra.run.gibba037.stdout:5.4.0-90-generic 2021-11-15T19:20:50.132 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T19:20:50.132 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T19:20:50.133 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T19:20:50.133 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-11-15T19:20:50.133 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-90-generic"... 2021-11-15T19:20:50.134 DEBUG:teuthology.orchestra.run.gibba011:> uname -r 2021-11-15T19:20:50.142 INFO:teuthology.orchestra.run.gibba011.stdout:5.4.0-90-generic 2021-11-15T19:20:50.143 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T19:20:50.143 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T19:20:50.143 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T19:20:50.144 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-11-15T19:20:50.144 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-90-generic"... 2021-11-15T19:20:50.144 DEBUG:teuthology.orchestra.run.gibba031:> uname -r 2021-11-15T19:20:50.153 INFO:teuthology.orchestra.run.gibba031.stdout:5.4.0-90-generic 2021-11-15T19:20:50.154 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T19:20:50.154 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T19:20:50.154 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T19:20:50.154 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-11-15T19:20:50.155 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-90-generic"... 2021-11-15T19:20:50.155 DEBUG:teuthology.orchestra.run.gibba018:> uname -r 2021-11-15T19:20:50.164 INFO:teuthology.orchestra.run.gibba018.stdout:5.4.0-90-generic 2021-11-15T19:20:50.164 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T19:20:50.164 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T19:20:50.165 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T19:20:50.165 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2021-11-15T19:20:50.165 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.4.0-90-generic"... 2021-11-15T19:20:50.165 DEBUG:teuthology.orchestra.run.gibba017:> uname -r 2021-11-15T19:20:50.174 INFO:teuthology.orchestra.run.gibba017.stdout:5.4.0-90-generic 2021-11-15T19:20:50.174 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T19:20:50.175 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T19:20:50.175 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T19:20:51.176 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-11-15T19:20:51.177 DEBUG:teuthology.orchestra.run.gibba037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T19:20:51.250 INFO:teuthology.orchestra.run.gibba037.stdout:ttyS1 2021-11-15T19:20:51.285 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-11-15T19:20:51.285 DEBUG:teuthology.orchestra.run.gibba011:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T19:20:51.356 INFO:teuthology.orchestra.run.gibba011.stdout:ttyS1 2021-11-15T19:20:51.393 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-11-15T19:20:51.393 DEBUG:teuthology.orchestra.run.gibba031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T19:20:51.479 INFO:teuthology.orchestra.run.gibba031.stdout:ttyS1 2021-11-15T19:20:51.504 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-11-15T19:20:51.504 DEBUG:teuthology.orchestra.run.gibba018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T19:20:51.584 INFO:teuthology.orchestra.run.gibba018.stdout:ttyS1 2021-11-15T19:20:51.613 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2021-11-15T19:20:51.613 DEBUG:teuthology.orchestra.run.gibba017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T19:20:51.687 INFO:teuthology.orchestra.run.gibba017.stdout:ttyS1 2021-11-15T19:20:51.723 INFO:teuthology.run_tasks:Running task internal.base... 2021-11-15T19:20:51.735 INFO:teuthology.task.internal:Creating test directory... 2021-11-15T19:20:51.735 DEBUG:teuthology.orchestra.run.gibba011:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T19:20:51.739 DEBUG:teuthology.orchestra.run.gibba017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T19:20:51.742 DEBUG:teuthology.orchestra.run.gibba018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T19:20:51.745 DEBUG:teuthology.orchestra.run.gibba031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T19:20:51.749 DEBUG:teuthology.orchestra.run.gibba037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T19:20:51.758 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-11-15T19:20:51.768 INFO:teuthology.run_tasks:Running task internal.archive... 2021-11-15T19:20:51.794 INFO:teuthology.task.internal:Creating archive directory... 2021-11-15T19:20:51.794 DEBUG:teuthology.orchestra.run.gibba011:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T19:20:51.797 DEBUG:teuthology.orchestra.run.gibba017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T19:20:51.800 DEBUG:teuthology.orchestra.run.gibba018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T19:20:51.803 DEBUG:teuthology.orchestra.run.gibba031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T19:20:51.805 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T19:20:51.824 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-11-15T19:20:51.835 INFO:teuthology.task.internal:Enabling coredump saving... 2021-11-15T19:20:51.836 DEBUG:teuthology.orchestra.run.gibba011:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T19:20:51.839 DEBUG:teuthology.orchestra.run.gibba017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T19:20:51.842 DEBUG:teuthology.orchestra.run.gibba018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T19:20:51.844 DEBUG:teuthology.orchestra.run.gibba031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T19:20:51.847 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T19:20:51.855 INFO:teuthology.orchestra.run.gibba011.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.857 INFO:teuthology.orchestra.run.gibba011.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.865 INFO:teuthology.orchestra.run.gibba018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.869 INFO:teuthology.orchestra.run.gibba017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.870 INFO:teuthology.orchestra.run.gibba031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.872 INFO:teuthology.orchestra.run.gibba017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.873 INFO:teuthology.orchestra.run.gibba037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.874 INFO:teuthology.orchestra.run.gibba018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.876 INFO:teuthology.orchestra.run.gibba037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.878 INFO:teuthology.orchestra.run.gibba031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T19:20:51.879 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-11-15T19:20:51.890 INFO:teuthology.task.internal:Configuring sudo... 2021-11-15T19:20:51.891 DEBUG:teuthology.orchestra.run.gibba011:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T19:20:51.901 DEBUG:teuthology.orchestra.run.gibba017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T19:20:51.915 DEBUG:teuthology.orchestra.run.gibba018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T19:20:51.921 DEBUG:teuthology.orchestra.run.gibba031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T19:20:51.924 DEBUG:teuthology.orchestra.run.gibba037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T19:20:51.936 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-11-15T19:20:51.949 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-11-15T19:20:51.950 DEBUG:teuthology.orchestra.run.gibba011:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T19:20:51.953 DEBUG:teuthology.orchestra.run.gibba017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T19:20:51.956 DEBUG:teuthology.orchestra.run.gibba018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T19:20:51.959 DEBUG:teuthology.orchestra.run.gibba031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T19:20:51.975 DEBUG:teuthology.orchestra.run.gibba037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T19:20:51.985 DEBUG:teuthology.orchestra.run.gibba037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T19:20:52.035 DEBUG:teuthology.orchestra.run.gibba037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T19:20:52.044 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:20:52.044 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T19:20:52.061 DEBUG:teuthology.orchestra.run.gibba011:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T19:20:52.071 DEBUG:teuthology.orchestra.run.gibba011:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T19:20:52.080 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:20:52.081 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T19:20:52.111 DEBUG:teuthology.orchestra.run.gibba031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T19:20:52.121 DEBUG:teuthology.orchestra.run.gibba031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T19:20:52.174 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:20:52.174 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T19:20:52.196 DEBUG:teuthology.orchestra.run.gibba018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T19:20:52.205 DEBUG:teuthology.orchestra.run.gibba018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T19:20:52.209 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:20:52.209 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T19:20:52.268 DEBUG:teuthology.orchestra.run.gibba017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T19:20:52.277 DEBUG:teuthology.orchestra.run.gibba017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T19:20:52.322 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:20:52.322 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T19:20:52.343 DEBUG:teuthology.orchestra.run.gibba011:> sudo service rsyslog restart 2021-11-15T19:20:52.347 DEBUG:teuthology.orchestra.run.gibba017:> sudo service rsyslog restart 2021-11-15T19:20:52.349 DEBUG:teuthology.orchestra.run.gibba018:> sudo service rsyslog restart 2021-11-15T19:20:52.353 DEBUG:teuthology.orchestra.run.gibba031:> sudo service rsyslog restart 2021-11-15T19:20:52.356 DEBUG:teuthology.orchestra.run.gibba037:> sudo service rsyslog restart 2021-11-15T19:20:52.391 INFO:teuthology.run_tasks:Running task internal.timer... 2021-11-15T19:20:52.403 INFO:teuthology.task.internal:Starting timer... 2021-11-15T19:20:52.403 INFO:teuthology.run_tasks:Running task pcp... 2021-11-15T19:20:52.429 INFO:teuthology.run_tasks:Running task selinux... 2021-11-15T19:20:52.459 DEBUG:teuthology.task.selinux:Excluding gibba037: OS 'ubuntu' does not support SELinux 2021-11-15T19:20:52.460 DEBUG:teuthology.task.selinux:Excluding gibba011: OS 'ubuntu' does not support SELinux 2021-11-15T19:20:52.460 DEBUG:teuthology.task.selinux:Excluding gibba031: OS 'ubuntu' does not support SELinux 2021-11-15T19:20:52.460 DEBUG:teuthology.task.selinux:Excluding gibba018: OS 'ubuntu' does not support SELinux 2021-11-15T19:20:52.461 DEBUG:teuthology.task.selinux:Excluding gibba017: OS 'ubuntu' does not support SELinux 2021-11-15T19:20:52.461 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-11-15T19:20:52.461 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-11-15T19:20:52.461 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-11-15T19:20:52.462 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-11-15T19:20:52.493 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-11-15T19:20:52.499 INFO:teuthology.repo_utils:Fetching master from origin 2021-11-15T19:20:52.532 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-11-15T19:20:52.551 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-11-15T19:20:52.553 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba037.front.sepia.ceph.com,gibba011.front.sepia.ceph.com,gibba031.front.sepia.ceph.com,gibba018.front.sepia.ceph.com,gibba017.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-11-15T19:20:52.925 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-11-15T19:20:53.686 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-11-15T19:20:56.387 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-11-15T19:20:56.497 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:56 +0000 (0:00:00.124) 0:00:00.125 ******* 2021-11-15T19:20:56.510 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:56 +0000 (0:00:00.013) 0:00:00.138 ******* 2021-11-15T19:20:56.522 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:56 +0000 (0:00:00.011) 0:00:00.149 ******* 2021-11-15T19:20:56.533 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:56 +0000 (0:00:00.011) 0:00:00.161 ******* 2021-11-15T19:20:56.545 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:56 +0000 (0:00:00.011) 0:00:00.173 ******* 2021-11-15T19:20:58.192 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-15T19:20:58.194 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba018.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba018.front.sepia.ceph.com] 2021-11-15T19:20:58.246 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:01.700) 0:00:01.873 ******* 2021-11-15T19:20:58.256 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba037.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba037.front.sepia.ceph.com] 2021-11-15T19:20:58.269 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba017.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba017.front.sepia.ceph.com] 2021-11-15T19:20:58.279 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba031.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba031.front.sepia.ceph.com] 2021-11-15T19:20:58.354 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.108) 0:00:01.981 ******* 2021-11-15T19:20:58.373 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.019) 0:00:02.001 ******* 2021-11-15T19:20:58.394 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.021) 0:00:02.022 ******* 2021-11-15T19:20:58.405 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba011.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba011.front.sepia.ceph.com] 2021-11-15T19:20:58.414 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-11-15T19:20:58.415 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:20:58.450 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.055) 0:00:02.077 ******* 2021-11-15T19:20:58.457 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:20:58.481 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.030) 0:00:02.108 ******* 2021-11-15T19:20:58.504 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.023) 0:00:02.132 ******* 2021-11-15T19:20:58.511 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:20:58.512 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:20:58.537 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.032) 0:00:02.164 ******* 2021-11-15T19:20:58.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.019) 0:00:02.183 ******* 2021-11-15T19:20:58.583 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:20:58.608 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.051) 0:00:02.235 ******* 2021-11-15T19:20:58.888 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-11-15T19:20:58.890 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T19:20:58.892 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T19:20:58.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.307) 0:00:02.543 ******* 2021-11-15T19:20:58.941 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.025) 0:00:02.568 ******* 2021-11-15T19:20:58.948 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T19:20:58.949 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T19:20:58.951 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T19:20:58.977 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.036) 0:00:02.605 ******* 2021-11-15T19:20:58.998 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:58 +0000 (0:00:00.020) 0:00:02.625 ******* 2021-11-15T19:20:59.018 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.019) 0:00:02.645 ******* 2021-11-15T19:20:59.026 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-11-15T19:20:59.028 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:20:59.051 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.033) 0:00:02.678 ******* 2021-11-15T19:20:59.071 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.020) 0:00:02.699 ******* 2021-11-15T19:20:59.077 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:20:59.079 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:20:59.103 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.031) 0:00:02.731 ******* 2021-11-15T19:20:59.123 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.019) 0:00:02.750 ******* 2021-11-15T19:20:59.129 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:20:59.154 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.031) 0:00:02.782 ******* 2021-11-15T19:20:59.223 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:20:59.224 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:20:59.225 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:20:59.249 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.094) 0:00:02.876 ******* 2021-11-15T19:20:59.268 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.018) 0:00:02.895 ******* 2021-11-15T19:20:59.292 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.024) 0:00:02.919 ******* 2021-11-15T19:20:59.313 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.020) 0:00:02.940 ******* 2021-11-15T19:20:59.320 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:20:59.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:20:59 +0000 (0:00:00.032) 0:00:02.972 ******* 2021-11-15T19:20:59.985 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-11-15T19:20:59.987 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T19:21:00.007 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:00 +0000 (0:00:00.662) 0:00:03.635 ******* 2021-11-15T19:21:00.014 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T19:21:00.015 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T19:21:00.017 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T19:21:00.017 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T19:21:00.042 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:00 +0000 (0:00:00.034) 0:00:03.669 ******* 2021-11-15T19:21:00.064 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:00 +0000 (0:00:00.022) 0:00:03.692 ******* 2021-11-15T19:21:00.087 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:00 +0000 (0:00:00.022) 0:00:03.714 ******* 2021-11-15T19:21:00.110 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:00 +0000 (0:00:00.022) 0:00:03.737 ******* 2021-11-15T19:21:00.431 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-11-15T19:21:00.433 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-15T19:21:00.434 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.c 2021-11-15T19:21:00.436 INFO:teuthology.task.ansible.out:om\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ak 2021-11-15T19:21:00.438 INFO:teuthology.task.ansible.out:lap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-15T19:21:00.470 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-15T19:21:00.472 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.c 2021-11-15T19:21:00.474 INFO:teuthology.task.ansible.out:om\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ak 2021-11-15T19:21:00.475 INFO:teuthology.task.ansible.out:lap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-15T19:21:00.525 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-15T19:21:00.527 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-15T19:21:00.611 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-11-15T19:21:00.612 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-15T19:21:00.627 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-15T19:21:00.629 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:00 +0000 (0:00:00.517) 0:00:04.255 ******* 2021-11-15T19:21:01.084 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] 2021-11-15T19:21:01.105 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] 2021-11-15T19:21:01.125 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] 2021-11-15T19:21:01.146 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] 2021-11-15T19:21:01.155 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] 2021-11-15T19:21:01.174 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-11-15T19:21:01.175 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:01 +0000 (0:00:00.546) 0:00:04.801 ******* 2021-11-15T19:21:01.199 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T19:21:01.221 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T19:21:01.241 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T19:21:01.260 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T19:21:01.271 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T19:21:01.276 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-15T19:21:01.420 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:01 +0000 (0:00:00.246) 0:00:05.048 ******* 2021-11-15T19:21:01.440 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:01 +0000 (0:00:00.019) 0:00:05.068 ******* 2021-11-15T19:21:01.462 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:01 +0000 (0:00:00.020) 0:00:05.089 ******* 2021-11-15T19:21:01.482 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:01 +0000 (0:00:00.020) 0:00:05.110 ******* 2021-11-15T19:21:01.509 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:01 +0000 (0:00:00.026) 0:00:05.136 ******* 2021-11-15T19:21:02.124 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba011.front.sepia.ceph.com] 2021-11-15T19:21:02.162 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] 2021-11-15T19:21:02.213 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-11-15T19:21:02.215 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.704) 0:00:05.840 ******* 2021-11-15T19:21:02.239 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] 2021-11-15T19:21:02.250 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] 2021-11-15T19:21:02.396 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.182) 0:00:06.023 ******* 2021-11-15T19:21:02.435 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] 2021-11-15T19:21:02.467 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.070) 0:00:06.094 ******* 2021-11-15T19:21:02.491 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.024) 0:00:06.118 ******* 2021-11-15T19:21:02.538 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.047) 0:00:06.166 ******* 2021-11-15T19:21:02.838 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-15T19:21:02.840 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.214467", "end": "2021-11-15 19:21:02.819525", "rc": 0, "start": "2021-11-15 19:21:02.605058", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T19:21:02.862 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.323) 0:00:06.489 ******* 2021-11-15T19:21:02.900 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.270032", "end": "2021-11-15 19:21:02.873658", "rc": 0, "start": "2021-11-15 19:21:02.603626", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T19:21:02.925 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.063) 0:00:06.553 ******* 2021-11-15T19:21:02.933 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.197456", "end": "2021-11-15 19:21:02.891377", "rc": 0, "start": "2021-11-15 19:21:02.693921", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T19:21:02.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.039) 0:00:06.592 ******* 2021-11-15T19:21:02.974 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.256360", "end": "2021-11-15 19:21:02.928849", "rc": 0, "start": "2021-11-15 19:21:02.672489", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T19:21:02.999 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:02 +0000 (0:00:00.034) 0:00:06.627 ******* 2021-11-15T19:21:03.006 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-15T19:21:03.008 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007860", "end": "2021-11-15 19:21:02.517616", "failed_when_result": false, "rc": 0, "start": "2021-11-15 19:21:02.509756", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.200355", "end": "2021-11-15 19:21:02.963389", "rc": 0, "start": "2021-11-15 19:21:02.763034", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T19:21:03.035 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.035) 0:00:06.662 ******* 2021-11-15T19:21:03.059 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.023) 0:00:06.686 ******* 2021-11-15T19:21:03.066 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-15T19:21:03.068 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008994", "end": "2021-11-15 19:21:03.166955", "failed_when_result": false, "rc": 0, "start": "2021-11-15 19:21:03.157961", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-15T19:21:03.069 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.002309", "end": "2021-11-15 19:21:02.718412", "failed_when_result": false, "rc": 0, "start": "2021-11-15 19:21:02.716103", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-15T19:21:03.095 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.036) 0:00:06.723 ******* 2021-11-15T19:21:03.120 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.024) 0:00:06.747 ******* 2021-11-15T19:21:03.126 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-15T19:21:03.128 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.004714", "end": "2021-11-15 19:21:03.212501", "failed_when_result": false, "rc": 0, "start": "2021-11-15 19:21:03.207787", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-15T19:21:03.153 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.032) 0:00:06.780 ******* 2021-11-15T19:21:03.175 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.022) 0:00:06.803 ******* 2021-11-15T19:21:03.182 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-15T19:21:03.184 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006964", "end": "2021-11-15 19:21:03.616608", "failed_when_result": false, "rc": 0, "start": "2021-11-15 19:21:03.609644", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-15T19:21:03.184 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.213 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.037) 0:00:06.840 ******* 2021-11-15T19:21:03.238 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.025) 0:00:06.865 ******* 2021-11-15T19:21:03.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.021) 0:00:06.887 ******* 2021-11-15T19:21:03.267 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-15T19:21:03.268 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.294 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.034) 0:00:06.922 ******* 2021-11-15T19:21:03.326 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.031) 0:00:06.953 ******* 2021-11-15T19:21:03.335 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-15T19:21:03.337 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.364 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.037) 0:00:06.991 ******* 2021-11-15T19:21:03.387 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.022) 0:00:07.014 ******* 2021-11-15T19:21:03.410 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.023) 0:00:07.037 ******* 2021-11-15T19:21:03.418 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-15T19:21:03.420 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.444 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.034) 0:00:07.072 ******* 2021-11-15T19:21:03.466 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.021) 0:00:07.093 ******* 2021-11-15T19:21:03.473 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-15T19:21:03.475 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.502 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.035) 0:00:07.129 ******* 2021-11-15T19:21:03.526 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.024) 0:00:07.153 ******* 2021-11-15T19:21:03.534 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-15T19:21:03.536 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.562 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.035) 0:00:07.189 ******* 2021-11-15T19:21:03.583 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.021) 0:00:07.211 ******* 2021-11-15T19:21:03.605 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.021) 0:00:07.232 ******* 2021-11-15T19:21:03.612 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-15T19:21:03.613 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.639 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.034) 0:00:07.267 ******* 2021-11-15T19:21:03.669 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.029) 0:00:07.297 ******* 2021-11-15T19:21:03.676 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T19:21:03.678 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.704 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.034) 0:00:07.331 ******* 2021-11-15T19:21:03.727 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.022) 0:00:07.354 ******* 2021-11-15T19:21:03.750 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.023) 0:00:07.378 ******* 2021-11-15T19:21:03.758 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T19:21:03.760 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.786 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.035) 0:00:07.414 ******* 2021-11-15T19:21:03.809 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.022) 0:00:07.437 ******* 2021-11-15T19:21:03.816 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:03.842 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.033) 0:00:07.470 ******* 2021-11-15T19:21:03.849 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-15T19:21:03.851 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* ok: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:21:03.876 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.033) 0:00:07.504 ******* 2021-11-15T19:21:03.908 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.031) 0:00:07.535 ******* 2021-11-15T19:21:03.928 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:21:03.953 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.045) 0:00:07.581 ******* 2021-11-15T19:21:03.960 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:21:03.988 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:03 +0000 (0:00:00.035) 0:00:07.616 ******* 2021-11-15T19:21:03.996 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T19:21:03.998 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* ok: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:21:04.025 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:04 +0000 (0:00:00.036) 0:00:07.653 ******* 2021-11-15T19:21:04.056 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:04 +0000 (0:00:00.030) 0:00:07.683 ******* 2021-11-15T19:21:04.105 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-15T19:21:04.107 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T19:21:04.138 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T19:21:04.192 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T19:21:04.194 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:21:04.222 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:04 +0000 (0:00:00.166) 0:00:07.850 ******* 2021-11-15T19:21:04.229 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-15T19:21:04.230 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T19:21:04.231 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T19:21:04.232 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T19:21:04.286 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T19:21:04.287 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T19:21:04.299 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T19:21:04.321 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T19:21:04.375 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T19:21:04.376 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T19:21:04.398 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T19:21:04.409 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T19:21:04.410 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T19:21:04.464 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T19:21:04.475 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T19:21:04.497 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T19:21:04.509 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T19:21:04.520 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T19:21:04.563 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T19:21:04.564 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T19:21:04.596 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T19:21:04.597 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T19:21:04.619 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T19:21:04.652 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T19:21:04.653 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T19:21:04.685 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T19:21:04.687 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T19:21:04.708 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T19:21:04.751 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T19:21:04.785 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T19:21:04.786 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T19:21:04.797 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T19:21:04.829 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T19:21:04.841 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T19:21:04.873 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T19:21:04.885 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T19:21:04.886 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T19:21:04.918 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T19:21:04.929 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T19:21:04.972 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T19:21:04.973 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T19:21:04.975 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T19:21:05.017 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T19:21:05.018 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T19:21:05.061 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T19:21:05.072 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T19:21:05.094 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T19:21:05.106 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T19:21:05.107 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T19:21:05.160 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T19:21:05.162 INFO:teuthology.task.ansible.out: ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T19:21:05.185 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T19:21:05.197 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T19:21:05.209 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T19:21:05.253 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T19:21:05.254 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T19:21:05.287 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T19:21:05.299 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T19:21:05.300 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T19:21:05.353 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T19:21:05.355 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T19:21:05.376 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T19:21:05.388 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T19:21:05.389 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T19:21:05.442 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T19:21:05.444 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T19:21:05.466 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T19:21:05.478 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T19:21:05.479 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T19:21:05.532 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T19:21:05.543 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T19:21:05.555 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T19:21:05.577 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T19:21:05.578 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T19:21:05.621 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T19:21:05.632 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T19:21:05.654 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T19:21:05.665 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T19:21:05.677 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T19:21:05.709 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T19:21:05.731 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T19:21:05.743 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T19:21:05.754 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T19:21:05.765 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T19:21:05.798 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T19:21:05.820 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T19:21:05.831 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T19:21:05.842 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T19:21:05.854 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T19:21:05.886 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T19:21:05.908 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T19:21:05.920 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T19:21:05.942 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T19:21:05.943 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T19:21:05.986 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T19:21:06.009 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T19:21:06.011 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T19:21:06.032 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T19:21:06.033 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T19:21:06.076 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T19:21:06.098 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T19:21:06.120 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T19:21:06.121 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T19:21:06.132 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T19:21:06.165 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T19:21:06.187 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T19:21:06.209 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T19:21:06.220 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T19:21:06.232 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T19:21:06.254 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T19:21:06.287 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T19:21:06.309 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T19:21:06.310 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T19:21:06.321 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T19:21:06.354 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T19:21:06.386 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T19:21:06.398 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T19:21:06.399 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T19:21:06.421 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T19:21:06.453 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T19:21:06.476 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T19:21:06.488 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T19:21:06.489 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T19:21:06.511 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T19:21:06.544 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T19:21:06.566 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T19:21:06.578 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T19:21:06.589 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T19:21:06.601 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T19:21:06.634 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T19:21:06.656 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T19:21:06.668 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T19:21:06.679 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T19:21:06.691 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T19:21:06.723 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T19:21:06.745 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T19:21:06.767 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T19:21:06.769 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T19:21:06.781 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T19:21:06.814 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T19:21:06.847 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T19:21:06.859 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T19:21:06.861 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T19:21:06.873 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T19:21:06.905 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T19:21:06.948 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T19:21:06.961 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T19:21:06.962 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T19:21:06.964 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T19:21:06.997 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T19:21:07.051 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T19:21:07.053 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T19:21:07.054 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T19:21:07.056 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T19:21:07.087 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T19:21:07.141 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T19:21:07.142 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T19:21:07.144 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T19:21:07.145 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T19:21:07.177 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T19:21:07.230 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T19:21:07.231 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T19:21:07.233 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:07.233 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T19:21:07.265 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T19:21:07.328 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T19:21:07.329 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T19:21:07.331 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:07.363 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T19:21:07.364 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T19:21:07.418 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T19:21:07.420 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:07.453 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T19:21:07.454 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T19:21:07.455 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:07.509 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T19:21:07.511 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T19:21:07.543 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T19:21:07.545 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:07.546 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T19:21:07.599 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T19:21:07.610 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T19:21:07.633 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T19:21:07.635 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T19:21:07.637 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T19:21:07.691 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T19:21:07.703 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T19:21:07.726 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T19:21:07.727 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T19:21:07.738 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T19:21:07.792 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T19:21:07.814 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T19:21:07.815 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T19:21:07.837 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T19:21:07.858 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T19:21:07.891 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T19:21:07.913 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T19:21:07.914 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T19:21:07.936 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T19:21:07.947 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T19:21:07.980 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T19:21:08.002 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T19:21:08.014 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T19:21:08.025 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:08.036 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T19:21:08.069 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T19:21:08.090 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T19:21:08.102 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:08.134 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T19:21:08.157 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:08.158 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T19:21:08.190 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T19:21:08.222 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:08.223 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T19:21:08.256 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T19:21:08.257 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T19:21:08.279 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:08.312 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T19:21:08.323 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T19:21:08.346 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T19:21:08.347 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T19:21:08.380 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T19:21:08.402 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T19:21:08.403 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T19:21:08.435 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T19:21:08.447 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T19:21:08.469 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T19:21:08.501 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T19:21:08.502 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T19:21:08.534 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T19:21:08.535 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T19:21:08.557 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T19:21:08.589 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T19:21:08.590 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T19:21:08.622 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T19:21:08.624 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T19:21:08.645 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T19:21:08.688 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T19:21:08.710 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T19:21:08.711 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T19:21:08.722 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T19:21:08.734 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T19:21:08.777 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T19:21:08.799 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T19:21:08.810 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T19:21:08.811 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T19:21:08.823 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T19:21:08.876 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T19:21:08.898 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T19:21:08.899 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T19:21:08.911 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T19:21:08.922 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T19:21:08.996 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T19:21:08.997 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T19:21:08.999 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T19:21:09.010 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T19:21:09.011 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T19:21:09.096 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T19:21:09.096 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T19:21:09.098 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T19:21:09.109 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T19:21:09.120 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T19:21:09.195 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T19:21:09.196 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T19:21:09.198 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T19:21:09.198 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T19:21:09.210 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T19:21:09.284 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T19:21:09.295 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T19:21:09.296 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T19:21:09.298 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T19:21:09.309 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T19:21:09.372 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T19:21:09.384 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T19:21:09.385 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T19:21:09.387 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T19:21:09.397 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T19:21:09.461 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T19:21:09.483 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T19:21:09.484 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T19:21:09.486 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T19:21:09.518 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T19:21:09.560 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T19:21:09.572 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T19:21:09.583 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T19:21:09.584 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T19:21:09.606 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T19:21:09.649 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:09.671 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T19:21:09.672 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T19:21:09.684 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T19:21:09.696 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T19:21:09.739 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T19:21:09.761 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:09.763 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T19:21:09.765 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T19:21:09.786 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:09.829 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T19:21:09.851 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T19:21:09.863 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:09.865 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T19:21:09.898 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T19:21:09.925 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T19:21:09.947 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T19:21:09.948 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T19:21:09.960 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T19:21:09.992 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T19:21:10.015 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T19:21:10.047 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T19:21:10.048 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T19:21:10.060 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T19:21:10.092 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T19:21:10.103 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T19:21:10.136 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T19:21:10.148 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T19:21:10.149 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T19:21:10.181 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T19:21:10.204 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T19:21:10.238 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T19:21:10.240 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T19:21:10.252 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T19:21:10.274 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T19:21:10.296 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T19:21:10.328 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T19:21:10.340 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T19:21:10.362 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T19:21:10.363 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T19:21:10.395 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T19:21:10.418 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T19:21:10.429 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T19:21:10.462 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T19:21:10.464 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T19:21:10.487 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T19:21:10.508 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T19:21:10.520 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T19:21:10.553 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T19:21:10.554 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T19:21:10.577 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T19:21:10.599 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T19:21:10.610 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T19:21:10.643 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T19:21:10.676 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T19:21:10.688 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T19:21:10.699 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T19:21:10.732 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T19:21:10.733 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T19:21:10.765 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T19:21:10.777 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T19:21:10.799 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T19:21:10.834 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T19:21:10.836 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T19:21:10.857 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T19:21:10.869 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T19:21:10.891 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T19:21:10.924 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T19:21:10.926 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T19:21:10.947 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T19:21:10.959 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T19:21:10.991 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T19:21:11.013 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T19:21:11.015 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T19:21:11.047 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T19:21:11.059 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T19:21:11.081 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T19:21:11.113 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T19:21:11.114 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T19:21:11.147 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T19:21:11.179 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T19:21:11.190 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T19:21:11.202 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T19:21:11.203 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T19:21:11.235 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T19:21:11.279 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T19:21:11.280 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T19:21:11.292 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T19:21:11.303 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T19:21:11.357 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T19:21:11.389 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T19:21:11.390 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T19:21:11.402 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T19:21:11.413 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T19:21:11.456 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T19:21:11.479 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T19:21:11.480 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T19:21:11.502 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T19:21:11.524 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T19:21:11.557 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T19:21:11.579 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T19:21:11.580 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T19:21:11.591 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T19:21:11.613 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T19:21:11.645 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T19:21:11.667 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T19:21:11.678 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T19:21:11.690 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T19:21:11.701 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T19:21:11.734 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T19:21:11.756 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T19:21:11.767 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T19:21:11.779 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T19:21:11.801 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T19:21:11.823 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T19:21:11.855 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T19:21:11.856 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T19:21:11.868 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T19:21:11.891 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T19:21:11.913 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T19:21:11.945 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T19:21:11.946 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T19:21:11.968 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T19:21:11.980 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T19:21:12.033 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T19:21:12.034 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T19:21:12.035 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T19:21:12.056 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T19:21:12.068 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T19:21:12.131 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T19:21:12.132 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T19:21:12.134 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-15T19:21:12.144 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T19:21:12.318 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma" 2021-11-15T19:21:12.320 INFO:teuthology.task.ansible.out:, "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@s 2021-11-15T19:21:12.322 INFO:teuthology.task.ansible.out:use Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T19:21:12.331 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T19:21:12.344 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T19:21:12.346 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T19:21:12.400 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T19:21:12.411 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-15T19:21:12.433 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T19:21:12.434 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T19:21:12.445 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T19:21:12.499 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T19:21:12.500 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T19:21:12.522 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T19:21:12.533 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T19:21:12.534 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T19:21:12.587 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T19:21:12.599 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T19:21:12.600 INFO:teuthology.task.ansible.out: 2021-11-15T19:21:12.621 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T19:21:12.622 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T19:21:12.623 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T19:21:12.686 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T19:21:12.719 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T19:21:12.720 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T19:21:12.722 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T19:21:12.732 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T19:21:12.775 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T19:21:12.817 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T19:21:12.819 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T19:21:12.820 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T19:21:12.842 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T19:21:12.864 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T19:21:12.907 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T19:21:12.908 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T19:21:12.920 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T19:21:12.942 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T19:21:12.965 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T19:21:12.998 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T19:21:12.999 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T19:21:13.010 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T19:21:13.043 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T19:21:13.086 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T19:21:13.098 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:13.099 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T19:21:13.101 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T19:21:13.132 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T19:21:13.186 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T19:21:13.187 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T19:21:13.189 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:13.200 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:13.222 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T19:21:13.276 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T19:21:13.288 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T19:21:13.290 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T19:21:13.322 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:13.323 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T19:21:13.376 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T19:21:13.377 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T19:21:13.389 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T19:21:13.411 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T19:21:13.412 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T19:21:13.476 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T19:21:13.477 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T19:21:13.509 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T19:21:13.510 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T19:21:13.512 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T19:21:13.564 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T19:21:13.576 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T19:21:13.598 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T19:21:13.599 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T19:21:13.601 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T19:21:13.664 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T19:21:13.665 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T19:21:13.688 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T19:21:13.690 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T19:21:13.692 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T19:21:13.756 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T19:21:13.757 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T19:21:13.779 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T19:21:13.780 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T19:21:13.792 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T19:21:13.845 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T19:21:13.867 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T19:21:13.878 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T19:21:13.879 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T19:21:13.891 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T19:21:13.934 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T19:21:13.956 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T19:21:13.967 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T19:21:13.979 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T19:21:13.980 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T19:21:14.023 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T19:21:14.055 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T19:21:14.067 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T19:21:14.069 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T19:21:14.080 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T19:21:14.144 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T19:21:14.156 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T19:21:14.157 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T19:21:14.168 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T19:21:14.169 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T19:21:14.244 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T19:21:14.257 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T19:21:14.259 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T19:21:14.260 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T19:21:14.272 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T19:21:14.326 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T19:21:14.337 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T19:21:14.349 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T19:21:14.350 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T19:21:14.361 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T19:21:14.436 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T19:21:14.437 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T19:21:14.449 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T19:21:14.460 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T19:21:14.462 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T19:21:14.525 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T19:21:14.537 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T19:21:14.548 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T19:21:14.549 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T19:21:14.571 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T19:21:14.624 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T19:21:14.625 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T19:21:14.647 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T19:21:14.648 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T19:21:14.670 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T19:21:14.734 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T19:21:14.735 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T19:21:14.737 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T19:21:14.747 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T19:21:14.790 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T19:21:14.822 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T19:21:14.823 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T19:21:14.835 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T19:21:14.836 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T19:21:14.879 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T19:21:14.922 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T19:21:14.923 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T19:21:14.935 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T19:21:14.936 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T19:21:14.968 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T19:21:15.011 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T19:21:15.033 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T19:21:15.034 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T19:21:15.056 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T19:21:15.057 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T19:21:15.110 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T19:21:15.122 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T19:21:15.134 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T19:21:15.156 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T19:21:15.157 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T19:21:15.212 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T19:21:15.224 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T19:21:15.245 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T19:21:15.246 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T19:21:15.258 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T19:21:15.311 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T19:21:15.323 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T19:21:15.335 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T19:21:15.346 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T19:21:15.347 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T19:21:15.401 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T19:21:15.412 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T19:21:15.434 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T19:21:15.446 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T19:21:15.468 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T19:21:15.501 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T19:21:15.534 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T19:21:15.535 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T19:21:15.536 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T19:21:15.558 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T19:21:15.622 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T19:21:15.623 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T19:21:15.624 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T19:21:15.625 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T19:21:15.688 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T19:21:15.710 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T19:21:15.711 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T19:21:15.723 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T19:21:15.755 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T19:21:15.787 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T19:21:15.809 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T19:21:15.810 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T19:21:15.812 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T19:21:15.843 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T19:21:15.875 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T19:21:15.908 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T19:21:15.909 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T19:21:15.910 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T19:21:15.931 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T19:21:15.964 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T19:21:15.996 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T19:21:15.997 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T19:21:16.009 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T19:21:16.031 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T19:21:16.064 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T19:21:16.096 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T19:21:16.097 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T19:21:16.119 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T19:21:16.120 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T19:21:16.152 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T19:21:16.184 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T19:21:16.195 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T19:21:16.218 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T19:21:16.230 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T19:21:16.242 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T19:21:16.274 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T19:21:16.285 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T19:21:16.307 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T19:21:16.329 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T19:21:16.341 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T19:21:16.363 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T19:21:16.374 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T19:21:16.407 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T19:21:16.428 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T19:21:16.440 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T19:21:16.472 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T19:21:16.494 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T19:21:16.495 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T19:21:16.517 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T19:21:16.539 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T19:21:16.561 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T19:21:16.583 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T19:21:16.584 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T19:21:16.606 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T19:21:16.638 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T19:21:16.660 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T19:21:16.672 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T19:21:16.683 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T19:21:16.705 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T19:21:16.727 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T19:21:16.749 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T19:21:16.771 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T19:21:16.782 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T19:21:16.794 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T19:21:16.816 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T19:21:16.848 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T19:21:16.870 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T19:21:16.892 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T19:21:16.893 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T19:21:16.904 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T19:21:16.936 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T19:21:16.969 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T19:21:16.990 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T19:21:16.991 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T19:21:17.003 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T19:21:17.025 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T19:21:17.067 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T19:21:17.089 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T19:21:17.090 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T19:21:17.092 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T19:21:17.124 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T19:21:17.156 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T19:21:17.179 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T19:21:17.190 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T19:21:17.192 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T19:21:17.213 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T19:21:17.256 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T19:21:17.278 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T19:21:17.279 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T19:21:17.281 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T19:21:17.313 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T19:21:17.345 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T19:21:17.367 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T19:21:17.378 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T19:21:17.379 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T19:21:17.401 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T19:21:17.434 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T19:21:17.456 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T19:21:17.467 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T19:21:17.468 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T19:21:17.490 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T19:21:17.533 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T19:21:17.544 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T19:21:17.555 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T19:21:17.557 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T19:21:17.578 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T19:21:17.621 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T19:21:17.643 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T19:21:17.644 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T19:21:17.676 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T19:21:17.688 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T19:21:17.720 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T19:21:17.732 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T19:21:17.743 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T19:21:17.765 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T19:21:17.787 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T19:21:17.819 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T19:21:17.831 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T19:21:17.842 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T19:21:17.864 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T19:21:17.886 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T19:21:17.908 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T19:21:17.920 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T19:21:17.931 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T19:21:17.963 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T19:21:17.975 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T19:21:17.997 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T19:21:18.019 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T19:21:18.041 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T19:21:18.052 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T19:21:18.064 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T19:21:18.096 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T19:21:18.118 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T19:21:18.140 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T19:21:18.141 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T19:21:18.163 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T19:21:18.185 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T19:21:18.207 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T19:21:18.228 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T19:21:18.240 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T19:21:18.262 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T19:21:18.284 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T19:21:18.295 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T19:21:18.317 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T19:21:18.339 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T19:21:18.350 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T19:21:18.372 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T19:21:18.384 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T19:21:18.416 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T19:21:18.438 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T19:21:18.439 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T19:21:18.472 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T19:21:18.515 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T19:21:18.516 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T19:21:18.528 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T19:21:18.540 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T19:21:18.562 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T19:21:18.605 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T19:21:18.606 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T19:21:18.628 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T19:21:18.629 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T19:21:18.692 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T19:21:18.714 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T19:21:18.715 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T19:21:18.727 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T19:21:18.822 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T19:21:18.907 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T19:21:19.178 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T19:21:19.451 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T19:21:19.534 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T19:21:19.535 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T19:21:19.677 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T19:21:19.769 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:15.546) 0:00:23.396 ******* 2021-11-15T19:21:19.793 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.024) 0:00:23.421 ******* 2021-11-15T19:21:19.819 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.025) 0:00:23.446 ******* 2021-11-15T19:21:19.843 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.024) 0:00:23.470 ******* 2021-11-15T19:21:19.868 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.024) 0:00:23.495 ******* 2021-11-15T19:21:19.874 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-15T19:21:19.919 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.051) 0:00:23.547 ******* 2021-11-15T19:21:19.943 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.023) 0:00:23.570 ******* 2021-11-15T19:21:19.977 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.034) 0:00:23.604 ******* 2021-11-15T19:21:20.000 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:19 +0000 (0:00:00.023) 0:00:23.628 ******* 2021-11-15T19:21:20.025 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.024) 0:00:23.653 ******* 2021-11-15T19:21:20.034 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-15T19:21:20.037 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T19:21:20.038 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T19:21:20.040 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T19:21:20.042 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T19:21:20.043 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "va 2021-11-15T19:21:20.044 INFO:teuthology.task.ansible.out:su", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T19:21:20.045 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T19:21:20.047 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T19:21:20.048 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T19:21:20.050 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T19:21:20.052 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "kh 2021-11-15T19:21:20.052 INFO:teuthology.task.ansible.out:iremat@kotresh-T490s 7o9Jje 2021-11-15T19:21:20.054 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T19:21:20.056 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T19:21:20.058 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T19:21:20.059 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9 2021-11-15T19:21:20.061 INFO:teuthology.task.ansible.out:fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b95 2021-11-15T19:21:20.062 INFO:teuthology.task.ansible.out:17faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai 2021-11-15T19:21:20.064 INFO:teuthology.task.ansible.out:YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@adm 2021-11-15T19:21:20.066 INFO:teuthology.task.ansible.out:in-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca45 2021-11-15T19:21:20.067 INFO:teuthology.task.ansible.out:5b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb2802992184 2021-11-15T19:21:20.069 INFO:teuthology.task.ansible.out:41a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d48 2021-11-15T19:21:20.069 INFO:teuthology.task.ansible.out:1f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135af 2021-11-15T19:21:20.071 INFO:teuthology.task.ansible.out:df4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, 2021-11-15T19:21:20.073 INFO:teuthology.task.ansible.out: {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepik 2021-11-15T19:21:20.074 INFO:teuthology.task.ansible.out:a", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, { 2021-11-15T19:21:20.076 INFO:teuthology.task.ansible.out:"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432a 2021-11-15T19:21:20.076 INFO:teuthology.task.ansible.out:ac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7e 2021-11-15T19:21:20.078 INFO:teuthology.task.ansible.out:b3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@ 2021-11-15T19:21:20.079 INFO:teuthology.task.ansible.out:localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052 2021-11-15T19:21:20.081 INFO:teuthology.task.ansible.out:887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdi 2021-11-15T19:21:20.083 INFO:teuthology.task.ansible.out:azbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-15T19:21:20.087 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T19:21:20.089 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T19:21:20.090 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T19:21:20.092 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T19:21:20.093 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-15T19:21:20.094 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T19:21:20.096 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T19:21:20.097 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T19:21:20.099 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T19:21:20.100 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T19:21:20.102 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-15T19:21:20.104 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T19:21:20.105 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T19:21:20.107 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T19:21:20.108 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9 2021-11-15T19:21:20.110 INFO:teuthology.task.ansible.out:fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b95 2021-11-15T19:21:20.112 INFO:teuthology.task.ansible.out:17faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai 2021-11-15T19:21:20.113 INFO:teuthology.task.ansible.out:YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@adm 2021-11-15T19:21:20.115 INFO:teuthology.task.ansible.out:in-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-15T19:21:20.115 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca45 2021-11-15T19:21:20.117 INFO:teuthology.task.ansible.out:5b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb2802992184 2021-11-15T19:21:20.118 INFO:teuthology.task.ansible.out:41a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135af 2021-11-15T19:21:20.120 INFO:teuthology.task.ansible.out:df4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, 2021-11-15T19:21:20.122 INFO:teuthology.task.ansible.out: {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"n 2021-11-15T19:21:20.122 INFO:teuthology.task.ansible.out:ame": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepik 2021-11-15T19:21:20.124 INFO:teuthology.task.ansible.out:a", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, { 2021-11-15T19:21:20.126 INFO:teuthology.task.ansible.out:"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7e 2021-11-15T19:21:20.127 INFO:teuthology.task.ansible.out:b3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@ 2021-11-15T19:21:20.129 INFO:teuthology.task.ansible.out:localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e52 2021-11-15T19:21:20.129 INFO:teuthology.task.ansible.out:99298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052 2021-11-15T19:21:20.131 INFO:teuthology.task.ansible.out:887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdi 2021-11-15T19:21:20.132 INFO:teuthology.task.ansible.out:azbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-15T19:21:20.135 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T19:21:20.137 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T19:21:20.138 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T19:21:20.140 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T19:21:20.141 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-15T19:21:20.142 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T19:21:20.143 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T19:21:20.145 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T19:21:20.147 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T19:21:20.148 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T19:21:20.150 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-15T19:21:20.151 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T19:21:20.153 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T19:21:20.155 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e52 2021-11-15T19:21:20.155 INFO:teuthology.task.ansible.out:99298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T19:21:20.157 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-15T19:21:20.181 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.156) 0:00:23.809 ******* 2021-11-15T19:21:20.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.026) 0:00:23.835 ******* 2021-11-15T19:21:20.233 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.025) 0:00:23.861 ******* 2021-11-15T19:21:20.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.026) 0:00:23.888 ******* 2021-11-15T19:21:20.286 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.026) 0:00:23.914 ******* 2021-11-15T19:21:20.912 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-15T19:21:20.913 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T19:21:20.936 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.649) 0:00:24.563 ******* 2021-11-15T19:21:20.944 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T19:21:20.946 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T19:21:20.947 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T19:21:20.973 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.037) 0:00:24.601 ******* 2021-11-15T19:21:20.997 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:20 +0000 (0:00:00.024) 0:00:24.625 ******* 2021-11-15T19:21:21.020 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:21 +0000 (0:00:00.022) 0:00:24.648 ******* 2021-11-15T19:21:21.028 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T19:21:21.064 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:21 +0000 (0:00:00.044) 0:00:24.692 ******* 2021-11-15T19:21:21.154 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T19:21:21.156 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T19:21:21.166 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T19:21:21.209 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T19:21:21.241 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T19:21:21.263 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T19:21:21.265 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUI 2021-11-15T19:21:21.267 INFO:teuthology.task.ansible.out:S2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T19:21:21.307 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T19:21:21.361 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T19:21:21.363 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T19:21:21.373 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T19:21:21.375 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T19:21:21.417 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T19:21:21.459 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T19:21:21.461 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T19:21:21.470 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T19:21:21.482 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T19:21:21.484 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T19:21:21.503 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T19:21:21.525 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T19:21:21.527 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T19:21:21.568 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T19:21:21.579 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T19:21:21.581 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T19:21:21.590 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T19:21:21.592 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T19:21:21.622 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T19:21:21.654 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T19:21:21.666 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T19:21:21.667 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T19:21:21.677 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T19:21:21.709 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T19:21:21.731 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T19:21:21.732 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T19:21:21.773 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T19:21:21.774 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T19:21:21.776 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T19:21:21.785 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T19:21:21.787 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T19:21:21.838 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T19:21:21.840 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T19:21:21.841 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T19:21:21.871 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T19:21:21.872 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T19:21:21.894 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T19:21:21.957 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T19:21:21.958 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T19:21:21.960 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T19:21:21.970 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:21.981 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T19:21:21.992 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T19:21:22.046 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T19:21:22.067 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T19:21:22.078 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.080 INFO:teuthology.task.ansible.out: ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMo 2021-11-15T19:21:22.082 INFO:teuthology.task.ansible.out:rbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T19:21:22.092 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.094 INFO:teuthology.task.ansible.out: 2021-11-15T19:21:22.115 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T19:21:22.126 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.148 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T19:21:22.160 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.172 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T19:21:22.173 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-15T19:21:22.183 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.185 INFO:teuthology.task.ansible.out: ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMo 2021-11-15T19:21:22.187 INFO:teuthology.task.ansible.out:rbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T19:21:22.196 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.196 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T19:21:22.198 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T19:21:22.228 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T19:21:22.230 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T19:21:22.281 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T19:21:22.283 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T19:21:22.292 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T19:21:22.294 INFO:teuthology.task.ansible.out:on", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2 2021-11-15T19:21:22.296 INFO:teuthology.task.ansible.out:NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.305 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.316 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T19:21:22.318 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.327 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.328 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T19:21:22.330 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-15T19:21:22.339 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.350 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.382 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T19:21:22.384 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T19:21:22.385 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihW 2021-11-15T19:21:22.386 INFO:teuthology.task.ansible.out:pgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2021-11-15T19:21:22.396 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T19:21:22.396 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.398 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:22.450 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T19:21:22.451 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T19:21:22.483 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T19:21:22.485 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9 2021-11-15T19:21:22.487 INFO:teuthology.task.ansible.out:W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T19:21:22.495 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T19:21:22.549 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T19:21:22.551 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T19:21:22.561 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T19:21:22.562 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T19:21:22.573 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T19:21:22.584 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T19:21:22.595 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T19:21:22.597 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T19:21:22.638 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T19:21:22.681 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T19:21:22.683 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T19:21:22.694 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T19:21:22.695 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T19:21:22.738 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T19:21:22.770 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T19:21:22.771 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T19:21:22.773 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T19:21:22.793 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T19:21:22.794 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T19:21:22.836 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T19:21:22.869 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T19:21:22.871 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAA 2021-11-15T19:21:22.872 INFO:teuthology.task.ansible.out:BAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T19:21:22.891 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T19:21:22.902 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T19:21:22.935 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T19:21:22.937 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T19:21:22.968 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T19:21:22.969 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T19:21:22.990 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T19:21:22.992 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T19:21:23.002 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T19:21:23.003 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T19:21:23.034 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T19:21:23.036 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T19:21:23.066 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T19:21:23.068 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T19:21:23.078 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T19:21:23.080 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T19:21:23.100 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T19:21:23.102 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T19:21:23.122 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T19:21:23.155 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T19:21:23.177 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T19:21:23.178 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T19:21:23.180 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T19:21:23.200 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T19:21:23.211 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T19:21:23.253 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T19:21:23.255 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T19:21:23.265 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T19:21:23.277 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T19:21:23.299 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T19:21:23.321 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T19:21:23.323 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T19:21:23.353 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T19:21:23.375 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T19:21:23.377 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T19:21:23.378 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T19:21:23.399 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T19:21:23.400 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T19:21:23.453 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T19:21:23.454 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T19:21:23.476 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T19:21:23.498 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T19:21:23.498 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T19:21:23.541 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T19:21:23.552 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T19:21:23.574 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T19:21:23.596 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T19:21:23.596 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T19:21:23.640 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T19:21:23.641 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T19:21:23.674 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T19:21:23.706 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T19:21:23.708 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T19:21:23.729 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T19:21:23.740 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T19:21:23.804 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T19:21:23.804 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T19:21:23.806 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T19:21:23.807 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T19:21:23.827 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T19:21:23.829 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T19:21:23.838 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T19:21:23.891 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T19:21:23.903 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T19:21:23.914 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T19:21:23.925 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T19:21:23.937 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T19:21:23.938 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T19:21:23.990 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T19:21:23.991 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T19:21:23.992 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T19:21:24.012 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T19:21:24.014 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T19:21:24.023 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T19:21:24.035 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T19:21:24.088 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T19:21:24.090 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T19:21:24.100 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T19:21:24.122 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T19:21:24.124 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T19:21:24.196 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T19:21:24.198 INFO:teuthology.task.ansible.out: ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T19:21:24.211 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T19:21:24.213 INFO:teuthology.task.ansible.out: 2021-11-15T19:21:24.254 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T19:21:24.265 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T19:21:24.288 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T19:21:24.290 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:24.300 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T19:21:24.353 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:24.375 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T19:21:24.386 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T19:21:24.388 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T19:21:24.398 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T19:21:24.451 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T19:21:24.483 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T19:21:24.483 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:24.495 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:24.506 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:24.538 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T19:21:24.570 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T19:21:24.572 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T19:21:24.593 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T19:21:24.626 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T19:21:24.637 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T19:21:24.638 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T19:21:24.669 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T19:21:24.691 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T19:21:24.702 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T19:21:24.704 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T19:21:24.734 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T19:21:24.736 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T19:21:24.756 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T19:21:24.767 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T19:21:24.769 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T19:21:24.789 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T19:21:24.789 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T19:21:24.791 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T19:21:24.832 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T19:21:24.853 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T19:21:24.855 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T19:21:24.864 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T19:21:24.866 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T19:21:24.886 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T19:21:24.888 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T19:21:24.919 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T19:21:24.954 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T19:21:24.956 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T19:21:24.965 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T19:21:24.976 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T19:21:24.977 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T19:21:25.020 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T19:21:25.052 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T19:21:25.063 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T19:21:25.075 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T19:21:25.107 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T19:21:25.107 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:25.138 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T19:21:25.140 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca 2021-11-15T19:21:25.142 INFO:teuthology.task.ansible.out:1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T19:21:25.161 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T19:21:25.172 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T19:21:25.235 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T19:21:25.237 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T19:21:25.239 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwo 2021-11-15T19:21:25.241 INFO:teuthology.task.ansible.out:j3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53 2021-11-15T19:21:25.243 INFO:teuthology.task.ansible.out:BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T19:21:25.247 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T19:21:25.269 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T19:21:25.270 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:25.291 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T19:21:25.292 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:25.334 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T19:21:25.355 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T19:21:25.357 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLnc 2021-11-15T19:21:25.359 INFO:teuthology.task.ansible.out:MSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoT 2021-11-15T19:21:25.360 INFO:teuthology.task.ansible.out:fAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T19:21:25.368 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T19:21:25.389 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T19:21:25.391 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T19:21:25.393 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T19:21:25.432 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T19:21:25.454 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T19:21:25.465 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T19:21:25.466 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T19:21:25.468 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T19:21:25.476 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T19:21:25.487 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T19:21:25.519 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T19:21:25.552 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T19:21:25.563 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T19:21:25.565 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T19:21:25.586 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T19:21:25.618 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T19:21:25.651 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T19:21:25.662 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T19:21:25.684 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T19:21:25.686 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T19:21:25.716 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T19:21:25.759 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T19:21:25.760 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T19:21:25.781 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T19:21:25.783 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T19:21:25.815 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T19:21:25.816 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-15T19:21:25.857 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T19:21:25.859 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T19:21:25.869 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T19:21:25.880 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T19:21:25.934 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T19:21:25.955 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T19:21:25.957 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-15T19:21:25.977 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T19:21:25.978 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T19:21:25.979 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-15T19:21:25.989 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T19:21:26.031 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T19:21:26.085 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T19:21:26.086 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T19:21:26.097 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T19:21:26.118 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T19:21:26.120 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T19:21:26.130 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T19:21:26.131 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-15T19:21:26.182 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T19:21:26.184 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T19:21:26.194 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T19:21:26.226 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T19:21:26.238 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T19:21:26.281 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T19:21:26.282 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T19:21:26.293 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T19:21:26.294 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T19:21:26.314 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T19:21:26.336 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T19:21:26.368 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T19:21:26.380 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T19:21:26.412 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T19:21:26.413 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T19:21:26.423 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T19:21:26.434 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T19:21:26.436 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T19:21:26.466 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T19:21:26.468 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T19:21:26.478 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T19:21:26.499 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T19:21:26.510 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T19:21:26.532 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T19:21:26.565 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T19:21:26.576 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T19:21:26.578 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T19:21:26.598 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T19:21:26.600 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T19:21:26.601 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T19:21:26.620 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T19:21:26.663 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T19:21:26.664 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T19:21:26.665 INFO:teuthology.task.ansible.out: 2021-11-15T19:21:26.696 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T19:21:26.698 INFO:teuthology.task.ansible.out: 2021-11-15T19:21:26.708 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T19:21:26.720 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T19:21:26.722 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T19:21:26.763 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T19:21:26.765 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T19:21:26.799 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:26.810 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T19:21:26.821 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T19:21:26.853 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:26.866 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T19:21:26.899 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T19:21:26.910 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T19:21:26.953 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:26.955 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMve 2021-11-15T19:21:26.958 INFO:teuthology.task.ansible.out:neKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T19:21:26.997 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T19:21:27.008 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:27.050 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T19:21:27.062 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T19:21:27.083 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T19:21:27.095 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T19:21:27.097 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T19:21:27.149 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T19:21:27.151 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T19:21:27.182 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T19:21:27.184 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T19:21:27.194 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T19:21:27.237 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T19:21:27.248 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T19:21:27.270 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T19:21:27.270 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T19:21:27.282 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T19:21:27.334 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T19:21:27.346 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T19:21:27.368 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T19:21:27.369 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T19:21:27.432 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T19:21:27.443 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T19:21:27.465 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T19:21:27.466 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T19:21:27.468 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T19:21:27.530 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T19:21:27.542 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T19:21:27.553 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T19:21:27.565 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T19:21:27.567 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T19:21:27.629 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T19:21:27.640 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T19:21:27.652 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T19:21:27.663 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T19:21:27.664 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T19:21:27.727 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T19:21:27.738 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T19:21:27.750 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T19:21:27.761 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T19:21:27.762 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T19:21:27.814 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T19:21:27.826 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T19:21:27.848 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T19:21:27.859 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T19:21:27.870 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T19:21:27.924 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T19:21:27.935 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T19:21:27.936 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T19:21:27.947 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T19:21:27.990 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T19:21:28.033 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T19:21:28.033 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T19:21:28.035 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T19:21:28.056 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T19:21:28.079 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T19:21:28.132 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T19:21:28.133 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T19:21:28.135 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T19:21:28.177 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T19:21:28.179 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T19:21:28.231 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T19:21:28.232 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T19:21:28.243 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T19:21:28.265 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T19:21:28.307 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T19:21:28.319 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T19:21:28.340 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T19:21:28.341 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T19:21:28.363 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T19:21:28.395 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T19:21:28.427 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T19:21:28.438 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T19:21:28.439 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T19:21:28.460 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T19:21:28.462 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T19:21:28.492 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T19:21:28.535 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T19:21:28.536 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T19:21:28.537 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T19:21:28.558 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T19:21:28.621 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T19:21:28.622 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T19:21:28.624 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T19:21:28.634 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T19:21:28.636 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T19:21:28.645 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T19:21:28.710 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T19:21:28.711 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T19:21:28.713 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T19:21:28.723 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T19:21:28.735 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T19:21:28.737 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T19:21:28.809 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T19:21:28.810 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T19:21:28.811 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T19:21:28.831 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T19:21:28.833 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T19:21:28.843 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T19:21:28.854 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T19:21:28.909 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T19:21:28.910 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T19:21:28.922 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T19:21:28.933 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T19:21:28.944 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T19:21:28.946 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T19:21:28.997 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T19:21:29.008 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T19:21:29.019 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T19:21:29.020 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T19:21:29.022 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T19:21:29.042 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T19:21:29.096 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T19:21:29.107 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T19:21:29.109 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T19:21:29.118 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T19:21:29.119 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T19:21:29.172 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T19:21:29.194 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T19:21:29.196 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T19:21:29.205 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T19:21:29.217 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T19:21:29.218 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T19:21:29.260 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T19:21:29.282 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T19:21:29.304 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T19:21:29.305 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T19:21:29.316 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T19:21:29.358 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T19:21:29.380 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T19:21:29.402 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T19:21:29.403 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "k 2021-11-15T19:21:29.405 INFO:teuthology.task.ansible.out:yr", "validate_certs": true} 2021-11-15T19:21:29.445 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T19:21:29.477 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T19:21:29.500 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T19:21:29.500 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T19:21:29.532 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T19:21:29.575 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T19:21:29.586 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T19:21:29.598 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T19:21:29.600 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T19:21:29.621 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T19:21:29.654 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T19:21:29.687 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T19:21:29.689 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T19:21:29.699 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T19:21:29.710 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T19:21:29.712 INFO:teuthology.task.ansible.out: 2021-11-15T19:21:29.753 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T19:21:29.776 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T19:21:29.777 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-15T19:21:29.787 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T19:21:29.789 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-15T19:21:29.799 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T19:21:29.810 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T19:21:29.853 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T19:21:29.885 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T19:21:29.887 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T19:21:29.897 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T19:21:29.908 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T19:21:29.910 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-15T19:21:29.950 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T19:21:29.952 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-15T19:21:29.982 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T19:21:29.984 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T19:21:29.994 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T19:21:30.037 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T19:21:30.038 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T19:21:30.081 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T19:21:30.083 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GO 2021-11-15T19:21:30.085 INFO:teuthology.task.ansible.out:i4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T19:21:30.125 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T19:21:30.127 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T19:21:30.179 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T19:21:30.181 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": nu 2021-11-15T19:21:30.183 INFO:teuthology.task.ansible.out:ll, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T19:21:30.224 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T19:21:30.226 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T19:21:30.268 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T19:21:30.279 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T19:21:30.281 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T19:21:30.283 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:30.323 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T19:21:30.355 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T19:21:30.366 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T19:21:30.367 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T19:21:30.378 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T19:21:30.421 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T19:21:30.453 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T19:21:30.464 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T19:21:30.465 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T19:21:30.467 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:30.477 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T19:21:30.478 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:30.530 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T19:21:30.562 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T19:21:30.564 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T19:21:30.607 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T19:21:30.618 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T19:21:30.620 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:30.662 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T19:21:30.663 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T19:21:30.665 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T19:21:30.666 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T19:21:30.740 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T19:21:30.751 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T19:21:30.763 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T19:21:30.764 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T19:21:30.766 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T19:21:30.830 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T19:21:30.841 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T19:21:30.853 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T19:21:30.864 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T19:21:30.865 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T19:21:30.939 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T19:21:30.940 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T19:21:30.951 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T19:21:30.953 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T19:21:30.964 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T19:21:31.037 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T19:21:31.039 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T19:21:31.050 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T19:21:31.052 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qV 2021-11-15T19:21:31.053 INFO:teuthology.task.ansible.out:E8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T19:21:31.136 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T19:21:31.137 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "use 2021-11-15T19:21:31.139 INFO:teuthology.task.ansible.out:r": "xiubli", "validate_certs": true} 2021-11-15T19:21:31.148 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T19:21:31.171 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T19:21:31.224 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T19:21:31.235 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T19:21:31.247 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T19:21:31.270 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T19:21:31.271 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T19:21:31.324 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T19:21:31.326 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T19:21:31.347 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T19:21:31.369 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T19:21:31.369 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T19:21:31.412 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T19:21:31.423 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T19:21:31.435 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T19:21:31.457 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T19:21:31.457 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T19:21:31.510 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T19:21:31.521 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T19:21:31.522 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T19:21:31.555 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T19:21:31.556 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T19:21:31.609 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T19:21:31.611 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/Nn 2021-11-15T19:21:31.613 INFO:teuthology.task.ansible.out:JQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T19:21:31.654 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T19:21:31.655 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T19:21:31.718 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T19:21:31.720 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T19:21:31.740 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T19:21:31.742 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T19:21:31.753 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T19:21:31.816 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T19:21:31.839 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T19:21:31.840 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T19:21:31.852 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T19:21:31.852 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T19:21:31.916 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T19:21:31.938 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T19:21:31.938 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T19:21:31.940 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T19:21:31.950 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T19:21:32.003 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T19:21:32.026 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T19:21:32.037 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T19:21:32.038 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T19:21:32.050 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T19:21:32.103 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T19:21:32.115 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T19:21:32.127 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T19:21:32.138 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T19:21:32.149 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T19:21:32.151 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T19:21:32.192 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T19:21:32.224 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T19:21:32.226 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T19:21:32.248 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T19:21:32.259 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T19:21:32.291 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T19:21:32.293 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T19:21:32.313 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T19:21:32.324 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T19:21:32.346 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T19:21:32.357 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T19:21:32.400 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T19:21:32.422 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T19:21:32.422 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T19:21:32.424 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T19:21:32.455 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T19:21:32.455 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T19:21:32.509 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T19:21:32.511 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T19:21:32.531 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T19:21:32.533 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T19:21:32.543 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T19:21:32.554 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T19:21:32.556 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T19:21:32.607 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T19:21:32.608 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T19:21:32.639 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T19:21:32.661 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T19:21:32.663 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T19:21:32.704 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T19:21:32.736 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T19:21:32.748 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T19:21:32.750 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T19:21:32.791 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T19:21:32.802 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T19:21:32.834 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T19:21:32.835 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T19:21:32.846 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T19:21:32.878 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T19:21:32.900 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T19:21:32.922 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T19:21:32.933 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T19:21:32.934 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T19:21:32.976 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T19:21:33.011 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T19:21:33.022 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T19:21:33.023 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T19:21:33.034 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T19:21:33.066 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T19:21:33.109 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T19:21:33.120 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T19:21:33.121 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T19:21:33.132 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T19:21:33.164 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T19:21:33.207 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T19:21:33.218 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T19:21:33.219 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T19:21:33.261 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T19:21:33.263 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T19:21:33.294 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T19:21:33.316 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T19:21:33.317 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T19:21:33.359 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T19:21:33.361 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T19:21:33.414 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T19:21:33.415 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T19:21:33.437 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T19:21:33.459 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T19:21:33.461 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T19:21:33.462 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T19:21:33.513 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T19:21:33.524 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T19:21:33.546 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T19:21:33.548 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-11-15T19:21:33.549 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T19:21:33.610 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T19:21:33.612 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T19:21:33.643 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T19:21:33.654 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T19:21:33.656 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T19:21:33.687 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T19:21:33.709 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T19:21:33.742 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T19:21:33.753 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T19:21:33.754 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T19:21:33.756 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T19:21:33.818 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T19:21:33.820 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T19:21:33.840 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T19:21:33.841 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T19:21:33.852 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T19:21:33.863 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T19:21:33.864 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T19:21:33.905 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T19:21:33.938 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T19:21:33.959 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T19:21:33.961 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T19:21:34.003 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T19:21:34.004 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T19:21:34.036 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T19:21:34.057 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T19:21:34.059 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T19:21:34.089 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T19:21:34.101 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T19:21:34.144 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T19:21:34.145 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T19:21:34.155 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T19:21:34.155 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T19:21:34.187 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T19:21:34.209 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T19:21:34.211 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T19:21:34.252 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T19:21:34.252 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T19:21:34.274 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T19:21:34.317 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T19:21:34.328 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T19:21:34.360 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T19:21:34.371 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T19:21:34.372 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T19:21:34.425 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T19:21:34.457 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T19:21:34.458 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T19:21:34.469 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T19:21:34.491 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T19:21:34.543 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T19:21:34.555 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T19:21:34.566 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T19:21:34.598 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T19:21:34.609 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T19:21:34.641 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T19:21:34.652 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T19:21:34.705 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T19:21:34.707 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T19:21:34.728 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T19:21:34.740 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T19:21:34.762 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T19:21:34.805 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T19:21:34.816 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T19:21:34.848 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T19:21:34.849 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T19:21:34.881 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T19:21:34.892 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T19:21:34.914 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T19:21:34.935 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T19:21:34.957 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T19:21:34.978 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T19:21:34.989 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T19:21:35.022 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T19:21:35.034 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T19:21:35.055 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T19:21:35.077 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T19:21:35.098 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T19:21:35.120 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T19:21:35.131 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T19:21:35.153 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T19:21:35.185 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T19:21:35.207 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T19:21:35.228 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T19:21:35.240 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T19:21:35.251 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T19:21:35.314 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T19:21:35.325 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T19:21:35.336 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T19:21:35.337 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T19:21:35.359 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T19:21:35.423 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T19:21:35.434 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T19:21:35.445 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T19:21:35.457 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T19:21:35.468 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T19:21:35.521 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T19:21:35.523 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T19:21:35.554 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T19:21:35.555 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T19:21:35.566 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T19:21:35.609 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T19:21:35.620 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T19:21:35.652 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T19:21:35.663 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T19:21:35.706 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T19:21:35.717 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T19:21:35.739 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T19:21:35.750 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T19:21:35.803 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T19:21:35.805 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T19:21:35.826 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T19:21:35.837 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T19:21:35.869 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T19:21:35.901 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T19:21:35.902 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T19:21:35.924 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T19:21:35.956 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T19:21:35.998 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T19:21:35.999 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T19:21:36.010 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T19:21:36.032 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T19:21:36.053 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T19:21:36.096 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T19:21:36.097 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T19:21:36.099 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T19:21:36.141 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T19:21:36.152 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T19:21:36.195 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T19:21:36.196 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T19:21:36.217 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T19:21:36.229 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T19:21:36.240 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T19:21:36.293 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T19:21:36.304 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T19:21:36.326 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T19:21:36.337 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T19:21:36.402 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T19:21:36.450 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T19:21:36.452 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsL 2021-11-15T19:21:36.454 INFO:teuthology.task.ansible.out:YttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T19:21:36.475 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:36 +0000 (0:00:15.411) 0:00:40.103 ******* 2021-11-15T19:21:36.499 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:36 +0000 (0:00:00.023) 0:00:40.126 ******* 2021-11-15T19:21:36.528 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T19:21:36.529 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T19:21:36.586 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T19:21:36.637 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.639 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59 2021-11-15T19:21:36.640 INFO:teuthology.task.ansible.out:894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 2021-11-15T19:21:36.642 INFO:teuthology.task.ansible.out: 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': ' 2021-11-15T19:21:36.644 INFO:teuthology.task.ansible.out:dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blai 2021-11-15T19:21:36.645 INFO:teuthology.task.ansible.out:ne", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage 2021-11-15T19:21:36.647 INFO:teuthology.task.ansible.out:@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.668 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:36 +0000 (0:00:00.169) 0:00:40.296 ******* 2021-11-15T19:21:36.691 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:36 +0000 (0:00:00.022) 0:00:40.319 ******* 2021-11-15T19:21:36.701 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.701 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.720 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T19:21:36.721 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": " 2021-11-15T19:21:36.723 INFO:teuthology.task.ansible.out:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-15T19:21:36.740 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T19:21:36.774 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T19:21:36.776 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7Ksqbpa 2021-11-15T19:21:36.778 INFO:teuthology.task.ansible.out:nvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b 2021-11-15T19:21:36.779 INFO:teuthology.task.ansible.out:53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2ca 2021-11-15T19:21:36.781 INFO:teuthology.task.ansible.out:a\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reas 2021-11-15T19:21:36.783 INFO:teuthology.task.ansible.out:on": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.804 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:36 +0000 (0:00:00.112) 0:00:40.431 ******* 2021-11-15T19:21:36.811 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.812 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.813 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.814 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAd 2021-11-15T19:21:36.815 INFO:teuthology.task.ansible.out:Q 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional 2021-11-15T19:21:36.817 INFO:teuthology.task.ansible.out:result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.830 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T19:21:36.831 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.831 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.832 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.843 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T19:21:36.885 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.896 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-15T19:21:36.907 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.909 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.919 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-15T19:21:36.930 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.932 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.942 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-15T19:21:36.943 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-15T19:21:36.944 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.955 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.956 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.967 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.968 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@Wo 2021-11-15T19:21:36.970 INFO:teuthology.task.ansible.out:rkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.979 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.981 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.991 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:36.992 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.003 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T19:21:37.004 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.004 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.005 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.016 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.017 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.028 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.029 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8 2021-11-15T19:21:37.031 INFO:teuthology.task.ansible.out:939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.041 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.042 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.053 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.055 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnsk 2021-11-15T19:21:37.056 INFO:teuthology.task.ansible.out:Q 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.057 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.057 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result w 2021-11-15T19:21:37.059 INFO:teuthology.task.ansible.out:as False"} 2021-11-15T19:21:37.069 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.070 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a 2021-11-15T19:21:37.072 INFO:teuthology.task.ansible.out:34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao 2021-11-15T19:21:37.073 INFO:teuthology.task.ansible.out: VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.083 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.084 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.085 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.085 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => 2021-11-15T19:21:37.087 INFO:teuthology.task.ansible.out: (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} ok: [gibba018.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NL 2021-11-15T19:21:37.088 INFO:teuthology.task.ansible.out:B8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.097 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.099 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.100 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3 2021-11-15T19:21:37.101 INFO:teuthology.task.ansible.out:668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.110 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.112 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodle 2021-11-15T19:21:37.114 INFO:teuthology.task.ansible.out:y@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.123 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.124 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.124 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.125 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.125 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3 2021-11-15T19:21:37.127 INFO:teuthology.task.ansible.out:fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.137 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.138 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.139 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.139 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 2021-11-15T19:21:37.141 INFO:teuthology.task.ansible.out:'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.150 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.152 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.152 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 495228 2021-11-15T19:21:37.154 INFO:teuthology.task.ansible.out:99bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.163 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.164 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-15T19:21:37.165 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.166 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.166 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi w 2021-11-15T19:21:37.168 INFO:teuthology.task.ansible.out:XYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.177 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.179 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6l 2021-11-15T19:21:37.180 INFO:teuthology.task.ansible.out:w 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "j 2021-11-15T19:21:37.182 INFO:teuthology.task.ansible.out:oshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.192 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.193 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-15T19:21:37.193 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.195 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.196 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@ra 2021-11-15T19:21:37.197 INFO:teuthology.task.ansible.out:el 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Condit 2021-11-15T19:21:37.199 INFO:teuthology.task.ansible.out:ional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.210 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.211 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\ 2021-11-15T19:21:37.213 INFO:teuthology.task.ansible.out:nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.223 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.224 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.225 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.225 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.226 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'n 2021-11-15T19:21:37.227 INFO:teuthology.task.ansible.out:ame': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.238 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.239 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.240 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.240 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1M 2021-11-15T19:21:37.241 INFO:teuthology.task.ansible.out:hoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-11-15T19:21:37.243 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.253 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.254 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.255 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7 2021-11-15T19:21:37.256 INFO:teuthology.task.ansible.out:OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reas 2021-11-15T19:21:37.258 INFO:teuthology.task.ansible.out:on": "Conditional result was False"} 2021-11-15T19:21:37.267 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.269 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.269 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat 2021-11-15T19:21:37.271 INFO:teuthology.task.ansible.out:.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.271 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.272 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba5 2021-11-15T19:21:37.273 INFO:teuthology.task.ansible.out:59a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.282 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.284 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.284 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.285 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a9 2021-11-15T19:21:37.286 INFO:teuthology.task.ansible.out:4b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.296 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.297 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.298 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.298 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaari 2021-11-15T19:21:37.300 INFO:teuthology.task.ansible.out:t@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.300 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40yg 2021-11-15T19:21:37.302 INFO:teuthology.task.ansible.out:fpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3N 2021-11-15T19:21:37.303 INFO:teuthology.task.ansible.out:zaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.313 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.314 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.315 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.315 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h 2021-11-15T19:21:37.317 INFO:teuthology.task.ansible.out:3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.327 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.329 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.329 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.330 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph 2021-11-15T19:21:37.331 INFO:teuthology.task.ansible.out:.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2021-11-15T19:21:37.333 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.342 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.343 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.344 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.344 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux" 2021-11-15T19:21:37.346 INFO:teuthology.task.ansible.out:, "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.346 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.347 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene 2021-11-15T19:21:37.348 INFO:teuthology.task.ansible.out:-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.358 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.359 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.360 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb 2021-11-15T19:21:37.362 INFO:teuthology.task.ansible.out:5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.372 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.373 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.373 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.374 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.374 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.374 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", 2021-11-15T19:21:37.376 INFO:teuthology.task.ansible.out: "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.386 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.388 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4Fi 2021-11-15T19:21:37.390 INFO:teuthology.task.ansible.out:Q ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} ok: [gibba031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPu 2021-11-15T19:21:37.391 INFO:teuthology.task.ansible.out:ERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.401 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.403 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.403 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.404 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9 2021-11-15T19:21:37.405 INFO:teuthology.task.ansible.out:bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c 2021-11-15T19:21:37.407 INFO:teuthology.task.ansible.out:288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.417 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.418 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc 2021-11-15T19:21:37.420 INFO:teuthology.task.ansible.out:46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.421 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa 2021-11-15T19:21:37.422 INFO:teuthology.task.ansible.out:92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.423 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.433 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.435 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.435 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761 2021-11-15T19:21:37.437 INFO:teuthology.task.ansible.out:c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11 2021-11-15T19:21:37.439 INFO:teuthology.task.ansible.out:a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.449 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.451 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.451 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5 2021-11-15T19:21:37.453 INFO:teuthology.task.ansible.out:c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedo 2021-11-15T19:21:37.454 INFO:teuthology.task.ansible.out:ra NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.465 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.466 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.467 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => ( 2021-11-15T19:21:37.468 INFO:teuthology.task.ansible.out:item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 2021-11-15T19:21:37.470 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.480 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.482 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.482 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxic 2021-11-15T19:21:37.484 INFO:teuthology.task.ansible.out:hen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.484 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.484 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec 2021-11-15T19:21:37.486 INFO:teuthology.task.ansible.out:2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.495 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.497 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.497 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594b 2021-11-15T19:21:37.499 INFO:teuthology.task.ansible.out:cccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.499 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.500 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtD 2021-11-15T19:21:37.501 INFO:teuthology.task.ansible.out:Pj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item" 2021-11-15T19:21:37.503 INFO:teuthology.task.ansible.out:, "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.512 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.514 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.515 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.515 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2021-11-15T19:21:37.516 INFO:teuthology.task.ansible.out:"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.517 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.528 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.529 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.530 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.530 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuq 2021-11-15T19:21:37.532 INFO:teuthology.task.ansible.out:IfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reas 2021-11-15T19:21:37.533 INFO:teuthology.task.ansible.out:on": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.544 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.546 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.546 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ov 2021-11-15T19:21:37.548 INFO:teuthology.task.ansible.out:pn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.548 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2 2021-11-15T19:21:37.550 INFO:teuthology.task.ansible.out:g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.550 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a196 2021-11-15T19:21:37.552 INFO:teuthology.task.ansible.out:4a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.562 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.564 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.564 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.565 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kac 2021-11-15T19:21:37.566 INFO:teuthology.task.ansible.out:hau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.577 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.578 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.578 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.579 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.579 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.580 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.581 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.581 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name' 2021-11-15T19:21:37.583 INFO:teuthology.task.ansible.out:: 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.583 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": 2021-11-15T19:21:37.585 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.594 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.595 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.595 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.596 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.596 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.596 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-11-15T19:21:37.598 INFO:teuthology.task.ansible.out: "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.598 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jlayton', 2021-11-15T19:21:37.600 INFO:teuthology.task.ansible.out: 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.609 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.611 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.611 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.612 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "ite 2021-11-15T19:21:37.613 INFO:teuthology.task.ansible.out:m": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6Yt 2021-11-15T19:21:37.615 INFO:teuthology.task.ansible.out:QJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.624 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.626 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.627 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.627 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovp 2021-11-15T19:21:37.628 INFO:teuthology.task.ansible.out:n": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.629 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.629 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4 2021-11-15T19:21:37.631 INFO:teuthology.task.ansible.out:d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.631 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-noteb 2021-11-15T19:21:37.633 INFO:teuthology.task.ansible.out:ook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.643 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.645 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.645 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.645 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item 2021-11-15T19:21:37.647 INFO:teuthology.task.ansible.out:": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.657 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.659 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.659 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.659 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"nam 2021-11-15T19:21:37.664 INFO:teuthology.task.ansible.out:e": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1r 2021-11-15T19:21:37.666 INFO:teuthology.task.ansible.out:EhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.673 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.675 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.675 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.676 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.se 2021-11-15T19:21:37.677 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.678 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={ 2021-11-15T19:21:37.679 INFO:teuthology.task.ansible.out:'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.690 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.691 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.692 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.692 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": 2021-11-15T19:21:37.694 INFO:teuthology.task.ansible.out:"kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.694 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gb 2021-11-15T19:21:37.695 INFO:teuthology.task.ansible.out:enhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.695 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.706 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.708 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.708 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.708 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wo 2021-11-15T19:21:37.710 INFO:teuthology.task.ansible.out:mbat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.711 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.712 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.712 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f78 2021-11-15T19:21:37.714 INFO:teuthology.task.ansible.out:51b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.723 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.725 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.725 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNI 2021-11-15T19:21:37.727 INFO:teuthology.task.ansible.out:KWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.727 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.738 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.740 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.740 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.741 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@ 2021-11-15T19:21:37.742 INFO:teuthology.task.ansible.out:laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.753 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.754 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.755 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.755 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => 2021-11-15T19:21:37.757 INFO:teuthology.task.ansible.out: (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.757 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2 2021-11-15T19:21:37.759 INFO:teuthology.task.ansible.out:Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.759 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd 2021-11-15T19:21:37.761 INFO:teuthology.task.ansible.out:5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.770 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.772 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.772 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.773 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn 2021-11-15T19:21:37.774 INFO:teuthology.task.ansible.out:": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.775 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kap 2021-11-15T19:21:37.776 INFO:teuthology.task.ansible.out:andya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.786 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.787 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.788 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.788 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_ 2021-11-15T19:21:37.790 INFO:teuthology.task.ansible.out:loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.790 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.791 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item 2021-11-15T19:21:37.792 INFO:teuthology.task.ansible.out:={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.802 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.804 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.804 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.805 INFO:teuthology.task.ansible.out:skipping: [gibba017. 2021-11-15T19:21:37.806 INFO:teuthology.task.ansible.out:front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.807 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gb 2021-11-15T19:21:37.808 INFO:teuthology.task.ansible.out:enhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.809 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOK 2021-11-15T19:21:37.810 INFO:teuthology.task.ansible.out:D0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.819 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.820 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.820 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.821 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.821 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.822 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-11-15T19:21:37.823 INFO:teuthology.task.ansible.out:{"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.834 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.835 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.836 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.836 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn 2021-11-15T19:21:37.838 INFO:teuthology.task.ansible.out:": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\n 2021-11-15T19:21:37.839 INFO:teuthology.task.ansible.out:xuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eed 2021-11-15T19:21:37.841 INFO:teuthology.task.ansible.out:d14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.852 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.853 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.854 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.854 INFO:teuthology.task.ansible.out:skipping: [gibba011.fr 2021-11-15T19:21:37.856 INFO:teuthology.task.ansible.out:ont.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.856 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redh 2021-11-15T19:21:37.858 INFO:teuthology.task.ansible.out:at OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.867 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.868 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.869 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.869 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "chan 2021-11-15T19:21:37.871 INFO:teuthology.task.ansible.out:ged": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.871 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.882 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.884 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.902 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.903 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.904 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:37.904 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-11-15T19:21:37.906 INFO:teuthology.task.ansible.out:{"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.050 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:01.246) 0:00:41.678 ******* 2021-11-15T19:21:38.059 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.059 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.061 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.079 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.081 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.081 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawa 2021-11-15T19:21:38.083 INFO:teuthology.task.ansible.out:ya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.083 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.084 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli 2021-11-15T19:21:38.085 INFO:teuthology.task.ansible.out:hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.086 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan 2021-11-15T19:21:38.087 INFO:teuthology.task.ansible.out:", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.088 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.088 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph 2021-11-15T19:21:38.090 INFO:teuthology.task.ansible.out:.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.090 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'n 2021-11-15T19:21:38.092 INFO:teuthology.task.ansible.out:ame': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.092 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA 2021-11-15T19:21:38.094 INFO:teuthology.task.ansible.out:d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.094 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.095 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330 2021-11-15T19:21:38.096 INFO:teuthology.task.ansible.out:631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.097 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216 2021-11-15T19:21:38.097 INFO:teuthology.task.ansible.out:242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.098 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.098 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.099 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.099 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.100 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.100 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.127 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.076) 0:00:41.755 ******* 2021-11-15T19:21:38.136 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.138 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.138 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.138 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"nam 2021-11-15T19:21:38.140 INFO:teuthology.task.ansible.out:e": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.140 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.142 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.143 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.143 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.143 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "z 2021-11-15T19:21:38.145 INFO:teuthology.task.ansible.out:l31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.164 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.166 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.166 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.166 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-11-15T19:21:38.168 INFO:teuthology.task.ansible.out: "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.169 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxueh 2021-11-15T19:21:38.170 INFO:teuthology.task.ansible.out:an@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.171 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.172 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.174 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.193 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.195 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.196 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.198 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.198 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173 2021-11-15T19:21:38.199 INFO:teuthology.task.ansible.out:189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.200 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.200 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.201 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.224 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.097) 0:00:41.852 ******* 2021-11-15T19:21:38.248 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.023) 0:00:41.875 ******* 2021-11-15T19:21:38.273 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.024) 0:00:41.900 ******* 2021-11-15T19:21:38.297 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.024) 0:00:41.925 ******* 2021-11-15T19:21:38.305 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.305 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.307 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.307 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.308 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.308 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn" 2021-11-15T19:21:38.310 INFO:teuthology.task.ansible.out:: "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.310 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.311 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06 2021-11-15T19:21:38.312 INFO:teuthology.task.ansible.out:b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.326 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.327 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.328 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.358 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.381 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.083) 0:00:42.009 ******* 2021-11-15T19:21:38.405 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.023) 0:00:42.032 ******* 2021-11-15T19:21:38.412 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:38.413 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-15T19:21:38.414 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T19:21:38.440 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.035) 0:00:42.067 ******* 2021-11-15T19:21:38.448 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T19:21:38.470 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-11-15T19:21:38.472 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba011.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T19:21:38.495 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:38 +0000 (0:00:00.055) 0:00:42.123 ******* 2021-11-15T19:21:38.524 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T19:21:38.546 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T19:21:38.568 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T19:21:38.611 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T19:21:38.611 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T19:21:38.633 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T19:21:38.676 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T19:21:38.687 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T19:21:38.698 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T19:21:38.720 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T19:21:38.742 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T19:21:38.774 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T19:21:38.775 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T19:21:38.797 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T19:21:38.808 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T19:21:38.861 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T19:21:38.863 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} ok: [gibba031.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T19:21:38.884 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T19:21:38.896 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T19:21:38.949 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T19:21:38.949 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T19:21:38.951 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T19:21:38.972 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T19:21:38.973 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T19:21:39.036 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T19:21:39.037 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T19:21:39.049 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T19:21:39.060 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T19:21:39.072 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T19:21:39.125 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T19:21:39.136 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T19:21:39.137 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T19:21:39.149 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T19:21:39.149 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T19:21:39.223 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T19:21:39.234 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T19:21:39.235 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T19:21:39.246 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T19:21:39.247 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T19:21:39.321 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T19:21:39.322 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T19:21:39.323 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T19:21:39.335 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T19:21:39.336 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T19:21:39.410 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T19:21:39.411 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T19:21:39.413 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T19:21:39.423 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T19:21:39.435 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T19:21:39.509 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T19:21:39.511 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T19:21:39.513 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T19:21:39.513 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T19:21:39.525 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T19:21:39.599 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T19:21:39.601 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} ok: [gibba037.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T19:21:39.603 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T19:21:39.613 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T19:21:39.687 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T19:21:39.688 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T19:21:39.690 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T19:21:39.700 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T19:21:39.733 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T19:21:39.777 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T19:21:39.777 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T19:21:39.789 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T19:21:39.811 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T19:21:39.823 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T19:21:39.865 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T19:21:39.877 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T19:21:39.888 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T19:21:39.899 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T19:21:39.953 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T19:21:39.953 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T19:21:39.965 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T19:21:39.976 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T19:21:39.987 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T19:21:40.040 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T19:21:40.041 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T19:21:40.052 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T19:21:40.074 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T19:21:40.106 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T19:21:40.128 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T19:21:40.128 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T19:21:40.140 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T19:21:40.162 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T19:21:40.205 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T19:21:40.218 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T19:21:40.219 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T19:21:40.240 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T19:21:40.283 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T19:21:40.294 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T19:21:40.316 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T19:21:40.317 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T19:21:40.328 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T19:21:40.381 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T19:21:40.393 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T19:21:40.394 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T19:21:40.415 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T19:21:40.426 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T19:21:40.459 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T19:21:40.480 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T19:21:40.481 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T19:21:40.503 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T19:21:40.514 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T19:21:40.546 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T19:21:40.579 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T19:21:40.581 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T19:21:40.601 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T19:21:40.602 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T19:21:40.634 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T19:21:40.667 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T19:21:40.668 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T19:21:40.690 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T19:21:40.690 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T19:21:40.723 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T19:21:40.755 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T19:21:40.756 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T19:21:40.777 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T19:21:40.778 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T19:21:40.810 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T19:21:40.842 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T19:21:40.854 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T19:21:40.875 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T19:21:40.876 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T19:21:40.898 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T19:21:40.940 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T19:21:40.941 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T19:21:40.963 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T19:21:40.963 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T19:21:40.985 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T19:21:41.038 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T19:21:41.050 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T19:21:41.050 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T19:21:41.062 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T19:21:41.075 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T19:21:41.128 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T19:21:41.139 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T19:21:41.151 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T19:21:41.152 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T19:21:41.163 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T19:21:41.237 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T19:21:41.238 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T19:21:41.249 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T19:21:41.250 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T19:21:41.262 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T19:21:41.325 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T19:21:41.337 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T19:21:41.348 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T19:21:41.349 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T19:21:41.381 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T19:21:41.413 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T19:21:41.424 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T19:21:41.436 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T19:21:41.468 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T19:21:41.480 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T19:21:41.502 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T19:21:41.513 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T19:21:41.524 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T19:21:41.567 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T19:21:41.588 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T19:21:41.589 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T19:21:41.600 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T19:21:41.612 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T19:21:41.654 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T19:21:41.676 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T19:21:41.687 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T19:21:41.698 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T19:21:41.710 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T19:21:41.742 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T19:21:41.763 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T19:21:41.775 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T19:21:41.786 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T19:21:41.797 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T19:21:41.841 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T19:21:41.852 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T19:21:41.863 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T19:21:41.885 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T19:21:41.906 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T19:21:41.938 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T19:21:41.950 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T19:21:41.950 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T19:21:41.972 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T19:21:41.994 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T19:21:42.026 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T19:21:42.037 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T19:21:42.038 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T19:21:42.060 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T19:21:42.081 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T19:21:42.114 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T19:21:42.126 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T19:21:42.127 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T19:21:42.149 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T19:21:42.170 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T19:21:42.203 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T19:21:42.214 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T19:21:42.215 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T19:21:42.236 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T19:21:42.258 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T19:21:42.300 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T19:21:42.301 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T19:21:42.303 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T19:21:42.324 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T19:21:42.346 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T19:21:42.400 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T19:21:42.402 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} ok: [gibba017.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T19:21:42.413 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T19:21:42.446 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T19:21:42.488 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T19:21:42.490 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} ok: [gibba037.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T19:21:42.502 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T19:21:42.534 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T19:21:42.576 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T19:21:42.577 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T19:21:42.588 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T19:21:42.589 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T19:21:42.610 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T19:21:42.664 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T19:21:42.665 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} ok: [gibba031.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T19:21:42.677 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T19:21:42.698 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T19:21:42.751 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T19:21:42.753 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T19:21:42.763 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T19:21:42.785 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T19:21:42.786 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T19:21:42.838 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T19:21:42.849 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-15T19:21:42.871 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T19:21:42.985 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} ok: [gibba018.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} ok: [gibba011.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} ok: [gibba037.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} ok: [gibba017.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} ok: [gibba031.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} ok: [gibba018.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T19:21:43.024 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T19:21:43.046 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T19:21:43.058 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T19:21:43.058 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T19:21:43.070 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T19:21:43.112 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T19:21:43.145 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T19:21:43.157 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T19:21:43.168 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T19:21:43.169 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T19:21:43.201 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T19:21:43.243 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T19:21:43.255 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T19:21:43.266 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T19:21:43.267 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-15T19:21:43.289 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T19:21:43.332 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T19:21:43.343 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T19:21:43.354 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T19:21:43.355 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T19:21:43.420 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T19:21:43.442 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T19:21:43.443 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T19:21:43.445 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T19:21:43.469 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:04.973) 0:00:47.097 ******* 2021-11-15T19:21:43.477 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T19:21:43.527 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.057) 0:00:47.154 ******* 2021-11-15T19:21:43.536 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T19:21:43.566 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T19:21:43.568 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T19:21:43.613 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.086) 0:00:47.241 ******* 2021-11-15T19:21:43.638 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.025) 0:00:47.266 ******* 2021-11-15T19:21:43.647 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T19:21:43.714 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T19:21:43.809 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T19:21:43.853 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.214) 0:00:47.480 ******* 2021-11-15T19:21:43.870 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-15T19:21:43.872 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637004103.5469098-9837-59194382358387/source", "state": "file", "uid": 0} 2021-11-15T19:21:43.895 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.042) 0:00:47.523 ******* 2021-11-15T19:21:43.903 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637004103.612224-9838-274437779574300/source", "state": "file", "uid": 0} 2021-11-15T19:21:43.930 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.034) 0:00:47.557 ******* 2021-11-15T19:21:43.958 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-15T19:21:43.960 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => { "msg": "Host gibba011.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T19:21:43.984 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:43 +0000 (0:00:00.054) 0:00:47.612 ******* 2021-11-15T19:21:43.991 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-15T19:21:43.993 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637004103.7009747-9845-170403508089668/source", "state": "file", "uid": 0} changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637004103.727432-9850-18853828588817/source", "state": "file", "uid": 0} 2021-11-15T19:21:43.994 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-15T19:21:43.994 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => { "msg": "Host gibba018.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T19:21:44.020 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.035) 0:00:47.647 ******* 2021-11-15T19:21:44.043 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:47.670 ******* 2021-11-15T19:21:44.066 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:47.693 ******* 2021-11-15T19:21:44.074 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T19:21:44.075 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-15T19:21:44.100 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.034) 0:00:47.727 ******* 2021-11-15T19:21:44.107 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-15T19:21:44.109 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => { "msg": "Host gibba017.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T19:21:44.133 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.032) 0:00:47.760 ******* 2021-11-15T19:21:44.140 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T19:21:44.142 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Log the OS name, version and release] *************************** ok: [gibba037.front.sepia.ceph.com] => { "msg": "Host gibba037.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T19:21:44.167 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.034) 0:00:47.795 ******* 2021-11-15T19:21:44.190 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:47.817 ******* 2021-11-15T19:21:44.197 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-15T19:21:44.198 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.224 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.033) 0:00:47.851 ******* 2021-11-15T19:21:44.231 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T19:21:44.233 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.235 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637004103.9349298-9871-141288252366061/source", "state": "file", "uid": 0} 2021-11-15T19:21:44.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.036) 0:00:47.887 ******* 2021-11-15T19:21:44.282 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:47.910 ******* 2021-11-15T19:21:44.304 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:47.932 ******* 2021-11-15T19:21:44.312 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T19:21:44.313 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.339 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.035) 0:00:47.967 ******* 2021-11-15T19:21:44.369 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.029) 0:00:47.997 ******* 2021-11-15T19:21:44.377 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-15T19:21:44.379 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Log the OS name, version and release] *************************** 2021-11-15T19:21:44.379 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => { "msg": "Host gibba031.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T19:21:44.404 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.035) 0:00:48.032 ******* 2021-11-15T19:21:44.425 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.020) 0:00:48.053 ******* 2021-11-15T19:21:44.447 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:48.074 ******* 2021-11-15T19:21:44.454 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-15T19:21:44.456 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.482 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.035) 0:00:48.109 ******* 2021-11-15T19:21:44.505 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.023) 0:00:48.133 ******* 2021-11-15T19:21:44.512 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-15T19:21:44.514 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.516 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [gibba031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-15T19:21:44.542 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.036) 0:00:48.169 ******* 2021-11-15T19:21:44.563 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:48.191 ******* 2021-11-15T19:21:44.585 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:48.213 ******* 2021-11-15T19:21:44.592 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-15T19:21:44.594 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.619 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.033) 0:00:48.246 ******* 2021-11-15T19:21:44.642 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:48.269 ******* 2021-11-15T19:21:44.648 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-15T19:21:44.650 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.651 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.676 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.034) 0:00:48.303 ******* 2021-11-15T19:21:44.706 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.030) 0:00:48.333 ******* 2021-11-15T19:21:44.728 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:48.355 ******* 2021-11-15T19:21:44.735 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-15T19:21:44.736 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.737 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-15T19:21:44.737 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.764 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.035) 0:00:48.391 ******* 2021-11-15T19:21:44.787 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:48.414 ******* 2021-11-15T19:21:44.810 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.023) 0:00:48.438 ******* 2021-11-15T19:21:44.817 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-15T19:21:44.819 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.843 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.032) 0:00:48.471 ******* 2021-11-15T19:21:44.866 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:48.493 ******* 2021-11-15T19:21:44.873 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-15T19:21:44.875 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.034) 0:00:48.528 ******* 2021-11-15T19:21:44.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:48.550 ******* 2021-11-15T19:21:44.945 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.022) 0:00:48.572 ******* 2021-11-15T19:21:44.952 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-15T19:21:44.954 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:44.978 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.033) 0:00:48.606 ******* 2021-11-15T19:21:45.000 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:44 +0000 (0:00:00.021) 0:00:48.628 ******* 2021-11-15T19:21:45.007 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-15T19:21:45.009 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.038 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.037) 0:00:48.666 ******* 2021-11-15T19:21:45.062 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.023) 0:00:48.690 ******* 2021-11-15T19:21:45.070 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-15T19:21:45.072 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.097 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.034) 0:00:48.724 ******* 2021-11-15T19:21:45.121 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.023) 0:00:48.748 ******* 2021-11-15T19:21:45.144 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:48.771 ******* 2021-11-15T19:21:45.151 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-15T19:21:45.152 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.177 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.033) 0:00:48.805 ******* 2021-11-15T19:21:45.200 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:48.827 ******* 2021-11-15T19:21:45.207 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-15T19:21:45.209 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.234 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.034) 0:00:48.862 ******* 2021-11-15T19:21:45.257 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.023) 0:00:48.885 ******* 2021-11-15T19:21:45.280 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:48.908 ******* 2021-11-15T19:21:45.287 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-15T19:21:45.289 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set entitlements_path] ****************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.315 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.035) 0:00:48.943 ******* 2021-11-15T19:21:45.337 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.021) 0:00:48.964 ******* 2021-11-15T19:21:45.344 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-15T19:21:45.345 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-15T19:21:45.346 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.376 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.039) 0:00:49.004 ******* 2021-11-15T19:21:45.399 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:49.027 ******* 2021-11-15T19:21:45.424 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.025) 0:00:49.052 ******* 2021-11-15T19:21:45.433 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-15T19:21:45.435 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba017.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:45.462 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.037) 0:00:49.089 ******* 2021-11-15T19:21:45.485 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.023) 0:00:49.112 ******* 2021-11-15T19:21:45.492 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-15T19:21:45.493 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.518 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.033) 0:00:49.146 ******* 2021-11-15T19:21:45.540 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.021) 0:00:49.168 ******* 2021-11-15T19:21:45.561 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.021) 0:00:49.189 ******* 2021-11-15T19:21:45.569 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T19:21:45.571 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.596 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.034) 0:00:49.223 ******* 2021-11-15T19:21:45.618 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:49.246 ******* 2021-11-15T19:21:45.626 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T19:21:45.628 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.651 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.032) 0:00:49.278 ******* 2021-11-15T19:21:45.672 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.020) 0:00:49.299 ******* 2021-11-15T19:21:45.678 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-15T19:21:45.680 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the releasever] ********************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.708 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.036) 0:00:49.336 ******* 2021-11-15T19:21:45.731 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:49.358 ******* 2021-11-15T19:21:45.738 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T19:21:45.740 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the releasever] ********************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.765 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.034) 0:00:49.392 ******* 2021-11-15T19:21:45.787 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.022) 0:00:49.415 ******* 2021-11-15T19:21:45.795 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-15T19:21:45.797 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:45.822 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.034) 0:00:49.449 ******* 2021-11-15T19:21:45.845 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.023) 0:00:49.472 ******* 2021-11-15T19:21:45.852 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-15T19:21:45.854 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the releasever] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:45.880 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.034) 0:00:49.507 ******* 2021-11-15T19:21:45.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.020) 0:00:49.528 ******* 2021-11-15T19:21:45.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.020) 0:00:49.549 ******* 2021-11-15T19:21:45.928 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-15T19:21:45.930 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:45.956 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.033) 0:00:49.583 ******* 2021-11-15T19:21:45.977 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:45 +0000 (0:00:00.021) 0:00:49.605 ******* 2021-11-15T19:21:45.984 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-15T19:21:45.986 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.032) 0:00:49.637 ******* 2021-11-15T19:21:46.039 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.029) 0:00:49.666 ******* 2021-11-15T19:21:46.046 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T19:21:46.048 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.073 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.034) 0:00:49.700 ******* 2021-11-15T19:21:46.095 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:49.723 ******* 2021-11-15T19:21:46.118 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:49.746 ******* 2021-11-15T19:21:46.126 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-15T19:21:46.128 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.153 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.035) 0:00:49.781 ******* 2021-11-15T19:21:46.176 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:49.803 ******* 2021-11-15T19:21:46.183 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T19:21:46.185 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the releasever] ********************************************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.210 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.034) 0:00:49.838 ******* 2021-11-15T19:21:46.233 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:49.860 ******* 2021-11-15T19:21:46.254 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:49.882 ******* 2021-11-15T19:21:46.261 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-15T19:21:46.263 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.288 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.033) 0:00:49.915 ******* 2021-11-15T19:21:46.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.020) 0:00:49.936 ******* 2021-11-15T19:21:46.315 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-15T19:21:46.316 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.340 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.032) 0:00:49.968 ******* 2021-11-15T19:21:46.370 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.029) 0:00:49.997 ******* 2021-11-15T19:21:46.378 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.380 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.404 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.034) 0:00:50.032 ******* 2021-11-15T19:21:46.427 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:50.054 ******* 2021-11-15T19:21:46.434 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-15T19:21:46.437 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.462 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.034) 0:00:50.089 ******* 2021-11-15T19:21:46.486 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.023) 0:00:50.113 ******* 2021-11-15T19:21:46.494 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-15T19:21:46.495 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.521 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.034) 0:00:50.148 ******* 2021-11-15T19:21:46.543 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:50.170 ******* 2021-11-15T19:21:46.564 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.192 ******* 2021-11-15T19:21:46.570 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-15T19:21:46.572 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.597 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.032) 0:00:50.225 ******* 2021-11-15T19:21:46.619 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.246 ******* 2021-11-15T19:21:46.626 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.627 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-15T19:21:46.627 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.651 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.032) 0:00:50.279 ******* 2021-11-15T19:21:46.672 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.300 ******* 2021-11-15T19:21:46.679 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.680 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-15T19:21:46.680 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.709 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.036) 0:00:50.337 ******* 2021-11-15T19:21:46.732 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:50.359 ******* 2021-11-15T19:21:46.740 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-15T19:21:46.742 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.768 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.035) 0:00:50.395 ******* 2021-11-15T19:21:46.791 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.022) 0:00:50.418 ******* 2021-11-15T19:21:46.798 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T19:21:46.800 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.824 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.033) 0:00:50.451 ******* 2021-11-15T19:21:46.845 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.473 ******* 2021-11-15T19:21:46.853 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T19:21:46.854 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:46.879 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.033) 0:00:50.507 ******* 2021-11-15T19:21:46.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.528 ******* 2021-11-15T19:21:46.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.549 ******* 2021-11-15T19:21:46.928 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-15T19:21:46.930 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:46.955 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.033) 0:00:50.582 ******* 2021-11-15T19:21:46.976 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:46 +0000 (0:00:00.021) 0:00:50.604 ******* 2021-11-15T19:21:46.983 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T19:21:46.985 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.008 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.031) 0:00:50.635 ******* 2021-11-15T19:21:47.036 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.028) 0:00:50.664 ******* 2021-11-15T19:21:47.044 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-15T19:21:47.046 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.070 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.033) 0:00:50.698 ******* 2021-11-15T19:21:47.093 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:50.720 ******* 2021-11-15T19:21:47.101 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-15T19:21:47.102 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.131 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.037) 0:00:50.758 ******* 2021-11-15T19:21:47.154 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:50.781 ******* 2021-11-15T19:21:47.177 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.023) 0:00:50.804 ******* 2021-11-15T19:21:47.184 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-15T19:21:47.186 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.211 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.034) 0:00:50.839 ******* 2021-11-15T19:21:47.234 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:50.861 ******* 2021-11-15T19:21:47.240 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-15T19:21:47.243 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.268 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.034) 0:00:50.896 ******* 2021-11-15T19:21:47.291 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:50.918 ******* 2021-11-15T19:21:47.313 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:50.941 ******* 2021-11-15T19:21:47.320 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-15T19:21:47.322 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.348 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.035) 0:00:50.976 ******* 2021-11-15T19:21:47.379 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.030) 0:00:51.007 ******* 2021-11-15T19:21:47.386 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-15T19:21:47.388 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:47.414 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.034) 0:00:51.042 ******* 2021-11-15T19:21:47.437 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:51.064 ******* 2021-11-15T19:21:47.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:51.087 ******* 2021-11-15T19:21:47.467 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-15T19:21:47.469 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:47.494 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.034) 0:00:51.122 ******* 2021-11-15T19:21:47.518 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.023) 0:00:51.145 ******* 2021-11-15T19:21:47.524 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-15T19:21:47.525 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.552 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.034) 0:00:51.179 ******* 2021-11-15T19:21:47.574 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.021) 0:00:51.201 ******* 2021-11-15T19:21:47.596 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:51.224 ******* 2021-11-15T19:21:47.603 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-15T19:21:47.605 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.630 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.033) 0:00:51.258 ******* 2021-11-15T19:21:47.653 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.022) 0:00:51.280 ******* 2021-11-15T19:21:47.659 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-15T19:21:47.661 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.687 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.034) 0:00:51.314 ******* 2021-11-15T19:21:47.793 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:47.832 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.145) 0:00:51.459 ******* 2021-11-15T19:21:47.843 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-15T19:21:47.845 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.002 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:47 +0000 (0:00:00.169) 0:00:51.629 ******* 2021-11-15T19:21:48.009 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-15T19:21:48.011 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:48.037 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.035) 0:00:51.664 ******* 2021-11-15T19:21:48.060 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:51.687 ******* 2021-11-15T19:21:48.084 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.024) 0:00:51.712 ******* 2021-11-15T19:21:48.092 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:48.094 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.119 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.034) 0:00:51.747 ******* 2021-11-15T19:21:48.140 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.020) 0:00:51.767 ******* 2021-11-15T19:21:48.150 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-15T19:21:48.152 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ 2021-11-15T19:21:48.153 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.190 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.050) 0:00:51.818 ******* 2021-11-15T19:21:48.224 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.033) 0:00:51.852 ******* 2021-11-15T19:21:48.247 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.023) 0:00:51.875 ******* 2021-11-15T19:21:48.254 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-15T19:21:48.256 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** 2021-11-15T19:21:48.256 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.282 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.034) 0:00:51.910 ******* 2021-11-15T19:21:48.305 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:51.932 ******* 2021-11-15T19:21:48.326 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.021) 0:00:51.953 ******* 2021-11-15T19:21:48.333 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-15T19:21:48.334 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.366 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.039) 0:00:51.993 ******* 2021-11-15T19:21:48.390 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.024) 0:00:52.018 ******* 2021-11-15T19:21:48.397 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T19:21:48.399 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.400 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.401 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.427 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.036) 0:00:52.054 ******* 2021-11-15T19:21:48.450 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.077 ******* 2021-11-15T19:21:48.472 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.099 ******* 2021-11-15T19:21:48.479 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-15T19:21:48.481 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.506 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.033) 0:00:52.133 ******* 2021-11-15T19:21:48.528 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.155 ******* 2021-11-15T19:21:48.535 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T19:21:48.537 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.539 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.564 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.036) 0:00:52.192 ******* 2021-11-15T19:21:48.586 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.021) 0:00:52.214 ******* 2021-11-15T19:21:48.610 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.023) 0:00:52.237 ******* 2021-11-15T19:21:48.616 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T19:21:48.618 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.619 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.645 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.035) 0:00:52.272 ******* 2021-11-15T19:21:48.667 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.295 ******* 2021-11-15T19:21:48.673 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T19:21:48.674 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.676 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.677 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:48.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.039) 0:00:52.335 ******* 2021-11-15T19:21:48.731 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.023) 0:00:52.358 ******* 2021-11-15T19:21:48.753 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.381 ******* 2021-11-15T19:21:48.761 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T19:21:48.763 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.763 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:48.789 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.036) 0:00:52.417 ******* 2021-11-15T19:21:48.814 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.024) 0:00:52.441 ******* 2021-11-15T19:21:48.820 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T19:21:48.822 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.848 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.034) 0:00:52.475 ******* 2021-11-15T19:21:48.870 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.021) 0:00:52.497 ******* 2021-11-15T19:21:48.877 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T19:21:48.879 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.903 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.033) 0:00:52.530 ******* 2021-11-15T19:21:48.910 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T19:21:48.912 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012144", "end": "2021-11-15 19:21:48.997306", "rc": 0, "start": "2021-11-15 19:21:48.985162", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.913 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:48.939 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.036) 0:00:52.567 ******* 2021-11-15T19:21:48.962 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.589 ******* 2021-11-15T19:21:48.985 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:48 +0000 (0:00:00.022) 0:00:52.612 ******* 2021-11-15T19:21:48.991 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-15T19:21:48.993 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.018 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.033) 0:00:52.646 ******* 2021-11-15T19:21:49.025 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T19:21:49.027 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.058 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.039) 0:00:52.685 ******* 2021-11-15T19:21:49.065 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-15T19:21:49.067 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015388", "end": "2021-11-15 19:21:48.608914", "rc": 0, "start": "2021-11-15 19:21:48.593526", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-15T19:21:49.093 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.035) 0:00:52.720 ******* 2021-11-15T19:21:49.117 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.023) 0:00:52.744 ******* 2021-11-15T19:21:49.124 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-15T19:21:49.126 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.153 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.036) 0:00:52.781 ******* 2021-11-15T19:21:49.162 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T19:21:49.164 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.011491", "end": "2021-11-15 19:21:49.230436", "rc": 0, "start": "2021-11-15 19:21:49.218945", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-15T19:21:49.189 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.036) 0:00:52.817 ******* 2021-11-15T19:21:49.212 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.022) 0:00:52.839 ******* 2021-11-15T19:21:49.220 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T19:21:49.222 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.247 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.035) 0:00:52.875 ******* 2021-11-15T19:21:49.269 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.022) 0:00:52.897 ******* 2021-11-15T19:21:49.276 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T19:21:49.278 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.306 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.036) 0:00:52.933 ******* 2021-11-15T19:21:49.313 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T19:21:49.314 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.339 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.033) 0:00:52.967 ******* 2021-11-15T19:21:49.346 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T19:21:49.348 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.372 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.032) 0:00:52.999 ******* 2021-11-15T19:21:49.379 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T19:21:49.381 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.407 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.034) 0:00:53.034 ******* 2021-11-15T19:21:49.414 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T19:21:49.416 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.446 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.039) 0:00:53.074 ******* 2021-11-15T19:21:49.455 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T19:21:49.456 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.481 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.035) 0:00:53.109 ******* 2021-11-15T19:21:49.489 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T19:21:49.491 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.518 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.036) 0:00:53.145 ******* 2021-11-15T19:21:49.524 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T19:21:49.526 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.551 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.033) 0:00:53.179 ******* 2021-11-15T19:21:49.579 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.606 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.054) 0:00:53.233 ******* 2021-11-15T19:21:49.696 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:49.698 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} ok: [gibba018.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanRe 2021-11-15T19:21:49.700 INFO:teuthology.task.ansible.out:load": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} TASK [common : Get the current timezone] *************************************** ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.007078", "end": "2021-11-15 19:21:49.347955", "rc": 0, "start": "2021-11-15 19:21:49.340877", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:49.700 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload 2021-11-15T19:21:49.702 INFO:teuthology.task.ansible.out:": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-15T19:21:49.725 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.119) 0:00:53.353 ******* 2021-11-15T19:21:49.774 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T19:21:49.775 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.021201", "end": "2021-11-15 19:21:50.223491", "rc": 0, "start": "2021-11-15 19:21:50.202290", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-15T19:21:49.799 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.073) 0:00:53.427 ******* 2021-11-15T19:21:49.805 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T19:21:49.807 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.833 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.033) 0:00:53.460 ******* 2021-11-15T19:21:49.840 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:49.841 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:49.843 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:49.844 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:49.877 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.068) 0:00:53.529 ******* 2021-11-15T19:21:49.907 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T19:21:49.908 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.033) 0:00:53.562 ******* 2021-11-15T19:21:49.942 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:49.943 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:49.944 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Def 2021-11-15T19:21:49.946 INFO:teuthology.task.ansible.out:aultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:49.956 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:49.967 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T19:21:49.969 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:49.992 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:49 +0000 (0:00:00.057) 0:00:53.619 ******* 2021-11-15T19:21:50.042 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.044 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.070 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.078) 0:00:53.698 ******* 2021-11-15T19:21:50.079 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.083 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.111 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.040) 0:00:53.738 ******* 2021-11-15T19:21:50.135 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.024) 0:00:53.763 ******* 2021-11-15T19:21:50.145 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-11-15T19:21:50.147 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.174 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.038) 0:00:53.802 ******* 2021-11-15T19:21:50.182 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.033) 0:00:53.835 ******* 2021-11-15T19:21:50.215 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.216 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-15T19:21:50.218 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.243 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.035) 0:00:53.870 ******* 2021-11-15T19:21:50.251 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.252 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.254 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.279 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.035) 0:00:53.906 ******* 2021-11-15T19:21:50.287 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.317 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.038) 0:00:53.945 ******* 2021-11-15T19:21:50.325 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.326 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.328 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.354 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.037) 0:00:53.982 ******* 2021-11-15T19:21:50.362 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-15T19:21:50.364 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.396 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.041) 0:00:54.023 ******* 2021-11-15T19:21:50.405 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.406 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.408 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.433 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.037) 0:00:54.061 ******* 2021-11-15T19:21:50.441 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.468 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.035) 0:00:54.096 ******* 2021-11-15T19:21:50.476 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.478 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.479 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.505 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.036) 0:00:54.132 ******* 2021-11-15T19:21:50.511 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.538 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.033) 0:00:54.165 ******* 2021-11-15T19:21:50.546 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T19:21:50.547 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.551 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-15T19:21:50.553 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.577 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.039) 0:00:54.205 ******* 2021-11-15T19:21:50.600 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.022) 0:00:54.227 ******* 2021-11-15T19:21:50.608 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-15T19:21:50.610 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [gibba037.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T19:21:50.614 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-15T19:21:50.616 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.641 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.040) 0:00:54.268 ******* 2021-11-15T19:21:50.663 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.022) 0:00:54.290 ******* 2021-11-15T19:21:50.686 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.022) 0:00:54.313 ******* 2021-11-15T19:21:50.692 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.694 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.723 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.037) 0:00:54.351 ******* 2021-11-15T19:21:50.745 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.021) 0:00:54.372 ******* 2021-11-15T19:21:50.763 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.788 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.043) 0:00:54.416 ******* 2021-11-15T19:21:50.805 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-15T19:21:50.806 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.049) 0:00:54.466 ******* 2021-11-15T19:21:50.856 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.881 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.042) 0:00:54.508 ******* 2021-11-15T19:21:50.898 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-15T19:21:50.900 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.923 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.042) 0:00:54.550 ******* 2021-11-15T19:21:50.941 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:50.966 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:50 +0000 (0:00:00.043) 0:00:54.594 ******* 2021-11-15T19:21:50.993 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-15T19:21:50.995 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.019 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.052) 0:00:54.646 ******* 2021-11-15T19:21:51.037 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.062 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.042) 0:00:54.689 ******* 2021-11-15T19:21:51.090 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-15T19:21:51.092 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.114 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.052) 0:00:54.742 ******* 2021-11-15T19:21:51.132 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.160 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.046) 0:00:54.788 ******* 2021-11-15T19:21:51.366 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-15T19:21:51.368 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.628574", "end": "2021-11-15 19:21:51.500922", "rc": 0, "start": "2021-11-15 19:21:50.872348", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:51.400 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.239) 0:00:55.028 ******* 2021-11-15T19:21:51.408 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.576354", "end": "2021-11-15 19:21:51.500925", "rc": 0, "start": "2021-11-15 19:21:50.924571", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:51.434 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.034) 0:00:55.062 ******* 2021-11-15T19:21:51.463 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-15T19:21:51.465 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.489 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.054) 0:00:55.117 ******* 2021-11-15T19:21:51.509 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.544 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.054) 0:00:55.171 ******* 2021-11-15T19:21:51.785 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-15T19:21:51.786 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.120446", "end": "2021-11-15 19:21:51.901121", "rc": 0, "start": "2021-11-15 19:21:51.780675", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:51.809 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.265) 0:00:55.437 ******* 2021-11-15T19:21:51.849 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.142688", "end": "2021-11-15 19:21:51.937492", "rc": 0, "start": "2021-11-15 19:21:51.794804", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:51.851 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.637028", "end": "2021-11-15 19:21:51.500926", "rc": 0, "start": "2021-11-15 19:21:50.863898", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:51.874 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.064) 0:00:55.502 ******* 2021-11-15T19:21:51.898 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.023) 0:00:55.525 ******* 2021-11-15T19:21:51.959 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.202374", "end": "2021-11-15 19:21:51.502456", "rc": 0, "start": "2021-11-15 19:21:50.300082", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:51.960 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-15T19:21:51.960 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:51.983 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:51 +0000 (0:00:00.084) 0:00:55.610 ******* 2021-11-15T19:21:52.015 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.032) 0:00:55.643 ******* 2021-11-15T19:21:52.047 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-15T19:21:52.049 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.797554", "end": "2021-11-15 19:21:52.500929", "rc": 0, "start": "2021-11-15 19:21:51.703375", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:52.072 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.056) 0:00:55.699 ******* 2021-11-15T19:21:52.077 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-15T19:21:52.079 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:52.102 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.030) 0:00:55.730 ******* 2021-11-15T19:21:52.140 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:52.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.069) 0:00:55.799 ******* 2021-11-15T19:21:52.368 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-15T19:21:52.370 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.180456", "end": "2021-11-15 19:21:52.004437", "rc": 0, "start": "2021-11-15 19:21:51.823981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:52.392 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.220) 0:00:56.020 ******* 2021-11-15T19:21:52.410 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.142344", "end": "2021-11-15 19:21:51.936256", "rc": 0, "start": "2021-11-15 19:21:51.793912", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:52.436 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.043) 0:00:56.064 ******* 2021-11-15T19:21:52.486 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.155084", "end": "2021-11-15 19:21:52.923425", "rc": 0, "start": "2021-11-15 19:21:52.768341", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:21:52.511 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:52 +0000 (0:00:00.075) 0:00:56.139 ******* 2021-11-15T19:21:55.129 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-15T19:21:55.130 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.154 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:02.642) 0:00:58.781 ******* 2021-11-15T19:21:55.163 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.194 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.039) 0:00:58.821 ******* 2021-11-15T19:21:55.348 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.373 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.179) 0:00:59.001 ******* 2021-11-15T19:21:55.654 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T19:21:55.656 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.679 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.305) 0:00:59.306 ******* 2021-11-15T19:21:55.696 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.721 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.042) 0:00:59.349 ******* 2021-11-15T19:21:55.728 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-15T19:21:55.729 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.754 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.032) 0:00:59.381 ******* 2021-11-15T19:21:55.761 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-15T19:21:55.762 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:55.787 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.033) 0:00:59.414 ******* 2021-11-15T19:21:55.793 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:55.818 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.031) 0:00:59.446 ******* 2021-11-15T19:21:55.846 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-15T19:21:55.848 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.872 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.053) 0:00:59.499 ******* 2021-11-15T19:21:55.879 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T19:21:55.881 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:21:55.905 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.032) 0:00:59.532 ******* 2021-11-15T19:21:55.976 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-15T19:21:55.978 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:56.000 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:55 +0000 (0:00:00.095) 0:00:59.627 ******* 2021-11-15T19:21:56.069 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T19:21:56.071 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T19:21:56.093 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.093) 0:00:59.721 ******* 2021-11-15T19:21:56.110 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T19:21:56.139 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.045) 0:00:59.767 ******* 2021-11-15T19:21:56.241 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T19:21:56.243 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:21:56.266 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.126) 0:00:59.893 ******* 2021-11-15T19:21:56.286 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T19:21:56.287 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T19:21:56.323 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.057) 0:00:59.950 ******* 2021-11-15T19:21:56.344 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-15T19:21:56.346 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:56.369 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.046) 0:00:59.997 ******* 2021-11-15T19:21:56.376 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T19:21:56.377 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:21:56.404 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.034) 0:01:00.031 ******* 2021-11-15T19:21:56.464 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-15T19:21:56.466 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:56.488 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.083) 0:01:00.115 ******* 2021-11-15T19:21:56.578 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T19:21:56.580 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:21:56.602 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.114) 0:01:00.229 ******* 2021-11-15T19:21:56.640 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T19:21:56.641 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T19:21:56.664 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.062) 0:01:00.292 ******* 2021-11-15T19:21:56.671 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T19:21:56.672 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:21:56.697 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.032) 0:01:00.324 ******* 2021-11-15T19:21:56.766 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T19:21:56.768 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T19:21:56.790 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.093) 0:01:00.418 ******* 2021-11-15T19:21:56.828 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T19:21:56.829 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:21:56.852 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:56 +0000 (0:00:00.061) 0:01:00.479 ******* 2021-11-15T19:21:56.911 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:56.913 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T19:21:57.028 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T19:21:57.123 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T19:21:57.155 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T19:21:57.156 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:21:57.183 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.331) 0:01:00.811 ******* 2021-11-15T19:21:57.190 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:57.192 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T19:21:57.266 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T19:21:57.277 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T19:21:57.279 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:21:57.301 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.118) 0:01:00.929 ******* 2021-11-15T19:21:57.329 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:57.331 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T19:21:57.356 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.054) 0:01:00.983 ******* 2021-11-15T19:21:57.395 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T19:21:57.480 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T19:21:57.482 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:21:57.505 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.149) 0:01:01.133 ******* 2021-11-15T19:21:57.512 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:57.513 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T19:21:57.515 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T19:21:57.545 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.039) 0:01:01.172 ******* 2021-11-15T19:21:57.606 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T19:21:57.619 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T19:21:57.646 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.100) 0:01:01.273 ******* 2021-11-15T19:21:57.652 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T19:21:57.654 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:21:57.680 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.034) 0:01:01.308 ******* 2021-11-15T19:21:57.739 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:57.740 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T19:21:57.772 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T19:21:57.774 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:21:57.798 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.118) 0:01:01.426 ******* 2021-11-15T19:21:57.806 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:57.807 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T19:21:57.882 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:57.884 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T19:21:57.936 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T19:21:57.962 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:57 +0000 (0:00:00.163) 0:01:01.590 ******* 2021-11-15T19:21:57.969 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:57.969 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T19:21:58.003 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T19:21:58.077 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T19:21:58.079 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:21:58.101 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.139) 0:01:01.729 ******* 2021-11-15T19:21:58.108 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:58.110 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T19:21:58.110 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T19:21:58.142 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.040) 0:01:01.770 ******* 2021-11-15T19:21:58.171 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:58.172 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T19:21:58.215 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T19:21:58.277 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.134) 0:01:01.904 ******* 2021-11-15T19:21:58.284 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T19:21:58.286 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:21:58.310 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.033) 0:01:01.938 ******* 2021-11-15T19:21:58.319 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T19:21:58.321 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:21:58.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.034) 0:01:01.972 ******* 2021-11-15T19:21:58.362 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:58.364 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T19:21:58.374 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T19:21:58.375 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:58.398 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.052) 0:01:02.025 ******* 2021-11-15T19:21:58.407 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:58.408 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} ok: [gibba018.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T19:21:58.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.041) 0:01:02.067 ******* 2021-11-15T19:21:58.447 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T19:21:58.449 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.460 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.461 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.484 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.044) 0:01:02.112 ******* 2021-11-15T19:21:58.491 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T19:21:58.493 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:21:58.516 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.031) 0:01:02.144 ******* 2021-11-15T19:21:58.522 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T19:21:58.524 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.547 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.030) 0:01:02.174 ******* 2021-11-15T19:21:58.553 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T19:21:58.555 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:58.579 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.031) 0:01:02.206 ******* 2021-11-15T19:21:58.587 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:58.589 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T19:21:58.616 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.037) 0:01:02.244 ******* 2021-11-15T19:21:58.625 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T19:21:58.626 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T19:21:58.627 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [gibba018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.628 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.628 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.630 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.663 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.047) 0:01:02.291 ******* 2021-11-15T19:21:58.669 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T19:21:58.671 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:21:58.693 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.029) 0:01:02.321 ******* 2021-11-15T19:21:58.699 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T19:21:58.701 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.723 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.030) 0:01:02.351 ******* 2021-11-15T19:21:58.729 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T19:21:58.731 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:58.755 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.031) 0:01:02.383 ******* 2021-11-15T19:21:58.793 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T19:21:58.794 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.804 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.806 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.829 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.073) 0:01:02.456 ******* 2021-11-15T19:21:58.836 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:58.837 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} ok: [gibba037.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T19:21:58.864 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.034) 0:01:02.491 ******* 2021-11-15T19:21:58.870 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T19:21:58.871 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:58.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.037) 0:01:02.529 ******* 2021-11-15T19:21:58.908 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T19:21:58.909 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:21:58.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.032) 0:01:02.561 ******* 2021-11-15T19:21:58.960 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T19:21:58.962 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:58.984 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:58 +0000 (0:00:00.050) 0:01:02.612 ******* 2021-11-15T19:21:58.991 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T19:21:58.993 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:21:59.018 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.034) 0:01:02.646 ******* 2021-11-15T19:21:59.028 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T19:21:59.029 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.039 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.041 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.049) 0:01:02.695 ******* 2021-11-15T19:21:59.075 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T19:21:59.076 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T19:21:59.105 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.037) 0:01:02.733 ******* 2021-11-15T19:21:59.112 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T19:21:59.113 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.139 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.034) 0:01:02.767 ******* 2021-11-15T19:21:59.146 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T19:21:59.148 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:21:59.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.032) 0:01:02.800 ******* 2021-11-15T19:21:59.180 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T19:21:59.181 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:21:59.206 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.033) 0:01:02.833 ******* 2021-11-15T19:21:59.213 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T19:21:59.214 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:21:59.240 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.033) 0:01:02.867 ******* 2021-11-15T19:21:59.257 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T19:21:59.259 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T19:21:59.284 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.044) 0:01:02.912 ******* 2021-11-15T19:21:59.292 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T19:21:59.293 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.304 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.330 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.045) 0:01:02.957 ******* 2021-11-15T19:21:59.347 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T19:21:59.349 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:21:59.378 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.048) 0:01:03.006 ******* 2021-11-15T19:21:59.386 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T19:21:59.388 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.412 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.033) 0:01:03.039 ******* 2021-11-15T19:21:59.450 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T19:21:59.452 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T19:21:59.476 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.063) 0:01:03.103 ******* 2021-11-15T19:21:59.546 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T19:21:59.548 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T19:21:59.573 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.096) 0:01:03.200 ******* 2021-11-15T19:21:59.590 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T19:21:59.592 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:21:59.618 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.044) 0:01:03.245 ******* 2021-11-15T19:21:59.626 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T19:21:59.627 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T19:21:59.653 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.035) 0:01:03.280 ******* 2021-11-15T19:21:59.732 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:21:59.734 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : Upload nagios check_mem script] ********************************* ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T19:21:59.758 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.105) 0:01:03.386 ******* 2021-11-15T19:21:59.807 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:21:59.809 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T19:21:59.833 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.074) 0:01:03.460 ******* 2021-11-15T19:21:59.859 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T19:21:59.861 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:21:59.882 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.049) 0:01:03.510 ******* 2021-11-15T19:21:59.889 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T19:21:59.891 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T19:21:59.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.033) 0:01:03.543 ******* 2021-11-15T19:21:59.936 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.020) 0:01:03.563 ******* 2021-11-15T19:21:59.943 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T19:21:59.944 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba018.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-15T19:21:59.970 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:21:59 +0000 (0:00:00.033) 0:01:03.597 ******* 2021-11-15T19:21:59.977 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T19:21:59.978 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T19:22:00.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.039) 0:01:03.637 ******* 2021-11-15T19:22:00.016 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:22:00.018 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T19:22:00.019 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.045 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.035) 0:01:03.673 ******* 2021-11-15T19:22:00.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.022) 0:01:03.695 ******* 2021-11-15T19:22:00.096 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T19:22:00.098 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.119 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.051) 0:01:03.747 ******* 2021-11-15T19:22:00.145 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T19:22:00.147 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:22:00.170 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.050) 0:01:03.798 ******* 2021-11-15T19:22:00.177 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:22:00.179 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T19:22:00.179 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T19:22:00.205 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.034) 0:01:03.832 ******* 2021-11-15T19:22:00.212 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-15T19:22:00.214 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.239 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.034) 0:01:03.867 ******* 2021-11-15T19:22:00.247 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:22:00.249 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T19:22:00.274 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.034) 0:01:03.901 ******* 2021-11-15T19:22:00.281 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T19:22:00.283 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T19:22:00.307 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.033) 0:01:03.935 ******* 2021-11-15T19:22:00.313 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T19:22:00.315 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.340 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.033) 0:01:03.968 ******* 2021-11-15T19:22:00.362 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.021) 0:01:03.990 ******* 2021-11-15T19:22:00.390 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T19:22:00.392 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:22:00.414 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.051) 0:01:04.042 ******* 2021-11-15T19:22:00.431 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:22:00.433 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-15T19:22:00.453 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.483 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.069) 0:01:04.111 ******* 2021-11-15T19:22:00.490 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T19:22:00.491 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T19:22:00.518 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.034) 0:01:04.145 ******* 2021-11-15T19:22:00.525 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T19:22:00.527 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T19:22:00.527 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T19:22:00.529 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:45 UTC", "ActiveEnterTimestampMonotonic": "14183720", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount network.target nss-lookup.target local-fs.target remote-fs.target systemd-tmpfiles-setup.service system.slice sysinit.target var-run.mount systemd-journald.socket basic.target time-sync.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:45 UTC", "AssertTimestampMonotonic": "14155228", "Before": "xdm.service getty@tty1.service plymouth-quit.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:45 UTC", "Con 2021-11-15T19:22:00.530 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "14155228", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1015", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:45 UTC", "ExecMainStartTimestampMonotonic": "14183618", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 19:19:45 UTC] ; stop_time=[n/a] ; pid=1015 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 19:19:45 UTC] ; stop_time=[n/a] ; pid=1015 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", " 2021-11-15T19:22:00.532 INFO:teuthology.task.ansible.out:GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:45 UTC", "InactiveExitTimestampMonotonic": "14183720", "InvocationID": "fba69f94c7434fc9b0bb7a0a07fe8369", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1015", "MemoryAccounting": "yes", "MemoryCurrent": "1269760", "Memo 2021-11-15T19:22:00.534 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:45 UTC", "StateChangeTimestampMonotonic": "14183720", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2021-11-15T19:22:00.535 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba037.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T19:22:00.559 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.041) 0:01:04.187 ******* 2021-11-15T19:22:00.581 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.021) 0:01:04.209 ******* 2021-11-15T19:22:00.604 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.022) 0:01:04.231 ******* 2021-11-15T19:22:00.612 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-15T19:22:00.614 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.639 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.035) 0:01:04.267 ******* 2021-11-15T19:22:00.645 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T19:22:00.647 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.671 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.031) 0:01:04.299 ******* 2021-11-15T19:22:00.677 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-15T19:22:00.679 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.703 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.031) 0:01:04.331 ******* 2021-11-15T19:22:00.711 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:22:00.713 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : Check firewalld status] ***************************************** skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:22:00.737 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.034) 0:01:04.365 ******* 2021-11-15T19:22:00.744 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T19:22:00.744 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T19:22:00.746 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.770 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.032) 0:01:04.398 ******* 2021-11-15T19:22:00.796 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.026) 0:01:04.424 ******* 2021-11-15T19:22:00.803 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T19:22:00.803 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T19:22:00.806 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.807 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T19:22:00.809 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:55 UTC", "ActiveEnterTimestampMonotonic": "12958766", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target remote-fs.target systemd-journald.socket sysinit.target network.target local-fs.target system.slice var-run.mount nss-lookup.target -.mount basic.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:55 UTC", "AssertTimestampMonotonic": "12947197", "Before": "getty@tty1.service xdm.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:55 UTC", "Con 2021-11-15T19:22:00.810 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "12947197", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "964", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:55 UTC", "ExecMainStartTimestampMonotonic": "12958665", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 19:19:55 UTC] ; stop_time=[n/a] ; pid=964 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 19:19:55 UTC] ; stop_time=[n/a] ; pid=964 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID 2021-11-15T19:22:00.812 INFO:teuthology.task.ansible.out:": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:55 UTC", "InactiveExitTimestampMonotonic": "12958766", "InvocationID": "d8f5bdcbc25746c0af6803832f4039f3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "964", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryDe 2021-11-15T19:22:00.814 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:55 UTC", "StateChangeTimestampMonotonic": "12958766", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-11-15T19:22:00.815 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:00.998 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:00 +0000 (0:00:00.201) 0:01:04.625 ******* 2021-11-15T19:22:01.023 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.025) 0:01:04.650 ******* 2021-11-15T19:22:01.049 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.025) 0:01:04.676 ******* 2021-11-15T19:22:01.072 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.023) 0:01:04.700 ******* 2021-11-15T19:22:01.080 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-15T19:22:01.082 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.109 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.036) 0:01:04.737 ******* 2021-11-15T19:22:01.133 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.023) 0:01:04.760 ******* 2021-11-15T19:22:01.155 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.022) 0:01:04.783 ******* 2021-11-15T19:22:01.164 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T19:22:01.166 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:51 UTC", "ActiveEnterTimestampMonotonic": "15313862", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount remote-fs.target time-sync.target systemd-journald.socket nss-lookup.target sysinit.target system.slice basic.target network.target -.mount local-fs.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:51 UTC", "AssertTimestampMonotonic": "15287073", "Before": "plymouth-quit.service shutdown.target xdm.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:51 UTC", "Con 2021-11-15T19:22:01.167 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "15287073", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1011", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:51 UTC", "ExecMainStartTimestampMonotonic": "15313769", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 19:19:51 UTC] ; stop_time=[n/a] ; pid=1011 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 19:19:51 UTC] ; stop_time=[n/a] ; pid=1011 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", " 2021-11-15T19:22:01.169 INFO:teuthology.task.ansible.out:GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:51 UTC", "InactiveExitTimestampMonotonic": "15313862", "InvocationID": "7f8d2c1d5703463fb8ed8f238a1bd68e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1011", "MemoryAccounting": "yes", "MemoryCurrent": "1388544", "Memo 2021-11-15T19:22:01.171 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:51 UTC", "StateChangeTimestampMonotonic": "15313862", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2021-11-15T19:22:01.172 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Check firewalld status] ***************************************** skipping: [gibba017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T19:22:01.193 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.037) 0:01:04.820 ******* 2021-11-15T19:22:01.214 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.021) 0:01:04.842 ******* 2021-11-15T19:22:01.238 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.023) 0:01:04.865 ******* 2021-11-15T19:22:01.245 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-15T19:22:01.247 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.247 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.271 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.033) 0:01:04.898 ******* 2021-11-15T19:22:01.298 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.026) 0:01:04.925 ******* 2021-11-15T19:22:01.320 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.021) 0:01:04.947 ******* 2021-11-15T19:22:01.327 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-15T19:22:01.329 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.329 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T19:22:01.330 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T19:22:01.357 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.036) 0:01:04.984 ******* 2021-11-15T19:22:01.381 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.023) 0:01:05.008 ******* 2021-11-15T19:22:01.405 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.024) 0:01:05.032 ******* 2021-11-15T19:22:01.411 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-15T19:22:01.412 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.034) 0:01:05.067 ******* 2021-11-15T19:22:01.463 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.023) 0:01:05.090 ******* 2021-11-15T19:22:01.486 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.022) 0:01:05.113 ******* 2021-11-15T19:22:01.492 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-15T19:22:01.494 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.520 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.034) 0:01:05.148 ******* 2021-11-15T19:22:01.543 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.022) 0:01:05.170 ******* 2021-11-15T19:22:01.550 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-15T19:22:01.552 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T19:22:01.554 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:22:01.578 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.035) 0:01:05.206 ******* 2021-11-15T19:22:01.608 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.029) 0:01:05.236 ******* 2021-11-15T19:22:01.633 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.024) 0:01:05.260 ******* 2021-11-15T19:22:01.640 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T19:22:01.642 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:41 UTC", "ActiveEnterTimestampMonotonic": "14806001", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target var-run.mount network.target -.mount systemd-journald.socket sysinit.target time-sync.target remote-fs.target basic.target nss-lookup.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:40 UTC", "AssertTimestampMonotonic": "14747111", "Before": "multi-user.target plymouth-quit.service getty@tty1.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:40 UTC", "Con 2021-11-15T19:22:01.643 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "14747111", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1016", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:41 UTC", "ExecMainStartTimestampMonotonic": "14805895", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 19:19:41 UTC] ; stop_time=[n/a] ; pid=1016 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 19:19:41 UTC] ; stop_time=[n/a] ; pid=1016 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", " 2021-11-15T19:22:01.645 INFO:teuthology.task.ansible.out:GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:41 UTC", "InactiveExitTimestampMonotonic": "14806001", "InvocationID": "11779eca83364a0fbae8cc4fd9dd086c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1016", "MemoryAccounting": "yes", "MemoryCurrent": "1269760", "Memo 2021-11-15T19:22:01.646 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:41 UTC", "StateChangeTimestampMonotonic": "14806001", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2021-11-15T19:22:01.648 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [gibba011.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrad 2021-11-15T19:22:01.650 INFO:teuthology.task.ansible.out:e": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T19:22:01.674 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.040) 0:01:05.301 ******* 2021-11-15T19:22:01.696 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.022) 0:01:05.324 ******* 2021-11-15T19:22:01.721 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.024) 0:01:05.348 ******* 2021-11-15T19:22:01.726 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-15T19:22:01.728 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including major version specific variables.] ****************** ok: [gibba011.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T19:22:01.730 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.755 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.033) 0:01:05.382 ******* 2021-11-15T19:22:01.780 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.024) 0:01:05.407 ******* 2021-11-15T19:22:01.802 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.022) 0:01:05.430 ******* 2021-11-15T19:22:01.809 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-15T19:22:01.811 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.811 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T19:22:01.813 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:20:01 UTC", "ActiveEnterTimestampMonotonic": "13483012", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target system.slice var-run.mount basic.target systemd-tmpfiles-setup.service remote-fs.target systemd-journald.socket sysinit.target -.mount time-sync.target network.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:20:01 UTC", "AssertTimestampMonotonic": "13467449", "Before": "shutdown.target multi-user.target getty@tty1.service xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:20:01 UTC", "Con 2021-11-15T19:22:01.814 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13467445", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "965", "ExecMainStartTimestamp": "Mon 2021-11-15 19:20:01 UTC", "ExecMainStartTimestampMonotonic": "13482841", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 19:20:01 UTC] ; stop_time=[n/a] ; pid=965 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 19:20:01 UTC] ; stop_time=[n/a] ; pid=965 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID 2021-11-15T19:22:01.816 INFO:teuthology.task.ansible.out:": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:20:01 UTC", "InactiveExitTimestampMonotonic": "13483012", "InvocationID": "52b417e561c34e588d006e14bc96c6f7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "965", "MemoryAccounting": "yes", "MemoryCurrent": "1273856", "MemoryDe 2021-11-15T19:22:01.818 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:20:01 UTC", "StateChangeTimestampMonotonic": "13483012", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-11-15T19:22:01.819 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Including version specific variables.] ************************ ok: [gibba011.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.036) 0:01:05.466 ******* 2021-11-15T19:22:01.859 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.020) 0:01:05.487 ******* 2021-11-15T19:22:01.880 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.020) 0:01:05.507 ******* 2021-11-15T19:22:01.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.042) 0:01:05.550 ******* 2021-11-15T19:22:01.931 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-15T19:22:01.932 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.933 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:01.958 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.036) 0:01:05.586 ******* 2021-11-15T19:22:01.981 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:01 +0000 (0:00:00.023) 0:01:05.609 ******* 2021-11-15T19:22:02.004 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.022) 0:01:05.632 ******* 2021-11-15T19:22:02.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-15T19:22:02.013 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.013 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.039 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.034) 0:01:05.666 ******* 2021-11-15T19:22:02.059 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.019) 0:01:05.686 ******* 2021-11-15T19:22:02.080 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.020) 0:01:05.707 ******* 2021-11-15T19:22:02.105 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.025) 0:01:05.733 ******* 2021-11-15T19:22:02.111 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T19:22:02.113 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.138 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.032) 0:01:05.765 ******* 2021-11-15T19:22:02.159 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.021) 0:01:05.786 ******* 2021-11-15T19:22:02.181 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.021) 0:01:05.808 ******* 2021-11-15T19:22:02.188 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-15T19:22:02.190 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.214 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.033) 0:01:05.841 ******* 2021-11-15T19:22:02.239 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.025) 0:01:05.867 ******* 2021-11-15T19:22:02.247 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-15T19:22:02.248 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T19:22:02.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.273 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.033) 0:01:05.900 ******* 2021-11-15T19:22:02.294 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.020) 0:01:05.921 ******* 2021-11-15T19:22:02.315 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.021) 0:01:05.942 ******* 2021-11-15T19:22:02.337 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.021) 0:01:05.964 ******* 2021-11-15T19:22:02.343 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-15T19:22:02.345 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T19:22:02.345 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.370 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.033) 0:01:05.997 ******* 2021-11-15T19:22:02.391 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.020) 0:01:06.018 ******* 2021-11-15T19:22:02.412 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.021) 0:01:06.040 ******* 2021-11-15T19:22:02.419 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-15T19:22:02.420 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T19:22:02.422 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-15T19:22:02.424 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.446 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.033) 0:01:06.073 ******* 2021-11-15T19:22:02.466 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.019) 0:01:06.093 ******* 2021-11-15T19:22:02.488 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.022) 0:01:06.116 ******* 2021-11-15T19:22:02.511 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.022) 0:01:06.138 ******* 2021-11-15T19:22:02.519 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-15T19:22:02.520 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.520 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.552 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.041) 0:01:06.180 ******* 2021-11-15T19:22:02.575 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.023) 0:01:06.203 ******* 2021-11-15T19:22:02.581 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-15T19:22:02.583 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T19:22:02.584 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-15T19:22:02.584 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.584 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T19:22:02.585 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T19:22:02.585 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-15T19:22:02.586 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.610 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.034) 0:01:06.237 ******* 2021-11-15T19:22:02.632 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.021) 0:01:06.259 ******* 2021-11-15T19:22:02.657 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.024) 0:01:06.284 ******* 2021-11-15T19:22:02.680 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.022) 0:01:06.307 ******* 2021-11-15T19:22:02.688 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T19:22:02.690 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.714 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.034) 0:01:06.342 ******* 2021-11-15T19:22:02.737 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.022) 0:01:06.364 ******* 2021-11-15T19:22:02.744 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-15T19:22:02.746 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-15T19:22:02.746 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:02.746 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-15T19:22:02.747 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:22:02.771 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.034) 0:01:06.399 ******* 2021-11-15T19:22:02.794 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.022) 0:01:06.421 ******* 2021-11-15T19:22:02.818 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.024) 0:01:06.445 ******* 2021-11-15T19:22:02.824 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-15T19:22:02.826 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* 2021-11-15T19:22:02.827 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T19:22:02.854 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.035) 0:01:06.481 ******* 2021-11-15T19:22:02.884 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.030) 0:01:06.511 ******* 2021-11-15T19:22:02.892 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-15T19:22:02.893 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:22:02.894 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [gibba017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T19:22:02.896 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-15T19:22:02.897 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:22:02.921 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.036) 0:01:06.548 ******* 2021-11-15T19:22:02.944 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.023) 0:01:06.571 ******* 2021-11-15T19:22:02.969 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:02 +0000 (0:00:00.024) 0:01:06.596 ******* 2021-11-15T19:22:02.976 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-15T19:22:02.977 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-15T19:22:02.979 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [gibba017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T19:22:03.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.036) 0:01:06.633 ******* 2021-11-15T19:22:03.027 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.021) 0:01:06.655 ******* 2021-11-15T19:22:03.051 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.023) 0:01:06.679 ******* 2021-11-15T19:22:03.057 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-15T19:22:03.058 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T19:22:03.060 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T19:22:03.062 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba011"}, "changed": false} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T19:22:03.087 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.035) 0:01:06.714 ******* 2021-11-15T19:22:03.108 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.020) 0:01:06.735 ******* 2021-11-15T19:22:03.130 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.022) 0:01:06.758 ******* 2021-11-15T19:22:03.137 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-15T19:22:03.138 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:03.163 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.033) 0:01:06.791 ******* 2021-11-15T19:22:03.184 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.020) 0:01:06.812 ******* 2021-11-15T19:22:03.217 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.032) 0:01:06.844 ******* 2021-11-15T19:22:03.225 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-15T19:22:03.227 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T19:22:03.227 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T19:22:03.227 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:03.253 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.035) 0:01:06.880 ******* 2021-11-15T19:22:03.276 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.023) 0:01:06.904 ******* 2021-11-15T19:22:03.284 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-15T19:22:03.285 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:03.311 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.034) 0:01:06.938 ******* 2021-11-15T19:22:03.317 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-15T19:22:03.319 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Including version specific variables.] ************************ ok: [gibba031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T19:22:03.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.033) 0:01:06.972 ******* 2021-11-15T19:22:03.367 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.021) 0:01:06.994 ******* 2021-11-15T19:22:03.374 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-15T19:22:03.376 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T19:22:03.376 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:03.378 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [gibba018.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T19:22:03.403 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.035) 0:01:07.030 ******* 2021-11-15T19:22:03.424 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.021) 0:01:07.052 ******* 2021-11-15T19:22:03.446 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.021) 0:01:07.073 ******* 2021-11-15T19:22:03.453 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T19:22:03.454 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:03.479 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.033) 0:01:07.107 ******* 2021-11-15T19:22:03.486 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-15T19:22:03.487 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Including distro specific variables.] ************************* 2021-11-15T19:22:03.488 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T19:22:03.513 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.034) 0:01:07.141 ******* 2021-11-15T19:22:03.536 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.022) 0:01:07.164 ******* 2021-11-15T19:22:03.576 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-15T19:22:03.577 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T19:22:03.608 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.071) 0:01:07.236 ******* 2021-11-15T19:22:03.625 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-15T19:22:03.626 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T19:22:03.650 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.042) 0:01:07.278 ******* 2021-11-15T19:22:03.656 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T19:22:03.657 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T19:22:03.659 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T19:22:03.684 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.033) 0:01:07.312 ******* 2021-11-15T19:22:03.705 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.020) 0:01:07.332 ******* 2021-11-15T19:22:03.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T19:22:03.715 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba011.front.sepia.ceph.com", "ansible_hostname": "gibba011", "ansible_nodename": "gibba011"}, "changed": true, "name": "gibba011"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:03.743 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.038) 0:01:07.371 ******* 2021-11-15T19:22:03.766 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.022) 0:01:07.393 ******* 2021-11-15T19:22:03.773 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-15T19:22:03.775 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-15T19:22:03.800 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.034) 0:01:07.428 ******* 2021-11-15T19:22:03.806 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T19:22:03.808 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T19:22:03.833 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.033) 0:01:07.461 ******* 2021-11-15T19:22:03.854 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.020) 0:01:07.482 ******* 2021-11-15T19:22:03.861 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T19:22:03.863 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba018"}, "changed": false} 2021-11-15T19:22:03.887 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.033) 0:01:07.515 ******* 2021-11-15T19:22:03.957 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T19:22:03.959 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T19:22:03.982 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:03 +0000 (0:00:00.095) 0:01:07.610 ******* 2021-11-15T19:22:03.989 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T19:22:03.991 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-15T19:22:04.015 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.033) 0:01:07.643 ******* 2021-11-15T19:22:04.046 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.030) 0:01:07.674 ******* 2021-11-15T19:22:04.054 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-15T19:22:04.055 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T19:22:04.081 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.034) 0:01:07.708 ******* 2021-11-15T19:22:04.088 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T19:22:04.090 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba017"}, "changed": false} 2021-11-15T19:22:04.113 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.032) 0:01:07.741 ******* 2021-11-15T19:22:04.119 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-15T19:22:04.120 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:04.145 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.031) 0:01:07.772 ******* 2021-11-15T19:22:04.151 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T19:22:04.153 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba018.front.sepia.ceph.com", "ansible_hostname": "gibba018", "ansible_nodename": "gibba018"}, "changed": true, "name": "gibba018"} 2021-11-15T19:22:04.179 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.034) 0:01:07.806 ******* 2021-11-15T19:22:04.186 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T19:22:04.187 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:04.213 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.033) 0:01:07.840 ******* 2021-11-15T19:22:04.251 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T19:22:04.253 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T19:22:04.278 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.064) 0:01:07.905 ******* 2021-11-15T19:22:04.294 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-15T19:22:04.296 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-15T19:22:04.321 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.043) 0:01:07.949 ******* 2021-11-15T19:22:04.339 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T19:22:04.341 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T19:22:04.365 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.043) 0:01:07.992 ******* 2021-11-15T19:22:04.371 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T19:22:04.372 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba031"}, "changed": false} TASK [testnode : Set the system's hostname] ************************************ changed: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba017.front.sepia.ceph.com", "ansible_hostname": "gibba017", "ansible_nodename": "gibba017"}, "changed": true, "name": "gibba017"} 2021-11-15T19:22:04.398 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.033) 0:01:08.026 ******* 2021-11-15T19:22:04.422 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.023) 0:01:08.049 ******* 2021-11-15T19:22:04.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T19:22:04.431 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T19:22:04.456 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.034) 0:01:08.083 ******* 2021-11-15T19:22:04.662 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T19:22:04.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba031.front.sepia.ceph.com", "ansible_hostname": "gibba031", "ansible_nodename": "gibba031"}, "changed": true, "name": "gibba031"} 2021-11-15T19:22:04.672 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T19:22:04.674 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-15T19:22:04.696 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.239) 0:01:08.323 ******* 2021-11-15T19:22:04.717 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.020) 0:01:08.344 ******* 2021-11-15T19:22:04.738 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.021) 0:01:08.365 ******* 2021-11-15T19:22:04.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-15T19:22:04.748 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Create remote.conf] ******************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:04.748 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T19:22:04.749 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T19:22:04.775 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.037) 0:01:08.403 ******* 2021-11-15T19:22:04.798 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.022) 0:01:08.426 ******* 2021-11-15T19:22:04.820 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.021) 0:01:08.448 ******* 2021-11-15T19:22:04.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:04.829 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:04.853 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.033) 0:01:08.481 ******* 2021-11-15T19:22:04.860 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T19:22:04.862 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba037"}, "changed": false} 2021-11-15T19:22:04.885 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.031) 0:01:08.513 ******* 2021-11-15T19:22:04.891 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T19:22:04.893 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:04.918 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.033) 0:01:08.546 ******* 2021-11-15T19:22:04.946 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:04.948 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T19:22:04.970 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.052) 0:01:08.598 ******* 2021-11-15T19:22:04.991 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:04 +0000 (0:00:00.020) 0:01:08.619 ******* 2021-11-15T19:22:04.998 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T19:22:04.999 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T19:22:05.001 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.031 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.039) 0:01:08.658 ******* 2021-11-15T19:22:05.054 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.022) 0:01:08.681 ******* 2021-11-15T19:22:05.061 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T19:22:05.063 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.088 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.034) 0:01:08.716 ******* 2021-11-15T19:22:05.116 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T19:22:05.117 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.139 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.050) 0:01:08.767 ******* 2021-11-15T19:22:05.146 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T19:22:05.148 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba037.front.sepia.ceph.com", "ansible_hostname": "gibba037", "ansible_nodename": "gibba037"}, "changed": true, "name": "gibba037"} 2021-11-15T19:22:05.171 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.032) 0:01:08.799 ******* 2021-11-15T19:22:05.178 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T19:22:05.179 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [gibba018.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-15T19:22:05.205 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.033) 0:01:08.833 ******* 2021-11-15T19:22:05.232 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.026) 0:01:08.859 ******* 2021-11-15T19:22:05.241 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:05.242 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.267 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.036) 0:01:08.895 ******* 2021-11-15T19:22:05.275 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T19:22:05.277 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.310 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.042) 0:01:08.938 ******* 2021-11-15T19:22:05.318 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T19:22:05.318 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T19:22:05.320 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [gibba011.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.344 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.033) 0:01:08.971 ******* 2021-11-15T19:22:05.365 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.021) 0:01:08.993 ******* 2021-11-15T19:22:05.372 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:05.374 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.399 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.033) 0:01:09.027 ******* 2021-11-15T19:22:05.427 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.028) 0:01:09.055 ******* 2021-11-15T19:22:05.434 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T19:22:05.436 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T19:22:05.436 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T19:22:05.436 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T19:22:05.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.032) 0:01:09.087 ******* 2021-11-15T19:22:05.480 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.020) 0:01:09.107 ******* 2021-11-15T19:22:05.502 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.021) 0:01:09.129 ******* 2021-11-15T19:22:05.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T19:22:05.509 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** TASK [testnode : Create remote.conf] ******************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.535 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.033) 0:01:09.162 ******* 2021-11-15T19:22:05.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.021) 0:01:09.184 ******* 2021-11-15T19:22:05.578 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.021) 0:01:09.205 ******* 2021-11-15T19:22:05.586 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T19:22:05.587 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.611 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.033) 0:01:09.238 ******* 2021-11-15T19:22:05.631 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.020) 0:01:09.259 ******* 2021-11-15T19:22:05.638 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:05.639 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.661 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.029) 0:01:09.289 ******* 2021-11-15T19:22:05.668 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-15T19:22:05.670 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.693 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.032) 0:01:09.321 ******* 2021-11-15T19:22:05.714 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.020) 0:01:09.341 ******* 2021-11-15T19:22:05.720 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T19:22:05.722 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.749 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.035) 0:01:09.377 ******* 2021-11-15T19:22:05.757 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-15T19:22:05.758 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.760 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T19:22:05.760 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T19:22:05.761 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:05.761 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.783 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.033) 0:01:09.411 ******* 2021-11-15T19:22:05.802 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.019) 0:01:09.430 ******* 2021-11-15T19:22:05.823 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.020) 0:01:09.451 ******* 2021-11-15T19:22:05.829 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T19:22:05.831 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.832 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.857 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.034) 0:01:09.485 ******* 2021-11-15T19:22:05.879 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.021) 0:01:09.506 ******* 2021-11-15T19:22:05.900 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.020) 0:01:09.527 ******* 2021-11-15T19:22:05.906 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T19:22:05.908 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:05.931 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.031) 0:01:09.559 ******* 2021-11-15T19:22:05.951 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.019) 0:01:09.578 ******* 2021-11-15T19:22:05.971 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:05 +0000 (0:00:00.020) 0:01:09.598 ******* 2021-11-15T19:22:05.977 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T19:22:05.979 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.003 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:09.630 ******* 2021-11-15T19:22:06.022 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.019) 0:01:09.650 ******* 2021-11-15T19:22:06.048 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.025) 0:01:09.675 ******* 2021-11-15T19:22:06.054 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T19:22:06.056 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.079 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:09.707 ******* 2021-11-15T19:22:06.100 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:09.728 ******* 2021-11-15T19:22:06.120 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:09.748 ******* 2021-11-15T19:22:06.127 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:06.129 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.152 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:09.780 ******* 2021-11-15T19:22:06.174 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.022) 0:01:09.802 ******* 2021-11-15T19:22:06.197 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.022) 0:01:09.824 ******* 2021-11-15T19:22:06.204 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:06.205 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.230 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.033) 0:01:09.857 ******* 2021-11-15T19:22:06.252 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.021) 0:01:09.879 ******* 2021-11-15T19:22:06.273 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.021) 0:01:09.901 ******* 2021-11-15T19:22:06.280 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T19:22:06.282 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.282 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.035) 0:01:09.936 ******* 2021-11-15T19:22:06.329 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:09.957 ******* 2021-11-15T19:22:06.355 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.025) 0:01:09.982 ******* 2021-11-15T19:22:06.360 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T19:22:06.362 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.364 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.388 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.033) 0:01:10.015 ******* 2021-11-15T19:22:06.408 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:10.035 ******* 2021-11-15T19:22:06.430 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.022) 0:01:10.058 ******* 2021-11-15T19:22:06.451 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:10.079 ******* 2021-11-15T19:22:06.458 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T19:22:06.459 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.460 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.482 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:10.110 ******* 2021-11-15T19:22:06.503 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:10.131 ******* 2021-11-15T19:22:06.522 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.019) 0:01:10.150 ******* 2021-11-15T19:22:06.542 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:10.170 ******* 2021-11-15T19:22:06.548 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T19:22:06.550 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T19:22:06.574 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:10.202 ******* 2021-11-15T19:22:06.593 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.018) 0:01:10.220 ******* 2021-11-15T19:22:06.612 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.019) 0:01:10.240 ******* 2021-11-15T19:22:06.637 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.025) 0:01:10.265 ******* 2021-11-15T19:22:06.643 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:06.645 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T19:22:06.669 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:10.296 ******* 2021-11-15T19:22:06.691 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.022) 0:01:10.319 ******* 2021-11-15T19:22:06.712 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:10.339 ******* 2021-11-15T19:22:06.733 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.021) 0:01:10.361 ******* 2021-11-15T19:22:06.739 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T19:22:06.741 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T19:22:06.765 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.032) 0:01:10.393 ******* 2021-11-15T19:22:06.786 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.020) 0:01:10.414 ******* 2021-11-15T19:22:06.807 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.021) 0:01:10.435 ******* 2021-11-15T19:22:06.830 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.022) 0:01:10.457 ******* 2021-11-15T19:22:06.836 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T19:22:06.838 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.838 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.861 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.031) 0:01:10.489 ******* 2021-11-15T19:22:06.881 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.019) 0:01:10.508 ******* 2021-11-15T19:22:06.902 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.021) 0:01:10.530 ******* 2021-11-15T19:22:06.935 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.032) 0:01:10.563 ******* 2021-11-15T19:22:06.943 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T19:22:06.944 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ 2021-11-15T19:22:06.945 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.947 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.948 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.949 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:06.972 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.036) 0:01:10.599 ******* 2021-11-15T19:22:06.993 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:06 +0000 (0:00:00.021) 0:01:10.621 ******* 2021-11-15T19:22:07.014 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:10.642 ******* 2021-11-15T19:22:07.036 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.022) 0:01:10.664 ******* 2021-11-15T19:22:07.042 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:07.044 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.044 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.031) 0:01:10.695 ******* 2021-11-15T19:22:07.089 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:10.716 ******* 2021-11-15T19:22:07.109 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:10.737 ******* 2021-11-15T19:22:07.130 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:10.758 ******* 2021-11-15T19:22:07.136 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T19:22:07.137 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.161 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.031) 0:01:10.789 ******* 2021-11-15T19:22:07.182 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:10.809 ******* 2021-11-15T19:22:07.201 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.019) 0:01:10.829 ******* 2021-11-15T19:22:07.208 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.210 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.237 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.036) 0:01:10.865 ******* 2021-11-15T19:22:07.259 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:10.887 ******* 2021-11-15T19:22:07.282 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.023) 0:01:10.910 ******* 2021-11-15T19:22:07.304 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:10.931 ******* 2021-11-15T19:22:07.310 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:07.311 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.312 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.335 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.031) 0:01:10.963 ******* 2021-11-15T19:22:07.356 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:10.984 ******* 2021-11-15T19:22:07.377 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:11.004 ******* 2021-11-15T19:22:07.397 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:11.024 ******* 2021-11-15T19:22:07.403 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T19:22:07.404 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.405 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-15T19:22:07.405 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.431 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.034) 0:01:11.059 ******* 2021-11-15T19:22:07.451 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:11.079 ******* 2021-11-15T19:22:07.470 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.018) 0:01:11.098 ******* 2021-11-15T19:22:07.490 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:11.118 ******* 2021-11-15T19:22:07.496 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T19:22:07.498 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.498 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.498 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.525 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.035) 0:01:11.153 ******* 2021-11-15T19:22:07.689 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.163) 0:01:11.316 ******* 2021-11-15T19:22:07.710 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:11.338 ******* 2021-11-15T19:22:07.730 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.019) 0:01:11.358 ******* 2021-11-15T19:22:07.737 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T19:22:07.739 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001398", "end": "2021-11-15 19:22:07.760073", "rc": 0, "start": "2021-11-15 19:22:07.758675", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:07.741 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.764 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.034) 0:01:11.392 ******* 2021-11-15T19:22:07.783 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.019) 0:01:11.411 ******* 2021-11-15T19:22:07.803 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.019) 0:01:11.430 ******* 2021-11-15T19:22:07.822 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.019) 0:01:11.450 ******* 2021-11-15T19:22:07.828 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-15T19:22:07.830 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.831 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.854 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.031) 0:01:11.482 ******* 2021-11-15T19:22:07.875 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:11.502 ******* 2021-11-15T19:22:07.895 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.020) 0:01:11.523 ******* 2021-11-15T19:22:07.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:11.544 ******* 2021-11-15T19:22:07.923 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T19:22:07.925 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:07.949 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.032) 0:01:11.577 ******* 2021-11-15T19:22:07.977 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.027) 0:01:11.605 ******* 2021-11-15T19:22:07.999 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:07 +0000 (0:00:00.021) 0:01:11.627 ******* 2021-11-15T19:22:08.006 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T19:22:08.007 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-15T19:22:08.007 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.008 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.032 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.032) 0:01:11.659 ******* 2021-11-15T19:22:08.053 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.021) 0:01:11.680 ******* 2021-11-15T19:22:08.074 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:11.701 ******* 2021-11-15T19:22:08.080 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:08.081 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.105 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.031) 0:01:11.733 ******* 2021-11-15T19:22:08.126 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:11.754 ******* 2021-11-15T19:22:08.147 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:11.774 ******* 2021-11-15T19:22:08.152 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T19:22:08.153 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T19:22:08.154 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-15T19:22:08.156 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.180 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.033) 0:01:11.808 ******* 2021-11-15T19:22:08.200 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.019) 0:01:11.827 ******* 2021-11-15T19:22:08.220 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:11.847 ******* 2021-11-15T19:22:08.240 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:11.868 ******* 2021-11-15T19:22:08.248 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T19:22:08.249 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.250 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.250 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:08.251 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.277 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.036) 0:01:11.904 ******* 2021-11-15T19:22:08.297 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:11.925 ******* 2021-11-15T19:22:08.321 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.023) 0:01:11.948 ******* 2021-11-15T19:22:08.343 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.022) 0:01:11.971 ******* 2021-11-15T19:22:08.351 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T19:22:08.353 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.377 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.034) 0:01:12.005 ******* 2021-11-15T19:22:08.399 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.021) 0:01:12.027 ******* 2021-11-15T19:22:08.421 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.021) 0:01:12.048 ******* 2021-11-15T19:22:08.427 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-15T19:22:08.428 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.451 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.030) 0:01:12.079 ******* 2021-11-15T19:22:08.470 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.019) 0:01:12.098 ******* 2021-11-15T19:22:08.491 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:12.118 ******* 2021-11-15T19:22:08.497 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-15T19:22:08.499 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.522 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.031) 0:01:12.150 ******* 2021-11-15T19:22:08.540 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.018) 0:01:12.168 ******* 2021-11-15T19:22:08.565 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.024) 0:01:12.193 ******* 2021-11-15T19:22:08.572 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T19:22:08.572 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-15T19:22:08.573 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.573 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.599 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.034) 0:01:12.227 ******* 2021-11-15T19:22:08.621 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.021) 0:01:12.249 ******* 2021-11-15T19:22:08.641 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:12.269 ******* 2021-11-15T19:22:08.647 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-15T19:22:08.649 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.649 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.651 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.674 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.032) 0:01:12.302 ******* 2021-11-15T19:22:08.694 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.019) 0:01:12.321 ******* 2021-11-15T19:22:08.715 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.021) 0:01:12.343 ******* 2021-11-15T19:22:08.722 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T19:22:08.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-15T19:22:08.724 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.724 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.748 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.032) 0:01:12.376 ******* 2021-11-15T19:22:08.769 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:12.396 ******* 2021-11-15T19:22:08.790 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:12.417 ******* 2021-11-15T19:22:08.796 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-15T19:22:08.798 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.820 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.030) 0:01:12.448 ******* 2021-11-15T19:22:08.840 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.019) 0:01:12.467 ******* 2021-11-15T19:22:08.868 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.028) 0:01:12.496 ******* 2021-11-15T19:22:08.875 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T19:22:08.877 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:08.899 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.031) 0:01:12.527 ******* 2021-11-15T19:22:08.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.022) 0:01:12.549 ******* 2021-11-15T19:22:08.928 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:08.930 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001335", "end": "2021-11-15 19:22:08.469067", "rc": 0, "start": "2021-11-15 19:22:08.467732", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:08.954 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.032) 0:01:12.582 ******* 2021-11-15T19:22:08.975 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:08 +0000 (0:00:00.020) 0:01:12.602 ******* 2021-11-15T19:22:08.981 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-15T19:22:08.982 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T19:22:09.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.031) 0:01:12.633 ******* 2021-11-15T19:22:09.027 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.020) 0:01:12.655 ******* 2021-11-15T19:22:09.034 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T19:22:09.036 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001245", "end": "2021-11-15 19:22:09.105782", "rc": 0, "start": "2021-11-15 19:22:09.104537", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.062 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.035) 0:01:12.690 ******* 2021-11-15T19:22:09.085 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.022) 0:01:12.712 ******* 2021-11-15T19:22:09.091 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-15T19:22:09.093 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.094 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T19:22:09.117 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.032) 0:01:12.745 ******* 2021-11-15T19:22:09.137 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.020) 0:01:12.765 ******* 2021-11-15T19:22:09.144 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-15T19:22:09.146 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.171 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.033) 0:01:12.798 ******* 2021-11-15T19:22:09.177 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:09.179 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.210 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.039) 0:01:12.838 ******* 2021-11-15T19:22:09.217 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-15T19:22:09.218 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.242 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.032) 0:01:12.870 ******* 2021-11-15T19:22:09.249 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T19:22:09.251 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.275 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.032) 0:01:12.902 ******* 2021-11-15T19:22:09.300 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.025) 0:01:12.927 ******* 2021-11-15T19:22:09.307 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-15T19:22:09.309 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.333 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.032) 0:01:12.960 ******* 2021-11-15T19:22:09.353 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.020) 0:01:12.981 ******* 2021-11-15T19:22:09.361 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-15T19:22:09.361 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.362 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T19:22:09.362 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-15T19:22:09.387 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.033) 0:01:13.014 ******* 2021-11-15T19:22:09.408 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.021) 0:01:13.036 ******* 2021-11-15T19:22:09.415 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T19:22:09.416 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.031) 0:01:13.067 ******* 2021-11-15T19:22:09.460 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.020) 0:01:13.087 ******* 2021-11-15T19:22:09.467 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-15T19:22:09.469 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.494 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.034) 0:01:13.122 ******* 2021-11-15T19:22:09.500 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T19:22:09.502 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.528 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.034) 0:01:13.156 ******* 2021-11-15T19:22:09.535 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-15T19:22:09.537 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.569 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.041) 0:01:13.197 ******* 2021-11-15T19:22:09.577 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:09.578 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.601 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.031) 0:01:13.229 ******* 2021-11-15T19:22:09.607 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-15T19:22:09.609 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.632 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.030) 0:01:13.259 ******* 2021-11-15T19:22:09.637 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-15T19:22:09.639 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.661 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.029) 0:01:13.289 ******* 2021-11-15T19:22:09.667 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T19:22:09.669 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.691 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.030) 0:01:13.319 ******* 2021-11-15T19:22:09.697 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:09.698 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.721 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.029) 0:01:13.348 ******* 2021-11-15T19:22:09.727 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T19:22:09.728 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.751 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.030) 0:01:13.379 ******* 2021-11-15T19:22:09.757 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:09.758 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.781 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.029) 0:01:13.409 ******* 2021-11-15T19:22:09.787 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:09.788 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.811 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.029) 0:01:13.438 ******* 2021-11-15T19:22:09.816 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-15T19:22:09.818 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.840 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.029) 0:01:13.468 ******* 2021-11-15T19:22:09.846 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-15T19:22:09.848 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.871 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.030) 0:01:13.498 ******* 2021-11-15T19:22:09.877 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:09.878 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T19:22:09.879 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:09.924 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.045) 0:01:13.543 ******* 2021-11-15T19:22:09.947 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.031) 0:01:13.575 ******* 2021-11-15T19:22:09.955 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:09.956 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [gibba017.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T19:22:09.981 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:09 +0000 (0:00:00.033) 0:01:13.609 ******* 2021-11-15T19:22:09.987 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-15T19:22:09.989 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.011 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.030) 0:01:13.639 ******* 2021-11-15T19:22:10.017 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:10.019 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.041 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.029) 0:01:13.668 ******* 2021-11-15T19:22:10.046 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-15T19:22:10.048 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.072 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.031) 0:01:13.700 ******* 2021-11-15T19:22:10.079 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-15T19:22:10.081 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.105 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.032) 0:01:13.733 ******* 2021-11-15T19:22:10.111 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-15T19:22:10.113 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [gibba018.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T19:22:10.137 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.032) 0:01:13.765 ******* 2021-11-15T19:22:10.144 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-15T19:22:10.146 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.168 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.030) 0:01:13.795 ******* 2021-11-15T19:22:10.173 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-15T19:22:10.175 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.197 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.029) 0:01:13.825 ******* 2021-11-15T19:22:10.203 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-15T19:22:10.205 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.228 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.030) 0:01:13.855 ******* 2021-11-15T19:22:10.235 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-15T19:22:10.237 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.032) 0:01:13.888 ******* 2021-11-15T19:22:10.267 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.291 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.030) 0:01:13.919 ******* 2021-11-15T19:22:10.297 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-15T19:22:10.298 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.324 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.033) 0:01:13.952 ******* 2021-11-15T19:22:10.331 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-15T19:22:10.332 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.356 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.031) 0:01:13.984 ******* 2021-11-15T19:22:10.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T19:22:10.374 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:22:10.397 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.040) 0:01:14.024 ******* 2021-11-15T19:22:10.404 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-15T19:22:10.405 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.428 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.030) 0:01:14.055 ******* 2021-11-15T19:22:10.433 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T19:22:10.434 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T19:22:10.435 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001342", "end": "2021-11-15 19:22:10.073080", "rc": 0, "start": "2021-11-15 19:22:10.071738", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:10.457 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.029) 0:01:14.085 ******* 2021-11-15T19:22:10.477 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.019) 0:01:14.105 ******* 2021-11-15T19:22:10.484 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-15T19:22:10.485 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.509 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.031) 0:01:14.136 ******* 2021-11-15T19:22:10.515 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:10.516 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T19:22:10.517 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T19:22:10.540 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.031) 0:01:14.168 ******* 2021-11-15T19:22:10.561 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.020) 0:01:14.189 ******* 2021-11-15T19:22:10.568 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-15T19:22:10.570 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.594 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.032) 0:01:14.221 ******* 2021-11-15T19:22:10.601 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T19:22:10.602 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011356", "end": "2021-11-15 19:22:10.709074", "rc": 0, "start": "2021-11-15 19:22:10.697718", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:10.627 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.033) 0:01:14.255 ******* 2021-11-15T19:22:10.696 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T19:22:10.698 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001422", "end": "2021-11-15 19:22:11.144887", "rc": 0, "start": "2021-11-15 19:22:11.143465", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:10.721 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.093) 0:01:14.348 ******* 2021-11-15T19:22:10.748 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T19:22:10.778 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.056) 0:01:14.405 ******* 2021-11-15T19:22:10.805 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:10.807 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T19:22:10.830 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.052) 0:01:14.458 ******* 2021-11-15T19:22:10.837 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T19:22:10.839 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-15T19:22:10.864 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.034) 0:01:14.492 ******* 2021-11-15T19:22:10.893 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-15T19:22:10.894 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:10.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:10 +0000 (0:00:00.051) 0:01:14.544 ******* 2021-11-15T19:22:10.985 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T19:22:10.987 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:22:11.011 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.094) 0:01:14.639 ******* 2021-11-15T19:22:11.029 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T19:22:11.031 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T19:22:11.054 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.042) 0:01:14.681 ******* 2021-11-15T19:22:11.075 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.021) 0:01:14.702 ******* 2021-11-15T19:22:11.103 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-15T19:22:11.105 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:11.126 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.051) 0:01:14.754 ******* 2021-11-15T19:22:11.163 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T19:22:11.165 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011463", "end": "2021-11-15 19:22:10.712369", "rc": 0, "start": "2021-11-15 19:22:10.700906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:11.189 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.062) 0:01:14.817 ******* 2021-11-15T19:22:11.314 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T19:22:11.316 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:22:11.339 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.149) 0:01:14.966 ******* 2021-11-15T19:22:11.366 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T19:22:11.389 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.050) 0:01:15.017 ******* 2021-11-15T19:22:11.468 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:11.470 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T19:22:11.501 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T19:22:11.503 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010944", "end": "2021-11-15 19:22:11.610240", "rc": 0, "start": "2021-11-15 19:22:11.599296", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:11.525 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:11 +0000 (0:00:00.135) 0:01:15.152 ******* 2021-11-15T19:22:11.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:11.837 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T19:22:12.055 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-15T19:22:12.057 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:22:12.079 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.554) 0:01:15.707 ******* 2021-11-15T19:22:12.151 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T19:22:12.152 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T19:22:12.177 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.097) 0:01:15.804 ******* 2021-11-15T19:22:12.564 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T19:22:12.590 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.413) 0:01:16.218 ******* 2021-11-15T19:22:12.609 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T19:22:12.611 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:22:12.635 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.044) 0:01:16.262 ******* 2021-11-15T19:22:12.652 INFO:teuthology.task.ansible.out: 2021-11-15T19:22:12.653 INFO:teuthology.task.ansible.out:TASK [testnode : Update apt cache.] ******************************************** ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T19:22:12.677 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.042) 0:01:16.305 ******* 2021-11-15T19:22:12.701 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.023) 0:01:16.328 ******* 2021-11-15T19:22:12.812 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T19:22:12.814 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010517", "end": "2021-11-15 19:22:12.469105", "rc": 0, "start": "2021-11-15 19:22:12.458588", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:12.836 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.135) 0:01:16.463 ******* 2021-11-15T19:22:12.968 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-15T19:22:12.970 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:22:12.992 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:12 +0000 (0:00:00.156) 0:01:16.620 ******* 2021-11-15T19:22:13.030 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T19:22:13.032 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:22:13.056 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:13 +0000 (0:00:00.064) 0:01:16.684 ******* 2021-11-15T19:22:13.085 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T19:22:13.108 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:13 +0000 (0:00:00.051) 0:01:16.736 ******* 2021-11-15T19:22:13.219 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T19:22:13.221 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011313", "end": "2021-11-15 19:22:13.670120", "rc": 0, "start": "2021-11-15 19:22:13.658807", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:13.248 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:13 +0000 (0:00:00.139) 0:01:16.876 ******* 2021-11-15T19:22:14.424 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-15T19:22:14.426 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:22:14.457 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:14 +0000 (0:00:01.209) 0:01:18.085 ******* 2021-11-15T19:22:14.740 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:22:14.767 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:14 +0000 (0:00:00.309) 0:01:18.394 ******* 2021-11-15T19:22:19.539 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-15T19:22:19.541 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T19:22:19.543 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T19:22:19.544 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T19:22:19.564 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:19 +0000 (0:00:04.797) 0:01:23.191 ******* 2021-11-15T19:22:20.138 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T19:22:20.140 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T19:22:20.141 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T19:22:20.162 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:20 +0000 (0:00:00.598) 0:01:23.790 ******* 2021-11-15T19:22:20.506 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T19:22:20.507 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T19:22:20.509 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T19:22:20.530 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:20 +0000 (0:00:00.368) 0:01:24.158 ******* 2021-11-15T19:22:21.569 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T19:22:21.571 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T19:22:21.573 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T19:22:21.593 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:21 +0000 (0:00:01.062) 0:01:25.221 ******* 2021-11-15T19:22:22.117 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T19:22:22.118 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 56 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T19:22:22.120 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T19:22:22.143 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:22 +0000 (0:00:00.549) 0:01:25.770 ******* 2021-11-15T19:22:33.276 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:33.278 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T19:22:33.280 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1771 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T19:22:33.282 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1771 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T19:22:33.283 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T19:22:33.301 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:33 +0000 (0:00:11.158) 0:01:36.929 ******* 2021-11-15T19:22:33.330 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T19:22:33.332 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:33.353 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:33 +0000 (0:00:00.051) 0:01:36.981 ******* 2021-11-15T19:22:33.972 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:33.974 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T19:22:33.976 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1855 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T19:22:33.978 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1855 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T19:22:33.979 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T19:22:33.998 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:33 +0000 (0:00:00.645) 0:01:37.626 ******* 2021-11-15T19:22:34.008 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T19:22:34.009 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1811 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T19:22:34.011 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1811 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T19:22:34.013 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T19:22:34.033 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:34 +0000 (0:00:00.034) 0:01:37.661 ******* 2021-11-15T19:22:34.040 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T19:22:34.042 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:34.066 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:34 +0000 (0:00:00.033) 0:01:37.694 ******* 2021-11-15T19:22:34.072 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:34.099 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:34 +0000 (0:00:00.032) 0:01:37.726 ******* 2021-11-15T19:22:35.558 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:35.559 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T19:22:35.561 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1849 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T19:22:35.563 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1849 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T19:22:35.564 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T19:22:35.582 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:35 +0000 (0:00:01.483) 0:01:39.209 ******* 2021-11-15T19:22:35.610 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T19:22:35.612 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:35.632 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:35 +0000 (0:00:00.050) 0:01:39.260 ******* 2021-11-15T19:22:36.039 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:36.041 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T19:22:36.043 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1829 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T19:22:36.045 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 52 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1829 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T19:22:36.046 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T19:22:36.065 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:36 +0000 (0:00:00.432) 0:01:39.692 ******* 2021-11-15T19:22:36.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T19:22:36.093 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:36.115 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:36 +0000 (0:00:00.050) 0:01:39.742 ******* 2021-11-15T19:22:43.482 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:43.483 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 50 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T19:22:43.485 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (12.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T19:22:43.486 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T19:22:43.488 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 50 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (12.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T19:22:43.490 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-15T19:22:43.491 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T19:22:43.515 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:43 +0000 (0:00:07.400) 0:01:47.143 ******* 2021-11-15T19:22:43.929 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 50 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T19:22:43.930 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (12.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T19:22:43.932 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T19:22:43.934 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 50 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (12.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T19:22:43.935 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processin 2021-11-15T19:22:43.936 INFO:teuthology.task.ansible.out:g triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T19:22:43.959 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:43 +0000 (0:00:00.444) 0:01:47.587 ******* 2021-11-15T19:22:43.967 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T19:22:43.969 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:22:43.993 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:43 +0000 (0:00:00.033) 0:01:47.621 ******* 2021-11-15T19:22:44.390 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:22:44.414 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.420) 0:01:48.042 ******* 2021-11-15T19:22:44.420 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-15T19:22:44.422 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:22:44.446 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.031) 0:01:48.073 ******* 2021-11-15T19:22:44.578 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T19:22:44.580 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T19:22:44.605 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.159) 0:01:48.233 ******* 2021-11-15T19:22:44.612 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:44.613 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 50 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T19:22:44.615 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T19:22:44.617 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T19:22:44.618 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 50 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T19:22:44.620 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proces 2021-11-15T19:22:44.620 INFO:teuthology.task.ansible.out:sing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T19:22:44.644 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.039) 0:01:48.272 ******* 2021-11-15T19:22:44.651 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T19:22:44.653 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:44.678 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.033) 0:01:48.306 ******* 2021-11-15T19:22:44.790 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T19:22:44.791 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-15T19:22:44.813 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.134) 0:01:48.440 ******* 2021-11-15T19:22:44.830 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-15T19:22:44.832 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:22:44.855 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.041) 0:01:48.482 ******* 2021-11-15T19:22:44.958 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T19:22:44.960 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T19:22:44.981 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:44 +0000 (0:00:00.125) 0:01:48.608 ******* 2021-11-15T19:22:45.008 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T19:22:45.010 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:45.033 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.052) 0:01:48.660 ******* 2021-11-15T19:22:45.081 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T19:22:45.083 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:22:45.106 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.073) 0:01:48.734 ******* 2021-11-15T19:22:45.123 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T19:22:45.125 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T19:22:45.149 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.042) 0:01:48.776 ******* 2021-11-15T19:22:45.155 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T19:22:45.157 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-15T19:22:45.181 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.031) 0:01:48.808 ******* 2021-11-15T19:22:45.284 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-15T19:22:45.285 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T19:22:45.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.126) 0:01:48.935 ******* 2021-11-15T19:22:45.408 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-15T19:22:45.410 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:45.430 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.122) 0:01:49.058 ******* 2021-11-15T19:22:45.478 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T19:22:45.480 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T19:22:45.510 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.079) 0:01:49.137 ******* 2021-11-15T19:22:45.528 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:45.529 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 50 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T19:22:45.531 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.6 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T19:22:45.532 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T19:22:45.534 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 50 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.6 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T19:22:45.536 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-15T19:22:45.536 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T19:22:45.562 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.052) 0:01:49.190 ******* 2021-11-15T19:22:45.569 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-15T19:22:45.571 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:22:45.599 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.036) 0:01:49.226 ******* 2021-11-15T19:22:45.640 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T19:22:45.642 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ActiveEnterTimestampMonotonic": "180570627", "ActiveExitTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ActiveExitTimestampMonotonic": "180528224", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target remote-fs.target system.slice nss-lookup.target systemd-tmpfiles-setup.service -.mount basic.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:22:31 UTC", "AssertTimestampMonotonic": "180559214", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ConditionTimestampMonotonic": "180559213", "ConfigurationDirect 2021-11-15T19:22:45.643 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6619", "ExecMainStartTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ExecMainStartTimestampMonotonic": "180570618", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T19:22:45.645 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:22:31 UTC", "InactiveEnterTimestampMonotonic": "180558681", "InactiveExitTimestamp": "Mon 2021-11-15 19:22:31 UTC", "InactiveExitTimestampMonotonic": "180559882", "InvocationID": "2b87b3c278564ff2b1dd72328bbb5238", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6619", "MemoryAccounting": "yes", "MemoryCurrent": "7065600", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T19:22:45.647 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:22:31 UTC", "StateChangeTimestampMonotonic": "180570627", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T19:22:45.648 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:22:45.668 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.069) 0:01:49.296 ******* 2021-11-15T19:22:45.676 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-15T19:22:45.677 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T19:22:45.702 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.034) 0:01:49.330 ******* 2021-11-15T19:22:45.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:45.716 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:45.742 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.039) 0:01:49.369 ******* 2021-11-15T19:22:45.749 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T19:22:45.751 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T19:22:45.775 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.033) 0:01:49.403 ******* 2021-11-15T19:22:45.782 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T19:22:45.784 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:45.807 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.031) 0:01:49.435 ******* 2021-11-15T19:22:45.814 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T19:22:45.816 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:45.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.031) 0:01:49.466 ******* 2021-11-15T19:22:45.846 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:45.848 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:45.871 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.032) 0:01:49.499 ******* 2021-11-15T19:22:45.878 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-15T19:22:45.880 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:45.905 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.033) 0:01:49.532 ******* 2021-11-15T19:22:45.912 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T19:22:45.914 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:45.947 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.041) 0:01:49.574 ******* 2021-11-15T19:22:45.955 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T19:22:45.957 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-15T19:22:45.981 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:45 +0000 (0:00:00.034) 0:01:49.608 ******* 2021-11-15T19:22:45.988 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T19:22:45.990 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.016 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.034) 0:01:49.643 ******* 2021-11-15T19:22:46.025 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:46.027 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 50 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T19:22:46.028 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T19:22:46.030 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T19:22:46.031 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 50 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T19:22:46.033 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} TASK [testnode : Install non aarch64 packages] *** 2021-11-15T19:22:46.035 INFO:teuthology.task.ansible.out:****************************** ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:22:46.053 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.037) 0:01:49.680 ******* 2021-11-15T19:22:46.079 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.025) 0:01:49.706 ******* 2021-11-15T19:22:46.087 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T19:22:46.089 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.115 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.036) 0:01:49.742 ******* 2021-11-15T19:22:46.123 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T19:22:46.125 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:22:32 UTC", "ActiveEnterTimestampMonotonic": "170283631", "ActiveExitTimestamp": "Mon 2021-11-15 19:22:32 UTC", "ActiveExitTimestampMonotonic": "170241333", "ActiveState": "active", "After": "system.slice remote-fs.target nss-lookup.target systemd-journald.socket systemd-tmpfiles-setup.service network.target sysinit.target basic.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:22:32 UTC", "AssertTimestampMonotonic": "170272297", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:22:32 UTC", "ConditionTimestampMonotonic": "170272296", "ConfigurationDirect 2021-11-15T19:22:46.126 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6652", "ExecMainStartTimestamp": "Mon 2021-11-15 19:22:32 UTC", "ExecMainStartTimestampMonotonic": "170283622", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T19:22:46.128 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:22:32 UTC", "InactiveEnterTimestampMonotonic": "170271902", "InactiveExitTimestamp": "Mon 2021-11-15 19:22:32 UTC", "InactiveExitTimestampMonotonic": "170272979", "InvocationID": "224ac0295bd94d46a8b58d25be28d868", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6652", "MemoryAccounting": "yes", "MemoryCurrent": "7159808", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T19:22:46.130 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:22:32 UTC", "StateChangeTimestampMonotonic": "170283631", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T19:22:46.131 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUS 2021-11-15T19:22:46.132 INFO:teuthology.task.ansible.out:ec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:22:46.157 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.042) 0:01:49.785 ******* 2021-11-15T19:22:46.164 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T19:22:46.165 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.188 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.030) 0:01:49.816 ******* 2021-11-15T19:22:46.195 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:46.196 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.218 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.030) 0:01:49.846 ******* 2021-11-15T19:22:46.225 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T19:22:46.227 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.250 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.031) 0:01:49.877 ******* 2021-11-15T19:22:46.257 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T19:22:46.259 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.282 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.032) 0:01:49.910 ******* 2021-11-15T19:22:46.303 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.020) 0:01:49.930 ******* 2021-11-15T19:22:46.309 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:46.311 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.342 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.038) 0:01:49.969 ******* 2021-11-15T19:22:46.350 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:46.351 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.374 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.032) 0:01:50.002 ******* 2021-11-15T19:22:46.382 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:46.383 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.407 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.032) 0:01:50.034 ******* 2021-11-15T19:22:46.414 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T19:22:46.416 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba017.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T19:22:46.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.032) 0:01:50.067 ******* 2021-11-15T19:22:46.460 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.021) 0:01:50.088 ******* 2021-11-15T19:22:46.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:46.469 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.493 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.032) 0:01:50.120 ******* 2021-11-15T19:22:46.500 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T19:22:46.502 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.524 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.031) 0:01:50.152 ******* 2021-11-15T19:22:46.531 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T19:22:46.533 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:46.534 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.031) 0:01:50.184 ******* 2021-11-15T19:22:46.579 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.022) 0:01:50.207 ******* 2021-11-15T19:22:46.601 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.021) 0:01:50.229 ******* 2021-11-15T19:22:46.607 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T19:22:46.609 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:46.609 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T19:22:46.610 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.636 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.034) 0:01:50.264 ******* 2021-11-15T19:22:46.657 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.021) 0:01:50.285 ******* 2021-11-15T19:22:46.688 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.030) 0:01:50.315 ******* 2021-11-15T19:22:46.696 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:46.697 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T19:22:46.722 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.034) 0:01:50.350 ******* 2021-11-15T19:22:46.745 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.022) 0:01:50.372 ******* 2021-11-15T19:22:46.753 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T19:22:46.754 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.778 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.033) 0:01:50.405 ******* 2021-11-15T19:22:46.798 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.020) 0:01:50.425 ******* 2021-11-15T19:22:46.805 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T19:22:46.806 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.829 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.031) 0:01:50.457 ******* 2021-11-15T19:22:46.853 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.023) 0:01:50.480 ******* 2021-11-15T19:22:46.860 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T19:22:46.861 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.862 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T19:22:46.863 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ActiveEnterTimestampMonotonic": "163686674", "ActiveExitTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ActiveExitTimestampMonotonic": "163643927", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service network.target system.slice nss-lookup.target systemd-journald.socket sysinit.target remote-fs.target basic.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:22:31 UTC", "AssertTimestampMonotonic": "163674985", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ConditionTimestampMonotonic": "163674984", "ConfigurationDirect 2021-11-15T19:22:46.865 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6629", "ExecMainStartTimestamp": "Mon 2021-11-15 19:22:31 UTC", "ExecMainStartTimestampMonotonic": "163686665", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T19:22:46.866 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:22:31 UTC", "InactiveEnterTimestampMonotonic": "163674509", "InactiveExitTimestamp": "Mon 2021-11-15 19:22:31 UTC", "InactiveExitTimestampMonotonic": "163675656", "InvocationID": "8f89d45899b2487cb805da40050c8d98", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6629", "MemoryAccounting": "yes", "MemoryCurrent": "7057408", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T19:22:46.868 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:22:31 UTC", "StateChangeTimestampMonotonic": "163686674", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T19:22:46.869 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.890 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.037) 0:01:50.518 ******* 2021-11-15T19:22:46.912 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.021) 0:01:50.539 ******* 2021-11-15T19:22:46.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.021) 0:01:50.561 ******* 2021-11-15T19:22:46.941 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:46.943 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:46.967 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.032) 0:01:50.594 ******* 2021-11-15T19:22:46.994 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:46 +0000 (0:00:00.027) 0:01:50.622 ******* 2021-11-15T19:22:47.002 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:47.004 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.028 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.033) 0:01:50.655 ******* 2021-11-15T19:22:47.049 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.021) 0:01:50.677 ******* 2021-11-15T19:22:47.057 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T19:22:47.058 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:22:47.059 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.085 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.035) 0:01:50.712 ******* 2021-11-15T19:22:47.107 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.022) 0:01:50.735 ******* 2021-11-15T19:22:47.129 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.021) 0:01:50.756 ******* 2021-11-15T19:22:47.151 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.022) 0:01:50.779 ******* 2021-11-15T19:22:47.158 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:47.160 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.187 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.035) 0:01:50.814 ******* 2021-11-15T19:22:47.209 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.021) 0:01:50.836 ******* 2021-11-15T19:22:47.231 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.021) 0:01:50.858 ******* 2021-11-15T19:22:47.238 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:47.239 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.263 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.031) 0:01:50.890 ******* 2021-11-15T19:22:47.283 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.020) 0:01:50.911 ******* 2021-11-15T19:22:47.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:47.293 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:47.293 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.323 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.039) 0:01:50.951 ******* 2021-11-15T19:22:47.347 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.023) 0:01:50.974 ******* 2021-11-15T19:22:47.371 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.024) 0:01:50.998 ******* 2021-11-15T19:22:47.378 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T19:22:47.380 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T19:22:47.380 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T19:22:47.381 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.409 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.038) 0:01:51.037 ******* 2021-11-15T19:22:47.431 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.021) 0:01:51.058 ******* 2021-11-15T19:22:47.452 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.020) 0:01:51.079 ******* 2021-11-15T19:22:47.472 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.019) 0:01:51.099 ******* 2021-11-15T19:22:47.478 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T19:22:47.480 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.481 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.506 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.034) 0:01:51.133 ******* 2021-11-15T19:22:47.526 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.020) 0:01:51.154 ******* 2021-11-15T19:22:47.548 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.022) 0:01:51.176 ******* 2021-11-15T19:22:47.569 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.020) 0:01:51.196 ******* 2021-11-15T19:22:47.575 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-15T19:22:47.577 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.609 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.040) 0:01:51.236 ******* 2021-11-15T19:22:47.638 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.029) 0:01:51.265 ******* 2021-11-15T19:22:47.809 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.170) 0:01:51.436 ******* 2021-11-15T19:22:47.817 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-15T19:22:47.819 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-15T19:22:47.820 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T19:22:47.844 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.035) 0:01:51.472 ******* 2021-11-15T19:22:47.864 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.019) 0:01:51.492 ******* 2021-11-15T19:22:47.886 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.021) 0:01:51.513 ******* 2021-11-15T19:22:47.908 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.022) 0:01:51.535 ******* 2021-11-15T19:22:47.915 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:47.916 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.942 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.034) 0:01:51.570 ******* 2021-11-15T19:22:47.963 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.020) 0:01:51.590 ******* 2021-11-15T19:22:47.969 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:47.971 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:47.994 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:47 +0000 (0:00:00.031) 0:01:51.621 ******* 2021-11-15T19:22:48.001 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:48.002 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:48.026 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.032) 0:01:51.654 ******* 2021-11-15T19:22:48.046 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.019) 0:01:51.674 ******* 2021-11-15T19:22:48.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:48.053 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.078 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.032) 0:01:51.706 ******* 2021-11-15T19:22:48.099 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:51.727 ******* 2021-11-15T19:22:48.107 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T19:22:48.109 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.137 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.038) 0:01:51.765 ******* 2021-11-15T19:22:48.158 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:51.785 ******* 2021-11-15T19:22:48.166 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:48.167 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.189 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.031) 0:01:51.817 ******* 2021-11-15T19:22:48.209 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:51.837 ******* 2021-11-15T19:22:48.216 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T19:22:48.217 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.242 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.033) 0:01:51.870 ******* 2021-11-15T19:22:48.263 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:51.890 ******* 2021-11-15T19:22:48.270 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T19:22:48.271 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:22:33 UTC", "ActiveEnterTimestampMonotonic": "177919525", "ActiveExitTimestamp": "Mon 2021-11-15 19:22:33 UTC", "ActiveExitTimestampMonotonic": "177877607", "ActiveState": "active", "After": "nss-lookup.target sysinit.target systemd-journald.socket basic.target network.target systemd-tmpfiles-setup.service system.slice -.mount remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:22:33 UTC", "AssertTimestampMonotonic": "177908309", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:22:33 UTC", "ConditionTimestampMonotonic": "177908309", "ConfigurationDirect 2021-11-15T19:22:48.273 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6697", "ExecMainStartTimestamp": "Mon 2021-11-15 19:22:33 UTC", "ExecMainStartTimestampMonotonic": "177919515", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T19:22:48.275 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:22:33 UTC", "InactiveEnterTimestampMonotonic": "177907880", "InactiveExitTimestamp": "Mon 2021-11-15 19:22:33 UTC", "InactiveExitTimestampMonotonic": "177908994", "InvocationID": "295b66cf50de4f158e86f6fc86f9cfe8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6697", "MemoryAccounting": "yes", "MemoryCurrent": "7098368", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T19:22:48.276 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:22:33 UTC", "StateChangeTimestampMonotonic": "177919525", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T19:22:48.278 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.300 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.037) 0:01:51.928 ******* 2021-11-15T19:22:48.321 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:51.948 ******* 2021-11-15T19:22:48.341 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.019) 0:01:51.968 ******* 2021-11-15T19:22:48.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:48.348 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.372 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.031) 0:01:52.000 ******* 2021-11-15T19:22:48.393 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.021) 0:01:52.021 ******* 2021-11-15T19:22:48.399 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:48.401 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba037.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T19:22:48.402 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.429 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.036) 0:01:52.057 ******* 2021-11-15T19:22:48.450 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.078 ******* 2021-11-15T19:22:48.471 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.098 ******* 2021-11-15T19:22:48.477 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:48.479 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-15T19:22:48.481 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.506 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.034) 0:01:52.133 ******* 2021-11-15T19:22:48.529 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.023) 0:01:52.157 ******* 2021-11-15T19:22:48.553 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.023) 0:01:52.180 ******* 2021-11-15T19:22:48.574 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.021) 0:01:52.202 ******* 2021-11-15T19:22:48.581 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:48.583 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.583 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-15T19:22:48.584 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:48.607 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.032) 0:01:52.234 ******* 2021-11-15T19:22:48.627 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.254 ******* 2021-11-15T19:22:48.648 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.021) 0:01:52.276 ******* 2021-11-15T19:22:48.654 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:48.656 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.680 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.032) 0:01:52.308 ******* 2021-11-15T19:22:48.701 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.329 ******* 2021-11-15T19:22:48.730 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.029) 0:01:52.358 ******* 2021-11-15T19:22:48.737 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:48.739 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.764 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.033) 0:01:52.391 ******* 2021-11-15T19:22:48.784 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.412 ******* 2021-11-15T19:22:48.791 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T19:22:48.793 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T19:22:48.793 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.816 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.031) 0:01:52.444 ******* 2021-11-15T19:22:48.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.021) 0:01:52.465 ******* 2021-11-15T19:22:48.858 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.486 ******* 2021-11-15T19:22:48.865 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:48.866 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.031) 0:01:52.517 ******* 2021-11-15T19:22:48.909 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.019) 0:01:52.536 ******* 2021-11-15T19:22:48.916 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T19:22:48.918 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:22:34 UTC", "ActiveEnterTimestampMonotonic": "188307600", "ActiveExitTimestamp": "Mon 2021-11-15 19:22:34 UTC", "ActiveExitTimestampMonotonic": "188237401", "ActiveState": "active", "After": "systemd-journald.socket remote-fs.target nss-lookup.target -.mount sysinit.target network.target systemd-tmpfiles-setup.service system.slice basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:22:34 UTC", "AssertTimestampMonotonic": "188274219", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:22:34 UTC", "ConditionTimestampMonotonic": "188274218", "ConfigurationDirect 2021-11-15T19:22:48.919 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6628", "ExecMainStartTimestamp": "Mon 2021-11-15 19:22:34 UTC", "ExecMainStartTimestampMonotonic": "188307578", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T19:22:48.921 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:22:34 UTC", "InactiveEnterTimestampMonotonic": "188272255", "InactiveExitTimestamp": "Mon 2021-11-15 19:22:34 UTC", "InactiveExitTimestampMonotonic": "188277454", "InvocationID": "8ed3b2054b094572a7e48c721db7bf35", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6628", "MemoryAccounting": "yes", "MemoryCurrent": "7266304", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T19:22:48.922 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:22:34 UTC", "StateChangeTimestampMonotonic": "188307600", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T19:22:48.924 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:48.942 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.033) 0:01:52.570 ******* 2021-11-15T19:22:48.963 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.590 ******* 2021-11-15T19:22:48.983 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:48 +0000 (0:00:00.020) 0:01:52.611 ******* 2021-11-15T19:22:48.989 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-15T19:22:48.991 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.018 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.035) 0:01:52.646 ******* 2021-11-15T19:22:49.038 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.019) 0:01:52.666 ******* 2021-11-15T19:22:49.059 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.021) 0:01:52.687 ******* 2021-11-15T19:22:49.067 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T19:22:49.069 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T19:22:49.093 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.033) 0:01:52.721 ******* 2021-11-15T19:22:49.113 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.019) 0:01:52.740 ******* 2021-11-15T19:22:49.135 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.022) 0:01:52.763 ******* 2021-11-15T19:22:49.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T19:22:49.144 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.144 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-15T19:22:49.145 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T19:22:49.168 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.032) 0:01:52.795 ******* 2021-11-15T19:22:49.188 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.019) 0:01:52.815 ******* 2021-11-15T19:22:49.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.020) 0:01:52.836 ******* 2021-11-15T19:22:49.216 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T19:22:49.217 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.241 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.033) 0:01:52.869 ******* 2021-11-15T19:22:49.247 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-15T19:22:49.249 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.273 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.031) 0:01:52.900 ******* 2021-11-15T19:22:49.293 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.019) 0:01:52.920 ******* 2021-11-15T19:22:49.299 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T19:22:49.301 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.331 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.037) 0:01:52.958 ******* 2021-11-15T19:22:49.351 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.020) 0:01:52.979 ******* 2021-11-15T19:22:49.372 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.021) 0:01:53.000 ******* 2021-11-15T19:22:49.380 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:49.381 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.405 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.032) 0:01:53.033 ******* 2021-11-15T19:22:49.426 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.020) 0:01:53.053 ******* 2021-11-15T19:22:49.478 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 15 November 2021 19:22:49 +0000 (0:00:00.033) 0:01:53.087 ******* 2021-11-15T19:22:49.479 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.019) 0:01:53.106 ******* 2021-11-15T19:22:49.500 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.021) 0:01:53.127 ******* 2021-11-15T19:22:49.506 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:49.508 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.532 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.032) 0:01:53.160 ******* 2021-11-15T19:22:49.552 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.019) 0:01:53.179 ******* 2021-11-15T19:22:49.558 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:49.560 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.582 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.030) 0:01:53.210 ******* 2021-11-15T19:22:49.603 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.020) 0:01:53.230 ******* 2021-11-15T19:22:49.640 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.037) 0:01:53.268 ******* 2021-11-15T19:22:49.647 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:49.648 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-15T19:22:49.650 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T19:22:49.675 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.035) 0:01:53.303 ******* 2021-11-15T19:22:49.702 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.026) 0:01:53.329 ******* 2021-11-15T19:22:49.727 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.025) 0:01:53.354 ******* 2021-11-15T19:22:49.734 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T19:22:49.736 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba011.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.736 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.737 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.737 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T19:22:49.738 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.738 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.738 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.763 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.036) 0:01:53.391 ******* 2021-11-15T19:22:49.787 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.023) 0:01:53.415 ******* 2021-11-15T19:22:49.794 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.795 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T19:22:49.795 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.795 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** ok: [gibba011.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T19:22:49.797 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.797 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.798 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.823 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.035) 0:01:53.451 ******* 2021-11-15T19:22:49.830 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.831 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.833 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.859 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.036) 0:01:53.487 ******* 2021-11-15T19:22:49.882 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.022) 0:01:53.509 ******* 2021-11-15T19:22:49.888 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T19:22:49.890 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-15T19:22:49.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.033) 0:01:53.543 ******* 2021-11-15T19:22:49.938 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.022) 0:01:53.565 ******* 2021-11-15T19:22:49.945 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T19:22:49.947 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:49.972 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:49 +0000 (0:00:00.034) 0:01:53.599 ******* 2021-11-15T19:22:49.977 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:49.979 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.015 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.043) 0:01:53.643 ******* 2021-11-15T19:22:50.023 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-15T19:22:50.025 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.052 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.036) 0:01:53.679 ******* 2021-11-15T19:22:50.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.023) 0:01:53.703 ******* 2021-11-15T19:22:50.084 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:50.086 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003267", "end": "2021-11-15 19:22:50.027462", "rc": 0, "start": "2021-11-15 19:22:50.024195", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T19:22:50.114 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.038) 0:01:53.742 ******* 2021-11-15T19:22:50.138 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.023) 0:01:53.766 ******* 2021-11-15T19:22:50.145 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T19:22:50.147 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.171 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.032) 0:01:53.798 ******* 2021-11-15T19:22:50.177 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T19:22:50.179 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T19:22:50.180 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.206 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.034) 0:01:53.833 ******* 2021-11-15T19:22:50.228 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.021) 0:01:53.855 ******* 2021-11-15T19:22:50.251 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.023) 0:01:53.879 ******* 2021-11-15T19:22:50.259 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T19:22:50.261 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.288 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.035) 0:01:53.914 ******* 2021-11-15T19:22:50.311 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.023) 0:01:53.938 ******* 2021-11-15T19:22:50.318 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T19:22:50.320 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.343 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.032) 0:01:53.971 ******* 2021-11-15T19:22:50.376 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.032) 0:01:54.003 ******* 2021-11-15T19:22:50.384 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-15T19:22:50.385 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T19:22:50.387 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.413 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.037) 0:01:54.041 ******* 2021-11-15T19:22:50.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.025) 0:01:54.066 ******* 2021-11-15T19:22:50.446 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:50.448 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.475 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.036) 0:01:54.102 ******* 2021-11-15T19:22:50.481 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T19:22:50.483 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T19:22:50.508 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.032) 0:01:54.135 ******* 2021-11-15T19:22:50.529 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.021) 0:01:54.157 ******* 2021-11-15T19:22:50.535 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T19:22:50.537 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.561 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.032) 0:01:54.189 ******* 2021-11-15T19:22:50.568 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:50.570 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.592 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.030) 0:01:54.220 ******* 2021-11-15T19:22:50.598 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:50.600 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.622 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.030) 0:01:54.250 ******* 2021-11-15T19:22:50.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:50.630 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.654 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.031) 0:01:54.281 ******* 2021-11-15T19:22:50.660 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-15T19:22:50.661 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T19:22:50.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:50.663 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.686 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.031) 0:01:54.313 ******* 2021-11-15T19:22:50.706 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.020) 0:01:54.334 ******* 2021-11-15T19:22:50.735 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.028) 0:01:54.362 ******* 2021-11-15T19:22:50.742 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:50.744 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.766 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.031) 0:01:54.394 ******* 2021-11-15T19:22:50.790 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.023) 0:01:54.417 ******* 2021-11-15T19:22:50.797 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:50.798 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:22:50.799 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-15T19:22:50.799 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:50.800 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.823 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.033) 0:01:54.450 ******* 2021-11-15T19:22:50.843 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.019) 0:01:54.470 ******* 2021-11-15T19:22:50.862 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.019) 0:01:54.490 ******* 2021-11-15T19:22:50.883 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.020) 0:01:54.510 ******* 2021-11-15T19:22:50.889 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T19:22:50.891 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.914 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.031) 0:01:54.541 ******* 2021-11-15T19:22:50.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.019) 0:01:54.561 ******* 2021-11-15T19:22:50.957 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.023) 0:01:54.584 ******* 2021-11-15T19:22:50.963 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-15T19:22:50.964 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:22:50.965 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item={'block_used': 14049716, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045392, 'size_available': 925881925632, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045392, "block_size": 4096, "block_total": 240095108, "block_used": 14049716, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881925632, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T19:22:50.966 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:50.990 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:50 +0000 (0:00:00.033) 0:01:54.618 ******* 2021-11-15T19:22:51.014 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.023) 0:01:54.642 ******* 2021-11-15T19:22:51.046 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.031) 0:01:54.673 ******* 2021-11-15T19:22:51.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.022) 0:01:54.696 ******* 2021-11-15T19:22:51.076 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:51.078 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.101 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.032) 0:01:54.728 ******* 2021-11-15T19:22:51.122 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.020) 0:01:54.749 ******* 2021-11-15T19:22:51.142 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.019) 0:01:54.769 ******* 2021-11-15T19:22:51.148 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:51.149 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002394", "end": "2021-11-15 19:22:51.229519", "rc": 0, "start": "2021-11-15 19:22:51.227125", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:51.150 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.150 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-15T19:22:51.150 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.174 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.032) 0:01:54.802 ******* 2021-11-15T19:22:51.194 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.020) 0:01:54.822 ******* 2021-11-15T19:22:51.216 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.021) 0:01:54.843 ******* 2021-11-15T19:22:51.237 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.020) 0:01:54.864 ******* 2021-11-15T19:22:51.244 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T19:22:51.245 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [gibba011.front.sepia.ceph.com] => (item={'block_used': 14049716, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045392, 'size_available': 925881925632, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045392, "block_size": 4096, "block_total": 240095108, "block_used": 14049716, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881925632, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.247 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T19:22:51.270 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.033) 0:01:54.898 ******* 2021-11-15T19:22:51.290 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.019) 0:01:54.918 ******* 2021-11-15T19:22:51.310 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.019) 0:01:54.937 ******* 2021-11-15T19:22:51.337 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.027) 0:01:54.964 ******* 2021-11-15T19:22:51.344 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:51.346 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Wipe filesystems on non-root partitions] ********************** TASK [testnode : set_fact] ***************************************************** ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T19:22:51.370 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.032) 0:01:54.997 ******* 2021-11-15T19:22:51.392 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.021) 0:01:55.019 ******* 2021-11-15T19:22:51.417 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.025) 0:01:55.044 ******* 2021-11-15T19:22:51.426 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T19:22:51.428 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba018.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.430 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.430 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.431 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.431 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.431 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T19:22:51.432 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.432 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.433 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.434 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.435 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba018.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.435 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.461 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.044) 0:01:55.089 ******* 2021-11-15T19:22:51.467 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.468 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.468 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.470 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.472 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba017.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.472 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.473 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.473 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.500 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.038) 0:01:55.127 ******* 2021-11-15T19:22:51.524 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.024) 0:01:55.151 ******* 2021-11-15T19:22:51.530 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T19:22:51.531 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.532 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba017.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.533 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.533 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.534 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.534 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.534 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.535 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.563 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.039) 0:01:55.191 ******* 2021-11-15T19:22:51.585 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.022) 0:01:55.213 ******* 2021-11-15T19:22:51.615 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T19:22:51.617 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.641 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.055) 0:01:55.268 ******* 2021-11-15T19:22:51.647 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-15T19:22:51.649 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T19:22:51.674 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.033) 0:01:55.302 ******* 2021-11-15T19:22:51.680 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T19:22:51.682 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.033) 0:01:55.335 ******* 2021-11-15T19:22:51.724 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-15T19:22:51.726 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003856", "end": "2021-11-15 19:22:51.691951", "rc": 0, "start": "2021-11-15 19:22:51.688095", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T19:22:51.758 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.050) 0:01:55.386 ******* 2021-11-15T19:22:51.765 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T19:22:51.767 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003230", "end": "2021-11-15 19:22:51.733140", "rc": 0, "start": "2021-11-15 19:22:51.729910", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T19:22:51.795 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.036) 0:01:55.423 ******* 2021-11-15T19:22:51.817 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.021) 0:01:55.444 ******* 2021-11-15T19:22:51.823 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T19:22:51.825 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.850 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.033) 0:01:55.478 ******* 2021-11-15T19:22:51.857 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.859 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.885 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.034) 0:01:55.512 ******* 2021-11-15T19:22:51.906 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.020) 0:01:55.533 ******* 2021-11-15T19:22:51.912 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-15T19:22:51.914 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.936 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.030) 0:01:55.564 ******* 2021-11-15T19:22:51.956 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.019) 0:01:55.584 ******* 2021-11-15T19:22:51.963 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T19:22:51.964 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Set grub config.] ********************************************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.965 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:51.988 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:51 +0000 (0:00:00.032) 0:01:55.616 ******* 2021-11-15T19:22:52.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.020) 0:01:55.636 ******* 2021-11-15T19:22:52.031 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.021) 0:01:55.658 ******* 2021-11-15T19:22:52.037 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:52.037 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:52.038 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:52.063 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.031) 0:01:55.690 ******* 2021-11-15T19:22:52.091 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.028) 0:01:55.718 ******* 2021-11-15T19:22:52.140 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-15T19:22:52.142 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T19:22:52.165 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.074) 0:01:55.793 ******* 2021-11-15T19:22:52.329 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-15T19:22:52.330 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-15T19:22:52.353 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.187) 0:01:55.981 ******* 2021-11-15T19:22:52.391 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T19:22:52.393 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-15T19:22:52.418 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.064) 0:01:56.046 ******* 2021-11-15T19:22:52.425 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-15T19:22:52.427 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:22:52.451 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.033) 0:01:56.079 ******* 2021-11-15T19:22:52.458 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T19:22:52.460 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:52.484 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.032) 0:01:56.112 ******* 2021-11-15T19:22:52.490 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-15T19:22:52.491 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:22:52.517 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.033) 0:01:56.145 ******* 2021-11-15T19:22:52.539 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.021) 0:01:56.166 ******* 2021-11-15T19:22:52.556 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:22:52.558 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item={'block_used': 14049712, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045396, 'size_available': 925881942016, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045396, "block_size": 4096, "block_total": 240095108, "block_used": 14049712, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881942016, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T19:22:52.582 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.042) 0:01:56.209 ******* 2021-11-15T19:22:52.588 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-15T19:22:52.590 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:52.614 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.032) 0:01:56.242 ******* 2021-11-15T19:22:52.622 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-15T19:22:52.623 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T19:22:52.647 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.032) 0:01:56.275 ******* 2021-11-15T19:22:52.654 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:22:52.656 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item={'block_used': 14049726, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045382, 'size_available': 925881884672, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045382, "block_size": 4096, "block_total": 240095108, "block_used": 14049726, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881884672, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T19:22:52.681 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.033) 0:01:56.309 ******* 2021-11-15T19:22:52.698 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T19:22:52.700 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002375", "end": "2021-11-15 19:22:52.236066", "rc": 0, "start": "2021-11-15 19:22:52.233691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:52.732 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.050) 0:01:56.360 ******* 2021-11-15T19:22:52.750 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-15T19:22:52.752 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-15T19:22:52.777 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.044) 0:01:56.404 ******* 2021-11-15T19:22:52.784 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T19:22:52.786 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'block_used': 14049712, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045396, 'size_available': 925881942016, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045396, "block_size": 4096, "block_total": 240095108, "block_used": 14049712, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881942016, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:52.812 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.035) 0:01:56.440 ******* 2021-11-15T19:22:52.819 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T19:22:52.820 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002529", "end": "2021-11-15 19:22:52.892609", "rc": 0, "start": "2021-11-15 19:22:52.890080", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:52.845 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.032) 0:01:56.472 ******* 2021-11-15T19:22:52.851 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T19:22:52.877 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.032) 0:01:56.505 ******* 2021-11-15T19:22:52.893 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T19:22:52.896 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'block_used': 14049726, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045382, 'size_available': 925881884672, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045382, "block_size": 4096, "block_total": 240095108, "block_used": 14049726, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881884672, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T19:22:52.920 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.042) 0:01:56.547 ******* 2021-11-15T19:22:52.941 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.020) 0:01:56.568 ******* 2021-11-15T19:22:52.948 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:52.949 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:52.950 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T19:22:52.974 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:52 +0000 (0:00:00.033) 0:01:56.602 ******* 2021-11-15T19:22:53.012 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:53.014 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prymRbKHvvLjjhQJIerW3FnvRiDsVwfmyOQ'], 'uuids': ['83a9c784-4097-4ae9-b34c-23b9498c0fc3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.501913", "end": "2021-11-15 19:22:53.133874", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prymRbKHvvLjjhQJIerW3FnvRiDsVwfmyOQ"], "labels": [], "masters": [], "uuids": ["83a9c784-4097-4ae9-b34c-23b9498c0fc3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:51.631961", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:53.015 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.s 2021-11-15T19:22:53.016 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.026 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.027 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.038 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-15T19:22:53.040 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T19:22:53.063 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.088) 0:01:56.691 ******* 2021-11-15T19:22:53.069 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-15T19:22:53.071 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:22:53.095 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.031) 0:01:56.722 ******* 2021-11-15T19:22:53.121 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-15T19:22:53.122 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.143 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.048) 0:01:56.771 ******* 2021-11-15T19:22:53.170 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-15T19:22:53.171 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.192 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.049) 0:01:56.820 ******* 2021-11-15T19:22:53.218 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-15T19:22:53.219 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.246 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.054) 0:01:56.874 ******* 2021-11-15T19:22:53.272 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-15T19:22:53.274 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.295 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.048) 0:01:56.923 ******* 2021-11-15T19:22:53.301 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-15T19:22:53.303 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T19:22:53.327 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.032) 0:01:56.955 ******* 2021-11-15T19:22:53.333 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-15T19:22:53.335 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.359 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.031) 0:01:56.986 ******* 2021-11-15T19:22:53.386 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:53.388 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T19:22:53.409 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.050) 0:01:57.037 ******* 2021-11-15T19:22:53.447 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T19:22:53.448 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.458 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.459 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.469 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-15T19:22:53.471 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba031.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.495 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.085) 0:01:57.123 ******* 2021-11-15T19:22:53.502 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.503 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T19:22:53.503 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.505 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.515 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.517 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.539 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.043) 0:01:57.167 ******* 2021-11-15T19:22:53.544 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T19:22:53.546 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.572 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.032) 0:01:57.199 ******* 2021-11-15T19:22:53.578 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-15T19:22:53.579 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.604 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.031) 0:01:57.231 ******* 2021-11-15T19:22:53.630 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-15T19:22:53.632 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.655 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.051) 0:01:57.282 ******* 2021-11-15T19:22:53.682 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-15T19:22:53.684 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.705 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.050) 0:01:57.333 ******* 2021-11-15T19:22:53.731 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-15T19:22:53.733 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.754 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.049) 0:01:57.382 ******* 2021-11-15T19:22:53.760 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-15T19:22:53.762 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003387", "end": "2021-11-15 19:22:53.729024", "rc": 0, "start": "2021-11-15 19:22:53.725637", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T19:22:53.791 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.036) 0:01:57.418 ******* 2021-11-15T19:22:53.797 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:22:53.798 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T19:22:53.822 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.030) 0:01:57.449 ******* 2021-11-15T19:22:53.827 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T19:22:53.828 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.855 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.033) 0:01:57.483 ******* 2021-11-15T19:22:53.863 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T19:22:53.865 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.875 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.876 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.886 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.888 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba037.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.911 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.056) 0:01:57.539 ******* 2021-11-15T19:22:53.917 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T19:22:53.918 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.919 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.919 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.930 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.932 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.942 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-15T19:22:53.944 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba037.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T19:22:53.967 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.055) 0:01:57.594 ******* 2021-11-15T19:22:53.990 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:53 +0000 (0:00:00.022) 0:01:57.617 ******* 2021-11-15T19:22:54.162 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-15T19:22:54.164 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002744", "end": "2021-11-15 19:22:54.142131", "rc": 0, "start": "2021-11-15 19:22:54.139387", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T19:22:54.188 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.198) 0:01:57.816 ******* 2021-11-15T19:22:54.204 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:54.206 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryxDSCrHXSjE2pKXwIJksV9AjQ0V3z127n'], 'uuids': ['d17dd272-27d1-4e0b-bef4-ff34f66a8447']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.095181", "end": "2021-11-15 19:22:54.331496", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryxDSCrHXSjE2pKXwIJksV9AjQ0V3z127n"], "labels": [], "masters": [], "uuids": ["d17dd272-27d1-4e0b-bef4-ff34f66a8447"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:53.236315", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:54.217 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF', 'wwn-0x50000399ab9813ca'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF-part1', 'wwn-0x50000399ab9813ca-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813ca', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2JWF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF", "wwn-0x50000399ab9813ca"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF-part1", "wwn-0x50000399ab9813ca-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JWF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813ca"}}, "skip_reason": "Cond 2021-11-15T19:22:54.218 INFO:teuthology.task.ansible.out:itional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.243 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.055) 0:01:57.871 ******* 2021-11-15T19:22:54.269 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-15T19:22:54.271 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.291 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.048) 0:01:57.919 ******* 2021-11-15T19:22:54.317 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-15T19:22:54.319 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.339 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.047) 0:01:57.967 ******* 2021-11-15T19:22:54.386 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-15T19:22:54.388 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:22:54.409 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.070) 0:01:58.037 ******* 2021-11-15T19:22:54.436 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.458 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.048) 0:01:58.085 ******* 2021-11-15T19:22:54.494 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:22:54.496 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item={'block_used': 14049724, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045384, 'size_available': 925881892864, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045384, "block_size": 4096, "block_total": 240095108, "block_used": 14049724, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881892864, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:54.497 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cERfgbcqDI4IJVU56UXygbfhoEcerg3lW'], 'uuids': ['7cec8264-c3c7-4ff6-9ec8-ded82a3c06c4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.372743", "end": "2021-11-15 19:22:54.597574", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cERfgbcqDI4IJVU56UXygbfhoEcerg3lW"], "labels": [], "masters": [], "uuids": ["7cec8264-c3c7-4ff6-9ec8- 2021-11-15T19:22:54.498 INFO:teuthology.task.ansible.out:ded82a3c06c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:53.224831", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:54.527 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.068) 0:01:58.154 ******* 2021-11-15T19:22:54.534 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.535 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.641 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T19:22:54.643 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002270", "end": "2021-11-15 19:22:54.289567", "rc": 0, "start": "2021-11-15 19:22:54.287297", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:54.664 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.136) 0:01:58.291 ******* 2021-11-15T19:22:54.681 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:54.683 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIfIKXP92gLjKUre35XZ2VCELEMd0Kbke0'], 'uuids': ['757753e5-1ce0-4782-97bb-5e15bafae8ad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.657458", "end": "2021-11-15 19:22:54.207601", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIfIKXP92gLjKUre35XZ2VCELEMd0Kbke0"], "labels": [], "masters": [], "uuids": ["757753e5-1ce0-4782-97bb-5e15bafae8ad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:52.550143", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:54.683 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.s 2021-11-15T19:22:54.685 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.695 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.706 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T19:22:54.707 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'block_used': 14049724, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045384, 'size_available': 925881892864, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045384, "block_size": 4096, "block_total": 240095108, "block_used": 14049724, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881892864, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.729 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.065) 0:01:58.357 ******* 2021-11-15T19:22:54.755 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T19:22:54.757 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:22:54.778 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.048) 0:01:58.405 ******* 2021-11-15T19:22:54.800 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.021) 0:01:58.427 ******* 2021-11-15T19:22:54.818 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:54.819 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.829 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-15T19:22:54.831 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:54.852 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.052) 0:01:58.480 ******* 2021-11-15T19:22:54.889 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:22:54.891 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'block_used': 14049718, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045390, 'size_available': 925881917440, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045390, "block_size": 4096, "block_total": 240095108, "block_used": 14049718, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881917440, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T19:22:54.913 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:54 +0000 (0:00:00.060) 0:01:58.540 ******* 2021-11-15T19:22:55.012 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T19:22:55.013 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002457", "end": "2021-11-15 19:22:55.465318", "rc": 0, "start": "2021-11-15 19:22:55.462861", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:55.035 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:55 +0000 (0:00:00.122) 0:01:58.662 ******* 2021-11-15T19:22:55.072 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T19:22:55.074 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'block_used': 14049718, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045390, 'size_available': 925881917440, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045390, "block_size": 4096, "block_total": 240095108, "block_used": 14049718, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881917440, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:55.095 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:55 +0000 (0:00:00.060) 0:01:58.723 ******* 2021-11-15T19:22:55.121 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T19:22:55.143 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:55 +0000 (0:00:00.047) 0:01:58.770 ******* 2021-11-15T19:22:55.189 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:55.191 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:55.420 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-g5kadC-8KE2-bCii-TRmz-bLAK-R6rf-UpCML8', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000BW375A', 'nvme-nvme.8086-50484b4d393230303030425733373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.122743", "end": "2021-11-15 19:22:55.545095", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-g5kadC-8KE2-bCii-TRmz-bLAK-R6rf-UpCML8", "nvme-INTEL_SSDPEL1K375GA_PHKM920000BW375A", "nvme-nvme.8086-50484b4d393230303030425733373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:54.422352", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T19:22:55.422 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:55.432 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:55.444 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:55.726 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cIwxCVF09Wn9R52UbYaDMm4CT0VoR8A3P'], 'uuids': ['5d621816-0990-499f-b93c-5bf937395c1c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.115407", "end": "2021-11-15 19:22:55.820487", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cIwxCVF09Wn9R52UbYaDMm4CT0VoR8A3P"], "labels": [], "masters": [], "uuids": ["5d621816-0990-499f-b93c-5bf937395c1c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:54.705080", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:55.728 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF', 'wwn-0x50000399ab901d83'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF-part1', 'wwn-0x50000399ab901d83-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab901d83', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I5K31JF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF", "wwn-0x50000399ab901d83"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF-part1", "wwn-0x50000399ab901d83-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I5K31JF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab901d83"}}, "skip_reason": "Cond 2021-11-15T19:22:55.729 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:22:55.875 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIZf1cay023utgCv8stxK7oIzQzf3CBZuW'], 'uuids': ['231a0298-a63a-45c7-8016-30c08f44e03f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.102775", "end": "2021-11-15 19:22:55.413526", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIZf1cay023utgCv8stxK7oIzQzf3CBZuW"], "labels": [], "masters": [], "uuids": ["231a0298-a63a-45c7-8016-30c08f44e03f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:54.310751", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:55.887 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF', 'wwn-0x50000399ab9813d2'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF-part1', 'wwn-0x50000399ab9813d2-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813d2', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2K4F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF", "wwn-0x50000399ab9813d2"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF-part1", "wwn-0x50000399ab9813d2-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K4F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813d2"}}, "skip_reason": "Cond 2021-11-15T19:22:55.888 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:22:56.405 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvPjd2Ci0fT5IGbqwiz1ShJgzeHxEDFun9'], 'uuids': ['089533ca-7215-49b7-afc1-883d9db511c7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.492391", "end": "2021-11-15 19:22:56.050896", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvPjd2Ci0fT5IGbqwiz1ShJgzeHxEDFun9"], "labels": [], "masters": [], "uuids": ["089533ca-7215-49b7-afc1-883d9db511c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:54.558505", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:56.416 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.428 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.679 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prydiIzS6YBCOxcbZq2YoB8h1T3bo4Jpjhn'], 'uuids': ['6588a0b8-1b2b-438f-83c5-6e72c46771fd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.105891", "end": "2021-11-15 19:22:56.798936", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prydiIzS6YBCOxcbZq2YoB8h1T3bo4Jpjhn"], "labels": [], "masters": [], "uuids": ["6588a0b8-1b2b-438f-83c5-6e72c46771fd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:55.693045", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:56.680 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.692 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.943 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vTR1ur-sFf3-K04y-JiWm-bTnP-Ehck-MYGFGY', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A9375A', 'nvme-nvme.8086-50484b4d393230303030413933373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.125374", "end": "2021-11-15 19:22:57.042110", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-vTR1ur-sFf3-K04y-JiWm-bTnP-Ehck-MYGFGY", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A9375A", "nvme-nvme.8086-50484b4d393230303030413933373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:55.916736", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T19:22:56.945 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:56.955 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.956 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xn93mN8YWkZz7MP4WFV4td0k6p1k0K1tj'], 'uuids': ['8847ad3e-8ac0-403f-9abf-d9b378c57f72']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.165956", "end": "2021-11-15 19:22:56.941742", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xn93mN8YWkZz7MP4WFV4td0k6p1k0K1tj"], "labels": [], "masters": [], "uuids": ["8847ad3e-8ac0-403f-9abf-d9b378c57f72"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:55.775786", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:56.958 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.968 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:56.969 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:57.127 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-DPqRDP-URr3-D9OV-mKvi-S8UJ-ytMt-HFkFIQ', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400KY375A', 'nvme-nvme.8086-50484b4d3931333430304b5933373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.155170", "end": "2021-11-15 19:22:56.662166", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-DPqRDP-URr3-D9OV-mKvi-S8UJ-ytMt-HFkFIQ", "nvme-INTEL_SSDPEL1K375GA_PHKM913400KY375A", "nvme-nvme.8086-50484b4d3931333430304b5933373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:55.506996", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T19:22:57.129 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:57.139 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:57.610 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvGjnStgfZTtGpfv7cctH94Q6ES1d1iR9a'], 'uuids': ['052021fc-af24-41b7-8e2f-8cc2cb6c914e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.097983", "end": "2021-11-15 19:22:57.253025", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvGjnStgfZTtGpfv7cctH94Q6ES1d1iR9a"], "labels": [], "masters": [], "uuids": ["052021fc-af24-41b7-8e2f-8cc2cb6c914e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:56.155042", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:57.622 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF', 'wwn-0x50000399ab801e8e'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF-part1', 'wwn-0x50000399ab801e8e-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e8e', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PUF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF", "wwn-0x50000399ab801e8e"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF-part1", "wwn-0x50000399ab801e8e-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PUF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e8e"}}, "skip_reason": "Cond 2021-11-15T19:22:57.623 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:22:57.883 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryLX5L7uJF3gMvUmt1S6EtxGhkbgwvMrsq'], 'uuids': ['12f416ac-27fa-4914-bed2-2861204b9509']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.107761", "end": "2021-11-15 19:22:58.006731", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryLX5L7uJF3gMvUmt1S6EtxGhkbgwvMrsq"], "labels": [], "masters": [], "uuids": ["12f416ac-27fa-4914-bed2-2861204b9509"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:56.898970", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:57.895 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:58.156 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xAx508R6oWMc3cOL4LvXWwcSqT1aYf19A'], 'uuids': ['70224047-5ee4-477f-899f-3c570be401c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.099534", "end": "2021-11-15 19:22:58.145022", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xAx508R6oWMc3cOL4LvXWwcSqT1aYf19A"], "labels": [], "masters": [], "uuids": ["70224047-5ee4-477f-899f-3c570be401c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:57.045488", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:58.168 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cb8F7bmsGMAz0AjUic8wBu2eBT1aZPydD'], 'uuids': ['01d67b23-af2d-4a71-9c6a-3f2c5face3c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.116791", "end": "2021-11-15 19:22:58.263444", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cb8F7bmsGMAz0AjUic8wBu2eBT1aZPydD"], "labels": [], "masters": [], "uuids": ["01d67b23-af2d-4a71-9c6a-3f2c5face3c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:57.146653", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:58.170 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF', 'wwn-0x50000399ab9813f4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1', 'wwn-0x50000399ab9813f4-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f4', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L2F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF", "wwn-0x50000399ab9813f4"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1", "wwn-0x50000399ab9813f4-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L2F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f4"}}, "skip_reason": "Cond 2021-11-15T19:22:58.171 INFO:teuthology.task.ansible.out:itional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:58.182 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:58.339 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIzHDXffzOwaStggK7UbY3Gpfj2UCYW7BA'], 'uuids': ['83c07980-773a-4a50-9bbe-440e08cc4ecc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.114536", "end": "2021-11-15 19:22:57.872901", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIzHDXffzOwaStggK7UbY3Gpfj2UCYW7BA"], "labels": [], "masters": [], "uuids": ["83c07980-773a-4a50-9bbe-440e08cc4ecc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:56.758365", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:58.341 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:58.352 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:58.822 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Ig1DDn-jTOM-K5sr-vSFL-Zki0-co2Z-M9zaNe', 'nvme-INTEL_SSDPEL1K375GA_PHKM8522008J375A', 'nvme-nvme.8086-50484b4d383532323030384a33373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.125169", "end": "2021-11-15 19:22:58.469015", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-Ig1DDn-jTOM-K5sr-vSFL-Zki0-co2Z-M9zaNe", "nvme-INTEL_SSDPEL1K375GA_PHKM8522008J375A", "nvme-nvme.8086-50484b4d383532323030384a33373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:57.343846", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T19:22:58.824 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:58.834 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:58.845 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.076 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryeGj9UdA7koM256e00C84ZhjbNuQT4oRI'], 'uuids': ['b7532feb-7747-4ad4-8127-5230b2fb87ee']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.102189", "end": "2021-11-15 19:22:59.199254", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryeGj9UdA7koM256e00C84ZhjbNuQT4oRI"], "labels": [], "masters": [], "uuids": ["b7532feb-7747-4ad4-8127-5230b2fb87ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:58.097065", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:59.109 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:22:59 +0000 (0:00:03.966) 0:02:02.736 ******* 2021-11-15T19:22:59.158 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:22:59.159 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.326 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prymRbKHvvLjjhQJIerW3FnvRiDsVwfmyOQ'], 'uuids': ['83a9c784-4097-4ae9-b34c-23b9498c0fc3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077791", "end": "2021-11-15 19:22:59.457329", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prymRbKHvvLjjhQJIerW3FnvRiDsVwfmyOQ"], "labels": [], "masters": [], "uuids": ["83a9c784-4097-4ae9-b34c-23b9498c0fc3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.379538", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0765984 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0765984 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:59.337 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.339 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.371 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:59.373 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5PCCj4-WwG8-QyFg-Le2d-Icjl-hIAK-7PwEkO', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A', 'nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.126982", "end": "2021-11-15 19:22:59.363337", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-5PCCj4-WwG8-QyFg-Le2d-Icjl-hIAK-7PwEkO", "nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A", "nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:58.236355", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T19:22:59.374 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:59.383 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.394 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.396 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7F4PefoANiZTvGIBiyOkGEbva2pcEC2y'], 'uuids': ['49ac93f3-c53f-456e-8558-ea0b48cd0e7d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.096980", "end": "2021-11-15 19:22:59.496135", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7F4PefoANiZTvGIBiyOkGEbva2pcEC2y"], "labels": [], "masters": [], "uuids": ["49ac93f3-c53f-456e-8558-ea0b48cd0e7d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:58.399155", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:59.407 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.503 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:22:59.505 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryxDSCrHXSjE2pKXwIJksV9AjQ0V3z127n'], 'uuids': ['d17dd272-27d1-4e0b-bef4-ff34f66a8447']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077991", "end": "2021-11-15 19:22:59.630959", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryxDSCrHXSjE2pKXwIJksV9AjQ0V3z127n"], "labels": [], "masters": [], "uuids": ["d17dd272-27d1-4e0b-bef4-ff34f66a8447"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.552968", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767843 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767843 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:59.515 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF', 'wwn-0x50000399ab9813ca'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF-part1', 'wwn-0x50000399ab9813ca-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813ca', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2JWF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF", "wwn-0x50000399ab9813ca"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JWF6XF-part1", "wwn-0x50000399ab9813ca-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JWF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813ca"}}, "skip_reason": "Cond 2021-11-15T19:22:59.517 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:22:59.579 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:22:59.581 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIO5RsRfKCcnYU2H6x6qiYs1gQjayi9yvW'], 'uuids': ['1ccab4f5-461a-4465-8b5d-166faf7cd06b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.140598", "end": "2021-11-15 19:22:59.118310", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIO5RsRfKCcnYU2H6x6qiYs1gQjayi9yvW"], "labels": [], "masters": [], "uuids": ["1ccab4f5-461a-4465-8b5d-166faf7cd06b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:57.977712", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:22:59.591 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.633 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:22:59.635 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-g5kadC-8KE2-bCii-TRmz-bLAK-R6rf-UpCML8', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000BW375A', 'nvme-nvme.8086-50484b4d393230303030425733373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025902", "end": "2021-11-15 19:22:59.757850", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-g5kadC-8KE2-bCii-TRmz-bLAK-R6rf-UpCML8", "nvme-INTEL_SSDPEL1K375GA_PHKM920000BW375A", "nvme-nvme.8086-50484b4d393230303030425733373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.731948", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0247033 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-15T19:22:59.637 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0247033 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.646 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.804 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prydiIzS6YBCOxcbZq2YoB8h1T3bo4Jpjhn'], 'uuids': ['6588a0b8-1b2b-438f-83c5-6e72c46771fd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078327", "end": "2021-11-15 19:22:59.937598", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8prydiIzS6YBCOxcbZq2YoB8h1T3bo4Jpjhn"], "labels": [], "masters": [], "uuids": ["6588a0b8-1b2b-438f-83c5-6e72c46771fd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.859271", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771085 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771085 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:59.816 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.817 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:22:59.987 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryLX5L7uJF3gMvUmt1S6EtxGhkbgwvMrsq'], 'uuids': ['12f416ac-27fa-4914-bed2-2861204b9509']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078323", "end": "2021-11-15 19:23:00.112225", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryLX5L7uJF3gMvUmt1S6EtxGhkbgwvMrsq"], "labels": [], "masters": [], "uuids": ["12f416ac-27fa-4914-bed2-2861204b9509"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:00.033902", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770225 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770225 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:22:59.988 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.083 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:00.085 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvZbJ7ca8V9QeONxRz94GHcA57KspF4JLX'], 'uuids': ['0987476b-c4da-4189-a562-69341990e1db']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.129221", "end": "2021-11-15 19:22:59.726725", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvZbJ7ca8V9QeONxRz94GHcA57KspF4JLX"], "labels": [], "masters": [], "uuids": ["0987476b-c4da-4189-a562-69341990e1db"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:58.597504", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:23:00.095 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.096 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.149 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:00.151 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryeGj9UdA7koM256e00C84ZhjbNuQT4oRI'], 'uuids': ['b7532feb-7747-4ad4-8127-5230b2fb87ee']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078082", "end": "2021-11-15 19:23:00.279384", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-iESRJU8pDI74edi2eeCLSv8Q73dU8pryeGj9UdA7koM256e00C84ZhjbNuQT4oRI"], "labels": [], "masters": [], "uuids": ["b7532feb-7747-4ad4-8127-5230b2fb87ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:00.201302", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768553 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768553 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:00.183 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:01.073) 0:02:03.810 ******* 2021-11-15T19:23:00.476 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T19:23:00.478 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.167439", "end": "2021-11-15 19:23:00.584881", "rc": 0, "start": "2021-11-15 19:23:00.417442", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:00.498 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.315) 0:02:04.126 ******* 2021-11-15T19:23:00.600 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:00.602 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7LfjipXnrJLBP3bi7QZqn0dU033SNuBs'], 'uuids': ['93b9ce31-7385-4db4-b3d2-e117c8e44d4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.109796", "end": "2021-11-15 19:23:00.696491", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7LfjipXnrJLBP3bi7QZqn0dU033SNuBs"], "labels": [], "masters": [], "uuids": ["93b9ce31-7385-4db4-b3d2-e117c8e44d4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.586695", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:23:00.641 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.142) 0:02:04.268 ******* 2021-11-15T19:23:00.651 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xy4ONVctbN9p2WCJ36Lg8Molea1KW0xuM'], 'uuids': ['2fb9055a-bfac-4405-8eac-b3166c7da3c5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.100170", "end": "2021-11-15 19:23:00.596875", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xy4ONVctbN9p2WCJ36Lg8Molea1KW0xuM"], "labels": [], "masters": [], "uuids": ["2fb9055a-bfac-4405-8eac-b3166c7da3c5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.496705", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:23:00.652 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.654 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.676 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T19:23:00.678 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.077948", "end": "2021-11-15 19:23:00.804546", "rc": 0, "start": "2021-11-15 19:23:00.726598", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:00.701 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.060) 0:02:04.329 ******* 2021-11-15T19:23:00.708 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:00.709 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.720 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T19:23:00.745 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.043) 0:02:04.372 ******* 2021-11-15T19:23:00.771 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:00.773 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIVbFh92qp17SceJgoR26KdsWEr2DWl8Kl'], 'uuids': ['05ddd109-4150-4787-a9de-742a9d2eeb15']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.097271", "end": "2021-11-15 19:23:00.306461", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIVbFh92qp17SceJgoR26KdsWEr2DWl8Kl"], "labels": [], "masters": [], "uuids": ["05ddd109-4150-4787-a9de-742a9d2eeb15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.209190", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Write a 2021-11-15T19:23:00.775 INFO:teuthology.task.ansible.out:new partition table to {{ item.value.device }}] ******* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.776 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:00.807 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.061) 0:02:04.434 ******* 2021-11-15T19:23:00.829 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.022) 0:02:04.456 ******* 2021-11-15T19:23:00.835 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-15T19:23:00.837 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.863 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.034) 0:02:04.491 ******* 2021-11-15T19:23:00.871 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:00.873 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cERfgbcqDI4IJVU56UXygbfhoEcerg3lW'], 'uuids': ['7cec8264-c3c7-4ff6-9ec8-ded82a3c06c4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077645", "end": "2021-11-15 19:23:00.958275", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cERfgbcqDI4IJVU56UXygbfhoEcerg3lW"], "labels": [], "masters": [], "uuids": ["7cec8264-c3c7-4ff6-9ec8-ded82a3c06c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:00.880630", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764967 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764967 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:00.874 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 2021-11-15T19:23:00.876 INFO:teuthology.task.ansible.out:'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.885 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.886 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.888 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.913 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.049) 0:02:04.540 ******* 2021-11-15T19:23:00.939 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T19:23:00.941 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:00.962 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:00 +0000 (0:00:00.049) 0:02:04.590 ******* 2021-11-15T19:23:01.031 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:01.033 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cIwxCVF09Wn9R52UbYaDMm4CT0VoR8A3P'], 'uuids': ['5d621816-0990-499f-b93c-5bf937395c1c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078426", "end": "2021-11-15 19:23:01.134639", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cIwxCVF09Wn9R52UbYaDMm4CT0VoR8A3P"], "labels": [], "masters": [], "uuids": ["5d621816-0990-499f-b93c-5bf937395c1c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.056213", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771705 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771705 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.033 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF', 'wwn-0x50000399ab901d83'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [ 2021-11-15T19:23:01.035 INFO:teuthology.task.ansible.out:], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF-part1', 'wwn-0x50000399ab901d83-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab901d83', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I5K31JF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF", "wwn-0x50000399ab901d83"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I5K31JF6XF-part1", "wwn-0x50000399ab901d83-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I5K31JF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab901d83"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.045 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIfIKXP92gLjKUre35XZ2VCELEMd0Kbke0'], 'uuids': ['757753e5-1ce0-4782-97bb-5e15bafae8ad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078699", "end": "2021-11-15 19:23:00.583916", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIfIKXP92gLjKUre35XZ2VCELEMd0Kbke0"], "labels": [], "masters": [], "uuids": ["757753e5-1ce0-4782-97bb-5e15bafae8ad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:00.505217", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0774808 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0774808 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.046 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.058 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T19:23:01.060 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.084 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.121) 0:02:04.712 ******* 2021-11-15T19:23:01.135 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:23:01.137 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'block_used': 14049716, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045392, 'size_available': 925881925632, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045392, "block_size": 4096, "block_total": 240095108, "block_used": 14049716, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881925632, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.164 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.079) 0:02:04.792 ******* 2021-11-15T19:23:01.172 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:01.173 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vTR1ur-sFf3-K04y-JiWm-bTnP-Ehck-MYGFGY', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A9375A', 'nvme-nvme.8086-50484b4d393230303030413933373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025737", "end": "2021-11-15 19:23:01.262171", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-vTR1ur-sFf3-K04y-JiWm-bTnP-Ehck-MYGFGY", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A9375A", "nvme-nvme.8086-50484b4d393230303030413933373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.236434", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0245532 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-15T19:23:01.175 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0245532 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.187 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.198 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.222 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.057) 0:02:04.849 ******* 2021-11-15T19:23:01.241 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:01.242 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIZf1cay023utgCv8stxK7oIzQzf3CBZuW'], 'uuids': ['231a0298-a63a-45c7-8016-30c08f44e03f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.080653", "end": "2021-11-15 19:23:00.766400", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIZf1cay023utgCv8stxK7oIzQzf3CBZuW"], "labels": [], "masters": [], "uuids": ["231a0298-a63a-45c7-8016-30c08f44e03f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:00.685747", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0794669 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0794669 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.245 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF', 'wwn-0x50000399ab9813d2'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF-part1', 'wwn-0x50000399ab9813d2-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813d2', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2K4F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF", "wwn-0x50000399ab9813d2"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K4F6XF-part1", "wwn-0x50000399ab9813d2-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K4F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813d2"}}, "skip_reason": "Cond 2021-11-15T19:23:01.247 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:23:01.258 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:01.260 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.283 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.060) 0:02:04.910 ******* 2021-11-15T19:23:01.311 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:01.313 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.349 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.066) 0:02:04.976 ******* 2021-11-15T19:23:01.361 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:01.362 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv4wLYlGpFIjfZvr0m0prZznFLCY3Mo4QM'], 'uuids': ['73cc1eb2-8a4d-498a-a781-844f692e6832']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.109435", "end": "2021-11-15 19:23:00.979175", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv4wLYlGpFIjfZvr0m0prZznFLCY3Mo4QM"], "labels": [], "masters": [], "uuids": ["73cc1eb2-8a4d-498a-a781-844f692e6832"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:22:59.869740", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:23:01.365 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.366 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:01.366 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cb8F7bmsGMAz0AjUic8wBu2eBT1aZPydD'], 'uuids': ['01d67b23-af2d-4a71-9c6a-3f2c5face3c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.079002", "end": "2021-11-15 19:23:01.447163", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9cb8F7bmsGMAz0AjUic8wBu2eBT1aZPydD"], "labels": [], "masters": [], "uuids": ["01d67b23-af2d-4a71-9c6a-3f2c5face3c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.368161", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0776256 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0776256 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.368 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.370 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.381 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.407 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.057) 0:02:05.034 ******* 2021-11-15T19:23:01.435 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T19:23:01.437 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.460 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.053) 0:02:05.087 ******* 2021-11-15T19:23:01.489 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T19:23:01.490 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.513 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.052) 0:02:05.140 ******* 2021-11-15T19:23:01.521 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:01.523 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-DPqRDP-URr3-D9OV-mKvi-S8UJ-ytMt-HFkFIQ', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400KY375A', 'nvme-nvme.8086-50484b4d3931333430304b5933373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025696", "end": "2021-11-15 19:23:01.040877", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-DPqRDP-URr3-D9OV-mKvi-S8UJ-ytMt-HFkFIQ", "nvme-INTEL_SSDPEL1K375GA_PHKM913400KY375A", "nvme-nvme.8086-50484b4d3931333430304b5933373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.015181", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0243751 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-15T19:23:01.525 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0243751 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.537 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7F4PefoANiZTvGIBiyOkGEbva2pcEC2y'], 'uuids': ['49ac93f3-c53f-456e-8558-ea0b48cd0e7d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078344", "end": "2021-11-15 19:23:01.623053", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7F4PefoANiZTvGIBiyOkGEbva2pcEC2y"], "labels": [], "masters": [], "uuids": ["49ac93f3-c53f-456e-8558-ea0b48cd0e7d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.544709", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771072 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771072 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.538 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.688 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIzHDXffzOwaStggK7UbY3Gpfj2UCYW7BA'], 'uuids': ['83c07980-773a-4a50-9bbe-440e08cc4ecc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078554", "end": "2021-11-15 19:23:01.226373", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIzHDXffzOwaStggK7UbY3Gpfj2UCYW7BA"], "labels": [], "masters": [], "uuids": ["83c07980-773a-4a50-9bbe-440e08cc4ecc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.147819", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772044 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772044 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.690 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7LfjipXnrJLBP3bi7QZqn0dU033SNuBs'], 'uuids': ['93b9ce31-7385-4db4-b3d2-e117c8e44d4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078352", "end": "2021-11-15 19:23:01.793111", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9FHZFR6cvn5LP46G6Yr43YL1ReDxZw9c7LfjipXnrJLBP3bi7QZqn0dU033SNuBs"], "labels": [], "masters": [], "uuids": ["93b9ce31-7385-4db4-b3d2-e117c8e44d4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.714759", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771025 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771025 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.712 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.714 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.738 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:01 +0000 (0:00:00.224) 0:02:05.365 ******* 2021-11-15T19:23:01.821 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:01.823 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xbE25ot9EU4g962jO7fiA6dcT7RQBmvnK'], 'uuids': ['154543dd-aea0-4c22-a1aa-19ae2658c24d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.102062", "end": "2021-11-15 19:23:01.804756", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xbE25ot9EU4g962jO7fiA6dcT7RQBmvnK"], "labels": [], "masters": [], "uuids": ["154543dd-aea0-4c22-a1aa-19ae2658c24d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:00.702694", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:23:01.833 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:01.887 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:01.888 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIO5RsRfKCcnYU2H6x6qiYs1gQjayi9yvW'], 'uuids': ['1ccab4f5-461a-4465-8b5d-166faf7cd06b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078555", "end": "2021-11-15 19:23:01.430186", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIO5RsRfKCcnYU2H6x6qiYs1gQjayi9yvW"], "labels": [], "masters": [], "uuids": ["1ccab4f5-461a-4465-8b5d-166faf7cd06b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.351631", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772753 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772753 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:01.900 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.038 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T19:23:02.039 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.174660", "end": "2021-11-15 19:23:02.125938", "rc": 0, "start": "2021-11-15 19:23:01.951278", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:02.064 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.326) 0:02:05.692 ******* 2021-11-15T19:23:02.221 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:02.223 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIVbFh92qp17SceJgoR26KdsWEr2DWl8Kl'], 'uuids': ['05ddd109-4150-4787-a9de-742a9d2eeb15']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078251", "end": "2021-11-15 19:23:01.605055", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-G3hoQg3y8m4bL7E65A8mGL80HsdEWaNIVbFh92qp17SceJgoR26KdsWEr2DWl8Kl"], "labels": [], "masters": [], "uuids": ["05ddd109-4150-4787-a9de-742a9d2eeb15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.526804", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770396 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770396 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:02.258 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.193) 0:02:05.886 ******* 2021-11-15T19:23:02.269 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T19:23:02.269 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T19:23:02.299 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.040) 0:02:05.926 ******* 2021-11-15T19:23:02.405 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T19:23:02.406 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.080808", "end": "2021-11-15 19:23:02.501404", "rc": 0, "start": "2021-11-15 19:23:02.420596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:02.430 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.130) 0:02:06.057 ******* 2021-11-15T19:23:02.457 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T19:23:02.484 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.054) 0:02:06.112 ******* 2021-11-15T19:23:02.513 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-15T19:23:02.514 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.541 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.056) 0:02:06.168 ******* 2021-11-15T19:23:02.549 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:02.551 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv01bmFdgeZ2X9JJHPqhMbUdf8zzFkXBa1'], 'uuids': ['3bd79640-0f6a-4a16-875d-2d64549841f9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.095074", "end": "2021-11-15 19:23:02.172055", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv01bmFdgeZ2X9JJHPqhMbUdf8zzFkXBa1"], "labels": [], "masters": [], "uuids": ["3bd79640-0f6a-4a16-875d-2d64549841f9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.076981", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T19:23:02.595 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.054) 0:02:06.222 ******* 2021-11-15T19:23:02.600 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-15T19:23:02.602 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [gibba017.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.207697", "end": "2021-11-15 19:23:02.109876", "rc": 0, "start": "2021-11-15 19:23:01.902179", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:02.629 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.033) 0:02:06.256 ******* 2021-11-15T19:23:02.664 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.034) 0:02:06.291 ******* 2021-11-15T19:23:02.671 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:02.673 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.694 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:02.696 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.720 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.056) 0:02:06.347 ******* 2021-11-15T19:23:02.746 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T19:23:02.748 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.768 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.048) 0:02:06.396 ******* 2021-11-15T19:23:02.796 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:02.799 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:02.808 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:02.810 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvPjd2Ci0fT5IGbqwiz1ShJgzeHxEDFun9'], 'uuids': ['089533ca-7215-49b7-afc1-883d9db511c7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077947", "end": "2021-11-15 19:23:02.460190", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvPjd2Ci0fT5IGbqwiz1ShJgzeHxEDFun9"], "labels": [], "masters": [], "uuids": ["089533ca-7215-49b7-afc1-883d9db511c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:02.382243", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767317 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767317 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:02.820 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.832 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.843 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T19:23:02.845 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.104604", "end": "2021-11-15 19:23:02.386095", "rc": 0, "start": "2021-11-15 19:23:02.281491", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:02.869 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.100) 0:02:06.496 ******* 2021-11-15T19:23:02.875 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T19:23:02.877 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:23:02.899 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.030) 0:02:06.527 ******* 2021-11-15T19:23:02.905 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T19:23:02.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.034) 0:02:06.561 ******* 2021-11-15T19:23:02.942 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:23:02.943 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'block_used': 14049726, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045382, 'size_available': 925881884672, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045382, "block_size": 4096, "block_total": 240095108, "block_used": 14049726, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881884672, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:02.967 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:02 +0000 (0:00:00.033) 0:02:06.595 ******* 2021-11-15T19:23:02.973 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-15T19:23:02.975 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.003 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.035) 0:02:06.630 ******* 2021-11-15T19:23:03.010 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-15T19:23:03.011 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.012 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvGjnStgfZTtGpfv7cctH94Q6ES1d1iR9a'], 'uuids': ['052021fc-af24-41b7-8e2f-8cc2cb6c914e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078506", "end": "2021-11-15 19:23:02.647028", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvGjnStgfZTtGpfv7cctH94Q6ES1d1iR9a"], "labels": [], "masters": [], "uuids": ["052021fc-af24-41b7-8e2f-8cc2cb6c914e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:02.568522", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772952 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772952 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.013 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF', 'wwn-0x50000399ab801e8e'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF-part1', 'wwn-0x50000399ab801e8e-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e8e', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PUF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF", "wwn-0x50000399ab801e8e"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PUF6XF-part1", "wwn-0x50000399ab801e8e-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PUF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e8e"}}, "skip_reason": "Cond 2021-11-15T19:23:03.015 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:23:03.041 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.038) 0:02:06.669 ******* 2021-11-15T19:23:03.048 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:03.050 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xiH7bSDqwxr72O6Hl3KOx3opOvT3ylBw4'], 'uuids': ['03d4c0e5-6b07-471d-9f9b-a93040b0afd6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.124760", "end": "2021-11-15 19:23:03.021787", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xiH7bSDqwxr72O6Hl3KOx3opOvT3ylBw4"], "labels": [], "masters": [], "uuids": ["03d4c0e5-6b07-471d-9f9b-a93040b0afd6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:01.897027", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Write pa 2021-11-15T19:23:03.052 INFO:teuthology.task.ansible.out:rtition entries to {{ item.0.device }}] *************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.055 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T19:23:03.088 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.046) 0:02:06.716 ******* 2021-11-15T19:23:03.123 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.034) 0:02:06.751 ******* 2021-11-15T19:23:03.130 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:03.131 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:03.133 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.134 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Ig1DDn-jTOM-K5sr-vSFL-Zki0-co2Z-M9zaNe', 'nvme-INTEL_SSDPEL1K375GA_PHKM8522008J375A', 'nvme-nvme.8086-50484b4d383532323030384a33373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025525", "end": "2021-11-15 19:23:02.782894", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-Ig1DDn-jTOM-K5sr-vSFL-Zki0-co2Z-M9zaNe", "nvme-INTEL_SSDPEL1K375GA_PHKM8522008J375A", "nvme-nvme.8086-50484b4d383532323030384a33373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:02.757369", "stderr": "110+0 records in\n110+0 records out\n1 2021-11-15T19:23:03.136 INFO:teuthology.task.ansible.out:15343360 bytes (115 MB, 110 MiB) copied, 0.0242566 s, 4.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0242566 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.163 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.040) 0:02:06.791 ******* 2021-11-15T19:23:03.197 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.033) 0:02:06.825 ******* 2021-11-15T19:23:03.204 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.206 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.207 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.208 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T19:23:03.208 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.234 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.036) 0:02:06.862 ******* 2021-11-15T19:23:03.241 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:03.242 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.272 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.037) 0:02:06.899 ******* 2021-11-15T19:23:03.298 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T19:23:03.300 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.324 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.051) 0:02:06.951 ******* 2021-11-15T19:23:03.331 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.332 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvZbJ7ca8V9QeONxRz94GHcA57KspF4JLX'], 'uuids': ['0987476b-c4da-4189-a562-69341990e1db']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077899", "end": "2021-11-15 19:23:02.966902", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0NvZbJ7ca8V9QeONxRz94GHcA57KspF4JLX"], "labels": [], "masters": [], "uuids": ["0987476b-c4da-4189-a562-69341990e1db"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:02.889003", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.076592 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.076592 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.334 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.345 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T19:23:03.347 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.347 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.349 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.372 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.048) 0:02:06.999 ******* 2021-11-15T19:23:03.394 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.022) 0:02:07.022 ******* 2021-11-15T19:23:03.401 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.402 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xn93mN8YWkZz7MP4WFV4td0k6p1k0K1tj'], 'uuids': ['8847ad3e-8ac0-403f-9abf-d9b378c57f72']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.079795", "end": "2021-11-15 19:23:03.355426", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xn93mN8YWkZz7MP4WFV4td0k6p1k0K1tj"], "labels": [], "masters": [], "uuids": ["8847ad3e-8ac0-403f-9abf-d9b378c57f72"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:03.275631", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0785997 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0785997 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.404 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.405 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.417 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:23:03.418 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'block_used': 14049712, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045396, 'size_available': 925881942016, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045396, "block_size": 4096, "block_total": 240095108, "block_used": 14049712, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881942016, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.441 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.046) 0:02:07.069 ******* 2021-11-15T19:23:03.448 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T19:23:03.450 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.478 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.037) 0:02:07.106 ******* 2021-11-15T19:23:03.485 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-15T19:23:03.487 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:03.512 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.033) 0:02:07.139 ******* 2021-11-15T19:23:03.540 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:03.541 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.571 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.059) 0:02:07.199 ******* 2021-11-15T19:23:03.578 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.579 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv4wLYlGpFIjfZvr0m0prZznFLCY3Mo4QM'], 'uuids': ['73cc1eb2-8a4d-498a-a781-844f692e6832']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078335", "end": "2021-11-15 19:23:03.195876", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv4wLYlGpFIjfZvr0m0prZznFLCY3Mo4QM"], "labels": [], "masters": [], "uuids": ["73cc1eb2-8a4d-498a-a781-844f692e6832"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:03.117541", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770883 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770883 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.581 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xAx508R6oWMc3cOL4LvXWwcSqT1aYf19A'], 'uuids': ['70224047-5ee4-477f-899f-3c570be401c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078614", "end": "2021-11-15 19:23:03.543089", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xAx508R6oWMc3cOL4LvXWwcSqT1aYf19A"], "labels": [], "masters": [], "uuids": ["70224047-5ee4-477f-899f-3c570be401c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:03.464475", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.07742 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.07742 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.582 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.584 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF', 'wwn-0x50000399ab9813f4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1', 'wwn-0x50000399ab9813f4-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f4', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L2F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF", "wwn-0x50000399ab9813f4"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1", "wwn-0x50000399ab9813f4-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L2F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f4"}}, "skip_reason": "Cond 2021-11-15T19:23:03.585 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T19:23:03.595 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:03.597 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.618 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.046) 0:02:07.245 ******* 2021-11-15T19:23:03.645 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T19:23:03.646 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.667 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.049) 0:02:07.295 ******* 2021-11-15T19:23:03.693 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T19:23:03.695 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.718 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.050) 0:02:07.345 ******* 2021-11-15T19:23:03.726 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.727 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5PCCj4-WwG8-QyFg-Le2d-Icjl-hIAK-7PwEkO', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A', 'nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025447", "end": "2021-11-15 19:23:03.713390", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-5PCCj4-WwG8-QyFg-Le2d-Icjl-hIAK-7PwEkO", "nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A", "nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:03.687943", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0242578 s, 4.8 GB/s", "stderr_lines": ["1 2021-11-15T19:23:03.729 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0242578 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.741 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.743 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv01bmFdgeZ2X9JJHPqhMbUdf8zzFkXBa1'], 'uuids': ['3bd79640-0f6a-4a16-875d-2d64549841f9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078875", "end": "2021-11-15 19:23:03.388235", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-89dq1aMW2Uh8l2FdcbCz7NiAxV1OI0Nv01bmFdgeZ2X9JJHPqhMbUdf8zzFkXBa1"], "labels": [], "masters": [], "uuids": ["3bd79640-0f6a-4a16-875d-2d64549841f9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:03.309360", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0775926 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0775926 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.744 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.755 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T19:23:03.757 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.778 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.060) 0:02:07.406 ******* 2021-11-15T19:23:03.801 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:03 +0000 (0:00:00.022) 0:02:07.428 ******* 2021-11-15T19:23:03.841 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:03.843 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:03.916 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:03.917 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xy4ONVctbN9p2WCJ36Lg8Molea1KW0xuM'], 'uuids': ['2fb9055a-bfac-4405-8eac-b3166c7da3c5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078867", "end": "2021-11-15 19:23:03.905912", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xy4ONVctbN9p2WCJ36Lg8Molea1KW0xuM"], "labels": [], "masters": [], "uuids": ["2fb9055a-bfac-4405-8eac-b3166c7da3c5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:03.827045", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.077641 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.077641 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:03.928 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.929 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:03.982 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T19:23:03.984 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T19:23:04.007 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.206) 0:02:07.635 ******* 2021-11-15T19:23:04.077 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T19:23:04.079 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.143107", "end": "2021-11-15 19:23:03.704839", "rc": 0, "start": "2021-11-15 19:23:03.561732", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:04.102 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.094) 0:02:07.729 ******* 2021-11-15T19:23:04.140 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:04.141 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xbE25ot9EU4g962jO7fiA6dcT7RQBmvnK'], 'uuids': ['154543dd-aea0-4c22-a1aa-19ae2658c24d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.077367", "end": "2021-11-15 19:23:04.134196", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xbE25ot9EU4g962jO7fiA6dcT7RQBmvnK"], "labels": [], "masters": [], "uuids": ["154543dd-aea0-4c22-a1aa-19ae2658c24d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:04.056829", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0761612 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0761612 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:04.152 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.226 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:04.228 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:04.253 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.151) 0:02:07.880 ******* 2021-11-15T19:23:04.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.100202", "end": "2021-11-15 19:23:03.949304", "rc": 0, "start": "2021-11-15 19:23:03.849102", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:04.314 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T19:23:04.315 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T19:23:04.316 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T19:23:04.317 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xiH7bSDqwxr72O6Hl3KOx3opOvT3ylBw4'], 'uuids': ['03d4c0e5-6b07-471d-9f9b-a93040b0afd6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078604", "end": "2021-11-15 19:23:04.311091", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9WFMDhL77pPaXpuRcDrXmJJxnTK1qA0xiH7bSDqwxr72O6Hl3KOx3opOvT3ylBw4"], "labels": [], "masters": [], "uuids": ["03d4c0e5-6b07-471d-9f9b-a93040b0afd6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 19:23:04.232487", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773936 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773936 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:04.340 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.087) 0:02:07.968 ******* 2021-11-15T19:23:04.362 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.022) 0:02:07.990 ******* 2021-11-15T19:23:04.381 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:04.382 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T19:23:04.407 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.044) 0:02:08.035 ******* 2021-11-15T19:23:04.432 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.024) 0:02:08.059 ******* 2021-11-15T19:23:04.439 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T19:23:04.439 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:04.440 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:04.470 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.038) 0:02:08.098 ******* 2021-11-15T19:23:04.498 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-15T19:23:04.500 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.524 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.053) 0:02:08.151 ******* 2021-11-15T19:23:04.541 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:04.543 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:04.553 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.576 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.052) 0:02:08.204 ******* 2021-11-15T19:23:04.603 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:04.604 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.628 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.051) 0:02:08.255 ******* 2021-11-15T19:23:04.634 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:04.636 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:04.657 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.681 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.053) 0:02:08.309 ******* 2021-11-15T19:23:04.699 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:04.700 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:04.742 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T19:23:04.744 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.186389", "end": "2021-11-15 19:23:04.711240", "rc": 0, "start": "2021-11-15 19:23:04.524851", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:04.769 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.087) 0:02:08.396 ******* 2021-11-15T19:23:04.794 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T19:23:04.796 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:04.798 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** skipping: [gibba011.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.825 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.055) 0:02:08.452 ******* 2021-11-15T19:23:04.849 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.024) 0:02:08.477 ******* 2021-11-15T19:23:04.859 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:04.860 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:04.862 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.897 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.048) 0:02:08.525 ******* 2021-11-15T19:23:04.904 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T19:23:04.906 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'block_used': 14049724, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045384, 'size_available': 925881892864, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045384, "block_size": 4096, "block_total": 240095108, "block_used": 14049724, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881892864, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.930 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.032) 0:02:08.557 ******* 2021-11-15T19:23:04.936 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T19:23:04.938 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.962 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.032) 0:02:08.589 ******* 2021-11-15T19:23:04.968 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-15T19:23:04.970 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:04.994 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:04 +0000 (0:00:00.032) 0:02:08.622 ******* 2021-11-15T19:23:05.001 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T19:23:05.002 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.097854", "end": "2021-11-15 19:23:04.959566", "rc": 0, "start": "2021-11-15 19:23:04.861712", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:05.027 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.033) 0:02:08.655 ******* 2021-11-15T19:23:05.033 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:05.035 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.058 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.030) 0:02:08.686 ******* 2021-11-15T19:23:05.064 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T19:23:05.091 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.033) 0:02:08.719 ******* 2021-11-15T19:23:05.097 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T19:23:05.099 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.123 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.031) 0:02:08.751 ******* 2021-11-15T19:23:05.144 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.020) 0:02:08.772 ******* 2021-11-15T19:23:05.152 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-15T19:23:05.153 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.184 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.039) 0:02:08.811 ******* 2021-11-15T19:23:05.190 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T19:23:05.192 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:05.192 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T19:23:05.193 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.193 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:05.220 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.036) 0:02:08.848 ******* 2021-11-15T19:23:05.242 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.021) 0:02:08.870 ******* 2021-11-15T19:23:05.249 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-15T19:23:05.251 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.277 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.034) 0:02:08.904 ******* 2021-11-15T19:23:05.283 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T19:23:05.284 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.309 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.032) 0:02:08.937 ******* 2021-11-15T19:23:05.316 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:05.317 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.035) 0:02:08.972 ******* 2021-11-15T19:23:05.351 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T19:23:05.352 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.377 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.032) 0:02:09.004 ******* 2021-11-15T19:23:05.383 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T19:23:05.385 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.411 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.033) 0:02:09.038 ******* 2021-11-15T19:23:05.471 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T19:23:05.473 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true} 2021-11-15T19:23:05.501 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.090) 0:02:09.128 ******* 2021-11-15T19:23:05.509 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:05.510 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:05.521 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:05.523 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T19:23:05.548 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.047) 0:02:09.176 ******* 2021-11-15T19:23:05.587 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [gibba037.front.sepia.ceph.com] => (item={'block_used': 14049718, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045390, 'size_available': 925881917440, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045390, "block_size": 4096, "block_total": 240095108, "block_used": 14049718, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881917440, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.611 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.063) 0:02:09.239 ******* 2021-11-15T19:23:05.639 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-15T19:23:05.640 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.664 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.052) 0:02:09.291 ******* 2021-11-15T19:23:05.703 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:05.705 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.735 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.071) 0:02:09.362 ******* 2021-11-15T19:23:05.767 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:05.769 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.792 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.056) 0:02:09.419 ******* 2021-11-15T19:23:05.819 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T19:23:05.821 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.842 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.050) 0:02:09.470 ******* 2021-11-15T19:23:05.868 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T19:23:05.870 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:05.892 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.049) 0:02:09.520 ******* 2021-11-15T19:23:05.898 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:05.900 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T19:23:05.900 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T19:23:05.902 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:05.903 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T19:23:05.905 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-15T19:23:05.905 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T19:23:05.930 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.037) 0:02:09.557 ******* 2021-11-15T19:23:05.951 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.021) 0:02:09.579 ******* 2021-11-15T19:23:05.972 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:05 +0000 (0:00:00.020) 0:02:09.600 ******* 2021-11-15T19:23:05.981 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T19:23:05.983 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install cachefilesd] ****************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.037) 0:02:09.637 ******* 2021-11-15T19:23:06.033 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.023) 0:02:09.660 ******* 2021-11-15T19:23:06.039 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T19:23:06.041 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.067 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.033) 0:02:09.694 ******* 2021-11-15T19:23:06.074 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:06.075 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T19:23:06.099 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.032) 0:02:09.727 ******* 2021-11-15T19:23:06.105 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:06.107 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.137 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.037) 0:02:09.764 ******* 2021-11-15T19:23:06.166 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.189 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.051) 0:02:09.816 ******* 2021-11-15T19:23:06.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:06.197 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:06.226 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.037) 0:02:09.854 ******* 2021-11-15T19:23:06.234 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:06.236 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.300 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.311 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T19:23:06.313 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:06.338 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.112) 0:02:09.966 ******* 2021-11-15T19:23:06.345 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:06.347 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:06.374 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.035) 0:02:10.002 ******* 2021-11-15T19:23:06.392 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:06.394 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.457 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T19:23:06.458 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:06.483 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.108) 0:02:10.110 ******* 2021-11-15T19:23:06.490 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:06.492 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [gibba018.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.521 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.037) 0:02:10.148 ******* 2021-11-15T19:23:06.539 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.540 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T19:23:06.540 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T19:23:06.566 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.044) 0:02:10.193 ******* 2021-11-15T19:23:06.573 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T19:23:06.574 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.599 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.033) 0:02:10.227 ******* 2021-11-15T19:23:06.617 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:06.619 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.629 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T19:23:06.630 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.653 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.053) 0:02:10.280 ******* 2021-11-15T19:23:06.660 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:06.662 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:06.704 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:06.705 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.737 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-15T19:23:06.738 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T19:23:06.762 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.109) 0:02:10.390 ******* 2021-11-15T19:23:06.769 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T19:23:06.769 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:06.795 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.032) 0:02:10.422 ******* 2021-11-15T19:23:06.802 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:06.803 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:06.804 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.839 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.044) 0:02:10.467 ******* 2021-11-15T19:23:06.846 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T19:23:06.848 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T19:23:06.871 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.032) 0:02:10.499 ******* 2021-11-15T19:23:06.878 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T19:23:06.879 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.903 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.032) 0:02:10.531 ******* 2021-11-15T19:23:06.931 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T19:23:06.933 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:06.955 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:06 +0000 (0:00:00.051) 0:02:10.583 ******* 2021-11-15T19:23:06.962 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:06.964 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:07.005 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T19:23:07.007 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T19:23:07.034 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.078) 0:02:10.661 ******* 2021-11-15T19:23:07.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:07.044 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [gibba018.front.sepia.ceph.com] => {"changed": true} 2021-11-15T19:23:07.069 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.035) 0:02:10.697 ******* 2021-11-15T19:23:07.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T19:23:07.078 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:07.103 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.033) 0:02:10.730 ******* 2021-11-15T19:23:07.141 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T19:23:07.142 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T19:23:07.163 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.060) 0:02:10.791 ******* 2021-11-15T19:23:07.222 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-15T19:23:07.224 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T19:23:07.247 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.083) 0:02:10.875 ******* 2021-11-15T19:23:07.275 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T19:23:07.277 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.299 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.050) 0:02:10.926 ******* 2021-11-15T19:23:07.325 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T19:23:07.327 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.349 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.050) 0:02:10.976 ******* 2021-11-15T19:23:07.369 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.020) 0:02:10.996 ******* 2021-11-15T19:23:07.376 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:07.378 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:07.399 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.429 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.060) 0:02:11.057 ******* 2021-11-15T19:23:07.436 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:07.438 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:07.459 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:23:07.461 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.484 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.054) 0:02:11.111 ******* 2021-11-15T19:23:07.507 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.022) 0:02:11.134 ******* 2021-11-15T19:23:07.525 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-15T19:23:07.526 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T19:23:07.552 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.044) 0:02:11.179 ******* 2021-11-15T19:23:07.579 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T19:23:07.581 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.606 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.054) 0:02:11.234 ******* 2021-11-15T19:23:07.624 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T19:23:07.625 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:07.649 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.042) 0:02:11.276 ******* 2021-11-15T19:23:07.655 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T19:23:07.657 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:07.683 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.034) 0:02:11.310 ******* 2021-11-15T19:23:07.710 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:07.712 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.734 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.051) 0:02:11.362 ******* 2021-11-15T19:23:07.752 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T19:23:07.753 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.146785", "end": "2021-11-15 19:23:07.719332", "rc": 0, "start": "2021-11-15 19:23:07.572547", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T19:23:07.776 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.042) 0:02:11.404 ******* 2021-11-15T19:23:07.784 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:07.785 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:07.791 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T19:23:07.793 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:07.816 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.039) 0:02:11.443 ******* 2021-11-15T19:23:07.837 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.021) 0:02:11.465 ******* 2021-11-15T19:23:07.859 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.021) 0:02:11.486 ******* 2021-11-15T19:23:07.866 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T19:23:07.868 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.042) 0:02:11.528 ******* 2021-11-15T19:23:07.930 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:07.954 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.053) 0:02:11.582 ******* 2021-11-15T19:23:07.962 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T19:23:07.964 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:07.989 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:07 +0000 (0:00:00.034) 0:02:11.616 ******* 2021-11-15T19:23:07.996 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:07.998 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T19:23:08.023 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.034) 0:02:11.651 ******* 2021-11-15T19:23:08.032 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:08.033 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:08.098 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-15T19:23:08.100 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T19:23:08.125 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.101) 0:02:11.752 ******* 2021-11-15T19:23:08.133 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T19:23:08.135 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:08.160 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.034) 0:02:11.787 ******* 2021-11-15T19:23:08.168 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:08.170 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:08.297 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:08.373 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:08.386 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T19:23:08.388 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T19:23:08.413 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.253) 0:02:12.041 ******* 2021-11-15T19:23:08.431 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T19:23:08.432 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:23:08.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.045) 0:02:12.086 ******* 2021-11-15T19:23:08.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T19:23:08.471 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T19:23:08.474 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:08.476 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [gibba031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:08.478 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-15T19:23:08.480 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T19:23:08.481 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:08.504 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.045) 0:02:12.132 ******* 2021-11-15T19:23:08.525 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.020) 0:02:12.153 ******* 2021-11-15T19:23:08.555 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.030) 0:02:12.183 ******* 2021-11-15T19:23:08.578 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.023) 0:02:12.206 ******* 2021-11-15T19:23:08.587 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T19:23:08.589 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:08.615 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.037) 0:02:12.243 ******* 2021-11-15T19:23:08.643 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T19:23:08.645 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:08.668 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.052) 0:02:12.295 ******* 2021-11-15T19:23:08.685 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T19:23:08.687 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T19:23:08.712 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.044) 0:02:12.340 ******* 2021-11-15T19:23:08.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T19:23:08.743 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T19:23:08.768 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.055) 0:02:12.396 ******* 2021-11-15T19:23:08.788 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:08.812 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.044) 0:02:12.440 ******* 2021-11-15T19:23:08.820 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T19:23:08.822 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:08.848 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.035) 0:02:12.475 ******* 2021-11-15T19:23:08.855 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T19:23:08.857 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:23:08.859 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T19:23:08.885 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.037) 0:02:12.512 ******* 2021-11-15T19:23:08.908 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.022) 0:02:12.535 ******* 2021-11-15T19:23:08.931 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:08 +0000 (0:00:00.022) 0:02:12.558 ******* 2021-11-15T19:23:08.938 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:08.940 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:08.951 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:08.996 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T19:23:08.997 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:43 UTC", "ActiveEnterTimestampMonotonic": "12487216", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service system.slice basic.target sysinit.target -.mount network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:43 UTC", "AssertTimestampMonotonic": "12379025", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:43 UTC", "ConditionTimestampMonotonic": "12379024", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-15T19:23:08.998 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "946", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:43 UTC", "ExecMainStartTimestampMonotonic": "12487208", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:43 UTC", "InactiveExitTimestampMonotonic": "12379666", "InvocationID": "88c168523e6147da8cdfd5ee8af35d91", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T19:23:09.000 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "946", "MemoryAccounting": "yes", "MemoryCurrent": "3874816", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-11-15T19:23:09.002 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:43 UTC", "StateChangeTimestampMonotonic": "12487216", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:09.030 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.099) 0:02:12.658 ******* 2021-11-15T19:23:09.039 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:09.040 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T19:23:09.052 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:09.054 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T19:23:09.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.046) 0:02:12.704 ******* 2021-11-15T19:23:09.083 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T19:23:09.084 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true} 2021-11-15T19:23:09.109 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.032) 0:02:12.736 ******* 2021-11-15T19:23:09.116 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:09.117 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T19:23:09.144 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.035) 0:02:12.771 ******* 2021-11-15T19:23:09.151 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T19:23:09.153 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.183 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.038) 0:02:12.810 ******* 2021-11-15T19:23:09.189 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T19:23:09.190 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.136406", "end": "2021-11-15 19:23:09.258983", "rc": 0, "start": "2021-11-15 19:23:09.122577", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T19:23:09.191 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.216 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.033) 0:02:12.844 ******* 2021-11-15T19:23:09.239 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.022) 0:02:12.867 ******* 2021-11-15T19:23:09.247 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T19:23:09.248 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.275 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.036) 0:02:12.903 ******* 2021-11-15T19:23:09.282 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T19:23:09.283 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T19:23:09.309 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.033) 0:02:12.936 ******* 2021-11-15T19:23:09.331 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.021) 0:02:12.958 ******* 2021-11-15T19:23:09.338 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T19:23:09.340 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:23:09.340 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.365 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.034) 0:02:12.992 ******* 2021-11-15T19:23:09.396 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.030) 0:02:13.023 ******* 2021-11-15T19:23:09.421 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.025) 0:02:13.048 ******* 2021-11-15T19:23:09.429 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T19:23:09.431 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.038) 0:02:13.087 ******* 2021-11-15T19:23:09.490 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T19:23:09.492 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.515 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.055) 0:02:13.142 ******* 2021-11-15T19:23:09.532 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T19:23:09.533 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:09.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.042) 0:02:13.184 ******* 2021-11-15T19:23:09.563 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:09.564 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.589 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.032) 0:02:13.217 ******* 2021-11-15T19:23:09.596 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T19:23:09.598 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T19:23:09.622 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.033) 0:02:13.250 ******* 2021-11-15T19:23:09.629 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:09.631 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.158268", "end": "2021-11-15 19:23:09.168406", "rc": 0, "start": "2021-11-15 19:23:09.010138", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T19:23:09.657 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.034) 0:02:13.284 ******* 2021-11-15T19:23:09.680 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.022) 0:02:13.307 ******* 2021-11-15T19:23:09.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T19:23:09.689 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.714 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.034) 0:02:13.342 ******* 2021-11-15T19:23:09.745 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-15T19:23:09.747 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.769 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.054) 0:02:13.397 ******* 2021-11-15T19:23:09.779 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T19:23:09.781 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true} 2021-11-15T19:23:09.806 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.036) 0:02:13.433 ******* 2021-11-15T19:23:09.814 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T19:23:09.814 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:09.849 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.043) 0:02:13.477 ******* 2021-11-15T19:23:09.857 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T19:23:09.859 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:23:09.884 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.035) 0:02:13.512 ******* 2021-11-15T19:23:09.915 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-15T19:23:09.917 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:09.951 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.064) 0:02:13.577 ******* 2021-11-15T19:23:09.967 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-15T19:23:09.969 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T19:23:09.995 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:09 +0000 (0:00:00.045) 0:02:13.622 ******* 2021-11-15T19:23:10.002 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T19:23:10.003 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:10.029 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.033) 0:02:13.656 ******* 2021-11-15T19:23:10.036 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T19:23:10.037 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:10.063 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.034) 0:02:13.691 ******* 2021-11-15T19:23:10.103 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T19:23:10.105 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:23:10.130 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.066) 0:02:13.757 ******* 2021-11-15T19:23:10.153 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.023) 0:02:13.781 ******* 2021-11-15T19:23:10.160 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T19:23:10.161 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:10.187 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.033) 0:02:13.815 ******* 2021-11-15T19:23:10.194 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:10.196 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:23:10.198 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T19:23:10.223 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.035) 0:02:13.851 ******* 2021-11-15T19:23:10.246 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.023) 0:02:13.874 ******* 2021-11-15T19:23:10.270 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.023) 0:02:13.897 ******* 2021-11-15T19:23:10.276 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-15T19:23:10.277 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the chrony.conf file] ********************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:10.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.038) 0:02:13.936 ******* 2021-11-15T19:23:10.332 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.022) 0:02:13.959 ******* 2021-11-15T19:23:10.340 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T19:23:10.342 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:10.368 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.036) 0:02:13.996 ******* 2021-11-15T19:23:10.392 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.024) 0:02:14.020 ******* 2021-11-15T19:23:10.400 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-15T19:23:10.402 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T19:23:10.429 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.036) 0:02:14.056 ******* 2021-11-15T19:23:10.490 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T19:23:10.491 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:55 UTC", "ActiveEnterTimestampMonotonic": "13003741", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service -.mount sysinit.target systemd-journald.socket basic.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:55 UTC", "AssertTimestampMonotonic": "12818948", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:55 UTC", "ConditionTimestampMonotonic": "12818947", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-11-15T19:23:10.493 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "948", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:55 UTC", "ExecMainStartTimestampMonotonic": "13003733", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:55 UTC", "InactiveExitTimestampMonotonic": "12819547", "InvocationID": "0884fab4231d4dddb63a7ad5da0ac66c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T19:23:10.495 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "948", "MemoryAccounting": "yes", "MemoryCurrent": "3624960", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requir 2021-11-15T19:23:10.496 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:55 UTC", "StateChangeTimestampMonotonic": "13003741", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:10.518 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.089) 0:02:14.146 ******* 2021-11-15T19:23:10.525 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T19:23:10.527 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:10.551 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.032) 0:02:14.179 ******* 2021-11-15T19:23:10.557 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T19:23:10.559 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T19:23:10.586 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.034) 0:02:14.213 ******* 2021-11-15T19:23:10.607 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.021) 0:02:14.235 ******* 2021-11-15T19:23:10.615 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T19:23:10.616 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:10.642 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.034) 0:02:14.269 ******* 2021-11-15T19:23:10.648 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:10.650 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T19:23:10.677 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.034) 0:02:14.304 ******* 2021-11-15T19:23:10.683 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T19:23:10.684 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T19:23:10.686 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:10.719 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.041) 0:02:14.346 ******* 2021-11-15T19:23:10.743 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.024) 0:02:14.371 ******* 2021-11-15T19:23:10.751 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T19:23:10.753 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-15T19:23:10.782 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.038) 0:02:14.409 ******* 2021-11-15T19:23:10.811 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.028) 0:02:14.438 ******* 2021-11-15T19:23:10.819 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T19:23:10.821 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:20:01 UTC", "ActiveEnterTimestampMonotonic": "13521367", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount system.slice network.target sysinit.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:20:01 UTC", "AssertTimestampMonotonic": "13327137", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:20:01 UTC", "ConditionTimestampMonotonic": "13327136", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-11-15T19:23:10.823 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "964", "ExecMainStartTimestamp": "Mon 2021-11-15 19:20:01 UTC", "ExecMainStartTimestampMonotonic": "13521360", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:20:01 UTC", "InactiveExitTimestampMonotonic": "13327793", "InvocationID": "af3f851a341741b7bafb8e45e70feb44", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T19:23:10.824 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "964", "MemoryAccounting": "yes", "MemoryCurrent": "3997696", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requir 2021-11-15T19:23:10.825 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:20:01 UTC", "StateChangeTimestampMonotonic": "13521367", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:10.852 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.041) 0:02:14.479 ******* 2021-11-15T19:23:10.882 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:10.884 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T19:23:10.906 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.054) 0:02:14.534 ******* 2021-11-15T19:23:10.945 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:10.947 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T19:23:10.968 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:10 +0000 (0:00:00.062) 0:02:14.596 ******* 2021-11-15T19:23:10.995 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T19:23:10.997 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:11.019 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.050) 0:02:14.646 ******* 2021-11-15T19:23:11.025 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-15T19:23:11.027 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T19:23:11.052 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.033) 0:02:14.680 ******* 2021-11-15T19:23:11.152 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-15T19:23:11.154 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:23:11.176 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.124) 0:02:14.804 ******* 2021-11-15T19:23:11.350 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T19:23:11.351 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T19:23:11.375 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.198) 0:02:15.002 ******* 2021-11-15T19:23:11.454 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T19:23:11.456 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.155441", "end": "2021-11-15 19:23:11.443205", "rc": 0, "start": "2021-11-15 19:23:11.287764", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T19:23:11.485 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.109) 0:02:15.112 ******* 2021-11-15T19:23:11.523 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T19:23:11.525 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:11.546 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.061) 0:02:15.174 ******* 2021-11-15T19:23:11.572 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-15T19:23:11.573 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:11.594 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.048) 0:02:15.222 ******* 2021-11-15T19:23:11.704 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T19:23:11.706 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:23:11.731 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.136) 0:02:15.359 ******* 2021-11-15T19:23:11.760 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T19:23:11.762 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:11.784 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.053) 0:02:15.412 ******* 2021-11-15T19:23:11.843 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-15T19:23:11.845 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:23:11.870 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.085) 0:02:15.498 ******* 2021-11-15T19:23:11.930 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-15T19:23:11.932 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:11.958 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:11 +0000 (0:00:00.087) 0:02:15.585 ******* 2021-11-15T19:23:12.028 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T19:23:12.030 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:23:12.054 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.096) 0:02:15.682 ******* 2021-11-15T19:23:12.082 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-15T19:23:12.084 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.107 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.052) 0:02:15.734 ******* 2021-11-15T19:23:12.114 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T19:23:12.116 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:23:12.140 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.033) 0:02:15.768 ******* 2021-11-15T19:23:12.149 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T19:23:12.151 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.140878", "end": "2021-11-15 19:23:12.110801", "rc": 0, "start": "2021-11-15 19:23:11.969923", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T19:23:12.176 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.035) 0:02:15.803 ******* 2021-11-15T19:23:12.182 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T19:23:12.184 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.032) 0:02:15.836 ******* 2021-11-15T19:23:12.215 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T19:23:12.216 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.250 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.041) 0:02:15.877 ******* 2021-11-15T19:23:12.278 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T19:23:12.280 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.302 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.051) 0:02:15.929 ******* 2021-11-15T19:23:12.324 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.021) 0:02:15.951 ******* 2021-11-15T19:23:12.341 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-15T19:23:12.343 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:12.368 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.044) 0:02:15.995 ******* 2021-11-15T19:23:12.374 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T19:23:12.376 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T19:23:12.401 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.033) 0:02:16.029 ******* 2021-11-15T19:23:12.429 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T19:23:12.430 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.451 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.050) 0:02:16.079 ******* 2021-11-15T19:23:12.616 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T19:23:12.617 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:48 UTC", "ActiveEnterTimestampMonotonic": "12688921", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-tmpfiles-setup.service system.slice network.target sysinit.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:48 UTC", "AssertTimestampMonotonic": "12427012", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:48 UTC", "ConditionTimestampMonotonic": "12426998", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-15T19:23:12.619 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "945", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:48 UTC", "ExecMainStartTimestampMonotonic": "12688911", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:48 UTC", "InactiveExitTimestampMonotonic": "12427670", "InvocationID": "da73f74c7464486e9baa7c28674a0a53", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T19:23:12.621 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "945", "MemoryAccounting": "yes", "MemoryCurrent": "3796992", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requir 2021-11-15T19:23:12.622 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:48 UTC", "StateChangeTimestampMonotonic": "12688921", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:12.643 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.191) 0:02:16.271 ******* 2021-11-15T19:23:12.653 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-15T19:23:12.654 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T19:23:12.684 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.040) 0:02:16.311 ******* 2021-11-15T19:23:12.691 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T19:23:12.693 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : set_fact] ***************************************************** ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T19:23:12.720 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.035) 0:02:16.347 ******* 2021-11-15T19:23:12.759 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.038) 0:02:16.386 ******* 2021-11-15T19:23:12.769 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T19:23:12.771 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:23:12.798 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.038) 0:02:16.425 ******* 2021-11-15T19:23:12.804 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:12.805 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T19:23:12.836 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.038) 0:02:16.463 ******* 2021-11-15T19:23:12.843 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-15T19:23:12.845 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.869 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.032) 0:02:16.496 ******* 2021-11-15T19:23:12.875 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T19:23:12.876 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:12.902 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:12 +0000 (0:00:00.033) 0:02:16.529 ******* 2021-11-15T19:23:13.065 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T19:23:13.067 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false} 2021-11-15T19:23:13.091 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.189) 0:02:16.719 ******* 2021-11-15T19:23:13.120 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T19:23:13.122 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-15T19:23:13.144 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.052) 0:02:16.771 ******* 2021-11-15T19:23:13.151 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T19:23:13.153 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T19:23:13.177 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.033) 0:02:16.805 ******* 2021-11-15T19:23:13.204 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T19:23:13.206 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:13.228 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.050) 0:02:16.855 ******* 2021-11-15T19:23:13.319 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T19:23:13.320 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003538.9945433, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1637003538.9905431, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1637003538.9905431, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:13.346 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.118) 0:02:16.974 ******* 2021-11-15T19:23:13.407 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T19:23:13.409 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:19:39 UTC", "ActiveEnterTimestampMonotonic": "12753594", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount network.target systemd-journald.socket basic.target sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:19:38 UTC", "AssertTimestampMonotonic": "12606951", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:19:38 UTC", "ConditionTimestampMonotonic": "12606948", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-11-15T19:23:13.410 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "950", "ExecMainStartTimestamp": "Mon 2021-11-15 19:19:39 UTC", "ExecMainStartTimestampMonotonic": "12753585", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 19:19:38 UTC", "InactiveExitTimestampMonotonic": "12607608", "InvocationID": "db0b3b1d036e45bea84c07ef1f3ab36d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T19:23:13.412 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "950", "MemoryAccounting": "yes", "MemoryCurrent": "3903488", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "Requir 2021-11-15T19:23:13.413 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:19:39 UTC", "StateChangeTimestampMonotonic": "12753594", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:13.435 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.089) 0:02:17.063 ******* 2021-11-15T19:23:13.466 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:13.468 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T19:23:13.489 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.054) 0:02:17.117 ******* 2021-11-15T19:23:13.538 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:13.540 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T19:23:13.562 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.072) 0:02:17.190 ******* 2021-11-15T19:23:13.589 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T19:23:13.591 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:13.617 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.055) 0:02:17.245 ******* 2021-11-15T19:23:13.697 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-15T19:23:13.699 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T19:23:13.880 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.262) 0:02:17.507 ******* 2021-11-15T19:23:13.908 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-15T19:23:13.909 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T19:23:13.931 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.051) 0:02:17.559 ******* 2021-11-15T19:23:13.938 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T19:23:13.940 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:23:13.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.033) 0:02:17.593 ******* 2021-11-15T19:23:13.972 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T19:23:13.974 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:13.996 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:13 +0000 (0:00:00.030) 0:02:17.624 ******* 2021-11-15T19:23:14.003 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T19:23:14.004 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages via pip] ************************************* ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T19:23:14.030 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.033) 0:02:17.657 ******* 2021-11-15T19:23:14.053 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.022) 0:02:17.680 ******* 2021-11-15T19:23:14.123 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T19:23:14.125 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T19:23:14.149 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.096) 0:02:17.776 ******* 2021-11-15T19:23:14.187 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-15T19:23:14.189 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:14.213 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.063) 0:02:17.840 ******* 2021-11-15T19:23:14.282 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T19:23:14.284 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T19:23:14.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.095) 0:02:17.935 ******* 2021-11-15T19:23:14.335 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T19:23:14.337 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.359 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.050) 0:02:17.986 ******* 2021-11-15T19:23:14.386 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-15T19:23:14.388 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T19:23:14.413 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.054) 0:02:18.040 ******* 2021-11-15T19:23:14.420 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T19:23:14.421 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.422 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.422 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba011.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.424 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T19:23:14.424 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false} 2021-11-15T19:23:14.450 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.037) 0:02:18.078 ******* 2021-11-15T19:23:14.480 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.029) 0:02:18.108 ******* 2021-11-15T19:23:14.490 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T19:23:14.492 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T19:23:14.493 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.493 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.519 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.038) 0:02:18.147 ******* 2021-11-15T19:23:14.527 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.528 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.529 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba011.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.530 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.555 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.035) 0:02:18.182 ******* 2021-11-15T19:23:14.576 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.021) 0:02:18.204 ******* 2021-11-15T19:23:14.582 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T19:23:14.584 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.613 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.036) 0:02:18.240 ******* 2021-11-15T19:23:14.636 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.023) 0:02:18.263 ******* 2021-11-15T19:23:14.643 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T19:23:14.644 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.672 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.036) 0:02:18.300 ******* 2021-11-15T19:23:14.695 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.023) 0:02:18.323 ******* 2021-11-15T19:23:14.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-15T19:23:14.704 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.731 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.035) 0:02:18.359 ******* 2021-11-15T19:23:14.739 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T19:23:14.741 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003540.6507266, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1637003540.6467264, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1637003540.6467264, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:14.765 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.033) 0:02:18.393 ******* 2021-11-15T19:23:14.772 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-15T19:23:14.774 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T19:23:14.800 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.034) 0:02:18.428 ******* 2021-11-15T19:23:14.822 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.021) 0:02:18.450 ******* 2021-11-15T19:23:14.828 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T19:23:14.830 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false} 2021-11-15T19:23:14.863 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.041) 0:02:18.491 ******* 2021-11-15T19:23:14.871 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T19:23:14.872 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.900 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.036) 0:02:18.527 ******* 2021-11-15T19:23:14.907 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T19:23:14.909 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T19:23:14.933 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.033) 0:02:18.561 ******* 2021-11-15T19:23:14.955 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.022) 0:02:18.583 ******* 2021-11-15T19:23:14.964 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:14.965 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:14.993 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:14 +0000 (0:00:00.037) 0:02:18.620 ******* 2021-11-15T19:23:15.000 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-15T19:23:15.001 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T19:23:15.025 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.032) 0:02:18.653 ******* 2021-11-15T19:23:15.137 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 15 November 2021 19:23:15 +0000 (0:00:00.040) 0:02:18.693 ******* TASK [testnode : ifdown and ifup] ********************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003541.6503403, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1637003541.6463401, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1637003541.6463401, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} Monday 15 November 2021 19:23:15 +0000 (0:00:00.042) 0:02:18.736 ******* 2021-11-15T19:23:15.139 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.030) 0:02:18.766 ******* 2021-11-15T19:23:15.148 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:15.150 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.181 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.041) 0:02:18.808 ******* 2021-11-15T19:23:15.233 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T19:23:15.235 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-15T19:23:15.264 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.082) 0:02:18.891 ******* 2021-11-15T19:23:15.273 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-15T19:23:15.274 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T19:23:15.275 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T19:23:15.275 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T19:23:15.305 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.041) 0:02:18.932 ******* 2021-11-15T19:23:15.341 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.036) 0:02:18.968 ******* 2021-11-15T19:23:15.349 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:15.351 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002456", "end": "2021-11-15 19:23:15.309473", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 19:23:15.307017", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T19:23:15.378 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.036) 0:02:19.005 ******* 2021-11-15T19:23:15.406 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T19:23:15.408 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.430 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.052) 0:02:19.058 ******* 2021-11-15T19:23:15.438 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:15.439 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001704", "end": "2021-11-15 19:23:15.413635", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 19:23:15.411931", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:15.471 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T19:23:15.473 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T19:23:15.502 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.071) 0:02:19.130 ******* 2021-11-15T19:23:15.530 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T19:23:15.531 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba011.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001621", "end": "2021-11-15 19:23:15.512391", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 19:23:15.510770", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:15.555 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.052) 0:02:19.182 ******* 2021-11-15T19:23:15.593 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T19:23:15.595 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.606 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.607 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.618 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T19:23:15.619 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T19:23:15.642 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.087) 0:02:19.270 ******* 2021-11-15T19:23:15.667 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.023) 0:02:19.294 ******* 2021-11-15T19:23:15.677 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:15.678 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.037708", "end": "2021-11-15 19:23:15.648018", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 19:23:15.610310", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:15.710 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.043) 0:02:19.337 ******* 2021-11-15T19:23:15.719 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T19:23:15.720 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.721 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.732 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.734 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.736 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T19:23:15.758 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.048) 0:02:19.385 ******* 2021-11-15T19:23:15.781 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.022) 0:02:19.408 ******* 2021-11-15T19:23:15.788 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T19:23:15.790 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.828 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.047) 0:02:19.455 ******* 2021-11-15T19:23:15.836 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:15.837 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.883 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.055) 0:02:19.511 ******* 2021-11-15T19:23:15.890 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T19:23:15.892 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.032) 0:02:19.543 ******* 2021-11-15T19:23:15.923 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-15T19:23:15.925 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.960 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:15 +0000 (0:00:00.044) 0:02:19.588 ******* 2021-11-15T19:23:15.970 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T19:23:15.972 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.972 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.974 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.984 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:15.985 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.048) 0:02:19.637 ******* 2021-11-15T19:23:16.033 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.023) 0:02:19.661 ******* 2021-11-15T19:23:16.052 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T19:23:16.054 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.054 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.065 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.067 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.091 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.057) 0:02:19.719 ******* 2021-11-15T19:23:16.113 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.021) 0:02:19.741 ******* 2021-11-15T19:23:16.120 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:16.122 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.151 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.037) 0:02:19.778 ******* 2021-11-15T19:23:16.157 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T19:23:16.159 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.189 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.037) 0:02:19.816 ******* 2021-11-15T19:23:16.196 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-15T19:23:16.197 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.223 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.034) 0:02:19.850 ******* 2021-11-15T19:23:16.230 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:16.231 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.255 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.032) 0:02:19.883 ******* 2021-11-15T19:23:16.263 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-15T19:23:16.264 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.296 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.039) 0:02:19.923 ******* 2021-11-15T19:23:16.306 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-15T19:23:16.307 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.335 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.039) 0:02:19.962 ******* 2021-11-15T19:23:16.341 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-15T19:23:16.343 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.366 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.031) 0:02:19.993 ******* 2021-11-15T19:23:16.373 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:16.374 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.400 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.033) 0:02:20.027 ******* 2021-11-15T19:23:16.407 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-15T19:23:16.408 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.437 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.036) 0:02:20.064 ******* 2021-11-15T19:23:16.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.022) 0:02:20.087 ******* 2021-11-15T19:23:16.470 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:16.472 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.501 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.041) 0:02:20.128 ******* 2021-11-15T19:23:16.529 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.055) 0:02:20.184 ******* 2021-11-15T19:23:16.564 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:16.565 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002503", "end": "2021-11-15 19:23:16.526565", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 19:23:16.524062", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.586 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:16.588 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:16.609 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.053) 0:02:20.237 ******* 2021-11-15T19:23:16.646 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:16.648 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001761", "end": "2021-11-15 19:23:16.629796", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 19:23:16.628035", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.741 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001664", "end": "2021-11-15 19:23:16.728088", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 19:23:16.726424", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.752 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002480", "end": "2021-11-15 19:23:16.290416", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 19:23:16.287936", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.815 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T19:23:16.817 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false} 2021-11-15T19:23:16.840 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.230) 0:02:20.467 ******* 2021-11-15T19:23:16.856 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:16.858 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001783", "end": "2021-11-15 19:23:16.393053", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 19:23:16.391270", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.868 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T19:23:16.869 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-15T19:23:16.892 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.051) 0:02:20.519 ******* 2021-11-15T19:23:16.898 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:16.899 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027779", "end": "2021-11-15 19:23:16.854841", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 19:23:16.827062", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.042) 0:02:20.562 ******* 2021-11-15T19:23:16.953 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001689", "end": "2021-11-15 19:23:16.492850", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 19:23:16.491161", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:16.964 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T19:23:16.988 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:16 +0000 (0:00:00.053) 0:02:20.616 ******* 2021-11-15T19:23:17.006 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-15T19:23:17.008 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T19:23:17.031 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.043) 0:02:20.659 ******* 2021-11-15T19:23:17.037 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T19:23:17.039 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T19:23:17.039 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003537.0067627, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1637003537.0027628, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1637003537.0027628, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:17.079 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.047) 0:02:20.706 ******* 2021-11-15T19:23:17.112 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:17.114 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.023482", "end": "2021-11-15 19:23:16.616974", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 19:23:16.593492", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:17.143 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.064) 0:02:20.770 ******* 2021-11-15T19:23:17.170 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T19:23:17.194 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.051) 0:02:20.821 ******* 2021-11-15T19:23:17.211 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-15T19:23:17.213 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T19:23:17.235 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.041) 0:02:20.863 ******* 2021-11-15T19:23:17.243 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T19:23:17.245 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.269 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-15T19:23:17.271 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T19:23:17.303 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.067) 0:02:20.931 ******* 2021-11-15T19:23:17.330 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T19:23:17.332 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.358 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.055) 0:02:20.986 ******* 2021-11-15T19:23:17.397 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T19:23:17.399 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false} 2021-11-15T19:23:17.425 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.066) 0:02:21.053 ******* 2021-11-15T19:23:17.453 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T19:23:17.455 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-15T19:23:17.478 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.052) 0:02:21.105 ******* 2021-11-15T19:23:17.485 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T19:23:17.486 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T19:23:17.515 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.036) 0:02:21.142 ******* 2021-11-15T19:23:17.606 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T19:23:17.608 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003540.52849, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1637003540.5244899, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1637003540.5244899, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:17.636 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.121) 0:02:21.264 ******* 2021-11-15T19:23:17.685 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T19:23:17.686 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T19:23:17.711 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.074) 0:02:21.339 ******* 2021-11-15T19:23:17.738 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T19:23:17.740 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.763 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.051) 0:02:21.390 ******* 2021-11-15T19:23:17.790 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-15T19:23:17.792 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T19:23:17.816 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.053) 0:02:21.444 ******* 2021-11-15T19:23:17.822 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T19:23:17.824 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.824 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.825 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.825 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.855 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.038) 0:02:21.482 ******* 2021-11-15T19:23:17.862 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-15T19:23:17.864 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T19:23:17.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.034) 0:02:21.517 ******* 2021-11-15T19:23:17.897 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T19:23:17.898 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.909 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.910 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.911 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.912 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.936 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.047) 0:02:21.564 ******* 2021-11-15T19:23:17.942 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T19:23:17.944 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:17.967 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:17 +0000 (0:00:00.031) 0:02:21.595 ******* 2021-11-15T19:23:17.973 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:17.974 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.010 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.042) 0:02:21.637 ******* 2021-11-15T19:23:18.040 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-15T19:23:18.042 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.064 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.054) 0:02:21.692 ******* 2021-11-15T19:23:18.092 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T19:23:18.093 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.118 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.053) 0:02:21.746 ******* 2021-11-15T19:23:18.141 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.023) 0:02:21.769 ******* 2021-11-15T19:23:18.148 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-15T19:23:18.149 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.175 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.033) 0:02:21.803 ******* 2021-11-15T19:23:18.202 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T19:23:18.203 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.228 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.052) 0:02:21.856 ******* 2021-11-15T19:23:18.254 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.280 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.051) 0:02:21.908 ******* 2021-11-15T19:23:18.287 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T19:23:18.288 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T19:23:18.312 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.032) 0:02:21.940 ******* 2021-11-15T19:23:18.318 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-15T19:23:18.320 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.032) 0:02:21.973 ******* 2021-11-15T19:23:18.351 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T19:23:18.353 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.376 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.031) 0:02:22.004 ******* 2021-11-15T19:23:18.383 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:18.384 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.410 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.033) 0:02:22.038 ******* 2021-11-15T19:23:18.421 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T19:23:18.423 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.434 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.436 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.461 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.051) 0:02:22.089 ******* 2021-11-15T19:23:18.500 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T19:23:18.502 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.522 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.537 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.538 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.549 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.551 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:18.553 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002535", "end": "2021-11-15 19:23:18.534847", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 19:23:18.532312", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:18.583 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.121) 0:02:22.210 ******* 2021-11-15T19:23:18.611 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T19:23:18.612 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.636 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.053) 0:02:22.264 ******* 2021-11-15T19:23:18.654 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:18.654 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001727", "end": "2021-11-15 19:23:18.641567", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 19:23:18.639840", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:18.666 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.689 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.052) 0:02:22.317 ******* 2021-11-15T19:23:18.716 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-15T19:23:18.718 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.741 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.052) 0:02:22.369 ******* 2021-11-15T19:23:18.768 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:18.769 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001639", "end": "2021-11-15 19:23:18.741726", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 19:23:18.740087", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.792 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.051) 0:02:22.420 ******* 2021-11-15T19:23:18.819 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T19:23:18.821 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.845 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.052) 0:02:22.472 ******* 2021-11-15T19:23:18.872 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:18.874 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.900 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.055) 0:02:22.527 ******* 2021-11-15T19:23:18.906 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:18.908 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026047", "end": "2021-11-15 19:23:18.876757", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 19:23:18.850710", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:18.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.034) 0:02:22.562 ******* 2021-11-15T19:23:18.941 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-15T19:23:18.943 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:18.969 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.034) 0:02:22.596 ******* 2021-11-15T19:23:18.975 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T19:23:19.001 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:18 +0000 (0:00:00.031) 0:02:22.627 ******* 2021-11-15T19:23:19.006 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T19:23:19.008 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:19.031 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.031) 0:02:22.659 ******* 2021-11-15T19:23:19.037 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T19:23:19.039 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:19.164 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T19:23:19.166 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002549", "end": "2021-11-15 19:23:19.150076", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 19:23:19.147527", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:19.269 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001763", "end": "2021-11-15 19:23:19.254621", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 19:23:19.252858", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:19.373 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001665", "end": "2021-11-15 19:23:19.354628", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 19:23:19.352963", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:19.497 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.020934", "end": "2021-11-15 19:23:19.481359", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 19:23:19.460425", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:19.524 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.492) 0:02:23.151 ******* 2021-11-15T19:23:19.551 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T19:23:19.575 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.051) 0:02:23.202 ******* 2021-11-15T19:23:19.602 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T19:23:19.603 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:19.672 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-11-15T19:23:19.692 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.117) 0:02:23.320 ******* 2021-11-15T19:23:19.717 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.024) 0:02:23.344 ******* 2021-11-15T19:23:19.745 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.028) 0:02:23.372 ******* 2021-11-15T19:23:19.777 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.031) 0:02:23.404 ******* 2021-11-15T19:23:19.807 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:19 +0000 (0:00:00.030) 0:02:23.434 ******* 2021-11-15T19:23:20.539 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba011.front.sepia.ceph.com] 2021-11-15T19:23:20.598 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.790) 0:02:24.225 ******* 2021-11-15T19:23:20.612 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] 2021-11-15T19:23:20.648 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] 2021-11-15T19:23:20.655 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:20.657 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T19:23:20.679 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.080) 0:02:24.306 ******* 2021-11-15T19:23:20.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.027) 0:02:24.334 ******* 2021-11-15T19:23:20.735 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-15T19:23:20.737 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] 2021-11-15T19:23:20.743 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:20.744 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : set_fact] *********************************************** ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T19:23:20.767 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.060) 0:02:24.394 ******* 2021-11-15T19:23:20.799 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.032) 0:02:24.427 ******* 2021-11-15T19:23:20.822 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.022) 0:02:24.449 ******* 2021-11-15T19:23:20.849 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba037.front.sepia.ceph.com] 2021-11-15T19:23:20.856 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T19:23:20.858 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} TASK [container-host : set_fact] *********************************************** skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : set_fact] *********************************************** ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T19:23:20.880 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.058) 0:02:24.508 ******* 2021-11-15T19:23:20.902 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.021) 0:02:24.529 ******* 2021-11-15T19:23:20.926 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.023) 0:02:24.553 ******* 2021-11-15T19:23:20.948 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.022) 0:02:24.575 ******* 2021-11-15T19:23:20.969 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T19:23:20.971 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} TASK [container-host : set_fact] *********************************************** skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:20.971 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T19:23:20.994 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:20 +0000 (0:00:00.045) 0:02:24.621 ******* 2021-11-15T19:23:21.014 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.020) 0:02:24.642 ******* 2021-11-15T19:23:21.038 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.023) 0:02:24.665 ******* 2021-11-15T19:23:21.064 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.026) 0:02:24.691 ******* 2021-11-15T19:23:21.069 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T19:23:21.071 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-15T19:23:21.071 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:21.103 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.039) 0:02:24.731 ******* 2021-11-15T19:23:21.125 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.021) 0:02:24.753 ******* 2021-11-15T19:23:21.136 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:21.138 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T19:23:21.166 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.040) 0:02:24.793 ******* 2021-11-15T19:23:21.184 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T19:23:21.186 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-15T19:23:21.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.042) 0:02:24.836 ******* 2021-11-15T19:23:21.214 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:21.216 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:21.241 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.032) 0:02:24.868 ******* 2021-11-15T19:23:21.291 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T19:23:21.292 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-15T19:23:21.315 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:21 +0000 (0:00:00.074) 0:02:24.943 ******* 2021-11-15T19:23:34.212 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T19:23:34.214 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.4 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T19:23:34.215 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.4 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T19:23:34.237 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:12.921) 0:02:37.865 ******* 2021-11-15T19:23:34.266 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.268 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:34.290 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.052) 0:02:37.918 ******* 2021-11-15T19:23:34.328 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba011.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T19:23:34.352 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.061) 0:02:37.980 ******* 2021-11-15T19:23:34.422 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T19:23:34.423 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.4 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T19:23:34.425 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.4 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T19:23:34.448 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.095) 0:02:38.075 ******* 2021-11-15T19:23:34.477 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.478 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:34.500 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.052) 0:02:38.128 ******* 2021-11-15T19:23:34.508 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:34.510 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:34.531 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba018.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T19:23:34.559 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.058) 0:02:38.186 ******* 2021-11-15T19:23:34.576 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T19:23:34.578 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T19:23:34.579 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T19:23:34.604 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.045) 0:02:38.231 ******* 2021-11-15T19:23:34.622 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:34.624 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:34.649 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.045) 0:02:38.277 ******* 2021-11-15T19:23:34.656 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.657 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:34.684 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.035) 0:02:38.312 ******* 2021-11-15T19:23:34.693 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T19:23:34.694 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T19:23:34.696 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T19:23:34.721 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.036) 0:02:38.348 ******* 2021-11-15T19:23:34.728 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:34.729 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:34.731 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.731 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T19:23:34.755 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.034) 0:02:38.382 ******* 2021-11-15T19:23:34.762 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.763 INFO:teuthology.task.ansible.out:skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:34.788 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.033) 0:02:38.415 ******* 2021-11-15T19:23:34.827 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.828 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [gibba018.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:34.853 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.065) 0:02:38.481 ******* 2021-11-15T19:23:34.876 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.022) 0:02:38.503 ******* 2021-11-15T19:23:34.895 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T19:23:34.896 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T19:23:34.897 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T19:23:34.921 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.045) 0:02:38.549 ******* 2021-11-15T19:23:34.929 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:34.930 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:34.952 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:34.954 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [gibba011.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:34.981 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:34 +0000 (0:00:00.059) 0:02:38.609 ******* 2021-11-15T19:23:34.998 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:35.000 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:35.011 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T19:23:35.013 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T19:23:35.034 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.052) 0:02:38.662 ******* 2021-11-15T19:23:35.040 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:35.041 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:35.074 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.039) 0:02:38.702 ******* 2021-11-15T19:23:35.124 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:35.153 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.079) 0:02:38.781 ******* 2021-11-15T19:23:35.192 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:35.224 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-15T19:23:35.226 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.257 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.290 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.136) 0:02:38.917 ******* 2021-11-15T19:23:35.309 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T19:23:35.311 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T19:23:35.337 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.047) 0:02:38.965 ******* 2021-11-15T19:23:35.438 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-15T19:23:35.440 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.492 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.493 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.521 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.183) 0:02:39.148 ******* 2021-11-15T19:23:35.634 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.719 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.744 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.223) 0:02:39.372 ******* 2021-11-15T19:23:35.772 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.798 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.053) 0:02:39.425 ******* 2021-11-15T19:23:35.815 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-15T19:23:35.817 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"cache_update_time": 1637003651, "cache_updated": false, "changed": false} 2021-11-15T19:23:35.844 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.046) 0:02:39.472 ******* 2021-11-15T19:23:35.913 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-15T19:23:35.915 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T19:23:35.939 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:35 +0000 (0:00:00.094) 0:02:39.567 ******* 2021-11-15T19:23:36.051 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-15T19:23:36.053 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"cache_update_time": 1637003747, "cache_updated": false, "changed": false} 2021-11-15T19:23:36.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:36 +0000 (0:00:00.137) 0:02:39.704 ******* 2021-11-15T19:23:36.260 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"cache_update_time": 1637003700, "cache_updated": false, "changed": false} 2021-11-15T19:23:36.285 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:36 +0000 (0:00:00.208) 0:02:39.912 ******* 2021-11-15T19:23:36.334 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"cache_update_time": 1637003796, "cache_updated": false, "changed": false} 2021-11-15T19:23:36.358 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:36 +0000 (0:00:00.073) 0:02:39.986 ******* 2021-11-15T19:23:36.459 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1637003601, "cache_updated": false, "changed": false} 2021-11-15T19:23:36.492 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:36 +0000 (0:00:00.133) 0:02:40.120 ******* 2021-11-15T19:23:39.220 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-15T19:23:39.222 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-e_ov5lg_\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-e_ov5lg_"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-e_ov5lg_\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97\n Stored in directory: /tmp/pip-ephem-wheel-cache-xvilr_f9/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T19:23:39.224 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-e_ov5lg_", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97", " Stored in directory: /tmp/pip-ephem-wheel-cache-xvilr_f9/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T19:23:39.245 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:02.753) 0:02:42.873 ******* 2021-11-15T19:23:39.380 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-1eztbldt\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-1eztbldt"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-1eztbldt\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97\n Stored in directory: /tmp/pip-ephem-wheel-cache-i7d0bx31/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T19:23:39.382 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-1eztbldt", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97", " Stored in directory: /tmp/pip-ephem-wheel-cache-i7d0bx31/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T19:23:39.405 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.159) 0:02:43.032 ******* 2021-11-15T19:23:39.412 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T19:23:39.413 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003528.634513, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:39.443 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.038) 0:02:43.071 ******* 2021-11-15T19:23:39.481 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T19:23:39.483 INFO:teuthology.task.ansible.out:skipping: [gibba011.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:39.506 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.062) 0:02:43.133 ******* 2021-11-15T19:23:39.522 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-15T19:23:39.524 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zzrwdp0o\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zzrwdp0o"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-zzrwdp0o\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97\n Stored in directory: /tmp/pip-ephem-wheel-cache-lfeaqzyz/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T19:23:39.525 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-zzrwdp0o", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97", " Stored in directory: /tmp/pip-ephem-wheel-cache-lfeaqzyz/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T19:23:39.720 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.214) 0:02:43.348 ******* 2021-11-15T19:23:39.728 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T19:23:39.728 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003529.0146923, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:39.730 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-3oylb6c2\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-3oylb6c2"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-3oylb6c2\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97\n Stored in directory: /tmp/pip-ephem-wheel-cache-pmzh9i8d/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastia 2021-11-15T19:23:39.732 INFO:teuthology.task.ansible.out:n-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-3oylb6c2", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97", " Stored in directory: /tmp/pip-ephem-wheel-cache-pmzh9i8d/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} TASK [container-host : Add local docker.io registry mirror] ******************** changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.064953", "end": "2021-11-15 19:23:39.692141", "rc": 0, "start": "2021-11-15 19:23:39.627188", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:39.758 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.037) 0:02:43.386 ******* 2021-11-15T19:23:39.785 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.026) 0:02:43.412 ******* 2021-11-15T19:23:39.813 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.028) 0:02:43.441 ******* 2021-11-15T19:23:39.821 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-15T19:23:39.823 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-k_1mfq8d\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-k_1mfq8d"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-k_1mfq8d\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97\n Stored in directory: /tmp/pip-ephem-wheel-cache-535bnot5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T19:23:39.825 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-k_1mfq8d", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=64db72f7222c2d810e23e85bb6da3d4175f978899f2bf645533d2d9092a76a97", " Stored in directory: /tmp/pip-ephem-wheel-cache-535bnot5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T19:23:39.852 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.039) 0:02:43.480 ******* 2021-11-15T19:23:39.860 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T19:23:39.862 INFO:teuthology.task.ansible.out:skipping: [gibba018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:39.886 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.033) 0:02:43.514 ******* 2021-11-15T19:23:39.893 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T19:23:39.894 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003525.6507301, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:39.920 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.034) 0:02:43.548 ******* 2021-11-15T19:23:39.939 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003530.2463071, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:39.963 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.043) 0:02:43.591 ******* 2021-11-15T19:23:39.970 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T19:23:39.972 INFO:teuthology.task.ansible.out:skipping: [gibba031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:39.996 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:39 +0000 (0:00:00.032) 0:02:43.624 ******* 2021-11-15T19:23:40.004 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T19:23:40.005 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1637003528.6924558, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T19:23:40.006 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ skipping: [gibba017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:40.032 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.035) 0:02:43.659 ******* 2021-11-15T19:23:40.070 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.037) 0:02:43.697 ******* 2021-11-15T19:23:40.111 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T19:23:40.141 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.071) 0:02:43.769 ******* 2021-11-15T19:23:40.147 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-15T19:23:40.149 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.082841", "end": "2021-11-15 19:23:40.095772", "rc": 0, "start": "2021-11-15 19:23:40.012931", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:40.175 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.033) 0:02:43.803 ******* 2021-11-15T19:23:40.192 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.056768", "end": "2021-11-15 19:23:40.183237", "rc": 0, "start": "2021-11-15 19:23:40.126469", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:40.217 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.041) 0:02:43.844 ******* 2021-11-15T19:23:40.266 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.054249", "end": "2021-11-15 19:23:40.245067", "rc": 0, "start": "2021-11-15 19:23:40.190818", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:40.291 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.074) 0:02:43.918 ******* 2021-11-15T19:23:40.351 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.075155", "end": "2021-11-15 19:23:40.334993", "rc": 0, "start": "2021-11-15 19:23:40.259838", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T19:23:40.376 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:40 +0000 (0:00:00.084) 0:02:44.003 ******* 2021-11-15T19:23:41.397 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-11-15T19:23:41.398 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ActiveEnterTimestampMonotonic": "240794638", "ActiveExitTimestamp": "Mon 2021-11-15 19:23:30 UTC", "ActiveExitTimestampMonotonic": "239825860", "ActiveState": "active", "After": "network-online.target sysinit.target system.slice docker.socket basic.target systemd-journald.socket containerd.service firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:23:30 UTC", "AssertTimestampMonotonic": "239831147", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:23:30 UTC", "ConditionTimestampMonotonic": "239831147", "ConfigurationDirectoryMode": "0755", 2021-11-15T19:23:41.400 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8432", "ExecMainStartTimestamp": "Mon 2021-11-15 19:23:30 UTC", "ExecMainStartTimestampMonotonic": "239831540", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T19:23:41.402 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:23:30 UTC", "InactiveEnterTimestampMonotonic": "239828475", "InactiveExitTimestamp": "Mon 2021-11-15 19:23:30 UTC", "InactiveExitTimestampMonotonic": "239831789", "InvocationID": "c3f72607a06b44f0aef1a13fea99709c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8432", "MemoryAccounting": "yes", "MemoryCurrent": "47529984", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T19:23:41.403 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:23:31 UTC", "StateChangeTimestampMonotonic": "240794638", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "24", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T19:23:41.405 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:41.801 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:23:32 UTC", "ActiveEnterTimestampMonotonic": "230065437", "ActiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ActiveExitTimestampMonotonic": "229221329", "ActiveState": "active", "After": "network-online.target containerd.service docker.socket sysinit.target systemd-journald.socket basic.target firewalld.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:23:31 UTC", "AssertTimestampMonotonic": "229226483", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ConditionTimestampMonotonic": "229226483", "ConfigurationDirectoryMode": "0755", 2021-11-15T19:23:41.803 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8457", "ExecMainStartTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ExecMainStartTimestampMonotonic": "229226846", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T19:23:41.805 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveEnterTimestampMonotonic": "229223979", "InactiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveExitTimestampMonotonic": "229227153", "InvocationID": "0bf2803d8bf247aab9a046556eaa8057", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8457", "MemoryAccounting": "yes", "MemoryCurrent": "47702016", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T19:23:41.806 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:23:32 UTC", "StateChangeTimestampMonotonic": "230065437", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "26", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T19:23:41.808 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init 2021-11-15T19:23:41.808 INFO:teuthology.task.ansible.out:", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:41.877 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:23:32 UTC", "ActiveEnterTimestampMonotonic": "236030187", "ActiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ActiveExitTimestampMonotonic": "235067985", "ActiveState": "active", "After": "docker.socket containerd.service network-online.target basic.target sysinit.target system.slice firewalld.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:23:31 UTC", "AssertTimestampMonotonic": "235073029", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ConditionTimestampMonotonic": "235073028", "ConfigurationDirectoryMode": "0755", 2021-11-15T19:23:41.879 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8503", "ExecMainStartTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ExecMainStartTimestampMonotonic": "235073424", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T19:23:41.880 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveEnterTimestampMonotonic": "235070670", "InactiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveExitTimestampMonotonic": "235073749", "InvocationID": "26afbba43e6a4635bfe75bfa900b0075", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8503", "MemoryAccounting": "yes", "MemoryCurrent": "47812608", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T19:23:41.882 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:23:32 UTC", "StateChangeTimestampMonotonic": "236030187", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "23", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartU 2021-11-15T19:23:41.882 INFO:teuthology.task.ansible.out:Sec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T19:23:41.884 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:41.959 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:23:32 UTC", "ActiveEnterTimestampMonotonic": "223529389", "ActiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ActiveExitTimestampMonotonic": "222629023", "ActiveState": "active", "After": "systemd-journald.socket containerd.service docker.socket network-online.target firewalld.service basic.target sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:23:31 UTC", "AssertTimestampMonotonic": "222633893", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ConditionTimestampMonotonic": "222633893", "ConfigurationDirectoryMode": "0755", 2021-11-15T19:23:41.961 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8471", "ExecMainStartTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ExecMainStartTimestampMonotonic": "222634265", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T19:23:41.962 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveEnterTimestampMonotonic": "222631607", "InactiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveExitTimestampMonotonic": "222634550", "InvocationID": "6109e044df394717bd0be656e30e989b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8471", "MemoryAccounting": "yes", "MemoryCurrent": "48099328", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T19:23:41.964 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:23:32 UTC", "StateChangeTimestampMonotonic": "223529389", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "23", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T19:23:41.966 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init 2021-11-15T19:23:41.966 INFO:teuthology.task.ansible.out:", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:42.033 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 19:23:32 UTC", "ActiveEnterTimestampMonotonic": "246432103", "ActiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ActiveExitTimestampMonotonic": "245484966", "ActiveState": "active", "After": "firewalld.service basic.target network-online.target sysinit.target containerd.service systemd-journald.socket system.slice docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 19:23:31 UTC", "AssertTimestampMonotonic": "245490003", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ConditionTimestampMonotonic": "245490003", "ConfigurationDirectoryMode": "0755", 2021-11-15T19:23:42.035 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8481", "ExecMainStartTimestamp": "Mon 2021-11-15 19:23:31 UTC", "ExecMainStartTimestampMonotonic": "245490369", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T19:23:42.037 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveEnterTimestampMonotonic": "245487688", "InactiveExitTimestamp": "Mon 2021-11-15 19:23:31 UTC", "InactiveExitTimestampMonotonic": "245490637", "InvocationID": "cefcc434248d44ff85d66bc32b661007", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8481", "MemoryAccounting": "yes", "MemoryCurrent": "49348608", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T19:23:42.038 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 19:23:32 UTC", "StateChangeTimestampMonotonic": "246432103", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "22", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartU 2021-11-15T19:23:42.039 INFO:teuthology.task.ansible.out:Sec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T19:23:42.040 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T19:23:42.107 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-11-15T19:23:42.108 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-11-15T19:23:42.110 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-11-15T19:23:42.111 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-15T19:23:42.124 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-15T19:23:42.126 INFO:teuthology.task.ansible.out:Monday 15 November 2021 19:23:42 +0000 (0:00:01.748) 0:02:45.752 ******* 2021-11-15T19:23:42.884 INFO:teuthology.task.ansible.out:ok: [gibba017.front.sepia.ceph.com] 2021-11-15T19:23:42.936 INFO:teuthology.task.ansible.out:ok: [gibba011.front.sepia.ceph.com] 2021-11-15T19:23:43.053 INFO:teuthology.task.ansible.out:ok: [gibba018.front.sepia.ceph.com] 2021-11-15T19:23:43.075 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] 2021-11-15T19:23:43.097 INFO:teuthology.task.ansible.out:ok: [gibba031.front.sepia.ceph.com] 2021-11-15T19:23:43.117 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Monday 15 November 2021 19:23:43 +0000 (0:00:00.992) 0:02:46.744 ******* 2021-11-15T19:23:43.250 INFO:teuthology.task.ansible.out:changed: [gibba011.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T19:23:43.271 INFO:teuthology.task.ansible.out:changed: [gibba017.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T19:23:43.293 INFO:teuthology.task.ansible.out:changed: [gibba018.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T19:23:43.314 INFO:teuthology.task.ansible.out:changed: [gibba031.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T19:23:43.356 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T19:23:43.359 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-11-15T19:23:43.360 INFO:teuthology.task.ansible.out:gibba011.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba017.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba018.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba031.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba037.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Monday 15 November 2021 19:23:43 +0000 (0:00:00.242) 0:02:46.987 ******* =============================================================================== Create all admin users with sudo access. ------------------------------- 15.55s users : Update authorized_keys using the keys repo --------------------- 15.41s container-host : Install container packages ---------------------------- 12.92s testnode : Upgrade packages -------------------------------------------- 11.16s testnode : Install packages --------------------------------------------- 7.40s Remove revoked users ---------------------------------------------------- 4.97s testnode : Ensure packages are not present. ----------------------------- 4.80s testnode : Zap all non-root disks --------------------------------------- 3.97s container-host : Install registries-conf-ctl ---------------------------- 2.75s common : Update apt cache ----------------------------------------------- 2.64s container-host : Restart docker service --------------------------------- 1.75s Gathering Facts --------------------------------------------------------- 1.70s users : Update authorized_keys for each user with literal keys ---------- 1.25s testnode : Update apt cache. -------------------------------------------- 1.21s Gathering Facts --------------------------------------------------------- 0.99s Gathering 2021-11-15T19:23:43.362 INFO:teuthology.task.ansible.out: Facts --------------------------------------------------------- 0.79s Gathering Facts --------------------------------------------------------- 0.70s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.66s users : Clone the keys repo --------------------------------------------- 0.65s Gathering Facts --------------------------------------------------------- 0.55s 2021-11-15T19:23:43.734 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba037.front.sepia.ceph.com'), Remote(name='ubuntu@gibba011.front.sepia.ceph.com'), Remote(name='ubuntu@gibba031.front.sepia.ceph.com'), Remote(name='ubuntu@gibba018.front.sepia.ceph.com'), Remote(name='ubuntu@gibba017.front.sepia.ceph.com')] 2021-11-15T19:23:43.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba037.front.sepia.ceph.com' 2021-11-15T19:23:43.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:23:43.773 DEBUG:teuthology.orchestra.run.gibba037:> true 2021-11-15T19:23:43.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba011.front.sepia.ceph.com' 2021-11-15T19:23:43.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:23:43.909 DEBUG:teuthology.orchestra.run.gibba011:> true 2021-11-15T19:23:43.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba031.front.sepia.ceph.com' 2021-11-15T19:23:43.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:23:44.021 DEBUG:teuthology.orchestra.run.gibba031:> true 2021-11-15T19:23:44.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba018.front.sepia.ceph.com' 2021-11-15T19:23:44.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:23:44.129 DEBUG:teuthology.orchestra.run.gibba018:> true 2021-11-15T19:23:44.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba017.front.sepia.ceph.com' 2021-11-15T19:23:44.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T19:23:44.240 DEBUG:teuthology.orchestra.run.gibba017:> true 2021-11-15T19:23:44.343 INFO:teuthology.run_tasks:Running task clock... 2021-11-15T19:23:44.355 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-11-15T19:23:44.356 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T19:23:44.357 DEBUG:teuthology.orchestra.run.gibba037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T19:23:44.377 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T19:23:44.377 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Command line: ntpd -gq 2021-11-15T19:23:44.377 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: proto: precision = 0.035 usec (-25) 2021-11-15T19:23:44.378 INFO:teuthology.orchestra.run.gibba037.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:23:44.378 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:23:44.379 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:23:44.379 INFO:teuthology.orchestra.run.gibba037.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:23:44.380 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T19:23:44.380 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T19:23:44.380 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T19:23:44.381 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listen normally on 3 enp1s0f0 172.21.2.137:123 2021-11-15T19:23:44.381 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listen normally on 4 lo [::1]:123 2021-11-15T19:23:44.381 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8de2%4]:123 2021-11-15T19:23:44.381 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:44 ntpd[9901]: Listening on routing socket on fd #22 for interface updates 2021-11-15T19:23:45.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:45.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:45.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:45.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:45.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:45.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:45.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:45.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:45.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:45.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:45.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:45.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:45 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:46.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:46 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:46.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:46 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:46.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:46 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:46.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:46 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:46.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:46 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:46.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:46 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:47.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:47.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:47.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:47.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:47.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:47.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:47.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:47.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:47.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:47.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:47.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:47.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:47 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:48.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:48.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:48.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:48.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:48.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:48.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:48.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:48.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:48.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:48.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:48.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:48.382 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:48 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:49.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:49.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:49.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:49.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:49.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:49.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:49.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:49.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:49.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:49.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:49.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:49.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:49 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:50.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:50.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:50.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:50.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:50.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:50.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:50.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:50.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:50.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:50.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:50.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:50.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:50 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:51.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:51.378 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:51.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:51.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:51.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:51.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:51.379 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:51.380 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:51.380 INFO:teuthology.orchestra.run.gibba037.stdout:15 Nov 19:23:51 ntpd[9901]: ntpd: time slew -0.007402 s 2021-11-15T19:23:51.380 INFO:teuthology.orchestra.run.gibba037.stdout:ntpd: time slew -0.007402s 2021-11-15T19:23:51.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T19:23:51.381 INFO:teuthology.orchestra.run.gibba037.stderr:15 Nov 19:23:51 ntpd[9901]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T19:23:51.420 INFO:teuthology.orchestra.run.gibba037.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T19:23:51.420 INFO:teuthology.orchestra.run.gibba037.stdout:============================================================================== 2021-11-15T19:23:51.420 INFO:teuthology.orchestra.run.gibba037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:51.420 INFO:teuthology.orchestra.run.gibba037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:51.421 INFO:teuthology.orchestra.run.gibba037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:51.421 INFO:teuthology.orchestra.run.gibba037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:51.421 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T19:23:51.422 DEBUG:teuthology.orchestra.run.gibba011:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T19:23:51.442 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T19:23:51.442 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Command line: ntpd -gq 2021-11-15T19:23:51.442 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: proto: precision = 0.035 usec (-25) 2021-11-15T19:23:51.443 INFO:teuthology.orchestra.run.gibba011.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:23:51.443 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:23:51.443 INFO:teuthology.orchestra.run.gibba011.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:23:51.444 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:23:51.445 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T19:23:51.445 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T19:23:51.445 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T19:23:51.445 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listen normally on 3 enp1s0f0 172.21.2.111:123 2021-11-15T19:23:51.446 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listen normally on 4 lo [::1]:123 2021-11-15T19:23:51.446 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8e0a%4]:123 2021-11-15T19:23:51.446 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:51 ntpd[9857]: Listening on routing socket on fd #22 for interface updates 2021-11-15T19:23:53.442 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:53 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:53.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:53 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:53.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:53 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:53.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:53 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:53.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:53 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:53.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:53 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:54.442 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:54 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:54.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:54 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:54.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:54 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:54.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:54 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:54.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:54 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:54.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:54 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:55.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:55 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:55.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:55 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:55.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:55 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:55.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:55 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:55.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:55 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:55.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:55 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:56.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:56.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:56.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:56.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:56.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:56.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:56.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:56.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:56.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:56.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:56.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:56.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:56.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:56.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:56.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:56.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:56.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:56.448 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:56 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:57.442 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:57 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:57.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:57 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:57.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:57 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:57.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:57 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:57.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:57 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:57.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:57 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:58.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:58.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:58.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:58.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:58.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:58.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:58.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:58.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:58.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:58.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:58.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:58.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:58.446 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:58.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:58.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:58.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:58.447 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:58.448 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:58 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:59.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:59.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:59.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:23:59.443 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:23:59.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:23:59.444 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:23:59.444 INFO:teuthology.orchestra.run.gibba011.stdout:15 Nov 19:23:59 ntpd[9857]: ntpd: time slew +0.000447 s 2021-11-15T19:23:59.445 INFO:teuthology.orchestra.run.gibba011.stdout:ntpd: time slew +0.000447s 2021-11-15T19:23:59.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T19:23:59.445 INFO:teuthology.orchestra.run.gibba011.stderr:15 Nov 19:23:59 ntpd[9857]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T19:23:59.486 INFO:teuthology.orchestra.run.gibba011.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T19:23:59.486 INFO:teuthology.orchestra.run.gibba011.stdout:============================================================================== 2021-11-15T19:23:59.486 INFO:teuthology.orchestra.run.gibba011.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:59.487 INFO:teuthology.orchestra.run.gibba011.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:59.487 INFO:teuthology.orchestra.run.gibba011.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:59.487 INFO:teuthology.orchestra.run.gibba011.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:23:59.488 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T19:23:59.489 DEBUG:teuthology.orchestra.run.gibba031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T19:23:59.509 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T19:23:59.510 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Command line: ntpd -gq 2021-11-15T19:23:59.510 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: proto: precision = 0.035 usec (-25) 2021-11-15T19:23:59.510 INFO:teuthology.orchestra.run.gibba031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:23:59.511 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:23:59.511 INFO:teuthology.orchestra.run.gibba031.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:23:59.512 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:23:59.513 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T19:23:59.513 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T19:23:59.513 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T19:23:59.513 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listen normally on 3 enp1s0f0 172.21.2.131:123 2021-11-15T19:23:59.513 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listen normally on 4 lo [::1]:123 2021-11-15T19:23:59.514 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9188%4]:123 2021-11-15T19:23:59.514 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:23:59 ntpd[9926]: Listening on routing socket on fd #22 for interface updates 2021-11-15T19:24:00.510 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:00 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:00.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:00 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:00.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:00 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:00.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:00 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:00.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:00 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:00.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:00 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:01.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:01 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:01.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:01 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:01.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:01 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:01.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:01 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:01.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:01 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:01.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:01 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:02.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:02.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:02.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:02.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:02.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:02.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:02.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:02.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:02.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:02.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:02.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:02.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:02.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:02.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:02.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:02.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:02.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:02.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:02 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:03.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:03 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:03.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:03 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:03.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:03 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:03.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:03 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:03.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:03 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:03.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:03 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:04.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:04.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:04.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:04.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:04.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:04.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:04.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:04.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:04.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:04.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:04.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:04.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:04.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:04.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:04.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:04.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:04.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:04.516 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:04 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:05.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:05 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:05.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:05 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:05.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:05 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:05.511 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:05 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:05.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:05 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:05.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:05 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:06.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:06.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:06.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:06.512 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:06.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:06.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:06.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:06.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:06.513 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:06.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:06.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:06.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:06.514 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:06.515 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:06.515 INFO:teuthology.orchestra.run.gibba031.stdout:15 Nov 19:24:06 ntpd[9926]: ntpd: time slew -0.007424 s 2021-11-15T19:24:06.515 INFO:teuthology.orchestra.run.gibba031.stdout:ntpd: time slew -0.007424s 2021-11-15T19:24:06.516 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T19:24:06.516 INFO:teuthology.orchestra.run.gibba031.stderr:15 Nov 19:24:06 ntpd[9926]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T19:24:06.560 INFO:teuthology.orchestra.run.gibba031.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T19:24:06.560 INFO:teuthology.orchestra.run.gibba031.stdout:============================================================================== 2021-11-15T19:24:06.561 INFO:teuthology.orchestra.run.gibba031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:06.561 INFO:teuthology.orchestra.run.gibba031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:06.561 INFO:teuthology.orchestra.run.gibba031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:06.561 INFO:teuthology.orchestra.run.gibba031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:06.562 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T19:24:06.563 DEBUG:teuthology.orchestra.run.gibba018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T19:24:06.583 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T19:24:06.583 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Command line: ntpd -gq 2021-11-15T19:24:06.583 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: proto: precision = 0.043 usec (-24) 2021-11-15T19:24:06.583 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:24:06.583 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:24:06.584 INFO:teuthology.orchestra.run.gibba018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:24:06.584 INFO:teuthology.orchestra.run.gibba018.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:24:06.585 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T19:24:06.585 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T19:24:06.586 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T19:24:06.586 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listen normally on 3 enp1s0f0 172.21.2.118:123 2021-11-15T19:24:06.586 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listen normally on 4 lo [::1]:123 2021-11-15T19:24:06.586 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9114%4]:123 2021-11-15T19:24:06.586 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:06 ntpd[9882]: Listening on routing socket on fd #22 for interface updates 2021-11-15T19:24:08.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:08 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:08.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:08 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:08.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:08 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:08.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:08 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:08.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:08 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:08.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:08 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:10.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:10.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:10.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:10.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:10.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:10.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:10.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:10.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:10.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:10.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:10.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:10.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:10 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:11.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:11.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:11.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:11.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:11.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:11.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:11.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:11.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:11.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:11.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:11.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:11.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:11 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:12.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:12.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:12.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:12.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:12.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:12.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:12.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:12.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:12.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:12.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:12.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:12.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:12 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:13.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:13.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:13.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:13.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:13.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:13.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:13.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:13.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:13.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:13.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:13.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:13.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:13 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:14.584 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:14.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:14.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:14.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:14.585 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:14.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:14.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:14.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:14.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:14.586 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:14.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:14.587 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:14.587 INFO:teuthology.orchestra.run.gibba018.stdout:15 Nov 19:24:14 ntpd[9882]: ntpd: time slew -0.007761 s 2021-11-15T19:24:14.588 INFO:teuthology.orchestra.run.gibba018.stdout:ntpd: time slew -0.007761s 2021-11-15T19:24:14.588 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T19:24:14.588 INFO:teuthology.orchestra.run.gibba018.stderr:15 Nov 19:24:14 ntpd[9882]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T19:24:14.629 INFO:teuthology.orchestra.run.gibba018.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T19:24:14.629 INFO:teuthology.orchestra.run.gibba018.stdout:============================================================================== 2021-11-15T19:24:14.629 INFO:teuthology.orchestra.run.gibba018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:14.630 INFO:teuthology.orchestra.run.gibba018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:14.630 INFO:teuthology.orchestra.run.gibba018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:14.630 INFO:teuthology.orchestra.run.gibba018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:14.631 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T19:24:14.631 DEBUG:teuthology.orchestra.run.gibba017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T19:24:14.651 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T19:24:14.652 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Command line: ntpd -gq 2021-11-15T19:24:14.652 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: proto: precision = 0.035 usec (-25) 2021-11-15T19:24:14.652 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:24:14.652 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:24:14.653 INFO:teuthology.orchestra.run.gibba017.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T19:24:14.653 INFO:teuthology.orchestra.run.gibba017.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T19:24:14.654 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T19:24:14.654 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T19:24:14.655 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T19:24:14.655 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listen normally on 3 enp1s0f0 172.21.2.117:123 2021-11-15T19:24:14.655 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listen normally on 4 lo [::1]:123 2021-11-15T19:24:14.655 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9232%4]:123 2021-11-15T19:24:14.655 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:14 ntpd[9891]: Listening on routing socket on fd #22 for interface updates 2021-11-15T19:24:15.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:15 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:15.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:15 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:15.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:15 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:15.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:15 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:15.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:15 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:15.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:15 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:16.652 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:16 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:16.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:16 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:16.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:16 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:16.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:16 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:16.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:16 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:16.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:16 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:17.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:17.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:17.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:17.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:17.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:17.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:17.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:17.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:17.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:17.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:17.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:17.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:17.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:17.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:17.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:17.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:17.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:17.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:17 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:18.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:18 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:18.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:18 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:18.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:18 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:18.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:18 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:18.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:18 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:18.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:18 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:19.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:19.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:19.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:19.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:19.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:19.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:19.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:19.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:19.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:19.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:19.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:19.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:19.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:19.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:19.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:19.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:19.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:19.659 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:19 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:20.652 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:20 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:20.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:20 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:20.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:20 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:20.653 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:20 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:20.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:20 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:20.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:20 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:21.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:21.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:21.654 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:21.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:21.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:21.655 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:21.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:21.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:21.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:21.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:21.656 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:21.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:21.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:21.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:21.657 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T19:24:21.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T19:24:21.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T19:24:21.658 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T19:24:21.659 INFO:teuthology.orchestra.run.gibba017.stdout:15 Nov 19:24:21 ntpd[9891]: ntpd: time slew +0.009172 s 2021-11-15T19:24:21.659 INFO:teuthology.orchestra.run.gibba017.stdout:ntpd: time slew +0.009172s 2021-11-15T19:24:21.659 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T19:24:21.660 INFO:teuthology.orchestra.run.gibba017.stderr:15 Nov 19:24:21 ntpd[9891]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T19:24:21.703 INFO:teuthology.orchestra.run.gibba017.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T19:24:21.704 INFO:teuthology.orchestra.run.gibba017.stdout:============================================================================== 2021-11-15T19:24:21.704 INFO:teuthology.orchestra.run.gibba017.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:21.704 INFO:teuthology.orchestra.run.gibba017.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:21.705 INFO:teuthology.orchestra.run.gibba017.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:21.705 INFO:teuthology.orchestra.run.gibba017.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T19:24:21.706 INFO:teuthology.run_tasks:Running task install... 2021-11-15T19:24:21.717 DEBUG:teuthology.task.install:project ceph 2021-11-15T19:24:21.718 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}} 2021-11-15T19:24:21.718 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'} 2021-11-15T19:24:21.719 INFO:teuthology.task.install:Using flavor: default 2021-11-15T19:24:21.725 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-11-15T19:24:21.726 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-11-15T19:24:21.726 DEBUG:teuthology.orchestra.run.gibba037:> sudo lsb_release -is 2021-11-15T19:24:21.753 INFO:teuthology.orchestra.run.gibba037.stdout:Ubuntu 2021-11-15T19:24:21.756 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.756 DEBUG:teuthology.orchestra.run.gibba011:> sudo lsb_release -is 2021-11-15T19:24:21.757 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-key list | grep Ceph 2021-11-15T19:24:21.783 INFO:teuthology.orchestra.run.gibba011.stdout:Ubuntu 2021-11-15T19:24:21.786 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.787 DEBUG:teuthology.orchestra.run.gibba031:> sudo lsb_release -is 2021-11-15T19:24:21.787 DEBUG:teuthology.orchestra.run.gibba011:> sudo apt-key list | grep Ceph 2021-11-15T19:24:21.814 INFO:teuthology.orchestra.run.gibba031.stdout:Ubuntu 2021-11-15T19:24:21.816 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.817 DEBUG:teuthology.orchestra.run.gibba018:> sudo lsb_release -is 2021-11-15T19:24:21.818 DEBUG:teuthology.orchestra.run.gibba031:> sudo apt-key list | grep Ceph 2021-11-15T19:24:21.819 INFO:teuthology.orchestra.run.gibba011.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T19:24:21.844 INFO:teuthology.orchestra.run.gibba018.stdout:Ubuntu 2021-11-15T19:24:21.845 INFO:teuthology.orchestra.run.gibba011.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T19:24:21.845 INFO:teuthology.orchestra.run.gibba011.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T19:24:21.846 DEBUG:teuthology.orchestra.run.gibba011:> sudo lsb_release -is 2021-11-15T19:24:21.847 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.848 DEBUG:teuthology.orchestra.run.gibba017:> sudo lsb_release -is 2021-11-15T19:24:21.849 DEBUG:teuthology.orchestra.run.gibba018:> sudo apt-key list | grep Ceph 2021-11-15T19:24:21.850 INFO:teuthology.orchestra.run.gibba031.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T19:24:21.852 INFO:teuthology.orchestra.run.gibba037.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T19:24:21.873 INFO:teuthology.orchestra.run.gibba037.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T19:24:21.873 INFO:teuthology.orchestra.run.gibba037.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T19:24:21.873 DEBUG:teuthology.orchestra.run.gibba037:> sudo lsb_release -is 2021-11-15T19:24:21.875 INFO:teuthology.orchestra.run.gibba031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T19:24:21.875 INFO:teuthology.orchestra.run.gibba031.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T19:24:21.875 DEBUG:teuthology.orchestra.run.gibba031:> sudo lsb_release -is 2021-11-15T19:24:21.882 INFO:teuthology.orchestra.run.gibba018.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T19:24:21.886 INFO:teuthology.orchestra.run.gibba017.stdout:Ubuntu 2021-11-15T19:24:21.889 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.889 DEBUG:teuthology.orchestra.run.gibba017:> sudo apt-key list | grep Ceph 2021-11-15T19:24:21.908 INFO:teuthology.orchestra.run.gibba018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T19:24:21.909 INFO:teuthology.orchestra.run.gibba018.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T19:24:21.909 DEBUG:teuthology.orchestra.run.gibba018:> sudo lsb_release -is 2021-11-15T19:24:21.911 INFO:teuthology.orchestra.run.gibba011.stdout:Ubuntu 2021-11-15T19:24:21.915 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.915 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T19:24:21.916 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T19:24:21.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:24:21.923 INFO:teuthology.orchestra.run.gibba017.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T19:24:21.924 INFO:teuthology.orchestra.run.gibba037.stdout:Ubuntu 2021-11-15T19:24:21.924 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.924 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T19:24:21.925 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T19:24:21.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:24:21.949 INFO:teuthology.orchestra.run.gibba017.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T19:24:21.950 INFO:teuthology.orchestra.run.gibba017.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T19:24:21.950 DEBUG:teuthology.orchestra.run.gibba017:> sudo lsb_release -is 2021-11-15T19:24:21.964 INFO:teuthology.orchestra.run.gibba018.stdout:Ubuntu 2021-11-15T19:24:21.973 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.973 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T19:24:21.973 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T19:24:21.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:24:21.993 INFO:teuthology.orchestra.run.gibba031.stdout:Ubuntu 2021-11-15T19:24:21.997 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:21.997 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T19:24:21.998 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T19:24:21.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:24:22.019 INFO:teuthology.orchestra.run.gibba017.stdout:Ubuntu 2021-11-15T19:24:22.022 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:24:22.023 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T19:24:22.023 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T19:24:22.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:24:22.140 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T19:24:22.140 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:22.148 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T19:24:22.148 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:22.197 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T19:24:22.198 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:22.202 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T19:24:22.203 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:22.267 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T19:24:22.268 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:22.299 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:24:22.300 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T19:24:22.316 DEBUG:teuthology.orchestra.run.gibba011:> sudo apt-get update 2021-11-15T19:24:22.317 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:24:22.317 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T19:24:22.328 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get update 2021-11-15T19:24:22.366 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:24:22.367 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T19:24:22.369 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:24:22.369 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T19:24:22.381 DEBUG:teuthology.orchestra.run.gibba031:> sudo apt-get update 2021-11-15T19:24:22.382 DEBUG:teuthology.orchestra.run.gibba018:> sudo apt-get update 2021-11-15T19:24:22.423 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:24:22.434 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:24:22.434 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T19:24:22.445 DEBUG:teuthology.orchestra.run.gibba017:> sudo apt-get update 2021-11-15T19:24:22.514 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:24:22.517 INFO:teuthology.orchestra.run.gibba011.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T19:24:22.544 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:24:22.550 INFO:teuthology.orchestra.run.gibba011.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T19:24:22.562 INFO:teuthology.orchestra.run.gibba037.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T19:24:22.566 INFO:teuthology.orchestra.run.gibba018.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T19:24:22.585 INFO:teuthology.orchestra.run.gibba011.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T19:24:22.587 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:24:22.587 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:24:22.596 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T19:24:22.597 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:24:22.597 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:24:22.600 INFO:teuthology.orchestra.run.gibba018.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T19:24:22.613 INFO:teuthology.orchestra.run.gibba031.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T19:24:22.619 INFO:teuthology.orchestra.run.gibba011.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T19:24:22.637 INFO:teuthology.orchestra.run.gibba037.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T19:24:22.638 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:24:22.638 INFO:teuthology.orchestra.run.gibba018.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T19:24:22.639 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:24:22.647 INFO:teuthology.orchestra.run.gibba031.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T19:24:22.662 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:24:22.671 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T19:24:22.672 INFO:teuthology.orchestra.run.gibba011.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T19:24:22.678 INFO:teuthology.orchestra.run.gibba017.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T19:24:22.680 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:24:22.680 INFO:teuthology.orchestra.run.gibba018.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T19:24:22.681 INFO:teuthology.orchestra.run.gibba031.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T19:24:22.708 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T19:24:22.708 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T19:24:22.712 INFO:teuthology.orchestra.run.gibba017.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T19:24:22.715 INFO:teuthology.orchestra.run.gibba011.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:24:22.716 INFO:teuthology.orchestra.run.gibba031.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T19:24:22.719 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T19:24:22.727 INFO:teuthology.orchestra.run.gibba018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T19:24:22.739 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:24:22.745 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:24:22.747 INFO:teuthology.orchestra.run.gibba017.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T19:24:22.753 INFO:teuthology.orchestra.run.gibba018.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:24:22.773 INFO:teuthology.orchestra.run.gibba031.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T19:24:22.780 INFO:teuthology.orchestra.run.gibba017.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T19:24:22.795 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T19:24:22.803 INFO:teuthology.orchestra.run.gibba031.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:24:22.835 INFO:teuthology.orchestra.run.gibba017.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T19:24:22.865 INFO:teuthology.orchestra.run.gibba017.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T19:24:22.943 INFO:teuthology.orchestra.run.gibba031.stdout:Fetched 26.5 kB in 0s (64.4 kB/s) 2021-11-15T19:24:22.948 INFO:teuthology.orchestra.run.gibba011.stdout:Fetched 26.5 kB in 0s (53.4 kB/s) 2021-11-15T19:24:23.022 INFO:teuthology.orchestra.run.gibba018.stdout:Fetched 26.5 kB in 1s (47.8 kB/s) 2021-11-15T19:24:23.050 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 26.5 kB in 1s (48.6 kB/s) 2021-11-15T19:24:23.190 INFO:teuthology.orchestra.run.gibba017.stdout:Fetched 26.5 kB in 1s (47.2 kB/s) 2021-11-15T19:24:23.459 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:24:23.471 DEBUG:teuthology.orchestra.run.gibba031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:23.471 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:24:23.482 DEBUG:teuthology.orchestra.run.gibba011:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:23.508 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:24:23.518 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:24:23.537 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:24:23.548 DEBUG:teuthology.orchestra.run.gibba018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:23.574 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:24:23.584 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:24:23.585 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:23.611 INFO:teuthology.orchestra.run.gibba031.stdout:Building dependency tree... 2021-11-15T19:24:23.611 INFO:teuthology.orchestra.run.gibba031.stdout:Reading state information... 2021-11-15T19:24:23.621 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:24:23.623 INFO:teuthology.orchestra.run.gibba011.stdout:Building dependency tree... 2021-11-15T19:24:23.624 INFO:teuthology.orchestra.run.gibba011.stdout:Reading state information... 2021-11-15T19:24:23.685 INFO:teuthology.orchestra.run.gibba018.stdout:Building dependency tree... 2021-11-15T19:24:23.685 INFO:teuthology.orchestra.run.gibba018.stdout:Reading state information... 2021-11-15T19:24:23.690 INFO:teuthology.orchestra.run.gibba031.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:24:23.691 INFO:teuthology.orchestra.run.gibba031.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:24:23.691 INFO:teuthology.orchestra.run.gibba031.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:24:23.691 INFO:teuthology.orchestra.run.gibba031.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:24:23.691 INFO:teuthology.orchestra.run.gibba031.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:24:23.692 INFO:teuthology.orchestra.run.gibba031.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:24:23.692 INFO:teuthology.orchestra.run.gibba031.stdout:The following additional packages will be installed: 2021-11-15T19:24:23.692 INFO:teuthology.orchestra.run.gibba031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.692 INFO:teuthology.orchestra.run.gibba031.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.693 INFO:teuthology.orchestra.run.gibba031.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T19:24:23.693 INFO:teuthology.orchestra.run.gibba031.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T19:24:23.693 INFO:teuthology.orchestra.run.gibba031.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T19:24:23.693 INFO:teuthology.orchestra.run.gibba031.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T19:24:23.694 INFO:teuthology.orchestra.run.gibba031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T19:24:23.694 INFO:teuthology.orchestra.run.gibba031.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T19:24:23.694 INFO:teuthology.orchestra.run.gibba031.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T19:24:23.694 INFO:teuthology.orchestra.run.gibba031.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T19:24:23.695 INFO:teuthology.orchestra.run.gibba031.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T19:24:23.695 INFO:teuthology.orchestra.run.gibba031.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T19:24:23.695 INFO:teuthology.orchestra.run.gibba031.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T19:24:23.695 INFO:teuthology.orchestra.run.gibba031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T19:24:23.696 INFO:teuthology.orchestra.run.gibba031.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T19:24:23.696 INFO:teuthology.orchestra.run.gibba031.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T19:24:23.696 INFO:teuthology.orchestra.run.gibba031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T19:24:23.696 INFO:teuthology.orchestra.run.gibba031.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T19:24:23.697 INFO:teuthology.orchestra.run.gibba031.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T19:24:23.697 INFO:teuthology.orchestra.run.gibba031.stdout: xmlstarlet 2021-11-15T19:24:23.697 INFO:teuthology.orchestra.run.gibba031.stdout:Suggested packages: 2021-11-15T19:24:23.698 INFO:teuthology.orchestra.run.gibba031.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T19:24:23.698 INFO:teuthology.orchestra.run.gibba031.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T19:24:23.698 INFO:teuthology.orchestra.run.gibba031.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T19:24:23.698 INFO:teuthology.orchestra.run.gibba031.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T19:24:23.699 INFO:teuthology.orchestra.run.gibba031.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T19:24:23.699 INFO:teuthology.orchestra.run.gibba031.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T19:24:23.699 INFO:teuthology.orchestra.run.gibba031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T19:24:23.699 INFO:teuthology.orchestra.run.gibba031.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T19:24:23.700 INFO:teuthology.orchestra.run.gibba031.stdout:Recommended packages: 2021-11-15T19:24:23.700 INFO:teuthology.orchestra.run.gibba031.stdout: btrfs-tools 2021-11-15T19:24:23.706 INFO:teuthology.orchestra.run.gibba011.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:24:23.706 INFO:teuthology.orchestra.run.gibba011.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:24:23.706 INFO:teuthology.orchestra.run.gibba011.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:24:23.707 INFO:teuthology.orchestra.run.gibba011.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:24:23.707 INFO:teuthology.orchestra.run.gibba011.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:24:23.707 INFO:teuthology.orchestra.run.gibba011.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:24:23.707 INFO:teuthology.orchestra.run.gibba011.stdout:The following additional packages will be installed: 2021-11-15T19:24:23.708 INFO:teuthology.orchestra.run.gibba011.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.708 INFO:teuthology.orchestra.run.gibba011.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.708 INFO:teuthology.orchestra.run.gibba011.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T19:24:23.708 INFO:teuthology.orchestra.run.gibba011.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T19:24:23.709 INFO:teuthology.orchestra.run.gibba011.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T19:24:23.709 INFO:teuthology.orchestra.run.gibba011.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T19:24:23.709 INFO:teuthology.orchestra.run.gibba011.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T19:24:23.709 INFO:teuthology.orchestra.run.gibba011.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T19:24:23.710 INFO:teuthology.orchestra.run.gibba011.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T19:24:23.710 INFO:teuthology.orchestra.run.gibba011.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T19:24:23.710 INFO:teuthology.orchestra.run.gibba011.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T19:24:23.710 INFO:teuthology.orchestra.run.gibba011.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T19:24:23.711 INFO:teuthology.orchestra.run.gibba011.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T19:24:23.711 INFO:teuthology.orchestra.run.gibba011.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T19:24:23.711 INFO:teuthology.orchestra.run.gibba011.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T19:24:23.711 INFO:teuthology.orchestra.run.gibba011.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T19:24:23.712 INFO:teuthology.orchestra.run.gibba011.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T19:24:23.712 INFO:teuthology.orchestra.run.gibba011.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T19:24:23.712 INFO:teuthology.orchestra.run.gibba011.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T19:24:23.712 INFO:teuthology.orchestra.run.gibba011.stdout: xmlstarlet 2021-11-15T19:24:23.712 INFO:teuthology.orchestra.run.gibba011.stdout:Suggested packages: 2021-11-15T19:24:23.713 INFO:teuthology.orchestra.run.gibba011.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T19:24:23.713 INFO:teuthology.orchestra.run.gibba011.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T19:24:23.713 INFO:teuthology.orchestra.run.gibba011.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T19:24:23.713 INFO:teuthology.orchestra.run.gibba011.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T19:24:23.714 INFO:teuthology.orchestra.run.gibba011.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T19:24:23.714 INFO:teuthology.orchestra.run.gibba011.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T19:24:23.714 INFO:teuthology.orchestra.run.gibba011.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T19:24:23.714 INFO:teuthology.orchestra.run.gibba011.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T19:24:23.715 INFO:teuthology.orchestra.run.gibba011.stdout:Recommended packages: 2021-11-15T19:24:23.715 INFO:teuthology.orchestra.run.gibba011.stdout: btrfs-tools 2021-11-15T19:24:23.716 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:24:23.717 DEBUG:teuthology.orchestra.run.gibba017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:24:23.725 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-11-15T19:24:23.726 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-11-15T19:24:23.742 INFO:teuthology.orchestra.run.gibba031.stdout:The following NEW packages will be installed: 2021-11-15T19:24:23.742 INFO:teuthology.orchestra.run.gibba031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T19:24:23.743 INFO:teuthology.orchestra.run.gibba031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.743 INFO:teuthology.orchestra.run.gibba031.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.743 INFO:teuthology.orchestra.run.gibba031.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T19:24:23.743 INFO:teuthology.orchestra.run.gibba031.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T19:24:23.744 INFO:teuthology.orchestra.run.gibba031.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T19:24:23.744 INFO:teuthology.orchestra.run.gibba031.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T19:24:23.744 INFO:teuthology.orchestra.run.gibba031.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T19:24:23.744 INFO:teuthology.orchestra.run.gibba031.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T19:24:23.745 INFO:teuthology.orchestra.run.gibba031.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T19:24:23.745 INFO:teuthology.orchestra.run.gibba031.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T19:24:23.745 INFO:teuthology.orchestra.run.gibba031.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T19:24:23.745 INFO:teuthology.orchestra.run.gibba031.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T19:24:23.746 INFO:teuthology.orchestra.run.gibba031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T19:24:23.746 INFO:teuthology.orchestra.run.gibba031.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T19:24:23.746 INFO:teuthology.orchestra.run.gibba031.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T19:24:23.746 INFO:teuthology.orchestra.run.gibba031.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T19:24:23.746 INFO:teuthology.orchestra.run.gibba031.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T19:24:23.747 INFO:teuthology.orchestra.run.gibba031.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T19:24:23.747 INFO:teuthology.orchestra.run.gibba031.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T19:24:23.747 INFO:teuthology.orchestra.run.gibba031.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T19:24:23.747 INFO:teuthology.orchestra.run.gibba031.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T19:24:23.748 INFO:teuthology.orchestra.run.gibba031.stdout:The following packages will be upgraded: 2021-11-15T19:24:23.748 INFO:teuthology.orchestra.run.gibba031.stdout: librados2 librbd1 2021-11-15T19:24:23.752 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:24:23.756 INFO:teuthology.orchestra.run.gibba011.stdout:The following NEW packages will be installed: 2021-11-15T19:24:23.756 INFO:teuthology.orchestra.run.gibba011.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T19:24:23.756 INFO:teuthology.orchestra.run.gibba011.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.757 INFO:teuthology.orchestra.run.gibba011.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.758 INFO:teuthology.orchestra.run.gibba011.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T19:24:23.758 INFO:teuthology.orchestra.run.gibba011.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T19:24:23.759 INFO:teuthology.orchestra.run.gibba011.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T19:24:23.759 INFO:teuthology.orchestra.run.gibba011.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T19:24:23.759 INFO:teuthology.orchestra.run.gibba011.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T19:24:23.759 INFO:teuthology.orchestra.run.gibba011.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T19:24:23.760 INFO:teuthology.orchestra.run.gibba011.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T19:24:23.760 INFO:teuthology.orchestra.run.gibba011.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T19:24:23.760 INFO:teuthology.orchestra.run.gibba011.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T19:24:23.760 INFO:teuthology.orchestra.run.gibba011.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T19:24:23.761 INFO:teuthology.orchestra.run.gibba011.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T19:24:23.761 INFO:teuthology.orchestra.run.gibba011.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T19:24:23.761 INFO:teuthology.orchestra.run.gibba011.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T19:24:23.761 INFO:teuthology.orchestra.run.gibba011.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T19:24:23.762 INFO:teuthology.orchestra.run.gibba011.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T19:24:23.762 INFO:teuthology.orchestra.run.gibba011.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T19:24:23.762 INFO:teuthology.orchestra.run.gibba011.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T19:24:23.763 INFO:teuthology.orchestra.run.gibba011.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T19:24:23.763 INFO:teuthology.orchestra.run.gibba011.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T19:24:23.763 INFO:teuthology.orchestra.run.gibba011.stdout:The following packages will be upgraded: 2021-11-15T19:24:23.763 INFO:teuthology.orchestra.run.gibba011.stdout: librados2 librbd1 2021-11-15T19:24:23.765 INFO:teuthology.orchestra.run.gibba018.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:24:23.765 INFO:teuthology.orchestra.run.gibba018.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:24:23.766 INFO:teuthology.orchestra.run.gibba018.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:24:23.766 INFO:teuthology.orchestra.run.gibba018.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:24:23.766 INFO:teuthology.orchestra.run.gibba018.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:24:23.766 INFO:teuthology.orchestra.run.gibba018.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:24:23.767 INFO:teuthology.orchestra.run.gibba018.stdout:The following additional packages will be installed: 2021-11-15T19:24:23.767 INFO:teuthology.orchestra.run.gibba018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.767 INFO:teuthology.orchestra.run.gibba018.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.767 INFO:teuthology.orchestra.run.gibba018.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T19:24:23.768 INFO:teuthology.orchestra.run.gibba018.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T19:24:23.768 INFO:teuthology.orchestra.run.gibba018.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T19:24:23.768 INFO:teuthology.orchestra.run.gibba018.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T19:24:23.769 INFO:teuthology.orchestra.run.gibba018.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T19:24:23.769 INFO:teuthology.orchestra.run.gibba018.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T19:24:23.769 INFO:teuthology.orchestra.run.gibba018.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T19:24:23.769 INFO:teuthology.orchestra.run.gibba018.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T19:24:23.770 INFO:teuthology.orchestra.run.gibba018.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T19:24:23.770 INFO:teuthology.orchestra.run.gibba018.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T19:24:23.770 INFO:teuthology.orchestra.run.gibba018.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T19:24:23.770 INFO:teuthology.orchestra.run.gibba018.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T19:24:23.771 INFO:teuthology.orchestra.run.gibba018.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T19:24:23.771 INFO:teuthology.orchestra.run.gibba018.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T19:24:23.771 INFO:teuthology.orchestra.run.gibba018.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T19:24:23.771 INFO:teuthology.orchestra.run.gibba018.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T19:24:23.772 INFO:teuthology.orchestra.run.gibba018.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T19:24:23.772 INFO:teuthology.orchestra.run.gibba018.stdout: xmlstarlet 2021-11-15T19:24:23.772 INFO:teuthology.orchestra.run.gibba018.stdout:Suggested packages: 2021-11-15T19:24:23.772 INFO:teuthology.orchestra.run.gibba018.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T19:24:23.772 INFO:teuthology.orchestra.run.gibba018.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T19:24:23.773 INFO:teuthology.orchestra.run.gibba018.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T19:24:23.773 INFO:teuthology.orchestra.run.gibba018.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T19:24:23.773 INFO:teuthology.orchestra.run.gibba018.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T19:24:23.773 INFO:teuthology.orchestra.run.gibba018.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T19:24:23.774 INFO:teuthology.orchestra.run.gibba018.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T19:24:23.774 INFO:teuthology.orchestra.run.gibba018.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T19:24:23.774 INFO:teuthology.orchestra.run.gibba018.stdout:Recommended packages: 2021-11-15T19:24:23.774 INFO:teuthology.orchestra.run.gibba018.stdout: btrfs-tools 2021-11-15T19:24:23.805 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:24:23.805 INFO:teuthology.orchestra.run.gibba037.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:24:23.805 INFO:teuthology.orchestra.run.gibba037.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:24:23.806 INFO:teuthology.orchestra.run.gibba037.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:24:23.806 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:24:23.806 INFO:teuthology.orchestra.run.gibba037.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:24:23.806 INFO:teuthology.orchestra.run.gibba037.stdout:The following additional packages will be installed: 2021-11-15T19:24:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T19:24:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T19:24:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T19:24:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T19:24:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T19:24:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T19:24:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T19:24:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T19:24:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T19:24:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T19:24:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T19:24:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T19:24:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T19:24:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T19:24:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T19:24:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T19:24:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T19:24:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: xmlstarlet 2021-11-15T19:24:23.811 INFO:teuthology.orchestra.run.gibba037.stdout:Suggested packages: 2021-11-15T19:24:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T19:24:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T19:24:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T19:24:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T19:24:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T19:24:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T19:24:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T19:24:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T19:24:23.813 INFO:teuthology.orchestra.run.gibba037.stdout:Recommended packages: 2021-11-15T19:24:23.814 INFO:teuthology.orchestra.run.gibba037.stdout: btrfs-tools 2021-11-15T19:24:23.816 INFO:teuthology.orchestra.run.gibba018.stdout:The following NEW packages will be installed: 2021-11-15T19:24:23.816 INFO:teuthology.orchestra.run.gibba018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T19:24:23.816 INFO:teuthology.orchestra.run.gibba018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.817 INFO:teuthology.orchestra.run.gibba018.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.817 INFO:teuthology.orchestra.run.gibba018.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T19:24:23.817 INFO:teuthology.orchestra.run.gibba018.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T19:24:23.817 INFO:teuthology.orchestra.run.gibba018.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T19:24:23.818 INFO:teuthology.orchestra.run.gibba018.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T19:24:23.818 INFO:teuthology.orchestra.run.gibba018.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T19:24:23.818 INFO:teuthology.orchestra.run.gibba018.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T19:24:23.818 INFO:teuthology.orchestra.run.gibba018.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T19:24:23.819 INFO:teuthology.orchestra.run.gibba018.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T19:24:23.819 INFO:teuthology.orchestra.run.gibba018.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T19:24:23.819 INFO:teuthology.orchestra.run.gibba018.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T19:24:23.819 INFO:teuthology.orchestra.run.gibba018.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T19:24:23.820 INFO:teuthology.orchestra.run.gibba018.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T19:24:23.820 INFO:teuthology.orchestra.run.gibba018.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T19:24:23.820 INFO:teuthology.orchestra.run.gibba018.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T19:24:23.820 INFO:teuthology.orchestra.run.gibba018.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T19:24:23.821 INFO:teuthology.orchestra.run.gibba018.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T19:24:23.821 INFO:teuthology.orchestra.run.gibba018.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T19:24:23.821 INFO:teuthology.orchestra.run.gibba018.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T19:24:23.821 INFO:teuthology.orchestra.run.gibba018.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T19:24:23.822 INFO:teuthology.orchestra.run.gibba018.stdout:The following packages will be upgraded: 2021-11-15T19:24:23.822 INFO:teuthology.orchestra.run.gibba018.stdout: librados2 librbd1 2021-11-15T19:24:23.853 INFO:teuthology.orchestra.run.gibba017.stdout:Building dependency tree... 2021-11-15T19:24:23.853 INFO:teuthology.orchestra.run.gibba017.stdout:Reading state information... 2021-11-15T19:24:23.857 INFO:teuthology.orchestra.run.gibba037.stdout:The following NEW packages will be installed: 2021-11-15T19:24:23.857 INFO:teuthology.orchestra.run.gibba037.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T19:24:23.857 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.857 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.858 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T19:24:23.858 INFO:teuthology.orchestra.run.gibba037.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T19:24:23.858 INFO:teuthology.orchestra.run.gibba037.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T19:24:23.858 INFO:teuthology.orchestra.run.gibba037.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T19:24:23.859 INFO:teuthology.orchestra.run.gibba037.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T19:24:23.859 INFO:teuthology.orchestra.run.gibba037.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T19:24:23.859 INFO:teuthology.orchestra.run.gibba037.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T19:24:23.859 INFO:teuthology.orchestra.run.gibba037.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T19:24:23.860 INFO:teuthology.orchestra.run.gibba037.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T19:24:23.860 INFO:teuthology.orchestra.run.gibba037.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T19:24:23.860 INFO:teuthology.orchestra.run.gibba037.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T19:24:23.860 INFO:teuthology.orchestra.run.gibba037.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T19:24:23.860 INFO:teuthology.orchestra.run.gibba037.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T19:24:23.861 INFO:teuthology.orchestra.run.gibba037.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T19:24:23.861 INFO:teuthology.orchestra.run.gibba037.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T19:24:23.861 INFO:teuthology.orchestra.run.gibba037.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T19:24:23.861 INFO:teuthology.orchestra.run.gibba037.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T19:24:23.862 INFO:teuthology.orchestra.run.gibba037.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T19:24:23.862 INFO:teuthology.orchestra.run.gibba037.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T19:24:23.862 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages will be upgraded: 2021-11-15T19:24:23.862 INFO:teuthology.orchestra.run.gibba037.stdout: librados2 librbd1 2021-11-15T19:24:23.917 INFO:teuthology.orchestra.run.gibba031.stdout:2 upgraded, 101 newly installed, 0 to remove and 49 not upgraded. 2021-11-15T19:24:23.917 INFO:teuthology.orchestra.run.gibba031.stdout:Need to get 153 MB of archives. 2021-11-15T19:24:23.917 INFO:teuthology.orchestra.run.gibba031.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T19:24:23.917 INFO:teuthology.orchestra.run.gibba031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T19:24:23.932 INFO:teuthology.orchestra.run.gibba017.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:24:23.932 INFO:teuthology.orchestra.run.gibba017.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:24:23.932 INFO:teuthology.orchestra.run.gibba017.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:24:23.932 INFO:teuthology.orchestra.run.gibba017.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:24:23.933 INFO:teuthology.orchestra.run.gibba017.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:24:23.933 INFO:teuthology.orchestra.run.gibba017.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:24:23.933 INFO:teuthology.orchestra.run.gibba017.stdout:The following additional packages will be installed: 2021-11-15T19:24:23.933 INFO:teuthology.orchestra.run.gibba017.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.933 INFO:teuthology.orchestra.run.gibba017.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.934 INFO:teuthology.orchestra.run.gibba017.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T19:24:23.934 INFO:teuthology.orchestra.run.gibba017.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T19:24:23.934 INFO:teuthology.orchestra.run.gibba017.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T19:24:23.934 INFO:teuthology.orchestra.run.gibba017.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T19:24:23.935 INFO:teuthology.orchestra.run.gibba017.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T19:24:23.935 INFO:teuthology.orchestra.run.gibba017.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T19:24:23.935 INFO:teuthology.orchestra.run.gibba017.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T19:24:23.935 INFO:teuthology.orchestra.run.gibba017.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T19:24:23.936 INFO:teuthology.orchestra.run.gibba017.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T19:24:23.936 INFO:teuthology.orchestra.run.gibba017.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T19:24:23.936 INFO:teuthology.orchestra.run.gibba017.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T19:24:23.936 INFO:teuthology.orchestra.run.gibba017.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T19:24:23.937 INFO:teuthology.orchestra.run.gibba017.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T19:24:23.937 INFO:teuthology.orchestra.run.gibba017.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T19:24:23.937 INFO:teuthology.orchestra.run.gibba017.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T19:24:23.937 INFO:teuthology.orchestra.run.gibba017.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T19:24:23.937 INFO:teuthology.orchestra.run.gibba017.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T19:24:23.938 INFO:teuthology.orchestra.run.gibba017.stdout: xmlstarlet 2021-11-15T19:24:23.938 INFO:teuthology.orchestra.run.gibba017.stdout:Suggested packages: 2021-11-15T19:24:23.938 INFO:teuthology.orchestra.run.gibba017.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T19:24:23.938 INFO:teuthology.orchestra.run.gibba017.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T19:24:23.939 INFO:teuthology.orchestra.run.gibba017.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T19:24:23.939 INFO:teuthology.orchestra.run.gibba017.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T19:24:23.939 INFO:teuthology.orchestra.run.gibba017.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T19:24:23.939 INFO:teuthology.orchestra.run.gibba017.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T19:24:23.940 INFO:teuthology.orchestra.run.gibba017.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T19:24:23.940 INFO:teuthology.orchestra.run.gibba017.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T19:24:23.940 INFO:teuthology.orchestra.run.gibba017.stdout:Recommended packages: 2021-11-15T19:24:23.940 INFO:teuthology.orchestra.run.gibba017.stdout: btrfs-tools 2021-11-15T19:24:23.941 INFO:teuthology.orchestra.run.gibba011.stdout:2 upgraded, 101 newly installed, 0 to remove and 49 not upgraded. 2021-11-15T19:24:23.941 INFO:teuthology.orchestra.run.gibba011.stdout:Need to get 153 MB of archives. 2021-11-15T19:24:23.941 INFO:teuthology.orchestra.run.gibba011.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T19:24:23.942 INFO:teuthology.orchestra.run.gibba011.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T19:24:23.948 INFO:teuthology.orchestra.run.gibba031.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T19:24:23.950 INFO:teuthology.orchestra.run.gibba011.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T19:24:23.984 INFO:teuthology.orchestra.run.gibba017.stdout:The following NEW packages will be installed: 2021-11-15T19:24:23.984 INFO:teuthology.orchestra.run.gibba017.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T19:24:23.984 INFO:teuthology.orchestra.run.gibba017.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T19:24:23.984 INFO:teuthology.orchestra.run.gibba017.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T19:24:23.985 INFO:teuthology.orchestra.run.gibba017.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T19:24:23.985 INFO:teuthology.orchestra.run.gibba017.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T19:24:23.985 INFO:teuthology.orchestra.run.gibba017.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T19:24:23.985 INFO:teuthology.orchestra.run.gibba017.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T19:24:23.986 INFO:teuthology.orchestra.run.gibba017.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T19:24:23.986 INFO:teuthology.orchestra.run.gibba017.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T19:24:23.986 INFO:teuthology.orchestra.run.gibba017.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T19:24:23.986 INFO:teuthology.orchestra.run.gibba017.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T19:24:23.987 INFO:teuthology.orchestra.run.gibba017.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T19:24:23.987 INFO:teuthology.orchestra.run.gibba017.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T19:24:23.987 INFO:teuthology.orchestra.run.gibba017.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T19:24:23.987 INFO:teuthology.orchestra.run.gibba017.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T19:24:23.988 INFO:teuthology.orchestra.run.gibba017.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T19:24:23.988 INFO:teuthology.orchestra.run.gibba017.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T19:24:23.988 INFO:teuthology.orchestra.run.gibba017.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T19:24:23.988 INFO:teuthology.orchestra.run.gibba017.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T19:24:23.989 INFO:teuthology.orchestra.run.gibba017.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T19:24:23.989 INFO:teuthology.orchestra.run.gibba017.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T19:24:23.989 INFO:teuthology.orchestra.run.gibba017.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T19:24:23.989 INFO:teuthology.orchestra.run.gibba017.stdout:The following packages will be upgraded: 2021-11-15T19:24:23.989 INFO:teuthology.orchestra.run.gibba017.stdout: librados2 librbd1 2021-11-15T19:24:23.991 INFO:teuthology.orchestra.run.gibba018.stdout:2 upgraded, 101 newly installed, 0 to remove and 49 not upgraded. 2021-11-15T19:24:23.992 INFO:teuthology.orchestra.run.gibba018.stdout:Need to get 153 MB of archives. 2021-11-15T19:24:23.992 INFO:teuthology.orchestra.run.gibba018.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T19:24:23.992 INFO:teuthology.orchestra.run.gibba018.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T19:24:24.001 INFO:teuthology.orchestra.run.gibba031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T19:24:24.004 INFO:teuthology.orchestra.run.gibba018.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T19:24:24.030 INFO:teuthology.orchestra.run.gibba031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T19:24:24.032 INFO:teuthology.orchestra.run.gibba037.stdout:2 upgraded, 101 newly installed, 0 to remove and 49 not upgraded. 2021-11-15T19:24:24.033 INFO:teuthology.orchestra.run.gibba037.stdout:Need to get 153 MB of archives. 2021-11-15T19:24:24.033 INFO:teuthology.orchestra.run.gibba037.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T19:24:24.033 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T19:24:24.066 INFO:teuthology.orchestra.run.gibba037.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T19:24:24.076 INFO:teuthology.orchestra.run.gibba018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T19:24:24.100 INFO:teuthology.orchestra.run.gibba011.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T19:24:24.106 INFO:teuthology.orchestra.run.gibba018.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T19:24:24.106 INFO:teuthology.orchestra.run.gibba011.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T19:24:24.118 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T19:24:24.125 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T19:24:24.141 INFO:teuthology.orchestra.run.gibba031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T19:24:24.159 INFO:teuthology.orchestra.run.gibba017.stdout:2 upgraded, 101 newly installed, 0 to remove and 49 not upgraded. 2021-11-15T19:24:24.159 INFO:teuthology.orchestra.run.gibba017.stdout:Need to get 153 MB of archives. 2021-11-15T19:24:24.159 INFO:teuthology.orchestra.run.gibba017.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T19:24:24.160 INFO:teuthology.orchestra.run.gibba017.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T19:24:24.205 INFO:teuthology.orchestra.run.gibba017.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T19:24:24.216 INFO:teuthology.orchestra.run.gibba018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T19:24:24.224 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T19:24:24.230 INFO:teuthology.orchestra.run.gibba011.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T19:24:24.231 INFO:teuthology.orchestra.run.gibba011.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T19:24:24.244 INFO:teuthology.orchestra.run.gibba017.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T19:24:24.274 INFO:teuthology.orchestra.run.gibba017.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T19:24:24.275 INFO:teuthology.orchestra.run.gibba031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T19:24:24.279 INFO:teuthology.orchestra.run.gibba031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T19:24:24.280 INFO:teuthology.orchestra.run.gibba031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T19:24:24.285 INFO:teuthology.orchestra.run.gibba018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T19:24:24.292 INFO:teuthology.orchestra.run.gibba031.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T19:24:24.349 INFO:teuthology.orchestra.run.gibba018.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T19:24:24.350 INFO:teuthology.orchestra.run.gibba018.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T19:24:24.353 INFO:teuthology.orchestra.run.gibba018.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T19:24:24.380 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T19:24:24.383 INFO:teuthology.orchestra.run.gibba017.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T19:24:24.390 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T19:24:24.394 INFO:teuthology.orchestra.run.gibba011.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T19:24:24.396 INFO:teuthology.orchestra.run.gibba031.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T19:24:24.399 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T19:24:24.407 INFO:teuthology.orchestra.run.gibba011.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T19:24:24.424 INFO:teuthology.orchestra.run.gibba011.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T19:24:24.425 INFO:teuthology.orchestra.run.gibba031.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T19:24:24.430 INFO:teuthology.orchestra.run.gibba031.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T19:24:24.453 INFO:teuthology.orchestra.run.gibba031.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T19:24:24.458 INFO:teuthology.orchestra.run.gibba031.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T19:24:24.460 INFO:teuthology.orchestra.run.gibba031.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T19:24:24.472 INFO:teuthology.orchestra.run.gibba018.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T19:24:24.476 INFO:teuthology.orchestra.run.gibba031.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T19:24:24.477 INFO:teuthology.orchestra.run.gibba031.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T19:24:24.478 INFO:teuthology.orchestra.run.gibba031.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T19:24:24.503 INFO:teuthology.orchestra.run.gibba018.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T19:24:24.509 INFO:teuthology.orchestra.run.gibba018.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T19:24:24.516 INFO:teuthology.orchestra.run.gibba037.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T19:24:24.517 INFO:teuthology.orchestra.run.gibba017.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T19:24:24.525 INFO:teuthology.orchestra.run.gibba031.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T19:24:24.527 INFO:teuthology.orchestra.run.gibba017.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T19:24:24.528 INFO:teuthology.orchestra.run.gibba031.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T19:24:24.528 INFO:teuthology.orchestra.run.gibba031.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T19:24:24.531 INFO:teuthology.orchestra.run.gibba011.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T19:24:24.532 INFO:teuthology.orchestra.run.gibba018.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T19:24:24.537 INFO:teuthology.orchestra.run.gibba018.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T19:24:24.540 INFO:teuthology.orchestra.run.gibba018.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T19:24:24.540 INFO:teuthology.orchestra.run.gibba017.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T19:24:24.544 INFO:teuthology.orchestra.run.gibba037.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T19:24:24.550 INFO:teuthology.orchestra.run.gibba037.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T19:24:24.553 INFO:teuthology.orchestra.run.gibba011.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T19:24:24.554 INFO:teuthology.orchestra.run.gibba018.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T19:24:24.556 INFO:teuthology.orchestra.run.gibba018.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T19:24:24.557 INFO:teuthology.orchestra.run.gibba018.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T19:24:24.560 INFO:teuthology.orchestra.run.gibba011.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T19:24:24.576 INFO:teuthology.orchestra.run.gibba011.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T19:24:24.576 INFO:teuthology.orchestra.run.gibba037.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T19:24:24.581 INFO:teuthology.orchestra.run.gibba037.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T19:24:24.584 INFO:teuthology.orchestra.run.gibba037.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T19:24:24.585 INFO:teuthology.orchestra.run.gibba011.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T19:24:24.590 INFO:teuthology.orchestra.run.gibba011.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T19:24:24.593 INFO:teuthology.orchestra.run.gibba011.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T19:24:24.600 INFO:teuthology.orchestra.run.gibba018.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T19:24:24.600 INFO:teuthology.orchestra.run.gibba037.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T19:24:24.601 INFO:teuthology.orchestra.run.gibba037.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T19:24:24.602 INFO:teuthology.orchestra.run.gibba018.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T19:24:24.603 INFO:teuthology.orchestra.run.gibba018.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T19:24:24.603 INFO:teuthology.orchestra.run.gibba037.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T19:24:24.607 INFO:teuthology.orchestra.run.gibba031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T19:24:24.608 INFO:teuthology.orchestra.run.gibba011.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T19:24:24.609 INFO:teuthology.orchestra.run.gibba031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T19:24:24.610 INFO:teuthology.orchestra.run.gibba011.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T19:24:24.610 INFO:teuthology.orchestra.run.gibba031.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T19:24:24.611 INFO:teuthology.orchestra.run.gibba011.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T19:24:24.612 INFO:teuthology.orchestra.run.gibba031.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T19:24:24.616 INFO:teuthology.orchestra.run.gibba031.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T19:24:24.616 INFO:teuthology.orchestra.run.gibba031.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T19:24:24.631 INFO:teuthology.orchestra.run.gibba037.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T19:24:24.631 INFO:teuthology.orchestra.run.gibba037.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T19:24:24.636 INFO:teuthology.orchestra.run.gibba031.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T19:24:24.636 INFO:teuthology.orchestra.run.gibba011.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T19:24:24.642 INFO:teuthology.orchestra.run.gibba017.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T19:24:24.643 INFO:teuthology.orchestra.run.gibba011.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T19:24:24.646 INFO:teuthology.orchestra.run.gibba011.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T19:24:24.646 INFO:teuthology.orchestra.run.gibba037.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T19:24:24.647 INFO:teuthology.orchestra.run.gibba011.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T19:24:24.656 INFO:teuthology.orchestra.run.gibba011.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T19:24:24.657 INFO:teuthology.orchestra.run.gibba011.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T19:24:24.664 INFO:teuthology.orchestra.run.gibba017.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T19:24:24.668 INFO:teuthology.orchestra.run.gibba018.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T19:24:24.671 INFO:teuthology.orchestra.run.gibba017.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T19:24:24.682 INFO:teuthology.orchestra.run.gibba018.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T19:24:24.684 INFO:teuthology.orchestra.run.gibba018.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T19:24:24.686 INFO:teuthology.orchestra.run.gibba018.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T19:24:24.689 INFO:teuthology.orchestra.run.gibba031.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T19:24:24.689 INFO:teuthology.orchestra.run.gibba031.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T19:24:24.690 INFO:teuthology.orchestra.run.gibba018.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T19:24:24.690 INFO:teuthology.orchestra.run.gibba031.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T19:24:24.693 INFO:teuthology.orchestra.run.gibba018.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T19:24:24.694 INFO:teuthology.orchestra.run.gibba018.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T19:24:24.698 INFO:teuthology.orchestra.run.gibba017.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T19:24:24.701 INFO:teuthology.orchestra.run.gibba031.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T19:24:24.702 INFO:teuthology.orchestra.run.gibba017.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T19:24:24.705 INFO:teuthology.orchestra.run.gibba017.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T19:24:24.707 INFO:teuthology.orchestra.run.gibba011.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T19:24:24.709 INFO:teuthology.orchestra.run.gibba011.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T19:24:24.714 INFO:teuthology.orchestra.run.gibba037.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T19:24:24.714 INFO:teuthology.orchestra.run.gibba018.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T19:24:24.715 INFO:teuthology.orchestra.run.gibba037.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T19:24:24.717 INFO:teuthology.orchestra.run.gibba037.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T19:24:24.718 INFO:teuthology.orchestra.run.gibba037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T19:24:24.722 INFO:teuthology.orchestra.run.gibba017.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T19:24:24.723 INFO:teuthology.orchestra.run.gibba017.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T19:24:24.724 INFO:teuthology.orchestra.run.gibba037.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T19:24:24.725 INFO:teuthology.orchestra.run.gibba017.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T19:24:24.725 INFO:teuthology.orchestra.run.gibba037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T19:24:24.726 INFO:teuthology.orchestra.run.gibba011.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T19:24:24.726 INFO:teuthology.orchestra.run.gibba037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T19:24:24.728 INFO:teuthology.orchestra.run.gibba011.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T19:24:24.729 INFO:teuthology.orchestra.run.gibba011.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T19:24:24.732 INFO:teuthology.orchestra.run.gibba011.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T19:24:24.736 INFO:teuthology.orchestra.run.gibba011.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T19:24:24.741 INFO:teuthology.orchestra.run.gibba011.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T19:24:24.742 INFO:teuthology.orchestra.run.gibba011.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T19:24:24.746 INFO:teuthology.orchestra.run.gibba018.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T19:24:24.753 INFO:teuthology.orchestra.run.gibba037.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T19:24:24.756 INFO:teuthology.orchestra.run.gibba018.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T19:24:24.756 INFO:teuthology.orchestra.run.gibba018.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T19:24:24.757 INFO:teuthology.orchestra.run.gibba011.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T19:24:24.764 INFO:teuthology.orchestra.run.gibba018.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T19:24:24.764 INFO:teuthology.orchestra.run.gibba018.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T19:24:24.765 INFO:teuthology.orchestra.run.gibba017.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T19:24:24.765 INFO:teuthology.orchestra.run.gibba018.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T19:24:24.767 INFO:teuthology.orchestra.run.gibba031.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T19:24:24.768 INFO:teuthology.orchestra.run.gibba017.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T19:24:24.768 INFO:teuthology.orchestra.run.gibba017.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T19:24:24.770 INFO:teuthology.orchestra.run.gibba031.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T19:24:24.775 INFO:teuthology.orchestra.run.gibba031.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T19:24:24.776 INFO:teuthology.orchestra.run.gibba017.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T19:24:24.777 INFO:teuthology.orchestra.run.gibba031.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T19:24:24.778 INFO:teuthology.orchestra.run.gibba031.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T19:24:24.779 INFO:teuthology.orchestra.run.gibba031.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T19:24:24.781 INFO:teuthology.orchestra.run.gibba031.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T19:24:24.782 INFO:teuthology.orchestra.run.gibba031.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T19:24:24.795 INFO:teuthology.orchestra.run.gibba031.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T19:24:24.796 INFO:teuthology.orchestra.run.gibba037.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T19:24:24.796 INFO:teuthology.orchestra.run.gibba037.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T19:24:24.798 INFO:teuthology.orchestra.run.gibba031.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T19:24:24.808 INFO:teuthology.orchestra.run.gibba011.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T19:24:24.808 INFO:teuthology.orchestra.run.gibba011.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T19:24:24.809 INFO:teuthology.orchestra.run.gibba011.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T19:24:24.821 INFO:teuthology.orchestra.run.gibba018.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T19:24:24.822 INFO:teuthology.orchestra.run.gibba018.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T19:24:24.833 INFO:teuthology.orchestra.run.gibba018.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T19:24:24.846 INFO:teuthology.orchestra.run.gibba018.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T19:24:24.847 INFO:teuthology.orchestra.run.gibba031.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T19:24:24.848 INFO:teuthology.orchestra.run.gibba017.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T19:24:24.848 INFO:teuthology.orchestra.run.gibba031.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T19:24:24.850 INFO:teuthology.orchestra.run.gibba017.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T19:24:24.850 INFO:teuthology.orchestra.run.gibba018.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T19:24:24.851 INFO:teuthology.orchestra.run.gibba017.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T19:24:24.852 INFO:teuthology.orchestra.run.gibba031.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T19:24:24.853 INFO:teuthology.orchestra.run.gibba031.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T19:24:24.854 INFO:teuthology.orchestra.run.gibba017.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T19:24:24.855 INFO:teuthology.orchestra.run.gibba018.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T19:24:24.855 INFO:teuthology.orchestra.run.gibba018.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T19:24:24.858 INFO:teuthology.orchestra.run.gibba017.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T19:24:24.858 INFO:teuthology.orchestra.run.gibba018.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T19:24:24.859 INFO:teuthology.orchestra.run.gibba017.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T19:24:24.863 INFO:teuthology.orchestra.run.gibba018.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T19:24:24.866 INFO:teuthology.orchestra.run.gibba018.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T19:24:24.879 INFO:teuthology.orchestra.run.gibba031.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T19:24:24.879 INFO:teuthology.orchestra.run.gibba017.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T19:24:24.880 INFO:teuthology.orchestra.run.gibba037.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T19:24:24.884 INFO:teuthology.orchestra.run.gibba037.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T19:24:24.889 INFO:teuthology.orchestra.run.gibba037.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T19:24:24.891 INFO:teuthology.orchestra.run.gibba037.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T19:24:24.891 INFO:teuthology.orchestra.run.gibba037.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T19:24:24.892 INFO:teuthology.orchestra.run.gibba037.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T19:24:24.894 INFO:teuthology.orchestra.run.gibba011.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T19:24:24.894 INFO:teuthology.orchestra.run.gibba037.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T19:24:24.896 INFO:teuthology.orchestra.run.gibba037.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T19:24:24.901 INFO:teuthology.orchestra.run.gibba011.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T19:24:24.903 INFO:teuthology.orchestra.run.gibba011.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T19:24:24.904 INFO:teuthology.orchestra.run.gibba011.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T19:24:24.904 INFO:teuthology.orchestra.run.gibba011.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T19:24:24.905 INFO:teuthology.orchestra.run.gibba011.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T19:24:24.905 INFO:teuthology.orchestra.run.gibba011.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T19:24:24.928 INFO:teuthology.orchestra.run.gibba018.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T19:24:24.928 INFO:teuthology.orchestra.run.gibba018.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T19:24:24.929 INFO:teuthology.orchestra.run.gibba017.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T19:24:24.930 INFO:teuthology.orchestra.run.gibba017.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T19:24:24.930 INFO:teuthology.orchestra.run.gibba017.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T19:24:24.962 INFO:teuthology.orchestra.run.gibba037.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T19:24:24.963 INFO:teuthology.orchestra.run.gibba037.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T19:24:24.980 INFO:teuthology.orchestra.run.gibba011.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T19:24:24.981 INFO:teuthology.orchestra.run.gibba011.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T19:24:25.038 INFO:teuthology.orchestra.run.gibba017.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T19:24:25.045 INFO:teuthology.orchestra.run.gibba017.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T19:24:25.047 INFO:teuthology.orchestra.run.gibba017.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T19:24:25.048 INFO:teuthology.orchestra.run.gibba017.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T19:24:25.051 INFO:teuthology.orchestra.run.gibba017.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T19:24:25.053 INFO:teuthology.orchestra.run.gibba017.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T19:24:25.055 INFO:teuthology.orchestra.run.gibba017.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T19:24:25.160 INFO:teuthology.orchestra.run.gibba017.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T19:24:25.161 INFO:teuthology.orchestra.run.gibba017.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T19:24:25.162 INFO:teuthology.orchestra.run.gibba011.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T19:24:25.287 INFO:teuthology.orchestra.run.gibba011.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T19:24:25.309 INFO:teuthology.orchestra.run.gibba018.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T19:24:25.310 INFO:teuthology.orchestra.run.gibba018.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T19:24:25.314 INFO:teuthology.orchestra.run.gibba011.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T19:24:25.334 INFO:teuthology.orchestra.run.gibba031.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T19:24:25.337 INFO:teuthology.orchestra.run.gibba031.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T19:24:25.346 INFO:teuthology.orchestra.run.gibba018.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T19:24:25.380 INFO:teuthology.orchestra.run.gibba031.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T19:24:25.383 INFO:teuthology.orchestra.run.gibba031.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T19:24:25.607 INFO:teuthology.orchestra.run.gibba031.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T19:24:25.608 INFO:teuthology.orchestra.run.gibba031.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T19:24:25.617 INFO:teuthology.orchestra.run.gibba018.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T19:24:25.634 INFO:teuthology.orchestra.run.gibba011.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T19:24:25.641 INFO:teuthology.orchestra.run.gibba037.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T19:24:25.656 INFO:teuthology.orchestra.run.gibba037.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T19:24:25.689 INFO:teuthology.orchestra.run.gibba017.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T19:24:25.690 INFO:teuthology.orchestra.run.gibba031.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T19:24:25.691 INFO:teuthology.orchestra.run.gibba031.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T19:24:25.692 INFO:teuthology.orchestra.run.gibba031.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T19:24:25.693 INFO:teuthology.orchestra.run.gibba031.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T19:24:25.695 INFO:teuthology.orchestra.run.gibba031.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T19:24:25.696 INFO:teuthology.orchestra.run.gibba031.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T19:24:25.697 INFO:teuthology.orchestra.run.gibba031.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T19:24:25.713 INFO:teuthology.orchestra.run.gibba018.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T19:24:25.721 INFO:teuthology.orchestra.run.gibba011.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T19:24:25.728 INFO:teuthology.orchestra.run.gibba018.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T19:24:25.739 INFO:teuthology.orchestra.run.gibba011.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T19:24:25.758 INFO:teuthology.orchestra.run.gibba037.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T19:24:25.761 INFO:teuthology.orchestra.run.gibba037.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T19:24:25.802 INFO:teuthology.orchestra.run.gibba031.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T19:24:25.803 INFO:teuthology.orchestra.run.gibba031.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T19:24:25.868 INFO:teuthology.orchestra.run.gibba018.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T19:24:25.884 INFO:teuthology.orchestra.run.gibba031.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T19:24:25.887 INFO:teuthology.orchestra.run.gibba031.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T19:24:25.888 INFO:teuthology.orchestra.run.gibba031.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T19:24:25.889 INFO:teuthology.orchestra.run.gibba031.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T19:24:25.890 INFO:teuthology.orchestra.run.gibba031.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T19:24:25.893 INFO:teuthology.orchestra.run.gibba017.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T19:24:25.894 INFO:teuthology.orchestra.run.gibba031.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T19:24:25.896 INFO:teuthology.orchestra.run.gibba031.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T19:24:25.897 INFO:teuthology.orchestra.run.gibba011.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T19:24:25.898 INFO:teuthology.orchestra.run.gibba011.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T19:24:25.899 INFO:teuthology.orchestra.run.gibba031.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T19:24:25.900 INFO:teuthology.orchestra.run.gibba011.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T19:24:25.901 INFO:teuthology.orchestra.run.gibba011.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T19:24:25.902 INFO:teuthology.orchestra.run.gibba011.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T19:24:25.903 INFO:teuthology.orchestra.run.gibba011.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T19:24:25.904 INFO:teuthology.orchestra.run.gibba011.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T19:24:25.907 INFO:teuthology.orchestra.run.gibba011.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T19:24:25.908 INFO:teuthology.orchestra.run.gibba011.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T19:24:25.920 INFO:teuthology.orchestra.run.gibba037.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T19:24:25.920 INFO:teuthology.orchestra.run.gibba037.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T19:24:25.921 INFO:teuthology.orchestra.run.gibba037.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T19:24:25.922 INFO:teuthology.orchestra.run.gibba037.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T19:24:25.922 INFO:teuthology.orchestra.run.gibba037.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T19:24:25.922 INFO:teuthology.orchestra.run.gibba037.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T19:24:25.922 INFO:teuthology.orchestra.run.gibba037.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T19:24:25.923 INFO:teuthology.orchestra.run.gibba037.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T19:24:25.928 INFO:teuthology.orchestra.run.gibba037.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T19:24:25.939 INFO:teuthology.orchestra.run.gibba037.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T19:24:25.941 INFO:teuthology.orchestra.run.gibba018.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T19:24:25.941 INFO:teuthology.orchestra.run.gibba037.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T19:24:25.942 INFO:teuthology.orchestra.run.gibba037.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T19:24:25.942 INFO:teuthology.orchestra.run.gibba018.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T19:24:25.943 INFO:teuthology.orchestra.run.gibba037.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T19:24:25.943 INFO:teuthology.orchestra.run.gibba037.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T19:24:25.944 INFO:teuthology.orchestra.run.gibba018.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T19:24:25.945 INFO:teuthology.orchestra.run.gibba018.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T19:24:25.946 INFO:teuthology.orchestra.run.gibba017.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T19:24:25.946 INFO:teuthology.orchestra.run.gibba018.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T19:24:25.947 INFO:teuthology.orchestra.run.gibba018.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T19:24:25.950 INFO:teuthology.orchestra.run.gibba018.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T19:24:25.950 INFO:teuthology.orchestra.run.gibba017.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T19:24:25.951 INFO:teuthology.orchestra.run.gibba018.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T19:24:25.952 INFO:teuthology.orchestra.run.gibba017.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T19:24:25.962 INFO:teuthology.orchestra.run.gibba017.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T19:24:25.964 INFO:teuthology.orchestra.run.gibba017.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T19:24:25.966 INFO:teuthology.orchestra.run.gibba031.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T19:24:25.975 INFO:teuthology.orchestra.run.gibba031.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T19:24:25.982 INFO:teuthology.orchestra.run.gibba011.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T19:24:25.992 INFO:teuthology.orchestra.run.gibba011.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T19:24:25.995 INFO:teuthology.orchestra.run.gibba011.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T19:24:25.995 INFO:teuthology.orchestra.run.gibba011.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T19:24:25.996 INFO:teuthology.orchestra.run.gibba011.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T19:24:25.999 INFO:teuthology.orchestra.run.gibba017.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T19:24:26.000 INFO:teuthology.orchestra.run.gibba011.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T19:24:26.002 INFO:teuthology.orchestra.run.gibba011.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T19:24:26.005 INFO:teuthology.orchestra.run.gibba011.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T19:24:26.006 INFO:teuthology.orchestra.run.gibba011.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T19:24:26.006 INFO:teuthology.orchestra.run.gibba037.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T19:24:26.014 INFO:teuthology.orchestra.run.gibba037.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T19:24:26.018 INFO:teuthology.orchestra.run.gibba037.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T19:24:26.020 INFO:teuthology.orchestra.run.gibba037.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T19:24:26.021 INFO:teuthology.orchestra.run.gibba037.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T19:24:26.023 INFO:teuthology.orchestra.run.gibba037.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T19:24:26.023 INFO:teuthology.orchestra.run.gibba037.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T19:24:26.025 INFO:teuthology.orchestra.run.gibba037.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T19:24:26.025 INFO:teuthology.orchestra.run.gibba037.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T19:24:26.026 INFO:teuthology.orchestra.run.gibba018.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T19:24:26.027 INFO:teuthology.orchestra.run.gibba017.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T19:24:26.030 INFO:teuthology.orchestra.run.gibba037.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T19:24:26.041 INFO:teuthology.orchestra.run.gibba018.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T19:24:26.042 INFO:teuthology.orchestra.run.gibba017.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T19:24:26.043 INFO:teuthology.orchestra.run.gibba017.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T19:24:26.043 INFO:teuthology.orchestra.run.gibba017.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T19:24:26.043 INFO:teuthology.orchestra.run.gibba017.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T19:24:26.043 INFO:teuthology.orchestra.run.gibba017.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T19:24:26.044 INFO:teuthology.orchestra.run.gibba017.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T19:24:26.044 INFO:teuthology.orchestra.run.gibba017.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T19:24:26.044 INFO:teuthology.orchestra.run.gibba018.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T19:24:26.048 INFO:teuthology.orchestra.run.gibba031.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T19:24:26.049 INFO:teuthology.orchestra.run.gibba018.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T19:24:26.050 INFO:teuthology.orchestra.run.gibba031.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T19:24:26.050 INFO:teuthology.orchestra.run.gibba031.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T19:24:26.051 INFO:teuthology.orchestra.run.gibba018.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T19:24:26.052 INFO:teuthology.orchestra.run.gibba031.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T19:24:26.062 INFO:teuthology.orchestra.run.gibba017.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T19:24:26.063 INFO:teuthology.orchestra.run.gibba017.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T19:24:26.064 INFO:teuthology.orchestra.run.gibba018.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T19:24:26.068 INFO:teuthology.orchestra.run.gibba011.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T19:24:26.069 INFO:teuthology.orchestra.run.gibba031.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T19:24:26.069 INFO:teuthology.orchestra.run.gibba031.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T19:24:26.070 INFO:teuthology.orchestra.run.gibba031.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T19:24:26.070 INFO:teuthology.orchestra.run.gibba031.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T19:24:26.072 INFO:teuthology.orchestra.run.gibba018.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T19:24:26.079 INFO:teuthology.orchestra.run.gibba018.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T19:24:26.080 INFO:teuthology.orchestra.run.gibba018.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T19:24:26.095 INFO:teuthology.orchestra.run.gibba011.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T19:24:26.097 INFO:teuthology.orchestra.run.gibba011.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T19:24:26.097 INFO:teuthology.orchestra.run.gibba011.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T19:24:26.098 INFO:teuthology.orchestra.run.gibba011.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T19:24:26.098 INFO:teuthology.orchestra.run.gibba037.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T19:24:26.108 INFO:teuthology.orchestra.run.gibba018.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T19:24:26.111 INFO:teuthology.orchestra.run.gibba037.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T19:24:26.112 INFO:teuthology.orchestra.run.gibba037.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T19:24:26.113 INFO:teuthology.orchestra.run.gibba037.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T19:24:26.114 INFO:teuthology.orchestra.run.gibba037.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T19:24:26.116 INFO:teuthology.orchestra.run.gibba017.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T19:24:26.118 INFO:teuthology.orchestra.run.gibba011.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T19:24:26.119 INFO:teuthology.orchestra.run.gibba011.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T19:24:26.120 INFO:teuthology.orchestra.run.gibba011.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T19:24:26.121 INFO:teuthology.orchestra.run.gibba011.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T19:24:26.135 INFO:teuthology.orchestra.run.gibba037.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T19:24:26.136 INFO:teuthology.orchestra.run.gibba037.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T19:24:26.136 INFO:teuthology.orchestra.run.gibba037.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T19:24:26.137 INFO:teuthology.orchestra.run.gibba031.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T19:24:26.137 INFO:teuthology.orchestra.run.gibba037.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T19:24:26.138 INFO:teuthology.orchestra.run.gibba031.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T19:24:26.145 INFO:teuthology.orchestra.run.gibba017.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T19:24:26.150 INFO:teuthology.orchestra.run.gibba011.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T19:24:26.152 INFO:teuthology.orchestra.run.gibba017.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T19:24:26.156 INFO:teuthology.orchestra.run.gibba017.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T19:24:26.160 INFO:teuthology.orchestra.run.gibba017.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T19:24:26.163 INFO:teuthology.orchestra.run.gibba017.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T19:24:26.170 INFO:teuthology.orchestra.run.gibba017.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T19:24:26.175 INFO:teuthology.orchestra.run.gibba017.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T19:24:26.175 INFO:teuthology.orchestra.run.gibba018.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T19:24:26.176 INFO:teuthology.orchestra.run.gibba018.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T19:24:26.176 INFO:teuthology.orchestra.run.gibba018.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T19:24:26.179 INFO:teuthology.orchestra.run.gibba018.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T19:24:26.181 INFO:teuthology.orchestra.run.gibba017.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T19:24:26.181 INFO:teuthology.orchestra.run.gibba037.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T19:24:26.219 INFO:teuthology.orchestra.run.gibba031.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T19:24:26.223 INFO:teuthology.orchestra.run.gibba031.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T19:24:26.227 INFO:teuthology.orchestra.run.gibba017.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T19:24:26.233 INFO:teuthology.orchestra.run.gibba011.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T19:24:26.234 INFO:teuthology.orchestra.run.gibba011.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T19:24:26.236 INFO:teuthology.orchestra.run.gibba017.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T19:24:26.238 INFO:teuthology.orchestra.run.gibba011.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T19:24:26.239 INFO:teuthology.orchestra.run.gibba018.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T19:24:26.240 INFO:teuthology.orchestra.run.gibba018.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T19:24:26.242 INFO:teuthology.orchestra.run.gibba018.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T19:24:26.243 INFO:teuthology.orchestra.run.gibba018.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T19:24:26.250 INFO:teuthology.orchestra.run.gibba018.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T19:24:26.263 INFO:teuthology.orchestra.run.gibba037.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T19:24:26.263 INFO:teuthology.orchestra.run.gibba037.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T19:24:26.265 INFO:teuthology.orchestra.run.gibba037.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T19:24:26.275 INFO:teuthology.orchestra.run.gibba018.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T19:24:26.275 INFO:teuthology.orchestra.run.gibba018.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T19:24:26.282 INFO:teuthology.orchestra.run.gibba018.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T19:24:26.309 INFO:teuthology.orchestra.run.gibba017.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T19:24:26.310 INFO:teuthology.orchestra.run.gibba017.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T19:24:26.312 INFO:teuthology.orchestra.run.gibba017.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T19:24:26.314 INFO:teuthology.orchestra.run.gibba017.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T19:24:26.351 INFO:teuthology.orchestra.run.gibba017.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T19:24:26.352 INFO:teuthology.orchestra.run.gibba017.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T19:24:26.352 INFO:teuthology.orchestra.run.gibba017.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T19:24:26.352 INFO:teuthology.orchestra.run.gibba017.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T19:24:26.391 INFO:teuthology.orchestra.run.gibba017.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T19:24:26.392 INFO:teuthology.orchestra.run.gibba017.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T19:24:26.474 INFO:teuthology.orchestra.run.gibba017.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T19:24:26.478 INFO:teuthology.orchestra.run.gibba017.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T19:24:26.940 INFO:teuthology.orchestra.run.gibba037.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T19:24:26.979 INFO:teuthology.orchestra.run.gibba037.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T19:24:27.014 INFO:teuthology.orchestra.run.gibba017.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T19:24:27.050 INFO:teuthology.orchestra.run.gibba017.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T19:24:27.071 INFO:teuthology.orchestra.run.gibba037.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T19:24:27.152 INFO:teuthology.orchestra.run.gibba017.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T19:24:27.722 INFO:teuthology.orchestra.run.gibba011.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T19:24:28.029 INFO:teuthology.orchestra.run.gibba018.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T19:24:28.294 INFO:teuthology.orchestra.run.gibba011.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T19:24:28.305 INFO:teuthology.orchestra.run.gibba011.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T19:24:28.340 INFO:teuthology.orchestra.run.gibba031.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T19:24:28.491 INFO:teuthology.orchestra.run.gibba011.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T19:24:28.652 INFO:teuthology.orchestra.run.gibba018.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T19:24:28.683 INFO:teuthology.orchestra.run.gibba018.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T19:24:28.862 INFO:teuthology.orchestra.run.gibba018.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T19:24:29.039 INFO:teuthology.orchestra.run.gibba031.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T19:24:29.060 INFO:teuthology.orchestra.run.gibba031.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T19:24:29.232 INFO:teuthology.orchestra.run.gibba011.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T19:24:29.255 INFO:teuthology.orchestra.run.gibba031.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T19:24:29.654 INFO:teuthology.orchestra.run.gibba018.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T19:24:30.158 INFO:teuthology.orchestra.run.gibba031.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T19:24:32.228 INFO:teuthology.orchestra.run.gibba037.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T19:24:32.331 INFO:teuthology.orchestra.run.gibba011.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T19:24:32.332 INFO:teuthology.orchestra.run.gibba011.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T19:24:32.347 INFO:teuthology.orchestra.run.gibba011.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T19:24:32.404 INFO:teuthology.orchestra.run.gibba017.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T19:24:32.590 INFO:teuthology.orchestra.run.gibba011.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T19:24:32.593 INFO:teuthology.orchestra.run.gibba011.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T19:24:32.597 INFO:teuthology.orchestra.run.gibba011.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T19:24:32.918 INFO:teuthology.orchestra.run.gibba018.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T19:24:32.919 INFO:teuthology.orchestra.run.gibba018.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T19:24:32.934 INFO:teuthology.orchestra.run.gibba018.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T19:24:32.986 INFO:teuthology.orchestra.run.gibba011.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T19:24:32.988 INFO:teuthology.orchestra.run.gibba011.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T19:24:33.184 INFO:teuthology.orchestra.run.gibba018.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T19:24:33.200 INFO:teuthology.orchestra.run.gibba018.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T19:24:33.204 INFO:teuthology.orchestra.run.gibba018.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T19:24:33.400 INFO:teuthology.orchestra.run.gibba037.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T19:24:33.433 INFO:teuthology.orchestra.run.gibba037.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T19:24:33.605 INFO:teuthology.orchestra.run.gibba017.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T19:24:33.632 INFO:teuthology.orchestra.run.gibba018.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T19:24:33.633 INFO:teuthology.orchestra.run.gibba018.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T19:24:33.649 INFO:teuthology.orchestra.run.gibba017.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T19:24:33.696 INFO:teuthology.orchestra.run.gibba031.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T19:24:33.697 INFO:teuthology.orchestra.run.gibba031.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T19:24:33.746 INFO:teuthology.orchestra.run.gibba031.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T19:24:33.762 INFO:teuthology.orchestra.run.gibba037.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T19:24:33.975 INFO:teuthology.orchestra.run.gibba017.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T19:24:34.002 INFO:teuthology.orchestra.run.gibba011.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T19:24:34.003 INFO:teuthology.orchestra.run.gibba011.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T19:24:34.034 INFO:teuthology.orchestra.run.gibba031.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T19:24:34.037 INFO:teuthology.orchestra.run.gibba031.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T19:24:34.040 INFO:teuthology.orchestra.run.gibba031.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T19:24:34.524 INFO:teuthology.orchestra.run.gibba031.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T19:24:34.527 INFO:teuthology.orchestra.run.gibba031.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T19:24:34.698 INFO:teuthology.orchestra.run.gibba018.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T19:24:34.699 INFO:teuthology.orchestra.run.gibba018.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T19:24:35.173 INFO:teuthology.orchestra.run.gibba037.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T19:24:35.430 INFO:teuthology.orchestra.run.gibba017.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T19:24:35.699 INFO:teuthology.orchestra.run.gibba031.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T19:24:35.700 INFO:teuthology.orchestra.run.gibba031.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T19:24:39.667 INFO:teuthology.orchestra.run.gibba011.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T19:24:39.668 INFO:teuthology.orchestra.run.gibba011.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T19:24:39.668 INFO:teuthology.orchestra.run.gibba011.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T19:24:39.795 INFO:teuthology.orchestra.run.gibba037.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T19:24:39.797 INFO:teuthology.orchestra.run.gibba037.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T19:24:39.845 INFO:teuthology.orchestra.run.gibba037.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T19:24:40.168 INFO:teuthology.orchestra.run.gibba017.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T19:24:40.169 INFO:teuthology.orchestra.run.gibba017.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T19:24:40.179 INFO:teuthology.orchestra.run.gibba037.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T19:24:40.186 INFO:teuthology.orchestra.run.gibba017.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T19:24:40.189 INFO:teuthology.orchestra.run.gibba037.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T19:24:40.192 INFO:teuthology.orchestra.run.gibba037.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T19:24:40.529 INFO:teuthology.orchestra.run.gibba017.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T19:24:40.535 INFO:teuthology.orchestra.run.gibba017.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T19:24:40.567 INFO:teuthology.orchestra.run.gibba017.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T19:24:40.723 INFO:teuthology.orchestra.run.gibba018.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T19:24:40.723 INFO:teuthology.orchestra.run.gibba018.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T19:24:40.724 INFO:teuthology.orchestra.run.gibba018.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T19:24:40.755 INFO:teuthology.orchestra.run.gibba037.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T19:24:40.756 INFO:teuthology.orchestra.run.gibba037.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T19:24:41.028 INFO:teuthology.orchestra.run.gibba011.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T19:24:41.109 INFO:teuthology.orchestra.run.gibba017.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T19:24:41.112 INFO:teuthology.orchestra.run.gibba017.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T19:24:41.389 INFO:teuthology.orchestra.run.gibba011.stdout:Fetched 153 MB in 17s (8,851 kB/s) 2021-11-15T19:24:41.550 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T19:24:41.622 INFO:teuthology.orchestra.run.gibba011.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T19:24:41.625 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T19:24:41.665 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T19:24:41.883 INFO:teuthology.orchestra.run.gibba037.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T19:24:41.884 INFO:teuthology.orchestra.run.gibba037.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T19:24:41.919 INFO:teuthology.orchestra.run.gibba018.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T19:24:41.959 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T19:24:41.991 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T19:24:42.002 INFO:teuthology.orchestra.run.gibba031.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T19:24:42.003 INFO:teuthology.orchestra.run.gibba031.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T19:24:42.004 INFO:teuthology.orchestra.run.gibba031.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T19:24:42.033 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:24:42.108 INFO:teuthology.orchestra.run.gibba017.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T19:24:42.108 INFO:teuthology.orchestra.run.gibba017.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T19:24:42.237 INFO:teuthology.orchestra.run.gibba018.stdout:Fetched 153 MB in 18s (8,445 kB/s) 2021-11-15T19:24:42.329 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T19:24:42.339 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T19:24:42.366 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T19:24:42.378 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:24:42.440 INFO:teuthology.orchestra.run.gibba018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T19:24:42.444 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T19:24:42.488 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T19:24:42.723 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T19:24:42.754 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T19:24:42.800 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T19:24:42.812 INFO:teuthology.orchestra.run.gibba031.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T19:24:42.832 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T19:24:42.839 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:24:42.875 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:24:43.131 INFO:teuthology.orchestra.run.gibba031.stdout:Fetched 153 MB in 19s (8,016 kB/s) 2021-11-15T19:24:43.177 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T19:24:43.186 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:43.187 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T19:24:43.218 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:24:43.280 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T19:24:43.315 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:43.352 INFO:teuthology.orchestra.run.gibba031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T19:24:43.355 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T19:24:43.394 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T19:24:43.547 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T19:24:43.579 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T19:24:43.663 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:24:43.673 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T19:24:43.704 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T19:24:43.765 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:24:43.820 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:43.947 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:44.002 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:44.017 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T19:24:44.049 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T19:24:44.084 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:24:44.150 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:44.453 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T19:24:44.461 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T19:24:44.517 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T19:24:44.548 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:44.574 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:24:44.583 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:44.631 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:44.738 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:44.877 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-rados. 2021-11-15T19:24:44.886 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:44.926 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:44.932 INFO:teuthology.orchestra.run.gibba037.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T19:24:44.933 INFO:teuthology.orchestra.run.gibba037.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T19:24:44.933 INFO:teuthology.orchestra.run.gibba037.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T19:24:45.080 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:45.182 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:45.269 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T19:24:45.301 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:45.310 INFO:teuthology.orchestra.run.gibba017.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T19:24:45.311 INFO:teuthology.orchestra.run.gibba017.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T19:24:45.312 INFO:teuthology.orchestra.run.gibba017.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T19:24:45.325 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T19:24:45.336 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:45.344 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:45.374 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:45.501 INFO:teuthology.orchestra.run.gibba037.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T19:24:45.671 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T19:24:45.676 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-rados. 2021-11-15T19:24:45.681 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:45.701 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:45.709 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:45.720 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:45.751 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:45.831 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 153 MB in 22s (7,059 kB/s) 2021-11-15T19:24:45.853 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:45.940 INFO:teuthology.orchestra.run.gibba017.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T19:24:45.961 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T19:24:45.999 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T19:24:46.031 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:46.032 INFO:teuthology.orchestra.run.gibba037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T19:24:46.036 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T19:24:46.065 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.076 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T19:24:46.103 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T19:24:46.113 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:46.152 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.255 INFO:teuthology.orchestra.run.gibba017.stdout:Fetched 153 MB in 22s (6,960 kB/s) 2021-11-15T19:24:46.368 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T19:24:46.400 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T19:24:46.415 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T19:24:46.420 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T19:24:46.435 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T19:24:46.452 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T19:24:46.473 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T19:24:46.480 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T19:24:46.483 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:46.488 INFO:teuthology.orchestra.run.gibba017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T19:24:46.491 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T19:24:46.495 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:24:46.511 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:46.523 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.529 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T19:24:46.548 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.695 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T19:24:46.727 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:46.770 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.776 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-rados. 2021-11-15T19:24:46.798 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T19:24:46.806 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:46.807 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T19:24:46.808 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T19:24:46.840 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:46.848 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:24:46.850 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.866 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T19:24:46.874 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:46.876 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T19:24:46.916 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:24:47.156 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T19:24:47.166 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T19:24:47.168 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T19:24:47.179 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T19:24:47.195 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T19:24:47.202 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T19:24:47.204 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:47.205 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:24:47.218 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T19:24:47.218 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T19:24:47.234 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T19:24:47.244 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:47.250 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T19:24:47.285 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:24:47.359 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:24:47.492 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T19:24:47.520 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T19:24:47.524 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T19:24:47.553 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:47.555 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T19:24:47.558 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:24:47.571 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T19:24:47.587 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:47.595 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:47.603 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T19:24:47.630 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:47.692 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:24:47.731 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:47.854 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:47.924 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package librgw2. 2021-11-15T19:24:47.933 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:47.973 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T19:24:47.973 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:47.983 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T19:24:47.990 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T19:24:48.001 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:48.022 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:24:48.034 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:48.040 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:48.200 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:48.276 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T19:24:48.307 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T19:24:48.342 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:24:48.349 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T19:24:48.358 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:48.381 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T19:24:48.410 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T19:24:48.418 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T19:24:48.441 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:48.476 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:48.492 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:48.638 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T19:24:48.667 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:48.677 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package librgw2. 2021-11-15T19:24:48.687 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:48.704 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:48.727 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:48.830 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T19:24:48.839 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T19:24:48.879 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:24:48.952 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.054 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T19:24:49.137 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T19:24:49.140 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T19:24:49.146 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.148 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T19:24:49.186 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:49.189 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:24:49.213 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T19:24:49.223 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package liboath0. 2021-11-15T19:24:49.245 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.255 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T19:24:49.288 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:49.331 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T19:24:49.497 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-rados. 2021-11-15T19:24:49.529 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.551 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T19:24:49.572 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:49.581 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T19:24:49.617 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T19:24:49.625 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:24:49.628 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.649 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T19:24:49.658 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T19:24:49.666 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T19:24:49.667 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:49.690 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:24:49.699 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.741 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:49.900 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T19:24:49.908 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:49.941 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:49.954 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package librgw2. 2021-11-15T19:24:49.960 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package liboath0. 2021-11-15T19:24:49.963 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:49.991 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T19:24:50.003 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.025 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T19:24:50.045 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-common. 2021-11-15T19:24:50.052 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:50.068 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-rados. 2021-11-15T19:24:50.076 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:50.118 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.120 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.234 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T19:24:50.265 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:50.308 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.313 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T19:24:50.323 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:50.362 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.479 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T19:24:50.511 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:50.523 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T19:24:50.554 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:50.555 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.589 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.612 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T19:24:50.643 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:50.678 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:50.814 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T19:24:50.824 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:50.863 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:51.007 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-common. 2021-11-15T19:24:51.016 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:51.022 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T19:24:51.032 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T19:24:51.056 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:51.069 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T19:24:51.072 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T19:24:51.080 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T19:24:51.175 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:24:51.183 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T19:24:51.215 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:51.249 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:51.366 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T19:24:51.398 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:51.441 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:51.511 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package liboath0. 2021-11-15T19:24:51.543 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T19:24:51.578 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T19:24:51.603 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T19:24:51.613 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T19:24:51.652 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T19:24:51.831 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T19:24:51.843 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T19:24:51.854 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T19:24:51.861 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:51.893 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:24:51.897 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:51.947 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T19:24:51.979 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:52.021 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:52.167 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-base. 2021-11-15T19:24:52.177 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:52.180 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T19:24:52.211 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T19:24:52.221 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:52.246 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:24:52.322 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-common. 2021-11-15T19:24:52.331 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:52.349 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T19:24:52.359 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T19:24:52.370 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:52.432 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:24:52.616 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package librgw2. 2021-11-15T19:24:52.623 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:52.663 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:52.711 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T19:24:52.743 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T19:24:52.777 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:24:52.783 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-base. 2021-11-15T19:24:52.816 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:52.905 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:53.013 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T19:24:53.045 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T19:24:53.088 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:24:53.147 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package librgw2. 2021-11-15T19:24:53.155 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:53.174 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T19:24:53.191 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:53.206 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:53.249 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:53.467 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T19:24:53.477 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T19:24:53.516 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T19:24:53.569 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T19:24:53.580 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T19:24:53.618 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:24:53.644 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T19:24:53.663 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T19:24:53.676 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:53.694 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T19:24:53.711 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:53.737 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:24:53.761 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T19:24:53.792 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:53.835 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:54.118 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-base. 2021-11-15T19:24:54.128 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:54.171 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:54.206 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T19:24:54.216 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T19:24:54.256 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:24:54.275 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T19:24:54.284 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T19:24:54.324 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T19:24:54.506 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T19:24:54.538 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T19:24:54.563 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package liboath0. 2021-11-15T19:24:54.572 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:24:54.585 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T19:24:54.595 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T19:24:54.597 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T19:24:54.617 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:54.629 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T19:24:54.630 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T19:24:54.652 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:54.672 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:24:54.884 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T19:24:54.916 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T19:24:54.950 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:24:54.982 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T19:24:54.983 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T19:24:54.992 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:54.993 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T19:24:55.006 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T19:24:55.014 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T19:24:55.031 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:55.049 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:24:55.058 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package liboath0. 2021-11-15T19:24:55.068 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T19:24:55.081 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:24:55.107 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T19:24:55.203 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T19:24:55.235 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T19:24:55.270 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T19:24:55.411 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T19:24:55.437 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T19:24:55.442 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:55.466 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T19:24:55.477 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:55.478 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-common. 2021-11-15T19:24:55.486 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:55.503 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T19:24:55.553 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T19:24:55.560 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:55.563 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T19:24:55.572 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T19:24:55.582 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T19:24:55.621 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:24:55.806 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T19:24:55.816 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:55.854 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:55.931 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-common. 2021-11-15T19:24:55.940 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:55.958 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-mako. 2021-11-15T19:24:55.963 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:24:55.979 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:55.989 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T19:24:56.033 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:24:56.209 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T19:24:56.239 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T19:24:56.275 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:24:56.345 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T19:24:56.354 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T19:24:56.386 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:24:56.681 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T19:24:56.687 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T19:24:56.712 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T19:24:56.718 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T19:24:56.755 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:24:56.761 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:24:57.056 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T19:24:57.087 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T19:24:57.130 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T19:24:57.162 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T19:24:57.193 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T19:24:57.237 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:24:57.301 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-base. 2021-11-15T19:24:57.333 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:57.389 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:57.492 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T19:24:57.502 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T19:24:57.541 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:24:57.583 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T19:24:57.593 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T19:24:57.649 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-webob. 2021-11-15T19:24:57.651 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:24:57.659 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T19:24:57.698 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T19:24:57.781 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-base. 2021-11-15T19:24:57.810 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:24:57.836 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-mako. 2021-11-15T19:24:57.861 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:57.868 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T19:24:57.911 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:24:57.970 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T19:24:58.000 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T19:24:58.027 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T19:24:58.044 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T19:24:58.059 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T19:24:58.135 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:24:58.172 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T19:24:58.204 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T19:24:58.231 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T19:24:58.240 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T19:24:58.272 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:24:58.280 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:24:58.398 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T19:24:58.408 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T19:24:58.447 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:24:58.455 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T19:24:58.465 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T19:24:58.504 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T19:24:58.575 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T19:24:58.607 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T19:24:58.620 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T19:24:58.627 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T19:24:58.650 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T19:24:58.652 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T19:24:58.656 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T19:24:58.693 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:24:58.695 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:24:58.775 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-mako. 2021-11-15T19:24:58.808 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T19:24:58.850 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:24:58.903 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T19:24:58.934 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:58.941 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T19:24:58.951 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T19:24:58.992 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T19:24:59.000 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:59.006 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-webob. 2021-11-15T19:24:59.038 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T19:24:59.081 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T19:24:59.096 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T19:24:59.104 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T19:24:59.146 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T19:24:59.161 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T19:24:59.171 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T19:24:59.236 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:24:59.310 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T19:24:59.340 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T19:24:59.341 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T19:24:59.350 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T19:24:59.382 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T19:24:59.385 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T19:24:59.392 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T19:24:59.412 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:24:59.414 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:24:59.424 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T19:24:59.469 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:24:59.475 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:24:59.531 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T19:24:59.563 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T19:24:59.606 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:24:59.738 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-paste. 2021-11-15T19:24:59.747 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T19:24:59.794 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T19:24:59.796 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:24:59.820 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T19:24:59.826 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T19:24:59.851 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T19:24:59.869 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T19:24:59.894 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:24:59.951 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-webob. 2021-11-15T19:24:59.961 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T19:25:00.008 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:00.066 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T19:25:00.071 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T19:25:00.084 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T19:25:00.092 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T19:25:00.124 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:00.129 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:00.181 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T19:25:00.212 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T19:25:00.230 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T19:25:00.239 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T19:25:00.251 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T19:25:00.279 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:00.379 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T19:25:00.411 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T19:25:00.440 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T19:25:00.450 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T19:25:00.454 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:00.461 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T19:25:00.493 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T19:25:00.508 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:00.536 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:00.584 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T19:25:00.594 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T19:25:00.633 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T19:25:00.633 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T19:25:00.664 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T19:25:00.708 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:00.798 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T19:25:00.809 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T19:25:00.827 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T19:25:00.848 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:00.858 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T19:25:00.873 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T19:25:00.883 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T19:25:00.902 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T19:25:00.903 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-paste. 2021-11-15T19:25:00.922 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T19:25:00.935 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T19:25:00.969 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:01.036 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T19:25:01.067 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T19:25:01.102 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T19:25:01.221 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T19:25:01.232 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T19:25:01.234 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T19:25:01.242 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T19:25:01.267 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T19:25:01.274 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T19:25:01.297 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T19:25:01.303 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:01.313 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T19:25:01.316 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:01.329 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T19:25:01.363 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:01.464 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T19:25:01.473 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T19:25:01.513 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:01.599 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T19:25:01.617 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T19:25:01.631 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T19:25:01.647 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T19:25:01.648 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T19:25:01.657 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T19:25:01.674 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:01.677 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-mako. 2021-11-15T19:25:01.686 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T19:25:01.691 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:01.704 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T19:25:01.746 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:01.858 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-mako. 2021-11-15T19:25:01.890 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T19:25:01.933 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:01.968 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T19:25:02.000 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T19:25:02.041 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-paste. 2021-11-15T19:25:02.043 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T19:25:02.073 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T19:25:02.073 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T19:25:02.105 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T19:25:02.107 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:02.112 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T19:25:02.122 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:02.169 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:02.172 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:02.253 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T19:25:02.285 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T19:25:02.354 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T19:25:02.361 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:02.386 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T19:25:02.428 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:02.435 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T19:25:02.445 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T19:25:02.484 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:02.492 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T19:25:02.501 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T19:25:02.566 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:02.623 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T19:25:02.632 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:02.672 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:02.673 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T19:25:02.681 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T19:25:02.726 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:02.750 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T19:25:02.782 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T19:25:02.816 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:02.829 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T19:25:02.862 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T19:25:02.900 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-webob. 2021-11-15T19:25:02.904 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:02.933 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T19:25:02.976 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:03.071 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-webob. 2021-11-15T19:25:03.103 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T19:25:03.145 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:03.190 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T19:25:03.195 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T19:25:03.204 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:03.222 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T19:25:03.244 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:03.256 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T19:25:03.346 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T19:25:03.356 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T19:25:03.395 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:03.541 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T19:25:03.542 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T19:25:03.551 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T19:25:03.552 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:03.590 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:03.591 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:03.593 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T19:25:03.603 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T19:25:03.642 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:03.673 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T19:25:03.705 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:03.748 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:03.765 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T19:25:03.797 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T19:25:03.840 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:03.960 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T19:25:03.992 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T19:25:04.005 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T19:25:04.035 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:04.036 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T19:25:04.080 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:04.294 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T19:25:04.304 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T19:25:04.344 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T19:25:04.450 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T19:25:04.460 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:04.463 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T19:25:04.472 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T19:25:04.499 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:04.514 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T19:25:04.643 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T19:25:04.663 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T19:25:04.674 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:04.695 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T19:25:04.717 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:04.729 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T19:25:04.842 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T19:25:04.873 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T19:25:04.916 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T19:25:04.946 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T19:25:04.955 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:04.995 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:05.082 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-paste. 2021-11-15T19:25:05.092 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T19:25:05.131 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:05.236 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-paste. 2021-11-15T19:25:05.267 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T19:25:05.302 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:05.435 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T19:25:05.467 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T19:25:05.501 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:05.581 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph. 2021-11-15T19:25:05.590 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:05.630 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:05.652 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T19:25:05.662 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T19:25:05.701 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:05.845 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T19:25:05.855 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T19:25:05.890 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T19:25:05.895 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:05.899 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:05.939 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:05.958 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T19:25:05.989 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:06.038 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T19:25:06.056 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:06.070 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T19:25:06.112 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:06.232 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T19:25:06.264 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T19:25:06.307 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T19:25:06.433 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T19:25:06.440 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T19:25:06.443 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T19:25:06.454 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:06.492 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:06.507 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T19:25:06.651 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T19:25:06.660 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T19:25:06.664 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph. 2021-11-15T19:25:06.696 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:06.708 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:06.739 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:06.827 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T19:25:06.858 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T19:25:06.901 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:06.971 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package cephadm. 2021-11-15T19:25:06.981 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:07.029 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:07.063 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T19:25:07.075 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T19:25:07.084 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:07.095 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T19:25:07.158 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:07.171 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:07.264 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T19:25:07.273 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T19:25:07.313 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:07.340 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T19:25:07.372 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T19:25:07.415 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:07.544 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T19:25:07.576 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:07.583 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T19:25:07.593 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:07.619 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:07.641 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:07.693 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T19:25:07.724 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:07.751 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T19:25:07.761 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:07.767 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:07.800 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.004 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph. 2021-11-15T19:25:08.035 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:08.078 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.088 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package cephadm. 2021-11-15T19:25:08.098 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:08.103 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T19:25:08.120 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T19:25:08.129 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:08.135 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T19:25:08.138 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.168 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.178 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:08.221 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T19:25:08.229 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:08.270 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.440 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T19:25:08.449 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:08.473 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T19:25:08.483 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T19:25:08.497 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.504 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T19:25:08.515 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T19:25:08.547 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:08.558 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:08.833 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T19:25:08.843 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T19:25:08.869 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T19:25:08.875 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T19:25:08.882 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:08.901 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:08.907 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:08.943 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:08.950 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:09.131 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T19:25:09.163 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:09.199 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T19:25:09.205 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:09.224 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-routes. 2021-11-15T19:25:09.230 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:09.256 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T19:25:09.271 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T19:25:09.296 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:09.301 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T19:25:09.303 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T19:25:09.362 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:09.395 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package cephadm. 2021-11-15T19:25:09.405 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:09.469 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:09.630 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T19:25:09.632 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T19:25:09.639 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:09.664 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T19:25:09.687 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:09.707 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:09.789 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T19:25:09.821 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T19:25:09.864 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:10.001 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T19:25:10.010 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T19:25:10.050 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:10.208 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T19:25:10.240 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:10.283 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:10.295 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-routes. 2021-11-15T19:25:10.305 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T19:25:10.344 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T19:25:10.410 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T19:25:10.419 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:10.459 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:10.619 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T19:25:10.629 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T19:25:10.677 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:10.697 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T19:25:10.729 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:10.763 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T19:25:10.772 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:10.795 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T19:25:10.862 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:10.989 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T19:25:11.021 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T19:25:11.064 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:11.166 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T19:25:11.176 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T19:25:11.215 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:11.261 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph. 2021-11-15T19:25:11.271 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:11.304 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph. 2021-11-15T19:25:11.319 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:11.333 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T19:25:11.335 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:11.365 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T19:25:11.379 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:11.407 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:11.518 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T19:25:11.550 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T19:25:11.562 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T19:25:11.573 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:11.618 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:11.620 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:11.663 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T19:25:11.696 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:11.715 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T19:25:11.722 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:11.730 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:11.743 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-routes. 2021-11-15T19:25:11.764 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:11.776 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T19:25:11.818 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T19:25:11.956 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T19:25:11.989 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T19:25:12.031 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:12.141 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T19:25:12.151 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:12.168 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T19:25:12.179 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T19:25:12.189 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:12.199 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:12.213 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:12.229 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:12.242 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:12.351 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T19:25:12.361 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T19:25:12.400 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:12.576 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T19:25:12.609 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T19:25:12.650 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:12.702 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package cephadm. 2021-11-15T19:25:12.713 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:12.728 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package cephadm. 2021-11-15T19:25:12.738 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:12.745 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T19:25:12.760 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:12.777 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T19:25:12.786 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:12.819 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:12.994 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T19:25:13.027 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:13.069 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:13.096 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T19:25:13.114 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T19:25:13.128 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T19:25:13.146 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T19:25:13.171 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:13.181 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:13.195 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T19:25:13.204 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T19:25:13.245 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T19:25:13.414 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T19:25:13.445 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T19:25:13.488 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:13.517 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T19:25:13.523 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T19:25:13.527 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:13.533 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:13.566 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:13.581 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:13.590 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T19:25:13.623 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T19:25:13.664 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:13.795 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T19:25:13.824 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T19:25:13.827 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T19:25:13.835 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T19:25:13.862 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T19:25:13.869 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:13.882 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:13.894 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T19:25:13.935 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T19:25:13.967 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T19:25:13.969 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:14.010 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:14.198 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T19:25:14.208 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:14.227 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T19:25:14.239 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T19:25:14.246 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:14.258 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T19:25:14.271 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T19:25:14.293 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:14.295 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T19:25:14.313 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:14.328 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T19:25:14.339 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T19:25:14.370 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:14.372 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T19:25:14.414 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T19:25:14.633 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T19:25:14.648 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T19:25:14.665 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T19:25:14.680 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T19:25:14.707 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:14.722 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:14.759 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T19:25:14.792 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T19:25:14.834 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:15.041 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-routes. 2021-11-15T19:25:15.052 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T19:25:15.060 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-routes. 2021-11-15T19:25:15.069 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T19:25:15.090 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T19:25:15.109 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T19:25:15.175 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T19:25:15.208 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T19:25:15.250 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:15.269 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T19:25:15.302 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T19:25:15.343 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:15.383 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T19:25:15.392 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:15.440 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:15.445 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T19:25:15.455 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T19:25:15.477 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:15.487 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:15.519 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:15.529 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:15.569 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T19:25:15.602 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T19:25:15.669 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:15.838 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T19:25:15.848 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T19:25:15.887 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T19:25:15.997 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T19:25:16.007 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T19:25:16.054 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:16.250 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T19:25:16.258 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T19:25:16.261 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:16.270 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T19:25:16.290 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T19:25:16.299 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:16.303 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:16.325 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:16.365 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:16.391 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T19:25:16.403 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T19:25:16.412 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T19:25:16.424 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T19:25:16.452 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:16.473 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T19:25:16.669 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T19:25:16.688 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T19:25:16.699 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T19:25:16.702 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T19:25:16.738 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:16.744 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:16.763 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T19:25:16.795 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T19:25:16.802 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T19:25:16.811 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T19:25:16.838 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:16.851 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:16.874 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T19:25:16.906 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:16.948 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:17.081 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T19:25:17.091 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T19:25:17.091 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T19:25:17.123 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T19:25:17.130 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:17.163 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T19:25:17.165 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:17.195 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T19:25:17.241 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T19:25:17.251 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T19:25:17.262 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:17.290 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:17.458 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T19:25:17.490 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T19:25:17.510 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T19:25:17.520 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T19:25:17.532 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:17.559 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:17.582 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T19:25:17.592 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T19:25:17.602 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T19:25:17.631 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:17.634 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T19:25:17.677 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T19:25:17.902 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T19:25:17.912 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T19:25:17.943 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T19:25:17.951 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:17.977 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T19:25:17.980 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T19:25:18.013 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T19:25:18.035 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:18.054 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:18.288 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T19:25:18.321 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T19:25:18.354 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T19:25:18.362 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:18.363 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T19:25:18.403 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:18.407 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T19:25:18.417 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T19:25:18.465 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:18.491 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T19:25:18.501 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T19:25:18.527 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T19:25:18.540 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:18.560 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T19:25:18.601 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:18.691 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T19:25:18.707 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T19:25:18.722 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T19:25:18.740 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T19:25:18.768 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T19:25:18.782 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:18.799 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:18.800 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T19:25:18.843 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:19.027 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T19:25:19.036 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T19:25:19.072 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T19:25:19.076 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T19:25:19.081 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T19:25:19.102 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T19:25:19.121 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T19:25:19.134 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T19:25:19.171 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T19:25:19.177 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T19:25:19.203 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T19:25:19.236 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T19:25:19.246 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:19.269 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:19.310 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:19.439 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T19:25:19.467 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T19:25:19.472 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T19:25:19.499 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T19:25:19.530 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T19:25:19.539 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:19.539 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T19:25:19.541 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:19.579 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:19.616 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T19:25:19.626 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T19:25:19.663 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T19:25:19.665 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:19.673 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T19:25:19.713 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:19.924 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T19:25:19.955 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T19:25:19.976 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T19:25:19.998 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:20.006 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T19:25:20.042 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:20.066 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T19:25:20.098 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:20.129 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T19:25:20.139 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:20.140 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:20.149 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T19:25:20.160 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:20.178 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:20.199 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:20.351 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T19:25:20.361 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T19:25:20.401 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:20.451 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package jq. 2021-11-15T19:25:20.461 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:20.481 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T19:25:20.491 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:20.508 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:20.530 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:20.722 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T19:25:20.754 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T19:25:20.770 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package socat. 2021-11-15T19:25:20.803 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T19:25:20.821 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:20.845 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T19:25:20.867 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T19:25:20.900 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T19:25:20.949 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:21.141 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T19:25:21.150 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T19:25:21.166 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T19:25:21.177 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T19:25:21.190 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:21.199 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T19:25:21.210 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T19:25:21.240 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:21.252 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:21.286 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T19:25:21.296 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:21.325 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T19:25:21.335 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:21.336 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T19:25:21.383 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:21.543 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T19:25:21.576 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T19:25:21.588 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T19:25:21.597 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T19:25:21.601 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T19:25:21.612 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T19:25:21.617 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:21.629 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:21.630 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package jq. 2021-11-15T19:25:21.653 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T19:25:21.659 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:21.663 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:21.686 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T19:25:21.704 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:21.736 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:21.892 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T19:25:21.924 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T19:25:21.974 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package socat. 2021-11-15T19:25:21.974 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:22.007 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T19:25:22.029 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T19:25:22.048 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T19:25:22.062 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T19:25:22.073 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T19:25:22.091 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package ceph-test. 2021-11-15T19:25:22.103 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:22.105 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:22.124 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:22.139 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:22.166 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:22.227 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T19:25:22.260 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T19:25:22.293 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T19:25:22.465 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T19:25:22.475 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T19:25:22.514 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T19:25:22.520 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T19:25:22.531 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T19:25:22.569 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:22.589 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T19:25:22.621 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T19:25:22.663 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:22.844 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T19:25:22.851 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T19:25:22.854 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T19:25:22.865 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T19:25:22.883 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T19:25:22.891 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:22.898 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T19:25:22.926 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:22.939 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:23.000 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T19:25:23.009 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T19:25:23.049 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:23.170 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T19:25:23.200 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:23.237 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:23.261 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package ceph-test. 2021-11-15T19:25:23.278 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T19:25:23.287 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T19:25:23.294 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:23.328 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:23.336 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:23.394 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T19:25:23.427 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T19:25:23.468 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:23.522 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package jq. 2021-11-15T19:25:23.554 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:23.597 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:23.673 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T19:25:23.705 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T19:25:23.747 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:23.822 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T19:25:23.832 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T19:25:23.872 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:23.908 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package socat. 2021-11-15T19:25:23.918 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T19:25:23.957 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T19:25:24.043 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T19:25:24.076 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T19:25:24.117 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:24.183 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T19:25:24.216 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T19:25:24.291 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:24.398 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T19:25:24.431 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T19:25:24.454 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T19:25:24.464 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T19:25:24.472 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:24.503 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:24.611 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T19:25:24.621 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T19:25:24.660 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:24.742 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T19:25:24.774 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T19:25:24.816 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:24.848 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T19:25:24.880 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T19:25:24.922 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:25.079 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T19:25:25.099 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T19:25:25.109 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T19:25:25.121 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package ceph-test. 2021-11-15T19:25:25.132 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:25.145 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:25.153 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:25.173 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:25.197 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:25.361 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T19:25:25.390 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T19:25:25.394 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:25.421 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:25.435 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:25.464 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:25.526 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T19:25:25.537 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T19:25:25.575 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:25.725 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T19:25:25.756 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:25.771 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T19:25:25.781 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T19:25:25.820 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:25.824 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:25.962 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T19:25:25.995 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:26.007 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T19:25:26.036 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:26.037 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T19:25:26.074 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:26.178 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T19:25:26.187 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T19:25:26.190 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T19:25:26.223 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:26.234 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:26.264 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:26.335 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T19:25:26.339 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package jq. 2021-11-15T19:25:26.349 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:26.365 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:26.388 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:26.401 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:26.558 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T19:25:26.567 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package jq. 2021-11-15T19:25:26.578 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T19:25:26.591 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T19:25:26.625 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:26.632 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:26.671 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T19:25:26.692 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package socat. 2021-11-15T19:25:26.701 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:26.725 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T19:25:26.745 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:26.775 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T19:25:26.920 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package socat. 2021-11-15T19:25:26.935 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-attr. 2021-11-15T19:25:26.946 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T19:25:26.953 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T19:25:26.984 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T19:25:26.995 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T19:25:27.239 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T19:25:27.249 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T19:25:27.254 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T19:25:27.287 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T19:25:27.288 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:27.329 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:27.359 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T19:25:27.370 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T19:25:27.459 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T19:25:27.459 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:27.469 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T19:25:27.508 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:27.584 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T19:25:27.616 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T19:25:27.640 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T19:25:27.658 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:27.674 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T19:25:27.715 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:27.754 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T19:25:27.787 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T19:25:27.795 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T19:25:27.828 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T19:25:27.829 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:27.870 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:27.955 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package ceph-test. 2021-11-15T19:25:27.988 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:28.026 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T19:25:28.051 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T19:25:28.057 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T19:25:28.061 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T19:25:28.063 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:28.092 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:28.100 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:28.131 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-attr. 2021-11-15T19:25:28.139 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T19:25:28.204 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T19:25:28.208 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-test. 2021-11-15T19:25:28.241 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:28.282 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:28.312 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T19:25:28.343 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:28.377 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:28.479 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T19:25:28.512 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T19:25:28.534 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T19:25:28.553 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T19:25:28.567 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T19:25:28.608 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:28.681 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T19:25:28.713 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:28.756 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:28.874 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T19:25:28.884 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T19:25:28.928 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T19:25:28.939 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T19:25:28.948 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:28.977 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:29.168 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T19:25:29.178 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T19:25:29.223 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:29.268 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T19:25:29.302 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T19:25:29.343 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:29.348 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T19:25:29.381 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T19:25:29.422 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:29.555 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T19:25:29.588 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T19:25:29.630 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:29.663 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T19:25:29.672 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T19:25:29.737 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:29.851 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T19:25:29.860 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T19:25:29.900 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T19:25:29.925 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-attr. 2021-11-15T19:25:29.957 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T19:25:30.006 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-py. 2021-11-15T19:25:30.014 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T19:25:30.024 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T19:25:30.048 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:30.203 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T19:25:30.237 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T19:25:30.277 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:30.278 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T19:25:30.309 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T19:25:30.343 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T19:25:30.344 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:30.354 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T19:25:30.392 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:30.622 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T19:25:30.631 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T19:25:30.640 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T19:25:30.653 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T19:25:30.688 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:30.689 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:30.746 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T19:25:30.778 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T19:25:30.820 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T19:25:30.926 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T19:25:30.937 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T19:25:30.975 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:31.018 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T19:25:31.026 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T19:25:31.035 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T19:25:31.051 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T19:25:31.083 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:31.092 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:31.148 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T19:25:31.157 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T19:25:31.206 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:31.237 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T19:25:31.246 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T19:25:31.268 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:31.279 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T19:25:31.320 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:31.336 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:31.428 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-py. 2021-11-15T19:25:31.439 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T19:25:31.477 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:31.553 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T19:25:31.563 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T19:25:31.581 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T19:25:31.602 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T19:25:31.615 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T19:25:31.623 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T19:25:31.644 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package radosgw. 2021-11-15T19:25:31.647 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:31.654 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:31.654 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:31.693 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:31.697 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:31.831 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T19:25:31.864 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T19:25:31.906 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:31.908 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T19:25:31.914 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T19:25:31.942 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:31.945 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T19:25:31.983 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:31.988 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:32.035 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T19:25:32.044 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T19:25:32.090 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:32.226 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T19:25:32.234 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T19:25:32.275 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T19:25:32.334 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T19:25:32.345 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T19:25:32.392 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:32.394 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T19:25:32.405 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T19:25:32.448 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T19:25:32.450 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:32.481 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T19:25:32.514 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:32.580 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T19:25:32.613 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:32.654 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:32.696 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T19:25:32.706 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T19:25:32.745 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:32.746 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T19:25:32.777 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T19:25:32.811 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:32.825 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T19:25:32.833 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-attr. 2021-11-15T19:25:32.843 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T19:25:32.857 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T19:25:32.883 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T19:25:32.924 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:32.988 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T19:25:33.149 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package radosgw. 2021-11-15T19:25:33.182 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:33.223 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:33.227 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-attr. 2021-11-15T19:25:33.228 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T19:25:33.237 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T19:25:33.256 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-py. 2021-11-15T19:25:33.262 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T19:25:33.267 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T19:25:33.294 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:25:33.302 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:33.309 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T19:25:33.313 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:33.452 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:25:33.569 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:33.587 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T19:25:33.621 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T19:25:33.649 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T19:25:33.659 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T19:25:33.685 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T19:25:33.687 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:33.704 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:33.718 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T19:25:33.759 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:33.770 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:33.975 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T19:25:33.999 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T19:25:34.008 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T19:25:34.008 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T19:25:34.041 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:34.073 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:34.092 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T19:25:34.102 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T19:25:34.110 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T19:25:34.143 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:34.153 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T19:25:34.185 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:34.350 INFO:teuthology.orchestra.run.gibba011.stdout:Adding system user cephadm....done 2021-11-15T19:25:34.393 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T19:25:34.420 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T19:25:34.426 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T19:25:34.454 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T19:25:34.468 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:34.482 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T19:25:34.486 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T19:25:34.494 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T19:25:34.514 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T19:25:34.518 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T19:25:34.556 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:34.747 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:25:34.760 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:34.781 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T19:25:34.814 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T19:25:34.855 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:34.904 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T19:25:34.914 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T19:25:34.915 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:25:34.953 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T19:25:34.986 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T19:25:35.002 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package radosgw. 2021-11-15T19:25:35.012 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:35.041 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:35.051 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:35.088 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:35.208 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T19:25:35.216 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T19:25:35.243 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:35.258 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:35.291 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T19:25:35.323 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T19:25:35.347 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T19:25:35.365 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:35.604 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T19:25:35.637 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T19:25:35.665 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:35.678 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:35.769 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T19:25:35.779 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T19:25:35.818 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:35.858 INFO:teuthology.orchestra.run.gibba018.stdout:Adding system user cephadm....done 2021-11-15T19:25:35.875 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:35.964 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T19:25:35.996 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:36.038 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:36.040 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T19:25:36.048 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-py. 2021-11-15T19:25:36.057 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T19:25:36.106 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:36.126 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:36.163 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T19:25:36.196 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T19:25:36.237 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:36.283 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:36.377 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:25:36.395 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T19:25:36.460 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T19:25:36.492 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T19:25:36.493 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T19:25:36.534 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:36.595 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:36.600 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-py. 2021-11-15T19:25:36.610 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T19:25:36.619 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:36.634 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:25:36.649 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:36.778 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:25:36.829 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:36.878 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:36.887 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T19:25:36.895 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T19:25:36.897 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T19:25:36.936 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T19:25:36.977 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T19:25:37.010 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T19:25:37.013 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:37.046 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:37.051 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:37.123 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T19:25:37.213 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:37.224 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T19:25:37.258 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T19:25:37.290 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:37.365 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:37.396 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T19:25:37.405 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T19:25:37.439 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:37.445 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T19:25:37.583 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:37.653 INFO:teuthology.orchestra.run.gibba031.stdout:Adding system user cephadm....done 2021-11-15T19:25:37.660 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package radosgw. 2021-11-15T19:25:37.670 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:37.682 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:37.709 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:37.785 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:37.799 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T19:25:37.832 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T19:25:37.853 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T19:25:37.899 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:37.925 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:25:38.079 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:38.094 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:38.202 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:38.313 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T19:25:38.328 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package radosgw. 2021-11-15T19:25:38.337 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:38.345 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:38.377 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:38.440 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:38.452 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:38.580 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T19:25:38.613 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:38.630 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:38.697 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:38.703 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:38.707 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T19:25:38.805 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T19:25:38.856 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:38.997 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T19:25:39.030 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:39.067 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:39.115 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T19:25:39.215 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:39.267 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:25:39.289 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T19:25:39.322 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T19:25:39.335 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:39.363 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:39.366 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T19:25:39.394 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:25:39.449 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:39.520 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:39.570 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:39.617 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:39.716 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T19:25:39.744 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:25:39.750 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:39.755 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:39.821 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:25:39.993 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T19:25:39.994 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:39.995 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:40.014 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:40.119 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T19:25:40.223 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:40.254 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:25:40.262 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:40.270 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T19:25:40.393 INFO:teuthology.orchestra.run.gibba017.stdout:Adding system user cephadm....done 2021-11-15T19:25:40.446 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:40.480 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:40.496 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:40.499 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:40.585 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T19:25:40.626 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T19:25:40.747 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T19:25:40.765 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:25:40.829 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:40.851 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:40.975 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T19:25:41.058 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T19:25:41.070 INFO:teuthology.orchestra.run.gibba037.stdout:Adding system user cephadm....done 2021-11-15T19:25:41.080 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T19:25:41.094 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:41.174 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:41.181 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:41.184 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:41.228 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T19:25:41.300 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:25:41.354 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:41.428 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:41.457 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T19:25:41.503 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T19:25:41.551 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:41.639 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:41.654 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:25:41.755 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T19:25:41.755 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:41.809 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:41.855 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T19:25:41.886 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:25:41.889 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:41.939 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:42.035 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:42.040 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:42.132 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T19:25:42.146 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:42.216 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:42.236 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:42.267 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:42.391 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T19:25:42.422 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:25:42.467 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:42.488 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:25:42.510 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T19:25:42.627 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T19:25:42.708 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T19:25:42.719 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:25:42.722 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:42.743 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T19:25:42.834 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:42.836 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T19:25:42.846 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:42.957 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:42.994 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T19:25:43.038 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T19:25:43.043 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:43.062 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T19:25:43.183 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:43.220 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:43.264 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:43.313 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T19:25:43.317 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T19:25:43.322 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:25:43.328 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:25:43.454 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:43.515 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:43.539 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:43.548 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:43.559 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:43.697 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:43.773 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:43.798 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:43.802 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:43.866 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:25:43.874 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T19:25:43.993 INFO:teuthology.orchestra.run.gibba011.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T19:25:44.007 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:44.045 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:44.108 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T19:25:44.109 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:44.125 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:44.200 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T19:25:44.227 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:44.343 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T19:25:44.355 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:44.368 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:25:44.451 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:25:44.477 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:44.561 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T19:25:44.577 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:44.589 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:44.655 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T19:25:44.755 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:44.787 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T19:25:44.788 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:44.829 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T19:25:44.874 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:44.914 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:44.957 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:45.038 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:45.040 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:45.063 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T19:25:45.100 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:45.233 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:25:45.247 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:45.274 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:45.348 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T19:25:45.359 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:45.410 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T19:25:45.500 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:45.599 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T19:25:45.601 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:45.602 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:45.674 INFO:teuthology.orchestra.run.gibba018.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T19:25:45.728 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:45.816 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T19:25:45.833 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:45.959 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:45.986 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T19:25:45.987 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:46.051 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T19:25:46.172 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T19:25:46.218 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:46.245 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:46.260 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T19:25:46.372 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:25:46.398 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:25:46.412 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T19:25:46.512 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:46.558 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:46.572 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:46.638 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:46.655 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T19:25:46.673 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:46.759 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T19:25:46.764 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:46.799 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:46.924 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:25:46.942 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T19:25:46.973 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:46.989 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T19:25:47.010 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:47.159 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:47.182 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T19:25:47.184 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T19:25:47.199 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:47.261 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:47.309 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:47.436 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:47.443 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:25:47.477 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T19:25:47.704 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:47.718 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T19:25:47.743 INFO:teuthology.orchestra.run.gibba031.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T19:25:47.778 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T19:25:47.863 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:47.888 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:47.905 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:47.988 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:48.014 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:48.071 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:48.098 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:48.156 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T19:25:48.216 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:48.299 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:48.314 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:25:48.364 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:48.400 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:48.416 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:48.449 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T19:25:48.465 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:48.476 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:48.551 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T19:25:48.566 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T19:25:48.600 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:48.627 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:48.693 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:48.734 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:48.735 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T19:25:48.753 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:48.818 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T19:25:48.844 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T19:25:48.944 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:48.987 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:49.110 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:49.145 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T19:25:49.220 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T19:25:49.255 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:49.353 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:49.364 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:49.389 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T19:25:49.471 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:25:49.482 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:49.583 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:49.598 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:49.640 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T19:25:49.671 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:49.684 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:49.758 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T19:25:49.793 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:49.797 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:49.815 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T19:25:49.975 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T19:25:49.999 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:50.007 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:50.044 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:50.108 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:50.170 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T19:25:50.200 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:50.201 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T19:25:50.395 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:50.401 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:50.421 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T19:25:50.435 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T19:25:50.513 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:50.585 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T19:25:50.631 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:50.639 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T19:25:50.732 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:50.744 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:50.845 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:50.870 INFO:teuthology.orchestra.run.gibba017.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T19:25:50.893 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:50.893 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:50.923 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T19:25:51.013 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T19:25:51.096 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:51.140 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:51.140 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T19:25:51.166 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:51.174 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:51.241 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:51.276 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:51.357 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:51.368 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:51.383 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:51.441 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T19:25:51.460 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:51.484 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:51.493 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:51.609 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:51.661 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:51.710 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:51.717 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T19:25:51.728 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:51.779 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:51.818 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T19:25:51.837 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T19:25:51.843 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:51.919 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T19:25:51.988 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.047 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.087 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T19:25:52.088 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.114 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.154 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T19:25:52.195 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:52.198 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:52.224 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.325 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T19:25:52.355 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.358 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.465 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:52.481 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T19:25:52.490 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.610 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:52.682 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:52.682 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:52.853 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.975 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:52.979 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.092 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:53.205 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.254 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.277 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:53.284 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.331 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:53.393 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:53.397 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:53.494 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T19:25:53.520 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:53.620 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.737 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T19:25:53.746 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:53.813 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.872 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T19:25:53.940 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:53.965 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:53.971 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:54.001 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.066 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.090 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:54.175 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T19:25:54.215 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T19:25:54.231 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:54.333 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:54.433 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T19:25:54.444 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:54.459 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T19:25:54.496 INFO:teuthology.orchestra.run.gibba011.stdout:Adding group ceph....done 2021-11-15T19:25:54.549 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.667 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T19:25:54.669 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T19:25:54.676 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:54.703 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.830 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.873 INFO:teuthology.orchestra.run.gibba011.stdout:Adding system user ceph....done 2021-11-15T19:25:54.920 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.927 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:54.935 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.028 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:55.029 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.036 INFO:teuthology.orchestra.run.gibba011.stdout:Setting system user ceph properties....done 2021-11-15T19:25:55.043 INFO:teuthology.orchestra.run.gibba011.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T19:25:55.045 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T19:25:55.072 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.119 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T19:25:55.189 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:55.190 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:55.199 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:55.285 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T19:25:55.287 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:55.305 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.431 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T19:25:55.447 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.568 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.574 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:55.670 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.698 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T19:25:55.783 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:55.843 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:55.846 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:25:55.847 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:25:56.051 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:56.059 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.178 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:56.238 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.304 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:56.345 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.347 INFO:teuthology.orchestra.run.gibba018.stdout:Adding group ceph....done 2021-11-15T19:25:56.412 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:56.454 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.462 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T19:25:56.496 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.580 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.621 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:56.622 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T19:25:56.666 INFO:teuthology.orchestra.run.gibba018.stdout:Adding system user ceph....done 2021-11-15T19:25:56.706 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T19:25:56.756 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:56.781 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T19:25:56.798 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T19:25:56.817 INFO:teuthology.orchestra.run.gibba018.stdout:Setting system user ceph properties....done 2021-11-15T19:25:56.830 INFO:teuthology.orchestra.run.gibba018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T19:25:56.907 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T19:25:56.923 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:25:56.924 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:25:56.924 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T19:25:56.990 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T19:25:57.058 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:57.103 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T19:25:57.150 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T19:25:57.216 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.224 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.251 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T19:25:57.301 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.342 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.390 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:25:57.390 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:25:57.419 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.427 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.477 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T19:25:57.501 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:57.501 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:57.546 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.667 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.670 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.737 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.793 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:25:57.794 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:25:57.802 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.805 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:25:57.819 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.864 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:57.979 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:58.021 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:58.022 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T19:25:58.163 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:58.180 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:25:58.180 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:25:58.323 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.397 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:58.441 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.449 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T19:25:58.462 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.506 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.588 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.691 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.692 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T19:25:58.730 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T19:25:58.747 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.817 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.919 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:25:58.919 INFO:teuthology.orchestra.run.gibba011.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:25:58.942 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:58.977 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T19:25:59.005 INFO:teuthology.orchestra.run.gibba031.stdout:Adding group ceph....done 2021-11-15T19:25:59.024 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.102 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T19:25:59.228 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:25:59.229 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:25:59.245 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.256 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.355 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.364 INFO:teuthology.orchestra.run.gibba031.stdout:Adding system user ceph....done 2021-11-15T19:25:59.391 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.413 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:59.498 INFO:teuthology.orchestra.run.gibba031.stdout:Setting system user ceph properties....done 2021-11-15T19:25:59.506 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.510 INFO:teuthology.orchestra.run.gibba031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T19:25:59.525 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.533 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.584 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T19:25:59.632 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T19:25:59.647 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.660 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T19:25:59.737 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:25:59.737 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:25:59.761 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T19:25:59.790 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:25:59.852 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:25:59.968 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T19:25:59.991 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.052 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.117 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:26:00.169 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.186 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.295 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.309 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.470 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.538 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.574 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:00.574 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:00.664 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T19:26:00.672 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:26:00.672 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:26:00.796 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.871 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:00.997 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.072 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.173 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.272 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:01.324 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T19:26:01.341 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.375 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:01.375 INFO:teuthology.orchestra.run.gibba018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:01.582 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.615 INFO:teuthology.orchestra.run.gibba011.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:01.617 DEBUG:teuthology.orchestra.run.gibba011:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T19:26:01.675 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.694 INFO:teuthology.orchestra.run.gibba011.stdout:Reading package lists... 2021-11-15T19:26:01.743 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:26:01.743 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:26:01.758 INFO:teuthology.orchestra.run.gibba037.stdout:Adding group ceph....done 2021-11-15T19:26:01.796 INFO:teuthology.orchestra.run.gibba011.stdout:Building dependency tree... 2021-11-15T19:26:01.797 INFO:teuthology.orchestra.run.gibba011.stdout:Reading state information... 2021-11-15T19:26:01.818 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:01.838 INFO:teuthology.orchestra.run.gibba017.stdout:Adding group ceph....done 2021-11-15T19:26:01.876 INFO:teuthology.orchestra.run.gibba011.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T19:26:01.876 INFO:teuthology.orchestra.run.gibba011.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T19:26:01.877 INFO:teuthology.orchestra.run.gibba011.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T19:26:01.877 INFO:teuthology.orchestra.run.gibba011.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:26:01.877 INFO:teuthology.orchestra.run.gibba011.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:26:01.877 INFO:teuthology.orchestra.run.gibba011.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:26:01.878 INFO:teuthology.orchestra.run.gibba011.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:26:01.878 INFO:teuthology.orchestra.run.gibba011.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:26:01.878 INFO:teuthology.orchestra.run.gibba011.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:26:01.878 INFO:teuthology.orchestra.run.gibba011.stdout:The following additional packages will be installed: 2021-11-15T19:26:01.879 INFO:teuthology.orchestra.run.gibba011.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-11-15T19:26:01.879 INFO:teuthology.orchestra.run.gibba011.stdout:Suggested packages: 2021-11-15T19:26:01.879 INFO:teuthology.orchestra.run.gibba011.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T19:26:01.889 INFO:teuthology.orchestra.run.gibba011.stdout:The following NEW packages will be installed: 2021-11-15T19:26:01.889 INFO:teuthology.orchestra.run.gibba011.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T19:26:01.889 INFO:teuthology.orchestra.run.gibba011.stdout: libssl-dev 2021-11-15T19:26:01.890 INFO:teuthology.orchestra.run.gibba011.stdout:The following packages will be upgraded: 2021-11-15T19:26:01.890 INFO:teuthology.orchestra.run.gibba011.stdout: libssl1.1 2021-11-15T19:26:01.944 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:02.033 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:02.087 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T19:26:02.109 INFO:teuthology.orchestra.run.gibba037.stdout:Adding system user ceph....done 2021-11-15T19:26:02.118 INFO:teuthology.orchestra.run.gibba011.stdout:1 upgraded, 10 newly installed, 0 to remove and 48 not upgraded. 2021-11-15T19:26:02.119 INFO:teuthology.orchestra.run.gibba011.stdout:Need to get 4,233 kB of archives. 2021-11-15T19:26:02.119 INFO:teuthology.orchestra.run.gibba011.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T19:26:02.119 INFO:teuthology.orchestra.run.gibba011.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T19:26:02.164 INFO:teuthology.orchestra.run.gibba017.stdout:Adding system user ceph....done 2021-11-15T19:26:02.193 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:26:02.194 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:26:02.273 INFO:teuthology.orchestra.run.gibba037.stdout:Setting system user ceph properties....done 2021-11-15T19:26:02.286 INFO:teuthology.orchestra.run.gibba037.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T19:26:02.304 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:02.345 INFO:teuthology.orchestra.run.gibba017.stdout:Setting system user ceph properties....done 2021-11-15T19:26:02.354 INFO:teuthology.orchestra.run.gibba017.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T19:26:02.360 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T19:26:02.428 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T19:26:02.484 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:02.555 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T19:26:02.566 INFO:teuthology.orchestra.run.gibba011.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.9 [1,321 kB] 2021-11-15T19:26:02.611 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T19:26:02.618 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:02.782 INFO:teuthology.orchestra.run.gibba011.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T19:26:02.830 INFO:teuthology.orchestra.run.gibba011.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T19:26:02.832 INFO:teuthology.orchestra.run.gibba011.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T19:26:02.838 INFO:teuthology.orchestra.run.gibba011.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T19:26:02.841 INFO:teuthology.orchestra.run.gibba011.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T19:26:02.842 INFO:teuthology.orchestra.run.gibba011.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T19:26:02.844 INFO:teuthology.orchestra.run.gibba011.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T19:26:02.845 INFO:teuthology.orchestra.run.gibba011.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T19:26:02.845 INFO:teuthology.orchestra.run.gibba011.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.9 [1,583 kB] 2021-11-15T19:26:02.888 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:02.923 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:02.990 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.016 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:03.016 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:03.053 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.073 INFO:teuthology.orchestra.run.gibba011.stdout:Preconfiguring packages ... 2021-11-15T19:26:03.164 INFO:teuthology.orchestra.run.gibba011.stdout:Fetched 4,233 kB in 1s (4,175 kB/s) 2021-11-15T19:26:03.186 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:26:03.186 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:26:03.288 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.294 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package flex. 2021-11-15T19:26:03.356 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:26:03.357 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T19:26:03.367 INFO:teuthology.orchestra.run.gibba011.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T19:26:03.371 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:03.417 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T19:26:03.438 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.573 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.649 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.772 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:03.772 INFO:teuthology.orchestra.run.gibba031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:03.814 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:03.875 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T19:26:03.907 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:04.015 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:04.042 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:04.118 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T19:26:04.168 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:04.184 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:04.242 INFO:teuthology.orchestra.run.gibba018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:04.243 DEBUG:teuthology.orchestra.run.gibba018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T19:26:04.279 INFO:teuthology.orchestra.run.gibba018.stdout:Reading package lists... 2021-11-15T19:26:04.298 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.9) over (1.1.1f-1ubuntu2.8) ... 2021-11-15T19:26:04.310 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:04.328 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:26:04.328 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:26:04.380 INFO:teuthology.orchestra.run.gibba018.stdout:Building dependency tree... 2021-11-15T19:26:04.381 INFO:teuthology.orchestra.run.gibba018.stdout:Reading state information... 2021-11-15T19:26:04.457 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:04.460 INFO:teuthology.orchestra.run.gibba018.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T19:26:04.460 INFO:teuthology.orchestra.run.gibba018.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T19:26:04.460 INFO:teuthology.orchestra.run.gibba018.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T19:26:04.461 INFO:teuthology.orchestra.run.gibba018.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:26:04.461 INFO:teuthology.orchestra.run.gibba018.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:26:04.461 INFO:teuthology.orchestra.run.gibba018.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:26:04.461 INFO:teuthology.orchestra.run.gibba018.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:26:04.461 INFO:teuthology.orchestra.run.gibba018.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:26:04.462 INFO:teuthology.orchestra.run.gibba018.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:26:04.462 INFO:teuthology.orchestra.run.gibba018.stdout:The following additional packages will be installed: 2021-11-15T19:26:04.463 INFO:teuthology.orchestra.run.gibba018.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-11-15T19:26:04.463 INFO:teuthology.orchestra.run.gibba018.stdout:Suggested packages: 2021-11-15T19:26:04.463 INFO:teuthology.orchestra.run.gibba018.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T19:26:04.473 INFO:teuthology.orchestra.run.gibba018.stdout:The following NEW packages will be installed: 2021-11-15T19:26:04.473 INFO:teuthology.orchestra.run.gibba018.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T19:26:04.474 INFO:teuthology.orchestra.run.gibba018.stdout: libssl-dev 2021-11-15T19:26:04.474 INFO:teuthology.orchestra.run.gibba018.stdout:The following packages will be upgraded: 2021-11-15T19:26:04.474 INFO:teuthology.orchestra.run.gibba018.stdout: libssl1.1 2021-11-15T19:26:04.478 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T19:26:04.600 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:26:04.603 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T19:26:04.611 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:04.647 INFO:teuthology.orchestra.run.gibba018.stdout:1 upgraded, 10 newly installed, 0 to remove and 48 not upgraded. 2021-11-15T19:26:04.647 INFO:teuthology.orchestra.run.gibba018.stdout:Need to get 4,233 kB of archives. 2021-11-15T19:26:04.648 INFO:teuthology.orchestra.run.gibba018.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T19:26:04.648 INFO:teuthology.orchestra.run.gibba018.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T19:26:04.687 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:04.710 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package bison. 2021-11-15T19:26:04.721 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T19:26:04.762 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:04.783 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:26:04.783 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:26:04.933 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:05.079 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:05.095 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:26:05.096 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T19:26:05.115 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T19:26:05.148 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T19:26:05.156 INFO:teuthology.orchestra.run.gibba018.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.9 [1,321 kB] 2021-11-15T19:26:05.190 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:05.239 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:05.368 INFO:teuthology.orchestra.run.gibba018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T19:26:05.417 INFO:teuthology.orchestra.run.gibba018.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T19:26:05.419 INFO:teuthology.orchestra.run.gibba018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T19:26:05.425 INFO:teuthology.orchestra.run.gibba018.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T19:26:05.429 INFO:teuthology.orchestra.run.gibba018.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T19:26:05.430 INFO:teuthology.orchestra.run.gibba018.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T19:26:05.433 INFO:teuthology.orchestra.run.gibba018.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T19:26:05.433 INFO:teuthology.orchestra.run.gibba018.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T19:26:05.434 INFO:teuthology.orchestra.run.gibba018.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.9 [1,583 kB] 2021-11-15T19:26:05.435 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:05.534 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package dump. 2021-11-15T19:26:05.543 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-11-15T19:26:05.569 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:05.583 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T19:26:05.609 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:05.609 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:05.660 INFO:teuthology.orchestra.run.gibba018.stdout:Preconfiguring packages ... 2021-11-15T19:26:05.747 INFO:teuthology.orchestra.run.gibba018.stdout:Fetched 4,233 kB in 1s (4,164 kB/s) 2021-11-15T19:26:05.854 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package indent. 2021-11-15T19:26:05.855 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package flex. 2021-11-15T19:26:05.887 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-11-15T19:26:05.914 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:05.920 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T19:26:05.927 INFO:teuthology.orchestra.run.gibba018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T19:26:05.931 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:05.960 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:05.960 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T19:26:05.970 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T19:26:06.042 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.157 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T19:26:06.176 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.189 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T19:26:06.223 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:06.224 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:06.238 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.378 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:06.378 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:06.389 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.477 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:06.520 INFO:teuthology.orchestra.run.gibba031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:06.522 DEBUG:teuthology.orchestra.run.gibba031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T19:26:06.524 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.551 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T19:26:06.558 INFO:teuthology.orchestra.run.gibba031.stdout:Reading package lists... 2021-11-15T19:26:06.561 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T19:26:06.600 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:06.659 INFO:teuthology.orchestra.run.gibba031.stdout:Building dependency tree... 2021-11-15T19:26:06.660 INFO:teuthology.orchestra.run.gibba031.stdout:Reading state information... 2021-11-15T19:26:06.682 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:06.682 INFO:teuthology.orchestra.run.gibba017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T19:26:06.683 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.9) over (1.1.1f-1ubuntu2.8) ... 2021-11-15T19:26:06.703 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.737 INFO:teuthology.orchestra.run.gibba031.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T19:26:06.737 INFO:teuthology.orchestra.run.gibba031.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T19:26:06.737 INFO:teuthology.orchestra.run.gibba031.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T19:26:06.738 INFO:teuthology.orchestra.run.gibba031.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:26:06.738 INFO:teuthology.orchestra.run.gibba031.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:26:06.738 INFO:teuthology.orchestra.run.gibba031.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:26:06.738 INFO:teuthology.orchestra.run.gibba031.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:26:06.738 INFO:teuthology.orchestra.run.gibba031.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:26:06.739 INFO:teuthology.orchestra.run.gibba031.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:26:06.739 INFO:teuthology.orchestra.run.gibba031.stdout:The following additional packages will be installed: 2021-11-15T19:26:06.739 INFO:teuthology.orchestra.run.gibba031.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-11-15T19:26:06.740 INFO:teuthology.orchestra.run.gibba031.stdout:Suggested packages: 2021-11-15T19:26:06.740 INFO:teuthology.orchestra.run.gibba031.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T19:26:06.749 INFO:teuthology.orchestra.run.gibba031.stdout:The following NEW packages will be installed: 2021-11-15T19:26:06.750 INFO:teuthology.orchestra.run.gibba031.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T19:26:06.750 INFO:teuthology.orchestra.run.gibba031.stdout: libssl-dev 2021-11-15T19:26:06.751 INFO:teuthology.orchestra.run.gibba031.stdout:The following packages will be upgraded: 2021-11-15T19:26:06.751 INFO:teuthology.orchestra.run.gibba031.stdout: libssl1.1 2021-11-15T19:26:06.837 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.923 INFO:teuthology.orchestra.run.gibba031.stdout:1 upgraded, 10 newly installed, 0 to remove and 48 not upgraded. 2021-11-15T19:26:06.923 INFO:teuthology.orchestra.run.gibba031.stdout:Need to get 4,233 kB of archives. 2021-11-15T19:26:06.923 INFO:teuthology.orchestra.run.gibba031.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T19:26:06.924 INFO:teuthology.orchestra.run.gibba031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T19:26:06.954 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T19:26:06.963 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.975 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:06.987 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:07.029 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:07.126 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:07.129 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package bison. 2021-11-15T19:26:07.139 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T19:26:07.140 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T19:26:07.185 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:07.257 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T19:26:07.278 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T19:26:07.289 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:07.339 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:07.377 INFO:teuthology.orchestra.run.gibba031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.9 [1,321 kB] 2021-11-15T19:26:07.382 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:07.420 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T19:26:07.517 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T19:26:07.550 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T19:26:07.576 INFO:teuthology.orchestra.run.gibba011.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T19:26:07.583 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:07.589 INFO:teuthology.orchestra.run.gibba031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T19:26:07.608 INFO:teuthology.orchestra.run.gibba011.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:07.621 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:07.638 INFO:teuthology.orchestra.run.gibba031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T19:26:07.640 INFO:teuthology.orchestra.run.gibba031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T19:26:07.646 INFO:teuthology.orchestra.run.gibba031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T19:26:07.649 INFO:teuthology.orchestra.run.gibba031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T19:26:07.649 INFO:teuthology.orchestra.run.gibba031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T19:26:07.650 INFO:teuthology.orchestra.run.gibba011.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:07.652 INFO:teuthology.orchestra.run.gibba031.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T19:26:07.652 INFO:teuthology.orchestra.run.gibba031.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T19:26:07.653 INFO:teuthology.orchestra.run.gibba031.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.9 [1,583 kB] 2021-11-15T19:26:07.879 INFO:teuthology.orchestra.run.gibba031.stdout:Preconfiguring packages ... 2021-11-15T19:26:07.928 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package dump. 2021-11-15T19:26:07.938 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-11-15T19:26:07.955 INFO:teuthology.orchestra.run.gibba031.stdout:Fetched 4,233 kB in 1s (4,403 kB/s) 2021-11-15T19:26:07.978 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T19:26:08.088 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package flex. 2021-11-15T19:26:08.123 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T19:26:08.161 INFO:teuthology.orchestra.run.gibba031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T19:26:08.164 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:08.203 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T19:26:08.248 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package indent. 2021-11-15T19:26:08.255 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:08.282 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-11-15T19:26:08.323 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T19:26:08.523 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:08.649 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:08.727 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:08.775 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:08.893 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.9) over (1.1.1f-1ubuntu2.8) ... 2021-11-15T19:26:08.926 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:08.943 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T19:26:08.975 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T19:26:09.009 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:09.044 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:09.051 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:09.177 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T19:26:09.276 INFO:teuthology.orchestra.run.gibba011.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T19:26:09.313 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T19:26:09.346 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T19:26:09.369 INFO:teuthology.orchestra.run.gibba037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:09.370 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T19:26:09.379 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:09.393 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:09.405 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-11-15T19:26:09.491 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:09.508 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-11-15T19:26:09.509 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-11-15T19:26:09.521 INFO:teuthology.orchestra.run.gibba011.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T19:26:09.570 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package bison. 2021-11-15T19:26:09.580 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T19:26:09.581 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T19:26:09.588 INFO:teuthology.orchestra.run.gibba037.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T19:26:09.588 INFO:teuthology.orchestra.run.gibba037.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T19:26:09.588 INFO:teuthology.orchestra.run.gibba037.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T19:26:09.589 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:26:09.589 INFO:teuthology.orchestra.run.gibba037.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:26:09.589 INFO:teuthology.orchestra.run.gibba037.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:26:09.589 INFO:teuthology.orchestra.run.gibba037.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:26:09.590 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:26:09.590 INFO:teuthology.orchestra.run.gibba037.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:26:09.591 INFO:teuthology.orchestra.run.gibba037.stdout:The following additional packages will be installed: 2021-11-15T19:26:09.591 INFO:teuthology.orchestra.run.gibba037.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-11-15T19:26:09.591 INFO:teuthology.orchestra.run.gibba037.stdout:Suggested packages: 2021-11-15T19:26:09.591 INFO:teuthology.orchestra.run.gibba037.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T19:26:09.601 INFO:teuthology.orchestra.run.gibba037.stdout:The following NEW packages will be installed: 2021-11-15T19:26:09.601 INFO:teuthology.orchestra.run.gibba037.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T19:26:09.602 INFO:teuthology.orchestra.run.gibba037.stdout: libssl-dev 2021-11-15T19:26:09.602 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages will be upgraded: 2021-11-15T19:26:09.602 INFO:teuthology.orchestra.run.gibba037.stdout: libssl1.1 2021-11-15T19:26:09.666 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:09.732 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T19:26:09.741 INFO:teuthology.orchestra.run.gibba011.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:09.743 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:09.782 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:09.796 INFO:teuthology.orchestra.run.gibba037.stdout:1 upgraded, 10 newly installed, 0 to remove and 48 not upgraded. 2021-11-15T19:26:09.796 INFO:teuthology.orchestra.run.gibba037.stdout:Need to get 4,233 kB of archives. 2021-11-15T19:26:09.797 INFO:teuthology.orchestra.run.gibba037.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T19:26:09.797 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T19:26:09.867 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:09.873 INFO:teuthology.orchestra.run.gibba017.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:09.874 DEBUG:teuthology.orchestra.run.gibba017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T19:26:09.971 INFO:teuthology.orchestra.run.gibba017.stdout:Reading package lists... 2021-11-15T19:26:10.009 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:10.025 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T19:26:10.034 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T19:26:10.067 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:10.073 INFO:teuthology.orchestra.run.gibba017.stdout:Building dependency tree... 2021-11-15T19:26:10.074 INFO:teuthology.orchestra.run.gibba017.stdout:Reading state information... 2021-11-15T19:26:10.075 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T19:26:10.093 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:10.134 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:10.153 INFO:teuthology.orchestra.run.gibba017.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T19:26:10.153 INFO:teuthology.orchestra.run.gibba017.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T19:26:10.153 INFO:teuthology.orchestra.run.gibba017.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T19:26:10.153 INFO:teuthology.orchestra.run.gibba017.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T19:26:10.154 INFO:teuthology.orchestra.run.gibba017.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T19:26:10.154 INFO:teuthology.orchestra.run.gibba017.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T19:26:10.154 INFO:teuthology.orchestra.run.gibba017.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T19:26:10.154 INFO:teuthology.orchestra.run.gibba017.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T19:26:10.154 INFO:teuthology.orchestra.run.gibba017.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T19:26:10.155 INFO:teuthology.orchestra.run.gibba017.stdout:The following additional packages will be installed: 2021-11-15T19:26:10.155 INFO:teuthology.orchestra.run.gibba017.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-11-15T19:26:10.156 INFO:teuthology.orchestra.run.gibba017.stdout:Suggested packages: 2021-11-15T19:26:10.156 INFO:teuthology.orchestra.run.gibba017.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T19:26:10.165 INFO:teuthology.orchestra.run.gibba017.stdout:The following NEW packages will be installed: 2021-11-15T19:26:10.166 INFO:teuthology.orchestra.run.gibba017.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T19:26:10.166 INFO:teuthology.orchestra.run.gibba017.stdout: libssl-dev 2021-11-15T19:26:10.166 INFO:teuthology.orchestra.run.gibba017.stdout:The following packages will be upgraded: 2021-11-15T19:26:10.167 INFO:teuthology.orchestra.run.gibba017.stdout: libssl1.1 2021-11-15T19:26:10.251 INFO:teuthology.orchestra.run.gibba037.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.9 [1,321 kB] 2021-11-15T19:26:10.339 INFO:teuthology.orchestra.run.gibba017.stdout:1 upgraded, 10 newly installed, 0 to remove and 48 not upgraded. 2021-11-15T19:26:10.340 INFO:teuthology.orchestra.run.gibba017.stdout:Need to get 4,233 kB of archives. 2021-11-15T19:26:10.340 INFO:teuthology.orchestra.run.gibba017.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T19:26:10.340 INFO:teuthology.orchestra.run.gibba017.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T19:26:10.404 INFO:teuthology.orchestra.run.gibba018.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T19:26:10.421 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package dump. 2021-11-15T19:26:10.431 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-11-15T19:26:10.437 INFO:teuthology.orchestra.run.gibba018.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:10.470 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T19:26:10.478 INFO:teuthology.orchestra.run.gibba018.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:10.517 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T19:26:10.600 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T19:26:10.602 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T19:26:10.607 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T19:26:10.611 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T19:26:10.612 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T19:26:10.614 INFO:teuthology.orchestra.run.gibba037.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T19:26:10.614 INFO:teuthology.orchestra.run.gibba037.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T19:26:10.615 INFO:teuthology.orchestra.run.gibba037.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.9 [1,583 kB] 2021-11-15T19:26:10.749 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package indent. 2021-11-15T19:26:10.780 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-11-15T19:26:10.788 INFO:teuthology.orchestra.run.gibba017.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.9 [1,321 kB] 2021-11-15T19:26:10.815 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T19:26:10.853 INFO:teuthology.orchestra.run.gibba037.stdout:Preconfiguring packages ... 2021-11-15T19:26:10.902 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T19:26:10.983 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 4,233 kB in 1s (3,907 kB/s) 2021-11-15T19:26:11.050 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:11.055 INFO:teuthology.orchestra.run.gibba017.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T19:26:11.102 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T19:26:11.107 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package flex. 2021-11-15T19:26:11.133 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T19:26:11.137 INFO:teuthology.orchestra.run.gibba017.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T19:26:11.139 INFO:teuthology.orchestra.run.gibba017.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T19:26:11.144 INFO:teuthology.orchestra.run.gibba017.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T19:26:11.148 INFO:teuthology.orchestra.run.gibba017.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T19:26:11.148 INFO:teuthology.orchestra.run.gibba017.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T19:26:11.151 INFO:teuthology.orchestra.run.gibba017.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T19:26:11.152 INFO:teuthology.orchestra.run.gibba017.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T19:26:11.153 INFO:teuthology.orchestra.run.gibba017.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.9 [1,583 kB] 2021-11-15T19:26:11.176 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:11.182 INFO:teuthology.orchestra.run.gibba037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T19:26:11.185 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:11.222 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T19:26:11.293 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:11.408 INFO:teuthology.orchestra.run.gibba017.stdout:Preconfiguring packages ... 2021-11-15T19:26:11.418 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:11.501 INFO:teuthology.orchestra.run.gibba017.stdout:Fetched 4,233 kB in 1s (3,943 kB/s) 2021-11-15T19:26:11.519 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:11.546 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T19:26:11.555 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T19:26:11.596 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:11.596 INFO:teuthology.orchestra.run.gibba011.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T19:26:11.629 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:11.639 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package flex. 2021-11-15T19:26:11.712 INFO:teuthology.orchestra.run.gibba017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T19:26:11.716 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:11.738 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:11.753 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T19:26:11.829 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:11.864 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T19:26:11.932 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T19:26:11.962 INFO:teuthology.orchestra.run.gibba018.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T19:26:11.964 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:11.999 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:12.032 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:12.094 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.9) over (1.1.1f-1ubuntu2.8) ... 2021-11-15T19:26:12.157 INFO:teuthology.orchestra.run.gibba018.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T19:26:12.225 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T19:26:12.235 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:12.256 INFO:teuthology.orchestra.run.gibba011.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:12.257 DEBUG:teuthology.parallel:result is None 2021-11-15T19:26:12.268 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T19:26:12.300 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:12.342 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:12.351 INFO:teuthology.orchestra.run.gibba018.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:12.426 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.9) over (1.1.1f-1ubuntu2.8) ... 2021-11-15T19:26:12.478 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:12.591 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package bison. 2021-11-15T19:26:12.604 INFO:teuthology.orchestra.run.gibba031.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T19:26:12.613 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:12.624 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T19:26:12.636 INFO:teuthology.orchestra.run.gibba031.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:12.671 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:12.712 INFO:teuthology.orchestra.run.gibba031.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:12.922 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package bison. 2021-11-15T19:26:12.933 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T19:26:12.973 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:13.112 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T19:26:13.126 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T19:26:13.145 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T19:26:13.186 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:13.275 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:13.401 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T19:26:13.411 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T19:26:13.451 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:13.517 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:13.547 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package dump. 2021-11-15T19:26:13.557 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-11-15T19:26:13.596 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T19:26:13.644 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:13.771 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:13.837 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package dump. 2021-11-15T19:26:13.870 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-11-15T19:26:13.871 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:13.885 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package indent. 2021-11-15T19:26:13.911 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T19:26:13.917 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-11-15T19:26:13.959 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T19:26:13.972 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:14.073 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T19:26:14.167 INFO:teuthology.orchestra.run.gibba018.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T19:26:14.171 INFO:teuthology.orchestra.run.gibba031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T19:26:14.182 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package indent. 2021-11-15T19:26:14.215 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-11-15T19:26:14.249 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T19:26:14.253 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T19:26:14.275 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:14.287 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T19:26:14.328 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:14.366 INFO:teuthology.orchestra.run.gibba031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T19:26:14.436 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T19:26:14.501 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T19:26:14.512 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T19:26:14.560 INFO:teuthology.orchestra.run.gibba031.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:14.576 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:14.665 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T19:26:14.697 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T19:26:14.739 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:14.831 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:14.854 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T19:26:14.876 INFO:teuthology.orchestra.run.gibba018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:14.878 DEBUG:teuthology.parallel:result is None 2021-11-15T19:26:14.887 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T19:26:14.929 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:14.939 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:15.109 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T19:26:15.118 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:15.183 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:15.300 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T19:26:15.310 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:15.349 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:15.412 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T19:26:15.445 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:15.486 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:15.618 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T19:26:15.651 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T19:26:15.693 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:15.773 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T19:26:15.806 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:15.847 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:15.937 INFO:teuthology.orchestra.run.gibba017.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T19:26:15.970 INFO:teuthology.orchestra.run.gibba017.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.9_amd64.deb ... 2021-11-15T19:26:16.020 INFO:teuthology.orchestra.run.gibba017.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:16.270 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T19:26:16.351 INFO:teuthology.orchestra.run.gibba031.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T19:26:16.418 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:16.531 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T19:26:16.690 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:16.821 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:16.947 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:17.024 INFO:teuthology.orchestra.run.gibba031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:17.026 DEBUG:teuthology.parallel:result is None 2021-11-15T19:26:17.098 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:17.176 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:17.215 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:17.316 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T19:26:17.419 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T19:26:17.540 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T19:26:17.570 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T19:26:17.610 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:17.696 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.9) ... 2021-11-15T19:26:17.701 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T19:26:17.762 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T19:26:17.814 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T19:26:17.921 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:17.937 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:18.049 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:18.049 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T19:26:18.131 INFO:teuthology.orchestra.run.gibba017.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T19:26:18.174 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:18.184 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T19:26:18.267 INFO:teuthology.orchestra.run.gibba017.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T19:26:18.327 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T19:26:18.479 INFO:teuthology.orchestra.run.gibba017.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T19:26:18.606 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T19:26:18.748 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T19:26:19.685 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T19:26:20.026 INFO:teuthology.orchestra.run.gibba017.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T19:26:20.483 INFO:teuthology.orchestra.run.gibba037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:20.485 DEBUG:teuthology.parallel:result is None 2021-11-15T19:26:20.719 INFO:teuthology.orchestra.run.gibba017.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T19:26:20.720 DEBUG:teuthology.parallel:result is None 2021-11-15T19:26:20.721 DEBUG:teuthology.orchestra.run.gibba037:> sudo lsb_release -is 2021-11-15T19:26:20.760 INFO:teuthology.orchestra.run.gibba037.stdout:Ubuntu 2021-11-15T19:26:20.763 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:26:20.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:26:20.981 DEBUG:teuthology.orchestra.run.gibba037:> dpkg-query -W -f '${Version}' ceph 2021-11-15T19:26:20.997 INFO:teuthology.orchestra.run.gibba037.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:20.997 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:20.998 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T19:26:20.998 DEBUG:teuthology.orchestra.run.gibba011:> sudo lsb_release -is 2021-11-15T19:26:21.025 INFO:teuthology.orchestra.run.gibba011.stdout:Ubuntu 2021-11-15T19:26:21.028 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:26:21.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:26:21.236 DEBUG:teuthology.orchestra.run.gibba011:> dpkg-query -W -f '${Version}' ceph 2021-11-15T19:26:21.281 INFO:teuthology.orchestra.run.gibba011.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:21.281 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:21.281 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T19:26:21.282 DEBUG:teuthology.orchestra.run.gibba031:> sudo lsb_release -is 2021-11-15T19:26:21.309 INFO:teuthology.orchestra.run.gibba031.stdout:Ubuntu 2021-11-15T19:26:21.312 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:26:21.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:26:21.514 DEBUG:teuthology.orchestra.run.gibba031:> dpkg-query -W -f '${Version}' ceph 2021-11-15T19:26:21.556 INFO:teuthology.orchestra.run.gibba031.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:21.556 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:21.557 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T19:26:21.557 DEBUG:teuthology.orchestra.run.gibba018:> sudo lsb_release -is 2021-11-15T19:26:21.585 INFO:teuthology.orchestra.run.gibba018.stdout:Ubuntu 2021-11-15T19:26:21.587 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:26:21.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:26:21.789 DEBUG:teuthology.orchestra.run.gibba018:> dpkg-query -W -f '${Version}' ceph 2021-11-15T19:26:21.832 INFO:teuthology.orchestra.run.gibba018.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:21.832 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:21.833 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T19:26:21.833 DEBUG:teuthology.orchestra.run.gibba017:> sudo lsb_release -is 2021-11-15T19:26:21.861 INFO:teuthology.orchestra.run.gibba017.stdout:Ubuntu 2021-11-15T19:26:21.864 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T19:26:21.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T19:26:22.063 DEBUG:teuthology.orchestra.run.gibba017:> dpkg-query -W -f '${Version}' ceph 2021-11-15T19:26:22.107 INFO:teuthology.orchestra.run.gibba017.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:22.107 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T19:26:22.108 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T19:26:22.108 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-11-15T19:26:22.109 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:22.109 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T19:26:22.120 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:22.120 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T19:26:22.132 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:26:22.132 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T19:26:22.144 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:26:22.144 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T19:26:22.156 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:26:22.156 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T19:26:22.177 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-11-15T19:26:22.178 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:22.178 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T19:26:22.188 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T19:26:22.200 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:22.201 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T19:26:22.211 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T19:26:22.226 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:26:22.227 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T19:26:22.246 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T19:26:22.265 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:26:22.266 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T19:26:22.287 DEBUG:teuthology.orchestra.run.gibba018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T19:26:22.308 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:26:22.308 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T19:26:22.330 DEBUG:teuthology.orchestra.run.gibba017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T19:26:22.390 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-11-15T19:26:22.391 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:22.391 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T19:26:22.402 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T19:26:22.452 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:22.452 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T19:26:22.473 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T19:26:22.538 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:26:22.538 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T19:26:22.559 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T19:26:22.620 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:26:22.621 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T19:26:22.633 DEBUG:teuthology.orchestra.run.gibba018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T19:26:22.681 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:26:22.681 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T19:26:22.693 DEBUG:teuthology.orchestra.run.gibba017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T19:26:22.699 INFO:teuthology.run_tasks:Running task ceph... 2021-11-15T19:26:22.751 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-11-15T19:26:22.751 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 777 /var/log/ceph 2021-11-15T19:26:22.755 DEBUG:teuthology.orchestra.run.gibba017:> sudo chmod 777 /var/log/ceph 2021-11-15T19:26:22.758 DEBUG:teuthology.orchestra.run.gibba018:> sudo chmod 777 /var/log/ceph 2021-11-15T19:26:22.761 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod 777 /var/log/ceph 2021-11-15T19:26:22.765 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 777 /var/log/ceph 2021-11-15T19:26:22.782 INFO:tasks.ceph:Disabling ceph logrotate... 2021-11-15T19:26:22.783 DEBUG:teuthology.orchestra.run.gibba011:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T19:26:22.807 DEBUG:teuthology.orchestra.run.gibba017:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T19:26:22.813 DEBUG:teuthology.orchestra.run.gibba018:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T19:26:22.824 DEBUG:teuthology.orchestra.run.gibba031:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T19:26:22.828 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T19:26:22.845 INFO:tasks.ceph:Creating extra log directories... 2021-11-15T19:26:22.845 DEBUG:teuthology.orchestra.run.gibba011:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T19:26:22.848 DEBUG:teuthology.orchestra.run.gibba017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T19:26:22.851 DEBUG:teuthology.orchestra.run.gibba018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T19:26:22.854 DEBUG:teuthology.orchestra.run.gibba031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T19:26:22.857 DEBUG:teuthology.orchestra.run.gibba037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T19:26:22.879 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-11-15T19:26:22.879 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-11-15T19:26:22.879 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-11-15T19:26:22.880 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:22.880 DEBUG:teuthology.orchestra.run.gibba037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T19:26:22.929 DEBUG:teuthology.orchestra.run.gibba037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:22.948 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:22.949 DEBUG:teuthology.orchestra.run.gibba011:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T19:26:22.957 DEBUG:teuthology.orchestra.run.gibba011:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:23.020 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:26:23.021 DEBUG:teuthology.orchestra.run.gibba031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T19:26:23.030 DEBUG:teuthology.orchestra.run.gibba031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:23.042 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:26:23.042 DEBUG:teuthology.orchestra.run.gibba018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T19:26:23.052 DEBUG:teuthology.orchestra.run.gibba018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:23.113 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:26:23.113 DEBUG:teuthology.orchestra.run.gibba017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T19:26:23.123 DEBUG:teuthology.orchestra.run.gibba017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:23.185 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-11-15T19:26:23.186 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-15T19:26:23.186 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6498820', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'gibba', 'name': 'teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'workunit': {'branch': 'octopus', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (5, 'gibba')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'd4737010a85099043cf081dc05b4069d301b23fb', 'timestamp': '2021-11-12_04:10:03', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.gibba.12704', 'targets': {'gibba037.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNgP4nUwCLJwHk5U5RzuMOLZKQlyCwce2x1RB8Oxr52JTiimFJaZaTXEcDHoZHuL2B/8v8c91SzfesSpACFIofqtaIVzQniHN4Ldsv6rXlZ3LIMLF3eT/B1BNv7OxZROrAra550eyC1nVbCBnjzZxz3yCpNnAXEuW2iB1F3CAVTiKZe7zqpHod2HrGn5Vvq0fhxIz6IGjUBOMz1lMaQ0brkU5lpBWYryMwRBrdbQMk5rTHv3R3fsKwksZb4qhXNtdOts+CNWRIyc1Iy80kwYyAA0Y5kHZMWmW6VJbDsXNO82bCHSV0Y7vRSSqrt3KsZidPlJYHkFfXJJ5sCIpSVDsuWtENGX4Lqc/ZI3p5PKXy0SO1VihLzT8Mq2LavmXq1b/UZND1rEkxoWQgzulkUeCbGC81PFm1Cob7KNCzLJgzcfi5HbnzZkOdep3/677fwISKLWB1xueXR1CFnI4KlQ/hngCTufzDGrpW4P7Il9M0Zkatd9k5gMO/CLWgOdXyYZ0=', 'gibba011.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl5uafO4UcWYVW61MSXFb5+uByn6pBkku4GhqfNGBN0bDjHU/eS6xFfAiV3prJ5ohG5NOm6N7kNdBMQdoDQxyNTpHlGsrFxk5zivNDFlEeXsJCi1QG6uygIQw3yqYMyCjrxq7U6l5KAHBIAq4FlE0LggLAOgh8IcyOUHbx0WTQA4+ff+XA6X3eQk3x44H5F8V4+zxQPYFNKkNH1Jovo4bzSakghoMprRDN+mOavuwxfnQqkqZqf96yQ7HljbUqvrmmNE3Cos4RE2c+GI55HE0lDO0do8kQ2FVx29efxGIik8TVVaoNJRiBdBKSIKal2+nJ7bbvFj6u1fSKlQ/Bxi0pMqJ1Iq2XV0NXYrf6GbCZJOTgQZyXuxOfGuK/fcqwoTzfbFLBHhZRaG6h9Ur0EOVB3kmSQiQY3b69qmKNH23tU93PxaWGp2WMnT/rrKzJSVuZIp6ZfXHKcPEVi4eGVD3DD/7in+dxkC/SbZvIEhFxSVoa5ttTWpWfCI7jRB1hk18=', 'gibba031.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo8+UA2eYlienvEFwsB7a/CQyVkiuBLcsTwmcgg4EN/Gt9x/ZqEYX9JAtl3ht3mMMmTvvCdcIb0mO/ek9UJ8HPfkdD70H7voibPaKtVfHKEflzL+czRpuyNWHWDe75kNfKZ4tDp0TV1nf26bPEqg4P+dqjkxvGrgj4ewgYoIxrmtY/9awOjndwgbNTLRdKmyLKG8TaEi2UktETjHZ+KFR6EHy0yhe+Uq50VZFJYvaLPlmzkU746fXkeq/AQmy2+bmcQ7cxhNCQsIpfCWLdAWkd3oAYxGCCK13oOed6/lHn2am3RYHwtZ1jM7lkkh+8SUn1HIs7rebQ+jAS3YpwQC4jrLWp5cYD+SIkHZcget3XFVBOozts2jB5FQ/uVPn9HgKkR6ErL0DP2R/HuQFePg0lyahHEFshEXqbb93p7K+bgucP7HbBpSrDbZpNUhkj5v6oSXROpl0av2i2osLnxf06cpiXroJOC37CWsoR/vDhAxx44w5avtzC9hY4bGua+B8=', 'gibba018.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoxdc0yhKf0cqE96BuESIgek2iBR7rwnA3V8ZfPV+QHeKizzo966M+UQ2M2wQIBaAOUoaCnQZL0TkbxWDd+PeCaldPpgTj4uQh5eYt5D8Fn8kxJSKeTjT8Z50uUX0cHXxRDosYA8riBf8MatL3AZ4fEL5CTCErH61iD+qUV/zVGTsvViPvU363Qn79/f+hkrRccpZFQeqYfnovfqaiFJbNIGNUljQ/rYbHswnI731fQji15gYlTij0rQqtwKjnj7B+8mwJSlpz4p+u9Dp/zc8b+MlurWyH0lWHkrDietV59evt3eMN5iARz1L+qrB0WujDYj1IwQwoqC8H5OHk9zJfPqJv3/5QReokpIbPeAJYQ1iv/IpyiLjETuYMxKabaRPmvAVNDPJwa+JmIE4lplWUdgnXbbYmC8SrDw2uo7iZQ6Zc6dt5Fq3Gex+FU7UYk1ZuiPIbtPgBy1xIZYGUgXgjgbqIzfWATYacCalFW8WiY8+Se6jGEkn5/WcapiDQX60=', 'gibba017.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJXtzTxqYAXaBkPdXit8LUjwSqWXmsBPJhLrlHLFQTWmXJaaG5IRkTJU7vAWsQLEbZNJVwVNQFlrRgZUVWiQCi7PSCXzqKlmow1HO7Psw1FRbHnKHGDn1AOfbkEIfLf9B7Of6W8tmJjdC8B0wdx5hK0huG3OK0DatRaH2mJ7yJKQEhKNjeIZMs4xLJG1l5kHG2Baf1mr0pnSUt1/vOAZSr27mVDiYOcQPmL/BeaX6tQubf0U2lBVsjjetUQ/I4lD8VjSjvR9uzb9AT9BWS7lO/3PBsJA+CtK9AOWDz9+Fra7XJuY/E505PdaWqvJkQXZqPGA/CTVIJlNBn0KCbwxlSJxgVj4RG4fHYc7QQ1pA9WU3YThstwT1tTNxTfeMpV+4/HRYlpwHaBDRw5aQ2S/F1wgDMB49sG5b/N6SxcMIo33V9JlBujOoqnobSh+3oIewukhluBj9CDgpVMsXB8IDmnyfEM9zrZ4wm2bspiYLAhFwAfDL7wYIEHT9k0Ovlq/c='}} 2021-11-15T19:26:23.187 DEBUG:teuthology.orchestra.run.gibba011:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T19:26:23.190 DEBUG:teuthology.orchestra.run.gibba017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T19:26:23.193 DEBUG:teuthology.orchestra.run.gibba018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T19:26:23.196 DEBUG:teuthology.orchestra.run.gibba031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T19:26:23.200 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T19:26:23.209 DEBUG:teuthology.orchestra.run.gibba011:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T19:26:23.212 DEBUG:teuthology.orchestra.run.gibba017:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T19:26:23.214 DEBUG:teuthology.orchestra.run.gibba018:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T19:26:23.248 DEBUG:teuthology.orchestra.run.gibba031:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T19:26:23.251 DEBUG:teuthology.orchestra.run.gibba037:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T19:26:23.270 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:23.270 DEBUG:teuthology.orchestra.run.gibba037:> dd if=/scratch_devs of=/dev/stdout 2021-11-15T19:26:23.276 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-15T19:26:23.277 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-15T19:26:23.329 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-15T19:26:23.330 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.330 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-11-15T19:26:23.330 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.330 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-11-15 19:23:07.021224259 +0000 2021-11-15T19:26:23.331 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-11-15 19:23:06.877223842 +0000 2021-11-15T19:26:23.331 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-11-15 19:23:06.877223842 +0000 2021-11-15T19:26:23.331 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-11-15T19:26:23.338 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-11-15T19:26:23.338 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-11-15T19:26:23.338 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000252288 s, 2.0 MB/s 2021-11-15T19:26:23.339 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-15T19:26:23.343 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-15T19:26:23.343 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.344 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 352 Links: 1 2021-11-15T19:26:23.344 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.344 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-11-15 19:23:07.425225432 +0000 2021-11-15T19:26:23.344 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-11-15 19:23:07.277225002 +0000 2021-11-15T19:26:23.344 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-11-15 19:23:07.277225002 +0000 2021-11-15T19:26:23.345 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-11-15T19:26:23.346 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-11-15T19:26:23.346 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-11-15T19:26:23.346 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000235426 s, 2.2 MB/s 2021-11-15T19:26:23.348 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-15T19:26:23.351 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-15T19:26:23.351 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.352 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-11-15T19:26:23.352 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.352 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-11-15 19:23:07.749226371 +0000 2021-11-15T19:26:23.352 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-11-15 19:23:07.637226046 +0000 2021-11-15T19:26:23.353 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-11-15 19:23:07.637226046 +0000 2021-11-15T19:26:23.353 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-11-15T19:26:23.354 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-11-15T19:26:23.355 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-11-15T19:26:23.355 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000244131 s, 2.1 MB/s 2021-11-15T19:26:23.356 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-15T19:26:23.407 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-15T19:26:23.407 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.408 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-11-15T19:26:23.408 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.408 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-11-15 19:23:08.109227414 +0000 2021-11-15T19:26:23.408 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-11-15 19:23:07.945226939 +0000 2021-11-15T19:26:23.409 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-11-15 19:23:07.945226939 +0000 2021-11-15T19:26:23.409 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-11-15T19:26:23.419 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-11-15T19:26:23.420 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-11-15T19:26:23.420 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.00048193 s, 1.1 MB/s 2021-11-15T19:26:23.426 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:23.426 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:23.427 DEBUG:teuthology.orchestra.run.gibba011:> dd if=/scratch_devs of=/dev/stdout 2021-11-15T19:26:23.436 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-15T19:26:23.436 DEBUG:teuthology.orchestra.run.gibba011:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-15T19:26:23.440 INFO:teuthology.orchestra.run.gibba011.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-15T19:26:23.440 INFO:teuthology.orchestra.run.gibba011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.440 INFO:teuthology.orchestra.run.gibba011.stdout:Device: 6h/6d Inode: 369 Links: 1 2021-11-15T19:26:23.440 INFO:teuthology.orchestra.run.gibba011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.441 INFO:teuthology.orchestra.run.gibba011.stdout:Access: 2021-11-15 19:23:02.869689922 +0000 2021-11-15T19:26:23.441 INFO:teuthology.orchestra.run.gibba011.stdout:Modify: 2021-11-15 19:23:02.709689461 +0000 2021-11-15T19:26:23.441 INFO:teuthology.orchestra.run.gibba011.stdout:Change: 2021-11-15 19:23:02.709689461 +0000 2021-11-15T19:26:23.441 INFO:teuthology.orchestra.run.gibba011.stdout: Birth: - 2021-11-15T19:26:23.442 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records in 2021-11-15T19:26:23.443 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records out 2021-11-15T19:26:23.443 INFO:teuthology.orchestra.run.gibba011.stderr:512 bytes copied, 0.000177603 s, 2.9 MB/s 2021-11-15T19:26:23.444 DEBUG:teuthology.orchestra.run.gibba011:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-15T19:26:23.447 INFO:teuthology.orchestra.run.gibba011.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-15T19:26:23.447 INFO:teuthology.orchestra.run.gibba011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.447 INFO:teuthology.orchestra.run.gibba011.stdout:Device: 6h/6d Inode: 377 Links: 1 2021-11-15T19:26:23.448 INFO:teuthology.orchestra.run.gibba011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.448 INFO:teuthology.orchestra.run.gibba011.stdout:Access: 2021-11-15 19:23:03.185690833 +0000 2021-11-15T19:26:23.448 INFO:teuthology.orchestra.run.gibba011.stdout:Modify: 2021-11-15 19:23:03.093690568 +0000 2021-11-15T19:26:23.448 INFO:teuthology.orchestra.run.gibba011.stdout:Change: 2021-11-15 19:23:03.093690568 +0000 2021-11-15T19:26:23.448 INFO:teuthology.orchestra.run.gibba011.stdout: Birth: - 2021-11-15T19:26:23.450 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records in 2021-11-15T19:26:23.450 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records out 2021-11-15T19:26:23.450 INFO:teuthology.orchestra.run.gibba011.stderr:512 bytes copied, 0.000226918 s, 2.3 MB/s 2021-11-15T19:26:23.451 DEBUG:teuthology.orchestra.run.gibba011:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-15T19:26:23.455 INFO:teuthology.orchestra.run.gibba011.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-15T19:26:23.455 INFO:teuthology.orchestra.run.gibba011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.455 INFO:teuthology.orchestra.run.gibba011.stdout:Device: 6h/6d Inode: 383 Links: 1 2021-11-15T19:26:23.455 INFO:teuthology.orchestra.run.gibba011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.456 INFO:teuthology.orchestra.run.gibba011.stdout:Access: 2021-11-15 19:23:03.561691917 +0000 2021-11-15T19:26:23.456 INFO:teuthology.orchestra.run.gibba011.stdout:Modify: 2021-11-15 19:23:03.453691606 +0000 2021-11-15T19:26:23.456 INFO:teuthology.orchestra.run.gibba011.stdout:Change: 2021-11-15 19:23:03.453691606 +0000 2021-11-15T19:26:23.456 INFO:teuthology.orchestra.run.gibba011.stdout: Birth: - 2021-11-15T19:26:23.457 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records in 2021-11-15T19:26:23.458 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records out 2021-11-15T19:26:23.458 INFO:teuthology.orchestra.run.gibba011.stderr:512 bytes copied, 0.000148797 s, 3.4 MB/s 2021-11-15T19:26:23.459 DEBUG:teuthology.orchestra.run.gibba011:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-15T19:26:23.507 INFO:teuthology.orchestra.run.gibba011.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-15T19:26:23.507 INFO:teuthology.orchestra.run.gibba011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T19:26:23.507 INFO:teuthology.orchestra.run.gibba011.stdout:Device: 6h/6d Inode: 388 Links: 1 2021-11-15T19:26:23.508 INFO:teuthology.orchestra.run.gibba011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T19:26:23.508 INFO:teuthology.orchestra.run.gibba011.stdout:Access: 2021-11-15 19:23:03.957693059 +0000 2021-11-15T19:26:23.508 INFO:teuthology.orchestra.run.gibba011.stdout:Modify: 2021-11-15 19:23:03.765692506 +0000 2021-11-15T19:26:23.508 INFO:teuthology.orchestra.run.gibba011.stdout:Change: 2021-11-15 19:23:03.765692506 +0000 2021-11-15T19:26:23.509 INFO:teuthology.orchestra.run.gibba011.stdout: Birth: - 2021-11-15T19:26:23.514 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records in 2021-11-15T19:26:23.514 INFO:teuthology.orchestra.run.gibba011.stderr:1+0 records out 2021-11-15T19:26:23.514 INFO:teuthology.orchestra.run.gibba011.stderr:512 bytes copied, 0.000181964 s, 2.8 MB/s 2021-11-15T19:26:23.515 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:23.516 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba011.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-11-15T19:26:23.516 INFO:tasks.ceph:Generating config... 2021-11-15T19:26:23.517 INFO:tasks.ceph:[client] client mount timeout = 600 2021-11-15T19:26:23.518 INFO:tasks.ceph:[client] debug client = 20 2021-11-15T19:26:23.518 INFO:tasks.ceph:[client] debug ms = 1 2021-11-15T19:26:23.518 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-11-15T19:26:23.519 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-11-15T19:26:23.519 INFO:tasks.ceph:[mds] debug mds = 20 2021-11-15T19:26:23.519 INFO:tasks.ceph:[mds] debug ms = 1 2021-11-15T19:26:23.520 INFO:tasks.ceph:[mds] mds bal frag = True 2021-11-15T19:26:23.520 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-11-15T19:26:23.520 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-11-15T19:26:23.521 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-11-15T19:26:23.521 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-11-15T19:26:23.521 INFO:tasks.ceph:[mds] mds debug frag = True 2021-11-15T19:26:23.521 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-11-15T19:26:23.522 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-11-15T19:26:23.522 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-11-15T19:26:23.522 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-11-15T19:26:23.523 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-11-15T19:26:23.523 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-11-15T19:26:23.523 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-15T19:26:23.524 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-15T19:26:23.524 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-15T19:26:23.524 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-15T19:26:23.524 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-15T19:26:23.525 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-11-15T19:26:23.525 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-15T19:26:23.525 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-15T19:26:23.526 INFO:tasks.ceph:[osd] osd objectstore = filestore 2021-11-15T19:26:23.526 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-11-15T19:26:23.526 INFO:tasks.ceph:[osd] osd sloppy crc = True 2021-11-15T19:26:23.527 INFO:tasks.ceph:Setting up mon.a... 2021-11-15T19:26:23.527 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-11-15T19:26:23.563 INFO:teuthology.orchestra.run.gibba037.stdout:creating /etc/ceph/ceph.keyring 2021-11-15T19:26:23.565 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-11-15T19:26:23.637 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T19:26:23.643 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.2.137'), ('mon.b', '172.21.2.111'), ('mon.c', '[v2:172.21.2.111:3301,v1:172.21.2.111:6790]')] 2021-11-15T19:26:23.643 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.137 --add b 172.21.2.111 --addv c '[v2:172.21.2.111:3301,v1:172.21.2.111:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:23.661 INFO:teuthology.orchestra.run.gibba037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:23.662 INFO:teuthology.orchestra.run.gibba037.stdout:monmaptool: generated fsid 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.662 INFO:teuthology.orchestra.run.gibba037.stdout:epoch 0 2021-11-15T19:26:23.662 INFO:teuthology.orchestra.run.gibba037.stdout:fsid 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.662 INFO:teuthology.orchestra.run.gibba037.stdout:last_changed 2021-11-15T19:26:23.658390+0000 2021-11-15T19:26:23.663 INFO:teuthology.orchestra.run.gibba037.stdout:created 2021-11-15T19:26:23.658390+0000 2021-11-15T19:26:23.663 INFO:teuthology.orchestra.run.gibba037.stdout:min_mon_release 0 (unknown) 2021-11-15T19:26:23.663 INFO:teuthology.orchestra.run.gibba037.stdout:0: [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] mon.a 2021-11-15T19:26:23.663 INFO:teuthology.orchestra.run.gibba037.stdout:1: [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] mon.b 2021-11-15T19:26:23.663 INFO:teuthology.orchestra.run.gibba037.stdout:2: [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] mon.c 2021-11-15T19:26:23.664 INFO:teuthology.orchestra.run.gibba037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-11-15T19:26:23.665 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 83e72b0f-d369-4e28-ba83-5e0d7df7d510... 2021-11-15T19:26:23.666 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:26:23.670 DEBUG:teuthology.orchestra.run.gibba017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:26:23.673 DEBUG:teuthology.orchestra.run.gibba018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:26:23.677 DEBUG:teuthology.orchestra.run.gibba031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:26:23.680 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:26:23.712 INFO:teuthology.orchestra.run.gibba031.stdout:[global] 2021-11-15T19:26:23.712 INFO:teuthology.orchestra.run.gibba031.stdout: chdir = "" 2021-11-15T19:26:23.713 INFO:teuthology.orchestra.run.gibba031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:26:23.713 INFO:teuthology.orchestra.run.gibba031.stdout: auth supported = cephx 2021-11-15T19:26:23.713 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.713 INFO:teuthology.orchestra.run.gibba031.stdout: filestore xattr use omap = true 2021-11-15T19:26:23.714 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.714 INFO:teuthology.orchestra.run.gibba031.stdout: mon clock drift allowed = 1.000 2021-11-15T19:26:23.714 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.714 INFO:teuthology.orchestra.run.gibba031.stdout: osd crush chooseleaf type = 0 2021-11-15T19:26:23.715 INFO:teuthology.orchestra.run.gibba031.stdout: auth debug = true 2021-11-15T19:26:23.715 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.715 INFO:teuthology.orchestra.run.gibba031.stdout: ms die on old message = true 2021-11-15T19:26:23.715 INFO:teuthology.orchestra.run.gibba031.stdout: ms die on bug = true 2021-11-15T19:26:23.715 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.716 INFO:teuthology.orchestra.run.gibba031.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:26:23.716 INFO:teuthology.orchestra.run.gibba031.stdout: mon pg warn max object skew = 0 2021-11-15T19:26:23.716 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.716 INFO:teuthology.orchestra.run.gibba031.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:26:23.716 INFO:teuthology.orchestra.run.gibba031.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:26:23.717 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.717 INFO:teuthology.orchestra.run.gibba031.stdout: osd pool default size = 2 2021-11-15T19:26:23.717 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.717 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd allow primary affinity = true 2021-11-15T19:26:23.718 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd allow pg remap = true 2021-11-15T19:26:23.718 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:26:23.718 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:26:23.718 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on no sortbitwise = false 2021-11-15T19:26:23.718 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:26:23.719 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on too few osds = false 2021-11-15T19:26:23.719 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:26:23.719 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:26:23.719 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.719 INFO:teuthology.orchestra.run.gibba031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:26:23.720 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.720 INFO:teuthology.orchestra.run.gibba031.stdout: osd default data pool replay window = 5 2021-11-15T19:26:23.720 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.720 INFO:teuthology.orchestra.run.gibba031.stdout: mon allow pool delete = true 2021-11-15T19:26:23.721 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.721 INFO:teuthology.orchestra.run.gibba031.stdout: mon cluster log file level = debug 2021-11-15T19:26:23.721 INFO:teuthology.orchestra.run.gibba031.stdout: debug asserts on shutdown = true 2021-11-15T19:26:23.721 INFO:teuthology.orchestra.run.gibba031.stdout: mon health detail to clog = false 2021-11-15T19:26:23.721 INFO:teuthology.orchestra.run.gibba031.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:26:23.722 INFO:teuthology.orchestra.run.gibba031.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.722 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.722 INFO:teuthology.orchestra.run.gibba031.stdout:[osd] 2021-11-15T19:26:23.722 INFO:teuthology.orchestra.run.gibba031.stdout: osd journal size = 100 2021-11-15T19:26:23.723 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.723 INFO:teuthology.orchestra.run.gibba031.stdout: osd scrub load threshold = 5.0 2021-11-15T19:26:23.723 INFO:teuthology.orchestra.run.gibba031.stdout: osd scrub max interval = 600 2021-11-15T19:26:23.723 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.724 INFO:teuthology.orchestra.run.gibba031.stdout: osd recover clone overlap = true 2021-11-15T19:26:23.724 INFO:teuthology.orchestra.run.gibba031.stdout: osd recovery max chunk = 1048576 2021-11-15T19:26:23.724 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.724 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug shutdown = true 2021-11-15T19:26:23.724 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug op order = true 2021-11-15T19:26:23.725 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug verify stray on activate = true 2021-11-15T19:26:23.725 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.725 INFO:teuthology.orchestra.run.gibba031.stdout: osd open classes on start = true 2021-11-15T19:26:23.725 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug pg log writeout = true 2021-11-15T19:26:23.725 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.726 INFO:teuthology.orchestra.run.gibba031.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:26:23.726 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.726 INFO:teuthology.orchestra.run.gibba031.stdout: osd map max advance = 10 2021-11-15T19:26:23.726 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.726 INFO:teuthology.orchestra.run.gibba031.stdout: journal zero on create = true 2021-11-15T19:26:23.727 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.727 INFO:teuthology.orchestra.run.gibba031.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:26:23.727 INFO:teuthology.orchestra.run.gibba031.stdout: filestore apply finisher threads = 3 2021-11-15T19:26:23.727 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.728 INFO:teuthology.orchestra.run.gibba031.stdout: bdev debug aio = true 2021-11-15T19:26:23.728 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug misdirected ops = true 2021-11-15T19:26:23.728 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:26:23.728 INFO:teuthology.orchestra.run.gibba031.stdout: debug osd = 20 2021-11-15T19:26:23.728 INFO:teuthology.orchestra.run.gibba031.stdout: osd objectstore = filestore 2021-11-15T19:26:23.729 INFO:teuthology.orchestra.run.gibba031.stdout: osd op complaint time = 180 2021-11-15T19:26:23.729 INFO:teuthology.orchestra.run.gibba031.stdout: osd sloppy crc = True 2021-11-15T19:26:23.729 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.729 INFO:teuthology.orchestra.run.gibba031.stdout:[mgr] 2021-11-15T19:26:23.729 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:26:23.730 INFO:teuthology.orchestra.run.gibba031.stdout: debug mgr = 20 2021-11-15T19:26:23.730 INFO:teuthology.orchestra.run.gibba031.stdout: debug mon = 20 2021-11-15T19:26:23.730 INFO:teuthology.orchestra.run.gibba031.stdout: debug auth = 20 2021-11-15T19:26:23.730 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.731 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.731 INFO:teuthology.orchestra.run.gibba031.stdout: mgr/telemetry/nag = false 2021-11-15T19:26:23.731 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.731 INFO:teuthology.orchestra.run.gibba031.stdout:[mon] 2021-11-15T19:26:23.731 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:26:23.732 INFO:teuthology.orchestra.run.gibba031.stdout: debug mon = 20 2021-11-15T19:26:23.732 INFO:teuthology.orchestra.run.gibba031.stdout: debug paxos = 20 2021-11-15T19:26:23.732 INFO:teuthology.orchestra.run.gibba031.stdout: debug auth = 20 2021-11-15T19:26:23.732 INFO:teuthology.orchestra.run.gibba031.stdout: mon data avail warn = 5 2021-11-15T19:26:23.732 INFO:teuthology.orchestra.run.gibba031.stdout: mon mgr mkfs grace = 240 2021-11-15T19:26:23.733 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.733 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd reporter subtree level = osd 2021-11-15T19:26:23.733 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd prime pg temp = true 2021-11-15T19:26:23.733 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.734 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.734 INFO:teuthology.orchestra.run.gibba031.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:26:23.734 INFO:teuthology.orchestra.run.gibba031.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:26:23.734 INFO:teuthology.orchestra.run.gibba031.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:26:23.734 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.735 INFO:teuthology.orchestra.run.gibba031.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:26:23.735 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:26:23.735 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:26:23.735 INFO:teuthology.orchestra.run.gibba031.stdout: mon op complaint time = 120 2021-11-15T19:26:23.735 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:26:23.736 INFO:teuthology.orchestra.run.gibba031.stdout:[client] 2021-11-15T19:26:23.736 INFO:teuthology.orchestra.run.gibba031.stdout: rgw cache enabled = true 2021-11-15T19:26:23.736 INFO:teuthology.orchestra.run.gibba031.stdout: rgw enable ops log = true 2021-11-15T19:26:23.736 INFO:teuthology.orchestra.run.gibba031.stdout: rgw enable usage log = true 2021-11-15T19:26:23.736 INFO:teuthology.orchestra.run.gibba031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:26:23.737 INFO:teuthology.orchestra.run.gibba031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:26:23.737 INFO:teuthology.orchestra.run.gibba031.stdout: client mount timeout = 600 2021-11-15T19:26:23.737 INFO:teuthology.orchestra.run.gibba031.stdout: debug client = 20 2021-11-15T19:26:23.737 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:26:23.738 INFO:teuthology.orchestra.run.gibba031.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.738 INFO:teuthology.orchestra.run.gibba031.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.738 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.a] 2021-11-15T19:26:23.738 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.b] 2021-11-15T19:26:23.738 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.c] 2021-11-15T19:26:23.739 INFO:teuthology.orchestra.run.gibba031.stdout:[mds.a] 2021-11-15T19:26:23.739 INFO:teuthology.orchestra.run.gibba031.stdout:[mds.b] 2021-11-15T19:26:23.739 INFO:teuthology.orchestra.run.gibba031.stdout:[mds] 2021-11-15T19:26:23.739 INFO:teuthology.orchestra.run.gibba031.stdout: debug mds = 20 2021-11-15T19:26:23.739 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:26:23.740 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal frag = True 2021-11-15T19:26:23.740 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal fragment size max = 10000 2021-11-15T19:26:23.740 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal merge size = 5 2021-11-15T19:26:23.740 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal split bits = 3 2021-11-15T19:26:23.740 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal split size = 100 2021-11-15T19:26:23.741 INFO:teuthology.orchestra.run.gibba031.stdout: mds debug frag = True 2021-11-15T19:26:23.741 INFO:teuthology.orchestra.run.gibba031.stdout: mds debug scatterstat = True 2021-11-15T19:26:23.741 INFO:teuthology.orchestra.run.gibba031.stdout: mds op complaint time = 180 2021-11-15T19:26:23.741 INFO:teuthology.orchestra.run.gibba031.stdout: mds verify scatter = True 2021-11-15T19:26:23.741 INFO:teuthology.orchestra.run.gibba031.stdout: osd op complaint time = 180 2021-11-15T19:26:23.742 INFO:teuthology.orchestra.run.gibba031.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.742 INFO:teuthology.orchestra.run.gibba031.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.742 INFO:teuthology.orchestra.run.gibba017.stdout:[global] 2021-11-15T19:26:23.742 INFO:teuthology.orchestra.run.gibba017.stdout: chdir = "" 2021-11-15T19:26:23.743 INFO:teuthology.orchestra.run.gibba017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:26:23.743 INFO:teuthology.orchestra.run.gibba017.stdout: auth supported = cephx 2021-11-15T19:26:23.743 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.743 INFO:teuthology.orchestra.run.gibba017.stdout: filestore xattr use omap = true 2021-11-15T19:26:23.743 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.744 INFO:teuthology.orchestra.run.gibba017.stdout: mon clock drift allowed = 1.000 2021-11-15T19:26:23.744 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.744 INFO:teuthology.orchestra.run.gibba017.stdout: osd crush chooseleaf type = 0 2021-11-15T19:26:23.744 INFO:teuthology.orchestra.run.gibba017.stdout: auth debug = true 2021-11-15T19:26:23.745 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.745 INFO:teuthology.orchestra.run.gibba017.stdout: ms die on old message = true 2021-11-15T19:26:23.745 INFO:teuthology.orchestra.run.gibba017.stdout: ms die on bug = true 2021-11-15T19:26:23.745 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.745 INFO:teuthology.orchestra.run.gibba017.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:26:23.746 INFO:teuthology.orchestra.run.gibba017.stdout: mon pg warn max object skew = 0 2021-11-15T19:26:23.746 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.746 INFO:teuthology.orchestra.run.gibba017.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:26:23.746 INFO:teuthology.orchestra.run.gibba017.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:26:23.746 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.747 INFO:teuthology.orchestra.run.gibba017.stdout: osd pool default size = 2 2021-11-15T19:26:23.747 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.747 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd allow primary affinity = true 2021-11-15T19:26:23.747 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd allow pg remap = true 2021-11-15T19:26:23.748 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:26:23.748 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:26:23.748 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on no sortbitwise = false 2021-11-15T19:26:23.748 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:26:23.748 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on too few osds = false 2021-11-15T19:26:23.749 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:26:23.749 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:26:23.749 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.749 INFO:teuthology.orchestra.run.gibba017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:26:23.749 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.750 INFO:teuthology.orchestra.run.gibba017.stdout: osd default data pool replay window = 5 2021-11-15T19:26:23.750 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.750 INFO:teuthology.orchestra.run.gibba017.stdout: mon allow pool delete = true 2021-11-15T19:26:23.750 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.750 INFO:teuthology.orchestra.run.gibba017.stdout: mon cluster log file level = debug 2021-11-15T19:26:23.751 INFO:teuthology.orchestra.run.gibba017.stdout: debug asserts on shutdown = true 2021-11-15T19:26:23.751 INFO:teuthology.orchestra.run.gibba017.stdout: mon health detail to clog = false 2021-11-15T19:26:23.751 INFO:teuthology.orchestra.run.gibba017.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:26:23.751 INFO:teuthology.orchestra.run.gibba017.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.752 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.752 INFO:teuthology.orchestra.run.gibba017.stdout:[osd] 2021-11-15T19:26:23.752 INFO:teuthology.orchestra.run.gibba017.stdout: osd journal size = 100 2021-11-15T19:26:23.752 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.752 INFO:teuthology.orchestra.run.gibba017.stdout: osd scrub load threshold = 5.0 2021-11-15T19:26:23.753 INFO:teuthology.orchestra.run.gibba017.stdout: osd scrub max interval = 600 2021-11-15T19:26:23.753 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.753 INFO:teuthology.orchestra.run.gibba017.stdout: osd recover clone overlap = true 2021-11-15T19:26:23.753 INFO:teuthology.orchestra.run.gibba017.stdout: osd recovery max chunk = 1048576 2021-11-15T19:26:23.753 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.754 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug shutdown = true 2021-11-15T19:26:23.754 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug op order = true 2021-11-15T19:26:23.754 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug verify stray on activate = true 2021-11-15T19:26:23.754 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.755 INFO:teuthology.orchestra.run.gibba017.stdout: osd open classes on start = true 2021-11-15T19:26:23.755 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug pg log writeout = true 2021-11-15T19:26:23.755 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.755 INFO:teuthology.orchestra.run.gibba017.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:26:23.755 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.756 INFO:teuthology.orchestra.run.gibba017.stdout: osd map max advance = 10 2021-11-15T19:26:23.756 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.756 INFO:teuthology.orchestra.run.gibba017.stdout: journal zero on create = true 2021-11-15T19:26:23.756 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.757 INFO:teuthology.orchestra.run.gibba017.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:26:23.757 INFO:teuthology.orchestra.run.gibba017.stdout: filestore apply finisher threads = 3 2021-11-15T19:26:23.757 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.757 INFO:teuthology.orchestra.run.gibba017.stdout: bdev debug aio = true 2021-11-15T19:26:23.757 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug misdirected ops = true 2021-11-15T19:26:23.758 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:26:23.758 INFO:teuthology.orchestra.run.gibba017.stdout: debug osd = 20 2021-11-15T19:26:23.758 INFO:teuthology.orchestra.run.gibba017.stdout: osd objectstore = filestore 2021-11-15T19:26:23.758 INFO:teuthology.orchestra.run.gibba017.stdout: osd op complaint time = 180 2021-11-15T19:26:23.759 INFO:teuthology.orchestra.run.gibba017.stdout: osd sloppy crc = True 2021-11-15T19:26:23.759 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.759 INFO:teuthology.orchestra.run.gibba017.stdout:[mgr] 2021-11-15T19:26:23.759 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:26:23.759 INFO:teuthology.orchestra.run.gibba017.stdout: debug mgr = 20 2021-11-15T19:26:23.760 INFO:teuthology.orchestra.run.gibba017.stdout: debug mon = 20 2021-11-15T19:26:23.760 INFO:teuthology.orchestra.run.gibba017.stdout: debug auth = 20 2021-11-15T19:26:23.760 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.760 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.761 INFO:teuthology.orchestra.run.gibba017.stdout: mgr/telemetry/nag = false 2021-11-15T19:26:23.761 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.761 INFO:teuthology.orchestra.run.gibba017.stdout:[mon] 2021-11-15T19:26:23.761 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:26:23.761 INFO:teuthology.orchestra.run.gibba017.stdout: debug mon = 20 2021-11-15T19:26:23.762 INFO:teuthology.orchestra.run.gibba017.stdout: debug paxos = 20 2021-11-15T19:26:23.762 INFO:teuthology.orchestra.run.gibba017.stdout: debug auth = 20 2021-11-15T19:26:23.762 INFO:teuthology.orchestra.run.gibba017.stdout: mon data avail warn = 5 2021-11-15T19:26:23.762 INFO:teuthology.orchestra.run.gibba017.stdout: mon mgr mkfs grace = 240 2021-11-15T19:26:23.763 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.763 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd reporter subtree level = osd 2021-11-15T19:26:23.763 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd prime pg temp = true 2021-11-15T19:26:23.763 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.763 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.764 INFO:teuthology.orchestra.run.gibba017.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:26:23.764 INFO:teuthology.orchestra.run.gibba017.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:26:23.764 INFO:teuthology.orchestra.run.gibba017.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:26:23.764 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.764 INFO:teuthology.orchestra.run.gibba017.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:26:23.765 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:26:23.765 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:26:23.765 INFO:teuthology.orchestra.run.gibba017.stdout: mon op complaint time = 120 2021-11-15T19:26:23.765 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:26:23.765 INFO:teuthology.orchestra.run.gibba017.stdout:[client] 2021-11-15T19:26:23.766 INFO:teuthology.orchestra.run.gibba017.stdout: rgw cache enabled = true 2021-11-15T19:26:23.766 INFO:teuthology.orchestra.run.gibba017.stdout: rgw enable ops log = true 2021-11-15T19:26:23.766 INFO:teuthology.orchestra.run.gibba017.stdout: rgw enable usage log = true 2021-11-15T19:26:23.766 INFO:teuthology.orchestra.run.gibba017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:26:23.767 INFO:teuthology.orchestra.run.gibba017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:26:23.767 INFO:teuthology.orchestra.run.gibba017.stdout: client mount timeout = 600 2021-11-15T19:26:23.767 INFO:teuthology.orchestra.run.gibba017.stdout: debug client = 20 2021-11-15T19:26:23.767 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:26:23.767 INFO:teuthology.orchestra.run.gibba017.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.768 INFO:teuthology.orchestra.run.gibba017.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.768 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.a] 2021-11-15T19:26:23.768 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.b] 2021-11-15T19:26:23.768 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.c] 2021-11-15T19:26:23.768 INFO:teuthology.orchestra.run.gibba017.stdout:[mds.a] 2021-11-15T19:26:23.769 INFO:teuthology.orchestra.run.gibba017.stdout:[mds.b] 2021-11-15T19:26:23.769 INFO:teuthology.orchestra.run.gibba017.stdout:[mds] 2021-11-15T19:26:23.769 INFO:teuthology.orchestra.run.gibba017.stdout: debug mds = 20 2021-11-15T19:26:23.769 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:26:23.769 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal frag = True 2021-11-15T19:26:23.770 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal fragment size max = 10000 2021-11-15T19:26:23.770 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal merge size = 5 2021-11-15T19:26:23.770 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal split bits = 3 2021-11-15T19:26:23.770 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal split size = 100 2021-11-15T19:26:23.770 INFO:teuthology.orchestra.run.gibba017.stdout: mds debug frag = True 2021-11-15T19:26:23.771 INFO:teuthology.orchestra.run.gibba017.stdout: mds debug scatterstat = True 2021-11-15T19:26:23.771 INFO:teuthology.orchestra.run.gibba017.stdout: mds op complaint time = 180 2021-11-15T19:26:23.771 INFO:teuthology.orchestra.run.gibba017.stdout: mds verify scatter = True 2021-11-15T19:26:23.771 INFO:teuthology.orchestra.run.gibba017.stdout: osd op complaint time = 180 2021-11-15T19:26:23.772 INFO:teuthology.orchestra.run.gibba017.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.772 INFO:teuthology.orchestra.run.gibba017.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.772 INFO:teuthology.orchestra.run.gibba011.stdout:[global] 2021-11-15T19:26:23.772 INFO:teuthology.orchestra.run.gibba011.stdout: chdir = "" 2021-11-15T19:26:23.772 INFO:teuthology.orchestra.run.gibba011.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:26:23.773 INFO:teuthology.orchestra.run.gibba011.stdout: auth supported = cephx 2021-11-15T19:26:23.773 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.773 INFO:teuthology.orchestra.run.gibba011.stdout: filestore xattr use omap = true 2021-11-15T19:26:23.773 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.774 INFO:teuthology.orchestra.run.gibba011.stdout: mon clock drift allowed = 1.000 2021-11-15T19:26:23.774 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.774 INFO:teuthology.orchestra.run.gibba011.stdout: osd crush chooseleaf type = 0 2021-11-15T19:26:23.774 INFO:teuthology.orchestra.run.gibba011.stdout: auth debug = true 2021-11-15T19:26:23.774 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.775 INFO:teuthology.orchestra.run.gibba011.stdout: ms die on old message = true 2021-11-15T19:26:23.775 INFO:teuthology.orchestra.run.gibba011.stdout: ms die on bug = true 2021-11-15T19:26:23.775 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.775 INFO:teuthology.orchestra.run.gibba011.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:26:23.775 INFO:teuthology.orchestra.run.gibba011.stdout: mon pg warn max object skew = 0 2021-11-15T19:26:23.776 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.776 INFO:teuthology.orchestra.run.gibba011.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:26:23.776 INFO:teuthology.orchestra.run.gibba011.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:26:23.776 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.776 INFO:teuthology.orchestra.run.gibba011.stdout: osd pool default size = 2 2021-11-15T19:26:23.777 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.777 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd allow primary affinity = true 2021-11-15T19:26:23.777 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd allow pg remap = true 2021-11-15T19:26:23.777 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:26:23.778 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:26:23.778 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on no sortbitwise = false 2021-11-15T19:26:23.778 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:26:23.778 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on too few osds = false 2021-11-15T19:26:23.778 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:26:23.779 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:26:23.779 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.779 INFO:teuthology.orchestra.run.gibba011.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:26:23.779 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.779 INFO:teuthology.orchestra.run.gibba011.stdout: osd default data pool replay window = 5 2021-11-15T19:26:23.780 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.780 INFO:teuthology.orchestra.run.gibba011.stdout: mon allow pool delete = true 2021-11-15T19:26:23.780 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.780 INFO:teuthology.orchestra.run.gibba011.stdout: mon cluster log file level = debug 2021-11-15T19:26:23.781 INFO:teuthology.orchestra.run.gibba011.stdout: debug asserts on shutdown = true 2021-11-15T19:26:23.781 INFO:teuthology.orchestra.run.gibba011.stdout: mon health detail to clog = false 2021-11-15T19:26:23.781 INFO:teuthology.orchestra.run.gibba011.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:26:23.781 INFO:teuthology.orchestra.run.gibba011.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.781 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.782 INFO:teuthology.orchestra.run.gibba011.stdout:[osd] 2021-11-15T19:26:23.782 INFO:teuthology.orchestra.run.gibba011.stdout: osd journal size = 100 2021-11-15T19:26:23.782 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.782 INFO:teuthology.orchestra.run.gibba011.stdout: osd scrub load threshold = 5.0 2021-11-15T19:26:23.783 INFO:teuthology.orchestra.run.gibba011.stdout: osd scrub max interval = 600 2021-11-15T19:26:23.783 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.783 INFO:teuthology.orchestra.run.gibba011.stdout: osd recover clone overlap = true 2021-11-15T19:26:23.783 INFO:teuthology.orchestra.run.gibba011.stdout: osd recovery max chunk = 1048576 2021-11-15T19:26:23.783 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.784 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug shutdown = true 2021-11-15T19:26:23.784 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug op order = true 2021-11-15T19:26:23.784 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug verify stray on activate = true 2021-11-15T19:26:23.784 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.784 INFO:teuthology.orchestra.run.gibba011.stdout: osd open classes on start = true 2021-11-15T19:26:23.785 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug pg log writeout = true 2021-11-15T19:26:23.785 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.785 INFO:teuthology.orchestra.run.gibba011.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:26:23.785 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.786 INFO:teuthology.orchestra.run.gibba011.stdout: osd map max advance = 10 2021-11-15T19:26:23.786 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.786 INFO:teuthology.orchestra.run.gibba011.stdout: journal zero on create = true 2021-11-15T19:26:23.786 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.786 INFO:teuthology.orchestra.run.gibba011.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:26:23.787 INFO:teuthology.orchestra.run.gibba011.stdout: filestore apply finisher threads = 3 2021-11-15T19:26:23.787 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.787 INFO:teuthology.orchestra.run.gibba011.stdout: bdev debug aio = true 2021-11-15T19:26:23.787 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug misdirected ops = true 2021-11-15T19:26:23.787 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:26:23.788 INFO:teuthology.orchestra.run.gibba011.stdout: debug osd = 20 2021-11-15T19:26:23.788 INFO:teuthology.orchestra.run.gibba011.stdout: osd objectstore = filestore 2021-11-15T19:26:23.788 INFO:teuthology.orchestra.run.gibba011.stdout: osd op complaint time = 180 2021-11-15T19:26:23.788 INFO:teuthology.orchestra.run.gibba011.stdout: osd sloppy crc = True 2021-11-15T19:26:23.789 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.789 INFO:teuthology.orchestra.run.gibba011.stdout:[mgr] 2021-11-15T19:26:23.789 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:26:23.789 INFO:teuthology.orchestra.run.gibba011.stdout: debug mgr = 20 2021-11-15T19:26:23.789 INFO:teuthology.orchestra.run.gibba011.stdout: debug mon = 20 2021-11-15T19:26:23.790 INFO:teuthology.orchestra.run.gibba011.stdout: debug auth = 20 2021-11-15T19:26:23.790 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.790 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.790 INFO:teuthology.orchestra.run.gibba011.stdout: mgr/telemetry/nag = false 2021-11-15T19:26:23.790 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.791 INFO:teuthology.orchestra.run.gibba011.stdout:[mon] 2021-11-15T19:26:23.791 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:26:23.791 INFO:teuthology.orchestra.run.gibba011.stdout: debug mon = 20 2021-11-15T19:26:23.791 INFO:teuthology.orchestra.run.gibba011.stdout: debug paxos = 20 2021-11-15T19:26:23.792 INFO:teuthology.orchestra.run.gibba011.stdout: debug auth = 20 2021-11-15T19:26:23.792 INFO:teuthology.orchestra.run.gibba011.stdout: mon data avail warn = 5 2021-11-15T19:26:23.792 INFO:teuthology.orchestra.run.gibba011.stdout: mon mgr mkfs grace = 240 2021-11-15T19:26:23.792 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.792 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd reporter subtree level = osd 2021-11-15T19:26:23.793 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd prime pg temp = true 2021-11-15T19:26:23.793 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.793 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.793 INFO:teuthology.orchestra.run.gibba011.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:26:23.794 INFO:teuthology.orchestra.run.gibba011.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:26:23.794 INFO:teuthology.orchestra.run.gibba011.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:26:23.794 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.794 INFO:teuthology.orchestra.run.gibba011.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:26:23.794 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:26:23.795 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:26:23.795 INFO:teuthology.orchestra.run.gibba011.stdout: mon op complaint time = 120 2021-11-15T19:26:23.795 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:26:23.795 INFO:teuthology.orchestra.run.gibba011.stdout:[client] 2021-11-15T19:26:23.796 INFO:teuthology.orchestra.run.gibba011.stdout: rgw cache enabled = true 2021-11-15T19:26:23.796 INFO:teuthology.orchestra.run.gibba011.stdout: rgw enable ops log = true 2021-11-15T19:26:23.796 INFO:teuthology.orchestra.run.gibba011.stdout: rgw enable usage log = true 2021-11-15T19:26:23.796 INFO:teuthology.orchestra.run.gibba011.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:26:23.796 INFO:teuthology.orchestra.run.gibba011.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:26:23.797 INFO:teuthology.orchestra.run.gibba011.stdout: client mount timeout = 600 2021-11-15T19:26:23.797 INFO:teuthology.orchestra.run.gibba011.stdout: debug client = 20 2021-11-15T19:26:23.797 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:26:23.797 INFO:teuthology.orchestra.run.gibba011.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.797 INFO:teuthology.orchestra.run.gibba011.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.798 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.a] 2021-11-15T19:26:23.798 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.b] 2021-11-15T19:26:23.798 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.c] 2021-11-15T19:26:23.798 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.a] 2021-11-15T19:26:23.799 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.b] 2021-11-15T19:26:23.799 INFO:teuthology.orchestra.run.gibba011.stdout:[mds] 2021-11-15T19:26:23.799 INFO:teuthology.orchestra.run.gibba011.stdout: debug mds = 20 2021-11-15T19:26:23.799 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:26:23.799 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal frag = True 2021-11-15T19:26:23.800 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal fragment size max = 10000 2021-11-15T19:26:23.800 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal merge size = 5 2021-11-15T19:26:23.800 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal split bits = 3 2021-11-15T19:26:23.800 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal split size = 100 2021-11-15T19:26:23.800 INFO:teuthology.orchestra.run.gibba011.stdout: mds debug frag = True 2021-11-15T19:26:23.801 INFO:teuthology.orchestra.run.gibba011.stdout: mds debug scatterstat = True 2021-11-15T19:26:23.801 INFO:teuthology.orchestra.run.gibba011.stdout: mds op complaint time = 180 2021-11-15T19:26:23.801 INFO:teuthology.orchestra.run.gibba011.stdout: mds verify scatter = True 2021-11-15T19:26:23.801 INFO:teuthology.orchestra.run.gibba011.stdout: osd op complaint time = 180 2021-11-15T19:26:23.801 INFO:teuthology.orchestra.run.gibba011.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.802 INFO:teuthology.orchestra.run.gibba011.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.805 INFO:teuthology.orchestra.run.gibba037.stdout:[global] 2021-11-15T19:26:23.805 INFO:teuthology.orchestra.run.gibba037.stdout: chdir = "" 2021-11-15T19:26:23.805 INFO:teuthology.orchestra.run.gibba037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:26:23.806 INFO:teuthology.orchestra.run.gibba037.stdout: auth supported = cephx 2021-11-15T19:26:23.806 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.806 INFO:teuthology.orchestra.run.gibba037.stdout: filestore xattr use omap = true 2021-11-15T19:26:23.806 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: mon clock drift allowed = 1.000 2021-11-15T19:26:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: osd crush chooseleaf type = 0 2021-11-15T19:26:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: auth debug = true 2021-11-15T19:26:23.807 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on old message = true 2021-11-15T19:26:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on bug = true 2021-11-15T19:26:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.808 INFO:teuthology.orchestra.run.gibba037.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:26:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: mon pg warn max object skew = 0 2021-11-15T19:26:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:26:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:26:23.809 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default size = 2 2021-11-15T19:26:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow primary affinity = true 2021-11-15T19:26:23.810 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow pg remap = true 2021-11-15T19:26:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:26:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:26:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on no sortbitwise = false 2021-11-15T19:26:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:26:23.811 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on too few osds = false 2021-11-15T19:26:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:26:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:26:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:26:23.812 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: osd default data pool replay window = 5 2021-11-15T19:26:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: mon allow pool delete = true 2021-11-15T19:26:23.813 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.814 INFO:teuthology.orchestra.run.gibba037.stdout: mon cluster log file level = debug 2021-11-15T19:26:23.814 INFO:teuthology.orchestra.run.gibba037.stdout: debug asserts on shutdown = true 2021-11-15T19:26:23.814 INFO:teuthology.orchestra.run.gibba037.stdout: mon health detail to clog = false 2021-11-15T19:26:23.814 INFO:teuthology.orchestra.run.gibba037.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:26:23.814 INFO:teuthology.orchestra.run.gibba037.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.815 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.815 INFO:teuthology.orchestra.run.gibba037.stdout:[osd] 2021-11-15T19:26:23.815 INFO:teuthology.orchestra.run.gibba037.stdout: osd journal size = 100 2021-11-15T19:26:23.815 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.816 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub load threshold = 5.0 2021-11-15T19:26:23.816 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub max interval = 600 2021-11-15T19:26:23.816 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.816 INFO:teuthology.orchestra.run.gibba037.stdout: osd recover clone overlap = true 2021-11-15T19:26:23.816 INFO:teuthology.orchestra.run.gibba037.stdout: osd recovery max chunk = 1048576 2021-11-15T19:26:23.817 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.817 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug shutdown = true 2021-11-15T19:26:23.817 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug op order = true 2021-11-15T19:26:23.817 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug verify stray on activate = true 2021-11-15T19:26:23.817 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.818 INFO:teuthology.orchestra.run.gibba037.stdout: osd open classes on start = true 2021-11-15T19:26:23.818 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug pg log writeout = true 2021-11-15T19:26:23.818 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.818 INFO:teuthology.orchestra.run.gibba037.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:26:23.819 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.819 INFO:teuthology.orchestra.run.gibba037.stdout: osd map max advance = 10 2021-11-15T19:26:23.819 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.819 INFO:teuthology.orchestra.run.gibba037.stdout: journal zero on create = true 2021-11-15T19:26:23.819 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.820 INFO:teuthology.orchestra.run.gibba037.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:26:23.820 INFO:teuthology.orchestra.run.gibba037.stdout: filestore apply finisher threads = 3 2021-11-15T19:26:23.820 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.820 INFO:teuthology.orchestra.run.gibba037.stdout: bdev debug aio = true 2021-11-15T19:26:23.820 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug misdirected ops = true 2021-11-15T19:26:23.821 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:26:23.821 INFO:teuthology.orchestra.run.gibba037.stdout: debug osd = 20 2021-11-15T19:26:23.821 INFO:teuthology.orchestra.run.gibba037.stdout: osd objectstore = filestore 2021-11-15T19:26:23.821 INFO:teuthology.orchestra.run.gibba037.stdout: osd op complaint time = 180 2021-11-15T19:26:23.822 INFO:teuthology.orchestra.run.gibba037.stdout: osd sloppy crc = True 2021-11-15T19:26:23.822 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.822 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr] 2021-11-15T19:26:23.822 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:26:23.822 INFO:teuthology.orchestra.run.gibba037.stdout: debug mgr = 20 2021-11-15T19:26:23.823 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-11-15T19:26:23.823 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-11-15T19:26:23.823 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.823 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.824 INFO:teuthology.orchestra.run.gibba037.stdout: mgr/telemetry/nag = false 2021-11-15T19:26:23.824 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.824 INFO:teuthology.orchestra.run.gibba037.stdout:[mon] 2021-11-15T19:26:23.824 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:26:23.824 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-11-15T19:26:23.825 INFO:teuthology.orchestra.run.gibba037.stdout: debug paxos = 20 2021-11-15T19:26:23.825 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-11-15T19:26:23.825 INFO:teuthology.orchestra.run.gibba037.stdout: mon data avail warn = 5 2021-11-15T19:26:23.825 INFO:teuthology.orchestra.run.gibba037.stdout: mon mgr mkfs grace = 240 2021-11-15T19:26:23.826 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.826 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd reporter subtree level = osd 2021-11-15T19:26:23.826 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd prime pg temp = true 2021-11-15T19:26:23.826 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.826 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.827 INFO:teuthology.orchestra.run.gibba037.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:26:23.827 INFO:teuthology.orchestra.run.gibba037.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:26:23.827 INFO:teuthology.orchestra.run.gibba037.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:26:23.827 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.828 INFO:teuthology.orchestra.run.gibba037.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:26:23.828 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:26:23.828 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:26:23.828 INFO:teuthology.orchestra.run.gibba037.stdout: mon op complaint time = 120 2021-11-15T19:26:23.828 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:23.829 INFO:teuthology.orchestra.run.gibba037.stdout:[client] 2021-11-15T19:26:23.829 INFO:teuthology.orchestra.run.gibba037.stdout: rgw cache enabled = true 2021-11-15T19:26:23.829 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable ops log = true 2021-11-15T19:26:23.829 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable usage log = true 2021-11-15T19:26:23.829 INFO:teuthology.orchestra.run.gibba037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:26:23.830 INFO:teuthology.orchestra.run.gibba037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:26:23.830 INFO:teuthology.orchestra.run.gibba037.stdout: client mount timeout = 600 2021-11-15T19:26:23.830 INFO:teuthology.orchestra.run.gibba037.stdout: debug client = 20 2021-11-15T19:26:23.830 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:26:23.831 INFO:teuthology.orchestra.run.gibba037.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.831 INFO:teuthology.orchestra.run.gibba037.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.831 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.a] 2021-11-15T19:26:23.831 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.b] 2021-11-15T19:26:23.831 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.c] 2021-11-15T19:26:23.832 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.a] 2021-11-15T19:26:23.832 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.b] 2021-11-15T19:26:23.832 INFO:teuthology.orchestra.run.gibba037.stdout:[mds] 2021-11-15T19:26:23.832 INFO:teuthology.orchestra.run.gibba037.stdout: debug mds = 20 2021-11-15T19:26:23.832 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:26:23.833 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal frag = True 2021-11-15T19:26:23.833 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal fragment size max = 10000 2021-11-15T19:26:23.833 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal merge size = 5 2021-11-15T19:26:23.833 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal split bits = 3 2021-11-15T19:26:23.833 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal split size = 100 2021-11-15T19:26:23.834 INFO:teuthology.orchestra.run.gibba037.stdout: mds debug frag = True 2021-11-15T19:26:23.834 INFO:teuthology.orchestra.run.gibba037.stdout: mds debug scatterstat = True 2021-11-15T19:26:23.834 INFO:teuthology.orchestra.run.gibba037.stdout: mds op complaint time = 180 2021-11-15T19:26:23.834 INFO:teuthology.orchestra.run.gibba037.stdout: mds verify scatter = True 2021-11-15T19:26:23.835 INFO:teuthology.orchestra.run.gibba037.stdout: osd op complaint time = 180 2021-11-15T19:26:23.835 INFO:teuthology.orchestra.run.gibba037.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.835 INFO:teuthology.orchestra.run.gibba037.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.835 INFO:teuthology.orchestra.run.gibba018.stdout:[global] 2021-11-15T19:26:23.835 INFO:teuthology.orchestra.run.gibba018.stdout: chdir = "" 2021-11-15T19:26:23.836 INFO:teuthology.orchestra.run.gibba018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:26:23.836 INFO:teuthology.orchestra.run.gibba018.stdout: auth supported = cephx 2021-11-15T19:26:23.836 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.836 INFO:teuthology.orchestra.run.gibba018.stdout: filestore xattr use omap = true 2021-11-15T19:26:23.837 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.837 INFO:teuthology.orchestra.run.gibba018.stdout: mon clock drift allowed = 1.000 2021-11-15T19:26:23.837 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.837 INFO:teuthology.orchestra.run.gibba018.stdout: osd crush chooseleaf type = 0 2021-11-15T19:26:23.837 INFO:teuthology.orchestra.run.gibba018.stdout: auth debug = true 2021-11-15T19:26:23.838 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.838 INFO:teuthology.orchestra.run.gibba018.stdout: ms die on old message = true 2021-11-15T19:26:23.838 INFO:teuthology.orchestra.run.gibba018.stdout: ms die on bug = true 2021-11-15T19:26:23.838 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.839 INFO:teuthology.orchestra.run.gibba018.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:26:23.839 INFO:teuthology.orchestra.run.gibba018.stdout: mon pg warn max object skew = 0 2021-11-15T19:26:23.839 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.839 INFO:teuthology.orchestra.run.gibba018.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:26:23.839 INFO:teuthology.orchestra.run.gibba018.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:26:23.840 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.840 INFO:teuthology.orchestra.run.gibba018.stdout: osd pool default size = 2 2021-11-15T19:26:23.840 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.840 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd allow primary affinity = true 2021-11-15T19:26:23.840 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd allow pg remap = true 2021-11-15T19:26:23.841 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:26:23.841 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:26:23.841 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on no sortbitwise = false 2021-11-15T19:26:23.841 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:26:23.842 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on too few osds = false 2021-11-15T19:26:23.842 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:26:23.842 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:26:23.842 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.842 INFO:teuthology.orchestra.run.gibba018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:26:23.843 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.843 INFO:teuthology.orchestra.run.gibba018.stdout: osd default data pool replay window = 5 2021-11-15T19:26:23.843 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.843 INFO:teuthology.orchestra.run.gibba018.stdout: mon allow pool delete = true 2021-11-15T19:26:23.843 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.844 INFO:teuthology.orchestra.run.gibba018.stdout: mon cluster log file level = debug 2021-11-15T19:26:23.844 INFO:teuthology.orchestra.run.gibba018.stdout: debug asserts on shutdown = true 2021-11-15T19:26:23.844 INFO:teuthology.orchestra.run.gibba018.stdout: mon health detail to clog = false 2021-11-15T19:26:23.844 INFO:teuthology.orchestra.run.gibba018.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:26:23.844 INFO:teuthology.orchestra.run.gibba018.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:26:23.845 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.845 INFO:teuthology.orchestra.run.gibba018.stdout:[osd] 2021-11-15T19:26:23.845 INFO:teuthology.orchestra.run.gibba018.stdout: osd journal size = 100 2021-11-15T19:26:23.845 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.846 INFO:teuthology.orchestra.run.gibba018.stdout: osd scrub load threshold = 5.0 2021-11-15T19:26:23.846 INFO:teuthology.orchestra.run.gibba018.stdout: osd scrub max interval = 600 2021-11-15T19:26:23.846 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.846 INFO:teuthology.orchestra.run.gibba018.stdout: osd recover clone overlap = true 2021-11-15T19:26:23.846 INFO:teuthology.orchestra.run.gibba018.stdout: osd recovery max chunk = 1048576 2021-11-15T19:26:23.847 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.847 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug shutdown = true 2021-11-15T19:26:23.847 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug op order = true 2021-11-15T19:26:23.847 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug verify stray on activate = true 2021-11-15T19:26:23.848 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.848 INFO:teuthology.orchestra.run.gibba018.stdout: osd open classes on start = true 2021-11-15T19:26:23.848 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug pg log writeout = true 2021-11-15T19:26:23.848 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.848 INFO:teuthology.orchestra.run.gibba018.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:26:23.849 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.849 INFO:teuthology.orchestra.run.gibba018.stdout: osd map max advance = 10 2021-11-15T19:26:23.849 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.849 INFO:teuthology.orchestra.run.gibba018.stdout: journal zero on create = true 2021-11-15T19:26:23.849 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.850 INFO:teuthology.orchestra.run.gibba018.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:26:23.850 INFO:teuthology.orchestra.run.gibba018.stdout: filestore apply finisher threads = 3 2021-11-15T19:26:23.850 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.850 INFO:teuthology.orchestra.run.gibba018.stdout: bdev debug aio = true 2021-11-15T19:26:23.851 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug misdirected ops = true 2021-11-15T19:26:23.851 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:26:23.851 INFO:teuthology.orchestra.run.gibba018.stdout: debug osd = 20 2021-11-15T19:26:23.851 INFO:teuthology.orchestra.run.gibba018.stdout: osd objectstore = filestore 2021-11-15T19:26:23.852 INFO:teuthology.orchestra.run.gibba018.stdout: osd op complaint time = 180 2021-11-15T19:26:23.852 INFO:teuthology.orchestra.run.gibba018.stdout: osd sloppy crc = True 2021-11-15T19:26:23.852 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.852 INFO:teuthology.orchestra.run.gibba018.stdout:[mgr] 2021-11-15T19:26:23.852 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:26:23.853 INFO:teuthology.orchestra.run.gibba018.stdout: debug mgr = 20 2021-11-15T19:26:23.853 INFO:teuthology.orchestra.run.gibba018.stdout: debug mon = 20 2021-11-15T19:26:23.853 INFO:teuthology.orchestra.run.gibba018.stdout: debug auth = 20 2021-11-15T19:26:23.853 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.853 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.854 INFO:teuthology.orchestra.run.gibba018.stdout: mgr/telemetry/nag = false 2021-11-15T19:26:23.854 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.854 INFO:teuthology.orchestra.run.gibba018.stdout:[mon] 2021-11-15T19:26:23.854 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:26:23.854 INFO:teuthology.orchestra.run.gibba018.stdout: debug mon = 20 2021-11-15T19:26:23.855 INFO:teuthology.orchestra.run.gibba018.stdout: debug paxos = 20 2021-11-15T19:26:23.855 INFO:teuthology.orchestra.run.gibba018.stdout: debug auth = 20 2021-11-15T19:26:23.855 INFO:teuthology.orchestra.run.gibba018.stdout: mon data avail warn = 5 2021-11-15T19:26:23.855 INFO:teuthology.orchestra.run.gibba018.stdout: mon mgr mkfs grace = 240 2021-11-15T19:26:23.856 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:26:23.856 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd reporter subtree level = osd 2021-11-15T19:26:23.856 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd prime pg temp = true 2021-11-15T19:26:23.856 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:26:23.856 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.857 INFO:teuthology.orchestra.run.gibba018.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:26:23.857 INFO:teuthology.orchestra.run.gibba018.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:26:23.857 INFO:teuthology.orchestra.run.gibba018.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:26:23.857 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.858 INFO:teuthology.orchestra.run.gibba018.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:26:23.858 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:26:23.858 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:26:23.858 INFO:teuthology.orchestra.run.gibba018.stdout: mon op complaint time = 120 2021-11-15T19:26:23.858 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:26:23.859 INFO:teuthology.orchestra.run.gibba018.stdout:[client] 2021-11-15T19:26:23.859 INFO:teuthology.orchestra.run.gibba018.stdout: rgw cache enabled = true 2021-11-15T19:26:23.859 INFO:teuthology.orchestra.run.gibba018.stdout: rgw enable ops log = true 2021-11-15T19:26:23.859 INFO:teuthology.orchestra.run.gibba018.stdout: rgw enable usage log = true 2021-11-15T19:26:23.860 INFO:teuthology.orchestra.run.gibba018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:26:23.860 INFO:teuthology.orchestra.run.gibba018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:26:23.860 INFO:teuthology.orchestra.run.gibba018.stdout: client mount timeout = 600 2021-11-15T19:26:23.860 INFO:teuthology.orchestra.run.gibba018.stdout: debug client = 20 2021-11-15T19:26:23.860 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:26:23.861 INFO:teuthology.orchestra.run.gibba018.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.861 INFO:teuthology.orchestra.run.gibba018.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.861 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.a] 2021-11-15T19:26:23.861 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.b] 2021-11-15T19:26:23.861 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.c] 2021-11-15T19:26:23.862 INFO:teuthology.orchestra.run.gibba018.stdout:[mds.a] 2021-11-15T19:26:23.862 INFO:teuthology.orchestra.run.gibba018.stdout:[mds.b] 2021-11-15T19:26:23.862 INFO:teuthology.orchestra.run.gibba018.stdout:[mds] 2021-11-15T19:26:23.862 INFO:teuthology.orchestra.run.gibba018.stdout: debug mds = 20 2021-11-15T19:26:23.863 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:26:23.863 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal frag = True 2021-11-15T19:26:23.863 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal fragment size max = 10000 2021-11-15T19:26:23.863 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal merge size = 5 2021-11-15T19:26:23.863 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal split bits = 3 2021-11-15T19:26:23.864 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal split size = 100 2021-11-15T19:26:23.864 INFO:teuthology.orchestra.run.gibba018.stdout: mds debug frag = True 2021-11-15T19:26:23.864 INFO:teuthology.orchestra.run.gibba018.stdout: mds debug scatterstat = True 2021-11-15T19:26:23.864 INFO:teuthology.orchestra.run.gibba018.stdout: mds op complaint time = 180 2021-11-15T19:26:23.864 INFO:teuthology.orchestra.run.gibba018.stdout: mds verify scatter = True 2021-11-15T19:26:23.865 INFO:teuthology.orchestra.run.gibba018.stdout: osd op complaint time = 180 2021-11-15T19:26:23.865 INFO:teuthology.orchestra.run.gibba018.stdout: rados mon op timeout = 15m 2021-11-15T19:26:23.865 INFO:teuthology.orchestra.run.gibba018.stdout: rados osd op timeout = 15m 2021-11-15T19:26:23.865 INFO:tasks.ceph:Creating admin key on mon.a... 2021-11-15T19:26:23.866 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-11-15T19:26:23.940 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-15T19:26:23.948 DEBUG:teuthology.orchestra.remote:gibba037:/etc/ceph/ceph.keyring is 206B 2021-11-15T19:26:23.965 DEBUG:teuthology.orchestra.remote:gibba037:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-11-15T19:26:23.975 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:26:23.975 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:23.975 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T19:26:23.976 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T19:26:23.987 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-11-15T19:26:23.987 DEBUG:teuthology.orchestra.run.gibba037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:24.037 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:26:24.037 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:24.038 DEBUG:teuthology.orchestra.run.gibba011:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T19:26:24.038 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T19:26:24.067 DEBUG:teuthology.orchestra.run.gibba011:> set -ex 2021-11-15T19:26:24.067 DEBUG:teuthology.orchestra.run.gibba011:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:24.071 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba031.front.sepia.ceph.com 2021-11-15T19:26:24.071 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:26:24.072 DEBUG:teuthology.orchestra.run.gibba031:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T19:26:24.072 DEBUG:teuthology.orchestra.run.gibba031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T19:26:24.089 DEBUG:teuthology.orchestra.run.gibba031:> set -ex 2021-11-15T19:26:24.089 DEBUG:teuthology.orchestra.run.gibba031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:24.137 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba018.front.sepia.ceph.com 2021-11-15T19:26:24.137 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:26:24.137 DEBUG:teuthology.orchestra.run.gibba018:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T19:26:24.138 DEBUG:teuthology.orchestra.run.gibba018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T19:26:24.155 DEBUG:teuthology.orchestra.run.gibba018:> set -ex 2021-11-15T19:26:24.155 DEBUG:teuthology.orchestra.run.gibba018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:24.159 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba017.front.sepia.ceph.com 2021-11-15T19:26:24.160 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:26:24.160 DEBUG:teuthology.orchestra.run.gibba017:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T19:26:24.160 DEBUG:teuthology.orchestra.run.gibba017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T19:26:24.177 DEBUG:teuthology.orchestra.run.gibba017:> set -ex 2021-11-15T19:26:24.178 DEBUG:teuthology.orchestra.run.gibba017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:24.222 INFO:tasks.ceph:Setting up mon nodes... 2021-11-15T19:26:24.223 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-15T19:26:24.223 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-11-15T19:26:24.248 INFO:teuthology.orchestra.run.gibba037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-11-15T19:26:24.249 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-11-15T19:26:24.325 INFO:teuthology.orchestra.run.gibba011.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-11-15T19:26:24.330 INFO:tasks.ceph:Setting up mds nodes... 2021-11-15T19:26:24.331 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-11-15T19:26:24.391 INFO:teuthology.orchestra.run.gibba037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-11-15T19:26:24.393 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-11-15T19:26:24.403 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-11-15T19:26:24.471 INFO:teuthology.orchestra.run.gibba011.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-11-15T19:26:24.474 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-11-15T19:26:24.483 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-15T19:26:24.484 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-11-15T19:26:24.519 INFO:teuthology.orchestra.run.gibba031.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-11-15T19:26:24.524 DEBUG:teuthology.orchestra.run.gibba018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-11-15T19:26:24.562 INFO:teuthology.orchestra.run.gibba018.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-11-15T19:26:24.567 DEBUG:teuthology.orchestra.run.gibba017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2021-11-15T19:26:24.606 INFO:teuthology.orchestra.run.gibba017.stdout:creating /etc/ceph/ceph.client.2.keyring 2021-11-15T19:26:24.611 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-15T19:26:24.612 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba011.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-11-15T19:26:24.612 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-11-15T19:26:24.623 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:24.624 INFO:tasks.ceph:role: osd.0 2021-11-15T19:26:24.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:26:24.624 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-15T19:26:24.663 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:24.663 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:24.663 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:24.664 INFO:teuthology.orchestra.run.gibba037.stdout: = reflink=1 2021-11-15T19:26:24.664 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:24.664 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:24.664 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:24.664 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:24.665 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:24.665 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:24.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-11-15T19:26:24.666 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-11-15T19:26:24.740 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-11-15T19:26:24.755 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:24.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:24.756 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-11-15T19:26:24.777 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:24.777 INFO:tasks.ceph:role: osd.1 2021-11-15T19:26:24.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:26:24.778 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-15T19:26:24.869 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:24.869 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:24.870 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:24.870 INFO:teuthology.orchestra.run.gibba037.stdout: = reflink=1 2021-11-15T19:26:24.870 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:24.870 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:24.870 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:24.871 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:24.871 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:24.871 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:24.872 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-11-15T19:26:24.873 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-11-15T19:26:24.886 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-11-15T19:26:24.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:24.891 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:24.891 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-11-15T19:26:24.897 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:24.897 INFO:tasks.ceph:role: osd.2 2021-11-15T19:26:24.898 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:26:24.898 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-15T19:26:24.989 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:24.990 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:24.990 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:24.991 INFO:teuthology.orchestra.run.gibba037.stdout: = reflink=1 2021-11-15T19:26:24.991 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:24.991 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:24.992 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:24.992 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:24.992 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:24.993 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:24.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-11-15T19:26:24.995 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-11-15T19:26:25.011 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-11-15T19:26:25.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:25.016 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:25.016 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-11-15T19:26:25.067 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:25.068 INFO:tasks.ceph:role: osd.3 2021-11-15T19:26:25.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T19:26:25.069 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-11-15T19:26:25.125 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:25.126 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:25.126 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:25.127 INFO:teuthology.orchestra.run.gibba037.stdout: = reflink=1 2021-11-15T19:26:25.127 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:25.127 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:25.128 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:25.129 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:25.129 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:25.129 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:25.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-11-15T19:26:25.132 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-11-15T19:26:25.164 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-11-15T19:26:25.220 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:25.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:25.221 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:25.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.318+0000 7f342bd60d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-11-15T19:26:25.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.318+0000 7f342bd60d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-11-15T19:26:25.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.326+0000 7f342bd60d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.326+0000 7f342bd60d80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.406+0000 7f342bd60d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.406+0000 7f342bd60d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.406+0000 7f342bd60d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.424 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-11-15T19:26:25.431 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:25.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.514+0000 7fa105190d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-11-15T19:26:25.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.514+0000 7fa105190d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-11-15T19:26:25.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.526+0000 7fa105190d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.526+0000 7fa105190d80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:25.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.606+0000 7fa105190d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.606+0000 7fa105190d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.606+0000 7fa105190d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.623 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-11-15T19:26:25.645 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:25.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.670+0000 7f021a639d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-11-15T19:26:25.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.670+0000 7f021a639d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-11-15T19:26:25.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.678+0000 7f021a639d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.678+0000 7f021a639d80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:25.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.750+0000 7f021a639d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.750+0000 7f021a639d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.750+0000 7f021a639d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.781 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-11-15T19:26:25.802 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:25.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.898+0000 7f835f750d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-11-15T19:26:25.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.898+0000 7f835f750d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-11-15T19:26:25.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.906+0000 7f835f750d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.906+0000 7f835f750d80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.990+0000 7f835f750d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.990+0000 7f835f750d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:25.990+0000 7f835f750d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:26.022 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-11-15T19:26:26.044 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-11-15T19:26:26.055 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:26.056 INFO:tasks.ceph:role: osd.4 2021-11-15T19:26:26.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:26:26.056 DEBUG:teuthology.orchestra.run.gibba011:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-15T19:26:26.140 INFO:teuthology.orchestra.run.gibba011.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:26.140 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:26.140 INFO:teuthology.orchestra.run.gibba011.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:26.141 INFO:teuthology.orchestra.run.gibba011.stdout: = reflink=1 2021-11-15T19:26:26.141 INFO:teuthology.orchestra.run.gibba011.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:26.141 INFO:teuthology.orchestra.run.gibba011.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:26.141 INFO:teuthology.orchestra.run.gibba011.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:26.142 INFO:teuthology.orchestra.run.gibba011.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:26.142 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:26.142 INFO:teuthology.orchestra.run.gibba011.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:26.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba011.front.sepia.ceph.com -o noatime 2021-11-15T19:26:26.144 DEBUG:teuthology.orchestra.run.gibba011:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-11-15T19:26:26.173 DEBUG:teuthology.orchestra.run.gibba011:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-11-15T19:26:26.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:26.184 INFO:teuthology.orchestra.run.gibba011.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:26.184 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-11-15T19:26:26.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:26.190 INFO:tasks.ceph:role: osd.5 2021-11-15T19:26:26.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:26:26.191 DEBUG:teuthology.orchestra.run.gibba011:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-15T19:26:26.277 INFO:teuthology.orchestra.run.gibba011.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:26.277 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:26.277 INFO:teuthology.orchestra.run.gibba011.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:26.278 INFO:teuthology.orchestra.run.gibba011.stdout: = reflink=1 2021-11-15T19:26:26.278 INFO:teuthology.orchestra.run.gibba011.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:26.278 INFO:teuthology.orchestra.run.gibba011.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:26.278 INFO:teuthology.orchestra.run.gibba011.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:26.279 INFO:teuthology.orchestra.run.gibba011.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:26.279 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:26.279 INFO:teuthology.orchestra.run.gibba011.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:26.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba011.front.sepia.ceph.com -o noatime 2021-11-15T19:26:26.281 DEBUG:teuthology.orchestra.run.gibba011:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-11-15T19:26:26.310 DEBUG:teuthology.orchestra.run.gibba011:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-11-15T19:26:26.324 INFO:teuthology.orchestra.run.gibba011.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:26.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:26.325 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-11-15T19:26:26.380 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:26.380 INFO:tasks.ceph:role: osd.6 2021-11-15T19:26:26.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:26:26.381 DEBUG:teuthology.orchestra.run.gibba011:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-15T19:26:26.421 INFO:teuthology.orchestra.run.gibba011.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:26.422 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:26.422 INFO:teuthology.orchestra.run.gibba011.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:26.422 INFO:teuthology.orchestra.run.gibba011.stdout: = reflink=1 2021-11-15T19:26:26.422 INFO:teuthology.orchestra.run.gibba011.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:26.423 INFO:teuthology.orchestra.run.gibba011.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:26.423 INFO:teuthology.orchestra.run.gibba011.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:26.423 INFO:teuthology.orchestra.run.gibba011.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:26.423 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:26.424 INFO:teuthology.orchestra.run.gibba011.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:26.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba011.front.sepia.ceph.com -o noatime 2021-11-15T19:26:26.425 DEBUG:teuthology.orchestra.run.gibba011:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-11-15T19:26:26.444 DEBUG:teuthology.orchestra.run.gibba011:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-11-15T19:26:26.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:26.495 INFO:teuthology.orchestra.run.gibba011.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:26.496 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-11-15T19:26:26.502 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T19:26:26.502 INFO:tasks.ceph:role: osd.7 2021-11-15T19:26:26.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T19:26:26.503 DEBUG:teuthology.orchestra.run.gibba011:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-11-15T19:26:26.544 INFO:teuthology.orchestra.run.gibba011.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T19:26:26.545 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T19:26:26.545 INFO:teuthology.orchestra.run.gibba011.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T19:26:26.545 INFO:teuthology.orchestra.run.gibba011.stdout: = reflink=1 2021-11-15T19:26:26.545 INFO:teuthology.orchestra.run.gibba011.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T19:26:26.545 INFO:teuthology.orchestra.run.gibba011.stdout: = sunit=0 swidth=0 blks 2021-11-15T19:26:26.546 INFO:teuthology.orchestra.run.gibba011.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T19:26:26.546 INFO:teuthology.orchestra.run.gibba011.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T19:26:26.546 INFO:teuthology.orchestra.run.gibba011.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T19:26:26.546 INFO:teuthology.orchestra.run.gibba011.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T19:26:26.548 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba011.front.sepia.ceph.com -o noatime 2021-11-15T19:26:26.548 DEBUG:teuthology.orchestra.run.gibba011:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-11-15T19:26:26.621 DEBUG:teuthology.orchestra.run.gibba011:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-11-15T19:26:26.636 INFO:teuthology.orchestra.run.gibba011.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T19:26:26.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:26:26.637 DEBUG:teuthology.orchestra.run.gibba011:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:26.747 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.742+0000 7fe482c65d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-11-15T19:26:26.747 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.742+0000 7fe482c65d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-11-15T19:26:26.757 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.750+0000 7fe482c65d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:26.757 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.750+0000 7fe482c65d80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:26.820 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.814+0000 7fe482c65d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:26.821 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.814+0000 7fe482c65d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:26.821 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.814+0000 7fe482c65d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:26.836 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-11-15T19:26:26.855 DEBUG:teuthology.orchestra.run.gibba011:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:26.913 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.906+0000 7fa37d65ed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-11-15T19:26:26.913 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.906+0000 7fa37d65ed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-11-15T19:26:26.922 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.918+0000 7fa37d65ed80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:26.923 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.918+0000 7fa37d65ed80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:27.002 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.998+0000 7fa37d65ed80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:27.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.998+0000 7fa37d65ed80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:27.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:26.998+0000 7fa37d65ed80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:27.026 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-11-15T19:26:27.047 DEBUG:teuthology.orchestra.run.gibba011:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:27.108 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.102+0000 7fa5a1c39d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-11-15T19:26:27.109 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.102+0000 7fa5a1c39d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-11-15T19:26:27.118 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.114+0000 7fa5a1c39d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:27.118 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.114+0000 7fa5a1c39d80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:27.190 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.182+0000 7fa5a1c39d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:27.190 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.182+0000 7fa5a1c39d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:27.191 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.182+0000 7fa5a1c39d80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:27.197 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-11-15T19:26:27.203 DEBUG:teuthology.orchestra.run.gibba011:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:27.265 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.258+0000 7fcaa6cdbd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-11-15T19:26:27.265 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.258+0000 7fcaa6cdbd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-11-15T19:26:27.271 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.266+0000 7fcaa6cdbd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:27.271 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.266+0000 7fcaa6cdbd80 -1 journal FileJournal::_open_file : zeroing journal 2021-11-15T19:26:27.349 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.342+0000 7fcaa6cdbd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:27.349 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.342+0000 7fcaa6cdbd80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:27.349 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:27.342+0000 7fcaa6cdbd80 -1 journal do_read_entry(4096): bad header magic 2021-11-15T19:26:27.354 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-11-15T19:26:27.360 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-15T19:26:27.361 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:27.370 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.kLMZeP0zeZ 2021-11-15T19:26:27.371 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.kLMZeP0zeZ 2021-11-15T19:26:27.420 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.kLMZeP0zeZ 2021-11-15T19:26:27.438 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.kLMZeP0zeZ is 56B 2021-11-15T19:26:27.452 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.kLMZeP0zeZ 2021-11-15T19:26:27.461 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:27.513 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.RD6tev2xdC 2021-11-15T19:26:27.514 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.RD6tev2xdC 2021-11-15T19:26:27.536 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.RD6tev2xdC 2021-11-15T19:26:27.621 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.RD6tev2xdC is 56B 2021-11-15T19:26:27.635 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.RD6tev2xdC 2021-11-15T19:26:27.639 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:27.684 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.xjU5B5YvFE 2021-11-15T19:26:27.685 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.xjU5B5YvFE 2021-11-15T19:26:27.694 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.xjU5B5YvFE 2021-11-15T19:26:27.709 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.xjU5B5YvFE is 56B 2021-11-15T19:26:27.758 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.xjU5B5YvFE 2021-11-15T19:26:27.764 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:27.769 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.qPUpHW4Pf4 2021-11-15T19:26:27.769 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.qPUpHW4Pf4 2021-11-15T19:26:27.834 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.qPUpHW4Pf4 2021-11-15T19:26:27.869 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.qPUpHW4Pf4 is 56B 2021-11-15T19:26:27.888 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.qPUpHW4Pf4 2021-11-15T19:26:27.897 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:27.949 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.fylhnDfFPb 2021-11-15T19:26:27.949 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.fylhnDfFPb 2021-11-15T19:26:27.971 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.fylhnDfFPb 2021-11-15T19:26:28.048 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.fylhnDfFPb is 56B 2021-11-15T19:26:28.068 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.fylhnDfFPb 2021-11-15T19:26:28.076 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:28.124 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.bZZCpX9vSj 2021-11-15T19:26:28.125 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.bZZCpX9vSj 2021-11-15T19:26:28.147 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.bZZCpX9vSj 2021-11-15T19:26:28.224 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.bZZCpX9vSj is 56B 2021-11-15T19:26:28.244 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.bZZCpX9vSj 2021-11-15T19:26:28.252 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:28.261 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.ymfHVUyH3U 2021-11-15T19:26:28.262 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.ymfHVUyH3U 2021-11-15T19:26:28.314 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.ymfHVUyH3U 2021-11-15T19:26:28.333 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.ymfHVUyH3U is 56B 2021-11-15T19:26:28.347 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.ymfHVUyH3U 2021-11-15T19:26:28.351 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:28.398 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.DJjBgttwhm 2021-11-15T19:26:28.399 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.DJjBgttwhm 2021-11-15T19:26:28.408 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.DJjBgttwhm 2021-11-15T19:26:28.464 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.DJjBgttwhm is 56B 2021-11-15T19:26:28.476 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.DJjBgttwhm 2021-11-15T19:26:28.482 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:28.534 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.Bb40OUyLvx 2021-11-15T19:26:28.534 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Bb40OUyLvx 2021-11-15T19:26:28.556 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.Bb40OUyLvx 2021-11-15T19:26:28.633 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.Bb40OUyLvx is 56B 2021-11-15T19:26:28.653 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.Bb40OUyLvx 2021-11-15T19:26:28.661 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:28.713 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.LfmENmIbk7 2021-11-15T19:26:28.714 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.LfmENmIbk7 2021-11-15T19:26:28.736 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.LfmENmIbk7 2021-11-15T19:26:28.813 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.LfmENmIbk7 is 56B 2021-11-15T19:26:28.832 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.LfmENmIbk7 2021-11-15T19:26:28.840 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:28.889 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.GJouiCjSIZ 2021-11-15T19:26:28.890 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.GJouiCjSIZ 2021-11-15T19:26:28.912 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.GJouiCjSIZ 2021-11-15T19:26:28.989 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.GJouiCjSIZ is 56B 2021-11-15T19:26:29.009 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.GJouiCjSIZ 2021-11-15T19:26:29.017 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:29.069 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.4bbfjdQE1v 2021-11-15T19:26:29.070 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.4bbfjdQE1v 2021-11-15T19:26:29.092 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.4bbfjdQE1v 2021-11-15T19:26:29.169 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.4bbfjdQE1v is 56B 2021-11-15T19:26:29.183 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.4bbfjdQE1v 2021-11-15T19:26:29.199 DEBUG:teuthology.orchestra.remote:gibba031:/etc/ceph/ceph.client.0.keyring is 59B 2021-11-15T19:26:29.265 DEBUG:teuthology.orchestra.remote:gibba018:/etc/ceph/ceph.client.1.keyring is 59B 2021-11-15T19:26:29.328 DEBUG:teuthology.orchestra.remote:gibba017:/etc/ceph/ceph.client.2.keyring is 59B 2021-11-15T19:26:29.382 INFO:tasks.ceph:Adding keys to all mons... 2021-11-15T19:26:29.383 DEBUG:teuthology.orchestra.run.gibba011:> sudo tee -a /etc/ceph/ceph.keyring 2021-11-15T19:26:29.386 DEBUG:teuthology.orchestra.run.gibba037:> sudo tee -a /etc/ceph/ceph.keyring 2021-11-15T19:26:29.394 INFO:teuthology.orchestra.run.gibba011.stdout:[mgr.y] 2021-11-15T19:26:29.394 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA== 2021-11-15T19:26:29.394 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.a] 2021-11-15T19:26:29.394 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw== 2021-11-15T19:26:29.395 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.0] 2021-11-15T19:26:29.395 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg== 2021-11-15T19:26:29.395 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.1] 2021-11-15T19:26:29.395 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g== 2021-11-15T19:26:29.396 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.2] 2021-11-15T19:26:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ== 2021-11-15T19:26:29.396 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.3] 2021-11-15T19:26:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ== 2021-11-15T19:26:29.397 INFO:teuthology.orchestra.run.gibba011.stdout:[mgr.x] 2021-11-15T19:26:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg== 2021-11-15T19:26:29.397 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.b] 2021-11-15T19:26:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA== 2021-11-15T19:26:29.397 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.4] 2021-11-15T19:26:29.398 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q== 2021-11-15T19:26:29.398 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.5] 2021-11-15T19:26:29.398 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A== 2021-11-15T19:26:29.398 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.6] 2021-11-15T19:26:29.399 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA== 2021-11-15T19:26:29.399 INFO:teuthology.orchestra.run.gibba011.stdout:[osd.7] 2021-11-15T19:26:29.399 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw== 2021-11-15T19:26:29.399 INFO:teuthology.orchestra.run.gibba011.stdout:[client.0] 2021-11-15T19:26:29.400 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg== 2021-11-15T19:26:29.400 INFO:teuthology.orchestra.run.gibba011.stdout:[client.1] 2021-11-15T19:26:29.400 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ== 2021-11-15T19:26:29.400 INFO:teuthology.orchestra.run.gibba011.stdout:[client.2] 2021-11-15T19:26:29.400 INFO:teuthology.orchestra.run.gibba011.stdout: key = AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag== 2021-11-15T19:26:29.402 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr.y] 2021-11-15T19:26:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA== 2021-11-15T19:26:29.403 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.a] 2021-11-15T19:26:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw== 2021-11-15T19:26:29.403 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.0] 2021-11-15T19:26:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg== 2021-11-15T19:26:29.404 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.1] 2021-11-15T19:26:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g== 2021-11-15T19:26:29.404 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.2] 2021-11-15T19:26:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ== 2021-11-15T19:26:29.405 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.3] 2021-11-15T19:26:29.405 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ== 2021-11-15T19:26:29.405 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr.x] 2021-11-15T19:26:29.405 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg== 2021-11-15T19:26:29.406 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.b] 2021-11-15T19:26:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA== 2021-11-15T19:26:29.406 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.4] 2021-11-15T19:26:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q== 2021-11-15T19:26:29.407 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.5] 2021-11-15T19:26:29.407 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A== 2021-11-15T19:26:29.407 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.6] 2021-11-15T19:26:29.407 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA== 2021-11-15T19:26:29.407 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.7] 2021-11-15T19:26:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw== 2021-11-15T19:26:29.408 INFO:teuthology.orchestra.run.gibba037.stdout:[client.0] 2021-11-15T19:26:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg== 2021-11-15T19:26:29.408 INFO:teuthology.orchestra.run.gibba037.stdout:[client.1] 2021-11-15T19:26:29.409 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ== 2021-11-15T19:26:29.409 INFO:teuthology.orchestra.run.gibba037.stdout:[client.2] 2021-11-15T19:26:29.409 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag== 2021-11-15T19:26:29.409 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T19:26:29.412 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T19:26:29.432 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T19:26:29.475 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T19:26:29.515 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.517 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.553 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.591 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.647 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.649 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.739 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.743 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.793 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T19:26:29.796 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T19:26:29.834 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T19:26:29.836 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T19:26:29.866 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.903 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.948 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:29.951 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:30.029 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:30.032 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:30.081 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:30.084 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T19:26:30.112 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T19:26:30.211 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T19:26:30.248 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T19:26:30.290 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T19:26:30.329 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T19:26:30.373 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T19:26:30.443 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-15T19:26:30.444 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-11-15T19:26:30.465 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-15T19:26:30.542 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-11-15T19:26:30.551 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-11-15T19:26:30.573 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-15T19:26:30.663 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-11-15T19:26:30.669 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-11-15T19:26:30.676 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-15T19:26:30.751 DEBUG:teuthology.orchestra.run.gibba011:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-11-15T19:26:30.757 DEBUG:teuthology.orchestra.run.gibba011:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:30.760 DEBUG:teuthology.orchestra.run.gibba037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-11-15T19:26:30.769 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-11-15T19:26:30.769 INFO:tasks.ceph.mon.a:Restarting daemon 2021-11-15T19:26:30.770 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-11-15T19:26:30.772 INFO:tasks.ceph.mon.a:Started 2021-11-15T19:26:30.773 INFO:tasks.ceph.mon.b:Restarting daemon 2021-11-15T19:26:30.773 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-11-15T19:26:30.808 INFO:tasks.ceph.mon.b:Started 2021-11-15T19:26:30.808 INFO:tasks.ceph.mon.c:Restarting daemon 2021-11-15T19:26:30.809 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-11-15T19:26:30.811 INFO:tasks.ceph.mon.c:Started 2021-11-15T19:26:30.811 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-11-15T19:26:30.811 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-11-15T19:26:30.812 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-11-15T19:26:30.814 INFO:tasks.ceph.mgr.y:Started 2021-11-15T19:26:30.814 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-11-15T19:26:30.814 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-11-15T19:26:30.816 INFO:tasks.ceph.mgr.x:Started 2021-11-15T19:26:30.816 INFO:tasks.ceph:Setting crush tunables to default 2021-11-15T19:26:30.817 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster ceph osd crush tunables default 2021-11-15T19:26:30.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 Processor -- start 2021-11-15T19:26:30.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 -- start start 2021-11-15T19:26:30.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:30.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:30.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b005cb50 con 0x7f23b005c770 2021-11-15T19:26:30.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00b1650 con 0x7f23b00b0550 2021-11-15T19:26:30.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.858+0000 7f23b823c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00ad030 con 0x7f23b014aaa0 2021-11-15T19:26:30.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b57d7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:30.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b67d9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:30.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b5fd8700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f23b005c770 0x7f23b00aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:41776/0 (socket says 172.21.2.137:41776) 2021-11-15T19:26:30.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b57d7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:37734/0 (socket says 172.21.2.137:37734) 2021-11-15T19:26:30.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b67d9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:60306/0 (socket says 172.21.2.137:60306) 2021-11-15T19:26:30.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 learned_addr learned my addr 172.21.2.137:0/375404804 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:30.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T19:26:30.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:30.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:30.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T19:26:30.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:30.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:30.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:30.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:30.862+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T19:26:31.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:31.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:31.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T19:26:31.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:31.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:31.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:31.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:31.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:31.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T19:26:31.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.066+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T19:26:31.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:31.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:31.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T19:26:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:31.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T19:26:31.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:31.466+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T19:26:32.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T19:26:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T19:26:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:32.270+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T19:26:33.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 msgr2=0x7f23b0140aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T19:26:33.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b014aaa0 0x7f23b0140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:33.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 msgr2=0x7f23b014a5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T19:26:33.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f23b00b0550 0x7f23b014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:33.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> v1:172.21.2.111:6789/0 conn(0x7f23b005c770 legacy=0x7f23b00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:33.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:33.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b00ad2d0 con 0x7f2390005e30 2021-11-15T19:26:33.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00b1650 con 0x7f23900033f0 2021-11-15T19:26:33.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:33.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:33.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:33.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:33.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:33.862+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T19:26:34.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.062+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:34.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.062+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:34.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.062+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:34.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.062+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:34.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.062+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T19:26:34.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.466+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:34.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.466+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.466+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.466+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:34.466+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T19:26:35.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:35.266+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:35.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:35.266+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:35.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:35.266+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:35.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:35.266+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:35.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:35.266+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T19:26:36.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 msgr2=0x7f2390005850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T19:26:36.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f23900033f0 0x7f2390005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:36.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> v1:172.21.2.137:6789/0 conn(0x7f2390005e30 legacy=0x7f23900082f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:36.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:36.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 reap_dead start 2021-11-15T19:26:36.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:36.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239000abe0 con 0x7f2390005920 2021-11-15T19:26:36.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00b1650 con 0x7f2390009ca0 2021-11-15T19:26:36.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00ad030 con 0x7f239000a700 2021-11-15T19:26:36.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:36.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:36.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:36.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:36.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T19:26:36.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:36.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T19:26:36.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:36.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:36.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:36.866+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T19:26:37.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.066+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:37.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.066+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:37.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.066+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:37.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.066+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:37.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.066+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T19:26:37.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.070+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:37.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.070+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T19:26:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.070+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.070+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.070+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T19:26:37.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:37.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:37.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:37.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:37.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T19:26:37.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:37.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:37.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:37.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:37.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:37.470+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T19:26:38.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:38.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:38.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:38.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:38.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T19:26:38.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:38.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T19:26:38.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:38.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:38.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:38.274+0000 7f23b67d9700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T19:26:39.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 msgr2=0x7f2390008ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T19:26:39.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239000a700 0x7f2390008ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:39.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 msgr2=0x7f239000a080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T19:26:39.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.137:3300/0 conn(0x7f2390009ca0 0x7f239000a080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:39.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 >> v1:172.21.2.111:6789/0 conn(0x7f2390005920 legacy=0x7f239000cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:39.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:39.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390008410 con 0x7f2390009200 2021-11-15T19:26:39.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23a37fe700 1 -- 172.21.2.137:0/375404804 --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00b1650 con 0x7f2390009610 2021-11-15T19:26:39.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:39.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 msgr2=0x7f2390007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T19:26:39.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 msgr2=0x7f2390007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:39.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:39.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:39.862+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T19:26:40.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.066+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:40.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.066+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 msgr2=0x7f2390007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T19:26:40.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.066+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 msgr2=0x7f2390007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:40.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.066+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:40.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.066+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T19:26:40.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.470+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:40.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.470+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 msgr2=0x7f2390007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T19:26:40.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.470+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 msgr2=0x7f2390007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T19:26:40.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.470+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T19:26:40.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.470+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T19:26:40.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.810+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v1:172.21.2.137:6789/0 conn(0x7f2390009200 legacy=0x7f23900072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-11-15T19:26:40.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.810+0000 7f23b5fd8700 1 -- 172.21.2.137:0/375404804 >> v1:172.21.2.137:6789/0 conn(0x7f2390009200 legacy=0x7f23900072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-11-15T19:26:40.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.810+0000 7f23b5fd8700 1 --1- 172.21.2.137:0/375404804 >> v1:172.21.2.137:6789/0 conn(0x7f2390009200 0x7f23900072f0 :-1 s=OPENED pgs=10 cs=1 l=1).handle_message read tag failed 2021-11-15T19:26:40.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:40.810+0000 7f23b5fd8700 1 --1- 172.21.2.137:0/375404804 >> v1:172.21.2.137:6789/0 conn(0x7f2390009200 0x7f23900072f0 :-1 s=OPENED pgs=10 cs=1 l=1).fault on lossy channel, failing 2021-11-15T19:26:41.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.274+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> v2:172.21.2.111:3300/0 conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:41.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.274+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 >> v1:172.21.2.137:6789/0 conn(0x7f2390009200 legacy=0x7f23900072f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-11-15T19:26:41.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.274+0000 7f23b57d7700 1 -- 172.21.2.137:0/375404804 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390007f50 con 0x7f2390009610 2021-11-15T19:26:41.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.274+0000 7f23b57d7700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2390009610 0x7f2390007a00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2390008300 tx=0x7f23ac008040).ready entity=mon.0 client_cookie=d2d1e91e5afb670e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:41.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b4fd6700 1 -- 172.21.2.137:0/375404804 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23ac0197e0 con 0x7f2390009610 2021-11-15T19:26:41.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b4fd6700 1 -- 172.21.2.137:0/375404804 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac019940 con 0x7f2390009610 2021-11-15T19:26:41.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b4fd6700 1 -- 172.21.2.137:0/375404804 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23ac019ca0 con 0x7f2390009610 2021-11-15T19:26:41.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 -- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2390009610 msgr2=0x7f2390007a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:41.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2390009610 0x7f2390007a00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2390008300 tx=0x7f23ac008040).stop 2021-11-15T19:26:41.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b67d9700 1 -- 172.21.2.137:0/375404804 reap_dead start 2021-11-15T19:26:41.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 -- 172.21.2.137:0/375404804 shutdown_connections 2021-11-15T19:26:41.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 --2- 172.21.2.137:0/375404804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2390009610 0x7f2390007a00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:41.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 -- 172.21.2.137:0/375404804 >> 172.21.2.137:0/375404804 conn(0x7f23b00631e0 msgr2=0x7f23b005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:41.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 -- 172.21.2.137:0/375404804 shutdown_connections 2021-11-15T19:26:41.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.278+0000 7f23b823c700 1 -- 172.21.2.137:0/375404804 wait complete. 2021-11-15T19:26:41.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.282+0000 7f23b823c700 1 Processor -- start 2021-11-15T19:26:41.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.282+0000 7f23b823c700 1 -- start start 2021-11-15T19:26:41.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2390009610 0x7f23b0066e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:41.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 0x7f23b01599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:41.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b0141b60 0x7f23b0142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:41.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0141720 con 0x7f23b0141b60 2021-11-15T19:26:41.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0159ec0 con 0x7f23b0065800 2021-11-15T19:26:41.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01474b0 con 0x7f2390009610 2021-11-15T19:26:41.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 0x7f23b01599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:41.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 0x7f23b01599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:58840/0 (socket says 172.21.2.137:58840) 2021-11-15T19:26:41.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 -- 172.21.2.137:0/218950325 learned_addr learned my addr 172.21.2.137:0/218950325 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:41.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b5fd8700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2390009610 0x7f23b0066e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:41.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 -- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2390009610 msgr2=0x7f23b0066e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:41.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2390009610 0x7f23b0066e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:41.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 -- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b0141b60 msgr2=0x7f23b0142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:41.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b0141b60 0x7f23b0142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:41.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 -- 172.21.2.137:0/218950325 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239000abe0 con 0x7f23b0065800 2021-11-15T19:26:41.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b57d7700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 0x7f23b01599d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2390008300 tx=0x7f23ac024000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:41.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23ac026040 con 0x7f23b0065800 2021-11-15T19:26:41.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac000e90 con 0x7f23b0065800 2021-11-15T19:26:41.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23ac02b630 con 0x7f23b0065800 2021-11-15T19:26:41.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b0147750 con 0x7f23b0065800 2021-11-15T19:26:41.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b00674a0 con 0x7f23b0065800 2021-11-15T19:26:41.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f23ac012040 con 0x7f23b0065800 2021-11-15T19:26:41.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f23ac02b920 con 0x7f23b0065800 2021-11-15T19:26:41.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b01472d0 con 0x7f23b0065800 2021-11-15T19:26:41.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.286+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f23ac034450 con 0x7f23b0065800 2021-11-15T19:26:41.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.330+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f23b0147910 con 0x7f23b0065800 2021-11-15T19:26:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23a2ffd700 1 -- 172.21.2.137:0/218950325 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f23ac019030 con 0x7f23b0065800 2021-11-15T19:26:41.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 msgr2=0x7f23b01599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 0x7f23b01599d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2390008300 tx=0x7f23ac024000).stop 2021-11-15T19:26:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 shutdown_connections 2021-11-15T19:26:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b0141b60 0x7f23b0142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b0065800 0x7f23b01599d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 --2- 172.21.2.137:0/218950325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2390009610 0x7f23b0066e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 >> 172.21.2.137:0/218950325 conn(0x7f23b00631e0 msgr2=0x7f23b01432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 shutdown_connections 2021-11-15T19:26:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:41.342+0000 7f23b823c700 1 -- 172.21.2.137:0/218950325 wait complete. 2021-11-15T19:26:41.355 INFO:teuthology.orchestra.run.gibba037.stderr:adjusted tunables profile to default 2021-11-15T19:26:41.365 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-11-15T19:26:41.365 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:41.369 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.ViaFU3Gt4f 2021-11-15T19:26:41.369 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.ViaFU3Gt4f 2021-11-15T19:26:41.376 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.ViaFU3Gt4f 2021-11-15T19:26:41.432 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.ViaFU3Gt4f is 37B 2021-11-15T19:26:41.444 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.ViaFU3Gt4f 2021-11-15T19:26:41.451 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:41.504 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.aChQUxrlV9 2021-11-15T19:26:41.504 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.aChQUxrlV9 2021-11-15T19:26:41.516 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.aChQUxrlV9 2021-11-15T19:26:41.574 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.aChQUxrlV9 is 37B 2021-11-15T19:26:41.582 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.aChQUxrlV9 2021-11-15T19:26:41.585 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:41.588 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.fyrk50qsKz 2021-11-15T19:26:41.588 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.fyrk50qsKz 2021-11-15T19:26:41.634 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.fyrk50qsKz 2021-11-15T19:26:41.644 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.fyrk50qsKz is 37B 2021-11-15T19:26:41.695 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.fyrk50qsKz 2021-11-15T19:26:41.699 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T19:26:41.745 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.SW9JwmUpy6 2021-11-15T19:26:41.746 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.SW9JwmUpy6 2021-11-15T19:26:41.763 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.SW9JwmUpy6 2021-11-15T19:26:41.834 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.SW9JwmUpy6 is 37B 2021-11-15T19:26:41.842 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.SW9JwmUpy6 2021-11-15T19:26:41.845 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:41.849 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.irYC4FUqqP 2021-11-15T19:26:41.849 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.irYC4FUqqP 2021-11-15T19:26:41.895 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.irYC4FUqqP 2021-11-15T19:26:41.905 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.irYC4FUqqP is 37B 2021-11-15T19:26:41.913 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.irYC4FUqqP 2021-11-15T19:26:41.916 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:41.960 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.S3fzRlgYSi 2021-11-15T19:26:41.960 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.S3fzRlgYSi 2021-11-15T19:26:41.966 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.S3fzRlgYSi 2021-11-15T19:26:42.019 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.S3fzRlgYSi is 37B 2021-11-15T19:26:42.028 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.S3fzRlgYSi 2021-11-15T19:26:42.035 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:42.080 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.LkrtMEerp8 2021-11-15T19:26:42.080 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.LkrtMEerp8 2021-11-15T19:26:42.086 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.LkrtMEerp8 2021-11-15T19:26:42.097 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.LkrtMEerp8 is 37B 2021-11-15T19:26:42.110 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.LkrtMEerp8 2021-11-15T19:26:42.114 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T19:26:42.160 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.K8LRx4SCdI 2021-11-15T19:26:42.160 DEBUG:teuthology.orchestra.run.gibba011:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.K8LRx4SCdI 2021-11-15T19:26:42.166 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.K8LRx4SCdI 2021-11-15T19:26:42.218 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.K8LRx4SCdI is 37B 2021-11-15T19:26:42.226 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.K8LRx4SCdI 2021-11-15T19:26:42.229 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new ab1f21b4-4df4-4fd6-9920-85e4abe60cd5 0 2021-11-15T19:26:42.319 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 Processor -- start 2021-11-15T19:26:42.320 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- start start 2021-11-15T19:26:42.321 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f27ac05c5d0 0x7f27ac143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.322 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f27ac0b1800 0x7f27ac139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.322 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac062a20 con 0x7f27ac0b0fd0 2021-11-15T19:26:42.322 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ac142f70 con 0x7f27ac05c5d0 2021-11-15T19:26:42.322 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ac143210 con 0x7f27ac0b1800 2021-11-15T19:26:42.323 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f27ac05c5d0 0x7f27ac143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.323 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f27ac05c5d0 0x7f27ac143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54750/0 (socket says 172.21.2.111:54750) 2021-11-15T19:26:42.323 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 -- 172.21.2.111:0/3292593795 learned_addr learned my addr 172.21.2.111:0/3292593795 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.323 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27ab7fe700 1 --2- 172.21.2.111:0/3292593795 >> v2:172.21.2.137:3300/0 conn(0x7f27ac0b1800 0x7f27ac139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.323 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 -- 172.21.2.111:0/3292593795 >> v2:172.21.2.137:3300/0 conn(0x7f27ac0b1800 msgr2=0x7f27ac139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.324 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 --2- 172.21.2.111:0/3292593795 >> v2:172.21.2.137:3300/0 conn(0x7f27ac0b1800 0x7f27ac139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.324 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 -- 172.21.2.111:0/3292593795 >> v1:172.21.2.137:6789/0 conn(0x7f27ac0b0fd0 legacy=0x7f27ac13f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.324 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 -- 172.21.2.111:0/3292593795 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac1434b0 con 0x7f27ac05c5d0 2021-11-15T19:26:42.324 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27abfff700 1 --2- 172.21.2.111:0/3292593795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac05c5d0 0x7f27ac143950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f27ac05f1b0 tx=0x7f2794006eb0).ready entity=mon.0 client_cookie=9a3359d959d4af16 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.324 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27aaffd700 1 -- 172.21.2.111:0/3292593795 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279400d5c0 con 0x7f27ac05c5d0 2021-11-15T19:26:42.325 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27aaffd700 1 -- 172.21.2.111:0/3292593795 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2794000e90 con 0x7f27ac05c5d0 2021-11-15T19:26:42.325 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27aaffd700 1 -- 172.21.2.111:0/3292593795 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279400d910 con 0x7f27ac05c5d0 2021-11-15T19:26:42.325 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- 172.21.2.111:0/3292593795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac05c5d0 msgr2=0x7f27ac143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.325 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 --2- 172.21.2.111:0/3292593795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac05c5d0 0x7f27ac143950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f27ac05f1b0 tx=0x7f2794006eb0).stop 2021-11-15T19:26:42.326 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- 172.21.2.111:0/3292593795 shutdown_connections 2021-11-15T19:26:42.326 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 --2- 172.21.2.111:0/3292593795 >> v2:172.21.2.137:3300/0 conn(0x7f27ac0b1800 0x7f27ac139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.326 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 --2- 172.21.2.111:0/3292593795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac05c5d0 0x7f27ac143950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.326 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- 172.21.2.111:0/3292593795 >> 172.21.2.111:0/3292593795 conn(0x7f27ac063780 msgr2=0x7f27ac05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.326 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- 172.21.2.111:0/3292593795 shutdown_connections 2021-11-15T19:26:42.327 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.314+0000 7f27b29bf700 1 -- 172.21.2.111:0/3292593795 wait complete. 2021-11-15T19:26:42.329 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 Processor -- start 2021-11-15T19:26:42.329 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- start start 2021-11-15T19:26:42.329 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27ac05c5d0 0x7f27ac067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.329 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27ac0b0fd0 0x7f27ac159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.330 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 0x7f27ac159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.330 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1564d0 con 0x7f27ac0b1800 2021-11-15T19:26:42.330 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac13f880 con 0x7f27ac05c5d0 2021-11-15T19:26:42.330 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac13fae0 con 0x7f27ac0b0fd0 2021-11-15T19:26:42.331 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 0x7f27ac159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.331 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 0x7f27ac159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54758/0 (socket says 172.21.2.111:54758) 2021-11-15T19:26:42.331 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 -- 172.21.2.111:0/2183311496 learned_addr learned my addr 172.21.2.111:0/2183311496 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.331 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27ab7fe700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27ac0b0fd0 0x7f27ac159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.332 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27abfff700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27ac05c5d0 0x7f27ac067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.332 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 -- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27ac0b0fd0 msgr2=0x7f27ac159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.332 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27ac0b0fd0 0x7f27ac159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.332 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 -- 172.21.2.111:0/2183311496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27ac05c5d0 msgr2=0x7f27ac067690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.332 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27ac05c5d0 0x7f27ac067690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.333 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 -- 172.21.2.111:0/2183311496 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279400b1e0 con 0x7f27ac0b1800 2021-11-15T19:26:42.333 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27abfff700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27ac05c5d0 0x7f27ac067690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:26:42.333 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b0f5c700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 0x7f27ac159f90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f27a4002320 tx=0x7f27a40023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.334 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27a4006aa0 con 0x7f27ac0b1800 2021-11-15T19:26:42.334 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a4006c00 con 0x7f27ac0b1800 2021-11-15T19:26:42.334 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac064f10 con 0x7f27ac0b1800 2021-11-15T19:26:42.335 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27a4007030 con 0x7f27ac0b1800 2021-11-15T19:26:42.335 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac064b50 con 0x7f27ac0b1800 2021-11-15T19:26:42.335 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f27a4010030 con 0x7f27ac0b1800 2021-11-15T19:26:42.335 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f27a401d7b0 con 0x7f27ac0b1800 2021-11-15T19:26:42.336 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.318+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac1403c0 con 0x7f27ac0b1800 2021-11-15T19:26:42.336 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.322+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f27ac1403c0 con 0x7f27ac0b1800 2021-11-15T19:26:42.369 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.362+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", "id": 0} v 0) v1 -- 0x7f27ac13fca0 con 0x7f27ac0b1800 2021-11-15T19:26:42.373 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.366+0000 7f27a97fa700 1 -- 172.21.2.111:0/2183311496 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f27a401d9c0 con 0x7f27ac0b1800 2021-11-15T19:26:42.374 INFO:teuthology.orchestra.run.gibba011.stdout:0 2021-11-15T19:26:42.375 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 msgr2=0x7f27ac159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.376 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 0x7f27ac159f90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f27a4002320 tx=0x7f27a40023f0).stop 2021-11-15T19:26:42.376 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 shutdown_connections 2021-11-15T19:26:42.376 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27ac0b1800 0x7f27ac159f90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.376 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27ac0b0fd0 0x7f27ac159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.377 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 --2- 172.21.2.111:0/2183311496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27ac05c5d0 0x7f27ac067690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.377 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 >> 172.21.2.111:0/2183311496 conn(0x7f27ac063780 msgr2=0x7f27ac140cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.377 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 shutdown_connections 2021-11-15T19:26:42.377 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.370+0000 7f27b29bf700 1 -- 172.21.2.111:0/2183311496 wait complete. 2021-11-15T19:26:42.381 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new a44e77ff-9cd6-4440-8f88-f256328291e5 1 2021-11-15T19:26:42.431 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 Processor -- start 2021-11-15T19:26:42.431 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- start start 2021-11-15T19:26:42.433 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe7b80b0550 0x7fe7b814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.433 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 0x7fe7b8140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.433 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b805cb50 con 0x7fe7b805c770 2021-11-15T19:26:42.434 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80b1650 con 0x7fe7b80b0550 2021-11-15T19:26:42.434 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80ad030 con 0x7fe7b814aaa0 2021-11-15T19:26:42.434 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 0x7fe7b8140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.434 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 0x7fe7b8140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.111:53816/0 (socket says 172.21.2.111:53816) 2021-11-15T19:26:42.435 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 -- 172.21.2.111:0/3742287712 learned_addr learned my addr 172.21.2.111:0/3742287712 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.435 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b67fc700 1 --2- 172.21.2.111:0/3742287712 >> v2:172.21.2.137:3300/0 conn(0x7fe7b80b0550 0x7fe7b814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.435 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 -- 172.21.2.111:0/3742287712 >> v2:172.21.2.137:3300/0 conn(0x7fe7b80b0550 msgr2=0x7fe7b814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.435 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 --2- 172.21.2.111:0/3742287712 >> v2:172.21.2.137:3300/0 conn(0x7fe7b80b0550 0x7fe7b814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.436 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 -- 172.21.2.111:0/3742287712 >> v1:172.21.2.137:6789/0 conn(0x7fe7b805c770 legacy=0x7fe7b80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.436 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 -- 172.21.2.111:0/3742287712 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b80ad2d0 con 0x7fe7b814aaa0 2021-11-15T19:26:42.436 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b77fe700 1 --2- 172.21.2.111:0/3742287712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 0x7fe7b8140aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fe7b80620e0 tx=0x7fe7b0009290).ready entity=mon.2 client_cookie=4d6e22f5bdbb117c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.436 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b5ffb700 1 -- 172.21.2.111:0/3742287712 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b000b860 con 0x7fe7b814aaa0 2021-11-15T19:26:42.436 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b5ffb700 1 -- 172.21.2.111:0/3742287712 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000b9c0 con 0x7fe7b814aaa0 2021-11-15T19:26:42.437 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7b5ffb700 1 -- 172.21.2.111:0/3742287712 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b000bb70 con 0x7fe7b814aaa0 2021-11-15T19:26:42.437 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- 172.21.2.111:0/3742287712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 msgr2=0x7fe7b8140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.437 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/3742287712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 0x7fe7b8140aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fe7b80620e0 tx=0x7fe7b0009290).stop 2021-11-15T19:26:42.437 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- 172.21.2.111:0/3742287712 shutdown_connections 2021-11-15T19:26:42.437 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/3742287712 >> v2:172.21.2.137:3300/0 conn(0x7fe7b80b0550 0x7fe7b814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.438 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/3742287712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b814aaa0 0x7fe7b8140aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.438 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- 172.21.2.111:0/3742287712 >> 172.21.2.111:0/3742287712 conn(0x7fe7b80631e0 msgr2=0x7fe7b805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.438 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- 172.21.2.111:0/3742287712 shutdown_connections 2021-11-15T19:26:42.438 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.426+0000 7fe7bd8db700 1 -- 172.21.2.111:0/3742287712 wait complete. 2021-11-15T19:26:42.441 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 Processor -- start 2021-11-15T19:26:42.441 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- start start 2021-11-15T19:26:42.441 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 0x7fe7b8066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.441 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe7b80b0550 0x7fe7b8141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.442 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7b814aaa0 0x7fe7b8142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.442 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b813fc50 con 0x7fe7b814aaa0 2021-11-15T19:26:42.442 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8146fd0 con 0x7fe7b80b0550 2021-11-15T19:26:42.442 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8147200 con 0x7fe7b805c770 2021-11-15T19:26:42.442 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 0x7fe7b8066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.443 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b77fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7b814aaa0 0x7fe7b8142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.443 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 0x7fe7b8066aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.111:53822/0 (socket says 172.21.2.111:53822) 2021-11-15T19:26:42.443 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 -- 172.21.2.111:0/1412478610 learned_addr learned my addr 172.21.2.111:0/1412478610 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.443 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b67fc700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe7b80b0550 0x7fe7b8141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.444 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 -- 172.21.2.111:0/1412478610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe7b80b0550 msgr2=0x7fe7b8141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.444 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe7b80b0550 0x7fe7b8141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.444 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 -- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7b814aaa0 msgr2=0x7fe7b8142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.444 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7b814aaa0 0x7fe7b8142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.444 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 -- 172.21.2.111:0/1412478610 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0009530 con 0x7fe7b805c770 2021-11-15T19:26:42.445 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b77fe700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7b814aaa0 0x7fe7b8142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:42.445 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7b6ffd700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 0x7fe7b8066aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe7b80671d0 tx=0x7fe7a8006d70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.445 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a8012410 con 0x7fe7b805c770 2021-11-15T19:26:42.445 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8012570 con 0x7fe7b805c770 2021-11-15T19:26:42.445 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b8157480 con 0x7fe7b805c770 2021-11-15T19:26:42.446 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a80128d0 con 0x7fe7b805c770 2021-11-15T19:26:42.446 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b81430f0 con 0x7fe7b805c770 2021-11-15T19:26:42.446 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe7a800f030 con 0x7fe7b805c770 2021-11-15T19:26:42.446 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fe7a801c440 con 0x7fe7b805c770 2021-11-15T19:26:42.446 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b80ae7f0 con 0x7fe7b805c770 2021-11-15T19:26:42.447 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.430+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe7a801b3e0 con 0x7fe7b805c770 2021-11-15T19:26:42.482 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.478+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", "id": 1} v 0) v1 -- 0x7fe7b80573d0 con 0x7fe7b805c770 2021-11-15T19:26:42.486 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7affff700 1 -- 172.21.2.111:0/1412478610 <== mon.2 v2:172.21.2.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7a801c600 con 0x7fe7b805c770 2021-11-15T19:26:42.486 INFO:teuthology.orchestra.run.gibba011.stdout:1 2021-11-15T19:26:42.487 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 msgr2=0x7fe7b8066aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.487 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 0x7fe7b8066aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe7b80671d0 tx=0x7fe7a8006d70).stop 2021-11-15T19:26:42.488 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 shutdown_connections 2021-11-15T19:26:42.488 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7b814aaa0 0x7fe7b8142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.488 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe7b80b0550 0x7fe7b8141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.488 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 --2- 172.21.2.111:0/1412478610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe7b805c770 0x7fe7b8066aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.488 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 >> 172.21.2.111:0/1412478610 conn(0x7fe7b80631e0 msgr2=0x7fe7b81402e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.489 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 shutdown_connections 2021-11-15T19:26:42.489 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.482+0000 7fe7bd8db700 1 -- 172.21.2.111:0/1412478610 wait complete. 2021-11-15T19:26:42.493 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new 5939bbcb-c02f-4a97-8e42-d014b81745c1 2 2021-11-15T19:26:42.544 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 Processor -- start 2021-11-15T19:26:42.544 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 -- start start 2021-11-15T19:26:42.546 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3b6c065b10 0x7f3b6c13c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.547 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.547 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c066270 con 0x7f3b6c065730 2021-11-15T19:26:42.547 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c067410 con 0x7f3b6c065b10 2021-11-15T19:26:42.547 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b72f75700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c065fd0 con 0x7f3b6c0b00a0 2021-11-15T19:26:42.548 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3b6c065b10 0x7f3b6c13c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.548 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b71512700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.548 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3b6c065b10 0x7f3b6c13c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54776/0 (socket says 172.21.2.111:54776) 2021-11-15T19:26:42.548 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 -- 172.21.2.111:0/3712391276 learned_addr learned my addr 172.21.2.111:0/3712391276 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.548 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 -- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 msgr2=0x7f3b6c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.549 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 --2- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c05bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.549 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 -- 172.21.2.111:0/3712391276 >> v1:172.21.2.137:6789/0 conn(0x7f3b6c065730 legacy=0x7f3b6c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.549 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 -- 172.21.2.111:0/3712391276 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c066f70 con 0x7f3b6c065b10 2021-11-15T19:26:42.549 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6bfff700 1 --2- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c13c9c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f3b5c002f70 tx=0x7f3b5c006e40).ready entity=mon.0 client_cookie=b6e725cd2743b9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.550 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6b7fe700 1 -- 172.21.2.111:0/3712391276 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5c00bc90 con 0x7f3b6c065b10 2021-11-15T19:26:42.550 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6b7fe700 1 -- 172.21.2.111:0/3712391276 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c000e90 con 0x7f3b6c065b10 2021-11-15T19:26:42.550 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.538+0000 7f3b6b7fe700 1 -- 172.21.2.111:0/3712391276 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5c0153f0 con 0x7f3b6c065b10 2021-11-15T19:26:42.550 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 msgr2=0x7f3b6c13c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.551 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 --2- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c13c9c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f3b5c002f70 tx=0x7f3b5c006e40).stop 2021-11-15T19:26:42.551 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/3712391276 shutdown_connections 2021-11-15T19:26:42.551 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 --2- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c13c9c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.551 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 --2- 172.21.2.111:0/3712391276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c05bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.551 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/3712391276 >> 172.21.2.111:0/3712391276 conn(0x7f3b6c060290 msgr2=0x7f3b6c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.552 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/3712391276 shutdown_connections 2021-11-15T19:26:42.552 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/3712391276 wait complete. 2021-11-15T19:26:42.555 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 Processor -- start 2021-11-15T19:26:42.555 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- start start 2021-11-15T19:26:42.555 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b6c065730 0x7f3b6c0ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.555 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.556 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.556 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c143170 con 0x7f3b6c065b10 2021-11-15T19:26:42.556 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0ae230 con 0x7f3b6c065730 2021-11-15T19:26:42.556 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c140d60 con 0x7f3b6c0b00a0 2021-11-15T19:26:42.557 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.557 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b71512700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.557 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c0ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54780/0 (socket says 172.21.2.111:54780) 2021-11-15T19:26:42.557 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 -- 172.21.2.111:0/1990230451 learned_addr learned my addr 172.21.2.111:0/1990230451 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.558 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b70d11700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b6c065730 0x7f3b6c0ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.558 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 -- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 msgr2=0x7f3b6c0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.558 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.558 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 -- 172.21.2.111:0/1990230451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b6c065730 msgr2=0x7f3b6c0ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.558 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b6c065730 0x7f3b6c0ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.559 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 -- 172.21.2.111:0/1990230451 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c00d4d0 con 0x7f3b6c065b10 2021-11-15T19:26:42.559 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b71512700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:42.559 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b6bfff700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c0ae7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3b5c006fc0 tx=0x7f3b5c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.559 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5c009070 con 0x7f3b6c065b10 2021-11-15T19:26:42.560 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c00a040 con 0x7f3b6c065b10 2021-11-15T19:26:42.560 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0ade50 con 0x7f3b6c065b10 2021-11-15T19:26:42.560 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5c00b210 con 0x7f3b6c065b10 2021-11-15T19:26:42.560 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c141690 con 0x7f3b6c065b10 2021-11-15T19:26:42.560 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f3b5c025030 con 0x7f3b6c065b10 2021-11-15T19:26:42.561 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f3b5c00be40 con 0x7f3b6c065b10 2021-11-15T19:26:42.561 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.542+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c0b0fb0 con 0x7f3b6c065b10 2021-11-15T19:26:42.561 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.546+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f3b5c023070 con 0x7f3b6c065b10 2021-11-15T19:26:42.595 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.590+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", "id": 2} v 0) v1 -- 0x7f3b6c0573d0 con 0x7f3b6c065b10 2021-11-15T19:26:42.598 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b69ffb700 1 -- 172.21.2.111:0/1990230451 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b5c006a10 con 0x7f3b6c065b10 2021-11-15T19:26:42.599 INFO:teuthology.orchestra.run.gibba011.stdout:2 2021-11-15T19:26:42.600 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 msgr2=0x7f3b6c0ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.600 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c0ae7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3b5c006fc0 tx=0x7f3b5c018000).stop 2021-11-15T19:26:42.600 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 shutdown_connections 2021-11-15T19:26:42.600 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b6c0b00a0 0x7f3b6c0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.601 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b6c065b10 0x7f3b6c0ae7b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.601 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 --2- 172.21.2.111:0/1990230451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b6c065730 0x7f3b6c0ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.601 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 >> 172.21.2.111:0/1990230451 conn(0x7f3b6c060290 msgr2=0x7f3b6c069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.601 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 shutdown_connections 2021-11-15T19:26:42.602 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.594+0000 7f3b72f75700 1 -- 172.21.2.111:0/1990230451 wait complete. 2021-11-15T19:26:42.605 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new 584801ab-fe8b-41cb-a22e-bb8327c9a7ce 3 2021-11-15T19:26:42.656 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 Processor -- start 2021-11-15T19:26:42.656 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 -- start start 2021-11-15T19:26:42.658 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 0x7f7e840b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.658 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e840b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.659 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e84146c20 con 0x7f7e840b2400 2021-11-15T19:26:42.659 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e84142af0 con 0x7f7e840b5330 2021-11-15T19:26:42.659 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840b27e0 con 0x7f7e840b3e70 2021-11-15T19:26:42.659 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e840b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.660 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8259c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 0x7f7e840b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.660 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e840b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.111:53842/0 (socket says 172.21.2.111:53842) 2021-11-15T19:26:42.660 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 -- 172.21.2.111:0/4202366438 learned_addr learned my addr 172.21.2.111:0/4202366438 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.660 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8259c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 0x7f7e840b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54786/0 (socket says 172.21.2.111:54786) 2021-11-15T19:26:42.661 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 -- 172.21.2.111:0/4202366438 >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 msgr2=0x7f7e840b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.661 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 --2- 172.21.2.111:0/4202366438 >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 0x7f7e840b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.661 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 -- 172.21.2.111:0/4202366438 >> v1:172.21.2.111:6789/0 conn(0x7f7e840b2400 legacy=0x7f7e840b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.661 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 -- 172.21.2.111:0/4202366438 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840b4d80 con 0x7f7e840b3e70 2021-11-15T19:26:42.661 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8259c700 1 --2- 172.21.2.111:0/4202366438 >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 0x7f7e840b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:42.662 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8359e700 1 --2- 172.21.2.111:0/4202366438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e840b5ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7e7c0032f0 tx=0x7f7e7c009290).ready entity=mon.2 client_cookie=ce8979b40d07ae60 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.662 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e81d9b700 1 -- 172.21.2.111:0/4202366438 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7c00b8a0 con 0x7f7e840b3e70 2021-11-15T19:26:42.662 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e81d9b700 1 -- 172.21.2.111:0/4202366438 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00ba00 con 0x7f7e840b3e70 2021-11-15T19:26:42.662 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e81d9b700 1 -- 172.21.2.111:0/4202366438 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7c00bb70 con 0x7f7e840b3e70 2021-11-15T19:26:42.663 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.650+0000 7f7e8904f700 1 -- 172.21.2.111:0/4202366438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 msgr2=0x7f7e840b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.663 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 --2- 172.21.2.111:0/4202366438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e840b5ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7e7c0032f0 tx=0x7f7e7c009290).stop 2021-11-15T19:26:42.663 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/4202366438 shutdown_connections 2021-11-15T19:26:42.663 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 --2- 172.21.2.111:0/4202366438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e840b5ab0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.663 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 --2- 172.21.2.111:0/4202366438 >> v2:172.21.2.111:3300/0 conn(0x7f7e840b5330 0x7f7e840b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.664 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/4202366438 >> 172.21.2.111:0/4202366438 conn(0x7f7e840623a0 msgr2=0x7f7e84062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.664 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/4202366438 shutdown_connections 2021-11-15T19:26:42.664 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/4202366438 wait complete. 2021-11-15T19:26:42.666 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 Processor -- start 2021-11-15T19:26:42.666 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- start start 2021-11-15T19:26:42.667 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e840b2400 0x7f7e84159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.667 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e84065c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.667 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e840b5330 0x7f7e840b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.667 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84063bc0 con 0x7f7e840b2400 2021-11-15T19:26:42.668 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84067570 con 0x7f7e840b5330 2021-11-15T19:26:42.668 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84067810 con 0x7f7e840b3e70 2021-11-15T19:26:42.668 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8259c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e84065c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.668 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e840b2400 0x7f7e84159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.668 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8259c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e84065c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.111:53846/0 (socket says 172.21.2.111:53846) 2021-11-15T19:26:42.669 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8259c700 1 -- 172.21.2.111:0/69802448 learned_addr learned my addr 172.21.2.111:0/69802448 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.669 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8359e700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e840b5330 0x7f7e840b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.669 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 -- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 msgr2=0x7f7e84065c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.669 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e84065c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.670 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 -- 172.21.2.111:0/69802448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e840b5330 msgr2=0x7f7e840b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.670 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e840b5330 0x7f7e840b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.670 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 -- 172.21.2.111:0/69802448 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c00b180 con 0x7f7e840b2400 2021-11-15T19:26:42.670 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e82d9d700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e840b2400 0x7f7e84159ba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7e840b6ee0 tx=0x7f7e74007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.670 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e74013450 con 0x7f7e840b2400 2021-11-15T19:26:42.671 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e740135b0 con 0x7f7e840b2400 2021-11-15T19:26:42.671 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c009530 con 0x7f7e840b2400 2021-11-15T19:26:42.671 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e74013910 con 0x7f7e840b2400 2021-11-15T19:26:42.671 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e840642d0 con 0x7f7e840b2400 2021-11-15T19:26:42.672 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f7e7401a060 con 0x7f7e840b2400 2021-11-15T19:26:42.672 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f7e7401d900 con 0x7f7e840b2400 2021-11-15T19:26:42.672 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.654+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e84065040 con 0x7f7e840b2400 2021-11-15T19:26:42.672 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.658+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f7e84065040 con 0x7f7e840b2400 2021-11-15T19:26:42.706 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.702+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", "id": 3} v 0) v1 -- 0x7f7e840573d0 con 0x7f7e840b2400 2021-11-15T19:26:42.709 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.702+0000 7f7e7bfff700 1 -- 172.21.2.111:0/69802448 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e74018070 con 0x7f7e840b2400 2021-11-15T19:26:42.710 INFO:teuthology.orchestra.run.gibba011.stdout:3 2021-11-15T19:26:42.711 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e840b2400 msgr2=0x7f7e84159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.711 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e840b2400 0x7f7e84159ba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7e840b6ee0 tx=0x7f7e74007b90).stop 2021-11-15T19:26:42.711 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 shutdown_connections 2021-11-15T19:26:42.711 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e840b5330 0x7f7e840b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.712 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e840b3e70 0x7f7e84065c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.712 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 --2- 172.21.2.111:0/69802448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e840b2400 0x7f7e84159ba0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.712 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 >> 172.21.2.111:0/69802448 conn(0x7f7e840623a0 msgr2=0x7f7e841411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.712 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 shutdown_connections 2021-11-15T19:26:42.713 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.706+0000 7f7e8904f700 1 -- 172.21.2.111:0/69802448 wait complete. 2021-11-15T19:26:42.716 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new db3bc207-56dd-423a-ae61-e28931277fe2 4 2021-11-15T19:26:42.768 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dd14b5700 1 Processor -- start 2021-11-15T19:26:42.769 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dd14b5700 1 -- start start 2021-11-15T19:26:42.775 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dd14b5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9dcc0b72e0 0x7f9dcc0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.775 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dd14b5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc0b76c0 con 0x7f9dcc0acd60 2021-11-15T19:26:42.776 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dd14b5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc12a170 con 0x7f9dcc0ad320 2021-11-15T19:26:42.776 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dd14b5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc0b3100 con 0x7f9dcc0b72e0 2021-11-15T19:26:42.776 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dca7fc700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f9dcc0acd60 0x7f9dcc0b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.111:53804/0 (socket says 172.21.2.111:53804) 2021-11-15T19:26:42.776 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dca7fc700 1 -- 172.21.2.111:0/2098266353 learned_addr learned my addr 172.21.2.111:0/2098266353 (peer_addr_for_me v1:172.21.2.111:0/0) 2021-11-15T19:26:42.776 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/2098266353 >> v2:172.21.2.137:3300/0 conn(0x7f9dcc0b72e0 0x7f9dcc0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.777 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 <== mon.0 v1:172.21.2.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415785415 0 0) 0x7f9dcc0b76c0 con 0x7f9dcc0acd60 2021-11-15T19:26:42.777 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 --> v1:172.21.2.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dac003260 con 0x7f9dcc0acd60 2021-11-15T19:26:42.777 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 <== mon.0 v1:172.21.2.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588482628 0 0) 0x7f9dac003260 con 0x7f9dcc0acd60 2021-11-15T19:26:42.777 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 >> v2:172.21.2.137:3300/0 conn(0x7f9dcc0b72e0 msgr2=0x7f9dcc0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.778 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 --2- 172.21.2.111:0/2098266353 >> v2:172.21.2.137:3300/0 conn(0x7f9dcc0b72e0 0x7f9dcc0b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.778 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 >> v1:172.21.2.137:6789/0 conn(0x7f9dcc0ad320 legacy=0x7f9dcc1290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.778 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 --> v1:172.21.2.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0ad8a0 con 0x7f9dcc0acd60 2021-11-15T19:26:42.778 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 <== mon.0 v1:172.21.2.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9dbc001660 con 0x7f9dcc0acd60 2021-11-15T19:26:42.778 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.762+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 >> v1:172.21.2.111:6789/0 conn(0x7f9dcc0acd60 legacy=0x7f9dcc0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.779 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dac003750 0x7f9dac003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.779 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac004500 0x7f9dac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.779 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dac004e70 0x7f9dac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.779 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0b3100 con 0x7f9dac004500 2021-11-15T19:26:42.779 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac00bd20 con 0x7f9dac004e70 2021-11-15T19:26:42.780 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac00bee0 con 0x7f9dac003750 2021-11-15T19:26:42.780 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dac003750 0x7f9dac003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.780 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dca7fc700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac004500 0x7f9dac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.780 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/2098266353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dac004e70 msgr2=0x7f9dac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.780 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dac004e70 0x7f9dac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:42.781 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac004500 msgr2=0x7f9dac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.781 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac004500 0x7f9dac004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.781 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/2098266353 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac003260 con 0x7f9dac003750 2021-11-15T19:26:42.781 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dca7fc700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac004500 0x7f9dac004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:42.782 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcb7fe700 1 -- 172.21.2.111:0/2098266353 reap_dead start 2021-11-15T19:26:42.782 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dac003750 0x7f9dac003b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9db400c000 tx=0x7f9db4006df0).ready entity=mon.2 client_cookie=9713b600c1d785cd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.782 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db400e830 con 0x7f9dac003750 2021-11-15T19:26:42.782 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400e990 con 0x7f9dac003750 2021-11-15T19:26:42.782 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc9ffb700 1 -- 172.21.2.111:0/2098266353 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db400ecf0 con 0x7f9dac003750 2021-11-15T19:26:42.783 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dac003750 msgr2=0x7f9dac003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.783 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dac003750 0x7f9dac003b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9db400c000 tx=0x7f9db4006df0).stop 2021-11-15T19:26:42.783 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/2098266353 shutdown_connections 2021-11-15T19:26:42.783 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 --2- 172.21.2.111:0/2098266353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dac003750 0x7f9dac003b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.783 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/2098266353 >> 172.21.2.111:0/2098266353 conn(0x7f9dcc064960 msgr2=0x7f9dcc064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.784 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/2098266353 shutdown_connections 2021-11-15T19:26:42.784 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/2098266353 wait complete. 2021-11-15T19:26:42.784 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 Processor -- start 2021-11-15T19:26:42.784 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- start start 2021-11-15T19:26:42.785 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 0x7f9dcc1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.785 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dcc144530 0x7f9dcc142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.785 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dcc151ea0 0x7f9dcc1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.785 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0aed60 con 0x7f9dac003750 2021-11-15T19:26:42.785 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc142610 con 0x7f9dcc144530 2021-11-15T19:26:42.786 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1428a0 con 0x7f9dcc151ea0 2021-11-15T19:26:42.786 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 0x7f9dcc1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.786 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dcc151ea0 0x7f9dcc1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.786 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 0x7f9dcc1432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54808/0 (socket says 172.21.2.111:54808) 2021-11-15T19:26:42.787 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/539467022 learned_addr learned my addr 172.21.2.111:0/539467022 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.787 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dcc151ea0 msgr2=0x7f9dcc1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.787 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dcc151ea0 0x7f9dcc1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.787 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/539467022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dcc144530 msgr2=0x7f9dcc142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.787 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dca7fc700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dcc144530 0x7f9dcc142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.788 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dcc144530 0x7f9dcc142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.788 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 -- 172.21.2.111:0/539467022 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc142b40 con 0x7f9dac003750 2021-11-15T19:26:42.788 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcb7fe700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dcc151ea0 0x7f9dcc1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:42.788 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dca7fc700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dcc144530 0x7f9dcc142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:42.788 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dcaffd700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 0x7f9dcc1432b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9db400c000 tx=0x7f9db4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.789 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db4012dd0 con 0x7f9dac003750 2021-11-15T19:26:42.789 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4000e90 con 0x7f9dac003750 2021-11-15T19:26:42.789 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc152350 con 0x7f9dac003750 2021-11-15T19:26:42.789 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db401d600 con 0x7f9dac003750 2021-11-15T19:26:42.790 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc152e40 con 0x7f9dac003750 2021-11-15T19:26:42.790 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f9db402d070 con 0x7f9dac003750 2021-11-15T19:26:42.790 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f9db401d930 con 0x7f9dac003750 2021-11-15T19:26:42.790 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.766+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0aeed0 con 0x7f9dac003750 2021-11-15T19:26:42.790 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.770+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9dcc0aeed0 con 0x7f9dac003750 2021-11-15T19:26:42.819 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.814+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", "id": 4} v 0) v1 -- 0x7f9dcc0b3a50 con 0x7f9dac003750 2021-11-15T19:26:42.823 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dc3fff700 1 -- 172.21.2.111:0/539467022 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9db402b060 con 0x7f9dac003750 2021-11-15T19:26:42.823 INFO:teuthology.orchestra.run.gibba011.stdout:4 2021-11-15T19:26:42.824 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 msgr2=0x7f9dcc1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.824 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 0x7f9dcc1432b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9db400c000 tx=0x7f9db4019000).stop 2021-11-15T19:26:42.825 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 shutdown_connections 2021-11-15T19:26:42.825 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9dcc151ea0 0x7f9dcc1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.825 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9dcc144530 0x7f9dcc142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.825 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 --2- 172.21.2.111:0/539467022 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9dac003750 0x7f9dcc1432b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.825 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 >> 172.21.2.111:0/539467022 conn(0x7f9dcc064960 msgr2=0x7f9dcc0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.826 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 shutdown_connections 2021-11-15T19:26:42.826 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.818+0000 7f9dd14b5700 1 -- 172.21.2.111:0/539467022 wait complete. 2021-11-15T19:26:42.830 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new 7e901196-37bd-4748-8503-79c358da8431 5 2021-11-15T19:26:42.882 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.874+0000 7f71ec2e3700 1 Processor -- start 2021-11-15T19:26:42.882 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.874+0000 7f71ec2e3700 1 -- start start 2021-11-15T19:26:42.884 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f71e40b5330 0x7f71e40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.884 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f71e40b3e70 0x7f71e40b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.884 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e4146c20 con 0x7f71e40b2400 2021-11-15T19:26:42.885 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e4142af0 con 0x7f71e40b3e70 2021-11-15T19:26:42.885 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40b27e0 con 0x7f71e40b5330 2021-11-15T19:26:42.885 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f71e40b3e70 0x7f71e40b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.885 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f71e40b3e70 0x7f71e40b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54816/0 (socket says 172.21.2.111:54816) 2021-11-15T19:26:42.886 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/123832816 learned_addr learned my addr 172.21.2.111:0/123832816 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.886 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71e987e700 1 --2- 172.21.2.111:0/123832816 >> v2:172.21.2.137:3300/0 conn(0x7f71e40b5330 0x7f71e40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.886 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/123832816 >> v2:172.21.2.137:3300/0 conn(0x7f71e40b5330 msgr2=0x7f71e40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.886 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- 172.21.2.111:0/123832816 >> v2:172.21.2.137:3300/0 conn(0x7f71e40b5330 0x7f71e40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.887 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/123832816 >> v1:172.21.2.137:6789/0 conn(0x7f71e40b2400 legacy=0x7f71e40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:42.887 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/123832816 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40b4d80 con 0x7f71e40b3e70 2021-11-15T19:26:42.887 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71e987e700 1 --2- 172.21.2.111:0/123832816 >> v2:172.21.2.137:3300/0 conn(0x7f71e40b5330 0x7f71e40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:42.887 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- 172.21.2.111:0/123832816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b3e70 0x7f71e40b5ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f71e40b6ee0 tx=0x7f71dc009290).ready entity=mon.0 client_cookie=970c4443f07cee23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.888 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71e907d700 1 -- 172.21.2.111:0/123832816 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71dc00b830 con 0x7f71e40b3e70 2021-11-15T19:26:42.888 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71e907d700 1 -- 172.21.2.111:0/123832816 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00b990 con 0x7f71e40b3e70 2021-11-15T19:26:42.888 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71e907d700 1 -- 172.21.2.111:0/123832816 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71dc00bb40 con 0x7f71e40b3e70 2021-11-15T19:26:42.888 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/123832816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b3e70 msgr2=0x7f71e40b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.889 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/123832816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b3e70 0x7f71e40b5ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f71e40b6ee0 tx=0x7f71dc009290).stop 2021-11-15T19:26:42.889 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/123832816 shutdown_connections 2021-11-15T19:26:42.889 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/123832816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b3e70 0x7f71e40b5ab0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.889 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/123832816 >> v2:172.21.2.137:3300/0 conn(0x7f71e40b5330 0x7f71e40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.889 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/123832816 >> 172.21.2.111:0/123832816 conn(0x7f71e40623a0 msgr2=0x7f71e4062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.890 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/123832816 shutdown_connections 2021-11-15T19:26:42.890 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/123832816 wait complete. 2021-11-15T19:26:42.890 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 Processor -- start 2021-11-15T19:26:42.891 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- start start 2021-11-15T19:26:42.893 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71e40b2400 0x7f71e40b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.893 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71e40b3e70 0x7f71e4140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.894 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 0x7f71e4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.894 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4067940 con 0x7f71e40b5330 2021-11-15T19:26:42.894 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4159970 con 0x7f71e40b2400 2021-11-15T19:26:42.894 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4159c10 con 0x7f71e40b3e70 2021-11-15T19:26:42.895 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 0x7f71e4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.895 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 0x7f71e4156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54824/0 (socket says 172.21.2.111:54824) 2021-11-15T19:26:42.895 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/164052611 learned_addr learned my addr 172.21.2.111:0/164052611 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:42.895 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71e987e700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71e40b3e70 0x7f71e4140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.896 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea07f700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71e40b2400 0x7f71e40b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.896 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71e40b3e70 msgr2=0x7f71e4140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.896 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71e40b3e70 0x7f71e4140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.896 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/164052611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71e40b2400 msgr2=0x7f71e40b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.896 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71e40b2400 0x7f71e40b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.897 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 -- 172.21.2.111:0/164052611 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc009530 con 0x7f71e40b5330 2021-11-15T19:26:42.897 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ea880700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 0x7f71e4156370 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f71e40b6ee0 tx=0x7f71dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:42.897 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71dc021480 con 0x7f71e40b5330 2021-11-15T19:26:42.898 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc0215e0 con 0x7f71e40b5330 2021-11-15T19:26:42.898 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e4159eb0 con 0x7f71e40b5330 2021-11-15T19:26:42.898 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71dc021980 con 0x7f71e40b5330 2021-11-15T19:26:42.899 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e415a5f0 con 0x7f71e40b5330 2021-11-15T19:26:42.899 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f71dc00f070 con 0x7f71e40b5330 2021-11-15T19:26:42.899 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f71dc02a9a0 con 0x7f71e40b5330 2021-11-15T19:26:42.899 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.878+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e415a8a0 con 0x7f71e40b5330 2021-11-15T19:26:42.900 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.882+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f71dc015020 con 0x7f71e40b5330 2021-11-15T19:26:42.932 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.926+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e901196-37bd-4748-8503-79c358da8431", "id": 5} v 0) v1 -- 0x7f71e40573d0 con 0x7f71e40b5330 2021-11-15T19:26:42.935 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71d77fe700 1 -- 172.21.2.111:0/164052611 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e901196-37bd-4748-8503-79c358da8431", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71dc02abb0 con 0x7f71e40b5330 2021-11-15T19:26:42.935 INFO:teuthology.orchestra.run.gibba011.stdout:5 2021-11-15T19:26:42.936 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 msgr2=0x7f71e4156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:42.936 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 0x7f71e4156370 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f71e40b6ee0 tx=0x7f71dc016000).stop 2021-11-15T19:26:42.936 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 shutdown_connections 2021-11-15T19:26:42.937 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71e40b5330 0x7f71e4156370 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.937 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71e40b3e70 0x7f71e4140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.937 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 --2- 172.21.2.111:0/164052611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71e40b2400 0x7f71e40b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:42.937 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 >> 172.21.2.111:0/164052611 conn(0x7f71e40623a0 msgr2=0x7f71e40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:42.937 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 shutdown_connections 2021-11-15T19:26:42.938 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.930+0000 7f71ec2e3700 1 -- 172.21.2.111:0/164052611 wait complete. 2021-11-15T19:26:42.942 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new dd9023bb-1799-4c2a-9d08-0abc1d2b27ee 6 2021-11-15T19:26:42.994 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f09776d3700 1 Processor -- start 2021-11-15T19:26:42.994 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f09776d3700 1 -- start start 2021-11-15T19:26:42.994 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f09776d3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0970065b10 0x7f097013c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:42.995 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f09776d3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0970066270 con 0x7f0970065730 2021-11-15T19:26:42.995 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f09776d3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0970065fd0 con 0x7f09700b00a0 2021-11-15T19:26:42.995 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f09776d3700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0970067410 con 0x7f0970065b10 2021-11-15T19:26:42.995 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f097546f700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f0970065730 0x7f097013c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.111:53830/0 (socket says 172.21.2.111:53830) 2021-11-15T19:26:42.996 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f097546f700 1 -- 172.21.2.111:0/3014627717 learned_addr learned my addr 172.21.2.111:0/3014627717 (peer_addr_for_me v1:172.21.2.111:0/0) 2021-11-15T19:26:42.996 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.986+0000 7f0974c6e700 1 --2- 172.21.2.111:0/3014627717 >> v2:172.21.2.137:3300/0 conn(0x7f0970065b10 0x7f097013c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:42.999 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0974c6e700 1 -- 172.21.2.111:0/3014627717 >> v1:172.21.2.137:6789/0 conn(0x7f09700b00a0 legacy=0x7f0970069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.000 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0974c6e700 1 -- 172.21.2.111:0/3014627717 >> v1:172.21.2.111:6789/0 conn(0x7f0970065730 legacy=0x7f097013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.000 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0974c6e700 1 -- 172.21.2.111:0/3014627717 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970066f70 con 0x7f0970065b10 2021-11-15T19:26:43.000 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0974c6e700 1 --2- 172.21.2.111:0/3014627717 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013c9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f096c002f70 tx=0x7f096c006df0).ready entity=mon.1 client_cookie=ac3cdb4fedd412fd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:43.000 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f095ffff700 1 -- 172.21.2.111:0/3014627717 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f096c00d610 con 0x7f0970065b10 2021-11-15T19:26:43.001 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f095ffff700 1 -- 172.21.2.111:0/3014627717 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c000e90 con 0x7f0970065b10 2021-11-15T19:26:43.001 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f095ffff700 1 -- 172.21.2.111:0/3014627717 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f096c00d960 con 0x7f0970065b10 2021-11-15T19:26:43.001 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/3014627717 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 msgr2=0x7f097013c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.001 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 --2- 172.21.2.111:0/3014627717 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013c9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f096c002f70 tx=0x7f096c006df0).stop 2021-11-15T19:26:43.002 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/3014627717 shutdown_connections 2021-11-15T19:26:43.002 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 --2- 172.21.2.111:0/3014627717 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013c9c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.002 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/3014627717 >> 172.21.2.111:0/3014627717 conn(0x7f0970060290 msgr2=0x7f0970060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:43.002 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/3014627717 shutdown_connections 2021-11-15T19:26:43.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/3014627717 wait complete. 2021-11-15T19:26:43.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 Processor -- start 2021-11-15T19:26:43.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- start start 2021-11-15T19:26:43.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0970065730 0x7f097013b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.003 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.004 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 0x7f0970145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.004 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09701451c0 con 0x7f0970065730 2021-11-15T19:26:43.004 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700af910 con 0x7f0970065b10 2021-11-15T19:26:43.004 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700afbb0 con 0x7f09700b00a0 2021-11-15T19:26:43.005 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0975c70700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 0x7f0970145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.005 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0974c6e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.005 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0970065730 0x7f097013b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.005 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0975c70700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 0x7f0970145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.111:53892/0 (socket says 172.21.2.111:53892) 2021-11-15T19:26:43.006 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0975c70700 1 -- 172.21.2.111:0/2962327343 learned_addr learned my addr 172.21.2.111:0/2962327343 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:43.006 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 -- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 msgr2=0x7f0970145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.006 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 0x7f0970145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.006 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 -- 172.21.2.111:0/2962327343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 msgr2=0x7f097013fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.007 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.007 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 -- 172.21.2.111:0/2962327343 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c00b180 con 0x7f0970065730 2021-11-15T19:26:43.007 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f0975c70700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 0x7f0970145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:43.007 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f097546f700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0970065730 0x7f097013b9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f09700612c0 tx=0x7f0960007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:43.008 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09600070d0 con 0x7f0970065730 2021-11-15T19:26:43.008 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960007230 con 0x7f0970065730 2021-11-15T19:26:43.008 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0960005610 con 0x7f0970065730 2021-11-15T19:26:43.008 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0970143890 con 0x7f0970065730 2021-11-15T19:26:43.008 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.990+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0970144790 con 0x7f0970065730 2021-11-15T19:26:43.009 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.994+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f0960010070 con 0x7f0970065730 2021-11-15T19:26:43.009 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.994+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f0960005de0 con 0x7f0970065730 2021-11-15T19:26:43.009 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.994+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09700aec10 con 0x7f0970065730 2021-11-15T19:26:43.009 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:42.994+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f0960018020 con 0x7f0970065730 2021-11-15T19:26:43.045 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.038+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", "id": 6} v 0) v1 -- 0x7f09701433e0 con 0x7f0970065730 2021-11-15T19:26:43.048 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f095e7fc700 1 -- 172.21.2.111:0/2962327343 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0960005020 con 0x7f0970065730 2021-11-15T19:26:43.048 INFO:teuthology.orchestra.run.gibba011.stdout:6 2021-11-15T19:26:43.049 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0970065730 msgr2=0x7f097013b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.049 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0970065730 0x7f097013b9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f09700612c0 tx=0x7f0960007b80).stop 2021-11-15T19:26:43.050 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 shutdown_connections 2021-11-15T19:26:43.050 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09700b00a0 0x7f0970145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.050 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0970065b10 0x7f097013fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.050 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 --2- 172.21.2.111:0/2962327343 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0970065730 0x7f097013b9e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.051 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 >> 172.21.2.111:0/2962327343 conn(0x7f0970060290 msgr2=0x7f0970142490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:43.051 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 shutdown_connections 2021-11-15T19:26:43.051 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.042+0000 7f09776d3700 1 -- 172.21.2.111:0/2962327343 wait complete. 2021-11-15T19:26:43.055 DEBUG:teuthology.orchestra.run.gibba011:> sudo ceph --cluster ceph osd new a483fa91-357c-4a8e-b313-b5cc41ce4b3a 7 2021-11-15T19:26:43.112 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 Processor -- start 2021-11-15T19:26:43.112 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- start start 2021-11-15T19:26:43.113 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff8880b72e0 0x7ff8880b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.113 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff8880b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.113 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880b76c0 con 0x7ff8880b4680 2021-11-15T19:26:43.113 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880b3100 con 0x7ff8880b72e0 2021-11-15T19:26:43.114 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88812a170 con 0x7ff8880acd60 2021-11-15T19:26:43.114 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff8880b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.114 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff8877fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff8880b72e0 0x7ff8880b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.114 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff8880b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.111:53896/0 (socket says 172.21.2.111:53896) 2021-11-15T19:26:43.115 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 -- 172.21.2.111:0/2263385851 learned_addr learned my addr 172.21.2.111:0/2263385851 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:43.115 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 -- 172.21.2.111:0/2263385851 >> v2:172.21.2.111:3300/0 conn(0x7ff8880b72e0 msgr2=0x7ff8880b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:43.115 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 --2- 172.21.2.111:0/2263385851 >> v2:172.21.2.111:3300/0 conn(0x7ff8880b72e0 0x7ff8880b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.115 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 -- 172.21.2.111:0/2263385851 >> v1:172.21.2.137:6789/0 conn(0x7ff8880b4680 legacy=0x7ff888143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.116 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 -- 172.21.2.111:0/2263385851 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880ad8a0 con 0x7ff8880acd60 2021-11-15T19:26:43.116 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff8877fe700 1 --2- 172.21.2.111:0/2263385851 >> v2:172.21.2.111:3300/0 conn(0x7ff8880b72e0 0x7ff8880b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:43.116 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff886ffd700 1 --2- 172.21.2.111:0/2263385851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff8880b4190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff870002f70 tx=0x7ff870006eb0).ready entity=mon.2 client_cookie=32e1fdc35a2f1c81 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:43.116 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff8867fc700 1 -- 172.21.2.111:0/2263385851 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff87000d570 con 0x7ff8880acd60 2021-11-15T19:26:43.116 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff8867fc700 1 -- 172.21.2.111:0/2263385851 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870000e90 con 0x7ff8880acd60 2021-11-15T19:26:43.117 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff8867fc700 1 -- 172.21.2.111:0/2263385851 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff87000d900 con 0x7ff8880acd60 2021-11-15T19:26:43.117 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- 172.21.2.111:0/2263385851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 msgr2=0x7ff8880b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.117 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 --2- 172.21.2.111:0/2263385851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff8880b4190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff870002f70 tx=0x7ff870006eb0).stop 2021-11-15T19:26:43.117 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- 172.21.2.111:0/2263385851 shutdown_connections 2021-11-15T19:26:43.118 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 --2- 172.21.2.111:0/2263385851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff8880b4190 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.118 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 --2- 172.21.2.111:0/2263385851 >> v2:172.21.2.111:3300/0 conn(0x7ff8880b72e0 0x7ff8880b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.118 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- 172.21.2.111:0/2263385851 >> 172.21.2.111:0/2263385851 conn(0x7ff888064960 msgr2=0x7ff888064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:43.118 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- 172.21.2.111:0/2263385851 shutdown_connections 2021-11-15T19:26:43.119 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- 172.21.2.111:0/2263385851 wait complete. 2021-11-15T19:26:43.119 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 Processor -- start 2021-11-15T19:26:43.119 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.102+0000 7ff88dfca700 1 -- start start 2021-11-15T19:26:43.119 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff888124b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.120 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 0x7ff8880ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.120 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8880b72e0 0x7ff8880ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:43.120 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888126440 con 0x7ff8880b4680 2021-11-15T19:26:43.120 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880b00e0 con 0x7ff8880b72e0 2021-11-15T19:26:43.121 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff888126210 con 0x7ff8880acd60 2021-11-15T19:26:43.121 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff886ffd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 0x7ff8880ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.121 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff888124b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.121 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff886ffd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 0x7ff8880ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.111:54842/0 (socket says 172.21.2.111:54842) 2021-11-15T19:26:43.121 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff886ffd700 1 -- 172.21.2.111:0/656466445 learned_addr learned my addr 172.21.2.111:0/656466445 (peer_addr_for_me v2:172.21.2.111:0/0) 2021-11-15T19:26:43.122 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff887fff700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8880b72e0 0x7ff8880ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:43.122 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 -- 172.21.2.111:0/656466445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8880b72e0 msgr2=0x7ff8880ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.122 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8880b72e0 0x7ff8880ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.122 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 -- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 msgr2=0x7ff8880ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.123 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 0x7ff8880ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.123 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 -- 172.21.2.111:0/656466445 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87800b180 con 0x7ff8880acd60 2021-11-15T19:26:43.123 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff887fff700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8880b72e0 0x7ff8880ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:43.123 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff886ffd700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 0x7ff8880ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:26:43.124 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff8877fe700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff888124b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff888144080 tx=0x7ff878006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:43.124 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff878010780 con 0x7ff8880acd60 2021-11-15T19:26:43.124 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8780108e0 con 0x7ff8880acd60 2021-11-15T19:26:43.124 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff878010c40 con 0x7ff8880acd60 2021-11-15T19:26:43.125 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87000b1e0 con 0x7ff8880acd60 2021-11-15T19:26:43.125 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8880ae720 con 0x7ff8880acd60 2021-11-15T19:26:43.125 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff87801c460 con 0x7ff8880acd60 2021-11-15T19:26:43.125 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7ff87801cba0 con 0x7ff8880acd60 2021-11-15T19:26:43.126 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888128d20 con 0x7ff8880acd60 2021-11-15T19:26:43.126 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.106+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff87801ce00 con 0x7ff8880acd60 2021-11-15T19:26:43.157 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.150+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", "id": 7} v 0) v1 -- 0x7ff8880b3a50 con 0x7ff8880acd60 2021-11-15T19:26:43.161 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.154+0000 7ff884ff9700 1 -- 172.21.2.111:0/656466445 <== mon.2 v2:172.21.2.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff878006020 con 0x7ff8880acd60 2021-11-15T19:26:43.162 INFO:teuthology.orchestra.run.gibba011.stdout:7 2021-11-15T19:26:43.163 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 msgr2=0x7ff888124b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:43.163 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff888124b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff888144080 tx=0x7ff878006df0).stop 2021-11-15T19:26:43.163 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 shutdown_connections 2021-11-15T19:26:43.164 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8880b72e0 0x7ff8880ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.164 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8880b4680 0x7ff8880ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.164 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 --2- 172.21.2.111:0/656466445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8880acd60 0x7ff888124b50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:43.165 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 >> 172.21.2.111:0/656466445 conn(0x7ff888064960 msgr2=0x7ff8881412c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:43.165 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 shutdown_connections 2021-11-15T19:26:43.165 INFO:teuthology.orchestra.run.gibba011.stderr:2021-11-15T19:26:43.158+0000 7ff88dfca700 1 -- 172.21.2.111:0/656466445 wait complete. 2021-11-15T19:26:43.168 INFO:tasks.ceph.osd.0:Restarting daemon 2021-11-15T19:26:43.169 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-11-15T19:26:43.171 INFO:tasks.ceph.osd.0:Started 2021-11-15T19:26:43.171 INFO:tasks.ceph.osd.1:Restarting daemon 2021-11-15T19:26:43.172 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-11-15T19:26:43.173 INFO:tasks.ceph.osd.1:Started 2021-11-15T19:26:43.174 INFO:tasks.ceph.osd.2:Restarting daemon 2021-11-15T19:26:43.174 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-11-15T19:26:43.178 INFO:tasks.ceph.osd.2:Started 2021-11-15T19:26:43.179 INFO:tasks.ceph.osd.3:Restarting daemon 2021-11-15T19:26:43.179 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-11-15T19:26:43.181 INFO:tasks.ceph.osd.3:Started 2021-11-15T19:26:43.181 INFO:tasks.ceph.osd.4:Restarting daemon 2021-11-15T19:26:43.182 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-11-15T19:26:43.184 INFO:tasks.ceph.osd.4:Started 2021-11-15T19:26:43.184 INFO:tasks.ceph.osd.5:Restarting daemon 2021-11-15T19:26:43.185 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-11-15T19:26:43.186 INFO:tasks.ceph.osd.5:Started 2021-11-15T19:26:43.187 INFO:tasks.ceph.osd.6:Restarting daemon 2021-11-15T19:26:43.187 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-11-15T19:26:43.189 INFO:tasks.ceph.osd.6:Started 2021-11-15T19:26:43.190 INFO:tasks.ceph.osd.7:Restarting daemon 2021-11-15T19:26:43.190 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-11-15T19:26:43.192 INFO:tasks.ceph.osd.7:Started 2021-11-15T19:26:43.192 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-15T19:26:43.205 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:43.198+0000 7f23e5c25d80 -1 Falling back to public interface 2021-11-15T19:26:43.207 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:43.198+0000 7f1d58814d80 -1 Falling back to public interface 2021-11-15T19:26:43.213 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:43.202+0000 7f8413670d80 -1 Falling back to public interface 2021-11-15T19:26:43.214 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:43.206+0000 7f23e5c25d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.215 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:43.206+0000 7f23e5c25d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.215 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:43.206+0000 7f23e5c25d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.216 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:43.206+0000 7f274e441d80 -1 Falling back to public interface 2021-11-15T19:26:43.217 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:43.210+0000 7f23e5c25d80 -1 osd.0 0 log_to_monitors {default=true} 2021-11-15T19:26:43.218 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:43.210+0000 7f1d58814d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.218 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:43.210+0000 7f1d58814d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.218 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:43.210+0000 7f1d58814d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.219 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:43.214+0000 7f6a71cf6d80 -1 Falling back to public interface 2021-11-15T19:26:43.219 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:43.214+0000 7f75766ecd80 -1 Falling back to public interface 2021-11-15T19:26:43.220 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:43.210+0000 7f1d58814d80 -1 osd.1 0 log_to_monitors {default=true} 2021-11-15T19:26:43.223 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:43.218+0000 7fd40027dd80 -1 Falling back to public interface 2021-11-15T19:26:43.227 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:43.218+0000 7f274e441d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.227 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:43.218+0000 7f274e441d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.227 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:43.218+0000 7f274e441d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.228 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:43.222+0000 7f6a71cf6d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.229 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:43.222+0000 7f6a71cf6d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.229 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:43.222+0000 7f6a71cf6d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.230 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:43.222+0000 7f75766ecd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.230 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:43.222+0000 7f75766ecd80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.230 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:43.222+0000 7f75766ecd80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.231 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:43.226+0000 7f6a71cf6d80 -1 osd.4 0 log_to_monitors {default=true} 2021-11-15T19:26:43.232 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:43.218+0000 7f8413670d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.232 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:43.218+0000 7f8413670d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.232 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:43.218+0000 7f8413670d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.233 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:43.226+0000 7fb9f96d0d80 -1 Falling back to public interface 2021-11-15T19:26:43.233 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:43.222+0000 7f274e441d80 -1 osd.3 0 log_to_monitors {default=true} 2021-11-15T19:26:43.234 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:43.226+0000 7f75766ecd80 -1 osd.5 0 log_to_monitors {default=true} 2021-11-15T19:26:43.234 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:43.222+0000 7f8413670d80 -1 osd.2 0 log_to_monitors {default=true} 2021-11-15T19:26:43.235 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:43.226+0000 7fd40027dd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.235 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:43.226+0000 7fd40027dd80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.235 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:43.226+0000 7fd40027dd80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.236 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:43.230+0000 7fd40027dd80 -1 osd.6 0 log_to_monitors {default=true} 2021-11-15T19:26:43.249 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:43.242+0000 7fb9f96d0d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-11-15T19:26:43.249 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:43.242+0000 7fb9f96d0d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.250 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:43.242+0000 7fb9f96d0d80 -1 journal do_read_entry(8192): bad header magic 2021-11-15T19:26:43.252 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:43.246+0000 7fb9f96d0d80 -1 osd.7 0 log_to_monitors {default=true} 2021-11-15T19:26:43.999 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:44.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 Processor -- start 2021-11-15T19:26:44.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- start start 2021-11-15T19:26:44.053 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7008144b30 0x7f70081470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.054 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700814b080 con 0x7f700805c9a0 2021-11-15T19:26:44.054 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700814b2b0 con 0x7f7008144750 2021-11-15T19:26:44.054 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700805d240 con 0x7f7008144b30 2021-11-15T19:26:44.054 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7006ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7008144750 0x7f700805c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49450/0 (socket says 172.21.2.137:49450) 2021-11-15T19:26:44.055 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7006ffd700 1 -- 172.21.2.137:0/1840296318 learned_addr learned my addr 172.21.2.137:0/1840296318 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:44.055 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033787198 0 0) 0x7f700814b2b0 con 0x7f7008144750 2021-11-15T19:26:44.055 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe8003260 con 0x7f7008144750 2021-11-15T19:26:44.055 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70067fc700 1 --2- 172.21.2.137:0/1840296318 >> v2:172.21.2.111:3300/0 conn(0x7f7008144b30 0x7f70081470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.055 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119667202 0 0) 0x7f6fe8003260 con 0x7f7008144750 2021-11-15T19:26:44.056 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 >> v2:172.21.2.111:3300/0 conn(0x7f7008144b30 msgr2=0x7f70081470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:44.056 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 --2- 172.21.2.137:0/1840296318 >> v2:172.21.2.111:3300/0 conn(0x7f7008144b30 0x7f70081470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.056 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 >> v1:172.21.2.111:6789/0 conn(0x7f700805c9a0 legacy=0x7f700805f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:44.056 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700814b550 con 0x7f7008144750 2021-11-15T19:26:44.056 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6ff0001660 con 0x7f7008144750 2021-11-15T19:26:44.057 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 >> v1:172.21.2.137:6789/0 conn(0x7f7008144750 legacy=0x7f700805c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:44.057 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8003820 0x7f6fe8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.057 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6fe8004500 0x7f6fe8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.057 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6fe8004f70 0x7f6fe800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.058 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe800be20 con 0x7f6fe8004500 2021-11-15T19:26:44.058 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe800bf90 con 0x7f6fe8004f70 2021-11-15T19:26:44.058 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe800c150 con 0x7f6fe8003820 2021-11-15T19:26:44.058 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6fe8004f70 0x7f6fe800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.059 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70067fc700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6fe8004500 0x7f6fe8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.059 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7006ffd700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8003820 0x7f6fe8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.059 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 -- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8003820 msgr2=0x7f6fe8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:44.059 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8003820 0x7f6fe8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.059 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 -- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6fe8004500 msgr2=0x7f6fe8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:44.060 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6fe8004500 0x7f6fe8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.060 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 -- 172.21.2.137:0/1840296318 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8003260 con 0x7f6fe8004f70 2021-11-15T19:26:44.060 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 -- 172.21.2.137:0/1840296318 reap_dead start 2021-11-15T19:26:44.060 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f70077fe700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6fe8004f70 0x7f6fe800b750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7000002320 tx=0x7f7000007d80).ready entity=mon.1 client_cookie=8bcb82bd8cbd1e37 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:44.060 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7000002510 con 0x7f6fe8004f70 2021-11-15T19:26:44.061 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7000006890 con 0x7f6fe8004f70 2021-11-15T19:26:44.061 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f7005ffb700 1 -- 172.21.2.137:0/1840296318 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7000006bf0 con 0x7f6fe8004f70 2021-11-15T19:26:44.061 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- 172.21.2.137:0/1840296318 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6fe8004f70 msgr2=0x7f6fe800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:44.061 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6fe8004f70 0x7f6fe800b750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7000002320 tx=0x7f7000007d80).stop 2021-11-15T19:26:44.061 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- 172.21.2.137:0/1840296318 shutdown_connections 2021-11-15T19:26:44.062 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 --2- 172.21.2.137:0/1840296318 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6fe8004f70 0x7f6fe800b750 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.062 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- 172.21.2.137:0/1840296318 >> 172.21.2.137:0/1840296318 conn(0x7f70080b4f00 msgr2=0x7f70080b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:44.062 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- 172.21.2.137:0/1840296318 shutdown_connections 2021-11-15T19:26:44.062 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.042+0000 7f700d636700 1 -- 172.21.2.137:0/1840296318 wait complete. 2021-11-15T19:26:44.062 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 Processor -- start 2021-11-15T19:26:44.063 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- start start 2021-11-15T19:26:44.066 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8004f70 0x7f70080aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.066 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70080a9200 0x7f70080ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.066 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 0x7f7008159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:44.066 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080ab500 con 0x7f70080a9200 2021-11-15T19:26:44.066 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080aa360 con 0x7f7008159850 2021-11-15T19:26:44.067 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7008098b20 con 0x7f6fe8004f70 2021-11-15T19:26:44.067 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 0x7f7008159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.067 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 0x7f7008159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:58912/0 (socket says 172.21.2.137:58912) 2021-11-15T19:26:44.067 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 -- 172.21.2.137:0/3834359292 learned_addr learned my addr 172.21.2.137:0/3834359292 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:44.068 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f7006ffd700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8004f70 0x7f70080aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.068 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70067fc700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70080a9200 0x7f70080ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:44.068 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 -- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8004f70 msgr2=0x7f70080aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:44.068 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8004f70 0x7f70080aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.068 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 -- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70080a9200 msgr2=0x7f70080ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:44.069 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70080a9200 0x7f70080ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.069 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 -- 172.21.2.137:0/3834359292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080aa060 con 0x7f7008159850 2021-11-15T19:26:44.069 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f7006ffd700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8004f70 0x7f70080aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:26:44.069 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70067fc700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70080a9200 0x7f70080ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:26:44.070 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f70077fe700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 0x7f7008159d00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f7000002320 tx=0x7f7000016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:44.070 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f700001d600 con 0x7f7008159850 2021-11-15T19:26:44.070 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700001d760 con 0x7f7008159850 2021-11-15T19:26:44.070 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700815a1f0 con 0x7f7008159850 2021-11-15T19:26:44.071 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f700001dac0 con 0x7f7008159850 2021-11-15T19:26:44.071 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700815a640 con 0x7f7008159850 2021-11-15T19:26:44.071 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7f700001b040 con 0x7f7008159850 2021-11-15T19:26:44.071 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700805bdf0 con 0x7f7008159850 2021-11-15T19:26:44.071 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f700003acc0 con 0x7f7008159850 2021-11-15T19:26:44.072 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.046+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f700001c960 con 0x7f7008159850 2021-11-15T19:26:44.092 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.082+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70080573d0 con 0x7f7008159850 2021-11-15T19:26:44.093 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.082+0000 7f6ffffff700 1 -- 172.21.2.137:0/3834359292 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7f700001c370 con 0x7f7008159850 2021-11-15T19:26:44.094 INFO:teuthology.misc.health.gibba037.stdout: 2021-11-15T19:26:44.094 INFO:teuthology.misc.health.gibba037.stdout:{"epoch":10,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:43.158528+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:44.095 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 msgr2=0x7f7008159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:44.095 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 0x7f7008159d00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f7000002320 tx=0x7f7000016000).stop 2021-11-15T19:26:44.095 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 shutdown_connections 2021-11-15T19:26:44.095 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7008159850 0x7f7008159d00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.095 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70080a9200 0x7f70080ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.096 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 --2- 172.21.2.137:0/3834359292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6fe8004f70 0x7f70080aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:44.096 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 >> 172.21.2.137:0/3834359292 conn(0x7f70080b4f00 msgr2=0x7f7008145c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:44.096 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 shutdown_connections 2021-11-15T19:26:44.097 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:44.086+0000 7f700d636700 1 -- 172.21.2.137:0/3834359292 wait complete. 2021-11-15T19:26:44.100 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-11-15T19:26:45.172 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:45.166+0000 7fd3ea340700 -1 osd.6 0 waiting for initial osdmap 2021-11-15T19:26:45.173 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:45.166+0000 7f6a5bdb9700 -1 osd.4 0 waiting for initial osdmap 2021-11-15T19:26:45.174 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:45.166+0000 7f75607af700 -1 osd.5 0 waiting for initial osdmap 2021-11-15T19:26:45.174 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:45.166+0000 7fb9e3793700 -1 osd.7 0 waiting for initial osdmap 2021-11-15T19:26:45.175 INFO:tasks.ceph.osd.6.gibba011.stderr:2021-11-15T19:26:45.170+0000 7fd3f97c2700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.175 INFO:tasks.ceph.osd.4.gibba011.stderr:2021-11-15T19:26:45.170+0000 7f6a6b23b700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.175 INFO:tasks.ceph.osd.7.gibba011.stderr:2021-11-15T19:26:45.170+0000 7fb9f2c15700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.176 INFO:tasks.ceph.osd.5.gibba011.stderr:2021-11-15T19:26:45.170+0000 7f756fc31700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.184 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:45.174+0000 7f23cfce8700 -1 osd.0 0 waiting for initial osdmap 2021-11-15T19:26:45.185 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:45.174+0000 7f1d428d7700 -1 osd.1 0 waiting for initial osdmap 2021-11-15T19:26:45.186 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:45.178+0000 7f83fd733700 -1 osd.2 0 waiting for initial osdmap 2021-11-15T19:26:45.186 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:45.178+0000 7f2738504700 -1 osd.3 0 waiting for initial osdmap 2021-11-15T19:26:45.190 INFO:tasks.ceph.osd.0.gibba037.stderr:2021-11-15T19:26:45.182+0000 7f23df16a700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.191 INFO:tasks.ceph.osd.1.gibba037.stderr:2021-11-15T19:26:45.182+0000 7f1d51d59700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.192 INFO:tasks.ceph.osd.3.gibba037.stderr:2021-11-15T19:26:45.182+0000 7f2747986700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:45.192 INFO:tasks.ceph.osd.2.gibba037.stderr:2021-11-15T19:26:45.182+0000 7f840cbb5700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T19:26:50.907 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:50.956 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f77897a2700 1 Processor -- start 2021-11-15T19:26:50.957 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f77897a2700 1 -- start start 2021-11-15T19:26:50.959 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f77897a2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7784140aa0 0x7f7784144a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.960 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f77897a2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840aab90 con 0x7f7784141a70 2021-11-15T19:26:50.960 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f77897a2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840b7f40 con 0x7f77840b7b60 2021-11-15T19:26:50.960 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f77897a2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77840b38e0 con 0x7f7784140aa0 2021-11-15T19:26:50.960 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f7782ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f77840b7b60 0x7f7784141360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49654/0 (socket says 172.21.2.137:49654) 2021-11-15T19:26:50.961 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f7782ffd700 1 -- 172.21.2.137:0/1287405426 learned_addr learned my addr 172.21.2.137:0/1287405426 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:50.961 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.946+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423897471 0 0) 0x7f77840b7f40 con 0x7f77840b7b60 2021-11-15T19:26:50.961 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7764003260 con 0x7f77840b7b60 2021-11-15T19:26:50.961 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1148627383 0 0) 0x7f7764003260 con 0x7f77840b7b60 2021-11-15T19:26:50.962 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 >> v2:172.21.2.111:3300/0 conn(0x7f7784140aa0 msgr2=0x7f7784144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:50.962 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 --2- 172.21.2.137:0/1287405426 >> v2:172.21.2.111:3300/0 conn(0x7f7784140aa0 0x7f7784144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:50.962 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 >> v1:172.21.2.111:6789/0 conn(0x7f7784141a70 legacy=0x7f7784144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:50.962 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840673d0 con 0x7f77840b7b60 2021-11-15T19:26:50.962 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f776c001660 con 0x7f77840b7b60 2021-11-15T19:26:50.963 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 >> v1:172.21.2.137:6789/0 conn(0x7f77840b7b60 legacy=0x7f7784141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:50.963 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7764003750 0x7f7764003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.963 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004500 0x7f7764004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.963 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7764004f90 0x7f776400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.963 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77840b38e0 con 0x7f7764003750 2021-11-15T19:26:50.964 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776400bed0 con 0x7f7764004f90 2021-11-15T19:26:50.964 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776400c090 con 0x7f7764004500 2021-11-15T19:26:50.964 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7764004f90 0x7f776400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:50.964 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7782ffd700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7764003750 0x7f7764003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:50.964 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 -- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004500 msgr2=0x7f7764004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:50.965 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004500 0x7f7764004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:50.965 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 -- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7764003750 msgr2=0x7f7764003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:50.965 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7764003750 0x7f7764003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:50.965 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 -- 172.21.2.137:0/1287405426 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840673d0 con 0x7f7764004f90 2021-11-15T19:26:50.965 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7782ffd700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7764003750 0x7f7764003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:50.966 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 -- 172.21.2.137:0/1287405426 reap_dead start 2021-11-15T19:26:50.966 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77837fe700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7764004f90 0x7f776400b750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f777c0032f0 tx=0x7f777c006f90).ready entity=mon.1 client_cookie=8c7205fa72074584 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:50.966 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777c011440 con 0x7f7764004f90 2021-11-15T19:26:50.966 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c0115a0 con 0x7f7764004f90 2021-11-15T19:26:50.966 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f7781ffb700 1 -- 172.21.2.137:0/1287405426 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777c011900 con 0x7f7764004f90 2021-11-15T19:26:50.967 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/1287405426 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7764004f90 msgr2=0x7f776400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:50.967 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7764004f90 0x7f776400b750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f777c0032f0 tx=0x7f777c006f90).stop 2021-11-15T19:26:50.967 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/1287405426 shutdown_connections 2021-11-15T19:26:50.967 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 --2- 172.21.2.137:0/1287405426 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7764004f90 0x7f776400b750 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:50.968 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/1287405426 >> 172.21.2.137:0/1287405426 conn(0x7f77840655b0 msgr2=0x7f77840b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:50.968 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/1287405426 shutdown_connections 2021-11-15T19:26:50.968 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/1287405426 wait complete. 2021-11-15T19:26:50.970 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 Processor -- start 2021-11-15T19:26:50.971 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- start start 2021-11-15T19:26:50.971 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004f90 0x7f7784062470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.971 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 0x7f778414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.971 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77840aaff0 0x7f7784151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.972 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77840ab490 con 0x7f77840aaff0 2021-11-15T19:26:50.972 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77840ab730 con 0x7f7784062960 2021-11-15T19:26:50.972 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77840ab9d0 con 0x7f7764004f90 2021-11-15T19:26:50.973 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 0x7f778414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:50.973 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 0x7f778414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59118/0 (socket says 172.21.2.137:59118) 2021-11-15T19:26:50.973 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 -- 172.21.2.137:0/4145367995 learned_addr learned my addr 172.21.2.137:0/4145367995 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:50.973 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 -- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004f90 msgr2=0x7f7784062470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:50.974 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004f90 0x7f7784062470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:50.974 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 -- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77840aaff0 msgr2=0x7f7784151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:50.974 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77840aaff0 0x7f7784151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:50.974 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 -- 172.21.2.137:0/4145367995 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778414ee10 con 0x7f7784062960 2021-11-15T19:26:50.975 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77827fc700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 0x7f778414e490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7774000f70 tx=0x7f7774006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:50.975 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7774013460 con 0x7f7784062960 2021-11-15T19:26:50.975 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77740135c0 con 0x7f7784062960 2021-11-15T19:26:50.975 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778414dce0 con 0x7f7784062960 2021-11-15T19:26:50.976 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7774013920 con 0x7f7784062960 2021-11-15T19:26:50.976 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.950+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778414eba0 con 0x7f7784062960 2021-11-15T19:26:50.976 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77840633a0 con 0x7f7784062960 2021-11-15T19:26:50.976 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f777401a060 con 0x7f7784062960 2021-11-15T19:26:50.977 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f777bfff700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77680534f0 0x7f77680559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:50.977 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4896+0+0 (secure 0 0 0) 0x7f777406ad20 con 0x7f7784062960 2021-11-15T19:26:50.977 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f7782ffd700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77680534f0 0x7f77680559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:50.977 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f7782ffd700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77680534f0 0x7f77680559b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f776c008000 tx=0x7f776c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:50.977 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:50.954+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f77840633a0 con 0x7f7784062960 2021-11-15T19:26:51.046 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77840633a0 con 0x7f7784062960 2021-11-15T19:26:51.047 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f777bfff700 1 -- 172.21.2.137:0/4145367995 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11805 (secure 0 0 0) 0x7f77840633a0 con 0x7f7784062960 2021-11-15T19:26:51.047 INFO:teuthology.misc.health.gibba037.stdout: 2021-11-15T19:26:51.048 INFO:teuthology.misc.health.gibba037.stdout:{"epoch":15,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:48.179061+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:51.049 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77680534f0 msgr2=0x7f77680559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.049 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77680534f0 0x7f77680559b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f776c008000 tx=0x7f776c009040).stop 2021-11-15T19:26:51.049 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 msgr2=0x7f778414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.049 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 0x7f778414e490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7774000f70 tx=0x7f7774006dc0).stop 2021-11-15T19:26:51.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 shutdown_connections 2021-11-15T19:26:51.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77680534f0 0x7f77680559b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:51.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77840aaff0 0x7f7784151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7784062960 0x7f778414e490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:51.050 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 --2- 172.21.2.137:0/4145367995 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7764004f90 0x7f7784062470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.051 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 >> 172.21.2.137:0/4145367995 conn(0x7f77840655b0 msgr2=0x7f7784140f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:51.051 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 shutdown_connections 2021-11-15T19:26:51.051 INFO:teuthology.misc.health.gibba037.stderr:2021-11-15T19:26:51.038+0000 7f77897a2700 1 -- 172.21.2.137:0/4145367995 wait complete. 2021-11-15T19:26:51.054 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-11-15T19:26:51.055 INFO:tasks.ceph:Creating RBD pool 2021-11-15T19:26:51.055 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster ceph osd pool create rbd 8 2021-11-15T19:26:51.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 Processor -- start 2021-11-15T19:26:51.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- start start 2021-11-15T19:26:51.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f036405c770 0x7f03640aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0364140aa0 0x7f0364140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036405cb50 con 0x7f03640b0550 2021-11-15T19:26:51.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03640b1650 con 0x7f036405c770 2021-11-15T19:26:51.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03640ad030 con 0x7f0364140aa0 2021-11-15T19:26:51.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0368b03700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0364140aa0 0x7f0364140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:51.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f03637fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f03640b0550 0x7f036414a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49676/0 (socket says 172.21.2.137:49676) 2021-11-15T19:26:51.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f03637fe700 1 -- 172.21.2.137:0/2855560388 learned_addr learned my addr 172.21.2.137:0/2855560388 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:51.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0368b03700 1 -- 172.21.2.137:0/2855560388 >> v2:172.21.2.111:3300/0 conn(0x7f036405c770 msgr2=0x7f03640aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:51.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0368b03700 1 --2- 172.21.2.137:0/2855560388 >> v2:172.21.2.111:3300/0 conn(0x7f036405c770 0x7f03640aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0368b03700 1 -- 172.21.2.137:0/2855560388 >> v1:172.21.2.137:6789/0 conn(0x7f03640b0550 legacy=0x7f036414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0368b03700 1 -- 172.21.2.137:0/2855560388 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640ad2d0 con 0x7f0364140aa0 2021-11-15T19:26:51.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0368b03700 1 --2- 172.21.2.137:0/2855560388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0364140aa0 0x7f0364140ef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f035c0032f0 tx=0x7f035c0091d0).ready entity=mon.1 client_cookie=2cc3ef0b33f66b65 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:51.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0362ffd700 1 -- 172.21.2.137:0/2855560388 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f035c009ea0 con 0x7f0364140aa0 2021-11-15T19:26:51.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0362ffd700 1 -- 172.21.2.137:0/2855560388 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c00b870 con 0x7f0364140aa0 2021-11-15T19:26:51.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f0362ffd700 1 -- 172.21.2.137:0/2855560388 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f035c00b9e0 con 0x7f0364140aa0 2021-11-15T19:26:51.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- 172.21.2.137:0/2855560388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0364140aa0 msgr2=0x7f0364140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- 172.21.2.137:0/2855560388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0364140aa0 0x7f0364140ef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f035c0032f0 tx=0x7f035c0091d0).stop 2021-11-15T19:26:51.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- 172.21.2.137:0/2855560388 shutdown_connections 2021-11-15T19:26:51.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- 172.21.2.137:0/2855560388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0364140aa0 0x7f0364140ef0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:51.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- 172.21.2.137:0/2855560388 >> v2:172.21.2.111:3300/0 conn(0x7f036405c770 0x7f03640aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- 172.21.2.137:0/2855560388 >> 172.21.2.137:0/2855560388 conn(0x7f03640631e0 msgr2=0x7f036405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:51.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- 172.21.2.137:0/2855560388 shutdown_connections 2021-11-15T19:26:51.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- 172.21.2.137:0/2855560388 wait complete. 2021-11-15T19:26:51.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 Processor -- start 2021-11-15T19:26:51.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- start start 2021-11-15T19:26:51.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 0x7f0364065760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03640b0550 0x7f0364156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0364140aa0 0x7f03640643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640671d0 con 0x7f03640b0550 2021-11-15T19:26:51.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03641429d0 con 0x7f036405c770 2021-11-15T19:26:51.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.098+0000 7f036a566700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0364156420 con 0x7f0364140aa0 2021-11-15T19:26:51.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 0x7f0364065760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:51.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 0x7f0364065760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59134/0 (socket says 172.21.2.137:59134) 2021-11-15T19:26:51.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 -- 172.21.2.137:0/1477542326 learned_addr learned my addr 172.21.2.137:0/1477542326 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:51.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 -- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0364140aa0 msgr2=0x7f03640643e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:51.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0364140aa0 0x7f03640643e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 -- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03640b0550 msgr2=0x7f0364156b60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:51.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03640b0550 0x7f0364156b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 -- 172.21.2.137:0/1477542326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c009470 con 0x7f036405c770 2021-11-15T19:26:51.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f0363fff700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 0x7f0364065760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f034c002f70 tx=0x7f034c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:51.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034c013460 con 0x7f036405c770 2021-11-15T19:26:51.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c0135c0 con 0x7f036405c770 2021-11-15T19:26:51.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034c013920 con 0x7f036405c770 2021-11-15T19:26:51.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03641566c0 con 0x7f036405c770 2021-11-15T19:26:51.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0364065c50 con 0x7f036405c770 2021-11-15T19:26:51.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0364156850 con 0x7f036405c770 2021-11-15T19:26:51.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f034c01a060 con 0x7f036405c770 2021-11-15T19:26:51.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03617fa700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0348053720 0x7f0348055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4896+0+0 (secure 0 0 0) 0x7f034c06af90 con 0x7f036405c770 2021-11-15T19:26:51.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03637fe700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0348053720 0x7f0348055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:51.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.102+0000 7f03637fe700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0348053720 0x7f0348055be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f03640aee10 tx=0x7f0354007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:51.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.106+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f034c042480 con 0x7f036405c770 2021-11-15T19:26:51.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.186+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f03640ae7f0 con 0x7f036405c770 2021-11-15T19:26:51.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f03617fa700 1 -- 172.21.2.137:0/1477542326 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f034c018070 con 0x7f036405c770 2021-11-15T19:26:51.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0348053720 msgr2=0x7f0348055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0348053720 0x7f0348055be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f03640aee10 tx=0x7f0354007790).stop 2021-11-15T19:26:51.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 msgr2=0x7f0364065760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 0x7f0364065760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f034c002f70 tx=0x7f034c006ec0).stop 2021-11-15T19:26:51.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 shutdown_connections 2021-11-15T19:26:51.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0348053720 0x7f0348055be0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:51.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0364140aa0 0x7f03640643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03640b0550 0x7f0364156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 --2- 172.21.2.137:0/1477542326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f036405c770 0x7f0364065760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:51.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 >> 172.21.2.137:0/1477542326 conn(0x7f03640631e0 msgr2=0x7f036414ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:51.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 shutdown_connections 2021-11-15T19:26:51.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.866+0000 7f036a566700 1 -- 172.21.2.137:0/1477542326 wait complete. 2021-11-15T19:26:51.878 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'rbd' created 2021-11-15T19:26:51.881 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-15T19:26:51.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.922+0000 7f7d14f51700 1 Processor -- start 2021-11-15T19:26:51.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.922+0000 7f7d14f51700 1 -- start start 2021-11-15T19:26:51.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 0x7f7d1013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7d100b3c00 0x7f7d1013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d100b63b0 con 0x7f7d100b6830 2021-11-15T19:26:51.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1013d0d0 con 0x7f7d100b3c00 2021-11-15T19:26:51.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d10147070 con 0x7f7d100b5fd0 2021-11-15T19:26:51.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7d100b3c00 0x7f7d1013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:51.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7d100b3c00 0x7f7d1013cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59140/0 (socket says 172.21.2.137:59140) 2021-11-15T19:26:51.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/4144918180 learned_addr learned my addr 172.21.2.137:0/4144918180 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:51.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/4144918180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 msgr2=0x7f7d1013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:51.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- 172.21.2.137:0/4144918180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 0x7f7d1013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/4144918180 >> v1:172.21.2.111:6789/0 conn(0x7f7d100b6830 legacy=0x7f7d10142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:51.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/4144918180 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10146dd0 con 0x7f7d100b3c00 2021-11-15T19:26:51.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- 172.21.2.137:0/4144918180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b3c00 0x7f7d1013cbe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7d100b65f0 tx=0x7f7d08009290).ready entity=mon.1 client_cookie=c91c282b0ab4fc35 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:51.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0d59a700 1 -- 172.21.2.137:0/4144918180 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0800b860 con 0x7f7d100b3c00 2021-11-15T19:26:51.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0d59a700 1 -- 172.21.2.137:0/4144918180 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0800b9c0 con 0x7f7d100b3c00 2021-11-15T19:26:51.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0d59a700 1 -- 172.21.2.137:0/4144918180 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0800bb70 con 0x7f7d100b3c00 2021-11-15T19:26:51.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- 172.21.2.137:0/4144918180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b3c00 msgr2=0x7f7d1013cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:51.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- 172.21.2.137:0/4144918180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b3c00 0x7f7d1013cbe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7d100b65f0 tx=0x7f7d08009290).stop 2021-11-15T19:26:51.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- 172.21.2.137:0/4144918180 shutdown_connections 2021-11-15T19:26:51.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- 172.21.2.137:0/4144918180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b3c00 0x7f7d1013cbe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:51.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- 172.21.2.137:0/4144918180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 0x7f7d1013c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- 172.21.2.137:0/4144918180 >> 172.21.2.137:0/4144918180 conn(0x7f7d100624b0 msgr2=0x7f7d10062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:51.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- 172.21.2.137:0/4144918180 shutdown_connections 2021-11-15T19:26:51.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- 172.21.2.137:0/4144918180 wait complete. 2021-11-15T19:26:51.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 Processor -- start 2021-11-15T19:26:51.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- start start 2021-11-15T19:26:51.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d100b3c00 0x7f7d1013bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 0x7f7d10156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 0x7f7d100671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1015ace0 con 0x7f7d100b3c00 2021-11-15T19:26:51.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d10063b60 con 0x7f7d100b6830 2021-11-15T19:26:51.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d14f51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1013c080 con 0x7f7d100b5fd0 2021-11-15T19:26:51.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 0x7f7d100671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:51.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 0x7f7d100671c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59148/0 (socket says 172.21.2.137:59148) 2021-11-15T19:26:51.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/1822203108 learned_addr learned my addr 172.21.2.137:0/1822203108 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:51.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 msgr2=0x7f7d10156920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:51.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 0x7f7d10156920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d100b3c00 msgr2=0x7f7d1013bb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:51.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d100b3c00 0x7f7d1013bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:51.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 -- 172.21.2.137:0/1822203108 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009530 con 0x7f7d100b6830 2021-11-15T19:26:51.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.926+0000 7f7d0ed9d700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 0x7f7d100671c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7d100b65f0 tx=0x7f7d08016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:51.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0800bb30 con 0x7f7d100b6830 2021-11-15T19:26:51.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0801f420 con 0x7f7d100b6830 2021-11-15T19:26:51.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0801f780 con 0x7f7d100b6830 2021-11-15T19:26:51.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d10063770 con 0x7f7d100b6830 2021-11-15T19:26:51.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1015aa20 con 0x7f7d100b6830 2021-11-15T19:26:51.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d10146af0 con 0x7f7d100b6830 2021-11-15T19:26:51.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d0800f070 con 0x7f7d100b6830 2021-11-15T19:26:51.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7cec0536a0 0x7f7cec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:51.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f7d0806c280 con 0x7f7d100b6830 2021-11-15T19:26:51.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7d0e59c700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7cec0536a0 0x7f7cec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:51.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7d0e59c700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7cec0536a0 0x7f7cec055b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7d00002f70 tx=0x7f7d000069f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:51.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:51.930+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d08043610 con 0x7f7d100b6830 2021-11-15T19:26:52.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.018+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7d100573d0 con 0x7f7d100b6830 2021-11-15T19:26:52.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7cff7fe700 1 -- 172.21.2.137:0/1822203108 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7d08015070 con 0x7f7d100b6830 2021-11-15T19:26:52.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7cec0536a0 msgr2=0x7f7cec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:52.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7cec0536a0 0x7f7cec055b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7d00002f70 tx=0x7f7d000069f0).stop 2021-11-15T19:26:52.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 msgr2=0x7f7d100671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:52.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 0x7f7d100671c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7d100b65f0 tx=0x7f7d08016000).stop 2021-11-15T19:26:52.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 shutdown_connections 2021-11-15T19:26:52.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7cec0536a0 0x7f7cec055b60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d100b6830 0x7f7d100671c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d100b5fd0 0x7f7d10156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:52.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 --2- 172.21.2.137:0/1822203108 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d100b3c00 0x7f7d1013bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:52.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 >> 172.21.2.137:0/1822203108 conn(0x7f7d100624b0 msgr2=0x7f7d100b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:52.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 shutdown_connections 2021-11-15T19:26:52.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.870+0000 7f7d14f51700 1 -- 172.21.2.137:0/1822203108 wait complete. 2021-11-15T19:26:52.884 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-15T19:26:52.887 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-11-15T19:26:52.887 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:26:52.888 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:26:52.890 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:26:52.890 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:26:52.890 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:26:52.893 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:26:52.893 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-11-15T19:26:52.894 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:52.926 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:26:52.926 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:26:52.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 Processor -- start 2021-11-15T19:26:52.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 -- start start 2021-11-15T19:26:52.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7db00b2d50 0x7f7db005f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:52.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7db005fed0 0x7f7db0060380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:52.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db0097c50 con 0x7f7db00ac3c0 2021-11-15T19:26:52.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00ac120 con 0x7f7db005fed0 2021-11-15T19:26:52.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db7097700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00979b0 con 0x7f7db00b2d50 2021-11-15T19:26:52.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7daffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7db00b2d50 0x7f7db005f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:52.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db4e33700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7db00ac3c0 0x7f7db00ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49714/0 (socket says 172.21.2.137:49714) 2021-11-15T19:26:52.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db4e33700 1 -- 172.21.2.137:0/3484202651 learned_addr learned my addr 172.21.2.137:0/3484202651 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:52.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7db5634700 1 --2- 172.21.2.137:0/3484202651 >> v2:172.21.2.111:3300/0 conn(0x7f7db005fed0 0x7f7db0060380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:52.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7daffff700 1 -- 172.21.2.137:0/3484202651 >> v2:172.21.2.111:3300/0 conn(0x7f7db005fed0 msgr2=0x7f7db0060380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:52.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7daffff700 1 --2- 172.21.2.137:0/3484202651 >> v2:172.21.2.111:3300/0 conn(0x7f7db005fed0 0x7f7db0060380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7daffff700 1 -- 172.21.2.137:0/3484202651 >> v1:172.21.2.137:6789/0 conn(0x7f7db00ac3c0 legacy=0x7f7db00ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:52.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7daffff700 1 -- 172.21.2.137:0/3484202651 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00aceb0 con 0x7f7db00b2d50 2021-11-15T19:26:52.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.938+0000 7f7daffff700 1 --2- 172.21.2.137:0/3484202651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00b2d50 0x7f7db005f9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7da4002f70 tx=0x7f7da4006df0).ready entity=mon.1 client_cookie=dc1f08b2826f4d60 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:52.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daf7fe700 1 -- 172.21.2.137:0/3484202651 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da400d5c0 con 0x7f7db00b2d50 2021-11-15T19:26:52.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daf7fe700 1 -- 172.21.2.137:0/3484202651 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4000e90 con 0x7f7db00b2d50 2021-11-15T19:26:52.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daf7fe700 1 -- 172.21.2.137:0/3484202651 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da400d910 con 0x7f7db00b2d50 2021-11-15T19:26:52.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/3484202651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00b2d50 msgr2=0x7f7db005f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:52.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 --2- 172.21.2.137:0/3484202651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00b2d50 0x7f7db005f9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7da4002f70 tx=0x7f7da4006df0).stop 2021-11-15T19:26:52.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/3484202651 shutdown_connections 2021-11-15T19:26:52.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 --2- 172.21.2.137:0/3484202651 >> v2:172.21.2.111:3300/0 conn(0x7f7db005fed0 0x7f7db0060380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 --2- 172.21.2.137:0/3484202651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00b2d50 0x7f7db005f9e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/3484202651 >> 172.21.2.137:0/3484202651 conn(0x7f7db00b7070 msgr2=0x7f7db00b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:52.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/3484202651 shutdown_connections 2021-11-15T19:26:52.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/3484202651 wait complete. 2021-11-15T19:26:52.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 Processor -- start 2021-11-15T19:26:52.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- start start 2021-11-15T19:26:52.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7db005fed0 0x7f7db00b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:52.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 0x7f7db0141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:52.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7db009ad90 0x7f7db0141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:52.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0141d20 con 0x7f7db005fed0 2021-11-15T19:26:52.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00b03f0 con 0x7f7db00ac3c0 2021-11-15T19:26:52.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00b0690 con 0x7f7db009ad90 2021-11-15T19:26:52.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 0x7f7db0141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:52.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 0x7f7db0141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59174/0 (socket says 172.21.2.137:59174) 2021-11-15T19:26:52.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 -- 172.21.2.137:0/837487199 learned_addr learned my addr 172.21.2.137:0/837487199 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:52.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db4e33700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7db005fed0 0x7f7db00b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:52.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db5634700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7db009ad90 0x7f7db0141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:52.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 -- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7db009ad90 msgr2=0x7f7db0141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:52.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7db009ad90 0x7f7db0141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 -- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7db005fed0 msgr2=0x7f7db00b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:52.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7db005fed0 0x7f7db00b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:52.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 -- 172.21.2.137:0/837487199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da400b180 con 0x7f7db00ac3c0 2021-11-15T19:26:52.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7daffff700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 0x7f7db0141340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7da4002f70 tx=0x7f7da4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:52.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da4013de0 con 0x7f7db00ac3c0 2021-11-15T19:26:52.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da401e400 con 0x7f7db00ac3c0 2021-11-15T19:26:52.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db009a990 con 0x7f7db00ac3c0 2021-11-15T19:26:52.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da401e760 con 0x7f7db00ac3c0 2021-11-15T19:26:52.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.942+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db00b1110 con 0x7f7db00ac3c0 2021-11-15T19:26:52.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7da4025030 con 0x7f7db00ac3c0 2021-11-15T19:26:52.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db0067c60 con 0x7f7db00ac3c0 2021-11-15T19:26:52.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7dadffb700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d900536a0 0x7f7d90055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:52.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7da406c2c0 con 0x7f7db00ac3c0 2021-11-15T19:26:52.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7db4e33700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d900536a0 0x7f7d90055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:52.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7db4e33700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d900536a0 0x7f7d90055b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f7da800d000 tx=0x7f7da8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:52.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:52.946+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7da4043750 con 0x7f7db00ac3c0 2021-11-15T19:26:53.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7db00573d0 con 0x7f7db00ac3c0 2021-11-15T19:26:53.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7dadffb700 1 -- 172.21.2.137:0/837487199 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f7da4023020 con 0x7f7db00ac3c0 2021-11-15T19:26:53.043 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:53.044 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":17,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:52.865699+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:53.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d900536a0 msgr2=0x7f7d90055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d900536a0 0x7f7d90055b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f7da800d000 tx=0x7f7da8009040).stop 2021-11-15T19:26:53.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 msgr2=0x7f7db0141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 0x7f7db0141340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7da4002f70 tx=0x7f7da4014000).stop 2021-11-15T19:26:53.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 shutdown_connections 2021-11-15T19:26:53.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d900536a0 0x7f7d90055b60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7db009ad90 0x7f7db0141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7db00ac3c0 0x7f7db0141340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 --2- 172.21.2.137:0/837487199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7db005fed0 0x7f7db00b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 >> 172.21.2.137:0/837487199 conn(0x7f7db00b7070 msgr2=0x7f7db0145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 shutdown_connections 2021-11-15T19:26:53.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.034+0000 7f7db7097700 1 -- 172.21.2.137:0/837487199 wait complete. 2021-11-15T19:26:53.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:26:53.051 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:26:53.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 Processor -- start 2021-11-15T19:26:53.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 -- start start 2021-11-15T19:26:53.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4940b2400 0x7fd4940b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd4940b5330 0x7fd4940b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd494146c20 con 0x7fd4940b3e70 2021-11-15T19:26:53.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd494142af0 con 0x7fd4940b5330 2021-11-15T19:26:53.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd4991d2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940b27e0 con 0x7fd4940b2400 2021-11-15T19:26:53.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49359e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd4940b3e70 0x7fd4940b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49730/0 (socket says 172.21.2.137:49730) 2021-11-15T19:26:53.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49359e700 1 -- 172.21.2.137:0/3856962728 learned_addr learned my addr 172.21.2.137:0/3856962728 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:53.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547363632 0 0) 0x7fd494146c20 con 0x7fd4940b3e70 2021-11-15T19:26:53.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd474003260 con 0x7fd4940b3e70 2021-11-15T19:26:53.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd492d9d700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4940b2400 0x7fd4940b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 --2- 172.21.2.137:0/3856962728 >> v2:172.21.2.111:3300/0 conn(0x7fd4940b5330 0x7fd4940b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1651627319 0 0) 0x7fd474003260 con 0x7fd4940b3e70 2021-11-15T19:26:53.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4940b2400 msgr2=0x7fd4940b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4940b2400 0x7fd4940b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 >> v2:172.21.2.111:3300/0 conn(0x7fd4940b5330 msgr2=0x7fd4940b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 --2- 172.21.2.137:0/3856962728 >> v2:172.21.2.111:3300/0 conn(0x7fd4940b5330 0x7fd4940b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940b4d80 con 0x7fd4940b3e70 2021-11-15T19:26:53.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd48c0019e0 con 0x7fd4940b3e70 2021-11-15T19:26:53.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 >> v1:172.21.2.137:6789/0 conn(0x7fd4940b3e70 legacy=0x7fd4940b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4740037d0 0x7fd474003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd474004500 0x7fd474004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd474005020 0x7fd47400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494142af0 con 0x7fd4740037d0 2021-11-15T19:26:53.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940b27e0 con 0x7fd474004500 2021-11-15T19:26:53.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47400bf00 con 0x7fd474005020 2021-11-15T19:26:53.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 --2- 172.21.2.137:0/3856962728 >> v2:172.21.2.111:3300/0 conn(0x7fd4940b5330 0x7fd4940b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:53.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd492d9d700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4940b2400 0x7fd4940b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:53.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd474004500 0x7fd474004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 -- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd474005020 msgr2=0x7fd47400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd474005020 0x7fd47400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 -- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4740037d0 msgr2=0x7fd474003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4740037d0 0x7fd474003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 -- 172.21.2.137:0/3856962728 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474003260 con 0x7fd474004500 2021-11-15T19:26:53.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd49259c700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd474004500 0x7fd474004980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd484007000 tx=0x7fd484008040).ready entity=mon.1 client_cookie=814ef8a0ca105013 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd484015070 con 0x7fd474004500 2021-11-15T19:26:53.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484011410 con 0x7fd474004500 2021-11-15T19:26:53.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.138+0000 7fd491d9b700 1 -- 172.21.2.137:0/3856962728 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd484011770 con 0x7fd474004500 2021-11-15T19:26:53.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/3856962728 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd474004500 msgr2=0x7fd474004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 --2- 172.21.2.137:0/3856962728 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd474004500 0x7fd474004980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd484007000 tx=0x7fd484008040).stop 2021-11-15T19:26:53.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49359e700 1 -- 172.21.2.137:0/3856962728 reap_dead start 2021-11-15T19:26:53.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/3856962728 shutdown_connections 2021-11-15T19:26:53.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/3856962728 >> 172.21.2.137:0/3856962728 conn(0x7fd4940623a0 msgr2=0x7fd494062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/3856962728 shutdown_connections 2021-11-15T19:26:53.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/3856962728 wait complete. 2021-11-15T19:26:53.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 Processor -- start 2021-11-15T19:26:53.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- start start 2021-11-15T19:26:53.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd474004500 0x7fd49414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 0x7fd494116750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd494116c40 0x7fd494113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49414fa40 con 0x7fd474004500 2021-11-15T19:26:53.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494152f40 con 0x7fd49414f5c0 2021-11-15T19:26:53.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940af9a0 con 0x7fd494116c40 2021-11-15T19:26:53.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 0x7fd494116750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 0x7fd494116750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59194/0 (socket says 172.21.2.137:59194) 2021-11-15T19:26:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 -- 172.21.2.137:0/1636925891 learned_addr learned my addr 172.21.2.137:0/1636925891 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 -- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd494116c40 msgr2=0x7fd494113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd494116c40 0x7fd494113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 -- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd474004500 msgr2=0x7fd49414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd474004500 0x7fd49414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 -- 172.21.2.137:0/1636925891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494152a20 con 0x7fd49414f5c0 2021-11-15T19:26:53.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd49259c700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 0x7fd494116750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd4941133b0 tx=0x7fd484008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd48401be70 con 0x7fd49414f5c0 2021-11-15T19:26:53.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484000e90 con 0x7fd49414f5c0 2021-11-15T19:26:53.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd494152ca0 con 0x7fd49414f5c0 2021-11-15T19:26:53.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4941134d0 con 0x7fd49414f5c0 2021-11-15T19:26:53.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd48401c620 con 0x7fd49414f5c0 2021-11-15T19:26:53.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd494146e50 con 0x7fd49414f5c0 2021-11-15T19:26:53.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd48401c780 con 0x7fd49414f5c0 2021-11-15T19:26:53.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd48bfff700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd478053690 0x7fd478055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd48406d420 con 0x7fd49414f5c0 2021-11-15T19:26:53.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.142+0000 7fd492d9d700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd478053690 0x7fd478055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.146+0000 7fd492d9d700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd478053690 0x7fd478055b50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd47c007000 tx=0x7fd47c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.146+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd484044740 con 0x7fd49414f5c0 2021-11-15T19:26:53.188 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:53.192 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:53.195 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:53.199 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:53.203 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:26:53.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd4940573d0 con 0x7fd49414f5c0 2021-11-15T19:26:53.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd48bfff700 1 -- 172.21.2.137:0/1636925891 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd484006b80 con 0x7fd49414f5c0 2021-11-15T19:26:53.240 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:26:53.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd478053690 msgr2=0x7fd478055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd478053690 0x7fd478055b50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd47c007000 tx=0x7fd47c008040).stop 2021-11-15T19:26:53.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 msgr2=0x7fd494116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 0x7fd494116750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd4941133b0 tx=0x7fd484008040).stop 2021-11-15T19:26:53.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 shutdown_connections 2021-11-15T19:26:53.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd478053690 0x7fd478055b50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd494116c40 0x7fd494113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd49414f5c0 0x7fd494116750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 --2- 172.21.2.137:0/1636925891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd474004500 0x7fd49414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 >> 172.21.2.137:0/1636925891 conn(0x7fd4940623a0 msgr2=0x7fd4940afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 shutdown_connections 2021-11-15T19:26:53.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.230+0000 7fd4991d2700 1 -- 172.21.2.137:0/1636925891 wait complete. 2021-11-15T19:26:53.247 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:26:53.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.346+0000 7fbb26de8700 1 Processor -- start 2021-11-15T19:26:53.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.346+0000 7fbb26de8700 1 -- start start 2021-11-15T19:26:53.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbb20065730 0x7fbb2013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbb20065b10 0x7fbb2013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 0x7fbb2005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb20067410 con 0x7fbb20065730 2021-11-15T19:26:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb20066270 con 0x7fbb20065b10 2021-11-15T19:26:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20065fd0 con 0x7fbb200b00a0 2021-11-15T19:26:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbb20065b10 0x7fbb2013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbb20065b10 0x7fbb2013c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59200/0 (socket says 172.21.2.137:59200) 2021-11-15T19:26:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/1618513694 learned_addr learned my addr 172.21.2.137:0/1618513694 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/1618513694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 msgr2=0x7fbb2005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- 172.21.2.137:0/1618513694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 0x7fbb2005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/1618513694 >> v2:172.21.2.111:3300/0 conn(0x7fbb20065730 msgr2=0x7fbb2013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb24b84700 1 --2- 172.21.2.137:0/1618513694 >> v2:172.21.2.111:3300/0 conn(0x7fbb20065730 0x7fbb2013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- 172.21.2.137:0/1618513694 >> v2:172.21.2.111:3300/0 conn(0x7fbb20065730 0x7fbb2013c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/1618513694 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20066f70 con 0x7fbb20065b10 2021-11-15T19:26:53.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb24b84700 1 --2- 172.21.2.137:0/1618513694 >> v2:172.21.2.111:3300/0 conn(0x7fbb20065730 0x7fbb2013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:53.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- 172.21.2.137:0/1618513694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb2013c7a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fbb10002f70 tx=0x7fbb10006e40).ready entity=mon.1 client_cookie=c378ac2240fa80d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1f7fe700 1 -- 172.21.2.137:0/1618513694 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1000bcf0 con 0x7fbb20065b10 2021-11-15T19:26:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1f7fe700 1 -- 172.21.2.137:0/1618513694 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb10000e90 con 0x7fbb20065b10 2021-11-15T19:26:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1f7fe700 1 -- 172.21.2.137:0/1618513694 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb100155e0 con 0x7fbb20065b10 2021-11-15T19:26:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- 172.21.2.137:0/1618513694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 msgr2=0x7fbb2013c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- 172.21.2.137:0/1618513694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb2013c7a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fbb10002f70 tx=0x7fbb10006e40).stop 2021-11-15T19:26:53.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- 172.21.2.137:0/1618513694 shutdown_connections 2021-11-15T19:26:53.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- 172.21.2.137:0/1618513694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 0x7fbb2005bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- 172.21.2.137:0/1618513694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb2013c7a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- 172.21.2.137:0/1618513694 >> v2:172.21.2.111:3300/0 conn(0x7fbb20065730 0x7fbb2013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- 172.21.2.137:0/1618513694 >> 172.21.2.137:0/1618513694 conn(0x7fbb20060290 msgr2=0x7fbb20060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- 172.21.2.137:0/1618513694 shutdown_connections 2021-11-15T19:26:53.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- 172.21.2.137:0/1618513694 wait complete. 2021-11-15T19:26:53.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 Processor -- start 2021-11-15T19:26:53.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- start start 2021-11-15T19:26:53.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbb20065730 0x7fbb200af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb20141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 0x7fbb20136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20140510 con 0x7fbb20065730 2021-11-15T19:26:53.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb201407b0 con 0x7fbb20065b10 2021-11-15T19:26:53.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb26de8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20140a50 con 0x7fbb200b00a0 2021-11-15T19:26:53.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb20141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb20141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59206/0 (socket says 172.21.2.137:59206) 2021-11-15T19:26:53.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/4171929725 learned_addr learned my addr 172.21.2.137:0/4171929725 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb24b84700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbb20065730 0x7fbb200af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 msgr2=0x7fbb20136180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 0x7fbb20136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbb20065730 msgr2=0x7fbb200af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbb20065730 0x7fbb200af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 -- 172.21.2.137:0/4171929725 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1000d4d0 con 0x7fbb20065b10 2021-11-15T19:26:53.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.350+0000 7fbb1ffff700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb20141890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbb10006fc0 tx=0x7fbb10018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb100158f0 con 0x7fbb20065b10 2021-11-15T19:26:53.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb10015a50 con 0x7fbb20065b10 2021-11-15T19:26:53.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb20141d80 con 0x7fbb20065b10 2021-11-15T19:26:53.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb20136670 con 0x7fbb20065b10 2021-11-15T19:26:53.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb10015db0 con 0x7fbb20065b10 2021-11-15T19:26:53.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb20140c10 con 0x7fbb20065b10 2021-11-15T19:26:53.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb10028460 con 0x7fbb20065b10 2021-11-15T19:26:53.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbb04053660 0x7fbb04055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fbb1006f040 con 0x7fbb20065b10 2021-11-15T19:26:53.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb24b84700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbb04053660 0x7fbb04055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb24b84700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbb04053660 0x7fbb04055b20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbb0800b000 tx=0x7fbb08008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.354+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb10046360 con 0x7fbb20065b10 2021-11-15T19:26:53.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb2013cc90 con 0x7fbb20065b10 2021-11-15T19:26:53.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb1dffb700 1 -- 172.21.2.137:0/4171929725 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb10049980 con 0x7fbb20065b10 2021-11-15T19:26:53.447 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:26:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbb04053660 msgr2=0x7fbb04055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbb04053660 0x7fbb04055b20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbb0800b000 tx=0x7fbb08008040).stop 2021-11-15T19:26:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 msgr2=0x7fbb20141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb20141890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbb10006fc0 tx=0x7fbb10018000).stop 2021-11-15T19:26:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 shutdown_connections 2021-11-15T19:26:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbb04053660 0x7fbb04055b20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbb200b00a0 0x7fbb20136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbb20065b10 0x7fbb20141890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 --2- 172.21.2.137:0/4171929725 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbb20065730 0x7fbb200af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 >> 172.21.2.137:0/4171929725 conn(0x7fbb20060290 msgr2=0x7fbb2013f950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 shutdown_connections 2021-11-15T19:26:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.438+0000 7fbb26de8700 1 -- 172.21.2.137:0/4171929725 wait complete. 2021-11-15T19:26:53.454 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:26:53.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6209da1700 1 Processor -- start 2021-11-15T19:26:53.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6209da1700 1 -- start start 2021-11-15T19:26:53.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6209da1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f62040b5fd0 0x7f620413c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6209da1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62040b63b0 con 0x7f62040b6830 2021-11-15T19:26:53.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6209da1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6204147070 con 0x7f62040b3c00 2021-11-15T19:26:53.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6209da1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6204146dd0 con 0x7f62040b5fd0 2021-11-15T19:26:53.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6203fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f62040b3c00 0x7f620414d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49766/0 (socket says 172.21.2.137:49766) 2021-11-15T19:26:53.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f6203fff700 1 -- 172.21.2.137:0/3957866055 learned_addr learned my addr 172.21.2.137:0/3957866055 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:53.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483842299 0 0) 0x7f6204147070 con 0x7f62040b3c00 2021-11-15T19:26:53.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e4003260 con 0x7f62040b3c00 2021-11-15T19:26:53.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570963996 0 0) 0x7f61e4003260 con 0x7f62040b3c00 2021-11-15T19:26:53.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 >> v2:172.21.2.111:3300/0 conn(0x7f62040b5fd0 msgr2=0x7f620413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 --2- 172.21.2.137:0/3957866055 >> v2:172.21.2.111:3300/0 conn(0x7f62040b5fd0 0x7f620413c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 >> v1:172.21.2.111:6789/0 conn(0x7f62040b6830 legacy=0x7f6204142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204146af0 con 0x7f62040b3c00 2021-11-15T19:26:53.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.494+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f61fc0019e0 con 0x7f62040b3c00 2021-11-15T19:26:53.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 >> v1:172.21.2.137:6789/0 conn(0x7f62040b3c00 legacy=0x7f620414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4003750 0x7f61e4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61e4004500 0x7f61e4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61e4005070 0x7f61e400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6204146dd0 con 0x7f61e4004500 2021-11-15T19:26:53.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e400bea0 con 0x7f61e4005070 2021-11-15T19:26:53.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e400c060 con 0x7f61e4003750 2021-11-15T19:26:53.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61e4005070 0x7f61e400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3957866055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4003750 msgr2=0x7f61e4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4003750 0x7f61e4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3957866055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61e4004500 msgr2=0x7f61e4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61e4004500 0x7f61e4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3957866055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4003260 con 0x7f61e4005070 2021-11-15T19:26:53.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3957866055 reap_dead start 2021-11-15T19:26:53.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61e4005070 0x7f61e400b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f62040b91b0 tx=0x7f61fc0021b0).ready entity=mon.1 client_cookie=1c7aa6f5fee483f9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61fc00cca0 con 0x7f61e4005070 2021-11-15T19:26:53.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc00ce00 con 0x7f61e4005070 2021-11-15T19:26:53.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f62027fc700 1 -- 172.21.2.137:0/3957866055 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61fc005b80 con 0x7f61e4005070 2021-11-15T19:26:53.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3957866055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61e4005070 msgr2=0x7f61e400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61e4005070 0x7f61e400b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f62040b91b0 tx=0x7f61fc0021b0).stop 2021-11-15T19:26:53.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3957866055 shutdown_connections 2021-11-15T19:26:53.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 --2- 172.21.2.137:0/3957866055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61e4005070 0x7f61e400b750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3957866055 >> 172.21.2.137:0/3957866055 conn(0x7f62040624b0 msgr2=0x7f6204062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3957866055 shutdown_connections 2021-11-15T19:26:53.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3957866055 wait complete. 2021-11-15T19:26:53.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 Processor -- start 2021-11-15T19:26:53.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- start start 2021-11-15T19:26:53.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4005070 0x7f620413b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f620413d260 0x7f6204152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 0x7f6204156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6204155970 con 0x7f620413d260 2021-11-15T19:26:53.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6204155bd0 con 0x7f620413dd80 2021-11-15T19:26:53.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62041406c0 con 0x7f61e4005070 2021-11-15T19:26:53.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 0x7f6204156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 0x7f6204156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59224/0 (socket says 172.21.2.137:59224) 2021-11-15T19:26:53.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3062835963 learned_addr learned my addr 172.21.2.137:0/3062835963 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4005070 msgr2=0x7f620413b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4005070 0x7f620413b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f620413d260 msgr2=0x7f6204152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f620413d260 0x7f6204152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 -- 172.21.2.137:0/3062835963 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204140990 con 0x7f620413dd80 2021-11-15T19:26:53.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6203fff700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 0x7f6204156070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f62040b91b0 tx=0x7f61fc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61fc001f90 con 0x7f620413dd80 2021-11-15T19:26:53.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc0074d0 con 0x7f620413dd80 2021-11-15T19:26:53.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61fc007830 con 0x7f620413dd80 2021-11-15T19:26:53.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6204152870 con 0x7f620413dd80 2021-11-15T19:26:53.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6204156780 con 0x7f620413dd80 2021-11-15T19:26:53.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.498+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62040afff0 con 0x7f620413dd80 2021-11-15T19:26:53.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.502+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61fc027070 con 0x7f620413dd80 2021-11-15T19:26:53.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.502+0000 7f6200ff9700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61e80536f0 0x7f61e8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.502+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f61fc06c360 con 0x7f620413dd80 2021-11-15T19:26:53.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.502+0000 7f62037fe700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61e80536f0 0x7f61e8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.502+0000 7f62037fe700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61e80536f0 0x7f61e8055bb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f61ec002f70 tx=0x7f61ec0069f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.502+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61fc0436e0 con 0x7f620413dd80 2021-11-15T19:26:53.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.586+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6204143a90 con 0x7f620413dd80 2021-11-15T19:26:53.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.586+0000 7f6200ff9700 1 -- 172.21.2.137:0/3062835963 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+143 (secure 0 0 0) 0x7f61fc046d00 con 0x7f620413dd80 2021-11-15T19:26:53.598 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:53.598 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:26:53.598 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:26:53.598 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:26:53.599 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:26:53.599 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:26:53.599 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:26:53.599 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:26:53.600 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:26:53.600 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:26:53.600 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:26:53.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61e80536f0 msgr2=0x7f61e8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61e80536f0 0x7f61e8055bb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f61ec002f70 tx=0x7f61ec0069f0).stop 2021-11-15T19:26:53.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 msgr2=0x7f6204156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 0x7f6204156070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f62040b91b0 tx=0x7f61fc015000).stop 2021-11-15T19:26:53.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 shutdown_connections 2021-11-15T19:26:53.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61e80536f0 0x7f61e8055bb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f620413dd80 0x7f6204156070 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f620413d260 0x7f6204152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 --2- 172.21.2.137:0/3062835963 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61e4005070 0x7f620413b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 >> 172.21.2.137:0/3062835963 conn(0x7f62040624b0 msgr2=0x7f620413a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 shutdown_connections 2021-11-15T19:26:53.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.590+0000 7f6209da1700 1 -- 172.21.2.137:0/3062835963 wait complete. 2021-11-15T19:26:53.605 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:26:53.605 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:26:53.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.646+0000 7f40812a6700 1 Processor -- start 2021-11-15T19:26:53.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- start start 2021-11-15T19:26:53.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 0x7f407c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f407c0acd60 0x7f407c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c0b76c0 con 0x7f407c0b4680 2021-11-15T19:26:53.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c0b3100 con 0x7f407c0acd60 2021-11-15T19:26:53.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c12a170 con 0x7f407c0b72e0 2021-11-15T19:26:53.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f407c0b4680 0x7f407c143ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49784/0 (socket says 172.21.2.137:49784) 2021-11-15T19:26:53.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407b7fe700 1 -- 172.21.2.137:0/1030877755 learned_addr learned my addr 172.21.2.137:0/1030877755 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:53.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790790305 0 0) 0x7f407c0b76c0 con 0x7f407c0b4680 2021-11-15T19:26:53.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c003260 con 0x7f407c0b4680 2021-11-15T19:26:53.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 --2- 172.21.2.137:0/1030877755 >> v2:172.21.2.111:3300/0 conn(0x7f407c0acd60 0x7f407c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407affd700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 0x7f407c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438066265 0 0) 0x7f405c003260 con 0x7f407c0b4680 2021-11-15T19:26:53.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 msgr2=0x7f407c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 0x7f407c0b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 >> v2:172.21.2.111:3300/0 conn(0x7f407c0acd60 msgr2=0x7f407c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 --2- 172.21.2.137:0/1030877755 >> v2:172.21.2.111:3300/0 conn(0x7f407c0acd60 0x7f407c0b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0ad8a0 con 0x7f407c0b4680 2021-11-15T19:26:53.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4074001a00 con 0x7f407c0b4680 2021-11-15T19:26:53.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 >> v1:172.21.2.137:6789/0 conn(0x7f407c0b4680 legacy=0x7f407c143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 0x7f405c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f405c003d50 0x7f405c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f405c0049f0 0x7f405c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c0b3100 con 0x7f405c0049f0 2021-11-15T19:26:53.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c12a170 con 0x7f405c003d50 2021-11-15T19:26:53.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c00fc40 con 0x7f407c0b72e0 2021-11-15T19:26:53.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f405c003d50 0x7f405c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 -- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 msgr2=0x7f405c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f407c0b72e0 0x7f405c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 -- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f405c0049f0 msgr2=0x7f405c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f405c0049f0 0x7f405c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 -- 172.21.2.137:0/1030877755 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c003260 con 0x7f405c003d50 2021-11-15T19:26:53.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407a7fc700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f405c003d50 0x7f405c004500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f406400c000 tx=0x7f4064006df0).ready entity=mon.1 client_cookie=e61e131ce87d1b90 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406400e830 con 0x7f405c003d50 2021-11-15T19:26:53.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400e990 con 0x7f405c003d50 2021-11-15T19:26:53.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f4079ffb700 1 -- 172.21.2.137:0/1030877755 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406400ecf0 con 0x7f405c003d50 2021-11-15T19:26:53.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- 172.21.2.137:0/1030877755 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f405c003d50 msgr2=0x7f405c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 --2- 172.21.2.137:0/1030877755 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f405c003d50 0x7f405c004500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f406400c000 tx=0x7f4064006df0).stop 2021-11-15T19:26:53.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f407b7fe700 1 -- 172.21.2.137:0/1030877755 reap_dead start 2021-11-15T19:26:53.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- 172.21.2.137:0/1030877755 shutdown_connections 2021-11-15T19:26:53.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- 172.21.2.137:0/1030877755 >> 172.21.2.137:0/1030877755 conn(0x7f407c064960 msgr2=0x7f407c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- 172.21.2.137:0/1030877755 shutdown_connections 2021-11-15T19:26:53.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- 172.21.2.137:0/1030877755 wait complete. 2021-11-15T19:26:53.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 Processor -- start 2021-11-15T19:26:53.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.650+0000 7f40812a6700 1 -- start start 2021-11-15T19:26:53.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f405c003d50 0x7f407c144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 0x7f407c0af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f407c0afad0 0x7f407c0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c143d40 con 0x7f407c0afad0 2021-11-15T19:26:53.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c143fa0 con 0x7f407c0b0fc0 2021-11-15T19:26:53.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c142fb0 con 0x7f405c003d50 2021-11-15T19:26:53.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 0x7f407c0af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 0x7f407c0af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59246/0 (socket says 172.21.2.137:59246) 2021-11-15T19:26:53.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 -- 172.21.2.137:0/3600977025 learned_addr learned my addr 172.21.2.137:0/3600977025 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 -- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f405c003d50 msgr2=0x7f407c144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407b7fe700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f407c0afad0 0x7f407c0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f405c003d50 0x7f407c144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 -- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f407c0afad0 msgr2=0x7f407c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f407c0afad0 0x7f407c0aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 -- 172.21.2.137:0/3600977025 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c143310 con 0x7f407c0b0fc0 2021-11-15T19:26:53.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407a7fc700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 0x7f407c0af5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f406400c000 tx=0x7f4064019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406401dea0 con 0x7f407c0b0fc0 2021-11-15T19:26:53.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064000e90 con 0x7f407c0b0fc0 2021-11-15T19:26:53.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40640255e0 con 0x7f407c0b0fc0 2021-11-15T19:26:53.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c144d10 con 0x7f407c0b0fc0 2021-11-15T19:26:53.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c142920 con 0x7f407c0b0fc0 2021-11-15T19:26:53.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c0b3a50 con 0x7f407c0b0fc0 2021-11-15T19:26:53.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f406402e430 con 0x7f407c0b0fc0 2021-11-15T19:26:53.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f4073fff700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40600535b0 0x7f4060055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f406406d2f0 con 0x7f407c0b0fc0 2021-11-15T19:26:53.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407affd700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40600535b0 0x7f4060055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.654+0000 7f407affd700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40600535b0 0x7f4060055a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f406c00a000 tx=0x7f406c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.658+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4064044720 con 0x7f407c0b0fc0 2021-11-15T19:26:53.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.738+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f407c0573d0 con 0x7f407c0b0fc0 2021-11-15T19:26:53.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f4073fff700 1 -- 172.21.2.137:0/3600977025 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f406400be60 con 0x7f407c0b0fc0 2021-11-15T19:26:53.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40600535b0 msgr2=0x7f4060055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40600535b0 0x7f4060055a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f406c00a000 tx=0x7f406c008040).stop 2021-11-15T19:26:53.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 msgr2=0x7f407c0af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 0x7f407c0af5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f406400c000 tx=0x7f4064019000).stop 2021-11-15T19:26:53.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 shutdown_connections 2021-11-15T19:26:53.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40600535b0 0x7f4060055a70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f407c0afad0 0x7f407c0aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f407c0b0fc0 0x7f407c0af5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 --2- 172.21.2.137:0/3600977025 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f405c003d50 0x7f407c144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 >> 172.21.2.137:0/3600977025 conn(0x7f407c064960 msgr2=0x7f407c140e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 shutdown_connections 2021-11-15T19:26:53.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.886+0000 7f40812a6700 1 -- 172.21.2.137:0/3600977025 wait complete. 2021-11-15T19:26:53.898 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:26:53.902 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:26:53.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.946+0000 7fdd3c299700 1 Processor -- start 2021-11-15T19:26:53.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.946+0000 7fdd3c299700 1 -- start start 2021-11-15T19:26:53.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdd340b2400 0x7fdd340b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdd340b3e70 0x7fdd340b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd34146c20 con 0x7fdd340b5330 2021-11-15T19:26:53.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd34142af0 con 0x7fdd340b2400 2021-11-15T19:26:53.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340b27e0 con 0x7fdd340b3e70 2021-11-15T19:26:53.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdd340b3e70 0x7fdd340b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdd340b3e70 0x7fdd340b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59256/0 (socket says 172.21.2.137:59256) 2021-11-15T19:26:53.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/1152617393 learned_addr learned my addr 172.21.2.137:0/1152617393 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/1152617393 >> v2:172.21.2.111:3300/0 conn(0x7fdd340b2400 msgr2=0x7fdd340b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- 172.21.2.137:0/1152617393 >> v2:172.21.2.111:3300/0 conn(0x7fdd340b2400 0x7fdd340b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/1152617393 >> v1:172.21.2.111:6789/0 conn(0x7fdd340b5330 legacy=0x7fdd340b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:53.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/1152617393 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340b4d80 con 0x7fdd340b3e70 2021-11-15T19:26:53.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- 172.21.2.137:0/1152617393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b3e70 0x7fdd340b5ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fdd340b6ee0 tx=0x7fdd2c009290).ready entity=mon.1 client_cookie=8852a88c3426b3d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd39033700 1 -- 172.21.2.137:0/1152617393 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2c00b830 con 0x7fdd340b3e70 2021-11-15T19:26:53.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd39033700 1 -- 172.21.2.137:0/1152617393 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c00b990 con 0x7fdd340b3e70 2021-11-15T19:26:53.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd39033700 1 -- 172.21.2.137:0/1152617393 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2c00bb40 con 0x7fdd340b3e70 2021-11-15T19:26:53.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/1152617393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b3e70 msgr2=0x7fdd340b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- 172.21.2.137:0/1152617393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b3e70 0x7fdd340b5ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fdd340b6ee0 tx=0x7fdd2c009290).stop 2021-11-15T19:26:53.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/1152617393 shutdown_connections 2021-11-15T19:26:53.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- 172.21.2.137:0/1152617393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b3e70 0x7fdd340b5ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- 172.21.2.137:0/1152617393 >> v2:172.21.2.111:3300/0 conn(0x7fdd340b2400 0x7fdd340b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/1152617393 >> 172.21.2.137:0/1152617393 conn(0x7fdd340623a0 msgr2=0x7fdd34062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:53.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/1152617393 shutdown_connections 2021-11-15T19:26:53.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/1152617393 wait complete. 2021-11-15T19:26:53.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 Processor -- start 2021-11-15T19:26:53.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- start start 2021-11-15T19:26:53.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd340b2400 0x7fdd341521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd340b3e70 0x7fdd340b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 0x7fdd34112920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34113150 con 0x7fdd340b3e70 2021-11-15T19:26:53.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd341133f0 con 0x7fdd340b5330 2021-11-15T19:26:53.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34155770 con 0x7fdd340b2400 2021-11-15T19:26:53.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 0x7fdd34112920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 0x7fdd34112920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59258/0 (socket says 172.21.2.137:59258) 2021-11-15T19:26:53.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/2826361184 learned_addr learned my addr 172.21.2.137:0/2826361184 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:53.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a035700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd340b2400 0x7fdd341521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd340b2400 msgr2=0x7fdd341521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd340b2400 0x7fdd341521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:53.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd340b3e70 msgr2=0x7fdd340b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:53.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd340b3e70 0x7fdd340b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 -- 172.21.2.137:0/2826361184 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c009530 con 0x7fdd340b5330 2021-11-15T19:26:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3a836700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 0x7fdd34112920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdd340b6ee0 tx=0x7fdd2c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2c00b830 con 0x7fdd340b5330 2021-11-15T19:26:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c021670 con 0x7fdd340b5330 2021-11-15T19:26:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2c0219d0 con 0x7fdd340b5330 2021-11-15T19:26:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd340b9bc0 con 0x7fdd340b5330 2021-11-15T19:26:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.950+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd34155c10 con 0x7fdd340b5330 2021-11-15T19:26:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd2c028070 con 0x7fdd340b5330 2021-11-15T19:26:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd34155930 con 0x7fdd340b5330 2021-11-15T19:26:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd277fe700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd140536d0 0x7fdd14055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5603+0+0 (secure 0 0 0) 0x7fdd2c06c7d0 con 0x7fdd340b5330 2021-11-15T19:26:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd3a035700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd140536d0 0x7fdd14055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd3a035700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd140536d0 0x7fdd14055b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdd2800a000 tx=0x7fdd28008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:53.954+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd2c0439f0 con 0x7fdd340b5330 2021-11-15T19:26:54.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.038+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fdd34067cd0 con 0x7fdd340b5330 2021-11-15T19:26:54.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd277fe700 1 -- 172.21.2.137:0/2826361184 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v19) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdd2c015030 con 0x7fdd340b5330 2021-11-15T19:26:54.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd140536d0 msgr2=0x7fdd14055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:54.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd140536d0 0x7fdd14055b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdd2800a000 tx=0x7fdd28008040).stop 2021-11-15T19:26:54.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 msgr2=0x7fdd34112920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:54.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 0x7fdd34112920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdd340b6ee0 tx=0x7fdd2c016000).stop 2021-11-15T19:26:54.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 shutdown_connections 2021-11-15T19:26:54.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd140536d0 0x7fdd14055b90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:54.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd340b5330 0x7fdd34112920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:54.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd340b3e70 0x7fdd340b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 --2- 172.21.2.137:0/2826361184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd340b2400 0x7fdd341521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:54.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 >> 172.21.2.137:0/2826361184 conn(0x7fdd340623a0 msgr2=0x7fdd340b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:54.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 shutdown_connections 2021-11-15T19:26:54.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.890+0000 7fdd3c299700 1 -- 172.21.2.137:0/2826361184 wait complete. 2021-11-15T19:26:54.905 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:26:54.908 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:26:54.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 Processor -- start 2021-11-15T19:26:54.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 -- start start 2021-11-15T19:26:54.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f30e80acab0 0x7f30e80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80b1180 0x7f30e80b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30e80af2f0 0x7f30e8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80aecf0 con 0x7f30e80acab0 2021-11-15T19:26:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e813f180 con 0x7f30e80af2f0 2021-11-15T19:26:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30ecc40700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80aef20 con 0x7f30e80b1180 2021-11-15T19:26:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30e80af2f0 0x7f30e8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30e80af2f0 0x7f30e8142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59266/0 (socket says 172.21.2.137:59266) 2021-11-15T19:26:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 -- 172.21.2.137:0/2613954180 learned_addr learned my addr 172.21.2.137:0/2613954180 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 -- 172.21.2.137:0/2613954180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80b1180 msgr2=0x7f30e80b2550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 --2- 172.21.2.137:0/2613954180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80b1180 0x7f30e80b2550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 -- 172.21.2.137:0/2613954180 >> v2:172.21.2.111:3300/0 conn(0x7f30e80acab0 msgr2=0x7f30e80b2060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 --2- 172.21.2.137:0/2613954180 >> v2:172.21.2.111:3300/0 conn(0x7f30e80acab0 0x7f30e80b2060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 -- 172.21.2.137:0/2613954180 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80ace90 con 0x7f30e80af2f0 2021-11-15T19:26:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e6d9d700 1 --2- 172.21.2.137:0/2613954180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80af2f0 0x7f30e8142b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f30e00032f0 tx=0x7f30e000b530).ready entity=mon.1 client_cookie=6222ac4b9c321d3b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e559a700 1 -- 172.21.2.137:0/2613954180 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e00155e0 con 0x7f30e80af2f0 2021-11-15T19:26:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e559a700 1 -- 172.21.2.137:0/2613954180 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0015740 con 0x7f30e80af2f0 2021-11-15T19:26:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.950+0000 7f30e559a700 1 -- 172.21.2.137:0/2613954180 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e0015ae0 con 0x7f30e80af2f0 2021-11-15T19:26:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/2613954180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80af2f0 msgr2=0x7f30e8142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- 172.21.2.137:0/2613954180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80af2f0 0x7f30e8142b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f30e00032f0 tx=0x7f30e000b530).stop 2021-11-15T19:26:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/2613954180 shutdown_connections 2021-11-15T19:26:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- 172.21.2.137:0/2613954180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80af2f0 0x7f30e8142b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- 172.21.2.137:0/2613954180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80b1180 0x7f30e80b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- 172.21.2.137:0/2613954180 >> v2:172.21.2.111:3300/0 conn(0x7f30e80acab0 0x7f30e80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/2613954180 >> 172.21.2.137:0/2613954180 conn(0x7f30e80630f0 msgr2=0x7f30e80634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/2613954180 shutdown_connections 2021-11-15T19:26:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/2613954180 wait complete. 2021-11-15T19:26:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 Processor -- start 2021-11-15T19:26:54.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- start start 2021-11-15T19:26:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80acab0 0x7f30e810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30e80af2f0 0x7f30e814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 0x7f30e814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e810fdd0 con 0x7f30e80af2f0 2021-11-15T19:26:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8067740 con 0x7f30e80b1180 2021-11-15T19:26:54.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8110050 con 0x7f30e80acab0 2021-11-15T19:26:54.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 0x7f30e814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:54.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 0x7f30e814e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59276/0 (socket says 172.21.2.137:59276) 2021-11-15T19:26:54.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 -- 172.21.2.137:0/247256795 learned_addr learned my addr 172.21.2.137:0/247256795 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:54.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 -- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80acab0 msgr2=0x7f30e810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:54.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80acab0 0x7f30e810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 -- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30e80af2f0 msgr2=0x7f30e814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:54.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30e80af2f0 0x7f30e814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:54.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 -- 172.21.2.137:0/247256795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e000b7d0 con 0x7f30e80b1180 2021-11-15T19:26:54.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30e6d9d700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 0x7f30e814e340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f30e00032f0 tx=0x7f30e0019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:54.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e00147b0 con 0x7f30e80b1180 2021-11-15T19:26:54.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e81102f0 con 0x7f30e80b1180 2021-11-15T19:26:54.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0014910 con 0x7f30e80b1180 2021-11-15T19:26:54.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e0014c70 con 0x7f30e80b1180 2021-11-15T19:26:54.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8112790 con 0x7f30e80b1180 2021-11-15T19:26:54.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e810f9e0 con 0x7f30e80b1180 2021-11-15T19:26:54.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f30e0029460 con 0x7f30e80b1180 2021-11-15T19:26:54.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30df7fe700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc0536f0 0x7f30cc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:54.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.954+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f30e006fd40 con 0x7f30e80b1180 2021-11-15T19:26:54.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.958+0000 7f30e659c700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc0536f0 0x7f30cc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:54.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.958+0000 7f30e659c700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc0536f0 0x7f30cc055bb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f30d0002fb0 tx=0x7f30d00069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:54.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:54.958+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f30e810f9e0 con 0x7f30e80b1180 2021-11-15T19:26:55.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.066+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f30e810f9e0 con 0x7f30e80b1180 2021-11-15T19:26:55.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30df7fe700 1 -- 172.21.2.137:0/247256795 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7f30e810f9e0 con 0x7f30e80b1180 2021-11-15T19:26:55.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc0536f0 msgr2=0x7f30cc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc0536f0 0x7f30cc055bb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f30d0002fb0 tx=0x7f30d00069b0).stop 2021-11-15T19:26:55.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 msgr2=0x7f30e814e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 0x7f30e814e340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f30e00032f0 tx=0x7f30e0019000).stop 2021-11-15T19:26:55.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 shutdown_connections 2021-11-15T19:26:55.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc0536f0 0x7f30cc055bb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30e80b1180 0x7f30e814e340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30e80af2f0 0x7f30e814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 --2- 172.21.2.137:0/247256795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30e80acab0 0x7f30e810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 >> 172.21.2.137:0/247256795 conn(0x7f30e80630f0 msgr2=0x7f30e8140f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:55.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 shutdown_connections 2021-11-15T19:26:55.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.082+0000 7f30ecc40700 1 -- 172.21.2.137:0/247256795 wait complete. 2021-11-15T19:26:55.095 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 3 and data pool 4 2021-11-15T19:26:55.099 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:55.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.138+0000 7f4c821fe700 1 Processor -- start 2021-11-15T19:26:55.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- start start 2021-11-15T19:26:55.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b5fd0 0x7f4c7c13c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4c7c0b6830 0x7f4c7c13cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c0b63b0 con 0x7f4c7c0b3c00 2021-11-15T19:26:55.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c13d0d0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c147070 con 0x7f4c7c0b5fd0 2021-11-15T19:26:55.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4c7c0b6830 0x7f4c7c13cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4c7c0b3c00 0x7f4c7c142ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49832/0 (socket says 172.21.2.137:49832) 2021-11-15T19:26:55.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4c7c0b6830 0x7f4c7c13cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59284/0 (socket says 172.21.2.137:59284) 2021-11-15T19:26:55.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 -- 172.21.2.137:0/3737797663 learned_addr learned my addr 172.21.2.137:0/3737797663 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:55.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 -- 172.21.2.137:0/3737797663 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b5fd0 msgr2=0x7f4c7c13c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 --2- 172.21.2.137:0/3737797663 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b5fd0 0x7f4c7c13c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 -- 172.21.2.137:0/3737797663 >> v1:172.21.2.137:6789/0 conn(0x7f4c7c0b3c00 legacy=0x7f4c7c142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 -- 172.21.2.137:0/3737797663 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c146dd0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7affd700 1 --2- 172.21.2.137:0/3737797663 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c13cbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4c740032f0 tx=0x7f4c740091d0).ready entity=mon.1 client_cookie=4dc5b31a25cd69e3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7a7fc700 1 -- 172.21.2.137:0/3737797663 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c74009ea0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7a7fc700 1 -- 172.21.2.137:0/3737797663 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7400b8a0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7a7fc700 1 -- 172.21.2.137:0/3737797663 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7400ba10 con 0x7f4c7c0b6830 2021-11-15T19:26:55.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/3737797663 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 msgr2=0x7f4c7c13cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- 172.21.2.137:0/3737797663 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c13cbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4c740032f0 tx=0x7f4c740091d0).stop 2021-11-15T19:26:55.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/3737797663 shutdown_connections 2021-11-15T19:26:55.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- 172.21.2.137:0/3737797663 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c13cbe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- 172.21.2.137:0/3737797663 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b5fd0 0x7f4c7c13c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/3737797663 >> 172.21.2.137:0/3737797663 conn(0x7f4c7c0624b0 msgr2=0x7f4c7c062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:55.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/3737797663 shutdown_connections 2021-11-15T19:26:55.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/3737797663 wait complete. 2021-11-15T19:26:55.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 Processor -- start 2021-11-15T19:26:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- start start 2021-11-15T19:26:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b3c00 0x7f4c7c153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c7c0b5fd0 0x7f4c7c13e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c0ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0ae990 con 0x7f4c7c0b5fd0 2021-11-15T19:26:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c13e2c0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c13eeb0 con 0x7f4c7c0b3c00 2021-11-15T19:26:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c0ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c0ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59286/0 (socket says 172.21.2.137:59286) 2021-11-15T19:26:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 -- 172.21.2.137:0/2398475946 learned_addr learned my addr 172.21.2.137:0/2398475946 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 -- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b3c00 msgr2=0x7f4c7c153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b3c00 0x7f4c7c153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 -- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c7c0b5fd0 msgr2=0x7f4c7c13e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c7c0b5fd0 0x7f4c7c13e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 -- 172.21.2.137:0/2398475946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74009470 con 0x7f4c7c0b6830 2021-11-15T19:26:55.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c7bfff700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c0ac910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4c7c0aead0 tx=0x7f4c6c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c00ce20 con 0x7f4c7c0b6830 2021-11-15T19:26:55.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0072e0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c005800 con 0x7f4c7c0b6830 2021-11-15T19:26:55.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c13f150 con 0x7f4c7c0b6830 2021-11-15T19:26:55.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.142+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c13d770 con 0x7f4c7c0b6830 2021-11-15T19:26:55.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c13f2e0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c6c010070 con 0x7f4c7c0b6830 2021-11-15T19:26:55.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c78ff9700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c0536a0 0x7f4c5c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4c6c06b040 con 0x7f4c7c0b6830 2021-11-15T19:26:55.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c7b7fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c0536a0 0x7f4c5c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c7b7fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c0536a0 0x7f4c5c055b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4c70002f70 tx=0x7f4c70006a70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.146+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c6c042090 con 0x7f4c7c0b6830 2021-11-15T19:26:55.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.230+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c7c146af0 con 0x7f4c7c0b6830 2021-11-15T19:26:55.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c78ff9700 1 -- 172.21.2.137:0/2398475946 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f4c6c018030 con 0x7f4c7c0b6830 2021-11-15T19:26:55.243 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:55.243 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:55.077471+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:55.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c0536a0 msgr2=0x7f4c5c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c0536a0 0x7f4c5c055b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4c70002f70 tx=0x7f4c70006a70).stop 2021-11-15T19:26:55.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 msgr2=0x7f4c7c0ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c0ac910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4c7c0aead0 tx=0x7f4c6c007b90).stop 2021-11-15T19:26:55.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 shutdown_connections 2021-11-15T19:26:55.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c0536a0 0x7f4c5c055b60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7c0b6830 0x7f4c7c0ac910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c7c0b5fd0 0x7f4c7c13e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 --2- 172.21.2.137:0/2398475946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c7c0b3c00 0x7f4c7c153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 >> 172.21.2.137:0/2398475946 conn(0x7f4c7c0624b0 msgr2=0x7f4c7c13c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:55.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 shutdown_connections 2021-11-15T19:26:55.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.234+0000 7f4c821fe700 1 -- 172.21.2.137:0/2398475946 wait complete. 2021-11-15T19:26:55.249 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:55.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde5668b700 1 Processor -- start 2021-11-15T19:26:55.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde5668b700 1 -- start start 2021-11-15T19:26:55.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde5668b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fde5005fe40 0x7fde500b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde5668b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500b0c80 con 0x7fde5013f890 2021-11-15T19:26:55.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde5668b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500b0f20 con 0x7fde500608f0 2021-11-15T19:26:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde5668b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500ad6c0 con 0x7fde5005fe40 2021-11-15T19:26:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde4ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fde500608f0 0x7fde500b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49844/0 (socket says 172.21.2.137:49844) 2021-11-15T19:26:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde4ffff700 1 -- 172.21.2.137:0/3747351652 learned_addr learned my addr 172.21.2.137:0/3747351652 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532511318 0 0) 0x7fde500b0f20 con 0x7fde500608f0 2021-11-15T19:26:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.290+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde30003260 con 0x7fde500608f0 2021-11-15T19:26:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3196030762 0 0) 0x7fde30003260 con 0x7fde500608f0 2021-11-15T19:26:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 >> v2:172.21.2.111:3300/0 conn(0x7fde5005fe40 msgr2=0x7fde500b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 --2- 172.21.2.137:0/3747351652 >> v2:172.21.2.111:3300/0 conn(0x7fde5005fe40 0x7fde500b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 >> v1:172.21.2.111:6789/0 conn(0x7fde5013f890 legacy=0x7fde5005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500b11c0 con 0x7fde500608f0 2021-11-15T19:26:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fde38001660 con 0x7fde500608f0 2021-11-15T19:26:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 >> v1:172.21.2.137:6789/0 conn(0x7fde500608f0 legacy=0x7fde500b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003820 0x7fde30003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004500 0x7fde30004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30005050 0x7fde3000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500ad6c0 con 0x7fde30005050 2021-11-15T19:26:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3000bf40 con 0x7fde30003820 2021-11-15T19:26:55.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3000c100 con 0x7fde30004500 2021-11-15T19:26:55.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003820 0x7fde30003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 -- 172.21.2.137:0/3747351652 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004500 msgr2=0x7fde30004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004500 0x7fde30004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 -- 172.21.2.137:0/3747351652 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30005050 msgr2=0x7fde3000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30005050 0x7fde3000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 -- 172.21.2.137:0/3747351652 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30003260 con 0x7fde30003820 2021-11-15T19:26:55.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde54c28700 1 -- 172.21.2.137:0/3747351652 reap_dead start 2021-11-15T19:26:55.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003820 0x7fde30003c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fde500b3ac0 tx=0x7fde500ae010).ready entity=mon.1 client_cookie=b6f62779595d5e7c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde380070d0 con 0x7fde30003820 2021-11-15T19:26:55.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde38007230 con 0x7fde30003820 2021-11-15T19:26:55.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4effd700 1 -- 172.21.2.137:0/3747351652 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde3800c8f0 con 0x7fde30003820 2021-11-15T19:26:55.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/3747351652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003820 msgr2=0x7fde30003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003820 0x7fde30003c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fde500b3ac0 tx=0x7fde500ae010).stop 2021-11-15T19:26:55.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/3747351652 shutdown_connections 2021-11-15T19:26:55.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 --2- 172.21.2.137:0/3747351652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003820 0x7fde30003c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/3747351652 >> 172.21.2.137:0/3747351652 conn(0x7fde50063980 msgr2=0x7fde50063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:55.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/3747351652 shutdown_connections 2021-11-15T19:26:55.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/3747351652 wait complete. 2021-11-15T19:26:55.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 Processor -- start 2021-11-15T19:26:55.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- start start 2021-11-15T19:26:55.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30003820 0x7fde50128a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 0x7fde5013bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde5013cb80 0x7fde5013e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5013db30 con 0x7fde5013cb80 2021-11-15T19:26:55.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5013c730 con 0x7fde501399d0 2021-11-15T19:26:55.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde50143580 con 0x7fde30003820 2021-11-15T19:26:55.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 0x7fde5013bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 0x7fde5013bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59308/0 (socket says 172.21.2.137:59308) 2021-11-15T19:26:55.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 -- 172.21.2.137:0/687809305 learned_addr learned my addr 172.21.2.137:0/687809305 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:55.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde54c28700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde5013cb80 0x7fde5013e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4ffff700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30003820 0x7fde50128a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 -- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30003820 msgr2=0x7fde50128a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30003820 0x7fde50128a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 -- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde5013cb80 msgr2=0x7fde5013e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde5013cb80 0x7fde5013e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 -- 172.21.2.137:0/687809305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50143820 con 0x7fde501399d0 2021-11-15T19:26:55.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 0x7fde5013bfd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fde40000f70 tx=0x7fde40007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4000ce80 con 0x7fde501399d0 2021-11-15T19:26:55.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40013450 con 0x7fde501399d0 2021-11-15T19:26:55.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde400137b0 con 0x7fde501399d0 2021-11-15T19:26:55.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5013d000 con 0x7fde501399d0 2021-11-15T19:26:55.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5013ed20 con 0x7fde501399d0 2021-11-15T19:26:55.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5013c870 con 0x7fde501399d0 2021-11-15T19:26:55.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.294+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde40010070 con 0x7fde501399d0 2021-11-15T19:26:55.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.298+0000 7fde4d7fa700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde34053610 0x7fde34055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.298+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fde4006b1e0 con 0x7fde501399d0 2021-11-15T19:26:55.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.298+0000 7fde4ffff700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde34053610 0x7fde34055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.298+0000 7fde4ffff700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde34053610 0x7fde34055ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fde38006000 tx=0x7fde38015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.298+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde40042340 con 0x7fde501399d0 2021-11-15T19:26:55.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.382+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde50060cd0 con 0x7fde501399d0 2021-11-15T19:26:55.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.382+0000 7fde4d7fa700 1 -- 172.21.2.137:0/687809305 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fde40013910 con 0x7fde501399d0 2021-11-15T19:26:55.393 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:55.394 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:55.077471+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:55.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde34053610 msgr2=0x7fde34055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde34053610 0x7fde34055ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fde38006000 tx=0x7fde38015000).stop 2021-11-15T19:26:55.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 msgr2=0x7fde5013bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 0x7fde5013bfd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fde40000f70 tx=0x7fde40007c30).stop 2021-11-15T19:26:55.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 shutdown_connections 2021-11-15T19:26:55.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde34053610 0x7fde34055ad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde5013cb80 0x7fde5013e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde501399d0 0x7fde5013bfd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 --2- 172.21.2.137:0/687809305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30003820 0x7fde50128a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 >> 172.21.2.137:0/687809305 conn(0x7fde50063980 msgr2=0x7fde5005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:55.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 shutdown_connections 2021-11-15T19:26:55.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.386+0000 7fde5668b700 1 -- 172.21.2.137:0/687809305 wait complete. 2021-11-15T19:26:55.401 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:26:55.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 Processor -- start 2021-11-15T19:26:55.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 -- start start 2021-11-15T19:26:55.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71040b0550 0x7f710414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710405cb50 con 0x7f710405c770 2021-11-15T19:26:55.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040ad030 con 0x7f710414aaa0 2021-11-15T19:26:55.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b1650 con 0x7f71040b0550 2021-11-15T19:26:55.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710ac75700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f710414aaa0 0x7f7104140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49868/0 (socket says 172.21.2.137:49868) 2021-11-15T19:26:55.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710ac75700 1 -- 172.21.2.137:0/3493785918 learned_addr learned my addr 172.21.2.137:0/3493785918 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:55.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805032792 0 0) 0x7f71040ad030 con 0x7f710414aaa0 2021-11-15T19:26:55.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003260 con 0x7f710414aaa0 2021-11-15T19:26:55.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871311585 0 0) 0x7f70ec003260 con 0x7f710414aaa0 2021-11-15T19:26:55.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71040b0550 msgr2=0x7f710414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71040b0550 0x7f710414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 >> v1:172.21.2.111:6789/0 conn(0x7f710405c770 legacy=0x7f71040aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040ad2d0 con 0x7f710414aaa0 2021-11-15T19:26:55.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f70fc0019e0 con 0x7f710414aaa0 2021-11-15T19:26:55.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 >> v1:172.21.2.137:6789/0 conn(0x7f710414aaa0 legacy=0x7f7104140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ec0037d0 0x7f70ec003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec004500 0x7f70ec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71040b0550 0x7f70ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b1650 con 0x7f70ec004500 2021-11-15T19:26:55.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0052b0 con 0x7f70ec0037d0 2021-11-15T19:26:55.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec00bc40 con 0x7f71040b0550 2021-11-15T19:26:55.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ec0037d0 0x7f70ec003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 -- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71040b0550 msgr2=0x7f70ec00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71040b0550 0x7f70ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 -- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec004500 msgr2=0x7f70ec004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:55.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109c73700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec004500 0x7f70ec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec004500 0x7f70ec004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:55.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 -- 172.21.2.137:0/3493785918 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec003260 con 0x7f70ec0037d0 2021-11-15T19:26:55.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109c73700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec004500 0x7f70ec004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:55.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710a474700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ec0037d0 0x7f70ec003bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f70f8001fa0 tx=0x7f70f8007a00).ready entity=mon.1 client_cookie=7f3283241db760c5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f8007070 con 0x7f70ec0037d0 2021-11-15T19:26:55.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f80071d0 con 0x7f70ec0037d0 2021-11-15T19:26:55.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f7109472700 1 -- 172.21.2.137:0/3493785918 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f8006510 con 0x7f70ec0037d0 2021-11-15T19:26:55.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 -- 172.21.2.137:0/3493785918 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ec0037d0 msgr2=0x7f70ec003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 --2- 172.21.2.137:0/3493785918 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ec0037d0 0x7f70ec003bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f70f8001fa0 tx=0x7f70f8007a00).stop 2021-11-15T19:26:55.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710ac75700 1 -- 172.21.2.137:0/3493785918 reap_dead start 2021-11-15T19:26:55.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.454+0000 7f710c6d8700 1 -- 172.21.2.137:0/3493785918 shutdown_connections 2021-11-15T19:26:55.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- 172.21.2.137:0/3493785918 >> 172.21.2.137:0/3493785918 conn(0x7f71040631e0 msgr2=0x7f710405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:55.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- 172.21.2.137:0/3493785918 shutdown_connections 2021-11-15T19:26:55.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- 172.21.2.137:0/3493785918 wait complete. 2021-11-15T19:26:55.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 Processor -- start 2021-11-15T19:26:55.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- start start 2021-11-15T19:26:55.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec0037d0 0x7f7104159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 0x7f7104144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71041449c0 0x7f7104066700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710415a7a0 con 0x7f70ec0037d0 2021-11-15T19:26:55.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104144330 con 0x7f7104143730 2021-11-15T19:26:55.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71041445d0 con 0x7f71041449c0 2021-11-15T19:26:55.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 0x7f7104144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 0x7f7104144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59328/0 (socket says 172.21.2.137:59328) 2021-11-15T19:26:55.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 -- 172.21.2.137:0/394269565 learned_addr learned my addr 172.21.2.137:0/394269565 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:55.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 -- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71041449c0 msgr2=0x7f7104066700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71041449c0 0x7f7104066700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 -- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec0037d0 msgr2=0x7f7104159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:55.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec0037d0 0x7f7104159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:55.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 -- 172.21.2.137:0/394269565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104143020 con 0x7f7104143730 2021-11-15T19:26:55.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f7109c73700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 0x7f7104144fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7100007000 tx=0x7f7100008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710000e440 con 0x7f7104143730 2021-11-15T19:26:55.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710000e5a0 con 0x7f7104143730 2021-11-15T19:26:55.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7104145490 con 0x7f7104143730 2021-11-15T19:26:55.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710000e900 con 0x7f7104143730 2021-11-15T19:26:55.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71041475f0 con 0x7f7104143730 2021-11-15T19:26:55.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7104144790 con 0x7f7104143730 2021-11-15T19:26:55.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f710000ea60 con 0x7f7104143730 2021-11-15T19:26:55.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f70f77fe700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70e4053660 0x7f70e4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:55.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f710006b6e0 con 0x7f7104143730 2021-11-15T19:26:55.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.458+0000 7f710a474700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70e4053660 0x7f70e4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:55.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.462+0000 7f710a474700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70e4053660 0x7f70e4055b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f70f8001fa0 tx=0x7f70f8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:55.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.462+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7100042730 con 0x7f7104143730 2021-11-15T19:26:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:55.570+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f71040573d0 con 0x7f7104143730 2021-11-15T19:26:56.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.094+0000 7f70f77fe700 1 -- 172.21.2.137:0/394269565 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7100045d50 con 0x7f7104143730 2021-11-15T19:26:56.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70e4053660 msgr2=0x7f70e4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70e4053660 0x7f70e4055b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f70f8001fa0 tx=0x7f70f8015000).stop 2021-11-15T19:26:56.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 msgr2=0x7f7104144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 0x7f7104144fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7100007000 tx=0x7f7100008040).stop 2021-11-15T19:26:56.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 shutdown_connections 2021-11-15T19:26:56.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70e4053660 0x7f70e4055b20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f71041449c0 0x7f7104066700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7104143730 0x7f7104144fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 --2- 172.21.2.137:0/394269565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ec0037d0 0x7f7104159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 >> 172.21.2.137:0/394269565 conn(0x7f71040631e0 msgr2=0x7f710414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 shutdown_connections 2021-11-15T19:26:56.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.098+0000 7f710c6d8700 1 -- 172.21.2.137:0/394269565 wait complete. 2021-11-15T19:26:56.113 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:26:56.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 Processor -- start 2021-11-15T19:26:56.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 -- start start 2021-11-15T19:26:56.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb18c144610 0x7fb18c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c148190 con 0x7fb18c0b1340 2021-11-15T19:26:56.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c0b1720 con 0x7fb18c144610 2021-11-15T19:26:56.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb190fd2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c147e70 con 0x7fb18c0a9f50 2021-11-15T19:26:56.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb18c144610 0x7fb18c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb18ad9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb18c144610 0x7fb18c147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:38332/0 (socket says 172.21.2.137:38332) 2021-11-15T19:26:56.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 -- 172.21.2.137:0/2167440196 learned_addr learned my addr 172.21.2.137:0/2167440196 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 -- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 msgr2=0x7fb18c0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 --2- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c0aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 -- 172.21.2.137:0/2167440196 >> v1:172.21.2.111:6789/0 conn(0x7fb18c0b1340 legacy=0x7fb18c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 -- 172.21.2.137:0/2167440196 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c0af800 con 0x7fb18c144610 2021-11-15T19:26:56.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb189d9b700 1 --2- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c144610 0x7fb18c147980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb17c002f70 tx=0x7fb17c006eb0).ready entity=mon.0 client_cookie=2dcb0e742519c5c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb18959a700 1 -- 172.21.2.137:0/2167440196 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb17c00d570 con 0x7fb18c144610 2021-11-15T19:26:56.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.158+0000 7fb18959a700 1 -- 172.21.2.137:0/2167440196 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c000e90 con 0x7fb18c144610 2021-11-15T19:26:56.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18959a700 1 -- 172.21.2.137:0/2167440196 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb17c00d900 con 0x7fb18c144610 2021-11-15T19:26:56.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c144610 msgr2=0x7fb18c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 --2- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c144610 0x7fb18c147980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb17c002f70 tx=0x7fb17c006eb0).stop 2021-11-15T19:26:56.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/2167440196 shutdown_connections 2021-11-15T19:26:56.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 --2- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 --2- 172.21.2.137:0/2167440196 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c144610 0x7fb18c147980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/2167440196 >> 172.21.2.137:0/2167440196 conn(0x7fb18c0b4e60 msgr2=0x7fb18c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/2167440196 shutdown_connections 2021-11-15T19:26:56.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/2167440196 wait complete. 2021-11-15T19:26:56.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 Processor -- start 2021-11-15T19:26:56.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- start start 2021-11-15T19:26:56.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c0b1340 0x7fb18c0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 0x7fb18c13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c14b0e0 con 0x7fb18c0b1340 2021-11-15T19:26:56.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c14b380 con 0x7fb18c144610 2021-11-15T19:26:56.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c09a060 con 0x7fb18c0a9f50 2021-11-15T19:26:56.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 0x7fb18c13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 0x7fb18c13fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59344/0 (socket says 172.21.2.137:59344) 2021-11-15T19:26:56.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 -- 172.21.2.137:0/795062883 learned_addr learned my addr 172.21.2.137:0/795062883 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 -- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 msgr2=0x7fb18c149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 -- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c0b1340 msgr2=0x7fb18c0ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c0b1340 0x7fb18c0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 -- 172.21.2.137:0/795062883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c00b1e0 con 0x7fb18c144610 2021-11-15T19:26:56.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18ad9d700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 0x7fb18c13fe30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb184006e00 tx=0x7fb1840091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18400c7f0 con 0x7fb18c144610 2021-11-15T19:26:56.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18400c950 con 0x7fb18c144610 2021-11-15T19:26:56.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c09a500 con 0x7fb18c144610 2021-11-15T19:26:56.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c159d50 con 0x7fb18c144610 2021-11-15T19:26:56.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18400ccb0 con 0x7fb18c144610 2021-11-15T19:26:56.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c140660 con 0x7fb18c144610 2021-11-15T19:26:56.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb184022070 con 0x7fb18c144610 2021-11-15T19:26:56.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb1837fe700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb170053540 0x7fb170055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb18406c1a0 con 0x7fb18c144610 2021-11-15T19:26:56.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.162+0000 7fb18a59c700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb170053540 0x7fb170055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.166+0000 7fb18a59c700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb170053540 0x7fb170055a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb18c062250 tx=0x7fb1740077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.166+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb18c140660 con 0x7fb18c144610 2021-11-15T19:26:56.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.274+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb18c140660 con 0x7fb18c144610 2021-11-15T19:26:56.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb1837fe700 1 -- 172.21.2.137:0/795062883 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7fb18c140660 con 0x7fb18c144610 2021-11-15T19:26:56.286 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:56.287 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:26:56.084069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.111:6835/2773926386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2773926386},{"type":"v1","addr":"172.21.2.111:6835","nonce":2773926386}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:26:56.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb170053540 msgr2=0x7fb170055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb170053540 0x7fb170055a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb18c062250 tx=0x7fb1740077f0).stop 2021-11-15T19:26:56.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 msgr2=0x7fb18c13fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 0x7fb18c13fe30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb184006e00 tx=0x7fb1840091d0).stop 2021-11-15T19:26:56.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 shutdown_connections 2021-11-15T19:26:56.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb170053540 0x7fb170055a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb18c144610 0x7fb18c13fe30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb18c0b1340 0x7fb18c0ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 --2- 172.21.2.137:0/795062883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb18c0a9f50 0x7fb18c149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 >> 172.21.2.137:0/795062883 conn(0x7fb18c0b4e60 msgr2=0x7fb18c145c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 shutdown_connections 2021-11-15T19:26:56.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.278+0000 7fb190fd2700 1 -- 172.21.2.137:0/795062883 wait complete. 2021-11-15T19:26:56.290 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 5 2021-11-15T19:26:56.293 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:56.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 Processor -- start 2021-11-15T19:26:56.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- start start 2021-11-15T19:26:56.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbdb40b1340 0x7fbdb4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbdb4143f00 0x7fbdb4144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb4148190 con 0x7fbdb40a9f50 2021-11-15T19:26:56.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40b1720 con 0x7fbdb4143f00 2021-11-15T19:26:56.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb4147e70 con 0x7fbdb40b1340 2021-11-15T19:26:56.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbdb40b1340 0x7fbdb4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbdb40b1340 0x7fbdb4147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59348/0 (socket says 172.21.2.137:59348) 2021-11-15T19:26:56.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 -- 172.21.2.137:0/922035163 learned_addr learned my addr 172.21.2.137:0/922035163 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 -- 172.21.2.137:0/922035163 >> v2:172.21.2.111:3300/0 conn(0x7fbdb4143f00 msgr2=0x7fbdb4144390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:56.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 --2- 172.21.2.137:0/922035163 >> v2:172.21.2.111:3300/0 conn(0x7fbdb4143f00 0x7fbdb4144390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 -- 172.21.2.137:0/922035163 >> v1:172.21.2.111:6789/0 conn(0x7fbdb40a9f50 legacy=0x7fbdb40aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:56.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 -- 172.21.2.137:0/922035163 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40af800 con 0x7fbdb40b1340 2021-11-15T19:26:56.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb3fff700 1 --2- 172.21.2.137:0/922035163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb40b1340 0x7fbdb4147980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fbdb4062250 tx=0x7fbda4006eb0).ready entity=mon.1 client_cookie=f465b72db2274a20 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb2ffd700 1 -- 172.21.2.137:0/922035163 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda400d5c0 con 0x7fbdb40b1340 2021-11-15T19:26:56.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb2ffd700 1 -- 172.21.2.137:0/922035163 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4000e90 con 0x7fbdb40b1340 2021-11-15T19:26:56.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdb2ffd700 1 -- 172.21.2.137:0/922035163 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda400d910 con 0x7fbdb40b1340 2021-11-15T19:26:56.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- 172.21.2.137:0/922035163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb40b1340 msgr2=0x7fbdb4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 --2- 172.21.2.137:0/922035163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb40b1340 0x7fbdb4147980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fbdb4062250 tx=0x7fbda4006eb0).stop 2021-11-15T19:26:56.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- 172.21.2.137:0/922035163 shutdown_connections 2021-11-15T19:26:56.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 --2- 172.21.2.137:0/922035163 >> v2:172.21.2.111:3300/0 conn(0x7fbdb4143f00 0x7fbdb4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 --2- 172.21.2.137:0/922035163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb40b1340 0x7fbdb4147980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- 172.21.2.137:0/922035163 >> 172.21.2.137:0/922035163 conn(0x7fbdb40b4e60 msgr2=0x7fbdb40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- 172.21.2.137:0/922035163 shutdown_connections 2021-11-15T19:26:56.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.334+0000 7fbdba277700 1 -- 172.21.2.137:0/922035163 wait complete. 2021-11-15T19:26:56.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 Processor -- start 2021-11-15T19:26:56.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- start start 2021-11-15T19:26:56.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdb40a9f50 0x7fbdb4140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdb40b1340 0x7fbdb4142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 0x7fbdb4143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40ac9e0 con 0x7fbdb40a9f50 2021-11-15T19:26:56.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb414ad80 con 0x7fbdb4143f00 2021-11-15T19:26:56.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40acc10 con 0x7fbdb40b1340 2021-11-15T19:26:56.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 0x7fbdb4143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 0x7fbdb4143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59356/0 (socket says 172.21.2.137:59356) 2021-11-15T19:26:56.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 -- 172.21.2.137:0/841353444 learned_addr learned my addr 172.21.2.137:0/841353444 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 -- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdb40b1340 msgr2=0x7fbdb4142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdb40b1340 0x7fbdb4142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 -- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdb40a9f50 msgr2=0x7fbdb4140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdb40a9f50 0x7fbdb4140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 -- 172.21.2.137:0/841353444 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda400b1e0 con 0x7fbdb4143f00 2021-11-15T19:26:56.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb8814700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 0x7fbdb4143240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fbdac003270 tx=0x7fbdac0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac00d4a0 con 0x7fbdb4143f00 2021-11-15T19:26:56.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac00d600 con 0x7fbdb4143f00 2021-11-15T19:26:56.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac00d960 con 0x7fbdb4143f00 2021-11-15T19:26:56.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb40ac2a0 con 0x7fbdb4143f00 2021-11-15T19:26:56.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb414b1e0 con 0x7fbdb4143f00 2021-11-15T19:26:56.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb405faf0 con 0x7fbdb4143f00 2021-11-15T19:26:56.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbdac018030 con 0x7fbdb4143f00 2021-11-15T19:26:56.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb17fa700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbd980534f0 0x7fbd980559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbdac06b1f0 con 0x7fbdb4143f00 2021-11-15T19:26:56.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.338+0000 7fbdb3fff700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbd980534f0 0x7fbd980559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.342+0000 7fbdb3fff700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbd980534f0 0x7fbd980559b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbdb4062250 tx=0x7fbda4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.342+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbdac042400 con 0x7fbdb4143f00 2021-11-15T19:26:56.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdb414aec0 con 0x7fbdb4143f00 2021-11-15T19:26:56.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdb17fa700 1 -- 172.21.2.137:0/841353444 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fbdac023ec0 con 0x7fbdb4143f00 2021-11-15T19:26:56.435 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:56.435 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:56.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbd980534f0 msgr2=0x7fbd980559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbd980534f0 0x7fbd980559b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbdb4062250 tx=0x7fbda4015000).stop 2021-11-15T19:26:56.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 msgr2=0x7fbdb4143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 0x7fbdb4143240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fbdac003270 tx=0x7fbdac0090f0).stop 2021-11-15T19:26:56.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 shutdown_connections 2021-11-15T19:26:56.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbd980534f0 0x7fbd980559b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdb4143f00 0x7fbdb4143240 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdb40b1340 0x7fbdb4142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 --2- 172.21.2.137:0/841353444 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdb40a9f50 0x7fbdb4140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 >> 172.21.2.137:0/841353444 conn(0x7fbdb40b4e60 msgr2=0x7fbdb40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 shutdown_connections 2021-11-15T19:26:56.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.426+0000 7fbdba277700 1 -- 172.21.2.137:0/841353444 wait complete. 2021-11-15T19:26:56.442 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:56.443 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-15T19:26:56.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f63597fb700 1 Processor -- start 2021-11-15T19:26:56.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f63597fb700 1 -- start start 2021-11-15T19:26:56.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f63597fb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6354144610 0x7f6354147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f63597fb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6354148190 con 0x7f63540a9f50 2021-11-15T19:26:56.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f63597fb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540b1720 con 0x7f63540b1340 2021-11-15T19:26:56.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f63597fb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6354147e70 con 0x7f6354144610 2021-11-15T19:26:56.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6352ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f63540b1340 0x7f6354143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49910/0 (socket says 172.21.2.137:49910) 2021-11-15T19:26:56.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6352ffd700 1 -- 172.21.2.137:0/3940001626 learned_addr learned my addr 172.21.2.137:0/3940001626 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:56.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972158489 0 0) 0x7f63540b1720 con 0x7f63540b1340 2021-11-15T19:26:56.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6334003260 con 0x7f63540b1340 2021-11-15T19:26:56.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1878597155 0 0) 0x7f6334003260 con 0x7f63540b1340 2021-11-15T19:26:56.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6354144610 msgr2=0x7f6354147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6354144610 0x7f6354147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 >> v1:172.21.2.111:6789/0 conn(0x7f63540a9f50 legacy=0x7f63540aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540af800 con 0x7f63540b1340 2021-11-15T19:26:56.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f633c001660 con 0x7f63540b1340 2021-11-15T19:26:56.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 >> v1:172.21.2.137:6789/0 conn(0x7f63540b1340 legacy=0x7f6354143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6334003750 0x7f6334003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6354144610 0x7f6334004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6334004b10 0x7f6334004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354147e70 con 0x7f6334004b10 2021-11-15T19:26:56.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.482+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633400b910 con 0x7f6334003750 2021-11-15T19:26:56.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633400bad0 con 0x7f6354144610 2021-11-15T19:26:56.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6334003750 0x7f6334003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 -- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6354144610 msgr2=0x7f6334004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6354144610 0x7f6334004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 -- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6334004b10 msgr2=0x7f6334004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6334004b10 0x7f6334004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 -- 172.21.2.137:0/3940001626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334003260 con 0x7f6334003750 2021-11-15T19:26:56.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6352ffd700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6334003750 0x7f6334003b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f635405cfa0 tx=0x7f63540abfb0).ready entity=mon.1 client_cookie=85dbd641b031c848 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f633c0070d0 con 0x7f6334003750 2021-11-15T19:26:56.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c007230 con 0x7f6334003750 2021-11-15T19:26:56.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f6351ffb700 1 -- 172.21.2.137:0/3940001626 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f633c00c9c0 con 0x7f6334003750 2021-11-15T19:26:56.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/3940001626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6334003750 msgr2=0x7f6334003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 --2- 172.21.2.137:0/3940001626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6334003750 0x7f6334003b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f635405cfa0 tx=0x7f63540abfb0).stop 2021-11-15T19:26:56.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 -- 172.21.2.137:0/3940001626 reap_dead start 2021-11-15T19:26:56.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/3940001626 shutdown_connections 2021-11-15T19:26:56.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/3940001626 >> 172.21.2.137:0/3940001626 conn(0x7f63540b4e60 msgr2=0x7f63540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/3940001626 shutdown_connections 2021-11-15T19:26:56.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/3940001626 wait complete. 2021-11-15T19:26:56.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 Processor -- start 2021-11-15T19:26:56.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- start start 2021-11-15T19:26:56.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6334003750 0x7f63540b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f635414a700 0x7f63540aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 0x7f63540ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635414b390 con 0x7f635414a700 2021-11-15T19:26:56.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635413fdd0 con 0x7f635413df70 2021-11-15T19:26:56.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6354140070 con 0x7f6334003750 2021-11-15T19:26:56.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 0x7f63540ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 0x7f63540ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59374/0 (socket says 172.21.2.137:59374) 2021-11-15T19:26:56.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 -- 172.21.2.137:0/38315896 learned_addr learned my addr 172.21.2.137:0/38315896 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 -- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6334003750 msgr2=0x7f63540b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6334003750 0x7f63540b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 -- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f635414a700 msgr2=0x7f63540aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f635414a700 0x7f63540aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 -- 172.21.2.137:0/38315896 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635414b080 con 0x7f635413df70 2021-11-15T19:26:56.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63537fe700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 0x7f63540ac2a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f633c001370 tx=0x7f634c007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f634c004850 con 0x7f635413df70 2021-11-15T19:26:56.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c0049b0 con 0x7f635413df70 2021-11-15T19:26:56.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63540ac790 con 0x7f635413df70 2021-11-15T19:26:56.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f634c004d50 con 0x7f635413df70 2021-11-15T19:26:56.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.486+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63540ad670 con 0x7f635413df70 2021-11-15T19:26:56.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635405faf0 con 0x7f635413df70 2021-11-15T19:26:56.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f634c01b070 con 0x7f635413df70 2021-11-15T19:26:56.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f634bfff700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63380536a0 0x7f6338055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f634c06acb0 con 0x7f635413df70 2021-11-15T19:26:56.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f6352ffd700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63380536a0 0x7f6338055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f6352ffd700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63380536a0 0x7f6338055b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f635405cfa0 tx=0x7f633c013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.490+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f634c041e10 con 0x7f635413df70 2021-11-15T19:26:56.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.574+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63540573d0 con 0x7f635413df70 2021-11-15T19:26:56.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.574+0000 7f634bfff700 1 -- 172.21.2.137:0/38315896 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f634c045430 con 0x7f635413df70 2021-11-15T19:26:56.585 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:56.586 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:56.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63380536a0 msgr2=0x7f6338055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63380536a0 0x7f6338055b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f635405cfa0 tx=0x7f633c013000).stop 2021-11-15T19:26:56.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 msgr2=0x7f63540ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 0x7f63540ac2a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f633c001370 tx=0x7f634c007e50).stop 2021-11-15T19:26:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 shutdown_connections 2021-11-15T19:26:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63380536a0 0x7f6338055b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f635413df70 0x7f63540ac2a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f635414a700 0x7f63540aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 --2- 172.21.2.137:0/38315896 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6334003750 0x7f63540b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 >> 172.21.2.137:0/38315896 conn(0x7f63540b4e60 msgr2=0x7f63541467f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 shutdown_connections 2021-11-15T19:26:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.578+0000 7f63597fb700 1 -- 172.21.2.137:0/38315896 wait complete. 2021-11-15T19:26:56.593 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:26:56.594 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:26:56.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 Processor -- start 2021-11-15T19:26:56.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- start start 2021-11-15T19:26:56.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fad340b2400 0x7fad340b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fad340b5330 0x7fad340b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad34146c20 con 0x7fad340b3e70 2021-11-15T19:26:56.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad34142af0 con 0x7fad340b2400 2021-11-15T19:26:56.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad340b27e0 con 0x7fad340b5330 2021-11-15T19:26:56.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fad340b5330 0x7fad340b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fad340b5330 0x7fad340b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59382/0 (socket says 172.21.2.137:59382) 2021-11-15T19:26:56.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 -- 172.21.2.137:0/1866976730 learned_addr learned my addr 172.21.2.137:0/1866976730 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 -- 172.21.2.137:0/1866976730 >> v2:172.21.2.111:3300/0 conn(0x7fad340b2400 msgr2=0x7fad340b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 --2- 172.21.2.137:0/1866976730 >> v2:172.21.2.111:3300/0 conn(0x7fad340b2400 0x7fad340b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 -- 172.21.2.137:0/1866976730 >> v1:172.21.2.111:6789/0 conn(0x7fad340b3e70 legacy=0x7fad340b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 -- 172.21.2.137:0/1866976730 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340b4d80 con 0x7fad340b5330 2021-11-15T19:26:56.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad38b29700 1 --2- 172.21.2.137:0/1866976730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad340b09b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fad340b6ee0 tx=0x7fad30006eb0).ready entity=mon.1 client_cookie=cbf0ae031ca1378c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad27fff700 1 -- 172.21.2.137:0/1866976730 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3000d5c0 con 0x7fad340b5330 2021-11-15T19:26:56.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad27fff700 1 -- 172.21.2.137:0/1866976730 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30000e90 con 0x7fad340b5330 2021-11-15T19:26:56.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad27fff700 1 -- 172.21.2.137:0/1866976730 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3000d910 con 0x7fad340b5330 2021-11-15T19:26:56.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- 172.21.2.137:0/1866976730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 msgr2=0x7fad340b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- 172.21.2.137:0/1866976730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad340b09b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fad340b6ee0 tx=0x7fad30006eb0).stop 2021-11-15T19:26:56.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- 172.21.2.137:0/1866976730 shutdown_connections 2021-11-15T19:26:56.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- 172.21.2.137:0/1866976730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad340b09b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- 172.21.2.137:0/1866976730 >> v2:172.21.2.111:3300/0 conn(0x7fad340b2400 0x7fad340b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- 172.21.2.137:0/1866976730 >> 172.21.2.137:0/1866976730 conn(0x7fad340623a0 msgr2=0x7fad34062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- 172.21.2.137:0/1866976730 shutdown_connections 2021-11-15T19:26:56.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- 172.21.2.137:0/1866976730 wait complete. 2021-11-15T19:26:56.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 Processor -- start 2021-11-15T19:26:56.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- start start 2021-11-15T19:26:56.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad340b2400 0x7fad340b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad340b3e70 0x7fad341556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad341167a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad341409b0 con 0x7fad340b2400 2021-11-15T19:26:56.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34114e70 con 0x7fad340b5330 2021-11-15T19:26:56.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad3b58e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad34112ce0 con 0x7fad340b3e70 2021-11-15T19:26:56.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.638+0000 7fad39b2b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad341167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad341167a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59386/0 (socket says 172.21.2.137:59386) 2021-11-15T19:26:56.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 -- 172.21.2.137:0/99270307 learned_addr learned my addr 172.21.2.137:0/99270307 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 -- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad340b3e70 msgr2=0x7fad341556c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:56.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad340b3e70 0x7fad341556c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 -- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad340b2400 msgr2=0x7fad340b97e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:56.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad340b2400 0x7fad340b97e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 -- 172.21.2.137:0/99270307 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3000b1e0 con 0x7fad340b5330 2021-11-15T19:26:56.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad39b2b700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad341167a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fad2c003310 tx=0x7fad2c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad2c001500 con 0x7fad340b5330 2021-11-15T19:26:56.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c001660 con 0x7fad340b5330 2021-11-15T19:26:56.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad34112830 con 0x7fad340b5330 2021-11-15T19:26:56.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad2c0019c0 con 0x7fad340b5330 2021-11-15T19:26:56.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad340b9cd0 con 0x7fad340b5330 2021-11-15T19:26:56.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad340573d0 con 0x7fad340b5330 2021-11-15T19:26:56.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad2c018030 con 0x7fad340b5330 2021-11-15T19:26:56.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad140536d0 0x7fad14055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fad2c06b290 con 0x7fad340b5330 2021-11-15T19:26:56.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad3932a700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad140536d0 0x7fad14055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad3932a700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad140536d0 0x7fad14055b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fad28002f70 tx=0x7fad28006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.642+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad2c0424a0 con 0x7fad340b5330 2021-11-15T19:26:56.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fad34067cd0 con 0x7fad340b5330 2021-11-15T19:26:56.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad267fc700 1 -- 172.21.2.137:0/99270307 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fad2c045ac0 con 0x7fad340b5330 2021-11-15T19:26:56.737 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:26:56.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad140536d0 msgr2=0x7fad14055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad140536d0 0x7fad14055b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fad28002f70 tx=0x7fad28006960).stop 2021-11-15T19:26:56.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 msgr2=0x7fad341167a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad341167a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fad2c003310 tx=0x7fad2c0091a0).stop 2021-11-15T19:26:56.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 shutdown_connections 2021-11-15T19:26:56.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad140536d0 0x7fad14055b90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad340b5330 0x7fad341167a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad340b3e70 0x7fad341556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 --2- 172.21.2.137:0/99270307 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad340b2400 0x7fad340b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.726+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 >> 172.21.2.137:0/99270307 conn(0x7fad340623a0 msgr2=0x7fad34146080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.730+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 shutdown_connections 2021-11-15T19:26:56.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.730+0000 7fad3b58e700 1 -- 172.21.2.137:0/99270307 wait complete. 2021-11-15T19:26:56.744 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:26:56.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f102e60a700 1 Processor -- start 2021-11-15T19:26:56.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f102e60a700 1 -- start start 2021-11-15T19:26:56.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f102e60a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10280acd60 0x7f10280b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f102e60a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10280b76c0 con 0x7f10280b4680 2021-11-15T19:26:56.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f102e60a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102812a170 con 0x7f10280b72e0 2021-11-15T19:26:56.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f102e60a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280b3100 con 0x7f10280acd60 2021-11-15T19:26:56.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f1027fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f10280b72e0 0x7f10280b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49942/0 (socket says 172.21.2.137:49942) 2021-11-15T19:26:56.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f1027fff700 1 -- 172.21.2.137:0/3299380177 learned_addr learned my addr 172.21.2.137:0/3299380177 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:56.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699531614 0 0) 0x7f102812a170 con 0x7f10280b72e0 2021-11-15T19:26:56.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.786+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1014003260 con 0x7f10280b72e0 2021-11-15T19:26:56.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932074880 0 0) 0x7f1014003260 con 0x7f10280b72e0 2021-11-15T19:26:56.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10280acd60 msgr2=0x7f10280b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10280acd60 0x7f10280b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 >> v1:172.21.2.111:6789/0 conn(0x7f10280b4680 legacy=0x7f10281290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280ad8a0 con 0x7f10280b72e0 2021-11-15T19:26:56.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f101c001660 con 0x7f10280b72e0 2021-11-15T19:26:56.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 >> v1:172.21.2.137:6789/0 conn(0x7f10280b72e0 legacy=0x7f10280b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10140037d0 0x7f1014003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10280acd60 0x7f1014004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1014004b40 0x7f1014004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280b3100 con 0x7f1014004b40 2021-11-15T19:26:56.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101400fe10 con 0x7f10140037d0 2021-11-15T19:26:56.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101400ffd0 con 0x7f10280acd60 2021-11-15T19:26:56.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10140037d0 0x7f1014003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 -- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10280acd60 msgr2=0x7f1014004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10280acd60 0x7f1014004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 -- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1014004b40 msgr2=0x7f1014004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1014004b40 0x7f1014004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 -- 172.21.2.137:0/3299380177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1014003260 con 0x7f10140037d0 2021-11-15T19:26:56.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1027fff700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10140037d0 0x7f1014003bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f10280ad1d0 tx=0x7f10280ada30).ready entity=mon.1 client_cookie=baaac32ad73e3818 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101c0070d0 con 0x7f10140037d0 2021-11-15T19:26:56.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c007230 con 0x7f10140037d0 2021-11-15T19:26:56.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f1026ffd700 1 -- 172.21.2.137:0/3299380177 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101c00c8f0 con 0x7f10140037d0 2021-11-15T19:26:56.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/3299380177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10140037d0 msgr2=0x7f1014003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 --2- 172.21.2.137:0/3299380177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10140037d0 0x7f1014003bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f10280ad1d0 tx=0x7f10280ada30).stop 2021-11-15T19:26:56.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102cba7700 1 -- 172.21.2.137:0/3299380177 reap_dead start 2021-11-15T19:26:56.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/3299380177 shutdown_connections 2021-11-15T19:26:56.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/3299380177 >> 172.21.2.137:0/3299380177 conn(0x7f1028064960 msgr2=0x7f1028064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/3299380177 shutdown_connections 2021-11-15T19:26:56.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/3299380177 wait complete. 2021-11-15T19:26:56.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 Processor -- start 2021-11-15T19:26:56.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- start start 2021-11-15T19:26:56.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10140037d0 0x7f10280ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 0x7f1028066470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1028156ad0 0x7f1028156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280b20c0 con 0x7f10140037d0 2021-11-15T19:26:56.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028157440 con 0x7f1028141dd0 2021-11-15T19:26:56.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280aeae0 con 0x7f1028156ad0 2021-11-15T19:26:56.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 0x7f1028066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 0x7f1028066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59404/0 (socket says 172.21.2.137:59404) 2021-11-15T19:26:56.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 -- 172.21.2.137:0/2903206610 learned_addr learned my addr 172.21.2.137:0/2903206610 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 -- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1028156ad0 msgr2=0x7f1028156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1028156ad0 0x7f1028156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 -- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10140037d0 msgr2=0x7f10280ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10140037d0 0x7f10280ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 -- 172.21.2.137:0/2903206610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028156390 con 0x7f1028141dd0 2021-11-15T19:26:56.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10277fe700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 0x7f1028066470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1018002f70 tx=0x7f1018006e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101800f510 con 0x7f1028141dd0 2021-11-15T19:26:56.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018000e90 con 0x7f1028141dd0 2021-11-15T19:26:56.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1028156630 con 0x7f1028141dd0 2021-11-15T19:26:56.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101800f670 con 0x7f1028141dd0 2021-11-15T19:26:56.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280ae150 con 0x7f1028141dd0 2021-11-15T19:26:56.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.790+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10281567c0 con 0x7f1028141dd0 2021-11-15T19:26:56.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.794+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1018017020 con 0x7f1028141dd0 2021-11-15T19:26:56.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.794+0000 7f10257fa700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1008053720 0x7f1008055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.794+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f101806b090 con 0x7f1028141dd0 2021-11-15T19:26:56.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.794+0000 7f1027fff700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1008053720 0x7f1008055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.794+0000 7f1027fff700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1008053720 0x7f1008055be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f10280ad1d0 tx=0x7f101c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.794+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1018042080 con 0x7f1028141dd0 2021-11-15T19:26:56.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.878+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10280b3a50 con 0x7f1028141dd0 2021-11-15T19:26:56.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.878+0000 7f10257fa700 1 -- 172.21.2.137:0/2903206610 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1018015030 con 0x7f1028141dd0 2021-11-15T19:26:56.890 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:26:56.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1008053720 msgr2=0x7f1008055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1008053720 0x7f1008055be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f10280ad1d0 tx=0x7f101c015000).stop 2021-11-15T19:26:56.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 msgr2=0x7f1028066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 0x7f1028066470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1018002f70 tx=0x7f1018006e70).stop 2021-11-15T19:26:56.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 shutdown_connections 2021-11-15T19:26:56.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1008053720 0x7f1008055be0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1028156ad0 0x7f1028156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1028141dd0 0x7f1028066470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 --2- 172.21.2.137:0/2903206610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10140037d0 0x7f10280ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 >> 172.21.2.137:0/2903206610 conn(0x7f1028064960 msgr2=0x7f10280b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 shutdown_connections 2021-11-15T19:26:56.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.882+0000 7f102e60a700 1 -- 172.21.2.137:0/2903206610 wait complete. 2021-11-15T19:26:56.897 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:26:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 Processor -- start 2021-11-15T19:26:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- start start 2021-11-15T19:26:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f02100acff0 0x7f021013c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100aedf0 con 0x7f02100b0fe0 2021-11-15T19:26:56.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100afbd0 con 0x7f02100afde0 2021-11-15T19:26:56.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100ae070 con 0x7f02100acff0 2021-11-15T19:26:56.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020dd9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f02100afde0 0x7f021013f5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49964/0 (socket says 172.21.2.137:49964) 2021-11-15T19:26:56.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020dd9b700 1 -- 172.21.2.137:0/2786561881 learned_addr learned my addr 172.21.2.137:0/2786561881 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020ed9d700 1 --2- 172.21.2.137:0/2786561881 >> v2:172.21.2.137:3300/0 conn(0x7f02100acff0 0x7f021013c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020ed9d700 1 -- 172.21.2.137:0/2786561881 >> v1:172.21.2.137:6789/0 conn(0x7f02100afde0 legacy=0x7f021013f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020ed9d700 1 -- 172.21.2.137:0/2786561881 >> v1:172.21.2.111:6789/0 conn(0x7f02100b0fe0 legacy=0x7f02100af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020ed9d700 1 -- 172.21.2.137:0/2786561881 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100ad440 con 0x7f02100acff0 2021-11-15T19:26:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020ed9d700 1 --2- 172.21.2.137:0/2786561881 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100acff0 0x7f021013c640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f02100aec90 tx=0x7f02080091d0).ready entity=mon.1 client_cookie=9c2178e3c28c099a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020d59a700 1 -- 172.21.2.137:0/2786561881 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0208009ea0 con 0x7f02100acff0 2021-11-15T19:26:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020d59a700 1 -- 172.21.2.137:0/2786561881 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020800b860 con 0x7f02100acff0 2021-11-15T19:26:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f020d59a700 1 -- 172.21.2.137:0/2786561881 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f020800b9d0 con 0x7f02100acff0 2021-11-15T19:26:56.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- 172.21.2.137:0/2786561881 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100acff0 msgr2=0x7f021013c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 --2- 172.21.2.137:0/2786561881 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100acff0 0x7f021013c640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f02100aec90 tx=0x7f02080091d0).stop 2021-11-15T19:26:56.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- 172.21.2.137:0/2786561881 shutdown_connections 2021-11-15T19:26:56.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 --2- 172.21.2.137:0/2786561881 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100acff0 0x7f021013c640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:56.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- 172.21.2.137:0/2786561881 >> 172.21.2.137:0/2786561881 conn(0x7f02100b5f50 msgr2=0x7f02100b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:56.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- 172.21.2.137:0/2786561881 shutdown_connections 2021-11-15T19:26:56.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- 172.21.2.137:0/2786561881 wait complete. 2021-11-15T19:26:56.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 Processor -- start 2021-11-15T19:26:56.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.942+0000 7f0214913700 1 -- start start 2021-11-15T19:26:56.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f02100acff0 0x7f0210065b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f02100afde0 0x7f02101154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 0x7f0210115990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210152420 con 0x7f02100acff0 2021-11-15T19:26:56.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101526c0 con 0x7f02100b0fe0 2021-11-15T19:26:56.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210152960 con 0x7f02100afde0 2021-11-15T19:26:56.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 0x7f0210115990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 0x7f0210115990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59420/0 (socket says 172.21.2.137:59420) 2021-11-15T19:26:56.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 -- 172.21.2.137:0/3431129751 learned_addr learned my addr 172.21.2.137:0/3431129751 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:56.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 -- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f02100afde0 msgr2=0x7f02101154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f02100afde0 0x7f02101154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 -- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f02100acff0 msgr2=0x7f0210065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:56.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f02100acff0 0x7f0210065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:56.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 -- 172.21.2.137:0/3431129751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009470 con 0x7f02100b0fe0 2021-11-15T19:26:56.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020ed9d700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 0x7f0210115990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f02100aec90 tx=0x7f0208016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0208009ea0 con 0x7f02100b0fe0 2021-11-15T19:26:56.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020801f5e0 con 0x7f02100b0fe0 2021-11-15T19:26:56.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0210066060 con 0x7f02100b0fe0 2021-11-15T19:26:56.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0210152e00 con 0x7f02100b0fe0 2021-11-15T19:26:56.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f020801f940 con 0x7f02100b0fe0 2021-11-15T19:26:56.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100ad690 con 0x7f02100b0fe0 2021-11-15T19:26:56.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0208026030 con 0x7f02100b0fe0 2021-11-15T19:26:56.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f01ff7fe700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01ec0536a0 0x7f01ec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:56.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f020806c750 con 0x7f02100b0fe0 2021-11-15T19:26:56.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.946+0000 7f020e59c700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01ec0536a0 0x7f01ec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:56.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.950+0000 7f020e59c700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01ec0536a0 0x7f01ec055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0200002ef0 tx=0x7f0200006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:56.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:56.950+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02080438b0 con 0x7f02100b0fe0 2021-11-15T19:26:57.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.030+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02100b1450 con 0x7f02100b0fe0 2021-11-15T19:26:57.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f01ff7fe700 1 -- 172.21.2.137:0/3431129751 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7f02100b1450 con 0x7f02100b0fe0 2021-11-15T19:26:57.042 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:26:57.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01ec0536a0 msgr2=0x7f01ec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01ec0536a0 0x7f01ec055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0200002ef0 tx=0x7f0200006910).stop 2021-11-15T19:26:57.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 msgr2=0x7f0210115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 0x7f0210115990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f02100aec90 tx=0x7f0208016000).stop 2021-11-15T19:26:57.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 shutdown_connections 2021-11-15T19:26:57.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01ec0536a0 0x7f01ec055b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f02100b0fe0 0x7f0210115990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f02100afde0 0x7f02101154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 --2- 172.21.2.137:0/3431129751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f02100acff0 0x7f0210065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 >> 172.21.2.137:0/3431129751 conn(0x7f02100b5f50 msgr2=0x7f0210143290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 shutdown_connections 2021-11-15T19:26:57.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.034+0000 7f0214913700 1 -- 172.21.2.137:0/3431129751 wait complete. 2021-11-15T19:26:57.049 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:26:57.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 Processor -- start 2021-11-15T19:26:57.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- start start 2021-11-15T19:26:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb38005c770 0x7fb3800aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38005cb50 con 0x7fb380140aa0 2021-11-15T19:26:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3800ad030 con 0x7fb3800b0550 2021-11-15T19:26:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3800b1650 con 0x7fb38005c770 2021-11-15T19:26:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37f7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb3800b0550 0x7fb38014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49980/0 (socket says 172.21.2.137:49980) 2021-11-15T19:26:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37f7fe700 1 -- 172.21.2.137:0/2037638037 learned_addr learned my addr 172.21.2.137:0/2037638037 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- 172.21.2.137:0/2037638037 >> v2:172.21.2.137:3300/0 conn(0x7fb38005c770 0x7fb3800aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37effd700 1 -- 172.21.2.137:0/2037638037 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596345810 0 0) 0x7fb3800ad030 con 0x7fb3800b0550 2021-11-15T19:26:57.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37effd700 1 -- 172.21.2.137:0/2037638037 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb36c003260 con 0x7fb3800b0550 2021-11-15T19:26:57.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/2037638037 >> v1:172.21.2.137:6789/0 conn(0x7fb3800b0550 legacy=0x7fb38014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/2037638037 >> v1:172.21.2.111:6789/0 conn(0x7fb380140aa0 legacy=0x7fb380140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/2037638037 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800ad2d0 con 0x7fb38005c770 2021-11-15T19:26:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- 172.21.2.137:0/2037638037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb3800aef30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb3800aee10 tx=0x7fb374006df0).ready entity=mon.1 client_cookie=2f466a6732ce2a90 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37effd700 1 -- 172.21.2.137:0/2037638037 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37400d5c0 con 0x7fb38005c770 2021-11-15T19:26:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37effd700 1 -- 172.21.2.137:0/2037638037 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374000e90 con 0x7fb38005c770 2021-11-15T19:26:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37effd700 1 -- 172.21.2.137:0/2037638037 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37400d910 con 0x7fb38005c770 2021-11-15T19:26:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- 172.21.2.137:0/2037638037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 msgr2=0x7fb3800aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 --2- 172.21.2.137:0/2037638037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb3800aef30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb3800aee10 tx=0x7fb374006df0).stop 2021-11-15T19:26:57.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- 172.21.2.137:0/2037638037 shutdown_connections 2021-11-15T19:26:57.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 --2- 172.21.2.137:0/2037638037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb3800aef30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- 172.21.2.137:0/2037638037 >> 172.21.2.137:0/2037638037 conn(0x7fb3800631e0 msgr2=0x7fb38005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- 172.21.2.137:0/2037638037 shutdown_connections 2021-11-15T19:26:57.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- 172.21.2.137:0/2037638037 wait complete. 2021-11-15T19:26:57.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 Processor -- start 2021-11-15T19:26:57.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- start start 2021-11-15T19:26:57.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb380065da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3800b0550 0x7fb380146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb380140aa0 0x7fb380147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb380142990 con 0x7fb3800b0550 2021-11-15T19:26:57.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb380066580 con 0x7fb38005c770 2021-11-15T19:26:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb386a31700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb380066290 con 0x7fb380140aa0 2021-11-15T19:26:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb380065da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb380065da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59432/0 (socket says 172.21.2.137:59432) 2021-11-15T19:26:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/630436849 learned_addr learned my addr 172.21.2.137:0/630436849 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb380140aa0 msgr2=0x7fb380147290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb380140aa0 0x7fb380147290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3800b0550 msgr2=0x7fb380146da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3800b0550 0x7fb380146da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 -- 172.21.2.137:0/630436849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37400b180 con 0x7fb38005c770 2021-11-15T19:26:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.098+0000 7fb37ffff700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb380065da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb380066a30 tx=0x7fb374014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374016070 con 0x7fb38005c770 2021-11-15T19:26:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374002f70 con 0x7fb38005c770 2021-11-15T19:26:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb380142430 con 0x7fb38005c770 2021-11-15T19:26:57.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37400de70 con 0x7fb38005c770 2021-11-15T19:26:57.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3800645b0 con 0x7fb38005c770 2021-11-15T19:26:57.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3800ae7f0 con 0x7fb38005c770 2021-11-15T19:26:57.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb374025030 con 0x7fb38005c770 2021-11-15T19:26:57.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb360053640 0x7fb360055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb37406ca10 con 0x7fb38005c770 2021-11-15T19:26:57.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37f7fe700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb360053640 0x7fb360055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37f7fe700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb360053640 0x7fb360055b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb370001110 tx=0x7fb370007630).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.102+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb374043b70 con 0x7fb38005c770 2021-11-15T19:26:57.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.186+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3800647d0 con 0x7fb38005c770 2021-11-15T19:26:57.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.186+0000 7fb37d7fa700 1 -- 172.21.2.137:0/630436849 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb374023070 con 0x7fb38005c770 2021-11-15T19:26:57.198 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:26:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb360053640 msgr2=0x7fb360055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb360053640 0x7fb360055b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb370001110 tx=0x7fb370007630).stop 2021-11-15T19:26:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 msgr2=0x7fb380065da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb380065da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb380066a30 tx=0x7fb374014000).stop 2021-11-15T19:26:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 shutdown_connections 2021-11-15T19:26:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb360053640 0x7fb360055b00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb380140aa0 0x7fb380147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3800b0550 0x7fb380146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 --2- 172.21.2.137:0/630436849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38005c770 0x7fb380065da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 >> 172.21.2.137:0/630436849 conn(0x7fb3800631e0 msgr2=0x7fb380140ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 shutdown_connections 2021-11-15T19:26:57.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.190+0000 7fb386a31700 1 -- 172.21.2.137:0/630436849 wait complete. 2021-11-15T19:26:57.205 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-11-15T19:26:57.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-11-15T19:26:57.205 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-11-15T19:26:57.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fcccaf48700 1 Processor -- start 2021-11-15T19:26:57.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fcccaf48700 1 -- start start 2021-11-15T19:26:57.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fcccaf48700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 0x7fccc4143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fcccaf48700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc405fe40 con 0x7fccc409c8c0 2021-11-15T19:26:57.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fcccaf48700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc409d150 con 0x7fccc40b3140 2021-11-15T19:26:57.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fcccaf48700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4099790 con 0x7fccc409cca0 2021-11-15T19:26:57.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc3fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fccc40b3140 0x7fccc409ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:49994/0 (socket says 172.21.2.137:49994) 2021-11-15T19:26:57.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc3fff700 1 -- 172.21.2.137:0/480188508 learned_addr learned my addr 172.21.2.137:0/480188508 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:57.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc94e5700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 0x7fccc4143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560814158 0 0) 0x7fccc409d150 con 0x7fccc40b3140 2021-11-15T19:26:57.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb0003260 con 0x7fccc40b3140 2021-11-15T19:26:57.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356852661 0 0) 0x7fccb0003260 con 0x7fccc40b3140 2021-11-15T19:26:57.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 msgr2=0x7fccc4143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 0x7fccc4143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 >> v1:172.21.2.111:6789/0 conn(0x7fccc409c8c0 legacy=0x7fccc405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40b2940 con 0x7fccc40b3140 2021-11-15T19:26:57.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.246+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fccbc0019e0 con 0x7fccc40b3140 2021-11-15T19:26:57.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 >> v1:172.21.2.137:6789/0 conn(0x7fccc40b3140 legacy=0x7fccc409ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb0003750 0x7fccb0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 0x7fccb0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccb00049f0 0x7fccb0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4099790 con 0x7fccb0003750 2021-11-15T19:26:57.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb000b830 con 0x7fccb00049f0 2021-11-15T19:26:57.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb000b9f0 con 0x7fccc409cca0 2021-11-15T19:26:57.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccb00049f0 0x7fccb0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc8ce4700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb0003750 0x7fccb0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 0x7fccb0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 -- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 msgr2=0x7fccb0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc409cca0 0x7fccb0004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 -- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb0003750 msgr2=0x7fccb0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb0003750 0x7fccb0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 -- 172.21.2.137:0/480188508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0003260 con 0x7fccb00049f0 2021-11-15T19:26:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccb00049f0 0x7fccb0004e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fccb800a000 tx=0x7fccb8008040).ready entity=mon.1 client_cookie=ae16cff57f057d3a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb8013670 con 0x7fccb00049f0 2021-11-15T19:26:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb80137d0 con 0x7fccb00049f0 2021-11-15T19:26:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc37fe700 1 -- 172.21.2.137:0/480188508 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb8013b30 con 0x7fccb00049f0 2021-11-15T19:26:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/480188508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccb00049f0 msgr2=0x7fccb0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 --2- 172.21.2.137:0/480188508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccb00049f0 0x7fccb0004e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fccb800a000 tx=0x7fccb8008040).stop 2021-11-15T19:26:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc94e5700 1 -- 172.21.2.137:0/480188508 reap_dead start 2021-11-15T19:26:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/480188508 shutdown_connections 2021-11-15T19:26:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/480188508 >> 172.21.2.137:0/480188508 conn(0x7fccc40b45b0 msgr2=0x7fccc405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/480188508 shutdown_connections 2021-11-15T19:26:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/480188508 wait complete. 2021-11-15T19:26:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 Processor -- start 2021-11-15T19:26:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- start start 2021-11-15T19:26:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb00049f0 0x7fccc40ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 0x7fccc40b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc40ad720 0x7fccc414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40affc0 con 0x7fccb00049f0 2021-11-15T19:26:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40adca0 con 0x7fccc40ae900 2021-11-15T19:26:57.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b0220 con 0x7fccc40ad720 2021-11-15T19:26:57.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 0x7fccc40b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 0x7fccc40b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59456/0 (socket says 172.21.2.137:59456) 2021-11-15T19:26:57.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 -- 172.21.2.137:0/3845030070 learned_addr learned my addr 172.21.2.137:0/3845030070 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 -- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc40ad720 msgr2=0x7fccc414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc40ad720 0x7fccc414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 -- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb00049f0 msgr2=0x7fccc40ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb00049f0 0x7fccc40ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 -- 172.21.2.137:0/3845030070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40acbf0 con 0x7fccc40ae900 2021-11-15T19:26:57.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc3fff700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 0x7fccc40b06c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fccbc008000 tx=0x7fccbc009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccbc004ab0 con 0x7fccc40ae900 2021-11-15T19:26:57.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc004c10 con 0x7fccc40ae900 2021-11-15T19:26:57.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40b0fe0 con 0x7fccc40ae900 2021-11-15T19:26:57.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccbc007170 con 0x7fccc40ae900 2021-11-15T19:26:57.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.250+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc40b0d50 con 0x7fccc40ae900 2021-11-15T19:26:57.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc409b210 con 0x7fccc40ae900 2021-11-15T19:26:57.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fccbc0072d0 con 0x7fccc40ae900 2021-11-15T19:26:57.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fccc1ffb700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcca40536f0 0x7fcca4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fccbc06c1c0 con 0x7fccc40ae900 2021-11-15T19:26:57.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fccc8ce4700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcca40536f0 0x7fcca4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fccc8ce4700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcca40536f0 0x7fcca4055bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fccb400b000 tx=0x7fccb4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.254+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccbc043210 con 0x7fccc40ae900 2021-11-15T19:26:57.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.358+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fccc40573d0 con 0x7fccc40ae900 2021-11-15T19:26:57.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fccc1ffb700 1 -- 172.21.2.137:0/3845030070 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+131253 (secure 0 0 0) 0x7fccbc046830 con 0x7fccc40ae900 2021-11-15T19:26:57.372 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:57.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcca40536f0 msgr2=0x7fcca4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcca40536f0 0x7fcca4055bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fccb400b000 tx=0x7fccb4009040).stop 2021-11-15T19:26:57.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 msgr2=0x7fccc40b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 0x7fccc40b06c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fccbc008000 tx=0x7fccbc009040).stop 2021-11-15T19:26:57.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 shutdown_connections 2021-11-15T19:26:57.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcca40536f0 0x7fcca4055bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fccc40ad720 0x7fccc414fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fccc40ae900 0x7fccc40b06c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 --2- 172.21.2.137:0/3845030070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fccb00049f0 0x7fccc40ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 >> 172.21.2.137:0/3845030070 conn(0x7fccc40b45b0 msgr2=0x7fccc4143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 shutdown_connections 2021-11-15T19:26:57.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.362+0000 7fcccaf48700 1 -- 172.21.2.137:0/3845030070 wait complete. 2021-11-15T19:26:57.378 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6832","nonce":14547},{"type":"v1","addr":"172.21.2.111:6833","nonce":14547}]},"active_addr":"172.21.2.111:6833/14547","active_change":"2021-11-15T19:26:43.343993+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.111:0","nonce":3653392696}]},{"addrvec":[{"type":"v2","addr":"172.21.2.111:0","nonce":2160418413}]},{"addrvec":[{"type":"v2","addr":"172.21.2.111:0","nonce":161871318}]}]}} 2021-11-15T19:26:57.382 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-11-15T19:26:57.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-11-15T19:26:57.383 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:57.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 Processor -- start 2021-11-15T19:26:57.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- start start 2021-11-15T19:26:57.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c1413ce00 0x7f2c14142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2c140b6830 0x7f2c141433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c140b63b0 con 0x7f2c140b5fd0 2021-11-15T19:26:57.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c14147070 con 0x7f2c140b6830 2021-11-15T19:26:57.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14146dd0 con 0x7f2c1413ce00 2021-11-15T19:26:57.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2c140b6830 0x7f2c141433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2c140b6830 0x7f2c141433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59462/0 (socket says 172.21.2.137:59462) 2021-11-15T19:26:57.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 -- 172.21.2.137:0/26444485 learned_addr learned my addr 172.21.2.137:0/26444485 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 -- 172.21.2.137:0/26444485 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c1413ce00 msgr2=0x7f2c14142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 --2- 172.21.2.137:0/26444485 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c1413ce00 0x7f2c14142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 -- 172.21.2.137:0/26444485 >> v1:172.21.2.111:6789/0 conn(0x7f2c140b5fd0 legacy=0x7f2c1413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 -- 172.21.2.137:0/26444485 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14146af0 con 0x7f2c140b6830 2021-11-15T19:26:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c137fe700 1 --2- 172.21.2.137:0/26444485 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c141433c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2c1413d200 tx=0x7f2c0c009290).ready entity=mon.1 client_cookie=134526eef4e9e381 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c11ffb700 1 -- 172.21.2.137:0/26444485 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c0c00b860 con 0x7f2c140b6830 2021-11-15T19:26:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c11ffb700 1 -- 172.21.2.137:0/26444485 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00b9c0 con 0x7f2c140b6830 2021-11-15T19:26:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c11ffb700 1 -- 172.21.2.137:0/26444485 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c0c00bb70 con 0x7f2c140b6830 2021-11-15T19:26:57.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- 172.21.2.137:0/26444485 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 msgr2=0x7f2c141433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- 172.21.2.137:0/26444485 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c141433c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2c1413d200 tx=0x7f2c0c009290).stop 2021-11-15T19:26:57.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- 172.21.2.137:0/26444485 shutdown_connections 2021-11-15T19:26:57.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- 172.21.2.137:0/26444485 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c141433c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- 172.21.2.137:0/26444485 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c1413ce00 0x7f2c14142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- 172.21.2.137:0/26444485 >> 172.21.2.137:0/26444485 conn(0x7f2c140624b0 msgr2=0x7f2c14062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- 172.21.2.137:0/26444485 shutdown_connections 2021-11-15T19:26:57.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- 172.21.2.137:0/26444485 wait complete. 2021-11-15T19:26:57.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 Processor -- start 2021-11-15T19:26:57.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- start start 2021-11-15T19:26:57.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c140b5fd0 0x7f2c141558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c1413b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c1413ce00 0x7f2c14140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1413f290 con 0x7f2c1413ce00 2021-11-15T19:26:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1413d770 con 0x7f2c140b6830 2021-11-15T19:26:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c194ab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1413da10 con 0x7f2c140b5fd0 2021-11-15T19:26:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c127fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c1413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c127fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c1413b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59468/0 (socket says 172.21.2.137:59468) 2021-11-15T19:26:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.426+0000 7f2c127fc700 1 -- 172.21.2.137:0/161221898 learned_addr learned my addr 172.21.2.137:0/161221898 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c127fc700 1 -- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c140b5fd0 msgr2=0x7f2c141558b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:26:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c127fc700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c140b5fd0 0x7f2c141558b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c127fc700 1 -- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c1413ce00 msgr2=0x7f2c14140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c127fc700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c1413ce00 0x7f2c14140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c127fc700 1 -- 172.21.2.137:0/161221898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009530 con 0x7f2c140b6830 2021-11-15T19:26:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c127fc700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c1413b780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2c04002f70 tx=0x7f2c04006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c04013460 con 0x7f2c140b6830 2021-11-15T19:26:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040135c0 con 0x7f2c140b6830 2021-11-15T19:26:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c04013920 con 0x7f2c140b6830 2021-11-15T19:26:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1413dfe0 con 0x7f2c140b6830 2021-11-15T19:26:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1413e2c0 con 0x7f2c140b6830 2021-11-15T19:26:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1413dbd0 con 0x7f2c140b6830 2021-11-15T19:26:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2c0400f070 con 0x7f2c140b6830 2021-11-15T19:26:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2bf80536d0 0x7f2bf8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f2c0406b270 con 0x7f2c140b6830 2021-11-15T19:26:57.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c12ffd700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2bf80536d0 0x7f2bf8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c12ffd700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2bf80536d0 0x7f2bf8055b90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2bfc002f40 tx=0x7f2bfc006880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.430+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c040423d0 con 0x7f2c140b6830 2021-11-15T19:26:57.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.514+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c140afff0 con 0x7f2c140b6830 2021-11-15T19:26:57.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.514+0000 7f2c0bfff700 1 -- 172.21.2.137:0/161221898 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f2c040459f0 con 0x7f2c140b6830 2021-11-15T19:26:57.525 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:57.526 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.514+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2bf80536d0 msgr2=0x7f2bf8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.514+0000 7f2c194ab700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2bf80536d0 0x7f2bf8055b90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2bfc002f40 tx=0x7f2bfc006880).stop 2021-11-15T19:26:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.514+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 msgr2=0x7f2c1413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.514+0000 7f2c194ab700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c1413b780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2c04002f70 tx=0x7f2c04006ec0).stop 2021-11-15T19:26:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 shutdown_connections 2021-11-15T19:26:57.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2bf80536d0 0x7f2bf8055b90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c1413ce00 0x7f2c14140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c140b6830 0x7f2c1413b780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 --2- 172.21.2.137:0/161221898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c140b5fd0 0x7f2c141558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 >> 172.21.2.137:0/161221898 conn(0x7f2c140624b0 msgr2=0x7f2c14146030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 shutdown_connections 2021-11-15T19:26:57.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.518+0000 7f2c194ab700 1 -- 172.21.2.137:0/161221898 wait complete. 2021-11-15T19:26:57.532 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-11-15T19:26:57.533 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:26:57.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 Processor -- start 2021-11-15T19:26:57.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 -- start start 2021-11-15T19:26:57.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcdd413f890 0x7fcdd40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 0x7fcdd405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd4060070 con 0x7fcdd40608f0 2021-11-15T19:26:57.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40ad6c0 con 0x7fcdd413f890 2021-11-15T19:26:57.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcddc178700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40b1b50 con 0x7fcdd405f730 2021-11-15T19:26:57.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 0x7fcdd405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdd9713700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcdd413f890 0x7fcdd40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 0x7fcdd405fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:32816/0 (socket says 172.21.2.137:32816) 2021-11-15T19:26:57.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdd9713700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcdd413f890 0x7fcdd40b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:38472/0 (socket says 172.21.2.137:38472) 2021-11-15T19:26:57.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 -- 172.21.2.137:0/362203686 learned_addr learned my addr 172.21.2.137:0/362203686 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 -- 172.21.2.137:0/362203686 >> v2:172.21.2.111:3300/0 conn(0x7fcdd413f890 msgr2=0x7fcdd40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 --2- 172.21.2.137:0/362203686 >> v2:172.21.2.111:3300/0 conn(0x7fcdd413f890 0x7fcdd40b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 -- 172.21.2.137:0/362203686 >> v1:172.21.2.111:6789/0 conn(0x7fcdd40608f0 legacy=0x7fcdd40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 -- 172.21.2.137:0/362203686 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40b0c80 con 0x7fcdd405f730 2021-11-15T19:26:57.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.574+0000 7fcdda715700 1 --2- 172.21.2.137:0/362203686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 0x7fcdd405fb80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fcdcc0032f0 tx=0x7fcdcc0091e0).ready entity=mon.2 client_cookie=bf67a3a3dcb50aee server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd8f12700 1 -- 172.21.2.137:0/362203686 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdcc012070 con 0x7fcdd405f730 2021-11-15T19:26:57.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd8f12700 1 -- 172.21.2.137:0/362203686 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc00fd90 con 0x7fcdd405f730 2021-11-15T19:26:57.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd8f12700 1 -- 172.21.2.137:0/362203686 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdcc016600 con 0x7fcdd405f730 2021-11-15T19:26:57.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/362203686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 msgr2=0x7fcdd405fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 --2- 172.21.2.137:0/362203686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 0x7fcdd405fb80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fcdcc0032f0 tx=0x7fcdcc0091e0).stop 2021-11-15T19:26:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/362203686 shutdown_connections 2021-11-15T19:26:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 --2- 172.21.2.137:0/362203686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd405f730 0x7fcdd405fb80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 --2- 172.21.2.137:0/362203686 >> v2:172.21.2.111:3300/0 conn(0x7fcdd413f890 0x7fcdd40b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/362203686 >> 172.21.2.137:0/362203686 conn(0x7fcdd4063980 msgr2=0x7fcdd4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/362203686 shutdown_connections 2021-11-15T19:26:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/362203686 wait complete. 2021-11-15T19:26:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 Processor -- start 2021-11-15T19:26:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- start start 2021-11-15T19:26:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 0x7fcdd414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcdd40608f0 0x7fcdd414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd413f890 0x7fcdd41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd413dee0 con 0x7fcdd40608f0 2021-11-15T19:26:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd413e180 con 0x7fcdd405f730 2021-11-15T19:26:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4151990 con 0x7fcdd413f890 2021-11-15T19:26:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 0x7fcdd414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 0x7fcdd414f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59480/0 (socket says 172.21.2.137:59480) 2021-11-15T19:26:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 -- 172.21.2.137:0/4142272795 learned_addr learned my addr 172.21.2.137:0/4142272795 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 -- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd413f890 msgr2=0x7fcdd41514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd413f890 0x7fcdd41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 -- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcdd40608f0 msgr2=0x7fcdd414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcdd40608f0 0x7fcdd414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 -- 172.21.2.137:0/4142272795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc00d9d0 con 0x7fcdd405f730 2021-11-15T19:26:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdd9f14700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 0x7fcdd414f060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcdd40b3ac0 tx=0x7fcdd0007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd000ce30 con 0x7fcdd405f730 2021-11-15T19:26:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd000f470 con 0x7fcdd405f730 2021-11-15T19:26:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd4151c10 con 0x7fcdd405f730 2021-11-15T19:26:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd000f7d0 con 0x7fcdd405f730 2021-11-15T19:26:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.578+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd413e7c0 con 0x7fcdd405f730 2021-11-15T19:26:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd40b0f20 con 0x7fcdd405f730 2021-11-15T19:26:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcdd0019030 con 0x7fcdd405f730 2021-11-15T19:26:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcdc6ffd700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcdb4053690 0x7fcdb4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fcdd006ae60 con 0x7fcdd405f730 2021-11-15T19:26:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcdd9713700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcdb4053690 0x7fcdb4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcdd9713700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcdb4053690 0x7fcdb4055b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fcdc800c000 tx=0x7fcdc8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.582+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcdd0041eb0 con 0x7fcdd405f730 2021-11-15T19:26:57.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.666+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd40573d0 con 0x7fcdd405f730 2021-11-15T19:26:57.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.666+0000 7fcdc6ffd700 1 -- 172.21.2.137:0/4142272795 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fcdd00454d0 con 0x7fcdd405f730 2021-11-15T19:26:57.677 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:26:57.677 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:26:57.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.666+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcdb4053690 msgr2=0x7fcdb4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.666+0000 7fcddc178700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcdb4053690 0x7fcdb4055b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fcdc800c000 tx=0x7fcdc8006df0).stop 2021-11-15T19:26:57.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.666+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 msgr2=0x7fcdd414f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.666+0000 7fcddc178700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 0x7fcdd414f060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcdd40b3ac0 tx=0x7fcdd0007c50).stop 2021-11-15T19:26:57.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 shutdown_connections 2021-11-15T19:26:57.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcdb4053690 0x7fcdb4055b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcdd413f890 0x7fcdd41514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcdd40608f0 0x7fcdd414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 --2- 172.21.2.137:0/4142272795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcdd405f730 0x7fcdd414f060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 >> 172.21.2.137:0/4142272795 conn(0x7fcdd4063980 msgr2=0x7fcdd4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 shutdown_connections 2021-11-15T19:26:57.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.670+0000 7fcddc178700 1 -- 172.21.2.137:0/4142272795 wait complete. 2021-11-15T19:26:57.684 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-11-15T19:26:57.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 Processor -- start 2021-11-15T19:26:57.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 -- start start 2021-11-15T19:26:57.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f99ec0b2400 0x7f99ec0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec0b3e70 0x7f99ec0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec146c20 con 0x7f99ec0b5330 2021-11-15T19:26:57.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec142af0 con 0x7f99ec0b2400 2021-11-15T19:26:57.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99f1dcd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0b27e0 con 0x7f99ec0b3e70 2021-11-15T19:26:57.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99eaffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f99ec0b5330 0x7f99ec0b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50042/0 (socket says 172.21.2.137:50042) 2021-11-15T19:26:57.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99eaffd700 1 -- 172.21.2.137:0/2914925003 learned_addr learned my addr 172.21.2.137:0/2914925003 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:57.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859241214 0 0) 0x7f99ec146c20 con 0x7f99ec0b5330 2021-11-15T19:26:57.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99cc003260 con 0x7f99ec0b5330 2021-11-15T19:26:57.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005197853 0 0) 0x7f99cc003260 con 0x7f99ec0b5330 2021-11-15T19:26:57.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec0b3e70 msgr2=0x7f99ec0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec0b3e70 0x7f99ec0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 >> v2:172.21.2.111:3300/0 conn(0x7f99ec0b2400 msgr2=0x7f99ec0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 --2- 172.21.2.137:0/2914925003 >> v2:172.21.2.111:3300/0 conn(0x7f99ec0b2400 0x7f99ec0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0b4d80 con 0x7f99ec0b5330 2021-11-15T19:26:57.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f99d4001680 con 0x7f99ec0b5330 2021-11-15T19:26:57.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 >> v1:172.21.2.137:6789/0 conn(0x7f99ec0b5330 legacy=0x7f99ec0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99cc0037d0 0x7f99cc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec0b3e70 0x7f99cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc004bf0 0x7f99cc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec142af0 con 0x7f99cc004bf0 2021-11-15T19:26:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0b27e0 con 0x7f99cc0037d0 2021-11-15T19:26:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc005330 con 0x7f99ec0b3e70 2021-11-15T19:26:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99cc0037d0 0x7f99cc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99eb7fe700 1 -- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec0b3e70 msgr2=0x7f99cc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.726+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec0b3e70 0x7f99cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eb7fe700 1 -- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc004bf0 msgr2=0x7f99cc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc004bf0 0x7f99cc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eb7fe700 1 -- 172.21.2.137:0/2914925003 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc003260 con 0x7f99cc0037d0 2021-11-15T19:26:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99cc0037d0 0x7f99cc003bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f99dc002f70 tx=0x7f99dc006ca0).ready entity=mon.1 client_cookie=7b4ea26c61da3f97 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc012410 con 0x7f99cc0037d0 2021-11-15T19:26:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc012570 con 0x7f99cc0037d0 2021-11-15T19:26:57.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99ea7fc700 1 -- 172.21.2.137:0/2914925003 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc0128d0 con 0x7f99cc0037d0 2021-11-15T19:26:57.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2914925003 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99cc0037d0 msgr2=0x7f99cc003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 --2- 172.21.2.137:0/2914925003 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99cc0037d0 0x7f99cc003bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f99dc002f70 tx=0x7f99dc006ca0).stop 2021-11-15T19:26:57.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99ebfff700 1 -- 172.21.2.137:0/2914925003 reap_dead start 2021-11-15T19:26:57.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2914925003 shutdown_connections 2021-11-15T19:26:57.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2914925003 >> 172.21.2.137:0/2914925003 conn(0x7f99ec0623a0 msgr2=0x7f99ec062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2914925003 shutdown_connections 2021-11-15T19:26:57.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2914925003 wait complete. 2021-11-15T19:26:57.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 Processor -- start 2021-11-15T19:26:57.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- start start 2021-11-15T19:26:57.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc0037d0 0x7f99ec0b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99ec0af2b0 0x7f99ec116880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec116d70 0x7f99ec155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec116450 con 0x7f99cc0037d0 2021-11-15T19:26:57.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec117200 con 0x7f99ec0af2b0 2021-11-15T19:26:57.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec113e50 con 0x7f99ec116d70 2021-11-15T19:26:57.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99ec0af2b0 0x7f99ec116880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99ec0af2b0 0x7f99ec116880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59502/0 (socket says 172.21.2.137:59502) 2021-11-15T19:26:57.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 -- 172.21.2.137:0/2096992115 learned_addr learned my addr 172.21.2.137:0/2096992115 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc0037d0 0x7f99ec0b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 -- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec116d70 msgr2=0x7f99ec155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99ec116d70 0x7f99ec155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 -- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc0037d0 msgr2=0x7f99ec0b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc0037d0 0x7f99ec0b9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 -- 172.21.2.137:0/2096992115 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec1140f0 con 0x7f99ec0af2b0 2021-11-15T19:26:57.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99cc0037d0 0x7f99ec0b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:57.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99eaffd700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99ec0af2b0 0x7f99ec116880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f99d4001390 tx=0x7f99d4001b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99d4007170 con 0x7f99ec0af2b0 2021-11-15T19:26:57.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d40072d0 con 0x7f99ec0af2b0 2021-11-15T19:26:57.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec114de0 con 0x7f99ec0af2b0 2021-11-15T19:26:57.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99d4004920 con 0x7f99ec0af2b0 2021-11-15T19:26:57.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec0af070 con 0x7f99ec0af2b0 2021-11-15T19:26:57.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99ec0b50a0 con 0x7f99ec0af2b0 2021-11-15T19:26:57.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.730+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f99d4004a80 con 0x7f99ec0af2b0 2021-11-15T19:26:57.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99e8ff9700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99d0053690 0x7f99d0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f99d406b640 con 0x7f99ec0af2b0 2021-11-15T19:26:57.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99e8ff9700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f99d005ab00 0x7f99d005cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 --> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99d005d4e0 con 0x7f99d005ab00 2021-11-15T19:26:57.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99d406dc50 con 0x7f99ec0af2b0 2021-11-15T19:26:57.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99ebfff700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f99d005ab00 0x7f99d005cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99d0053690 0x7f99d0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99ebfff700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f99d005ab00 0x7f99d005cf20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== osd.0 v2:172.21.2.137:6800/14742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f99d005d4e0 con 0x7f99d005ab00 2021-11-15T19:26:57.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.734+0000 7f99eb7fe700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99d0053690 0x7f99d0055b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f99dc002000 tx=0x7f99dc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 --> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99ec142fb0 con 0x7f99d005ab00 2021-11-15T19:26:57.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99e8ff9700 1 -- 172.21.2.137:0/2096992115 <== osd.0 v2:172.21.2.137:6800/14742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99ec142fb0 con 0x7f99d005ab00 2021-11-15T19:26:57.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f99d005ab00 msgr2=0x7f99d005cf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f99d005ab00 0x7f99d005cf20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99d0053690 msgr2=0x7f99d0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99d0053690 0x7f99d0055b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f99dc002000 tx=0x7f99dc015000).stop 2021-11-15T19:26:57.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99ec0af2b0 msgr2=0x7f99ec116880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 --2- 172.21.2.137:0/2096992115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99ec0af2b0 0x7f99ec116880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f99d4001390 tx=0x7f99d4001b30).stop 2021-11-15T19:26:57.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99ebfff700 1 -- 172.21.2.137:0/2096992115 reap_dead start 2021-11-15T19:26:57.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 shutdown_connections 2021-11-15T19:26:57.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 >> 172.21.2.137:0/2096992115 conn(0x7f99ec0623a0 msgr2=0x7f99ec062830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 shutdown_connections 2021-11-15T19:26:57.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.742+0000 7f99f1dcd700 1 -- 172.21.2.137:0/2096992115 wait complete. 2021-11-15T19:26:57.764 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:26:57.765 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-11-15T19:26:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 Processor -- start 2021-11-15T19:26:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 -- start start 2021-11-15T19:26:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9780b2400 0x7fc9780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc9780b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc978146c20 con 0x7fc9780b3e70 2021-11-15T19:26:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc978142af0 con 0x7fc9780b2400 2021-11-15T19:26:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.806+0000 7fc98026d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b27e0 con 0x7fc9780b5330 2021-11-15T19:26:57.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc9780b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97e009700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9780b2400 0x7fc9780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97e80a700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fc9780b3e70 0x7fc9780b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:42552/0 (socket says 172.21.2.137:42552) 2021-11-15T19:26:57.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97e80a700 1 -- 172.21.2.137:0/1504865220 learned_addr learned my addr 172.21.2.137:0/1504865220 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:57.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97e009700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9780b2400 0x7fc9780b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:38508/0 (socket says 172.21.2.137:38508) 2021-11-15T19:26:57.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc9780b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:32852/0 (socket says 172.21.2.137:32852) 2021-11-15T19:26:57.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 -- 172.21.2.137:0/1504865220 >> v2:172.21.2.111:3300/0 conn(0x7fc9780b2400 msgr2=0x7fc9780b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 --2- 172.21.2.137:0/1504865220 >> v2:172.21.2.111:3300/0 conn(0x7fc9780b2400 0x7fc9780b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 -- 172.21.2.137:0/1504865220 >> v1:172.21.2.111:6789/0 conn(0x7fc9780b3e70 legacy=0x7fc9780b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 -- 172.21.2.137:0/1504865220 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780b4d80 con 0x7fc9780b5330 2021-11-15T19:26:57.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d808700 1 --2- 172.21.2.137:0/1504865220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc9780b09b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc96c002f70 tx=0x7fc96c006df0).ready entity=mon.2 client_cookie=e10b2c7844fffba9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d007700 1 -- 172.21.2.137:0/1504865220 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00d570 con 0x7fc9780b5330 2021-11-15T19:26:57.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d007700 1 -- 172.21.2.137:0/1504865220 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c000e90 con 0x7fc9780b5330 2021-11-15T19:26:57.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc97d007700 1 -- 172.21.2.137:0/1504865220 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00d8c0 con 0x7fc9780b5330 2021-11-15T19:26:57.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 -- 172.21.2.137:0/1504865220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 msgr2=0x7fc9780b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 --2- 172.21.2.137:0/1504865220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc9780b09b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc96c002f70 tx=0x7fc96c006df0).stop 2021-11-15T19:26:57.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 -- 172.21.2.137:0/1504865220 shutdown_connections 2021-11-15T19:26:57.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 --2- 172.21.2.137:0/1504865220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc9780b09b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 --2- 172.21.2.137:0/1504865220 >> v2:172.21.2.111:3300/0 conn(0x7fc9780b2400 0x7fc9780b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 -- 172.21.2.137:0/1504865220 >> 172.21.2.137:0/1504865220 conn(0x7fc9780623a0 msgr2=0x7fc978062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 -- 172.21.2.137:0/1504865220 shutdown_connections 2021-11-15T19:26:57.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 -- 172.21.2.137:0/1504865220 wait complete. 2021-11-15T19:26:57.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 Processor -- start 2021-11-15T19:26:57.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.810+0000 7fc98026d700 1 -- start start 2021-11-15T19:26:57.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9780b2400 0x7fc9780af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9780b3e70 0x7fc978112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc978112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97813f890 con 0x7fc9780b2400 2021-11-15T19:26:57.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc978152480 con 0x7fc9780b3e70 2021-11-15T19:26:57.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978152720 con 0x7fc9780b5330 2021-11-15T19:26:57.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9780b3e70 0x7fc978112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9780b3e70 0x7fc978112a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59516/0 (socket says 172.21.2.137:59516) 2021-11-15T19:26:57.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 -- 172.21.2.137:0/2472577446 learned_addr learned my addr 172.21.2.137:0/2472577446 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 -- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 msgr2=0x7fc978112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9780b5330 0x7fc978112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 -- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9780b2400 msgr2=0x7fc9780af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9780b2400 0x7fc9780af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 -- 172.21.2.137:0/2472577446 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c00b180 con 0x7fc9780b3e70 2021-11-15T19:26:57.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97d808700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9780b3e70 0x7fc978112a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc9780aec20 tx=0x7fc96c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00dea0 con 0x7fc9780b3e70 2021-11-15T19:26:57.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c01e400 con 0x7fc9780b3e70 2021-11-15T19:26:57.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9781529c0 con 0x7fc9780b3e70 2021-11-15T19:26:57.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c01e760 con 0x7fc9780b3e70 2021-11-15T19:26:57.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780ae7c0 con 0x7fc9780b3e70 2021-11-15T19:26:57.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc978153000 con 0x7fc9780b3e70 2021-11-15T19:26:57.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc96c01c070 con 0x7fc9780b3e70 2021-11-15T19:26:57.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc958053610 0x7fc958055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc96c06c4b0 con 0x7fc9780b3e70 2021-11-15T19:26:57.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7fc95805a980 0x7fc95805cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 --> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc95805d360 con 0x7fc95805a980 2021-11-15T19:26:57.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc96c043610 con 0x7fc9780b3e70 2021-11-15T19:26:57.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97e80a700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7fc95805a980 0x7fc95805cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97e80a700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7fc95805a980 0x7fc95805cda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97e009700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc958053610 0x7fc958055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== osd.1 v2:172.21.2.137:6808/14743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fc95805d360 con 0x7fc95805a980 2021-11-15T19:26:57.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.814+0000 7fc97e009700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc958053610 0x7fc958055ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc97400c000 tx=0x7fc974006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 --> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc978152b50 con 0x7fc95805a980 2021-11-15T19:26:57.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc96b7fe700 1 -- 172.21.2.137:0/2472577446 <== osd.1 v2:172.21.2.137:6808/14743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc978152b50 con 0x7fc95805a980 2021-11-15T19:26:57.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7fc95805a980 msgr2=0x7fc95805cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7fc95805a980 0x7fc95805cda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc958053610 msgr2=0x7fc958055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc958053610 0x7fc958055ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc97400c000 tx=0x7fc974006df0).stop 2021-11-15T19:26:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9780b3e70 msgr2=0x7fc978112a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 --2- 172.21.2.137:0/2472577446 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9780b3e70 0x7fc978112a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc9780aec20 tx=0x7fc96c014000).stop 2021-11-15T19:26:57.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc97e80a700 1 -- 172.21.2.137:0/2472577446 reap_dead start 2021-11-15T19:26:57.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 shutdown_connections 2021-11-15T19:26:57.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 >> 172.21.2.137:0/2472577446 conn(0x7fc9780623a0 msgr2=0x7fc97813fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 shutdown_connections 2021-11-15T19:26:57.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.822+0000 7fc98026d700 1 -- 172.21.2.137:0/2472577446 wait complete. 2021-11-15T19:26:57.842 INFO:teuthology.orchestra.run.gibba037.stdout:55834574852 2021-11-15T19:26:57.842 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-11-15T19:26:57.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.882+0000 7f141c383700 1 Processor -- start 2021-11-15T19:26:57.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.882+0000 7f141c383700 1 -- start start 2021-11-15T19:26:57.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f14140b5330 0x7f14140b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14140b3e70 0x7f14140b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1414146c20 con 0x7f14140b2400 2021-11-15T19:26:57.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1414142af0 con 0x7f14140b5330 2021-11-15T19:26:57.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14140b27e0 con 0x7f14140b3e70 2021-11-15T19:26:57.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a11f700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f14140b2400 0x7f14140b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50076/0 (socket says 172.21.2.137:50076) 2021-11-15T19:26:57.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a11f700 1 -- 172.21.2.137:0/4293651380 learned_addr learned my addr 172.21.2.137:0/4293651380 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- 172.21.2.137:0/4293651380 >> v2:172.21.2.137:3300/0 conn(0x7f14140b3e70 0x7f14140b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/4293651380 >> v2:172.21.2.111:3300/0 conn(0x7f14140b5330 msgr2=0x7f14140b2a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- 172.21.2.137:0/4293651380 >> v2:172.21.2.111:3300/0 conn(0x7f14140b5330 0x7f14140b2a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/4293651380 >> v1:172.21.2.137:6789/0 conn(0x7f14140b2400 legacy=0x7f14140b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/4293651380 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14140b4d80 con 0x7f14140b3e70 2021-11-15T19:26:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- 172.21.2.137:0/4293651380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b3e70 0x7f14140b5ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f140c0032f0 tx=0x7f140c0091d0).ready entity=mon.1 client_cookie=642af1de6e303329 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141911d700 1 -- 172.21.2.137:0/4293651380 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f140c009ea0 con 0x7f14140b3e70 2021-11-15T19:26:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141911d700 1 -- 172.21.2.137:0/4293651380 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00b870 con 0x7f14140b3e70 2021-11-15T19:26:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141911d700 1 -- 172.21.2.137:0/4293651380 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f140c00ba20 con 0x7f14140b3e70 2021-11-15T19:26:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/4293651380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b3e70 msgr2=0x7f14140b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- 172.21.2.137:0/4293651380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b3e70 0x7f14140b5ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f140c0032f0 tx=0x7f140c0091d0).stop 2021-11-15T19:26:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/4293651380 shutdown_connections 2021-11-15T19:26:57.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- 172.21.2.137:0/4293651380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b3e70 0x7f14140b5ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- 172.21.2.137:0/4293651380 >> v2:172.21.2.111:3300/0 conn(0x7f14140b5330 0x7f14140b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/4293651380 >> 172.21.2.137:0/4293651380 conn(0x7f14140623a0 msgr2=0x7f1414062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/4293651380 shutdown_connections 2021-11-15T19:26:57.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/4293651380 wait complete. 2021-11-15T19:26:57.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 Processor -- start 2021-11-15T19:26:57.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- start start 2021-11-15T19:26:57.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14140b2400 0x7f1414152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14140b3e70 0x7f14140b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b5330 0x7f1414116500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141172d0 con 0x7f14140b2400 2021-11-15T19:26:57.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141130d0 con 0x7f14140b5330 2021-11-15T19:26:57.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1414117030 con 0x7f14140b3e70 2021-11-15T19:26:57.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b5330 0x7f1414116500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b5330 0x7f1414116500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59536/0 (socket says 172.21.2.137:59536) 2021-11-15T19:26:57.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/2241906822 learned_addr learned my addr 172.21.2.137:0/2241906822 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14140b3e70 msgr2=0x7f14140b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14140b3e70 0x7f14140b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14140b2400 msgr2=0x7f1414152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14140b2400 0x7f1414152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 -- 172.21.2.137:0/2241906822 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009470 con 0x7f14140b5330 2021-11-15T19:26:57.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141a920700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b5330 0x7f1414116500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f140c0032f0 tx=0x7f140c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f140c009ea0 con 0x7f14140b5330 2021-11-15T19:26:57.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c01f5e0 con 0x7f14140b5330 2021-11-15T19:26:57.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f140c01f940 con 0x7f14140b5330 2021-11-15T19:26:57.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1414155780 con 0x7f14140b5330 2021-11-15T19:26:57.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14140b9f10 con 0x7f14140b5330 2021-11-15T19:26:57.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.886+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1414155910 con 0x7f14140b5330 2021-11-15T19:26:57.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f140c026030 con 0x7f14140b5330 2021-11-15T19:26:57.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f13f4053610 0x7f13f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f140c06c650 con 0x7f14140b5330 2021-11-15T19:26:57.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f13f405a980 0x7f13f405cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 --> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13f405d360 con 0x7f13f405a980 2021-11-15T19:26:57.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f140c0437b0 con 0x7f14140b5330 2021-11-15T19:26:57.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f141991e700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f13f405a980 0x7f13f405cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f141991e700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f13f405a980 0x7f13f405cda0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f141a11f700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f13f4053610 0x7f13f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== osd.2 v2:172.21.2.137:6816/14744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f13f405d360 con 0x7f13f405a980 2021-11-15T19:26:57.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.890+0000 7f141a11f700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f13f4053610 0x7f13f4055ad0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f14140b6ee0 tx=0x7f1410007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 --> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1414112cb0 con 0x7f13f405a980 2021-11-15T19:26:57.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f14077fe700 1 -- 172.21.2.137:0/2241906822 <== osd.2 v2:172.21.2.137:6816/14744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1414112cb0 con 0x7f13f405a980 2021-11-15T19:26:57.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f13f405a980 msgr2=0x7f13f405cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f13f405a980 0x7f13f405cda0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f13f4053610 msgr2=0x7f13f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f13f4053610 0x7f13f4055ad0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f14140b6ee0 tx=0x7f1410007860).stop 2021-11-15T19:26:57.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b5330 msgr2=0x7f1414116500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 --2- 172.21.2.137:0/2241906822 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14140b5330 0x7f1414116500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f140c0032f0 tx=0x7f140c016000).stop 2021-11-15T19:26:57.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141a920700 1 -- 172.21.2.137:0/2241906822 reap_dead start 2021-11-15T19:26:57.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 shutdown_connections 2021-11-15T19:26:57.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 >> 172.21.2.137:0/2241906822 conn(0x7f14140623a0 msgr2=0x7f1414062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 shutdown_connections 2021-11-15T19:26:57.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.898+0000 7f141c383700 1 -- 172.21.2.137:0/2241906822 wait complete. 2021-11-15T19:26:57.915 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:26:57.916 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-11-15T19:26:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 Processor -- start 2021-11-15T19:26:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- start start 2021-11-15T19:26:57.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f97b80acd60 0x7f97b80b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b80b76c0 con 0x7f97b80b4680 2021-11-15T19:26:57.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b812a170 con 0x7f97b80b72e0 2021-11-15T19:26:57.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b80b3100 con 0x7f97b80acd60 2021-11-15T19:26:57.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bd8ff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f97b80b72e0 0x7f97b80b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50092/0 (socket says 172.21.2.137:50092) 2021-11-15T19:26:57.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bd8ff700 1 -- 172.21.2.137:0/4144962077 learned_addr learned my addr 172.21.2.137:0/4144962077 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:57.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925726926 0 0) 0x7f97b812a170 con 0x7f97b80b72e0 2021-11-15T19:26:57.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a0003260 con 0x7f97b80b72e0 2021-11-15T19:26:57.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651372788 0 0) 0x7f97a0003260 con 0x7f97b80b72e0 2021-11-15T19:26:57.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 >> v2:172.21.2.111:3300/0 conn(0x7f97b80acd60 msgr2=0x7f97b80b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 --2- 172.21.2.137:0/4144962077 >> v2:172.21.2.111:3300/0 conn(0x7f97b80acd60 0x7f97b80b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 >> v1:172.21.2.111:6789/0 conn(0x7f97b80b4680 legacy=0x7f97b81290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80ad8a0 con 0x7f97b80b72e0 2021-11-15T19:26:57.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f97ac001660 con 0x7f97b80b72e0 2021-11-15T19:26:57.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 >> v1:172.21.2.137:6789/0 conn(0x7f97b80b72e0 legacy=0x7f97b80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97a00037d0 0x7f97a0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97a0004500 0x7f97a0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97a0005070 0x7f97a000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b80b3100 con 0x7f97a0004500 2021-11-15T19:26:57.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a000bef0 con 0x7f97a0005070 2021-11-15T19:26:57.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a000c0b0 con 0x7f97a00037d0 2021-11-15T19:26:57.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97a0005070 0x7f97a000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 -- 172.21.2.137:0/4144962077 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97a00037d0 msgr2=0x7f97a0003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97a00037d0 0x7f97a0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 -- 172.21.2.137:0/4144962077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97a0004500 msgr2=0x7f97a0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:57.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97a0004500 0x7f97a0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 -- 172.21.2.137:0/4144962077 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80ad8a0 con 0x7f97a0005070 2021-11-15T19:26:57.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 -- 172.21.2.137:0/4144962077 reap_dead start 2021-11-15T19:26:57.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97be100700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97a0005070 0x7f97a000b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f97b00012f0 tx=0x7f97b0007d60).ready entity=mon.1 client_cookie=35e52b5dd9705dc1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b0001500 con 0x7f97a0005070 2021-11-15T19:26:57.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0006870 con 0x7f97a0005070 2021-11-15T19:26:57.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bc8fd700 1 -- 172.21.2.137:0/4144962077 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b0006bd0 con 0x7f97a0005070 2021-11-15T19:26:57.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- 172.21.2.137:0/4144962077 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97a0005070 msgr2=0x7f97a000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97a0005070 0x7f97a000b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f97b00012f0 tx=0x7f97b0007d60).stop 2021-11-15T19:26:57.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- 172.21.2.137:0/4144962077 shutdown_connections 2021-11-15T19:26:57.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 --2- 172.21.2.137:0/4144962077 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97a0005070 0x7f97a000b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- 172.21.2.137:0/4144962077 >> 172.21.2.137:0/4144962077 conn(0x7f97b8064960 msgr2=0x7f97b8064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- 172.21.2.137:0/4144962077 shutdown_connections 2021-11-15T19:26:57.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 -- 172.21.2.137:0/4144962077 wait complete. 2021-11-15T19:26:57.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.962+0000 7f97bfb63700 1 Processor -- start 2021-11-15T19:26:57.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- start start 2021-11-15T19:26:57.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97a0005070 0x7f97b814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97b81249b0 0x7f97b8153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97b8153b60 0x7f97b8129770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b80b20c0 con 0x7f97a0005070 2021-11-15T19:26:57.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8150020 con 0x7f97b8153b60 2021-11-15T19:26:57.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8153210 con 0x7f97b81249b0 2021-11-15T19:26:57.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97b8153b60 0x7f97b8129770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97b8153b60 0x7f97b8129770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59556/0 (socket says 172.21.2.137:59556) 2021-11-15T19:26:57.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 -- 172.21.2.137:0/2933721621 learned_addr learned my addr 172.21.2.137:0/2933721621 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:57.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 -- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97b81249b0 msgr2=0x7f97b8153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97b81249b0 0x7f97b8153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 -- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97a0005070 msgr2=0x7f97b814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97a0005070 0x7f97b814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:57.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 -- 172.21.2.137:0/2933721621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8126520 con 0x7f97b8153b60 2021-11-15T19:26:57.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97be100700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97b8153b60 0x7f97b8129770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f97b00012f0 tx=0x7f97b0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b0014860 con 0x7f97b8153b60 2021-11-15T19:26:57.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b00149c0 con 0x7f97b8153b60 2021-11-15T19:26:57.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8144bb0 con 0x7f97b8153b60 2021-11-15T19:26:57.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b0014d20 con 0x7f97b8153b60 2021-11-15T19:26:57.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b8124e30 con 0x7f97b8153b60 2021-11-15T19:26:57.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97b80b14b0 con 0x7f97b8153b60 2021-11-15T19:26:57.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97b0010070 con 0x7f97b8153b60 2021-11-15T19:26:57.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97980536d0 0x7f9798055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f97b006c5c0 con 0x7f97b8153b60 2021-11-15T19:26:57.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7f979805aac0 0x7f979805cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:57.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 --> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f979805d4a0 con 0x7f979805aac0 2021-11-15T19:26:57.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97b006ec50 con 0x7f97b8153b60 2021-11-15T19:26:57.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bd0fe700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7f979805aac0 0x7f979805cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bd0fe700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7f979805aac0 0x7f979805cee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97bd8ff700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97980536d0 0x7f9798055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:57.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.966+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== osd.3 v2:172.21.2.137:6824/14753 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f979805d4a0 con 0x7f979805aac0 2021-11-15T19:26:57.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.970+0000 7f97bd8ff700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97980536d0 0x7f9798055b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f97ac001020 tx=0x7f97ac001580).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:57.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 --> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97b81533d0 con 0x7f979805aac0 2021-11-15T19:26:57.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97aaffd700 1 -- 172.21.2.137:0/2933721621 <== osd.3 v2:172.21.2.137:6824/14753 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f97b4009650 con 0x7f979805aac0 2021-11-15T19:26:57.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7f979805aac0 msgr2=0x7f979805cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7f979805aac0 0x7f979805cee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:57.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97980536d0 msgr2=0x7f9798055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97980536d0 0x7f9798055b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f97ac001020 tx=0x7f97ac001580).stop 2021-11-15T19:26:57.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97b8153b60 msgr2=0x7f97b8129770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:57.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 --2- 172.21.2.137:0/2933721621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97b8153b60 0x7f97b8129770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f97b00012f0 tx=0x7f97b0016000).stop 2021-11-15T19:26:57.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97be100700 1 -- 172.21.2.137:0/2933721621 reap_dead start 2021-11-15T19:26:57.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 shutdown_connections 2021-11-15T19:26:57.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 >> 172.21.2.137:0/2933721621 conn(0x7f97b8064960 msgr2=0x7f97b8140940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:57.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 shutdown_connections 2021-11-15T19:26:57.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:57.974+0000 7f97bfb63700 1 -- 172.21.2.137:0/2933721621 wait complete. 2021-11-15T19:26:57.996 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:26:57.996 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-11-15T19:26:58.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.038+0000 7f184a274700 1 Processor -- start 2021-11-15T19:26:58.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.038+0000 7f184a274700 1 -- start start 2021-11-15T19:26:58.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440acd60 0x7f18440b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f18440b4680 0x7f18441290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18440b76c0 con 0x7f18440b72e0 2021-11-15T19:26:58.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18440b3100 con 0x7f18440b4680 2021-11-15T19:26:58.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440b20c0 con 0x7f18440acd60 2021-11-15T19:26:58.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f18437fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440acd60 0x7f18440b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1848811700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f18440b4680 0x7f18441290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1843fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f18440b72e0 0x7f18440b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:42606/0 (socket says 172.21.2.137:42606) 2021-11-15T19:26:58.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f18437fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440acd60 0x7f18440b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:32902/0 (socket says 172.21.2.137:32902) 2021-11-15T19:26:58.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1843fff700 1 -- 172.21.2.137:0/2180269184 learned_addr learned my addr 172.21.2.137:0/2180269184 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:58.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1848811700 1 -- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440acd60 msgr2=0x7f18440b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1848811700 1 --2- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440acd60 0x7f18440b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1848811700 1 -- 172.21.2.137:0/2180269184 >> v1:172.21.2.111:6789/0 conn(0x7f18440b72e0 legacy=0x7f18440b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1848811700 1 -- 172.21.2.137:0/2180269184 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184412a170 con 0x7f18440b4680 2021-11-15T19:26:58.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1848811700 1 --2- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440b4680 0x7f18441290c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f18440b7850 tx=0x7f183c0091d0).ready entity=mon.0 client_cookie=68860c4fcf0df0f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1842ffd700 1 -- 172.21.2.137:0/2180269184 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c00b680 con 0x7f18440b4680 2021-11-15T19:26:58.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1842ffd700 1 -- 172.21.2.137:0/2180269184 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00b7e0 con 0x7f18440b4680 2021-11-15T19:26:58.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f1842ffd700 1 -- 172.21.2.137:0/2180269184 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c00b950 con 0x7f18440b4680 2021-11-15T19:26:58.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440b4680 msgr2=0x7f18441290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 --2- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440b4680 0x7f18441290c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f18440b7850 tx=0x7f183c0091d0).stop 2021-11-15T19:26:58.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- 172.21.2.137:0/2180269184 shutdown_connections 2021-11-15T19:26:58.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 --2- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440b4680 0x7f18441290c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 --2- 172.21.2.137:0/2180269184 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440acd60 0x7f18440b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- 172.21.2.137:0/2180269184 >> 172.21.2.137:0/2180269184 conn(0x7f1844064960 msgr2=0x7f1844064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- 172.21.2.137:0/2180269184 shutdown_connections 2021-11-15T19:26:58.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.042+0000 7f184a274700 1 -- 172.21.2.137:0/2180269184 wait complete. 2021-11-15T19:26:58.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 Processor -- start 2021-11-15T19:26:58.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- start start 2021-11-15T19:26:58.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440acd60 0x7f1844062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440b4680 0x7f18440aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18440b72e0 0x7f1844155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440ae710 con 0x7f18440acd60 2021-11-15T19:26:58.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440ae470 con 0x7f18440b72e0 2021-11-15T19:26:58.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440af340 con 0x7f18440b4680 2021-11-15T19:26:58.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18440b72e0 0x7f1844155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18440b72e0 0x7f1844155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59572/0 (socket says 172.21.2.137:59572) 2021-11-15T19:26:58.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 -- 172.21.2.137:0/4158738762 learned_addr learned my addr 172.21.2.137:0/4158738762 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 -- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440b4680 msgr2=0x7f18440aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18440b4680 0x7f18440aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 -- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440acd60 msgr2=0x7f1844062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1843fff700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440acd60 0x7f1844062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440acd60 0x7f1844062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 -- 172.21.2.137:0/4158738762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c009470 con 0x7f18440b72e0 2021-11-15T19:26:58.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1843fff700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18440acd60 0x7f1844062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:58.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1848811700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18440b72e0 0x7f1844155710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f18440b7850 tx=0x7f183c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c021440 con 0x7f18440b72e0 2021-11-15T19:26:58.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0215a0 con 0x7f18440b72e0 2021-11-15T19:26:58.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c021900 con 0x7f18440b72e0 2021-11-15T19:26:58.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440af5e0 con 0x7f18440b72e0 2021-11-15T19:26:58.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18441433b0 con 0x7f18440b72e0 2021-11-15T19:26:58.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18440b3a50 con 0x7f18440b72e0 2021-11-15T19:26:58.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f183c027020 con 0x7f18440b72e0 2021-11-15T19:26:58.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1828053610 0x7f1828055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f183c06cdd0 con 0x7f18440b72e0 2021-11-15T19:26:58.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f182805aa00 0x7f182805ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 --> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f182805d3e0 con 0x7f182805aa00 2021-11-15T19:26:58.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f183c06f460 con 0x7f18440b72e0 2021-11-15T19:26:58.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f18437fe700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f182805aa00 0x7f182805ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.046+0000 7f1843fff700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1828053610 0x7f1828055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.050+0000 7f18437fe700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f182805aa00 0x7f182805ce20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.050+0000 7f1843fff700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1828053610 0x7f1828055ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f182c008000 tx=0x7f182c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.050+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== osd.4 v2:172.21.2.111:6800/14921 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f182805d3e0 con 0x7f182805aa00 2021-11-15T19:26:58.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.058+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 --> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18440573d0 con 0x7f182805aa00 2021-11-15T19:26:58.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f18417fa700 1 -- 172.21.2.137:0/4158738762 <== osd.4 v2:172.21.2.111:6800/14921 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1834000e90 con 0x7f182805aa00 2021-11-15T19:26:58.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f182805aa00 msgr2=0x7f182805ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f182805aa00 0x7f182805ce20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1828053610 msgr2=0x7f1828055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1828053610 0x7f1828055ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f182c008000 tx=0x7f182c009040).stop 2021-11-15T19:26:58.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18440b72e0 msgr2=0x7f1844155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 --2- 172.21.2.137:0/4158738762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18440b72e0 0x7f1844155710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f18440b7850 tx=0x7f183c016000).stop 2021-11-15T19:26:58.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f1848811700 1 -- 172.21.2.137:0/4158738762 reap_dead start 2021-11-15T19:26:58.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 shutdown_connections 2021-11-15T19:26:58.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 >> 172.21.2.137:0/4158738762 conn(0x7f1844064960 msgr2=0x7f1844122cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 shutdown_connections 2021-11-15T19:26:58.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.062+0000 7f184a274700 1 -- 172.21.2.137:0/4158738762 wait complete. 2021-11-15T19:26:58.076 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:26:58.077 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-11-15T19:26:58.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 Processor -- start 2021-11-15T19:26:58.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 -- start start 2021-11-15T19:26:58.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbcd0065730 0x7fbcd013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbcd0065b10 0x7fbcd013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd0066270 con 0x7fbcd00b00a0 2021-11-15T19:26:58.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd0067410 con 0x7fbcd0065b10 2021-11-15T19:26:58.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcd4f7b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd0065fd0 con 0x7fbcd0065730 2021-11-15T19:26:58.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbcd0065730 0x7fbcd013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbcd0065730 0x7fbcd013c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59578/0 (socket says 172.21.2.137:59578) 2021-11-15T19:26:58.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 -- 172.21.2.137:0/1100424319 learned_addr learned my addr 172.21.2.137:0/1100424319 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 -- 172.21.2.137:0/1100424319 >> v2:172.21.2.111:3300/0 conn(0x7fbcd0065b10 msgr2=0x7fbcd013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 --2- 172.21.2.137:0/1100424319 >> v2:172.21.2.111:3300/0 conn(0x7fbcd0065b10 0x7fbcd013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 -- 172.21.2.137:0/1100424319 >> v1:172.21.2.111:6789/0 conn(0x7fbcd00b00a0 legacy=0x7fbcd005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 -- 172.21.2.137:0/1100424319 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0066f70 con 0x7fbcd0065730 2021-11-15T19:26:58.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbcce59c700 1 --2- 172.21.2.137:0/1100424319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd013c2b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbcd013f060 tx=0x7fbcc0006eb0).ready entity=mon.1 client_cookie=48a239d7827f4fe5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbccd59a700 1 -- 172.21.2.137:0/1100424319 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc0010810 con 0x7fbcd0065730 2021-11-15T19:26:58.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbccd59a700 1 -- 172.21.2.137:0/1100424319 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0000e90 con 0x7fbcd0065730 2021-11-15T19:26:58.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.122+0000 7fbccd59a700 1 -- 172.21.2.137:0/1100424319 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc0010ba0 con 0x7fbcd0065730 2021-11-15T19:26:58.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/1100424319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 msgr2=0x7fbcd013c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 --2- 172.21.2.137:0/1100424319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd013c2b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbcd013f060 tx=0x7fbcc0006eb0).stop 2021-11-15T19:26:58.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/1100424319 shutdown_connections 2021-11-15T19:26:58.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 --2- 172.21.2.137:0/1100424319 >> v2:172.21.2.111:3300/0 conn(0x7fbcd0065b10 0x7fbcd013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 --2- 172.21.2.137:0/1100424319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd013c2b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/1100424319 >> 172.21.2.137:0/1100424319 conn(0x7fbcd0060290 msgr2=0x7fbcd0060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/1100424319 shutdown_connections 2021-11-15T19:26:58.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/1100424319 wait complete. 2021-11-15T19:26:58.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 Processor -- start 2021-11-15T19:26:58.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- start start 2021-11-15T19:26:58.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd00ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcd0065b10 0x7fbcd01415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbcd00b00a0 0x7fbcd0142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00acd60 con 0x7fbcd0065b10 2021-11-15T19:26:58.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00ae220 con 0x7fbcd0065730 2021-11-15T19:26:58.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00aed30 con 0x7fbcd00b00a0 2021-11-15T19:26:58.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd00ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd00ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59586/0 (socket says 172.21.2.137:59586) 2021-11-15T19:26:58.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 -- 172.21.2.137:0/614987438 learned_addr learned my addr 172.21.2.137:0/614987438 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbccdd9b700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcd0065b10 0x7fbcd01415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcced9d700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbcd00b00a0 0x7fbcd0142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 -- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbcd00b00a0 msgr2=0x7fbcd0142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbcd00b00a0 0x7fbcd0142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 -- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcd0065b10 msgr2=0x7fbcd01415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcd0065b10 0x7fbcd01415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 -- 172.21.2.137:0/614987438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc000c2f0 con 0x7fbcd0065730 2021-11-15T19:26:58.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcce59c700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd00ae840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbcd013f060 tx=0x7fbcc0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc001ab70 con 0x7fbcd0065730 2021-11-15T19:26:58.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000c030 con 0x7fbcd0065730 2021-11-15T19:26:58.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc0023440 con 0x7fbcd0065730 2021-11-15T19:26:58.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd0145f20 con 0x7fbcd0065730 2021-11-15T19:26:58.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd0141ad0 con 0x7fbcd0065730 2021-11-15T19:26:58.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbcd01427c0 con 0x7fbcd0065730 2021-11-15T19:26:58.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcc000e040 con 0x7fbcd0065730 2021-11-15T19:26:58.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbcb4053660 0x7fbcb4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbcc006d0e0 con 0x7fbcd0065730 2021-11-15T19:26:58.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fbcb405aad0 0x7fbcb405cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 --> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcb405d4b0 con 0x7fbcb405aad0 2021-11-15T19:26:58.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcc006f6f0 con 0x7fbcd0065730 2021-11-15T19:26:58.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbccdd9b700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbcb4053660 0x7fbcb4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.126+0000 7fbcced9d700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fbcb405aad0 0x7fbcb405cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.130+0000 7fbccdd9b700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbcb4053660 0x7fbcb4055b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbcb800c000 tx=0x7fbcb8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.130+0000 7fbcced9d700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fbcb405aad0 0x7fbcb405cef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.130+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== osd.5 v2:172.21.2.111:6808/14922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fbcb405d4b0 con 0x7fbcb405aad0 2021-11-15T19:26:58.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 --> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbcd013cc90 con 0x7fbcb405aad0 2021-11-15T19:26:58.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcc77fe700 1 -- 172.21.2.137:0/614987438 <== osd.5 v2:172.21.2.111:6808/14922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbcd013cc90 con 0x7fbcb405aad0 2021-11-15T19:26:58.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fbcb405aad0 msgr2=0x7fbcb405cef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fbcb405aad0 0x7fbcb405cef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbcb4053660 msgr2=0x7fbcb4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbcb4053660 0x7fbcb4055b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbcb800c000 tx=0x7fbcb8008040).stop 2021-11-15T19:26:58.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 msgr2=0x7fbcd00ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 --2- 172.21.2.137:0/614987438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcd0065730 0x7fbcd00ae840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbcd013f060 tx=0x7fbcc0017000).stop 2021-11-15T19:26:58.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcced9d700 1 -- 172.21.2.137:0/614987438 reap_dead start 2021-11-15T19:26:58.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 shutdown_connections 2021-11-15T19:26:58.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 >> 172.21.2.137:0/614987438 conn(0x7fbcd0060290 msgr2=0x7fbcd00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 shutdown_connections 2021-11-15T19:26:58.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.138+0000 7fbcd4f7b700 1 -- 172.21.2.137:0/614987438 wait complete. 2021-11-15T19:26:58.155 INFO:teuthology.orchestra.run.gibba037.stdout:55834574854 2021-11-15T19:26:58.155 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-11-15T19:26:58.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 Processor -- start 2021-11-15T19:26:58.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 -- start start 2021-11-15T19:26:58.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f608c0afde0 0x7f608c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f608c13f5c0 0x7f608c13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c0aedf0 con 0x7f608c0b0fe0 2021-11-15T19:26:58.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0ae070 con 0x7f608c13f5c0 2021-11-15T19:26:58.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f609370a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0afbd0 con 0x7f608c0afde0 2021-11-15T19:26:58.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f60914a6700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f608c0b0fe0 0x7f608c0af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50144/0 (socket says 172.21.2.137:50144) 2021-11-15T19:26:58.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f60914a6700 1 -- 172.21.2.137:0/896303290 learned_addr learned my addr 172.21.2.137:0/896303290 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:58.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f6090ca5700 1 --2- 172.21.2.137:0/896303290 >> v2:172.21.2.137:3300/0 conn(0x7f608c0afde0 0x7f608c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f6090ca5700 1 -- 172.21.2.137:0/896303290 >> v2:172.21.2.111:3300/0 conn(0x7f608c13f5c0 msgr2=0x7f608c13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f6090ca5700 1 --2- 172.21.2.137:0/896303290 >> v2:172.21.2.111:3300/0 conn(0x7f608c13f5c0 0x7f608c13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f6090ca5700 1 -- 172.21.2.137:0/896303290 >> v1:172.21.2.137:6789/0 conn(0x7f608c0b0fe0 legacy=0x7f608c0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f6090ca5700 1 -- 172.21.2.137:0/896303290 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0b13c0 con 0x7f608c0afde0 2021-11-15T19:26:58.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f6090ca5700 1 --2- 172.21.2.137:0/896303290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c0acff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f608c0ad960 tx=0x7f6080006df0).ready entity=mon.1 client_cookie=4a11d0bb06f759a1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f607ffff700 1 -- 172.21.2.137:0/896303290 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608000d5c0 con 0x7f608c0afde0 2021-11-15T19:26:58.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f607ffff700 1 -- 172.21.2.137:0/896303290 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080000e90 con 0x7f608c0afde0 2021-11-15T19:26:58.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.198+0000 7f607ffff700 1 -- 172.21.2.137:0/896303290 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608000d910 con 0x7f608c0afde0 2021-11-15T19:26:58.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/896303290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 msgr2=0x7f608c0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 --2- 172.21.2.137:0/896303290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c0acff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f608c0ad960 tx=0x7f6080006df0).stop 2021-11-15T19:26:58.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/896303290 shutdown_connections 2021-11-15T19:26:58.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 --2- 172.21.2.137:0/896303290 >> v2:172.21.2.111:3300/0 conn(0x7f608c13f5c0 0x7f608c13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 --2- 172.21.2.137:0/896303290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c0acff0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/896303290 >> 172.21.2.137:0/896303290 conn(0x7f608c0b5f50 msgr2=0x7f608c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/896303290 shutdown_connections 2021-11-15T19:26:58.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/896303290 wait complete. 2021-11-15T19:26:58.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 Processor -- start 2021-11-15T19:26:58.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- start start 2021-11-15T19:26:58.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c1122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f608c0b0fe0 0x7f608c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f608c13f5c0 0x7f608c13d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c1562f0 con 0x7f608c13f5c0 2021-11-15T19:26:58.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c112de0 con 0x7f608c0afde0 2021-11-15T19:26:58.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c067340 con 0x7f608c0b0fe0 2021-11-15T19:26:58.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c1122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c1122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59602/0 (socket says 172.21.2.137:59602) 2021-11-15T19:26:58.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 -- 172.21.2.137:0/1355500028 learned_addr learned my addr 172.21.2.137:0/1355500028 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 -- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f608c0b0fe0 msgr2=0x7f608c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f608c0b0fe0 0x7f608c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 -- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f608c13f5c0 msgr2=0x7f608c13d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f6091ca7700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f608c13f5c0 0x7f608c13d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f608c13f5c0 0x7f608c13d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 -- 172.21.2.137:0/1355500028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608000b180 con 0x7f608c0afde0 2021-11-15T19:26:58.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f60914a6700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c1122c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f608c0aec90 tx=0x7f6088007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608800ce30 con 0x7f608c0afde0 2021-11-15T19:26:58.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60880072e0 con 0x7f608c0afde0 2021-11-15T19:26:58.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6088005800 con 0x7f608c0afde0 2021-11-15T19:26:58.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c0675e0 con 0x7f608c0afde0 2021-11-15T19:26:58.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c15a740 con 0x7f608c0afde0 2021-11-15T19:26:58.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f608c10f2e0 con 0x7f608c0afde0 2021-11-15T19:26:58.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6088010070 con 0x7f608c0afde0 2021-11-15T19:26:58.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f606c0536f0 0x7f606c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f608806b870 con 0x7f608c0afde0 2021-11-15T19:26:58.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f606c05abe0 0x7f606c05d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 --> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f606c05d5c0 con 0x7f606c05abe0 2021-11-15T19:26:58.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.202+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f608806bb80 con 0x7f608c0afde0 2021-11-15T19:26:58.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.206+0000 7f6090ca5700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f606c0536f0 0x7f606c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.206+0000 7f6091ca7700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f606c05abe0 0x7f606c05d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.206+0000 7f6091ca7700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f606c05abe0 0x7f606c05d000 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.206+0000 7f6090ca5700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f606c0536f0 0x7f606c055bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f608c0ad960 tx=0x7f6080012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.206+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== osd.6 v2:172.21.2.111:6816/14923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f606c05d5c0 con 0x7f606c05abe0 2021-11-15T19:26:58.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.214+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 --> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f608c112b40 con 0x7f606c05abe0 2021-11-15T19:26:58.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f607e7fc700 1 -- 172.21.2.137:0/1355500028 <== osd.6 v2:172.21.2.111:6816/14923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f608400a4a0 con 0x7f606c05abe0 2021-11-15T19:26:58.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f606c05abe0 msgr2=0x7f606c05d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f606c05abe0 0x7f606c05d000 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f606c0536f0 msgr2=0x7f606c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f606c0536f0 0x7f606c055bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f608c0ad960 tx=0x7f6080012000).stop 2021-11-15T19:26:58.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 msgr2=0x7f608c1122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 --2- 172.21.2.137:0/1355500028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f608c0afde0 0x7f608c1122c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f608c0aec90 tx=0x7f6088007c40).stop 2021-11-15T19:26:58.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f6091ca7700 1 -- 172.21.2.137:0/1355500028 reap_dead start 2021-11-15T19:26:58.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 shutdown_connections 2021-11-15T19:26:58.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 >> 172.21.2.137:0/1355500028 conn(0x7f608c0b5f50 msgr2=0x7f608c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 shutdown_connections 2021-11-15T19:26:58.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.218+0000 7f609370a700 1 -- 172.21.2.137:0/1355500028 wait complete. 2021-11-15T19:26:58.233 INFO:teuthology.orchestra.run.gibba037.stdout:55834574852 2021-11-15T19:26:58.233 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-11-15T19:26:58.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 Processor -- start 2021-11-15T19:26:58.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- start start 2021-11-15T19:26:58.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9a100b2400 0x7f9a100b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10146c20 con 0x7f9a100b3e70 2021-11-15T19:26:58.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10142af0 con 0x7f9a100b5330 2021-11-15T19:26:58.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100b27e0 con 0x7f9a100b2400 2021-11-15T19:26:58.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0e7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9a100b5330 0x7f9a100b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50160/0 (socket says 172.21.2.137:50160) 2021-11-15T19:26:58.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0e7fc700 1 -- 172.21.2.137:0/2522198731 learned_addr learned my addr 172.21.2.137:0/2522198731 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:26:58.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507318558 0 0) 0x7f9a00001110 con 0x7f9a100b5330 2021-11-15T19:26:58.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f0003260 con 0x7f9a100b5330 2021-11-15T19:26:58.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 781211956 0 0) 0x7f99f0003260 con 0x7f9a100b5330 2021-11-15T19:26:58.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 >> v2:172.21.2.111:3300/0 conn(0x7f9a100b2400 msgr2=0x7f9a100b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 --2- 172.21.2.137:0/2522198731 >> v2:172.21.2.111:3300/0 conn(0x7f9a100b2400 0x7f9a100b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 >> v1:172.21.2.111:6789/0 conn(0x7f9a100b3e70 legacy=0x7f9a100b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100b4d80 con 0x7f9a100b5330 2021-11-15T19:26:58.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9a000017f0 con 0x7f9a100b5330 2021-11-15T19:26:58.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 >> v1:172.21.2.137:6789/0 conn(0x7f9a100b5330 legacy=0x7f9a100b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99f0003820 0x7f99f0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99f0004500 0x7f99f0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99f0005050 0x7f99f000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100b27e0 con 0x7f99f0004500 2021-11-15T19:26:58.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000bf40 con 0x7f99f0003820 2021-11-15T19:26:58.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000c100 con 0x7f99f0005050 2021-11-15T19:26:58.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99f0003820 0x7f99f0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 -- 172.21.2.137:0/2522198731 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99f0005050 msgr2=0x7f99f000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99f0005050 0x7f99f000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 -- 172.21.2.137:0/2522198731 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99f0004500 msgr2=0x7f99f0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99f0004500 0x7f99f0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 -- 172.21.2.137:0/2522198731 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0003260 con 0x7f99f0003820 2021-11-15T19:26:58.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/2522198731 reap_dead start 2021-11-15T19:26:58.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0effd700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99f0003820 0x7f99f0003c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f99f8002f70 tx=0x7f99f8006ca0).ready entity=mon.1 client_cookie=b2dad3ca2da45b0a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f8013410 con 0x7f99f0003820 2021-11-15T19:26:58.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8013570 con 0x7f99f0003820 2021-11-15T19:26:58.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a0dffb700 1 -- 172.21.2.137:0/2522198731 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f80138d0 con 0x7f99f0003820 2021-11-15T19:26:58.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- 172.21.2.137:0/2522198731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99f0003820 msgr2=0x7f99f0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99f0003820 0x7f99f0003c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f99f8002f70 tx=0x7f99f8006ca0).stop 2021-11-15T19:26:58.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- 172.21.2.137:0/2522198731 shutdown_connections 2021-11-15T19:26:58.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 --2- 172.21.2.137:0/2522198731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99f0003820 0x7f99f0003c20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- 172.21.2.137:0/2522198731 >> 172.21.2.137:0/2522198731 conn(0x7f9a100623a0 msgr2=0x7f9a10062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- 172.21.2.137:0/2522198731 shutdown_connections 2021-11-15T19:26:58.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.278+0000 7f9a15291700 1 -- 172.21.2.137:0/2522198731 wait complete. 2021-11-15T19:26:58.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 Processor -- start 2021-11-15T19:26:58.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- start start 2021-11-15T19:26:58.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99f0003820 0x7f9a1005c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100af0b0 0x7f9a10112d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a10113270 0x7f9a10114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101529d0 con 0x7f9a100af0b0 2021-11-15T19:26:58.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10152c70 con 0x7f9a10113270 2021-11-15T19:26:58.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1005c7e0 con 0x7f99f0003820 2021-11-15T19:26:58.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a10113270 0x7f9a10114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a10113270 0x7f9a10114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59620/0 (socket says 172.21.2.137:59620) 2021-11-15T19:26:58.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1277909833 learned_addr learned my addr 172.21.2.137:0/1277909833 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99f0003820 msgr2=0x7f9a1005c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99f0003820 0x7f9a1005c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0e7fc700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100af0b0 0x7f9a10112d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100af0b0 msgr2=0x7f9a10112d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100af0b0 0x7f9a10112d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1277909833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100aea20 con 0x7f9a10113270 2021-11-15T19:26:58.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a10113270 0x7f9a10114090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9a000012a0 tx=0x7f9a08007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a08004850 con 0x7f9a10113270 2021-11-15T19:26:58.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a080049b0 con 0x7f9a10113270 2021-11-15T19:26:58.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a08004d50 con 0x7f9a10113270 2021-11-15T19:26:58.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100af680 con 0x7f9a10113270 2021-11-15T19:26:58.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10114580 con 0x7f9a10113270 2021-11-15T19:26:58.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a100aebb0 con 0x7f9a10113270 2021-11-15T19:26:58.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a0801b070 con 0x7f9a10113270 2021-11-15T19:26:58.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053690 0x7f99f4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9a0806ad70 con 0x7f9a10113270 2021-11-15T19:26:58.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7f99f405ab80 0x7f99f405cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 --> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99f405d560 con 0x7f99f405ab80 2021-11-15T19:26:58.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a0806d330 con 0x7f9a10113270 2021-11-15T19:26:58.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0e7fc700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7f99f405ab80 0x7f99f405cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.282+0000 7f9a0effd700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053690 0x7f99f4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.286+0000 7f9a0e7fc700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7f99f405ab80 0x7f99f405cfa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.286+0000 7f9a0effd700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053690 0x7f99f4055b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f99f8002f70 tx=0x7f99f8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.286+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== osd.7 v2:172.21.2.111:6824/14924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f99f405d560 con 0x7f99f405ab80 2021-11-15T19:26:58.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.294+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 --> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a100af810 con 0x7f99f405ab80 2021-11-15T19:26:58.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.294+0000 7f9a07fff700 1 -- 172.21.2.137:0/1277909833 <== osd.7 v2:172.21.2.111:6824/14924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a100af810 con 0x7f99f405ab80 2021-11-15T19:26:58.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.294+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7f99f405ab80 msgr2=0x7f99f405cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.294+0000 7f9a15291700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7f99f405ab80 0x7f99f405cfa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.294+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053690 msgr2=0x7f99f4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.294+0000 7f9a15291700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053690 0x7f99f4055b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f99f8002f70 tx=0x7f99f8014000).stop 2021-11-15T19:26:58.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a10113270 msgr2=0x7f9a10114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a15291700 1 --2- 172.21.2.137:0/1277909833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a10113270 0x7f9a10114090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9a000012a0 tx=0x7f9a08007e50).stop 2021-11-15T19:26:58.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1277909833 reap_dead start 2021-11-15T19:26:58.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 shutdown_connections 2021-11-15T19:26:58.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 >> 172.21.2.137:0/1277909833 conn(0x7f9a100623a0 msgr2=0x7f9a100b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 shutdown_connections 2021-11-15T19:26:58.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.298+0000 7f9a15291700 1 -- 172.21.2.137:0/1277909833 wait complete. 2021-11-15T19:26:58.312 INFO:teuthology.orchestra.run.gibba037.stdout:55834574854 2021-11-15T19:26:58.313 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-15T19:26:58.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 Processor -- start 2021-11-15T19:26:58.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 -- start start 2021-11-15T19:26:58.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80b0fe0 0x7f14f80afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14f813f5c0 0x7f14f813fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f80aedf0 con 0x7f14f80acff0 2021-11-15T19:26:58.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f80ae070 con 0x7f14f813f5c0 2021-11-15T19:26:58.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14feaf0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f80ad470 con 0x7f14f80b0fe0 2021-11-15T19:26:58.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14f813f5c0 0x7f14f813fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14f813f5c0 0x7f14f813fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59632/0 (socket says 172.21.2.137:59632) 2021-11-15T19:26:58.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 -- 172.21.2.137:0/3892872552 learned_addr learned my addr 172.21.2.137:0/3892872552 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 -- 172.21.2.137:0/3892872552 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80b0fe0 msgr2=0x7f14f80afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 --2- 172.21.2.137:0/3892872552 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80b0fe0 0x7f14f80afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 -- 172.21.2.137:0/3892872552 >> v1:172.21.2.111:6789/0 conn(0x7f14f80acff0 legacy=0x7f14f80af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:26:58.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.354+0000 7f14fd08d700 1 -- 172.21.2.137:0/3892872552 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f80afbd0 con 0x7f14f813f5c0 2021-11-15T19:26:58.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 --2- 172.21.2.137:0/3892872552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f813fa00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f14f80685f0 tx=0x7f14f0009290).ready entity=mon.1 client_cookie=2e2acdab3f9ea715 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f77fe700 1 -- 172.21.2.137:0/3892872552 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f000b860 con 0x7f14f813f5c0 2021-11-15T19:26:58.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f77fe700 1 -- 172.21.2.137:0/3892872552 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f000b9c0 con 0x7f14f813f5c0 2021-11-15T19:26:58.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f77fe700 1 -- 172.21.2.137:0/3892872552 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f000bb70 con 0x7f14f813f5c0 2021-11-15T19:26:58.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/3892872552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 msgr2=0x7f14f813fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 --2- 172.21.2.137:0/3892872552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f813fa00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f14f80685f0 tx=0x7f14f0009290).stop 2021-11-15T19:26:58.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/3892872552 shutdown_connections 2021-11-15T19:26:58.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 --2- 172.21.2.137:0/3892872552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f813fa00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 --2- 172.21.2.137:0/3892872552 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80b0fe0 0x7f14f80afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/3892872552 >> 172.21.2.137:0/3892872552 conn(0x7f14f80b5f50 msgr2=0x7f14f80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/3892872552 shutdown_connections 2021-11-15T19:26:58.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/3892872552 wait complete. 2021-11-15T19:26:58.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 Processor -- start 2021-11-15T19:26:58.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- start start 2021-11-15T19:26:58.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80acff0 0x7f14f8133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14f80b0fe0 0x7f14f80b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f812e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8064460 con 0x7f14f80b0fe0 2021-11-15T19:26:58.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8064700 con 0x7f14f813f5c0 2021-11-15T19:26:58.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8065a20 con 0x7f14f80acff0 2021-11-15T19:26:58.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f812e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f812e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59638/0 (socket says 172.21.2.137:59638) 2021-11-15T19:26:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 -- 172.21.2.137:0/1254305281 learned_addr learned my addr 172.21.2.137:0/1254305281 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 -- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80acff0 msgr2=0x7f14f8133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80acff0 0x7f14f8133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 -- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14f80b0fe0 msgr2=0x7f14f80b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14f80b0fe0 0x7f14f80b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 -- 172.21.2.137:0/1254305281 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f0009530 con 0x7f14f813f5c0 2021-11-15T19:26:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14fd08d700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f812e460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f14f80685f0 tx=0x7f14f0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f000bb30 con 0x7f14f813f5c0 2021-11-15T19:26:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f0020430 con 0x7f14f813f5c0 2021-11-15T19:26:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f0020790 con 0x7f14f813f5c0 2021-11-15T19:26:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f8142f90 con 0x7f14f813f5c0 2021-11-15T19:26:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f813ed70 con 0x7f14f813f5c0 2021-11-15T19:26:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f8065be0 con 0x7f14f813f5c0 2021-11-15T19:26:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14f0026020 con 0x7f14f813f5c0 2021-11-15T19:26:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f5ffb700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14dc053610 0x7f14dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.358+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f14f006c8a0 con 0x7f14f813f5c0 2021-11-15T19:26:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.362+0000 7f14fc88c700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14dc053610 0x7f14dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.362+0000 7f14fc88c700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14dc053610 0x7f14dc055ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f14e8002f70 tx=0x7f14e8006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.362+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14f00439b0 con 0x7f14f813f5c0 2021-11-15T19:26:58.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f14f80ad690 con 0x7f14f813f5c0 2021-11-15T19:26:58.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14f5ffb700 1 -- 172.21.2.137:0/1254305281 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14f0015020 con 0x7f14f813f5c0 2021-11-15T19:26:58.456 INFO:teuthology.orchestra.run.gibba037.stdout:55834574852 2021-11-15T19:26:58.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14dc053610 msgr2=0x7f14dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14dc053610 0x7f14dc055ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f14e8002f70 tx=0x7f14e8006a80).stop 2021-11-15T19:26:58.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 msgr2=0x7f14f812e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:58.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f812e460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f14f80685f0 tx=0x7f14f0016000).stop 2021-11-15T19:26:58.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 shutdown_connections 2021-11-15T19:26:58.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14dc053610 0x7f14dc055ad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14f813f5c0 0x7f14f812e460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:58.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14f80b0fe0 0x7f14f80b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 --2- 172.21.2.137:0/1254305281 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14f80acff0 0x7f14f8133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:58.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 >> 172.21.2.137:0/1254305281 conn(0x7f14f80b5f50 msgr2=0x7f14f8137cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:58.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 shutdown_connections 2021-11-15T19:26:58.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:58.446+0000 7f14feaf0700 1 -- 172.21.2.137:0/1254305281 wait complete. 2021-11-15T19:26:58.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2021-11-15T19:26:59.464 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-15T19:26:59.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 Processor -- start 2021-11-15T19:26:59.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- start start 2021-11-15T19:26:59.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42805c770 0x7ff4280aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff4280b0550 0x7ff42814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff42814aaa0 0x7ff428140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280b1650 con 0x7ff42814aaa0 2021-11-15T19:26:59.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42805cb50 con 0x7ff4280b0550 2021-11-15T19:26:59.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280ad030 con 0x7ff42805c770 2021-11-15T19:26:59.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff4280b0550 0x7ff42814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:59.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff4280b0550 0x7ff42814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59642/0 (socket says 172.21.2.137:59642) 2021-11-15T19:26:59.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 -- 172.21.2.137:0/3644178454 learned_addr learned my addr 172.21.2.137:0/3644178454 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:59.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 -- 172.21.2.137:0/3644178454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42805c770 msgr2=0x7ff4280aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:59.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 --2- 172.21.2.137:0/3644178454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42805c770 0x7ff4280aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:59.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 -- 172.21.2.137:0/3644178454 >> v2:172.21.2.111:3300/0 conn(0x7ff42814aaa0 msgr2=0x7ff428140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:26:59.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 --2- 172.21.2.137:0/3644178454 >> v2:172.21.2.111:3300/0 conn(0x7ff42814aaa0 0x7ff428140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:59.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 -- 172.21.2.137:0/3644178454 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280ad2d0 con 0x7ff4280b0550 2021-11-15T19:26:59.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff427fff700 1 --2- 172.21.2.137:0/3644178454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4280b0550 0x7ff42814a5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff41c002f70 tx=0x7ff41c006eb0).ready entity=mon.1 client_cookie=86eabbde9dff7fc0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:59.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff4277fe700 1 -- 172.21.2.137:0/3644178454 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41c00d570 con 0x7ff4280b0550 2021-11-15T19:26:59.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff4277fe700 1 -- 172.21.2.137:0/3644178454 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c000e90 con 0x7ff4280b0550 2021-11-15T19:26:59.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff4277fe700 1 -- 172.21.2.137:0/3644178454 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41c00d900 con 0x7ff4280b0550 2021-11-15T19:26:59.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- 172.21.2.137:0/3644178454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4280b0550 msgr2=0x7ff42814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:59.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/3644178454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4280b0550 0x7ff42814a5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff41c002f70 tx=0x7ff41c006eb0).stop 2021-11-15T19:26:59.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- 172.21.2.137:0/3644178454 shutdown_connections 2021-11-15T19:26:59.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/3644178454 >> v2:172.21.2.111:3300/0 conn(0x7ff42814aaa0 0x7ff428140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:59.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/3644178454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4280b0550 0x7ff42814a5b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:59.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/3644178454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42805c770 0x7ff4280aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:59.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- 172.21.2.137:0/3644178454 >> 172.21.2.137:0/3644178454 conn(0x7ff4280631e0 msgr2=0x7ff42805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:59.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- 172.21.2.137:0/3644178454 shutdown_connections 2021-11-15T19:26:59.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.510+0000 7ff42ee1e700 1 -- 172.21.2.137:0/3644178454 wait complete. 2021-11-15T19:26:59.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 Processor -- start 2021-11-15T19:26:59.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- start start 2021-11-15T19:26:59.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 0x7ff428147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4280b0550 0x7ff428157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42814aaa0 0x7ff428066350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428156930 con 0x7ff4280b0550 2021-11-15T19:26:59.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428156bd0 con 0x7ff42805c770 2021-11-15T19:26:59.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff428156e70 con 0x7ff42814aaa0 2021-11-15T19:26:59.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 0x7ff428147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:59.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 0x7ff428147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59650/0 (socket says 172.21.2.137:59650) 2021-11-15T19:26:59.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 -- 172.21.2.137:0/2255403277 learned_addr learned my addr 172.21.2.137:0/2255403277 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:26:59.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 -- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42814aaa0 msgr2=0x7ff428066350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:59.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42814aaa0 0x7ff428066350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:59.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff427fff700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4280b0550 0x7ff428157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:59.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 -- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4280b0550 msgr2=0x7ff428157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:59.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4280b0550 0x7ff428157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:59.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 -- 172.21.2.137:0/2255403277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c00b1e0 con 0x7ff42805c770 2021-11-15T19:26:59.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff427fff700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4280b0550 0x7ff428157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:26:59.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42cbba700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 0x7ff428147650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff418002ef0 tx=0x7ff418006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:59.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff418012410 con 0x7ff42805c770 2021-11-15T19:26:59.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418012570 con 0x7ff42805c770 2021-11-15T19:26:59.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4180128d0 con 0x7ff42805c770 2021-11-15T19:26:59.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff428157800 con 0x7ff42805c770 2021-11-15T19:26:59.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4280645c0 con 0x7ff42805c770 2021-11-15T19:26:59.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428064e90 con 0x7ff42805c770 2021-11-15T19:26:59.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff41800f030 con 0x7ff42805c770 2021-11-15T19:26:59.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff425ffb700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4080536d0 0x7ff408055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:26:59.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff41806b710 con 0x7ff42805c770 2021-11-15T19:26:59.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.514+0000 7ff427fff700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4080536d0 0x7ff408055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:26:59.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.518+0000 7ff427fff700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4080536d0 0x7ff408055b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff41c017000 tx=0x7ff41c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:26:59.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.518+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff428064e90 con 0x7ff42805c770 2021-11-15T19:26:59.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.598+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff428064e90 con 0x7ff42805c770 2021-11-15T19:26:59.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff425ffb700 1 -- 172.21.2.137:0/2255403277 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff428064e90 con 0x7ff42805c770 2021-11-15T19:26:59.610 INFO:teuthology.orchestra.run.gibba037.stdout:55834574852 2021-11-15T19:26:59.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4080536d0 msgr2=0x7ff408055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4080536d0 0x7ff408055b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff41c017000 tx=0x7ff41c015000).stop 2021-11-15T19:26:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 msgr2=0x7ff428147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:26:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 0x7ff428147650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff418002ef0 tx=0x7ff418006d50).stop 2021-11-15T19:26:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 shutdown_connections 2021-11-15T19:26:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4080536d0 0x7ff408055b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff42814aaa0 0x7ff428066350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:26:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4280b0550 0x7ff428157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 --2- 172.21.2.137:0/2255403277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff42805c770 0x7ff428147650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:26:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 >> 172.21.2.137:0/2255403277 conn(0x7ff4280631e0 msgr2=0x7ff4280b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:26:59.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 shutdown_connections 2021-11-15T19:26:59.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:26:59.602+0000 7ff42ee1e700 1 -- 172.21.2.137:0/2255403277 wait complete. 2021-11-15T19:26:59.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2021-11-15T19:27:00.618 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-15T19:27:00.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a42911700 1 Processor -- start 2021-11-15T19:27:00.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a42911700 1 -- start start 2021-11-15T19:27:00.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a42911700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6a3c065730 0x7f6a3c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a42911700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c066270 con 0x7f6a3c0b00a0 2021-11-15T19:27:00.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a42911700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c065fd0 con 0x7f6a3c065b10 2021-11-15T19:27:00.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a42911700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c067410 con 0x7f6a3c065730 2021-11-15T19:27:00.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6a3c065b10 0x7f6a3c13c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50208/0 (socket says 172.21.2.137:50208) 2021-11-15T19:27:00.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3b7fe700 1 -- 172.21.2.137:0/2556678151 learned_addr learned my addr 172.21.2.137:0/2556678151 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:00.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376611004 0 0) 0x7f6a3c065fd0 con 0x7f6a3c065b10 2021-11-15T19:27:00.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c003260 con 0x7f6a3c065b10 2021-11-15T19:27:00.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 951116912 0 0) 0x7f6a1c003260 con 0x7f6a3c065b10 2021-11-15T19:27:00.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 >> v2:172.21.2.111:3300/0 conn(0x7f6a3c065730 msgr2=0x7f6a3c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 --2- 172.21.2.137:0/2556678151 >> v2:172.21.2.111:3300/0 conn(0x7f6a3c065730 0x7f6a3c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 >> v1:172.21.2.111:6789/0 conn(0x7f6a3c0b00a0 legacy=0x7f6a3c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c066f70 con 0x7f6a3c065b10 2021-11-15T19:27:00.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6a24001660 con 0x7f6a3c065b10 2021-11-15T19:27:00.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 >> v1:172.21.2.137:6789/0 conn(0x7f6a3c065b10 legacy=0x7f6a3c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a1c003820 0x7f6a1c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c004500 0x7f6a1c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a1c005050 0x7f6a1c00d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c067410 con 0x7f6a1c004500 2021-11-15T19:27:00.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c00e150 con 0x7f6a1c005050 2021-11-15T19:27:00.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c00e310 con 0x7f6a1c003820 2021-11-15T19:27:00.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a1c005050 0x7f6a1c00d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3b7fe700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c004500 0x7f6a1c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 -- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a1c003820 msgr2=0x7f6a1c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a1c003820 0x7f6a1c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 -- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c004500 msgr2=0x7f6a1c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c004500 0x7f6a1c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 -- 172.21.2.137:0/2556678151 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c003260 con 0x7f6a1c005050 2021-11-15T19:27:00.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 -- 172.21.2.137:0/2556678151 reap_dead start 2021-11-15T19:27:00.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a40eae700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a1c005050 0x7f6a1c00d960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f6a340012f0 tx=0x7f6a34007d60).ready entity=mon.1 client_cookie=6f9c9c57e747f42b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a340014c0 con 0x7f6a1c005050 2021-11-15T19:27:00.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34006870 con 0x7f6a1c005050 2021-11-15T19:27:00.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.666+0000 7f6a3affd700 1 -- 172.21.2.137:0/2556678151 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a34006bd0 con 0x7f6a1c005050 2021-11-15T19:27:00.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/2556678151 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a1c005050 msgr2=0x7f6a1c00d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a1c005050 0x7f6a1c00d960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f6a340012f0 tx=0x7f6a34007d60).stop 2021-11-15T19:27:00.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/2556678151 shutdown_connections 2021-11-15T19:27:00.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 --2- 172.21.2.137:0/2556678151 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a1c005050 0x7f6a1c00d960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/2556678151 >> 172.21.2.137:0/2556678151 conn(0x7f6a3c060290 msgr2=0x7f6a3c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:00.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/2556678151 shutdown_connections 2021-11-15T19:27:00.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/2556678151 wait complete. 2021-11-15T19:27:00.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 Processor -- start 2021-11-15T19:27:00.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- start start 2021-11-15T19:27:00.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c005050 0x7f6a3c13aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a3c13e460 0x7f6a3c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 0x7f6a3c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c1388a0 con 0x7f6a1c005050 2021-11-15T19:27:00.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c13f300 con 0x7f6a3c15a330 2021-11-15T19:27:00.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c13f5a0 con 0x7f6a3c13e460 2021-11-15T19:27:00.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 0x7f6a3c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 0x7f6a3c0ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59672/0 (socket says 172.21.2.137:59672) 2021-11-15T19:27:00.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 -- 172.21.2.137:0/3797912550 learned_addr learned my addr 172.21.2.137:0/3797912550 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:00.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 -- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a3c13e460 msgr2=0x7f6a3c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a3c13e460 0x7f6a3c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 -- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c005050 msgr2=0x7f6a3c13aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a3bfff700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c005050 0x7f6a3c13aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c005050 0x7f6a3c13aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 -- 172.21.2.137:0/3797912550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c13f840 con 0x7f6a3c15a330 2021-11-15T19:27:00.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a3bfff700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c005050 0x7f6a3c13aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:00.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a40eae700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 0x7f6a3c0ae7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6a3c13fe60 tx=0x7f6a34016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a34014670 con 0x7f6a3c15a330 2021-11-15T19:27:00.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a340147d0 con 0x7f6a3c15a330 2021-11-15T19:27:00.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a34014b30 con 0x7f6a3c15a330 2021-11-15T19:27:00.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c13fae0 con 0x7f6a3c15a330 2021-11-15T19:27:00.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c13ea80 con 0x7f6a3c15a330 2021-11-15T19:27:00.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c13f300 con 0x7f6a3c15a330 2021-11-15T19:27:00.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a34010070 con 0x7f6a3c15a330 2021-11-15T19:27:00.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a397fa700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a200536d0 0x7f6a20055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.670+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6a3406c650 con 0x7f6a3c15a330 2021-11-15T19:27:00.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.674+0000 7f6a3bfff700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a200536d0 0x7f6a20055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.674+0000 7f6a3bfff700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a200536d0 0x7f6a20055b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6a2c007000 tx=0x7f6a2c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.674+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a340436a0 con 0x7f6a3c15a330 2021-11-15T19:27:00.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.754+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a3c13fc70 con 0x7f6a3c15a330 2021-11-15T19:27:00.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.754+0000 7f6a397fa700 1 -- 172.21.2.137:0/3797912550 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a34046cc0 con 0x7f6a3c15a330 2021-11-15T19:27:00.765 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:27:00.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a200536d0 msgr2=0x7f6a20055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a200536d0 0x7f6a20055b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6a2c007000 tx=0x7f6a2c008040).stop 2021-11-15T19:27:00.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 msgr2=0x7f6a3c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 0x7f6a3c0ae7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6a3c13fe60 tx=0x7f6a34016000).stop 2021-11-15T19:27:00.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 shutdown_connections 2021-11-15T19:27:00.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a200536d0 0x7f6a20055b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a3c15a330 0x7f6a3c0ae7f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a3c13e460 0x7f6a3c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 --2- 172.21.2.137:0/3797912550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a1c005050 0x7f6a3c13aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 >> 172.21.2.137:0/3797912550 conn(0x7f6a3c060290 msgr2=0x7f6a3c13c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:00.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 shutdown_connections 2021-11-15T19:27:00.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.758+0000 7f6a42911700 1 -- 172.21.2.137:0/3797912550 wait complete. 2021-11-15T19:27:00.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2021-11-15T19:27:00.773 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-11-15T19:27:00.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 Processor -- start 2021-11-15T19:27:00.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- start start 2021-11-15T19:27:00.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb2c0065730 0x7fb2c013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c0065b10 0x7fb2c013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb2c00b00a0 0x7fb2c005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c0067410 con 0x7fb2c00b00a0 2021-11-15T19:27:00.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c0066270 con 0x7fb2c0065730 2021-11-15T19:27:00.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0065fd0 con 0x7fb2c0065b10 2021-11-15T19:27:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb2c0065730 0x7fb2c013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb2c0065730 0x7fb2c013c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59676/0 (socket says 172.21.2.137:59676) 2021-11-15T19:27:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 -- 172.21.2.137:0/4097383045 learned_addr learned my addr 172.21.2.137:0/4097383045 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 -- 172.21.2.137:0/4097383045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c0065b10 msgr2=0x7fb2c013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 --2- 172.21.2.137:0/4097383045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c0065b10 0x7fb2c013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 -- 172.21.2.137:0/4097383045 >> v2:172.21.2.111:3300/0 conn(0x7fb2c00b00a0 msgr2=0x7fb2c005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 --2- 172.21.2.137:0/4097383045 >> v2:172.21.2.111:3300/0 conn(0x7fb2c00b00a0 0x7fb2c005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 -- 172.21.2.137:0/4097383045 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0066f70 con 0x7fb2c0065730 2021-11-15T19:27:00.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2be59c700 1 --2- 172.21.2.137:0/4097383045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c013c2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb2a8002f70 tx=0x7fb2a8006e40).ready entity=mon.1 client_cookie=1f6faa9aba9503b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2bd59a700 1 -- 172.21.2.137:0/4097383045 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a800bcf0 con 0x7fb2c0065730 2021-11-15T19:27:00.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2bd59a700 1 -- 172.21.2.137:0/4097383045 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8000e90 con 0x7fb2c0065730 2021-11-15T19:27:00.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2bd59a700 1 -- 172.21.2.137:0/4097383045 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a80155e0 con 0x7fb2c0065730 2021-11-15T19:27:00.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/4097383045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 msgr2=0x7fb2c013c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/4097383045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c013c2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb2a8002f70 tx=0x7fb2a8006e40).stop 2021-11-15T19:27:00.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/4097383045 shutdown_connections 2021-11-15T19:27:00.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/4097383045 >> v2:172.21.2.111:3300/0 conn(0x7fb2c00b00a0 0x7fb2c005bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/4097383045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c0065b10 0x7fb2c013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/4097383045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c013c2b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/4097383045 >> 172.21.2.137:0/4097383045 conn(0x7fb2c0060290 msgr2=0x7fb2c0060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/4097383045 shutdown_connections 2021-11-15T19:27:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.814+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/4097383045 wait complete. 2021-11-15T19:27:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 Processor -- start 2021-11-15T19:27:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- start start 2021-11-15T19:27:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c0145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2c0065b10 0x7fb2c00adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c00b00a0 0x7fb2c0140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0144500 con 0x7fb2c0065b10 2021-11-15T19:27:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0146360 con 0x7fb2c0065730 2021-11-15T19:27:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0145bd0 con 0x7fb2c00b00a0 2021-11-15T19:27:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c0145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c0145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59680/0 (socket says 172.21.2.137:59680) 2021-11-15T19:27:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 -- 172.21.2.137:0/2009252865 learned_addr learned my addr 172.21.2.137:0/2009252865 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2bdd9b700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2c0065b10 0x7fb2c00adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2bed9d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c00b00a0 0x7fb2c0140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 -- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c00b00a0 msgr2=0x7fb2c0140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c00b00a0 0x7fb2c0140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 -- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2c0065b10 msgr2=0x7fb2c00adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2c0065b10 0x7fb2c00adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 -- 172.21.2.137:0/2009252865 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a800d4d0 con 0x7fb2c0065730 2021-11-15T19:27:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2be59c700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c0145e70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb2c01440e0 tx=0x7fb2a8018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a8015a00 con 0x7fb2c0065730 2021-11-15T19:27:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800be90 con 0x7fb2c0065730 2021-11-15T19:27:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c0141620 con 0x7fb2c0065730 2021-11-15T19:27:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a8015d50 con 0x7fb2c0065730 2021-11-15T19:27:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c0140480 con 0x7fb2c0065730 2021-11-15T19:27:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c013cc90 con 0x7fb2c0065730 2021-11-15T19:27:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2a8028460 con 0x7fb2c0065730 2021-11-15T19:27:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2b77fe700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2a4053610 0x7fb2a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb2a806f120 con 0x7fb2c0065730 2021-11-15T19:27:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2bdd9b700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2a4053610 0x7fb2a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.818+0000 7fb2bdd9b700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2a4053610 0x7fb2a4055ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb2b000c000 tx=0x7fb2b0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.822+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2a8046220 con 0x7fb2c0065730 2021-11-15T19:27:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2c005fd80 con 0x7fb2c0065730 2021-11-15T19:27:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2b77fe700 1 -- 172.21.2.137:0/2009252865 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2a8049840 con 0x7fb2c0065730 2021-11-15T19:27:00.916 INFO:teuthology.orchestra.run.gibba037.stdout:55834574852 2021-11-15T19:27:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2a4053610 msgr2=0x7fb2a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2a4053610 0x7fb2a4055ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb2b000c000 tx=0x7fb2b0008040).stop 2021-11-15T19:27:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 msgr2=0x7fb2c0145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c0145e70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb2c01440e0 tx=0x7fb2a8018000).stop 2021-11-15T19:27:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 shutdown_connections 2021-11-15T19:27:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2a4053610 0x7fb2a4055ad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2c00b00a0 0x7fb2c0140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2c0065b10 0x7fb2c00adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 --2- 172.21.2.137:0/2009252865 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2c0065730 0x7fb2c0145e70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 >> 172.21.2.137:0/2009252865 conn(0x7fb2c0060290 msgr2=0x7fb2c0069680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 shutdown_connections 2021-11-15T19:27:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.906+0000 7fb2c4c8d700 1 -- 172.21.2.137:0/2009252865 wait complete. 2021-11-15T19:27:00.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2021-11-15T19:27:00.923 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-11-15T19:27:00.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 Processor -- start 2021-11-15T19:27:00.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- start start 2021-11-15T19:27:00.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efc700b2400 0x7efc700b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efc700b5330 0x7efc700b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc70146c20 con 0x7efc700b3e70 2021-11-15T19:27:00.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc70142af0 con 0x7efc700b5330 2021-11-15T19:27:00.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc700b27e0 con 0x7efc700b2400 2021-11-15T19:27:00.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc76bae700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efc700b3e70 0x7efc700b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50240/0 (socket says 172.21.2.137:50240) 2021-11-15T19:27:00.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc76bae700 1 -- 172.21.2.137:0/4263794445 learned_addr learned my addr 172.21.2.137:0/4263794445 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:00.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc763ad700 1 --2- 172.21.2.137:0/4263794445 >> v2:172.21.2.137:3300/0 conn(0x7efc700b2400 0x7efc700b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc763ad700 1 -- 172.21.2.137:0/4263794445 >> v2:172.21.2.111:3300/0 conn(0x7efc700b5330 msgr2=0x7efc700b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:00.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc763ad700 1 --2- 172.21.2.137:0/4263794445 >> v2:172.21.2.111:3300/0 conn(0x7efc700b5330 0x7efc700b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc763ad700 1 -- 172.21.2.137:0/4263794445 >> v1:172.21.2.137:6789/0 conn(0x7efc700b3e70 legacy=0x7efc700b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc763ad700 1 -- 172.21.2.137:0/4263794445 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700b4d80 con 0x7efc700b2400 2021-11-15T19:27:00.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc763ad700 1 --2- 172.21.2.137:0/4263794445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b2400 0x7efc700b2a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7efc64002f70 tx=0x7efc64006df0).ready entity=mon.1 client_cookie=217631ec27b6d7d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc753ab700 1 -- 172.21.2.137:0/4263794445 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6400d5c0 con 0x7efc700b2400 2021-11-15T19:27:00.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc753ab700 1 -- 172.21.2.137:0/4263794445 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64000e90 con 0x7efc700b2400 2021-11-15T19:27:00.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc753ab700 1 -- 172.21.2.137:0/4263794445 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6400d910 con 0x7efc700b2400 2021-11-15T19:27:00.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- 172.21.2.137:0/4263794445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b2400 msgr2=0x7efc700b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- 172.21.2.137:0/4263794445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b2400 0x7efc700b2a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7efc64002f70 tx=0x7efc64006df0).stop 2021-11-15T19:27:00.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- 172.21.2.137:0/4263794445 shutdown_connections 2021-11-15T19:27:00.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- 172.21.2.137:0/4263794445 >> v2:172.21.2.111:3300/0 conn(0x7efc700b5330 0x7efc700b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- 172.21.2.137:0/4263794445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b2400 0x7efc700b2a90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:00.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- 172.21.2.137:0/4263794445 >> 172.21.2.137:0/4263794445 conn(0x7efc700623a0 msgr2=0x7efc70062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:00.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- 172.21.2.137:0/4263794445 shutdown_connections 2021-11-15T19:27:00.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- 172.21.2.137:0/4263794445 wait complete. 2021-11-15T19:27:00.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 Processor -- start 2021-11-15T19:27:00.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- start start 2021-11-15T19:27:00.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc700b2400 0x7efc70152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 0x7efc70146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc700b5330 0x7efc70112400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70152220 con 0x7efc700b5330 2021-11-15T19:27:00.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc701524c0 con 0x7efc700b3e70 2021-11-15T19:27:00.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc78611700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc70152760 con 0x7efc700b2400 2021-11-15T19:27:00.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc75bac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 0x7efc70146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc75bac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 0x7efc70146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59698/0 (socket says 172.21.2.137:59698) 2021-11-15T19:27:00.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.966+0000 7efc75bac700 1 -- 172.21.2.137:0/3933604867 learned_addr learned my addr 172.21.2.137:0/3933604867 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:00.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc75bac700 1 -- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc700b2400 msgr2=0x7efc70152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc75bac700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc700b2400 0x7efc70152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc75bac700 1 -- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc700b5330 msgr2=0x7efc70112400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:00.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc75bac700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc700b5330 0x7efc70112400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:00.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc75bac700 1 -- 172.21.2.137:0/3933604867 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6400b180 con 0x7efc700b3e70 2021-11-15T19:27:00.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc75bac700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 0x7efc70146080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efc6c002f70 tx=0x7efc6c006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6c013460 con 0x7efc700b3e70 2021-11-15T19:27:00.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0135c0 con 0x7efc700b3e70 2021-11-15T19:27:00.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70146570 con 0x7efc700b3e70 2021-11-15T19:27:00.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc700af240 con 0x7efc700b3e70 2021-11-15T19:27:00.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6c013920 con 0x7efc700b3e70 2021-11-15T19:27:00.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc70152920 con 0x7efc700b3e70 2021-11-15T19:27:00.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc6c01a060 con 0x7efc700b3e70 2021-11-15T19:27:00.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc637fe700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc500535d0 0x7efc50055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:00.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7efc6c06b450 con 0x7efc700b3e70 2021-11-15T19:27:00.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc763ad700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc500535d0 0x7efc50055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:00.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.970+0000 7efc763ad700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc500535d0 0x7efc50055a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efc64002f70 tx=0x7efc64014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:00.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:00.974+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc6c0424a0 con 0x7efc700b3e70 2021-11-15T19:27:01.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc701467f0 con 0x7efc700b3e70 2021-11-15T19:27:01.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc637fe700 1 -- 172.21.2.137:0/3933604867 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc6c045ac0 con 0x7efc700b3e70 2021-11-15T19:27:01.065 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:27:01.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc500535d0 msgr2=0x7efc50055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc500535d0 0x7efc50055a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efc64002f70 tx=0x7efc64014000).stop 2021-11-15T19:27:01.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 msgr2=0x7efc70146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 0x7efc70146080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efc6c002f70 tx=0x7efc6c006e90).stop 2021-11-15T19:27:01.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 shutdown_connections 2021-11-15T19:27:01.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc500535d0 0x7efc50055a90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc700b5330 0x7efc70112400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc700b3e70 0x7efc70146080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 --2- 172.21.2.137:0/3933604867 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc700b2400 0x7efc70152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.054+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 >> 172.21.2.137:0/3933604867 conn(0x7efc700623a0 msgr2=0x7efc70062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.058+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 shutdown_connections 2021-11-15T19:27:01.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.058+0000 7efc78611700 1 -- 172.21.2.137:0/3933604867 wait complete. 2021-11-15T19:27:01.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2021-11-15T19:27:01.072 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-11-15T19:27:01.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 Processor -- start 2021-11-15T19:27:01.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 -- start start 2021-11-15T19:27:01.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f849005c770 0x7f84900aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8490140aa0 0x7f8490140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849005cb50 con 0x7f84900b0550 2021-11-15T19:27:01.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900b1650 con 0x7f8490140aa0 2021-11-15T19:27:01.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8496d7d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900ad030 con 0x7f849005c770 2021-11-15T19:27:01.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f848ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f84900b0550 0x7f849014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50256/0 (socket says 172.21.2.137:50256) 2021-11-15T19:27:01.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f848ffff700 1 -- 172.21.2.137:0/2305965214 learned_addr learned my addr 172.21.2.137:0/2305965214 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:01.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f849531a700 1 --2- 172.21.2.137:0/2305965214 >> v2:172.21.2.111:3300/0 conn(0x7f8490140aa0 0x7f8490140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f8494b19700 1 --2- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f849005c770 0x7f84900aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f849531a700 1 -- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f849005c770 msgr2=0x7f84900aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f849531a700 1 --2- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f849005c770 0x7f84900aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f849531a700 1 -- 172.21.2.137:0/2305965214 >> v1:172.21.2.137:6789/0 conn(0x7f84900b0550 legacy=0x7f849014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f849531a700 1 -- 172.21.2.137:0/2305965214 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900ad2d0 con 0x7f8490140aa0 2021-11-15T19:27:01.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.114+0000 7f849531a700 1 --2- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8490140aa0 0x7f8490140f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f84880032f0 tx=0x7f84880091d0).ready entity=mon.0 client_cookie=f59f6b5394048eb8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.118+0000 7f848f7fe700 1 -- 172.21.2.137:0/2305965214 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848800b6c0 con 0x7f8490140aa0 2021-11-15T19:27:01.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.118+0000 7f848f7fe700 1 -- 172.21.2.137:0/2305965214 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800b820 con 0x7f8490140aa0 2021-11-15T19:27:01.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.118+0000 7f848f7fe700 1 -- 172.21.2.137:0/2305965214 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848800b990 con 0x7f8490140aa0 2021-11-15T19:27:01.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.118+0000 7f8496d7d700 1 -- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8490140aa0 msgr2=0x7f8490140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.118+0000 7f8496d7d700 1 --2- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8490140aa0 0x7f8490140f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f84880032f0 tx=0x7f84880091d0).stop 2021-11-15T19:27:01.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/2305965214 shutdown_connections 2021-11-15T19:27:01.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 --2- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8490140aa0 0x7f8490140f10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 --2- 172.21.2.137:0/2305965214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f849005c770 0x7f84900aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/2305965214 >> 172.21.2.137:0/2305965214 conn(0x7f84900631e0 msgr2=0x7f849005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/2305965214 shutdown_connections 2021-11-15T19:27:01.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/2305965214 wait complete. 2021-11-15T19:27:01.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 Processor -- start 2021-11-15T19:27:01.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- start start 2021-11-15T19:27:01.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 0x7f849014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84900b0550 0x7f8490146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8490140aa0 0x7f8490142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490142170 con 0x7f84900b0550 2021-11-15T19:27:01.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490146880 con 0x7f849005c770 2021-11-15T19:27:01.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8490146b20 con 0x7f8490140aa0 2021-11-15T19:27:01.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 0x7f849014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 0x7f849014a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59708/0 (socket says 172.21.2.137:59708) 2021-11-15T19:27:01.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 -- 172.21.2.137:0/441890913 learned_addr learned my addr 172.21.2.137:0/441890913 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848ffff700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84900b0550 0x7f8490146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f849531a700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8490140aa0 0x7f8490142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 -- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8490140aa0 msgr2=0x7f8490142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8490140aa0 0x7f8490142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 -- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84900b0550 msgr2=0x7f8490146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84900b0550 0x7f8490146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 -- 172.21.2.137:0/441890913 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009470 con 0x7f849005c770 2021-11-15T19:27:01.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8494b19700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 0x7f849014a200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f847800c000 tx=0x7f8478006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8478010780 con 0x7f849005c770 2021-11-15T19:27:01.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84780108e0 con 0x7f849005c770 2021-11-15T19:27:01.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8478010c40 con 0x7f849005c770 2021-11-15T19:27:01.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84901577a0 con 0x7f849005c770 2021-11-15T19:27:01.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849014adc0 con 0x7f849005c770 2021-11-15T19:27:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84901444a0 con 0x7f849005c770 2021-11-15T19:27:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f847801c460 con 0x7f849005c770 2021-11-15T19:27:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848dffb700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8474053580 0x7f8474055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f847806bec0 con 0x7f849005c770 2021-11-15T19:27:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.122+0000 7f848ffff700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8474053580 0x7f8474055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.126+0000 7f848ffff700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8474053580 0x7f8474055a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f848000d000 tx=0x7f8480009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.126+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8478042f20 con 0x7f849005c770 2021-11-15T19:27:01.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f84900ae7f0 con 0x7f849005c770 2021-11-15T19:27:01.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f848dffb700 1 -- 172.21.2.137:0/441890913 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8478046540 con 0x7f849005c770 2021-11-15T19:27:01.220 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:27:01.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8474053580 msgr2=0x7f8474055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8474053580 0x7f8474055a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f848000d000 tx=0x7f8480009040).stop 2021-11-15T19:27:01.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 msgr2=0x7f849014a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 0x7f849014a200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f847800c000 tx=0x7f8478006df0).stop 2021-11-15T19:27:01.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 shutdown_connections 2021-11-15T19:27:01.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8474053580 0x7f8474055a40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8490140aa0 0x7f8490142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84900b0550 0x7f8490146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 --2- 172.21.2.137:0/441890913 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f849005c770 0x7f849014a200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 >> 172.21.2.137:0/441890913 conn(0x7f84900631e0 msgr2=0x7f84900b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 shutdown_connections 2021-11-15T19:27:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.210+0000 7f8496d7d700 1 -- 172.21.2.137:0/441890913 wait complete. 2021-11-15T19:27:01.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2021-11-15T19:27:01.228 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-11-15T19:27:01.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 Processor -- start 2021-11-15T19:27:01.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 -- start start 2021-11-15T19:27:01.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3dd005c770 0x7f3dd00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd0140aa0 0x7f3dd0140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd005cb50 con 0x7f3dd00b0550 2021-11-15T19:27:01.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00b1650 con 0x7f3dd005c770 2021-11-15T19:27:01.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd7f5c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00ad030 con 0x7f3dd0140aa0 2021-11-15T19:27:01.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3dd005c770 0x7f3dd00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd64f9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd0140aa0 0x7f3dd0140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3dd005c770 0x7f3dd00aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:38712/0 (socket says 172.21.2.137:38712) 2021-11-15T19:27:01.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/2344858897 learned_addr learned my addr 172.21.2.137:0/2344858897 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd0140aa0 msgr2=0x7f3dd0140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 --2- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd0140aa0 0x7f3dd0140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/2344858897 >> v1:172.21.2.111:6789/0 conn(0x7f3dd00b0550 legacy=0x7f3dd014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.270+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/2344858897 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00ad2d0 con 0x7f3dd005c770 2021-11-15T19:27:01.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 --2- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd005c770 0x7f3dd00aef30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3dc4002f70 tx=0x7f3dc4006eb0).ready entity=mon.0 client_cookie=64142d65c111bebd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd4cf6700 1 -- 172.21.2.137:0/2344858897 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc400d570 con 0x7f3dd005c770 2021-11-15T19:27:01.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd4cf6700 1 -- 172.21.2.137:0/2344858897 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc4000e90 con 0x7f3dd005c770 2021-11-15T19:27:01.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd4cf6700 1 -- 172.21.2.137:0/2344858897 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc400d900 con 0x7f3dd005c770 2021-11-15T19:27:01.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd005c770 msgr2=0x7f3dd00aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd005c770 0x7f3dd00aef30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3dc4002f70 tx=0x7f3dc4006eb0).stop 2021-11-15T19:27:01.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/2344858897 shutdown_connections 2021-11-15T19:27:01.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd0140aa0 0x7f3dd0140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/2344858897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd005c770 0x7f3dd00aef30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/2344858897 >> 172.21.2.137:0/2344858897 conn(0x7f3dd00631e0 msgr2=0x7f3dd005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/2344858897 shutdown_connections 2021-11-15T19:27:01.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/2344858897 wait complete. 2021-11-15T19:27:01.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 Processor -- start 2021-11-15T19:27:01.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- start start 2021-11-15T19:27:01.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 0x7f3dd0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd00b0550 0x7f3dd0156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd0140aa0 0x7f3dd01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0067060 con 0x7f3dd0140aa0 2021-11-15T19:27:01.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0157070 con 0x7f3dd005c770 2021-11-15T19:27:01.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0067290 con 0x7f3dd00b0550 2021-11-15T19:27:01.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 0x7f3dd0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 0x7f3dd0156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59722/0 (socket says 172.21.2.137:59722) 2021-11-15T19:27:01.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/1795174575 learned_addr learned my addr 172.21.2.137:0/1795174575 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd64f9700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd0140aa0 0x7f3dd01449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd54f7700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd00b0550 0x7f3dd0156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd00b0550 msgr2=0x7f3dd0156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd00b0550 0x7f3dd0156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd0140aa0 msgr2=0x7f3dd01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd0140aa0 0x7f3dd01449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 -- 172.21.2.137:0/1795174575 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc400b1e0 con 0x7f3dd005c770 2021-11-15T19:27:01.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd54f7700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd00b0550 0x7f3dd0156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:27:01.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd5cf8700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 0x7f3dd0156240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3dd0157340 tx=0x7f3dc4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc4006b40 con 0x7f3dd005c770 2021-11-15T19:27:01.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc400d8f0 con 0x7f3dd005c770 2021-11-15T19:27:01.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd0066510 con 0x7f3dd005c770 2021-11-15T19:27:01.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc4011e90 con 0x7f3dd005c770 2021-11-15T19:27:01.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.274+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd0156e40 con 0x7f3dd005c770 2021-11-15T19:27:01.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd0067450 con 0x7f3dd005c770 2021-11-15T19:27:01.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3dc4025030 con 0x7f3dd005c770 2021-11-15T19:27:01.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dc2ffd700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3db0053610 0x7f3db0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3dc406cd10 con 0x7f3dd005c770 2021-11-15T19:27:01.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dd54f7700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3db0053610 0x7f3db0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dd54f7700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3db0053610 0x7f3db0055ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3dcc00b000 tx=0x7f3dcc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.278+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3dc4072020 con 0x7f3dd005c770 2021-11-15T19:27:01.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3dd00573d0 con 0x7f3dd005c770 2021-11-15T19:27:01.372 INFO:teuthology.orchestra.run.gibba037.stdout:55834574853 2021-11-15T19:27:01.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dc2ffd700 1 -- 172.21.2.137:0/1795174575 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dc4023090 con 0x7f3dd005c770 2021-11-15T19:27:01.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3db0053610 msgr2=0x7f3db0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3db0053610 0x7f3db0055ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3dcc00b000 tx=0x7f3dcc009040).stop 2021-11-15T19:27:01.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 msgr2=0x7f3dd0156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 0x7f3dd0156240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3dd0157340 tx=0x7f3dc4015000).stop 2021-11-15T19:27:01.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 shutdown_connections 2021-11-15T19:27:01.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3db0053610 0x7f3db0055ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3dd0140aa0 0x7f3dd01449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3dd00b0550 0x7f3dd0156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 --2- 172.21.2.137:0/1795174575 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3dd005c770 0x7f3dd0156240 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 >> 172.21.2.137:0/1795174575 conn(0x7f3dd00631e0 msgr2=0x7f3dd00b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 shutdown_connections 2021-11-15T19:27:01.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.362+0000 7f3dd7f5c700 1 -- 172.21.2.137:0/1795174575 wait complete. 2021-11-15T19:27:01.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2021-11-15T19:27:01.380 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-11-15T19:27:01.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61d0cf7700 1 Processor -- start 2021-11-15T19:27:01.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61d0cf7700 1 -- start start 2021-11-15T19:27:01.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61d0cf7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b72e0 0x7f61cc0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61d0cf7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0b76c0 con 0x7f61cc0acd60 2021-11-15T19:27:01.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61d0cf7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc12a170 con 0x7f61cc0ad320 2021-11-15T19:27:01.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61d0cf7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0b3100 con 0x7f61cc0b72e0 2021-11-15T19:27:01.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61cad9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f61cc0ad320 0x7f61cc1290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50282/0 (socket says 172.21.2.137:50282) 2021-11-15T19:27:01.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61cad9d700 1 -- 172.21.2.137:0/3244125208 learned_addr learned my addr 172.21.2.137:0/3244125208 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:01.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090269266 0 0) 0x7f61cc12a170 con 0x7f61cc0ad320 2021-11-15T19:27:01.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ac003260 con 0x7f61cc0ad320 2021-11-15T19:27:01.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195917736 0 0) 0x7f61ac003260 con 0x7f61cc0ad320 2021-11-15T19:27:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b72e0 0x7f61cc0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b72e0 msgr2=0x7f61cc0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b72e0 0x7f61cc0b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 >> v1:172.21.2.111:6789/0 conn(0x7f61cc0acd60 legacy=0x7f61cc0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0ad8a0 con 0x7f61cc0ad320 2021-11-15T19:27:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f61c40019e0 con 0x7f61cc0ad320 2021-11-15T19:27:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 >> v1:172.21.2.137:6789/0 conn(0x7f61cc0ad320 legacy=0x7f61cc1290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61ac003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61ac004500 0x7f61ac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61ac004ee0 0x7f61ac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0b3100 con 0x7f61ac004ee0 2021-11-15T19:27:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac00bda0 con 0x7f61ac003750 2021-11-15T19:27:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac00bf60 con 0x7f61ac004500 2021-11-15T19:27:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b72e0 0x7f61cc0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61ac003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61cad9d700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61ac004ee0 0x7f61ac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 -- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61ac004500 msgr2=0x7f61ac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61ac004500 0x7f61ac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 -- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61ac004ee0 msgr2=0x7f61ac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61ac004ee0 0x7f61ac00b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 -- 172.21.2.137:0/3244125208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac003260 con 0x7f61ac003750 2021-11-15T19:27:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.422+0000 7f61ca59c700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61ac003b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f61bc007000 tx=0x7f61bc008040).ready entity=mon.1 client_cookie=a8ba52ae9e2dec34 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc012430 con 0x7f61ac003750 2021-11-15T19:27:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc00c030 con 0x7f61ac003750 2021-11-15T19:27:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c959a700 1 -- 172.21.2.137:0/3244125208 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc012780 con 0x7f61ac003750 2021-11-15T19:27:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/3244125208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 msgr2=0x7f61ac003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/3244125208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61ac003b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f61bc007000 tx=0x7f61bc008040).stop 2021-11-15T19:27:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61cad9d700 1 -- 172.21.2.137:0/3244125208 reap_dead start 2021-11-15T19:27:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/3244125208 shutdown_connections 2021-11-15T19:27:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/3244125208 >> 172.21.2.137:0/3244125208 conn(0x7f61cc064960 msgr2=0x7f61cc064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/3244125208 shutdown_connections 2021-11-15T19:27:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/3244125208 wait complete. 2021-11-15T19:27:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 Processor -- start 2021-11-15T19:27:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- start start 2021-11-15T19:27:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61cc066280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc1253b0 0x7f61cc127000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc122c50 0x7f61cc1274f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc062e70 con 0x7f61cc122c50 2021-11-15T19:27:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc126950 con 0x7f61ac003750 2021-11-15T19:27:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc066f20 con 0x7f61cc1253b0 2021-11-15T19:27:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61cc066280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61cc066280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59742/0 (socket says 172.21.2.137:59742) 2021-11-15T19:27:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 -- 172.21.2.137:0/4267107148 learned_addr learned my addr 172.21.2.137:0/4267107148 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 -- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc1253b0 msgr2=0x7f61cc127000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc1253b0 0x7f61cc127000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 -- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc122c50 msgr2=0x7f61cc1274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc122c50 0x7f61cc1274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 -- 172.21.2.137:0/4267107148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc126b30 con 0x7f61ac003750 2021-11-15T19:27:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61ca59c700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61cc066280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f61bc007000 tx=0x7f61bc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc011830 con 0x7f61ac003750 2021-11-15T19:27:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc011990 con 0x7f61ac003750 2021-11-15T19:27:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc126dd0 con 0x7f61ac003750 2021-11-15T19:27:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc011cf0 con 0x7f61ac003750 2021-11-15T19:27:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc124d00 con 0x7f61ac003750 2021-11-15T19:27:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc0b3a50 con 0x7f61ac003750 2021-11-15T19:27:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61bc024030 con 0x7f61ac003750 2021-11-15T19:27:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c37fe700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b0053720 0x7f61b0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f61bc06c970 con 0x7f61ac003750 2021-11-15T19:27:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.426+0000 7f61c9d9b700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b0053720 0x7f61b0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.430+0000 7f61c9d9b700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b0053720 0x7f61b0055be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f61b4001fa0 tx=0x7f61b40077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.430+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61bc043ad0 con 0x7f61ac003750 2021-11-15T19:27:01.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f61cc127d20 con 0x7f61ac003750 2021-11-15T19:27:01.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61c37fe700 1 -- 172.21.2.137:0/4267107148 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61bc022090 con 0x7f61ac003750 2021-11-15T19:27:01.524 INFO:teuthology.orchestra.run.gibba037.stdout:55834574854 2021-11-15T19:27:01.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b0053720 msgr2=0x7f61b0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b0053720 0x7f61b0055be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f61b4001fa0 tx=0x7f61b40077f0).stop 2021-11-15T19:27:01.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 msgr2=0x7f61cc066280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61cc066280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f61bc007000 tx=0x7f61bc008040).stop 2021-11-15T19:27:01.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 shutdown_connections 2021-11-15T19:27:01.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b0053720 0x7f61b0055be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc122c50 0x7f61cc1274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc1253b0 0x7f61cc127000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 --2- 172.21.2.137:0/4267107148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61ac003750 0x7f61cc066280 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 >> 172.21.2.137:0/4267107148 conn(0x7f61cc064960 msgr2=0x7f61cc1412e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 shutdown_connections 2021-11-15T19:27:01.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.514+0000 7f61d0cf7700 1 -- 172.21.2.137:0/4267107148 wait complete. 2021-11-15T19:27:01.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2021-11-15T19:27:01.532 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-11-15T19:27:01.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 Processor -- start 2021-11-15T19:27:01.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- start start 2021-11-15T19:27:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1f300b2400 0x7f1f300b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f30146c20 con 0x7f1f300b5330 2021-11-15T19:27:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f30142af0 con 0x7f1f300b3e70 2021-11-15T19:27:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f300b27e0 con 0x7f1f300b2400 2021-11-15T19:27:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f34adb700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1f300b3e70 0x7f1f300b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50302/0 (socket says 172.21.2.137:50302) 2021-11-15T19:27:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f34adb700 1 -- 172.21.2.137:0/2667195754 learned_addr learned my addr 172.21.2.137:0/2667195754 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951026460 0 0) 0x7f1f28001490 con 0x7f1f300b3e70 2021-11-15T19:27:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f10003260 con 0x7f1f300b3e70 2021-11-15T19:27:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2ffff700 1 --2- 172.21.2.137:0/2667195754 >> v2:172.21.2.111:3300/0 conn(0x7f1f300b2400 0x7f1f300b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3336292681 0 0) 0x7f1f10003260 con 0x7f1f300b3e70 2021-11-15T19:27:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 >> v2:172.21.2.111:3300/0 conn(0x7f1f300b2400 msgr2=0x7f1f300b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 --2- 172.21.2.137:0/2667195754 >> v2:172.21.2.111:3300/0 conn(0x7f1f300b2400 0x7f1f300b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 >> v1:172.21.2.111:6789/0 conn(0x7f1f300b5330 legacy=0x7f1f300b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300b4d80 con 0x7f1f300b3e70 2021-11-15T19:27:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1f28001b70 con 0x7f1f300b3e70 2021-11-15T19:27:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 >> v1:172.21.2.137:6789/0 conn(0x7f1f300b3e70 legacy=0x7f1f300b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10003750 0x7f1f10003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f10004500 0x7f1f10004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f10004ec0 0x7f1f1000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300b27e0 con 0x7f1f10003750 2021-11-15T19:27:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1000bd80 con 0x7f1f10004500 2021-11-15T19:27:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1000bf40 con 0x7f1f10004ec0 2021-11-15T19:27:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f10004500 0x7f1f10004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2ffff700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10003750 0x7f1f10003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 -- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f10004ec0 msgr2=0x7f1f1000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f10004ec0 0x7f1f1000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 -- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10003750 msgr2=0x7f1f10003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10003750 0x7f1f10003b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 -- 172.21.2.137:0/2667195754 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10003260 con 0x7f1f10004500 2021-11-15T19:27:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f34adb700 1 -- 172.21.2.137:0/2667195754 reap_dead start 2021-11-15T19:27:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2f7fe700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f10004500 0x7f1f10004980 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f1f20001fa0 tx=0x7f1f20007a00).ready entity=mon.1 client_cookie=c85bb9a4da86350e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f20007070 con 0x7f1f10004500 2021-11-15T19:27:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f200071d0 con 0x7f1f10004500 2021-11-15T19:27:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f2effd700 1 -- 172.21.2.137:0/2667195754 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f20006510 con 0x7f1f10004500 2021-11-15T19:27:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- 172.21.2.137:0/2667195754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f10004500 msgr2=0x7f1f10004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f10004500 0x7f1f10004980 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f1f20001fa0 tx=0x7f1f20007a00).stop 2021-11-15T19:27:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- 172.21.2.137:0/2667195754 shutdown_connections 2021-11-15T19:27:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 --2- 172.21.2.137:0/2667195754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f10004500 0x7f1f10004980 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- 172.21.2.137:0/2667195754 >> 172.21.2.137:0/2667195754 conn(0x7f1f300623a0 msgr2=0x7f1f30062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- 172.21.2.137:0/2667195754 shutdown_connections 2021-11-15T19:27:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.574+0000 7f1f3653e700 1 -- 172.21.2.137:0/2667195754 wait complete. 2021-11-15T19:27:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 Processor -- start 2021-11-15T19:27:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- start start 2021-11-15T19:27:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10004500 0x7f1f300675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f300af4a0 0x7f1f30140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 0x7f1f30064df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30065be0 con 0x7f1f10004500 2021-11-15T19:27:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30063700 con 0x7f1f30064940 2021-11-15T19:27:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30063e30 con 0x7f1f300af4a0 2021-11-15T19:27:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 0x7f1f30064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 0x7f1f30064df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59766/0 (socket says 172.21.2.137:59766) 2021-11-15T19:27:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 -- 172.21.2.137:0/1078769870 learned_addr learned my addr 172.21.2.137:0/1078769870 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 -- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f300af4a0 msgr2=0x7f1f30140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f300af4a0 0x7f1f30140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 -- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10004500 msgr2=0x7f1f300675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10004500 0x7f1f300675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 -- 172.21.2.137:0/1078769870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300638f0 con 0x7f1f30064940 2021-11-15T19:27:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f34adb700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 0x7f1f30064df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1f28001620 tx=0x7f1f300b3420).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f28004ab0 con 0x7f1f30064940 2021-11-15T19:27:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28004c10 con 0x7f1f30064940 2021-11-15T19:27:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f30063b90 con 0x7f1f30064940 2021-11-15T19:27:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f28007030 con 0x7f1f30064940 2021-11-15T19:27:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f30159930 con 0x7f1f30064940 2021-11-15T19:27:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f30146e50 con 0x7f1f30064940 2021-11-15T19:27:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f2801b060 con 0x7f1f30064940 2021-11-15T19:27:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2d7fa700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f140536d0 0x7f1f14055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1f2806b260 con 0x7f1f30064940 2021-11-15T19:27:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.578+0000 7f1f2ffff700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f140536d0 0x7f1f14055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.582+0000 7f1f2ffff700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f140536d0 0x7f1f14055b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1f18008000 tx=0x7f1f18008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.582+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f280423c0 con 0x7f1f30064940 2021-11-15T19:27:01.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1f30142ac0 con 0x7f1f30064940 2021-11-15T19:27:01.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f2d7fa700 1 -- 172.21.2.137:0/1078769870 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f28019070 con 0x7f1f30064940 2021-11-15T19:27:01.675 INFO:teuthology.orchestra.run.gibba037.stdout:55834574852 2021-11-15T19:27:01.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f140536d0 msgr2=0x7f1f14055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f140536d0 0x7f1f14055b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1f18008000 tx=0x7f1f18008040).stop 2021-11-15T19:27:01.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 msgr2=0x7f1f30064df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 0x7f1f30064df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1f28001620 tx=0x7f1f300b3420).stop 2021-11-15T19:27:01.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 shutdown_connections 2021-11-15T19:27:01.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f140536d0 0x7f1f14055b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f30064940 0x7f1f30064df0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f300af4a0 0x7f1f30140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 --2- 172.21.2.137:0/1078769870 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f10004500 0x7f1f300675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 >> 172.21.2.137:0/1078769870 conn(0x7f1f300623a0 msgr2=0x7f1f30141c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 shutdown_connections 2021-11-15T19:27:01.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.666+0000 7f1f3653e700 1 -- 172.21.2.137:0/1078769870 wait complete. 2021-11-15T19:27:01.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2021-11-15T19:27:01.682 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-11-15T19:27:01.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 Processor -- start 2021-11-15T19:27:01.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- start start 2021-11-15T19:27:01.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1a9c0b72e0 0x7f1a9c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0acd60 0x7f1a9c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1a9c0b4680 0x7f1a9c143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b3100 con 0x7f1a9c0b4680 2021-11-15T19:27:01.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b76c0 con 0x7f1a9c0b72e0 2021-11-15T19:27:01.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c12a170 con 0x7f1a9c0acd60 2021-11-15T19:27:01.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1a9c0b72e0 0x7f1a9c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1a9c0b72e0 0x7f1a9c0b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59770/0 (socket says 172.21.2.137:59770) 2021-11-15T19:27:01.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/3506315695 learned_addr learned my addr 172.21.2.137:0/3506315695 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/3506315695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0acd60 msgr2=0x7f1a9c0b4190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:01.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- 172.21.2.137:0/3506315695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0acd60 0x7f1a9c0b4190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/3506315695 >> v2:172.21.2.111:3300/0 conn(0x7f1a9c0b4680 msgr2=0x7f1a9c143ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:01.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- 172.21.2.137:0/3506315695 >> v2:172.21.2.111:3300/0 conn(0x7f1a9c0b4680 0x7f1a9c143ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/3506315695 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0ad8a0 con 0x7f1a9c0b72e0 2021-11-15T19:27:01.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- 172.21.2.137:0/3506315695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0b72e0 0x7f1a9c0b19b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1a90002f70 tx=0x7f1a90006eb0).ready entity=mon.1 client_cookie=2f0bf10135c7e0d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa1423700 1 -- 172.21.2.137:0/3506315695 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a90010b60 con 0x7f1a9c0b72e0 2021-11-15T19:27:01.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa1423700 1 -- 172.21.2.137:0/3506315695 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90000e90 con 0x7f1a9c0b72e0 2021-11-15T19:27:01.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa1423700 1 -- 172.21.2.137:0/3506315695 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a900183d0 con 0x7f1a9c0b72e0 2021-11-15T19:27:01.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/3506315695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0b72e0 msgr2=0x7f1a9c0b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- 172.21.2.137:0/3506315695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0b72e0 0x7f1a9c0b19b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1a90002f70 tx=0x7f1a90006eb0).stop 2021-11-15T19:27:01.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/3506315695 shutdown_connections 2021-11-15T19:27:01.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- 172.21.2.137:0/3506315695 >> v2:172.21.2.111:3300/0 conn(0x7f1a9c0b4680 0x7f1a9c143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- 172.21.2.137:0/3506315695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0acd60 0x7f1a9c0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- 172.21.2.137:0/3506315695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0b72e0 0x7f1a9c0b19b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/3506315695 >> 172.21.2.137:0/3506315695 conn(0x7f1a9c064960 msgr2=0x7f1a9c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/3506315695 shutdown_connections 2021-11-15T19:27:01.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/3506315695 wait complete. 2021-11-15T19:27:01.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 Processor -- start 2021-11-15T19:27:01.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- start start 2021-11-15T19:27:01.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 0x7f1a9c065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0b4680 0x7f1a9c14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0b72e0 0x7f1a9c14deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c142160 con 0x7f1a9c0b72e0 2021-11-15T19:27:01.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c142400 con 0x7f1a9c0acd60 2021-11-15T19:27:01.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c066490 con 0x7f1a9c0b4680 2021-11-15T19:27:01.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 0x7f1a9c065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 0x7f1a9c065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59776/0 (socket says 172.21.2.137:59776) 2021-11-15T19:27:01.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/271266521 learned_addr learned my addr 172.21.2.137:0/271266521 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0b4680 msgr2=0x7f1a9c14d9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:01.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0b4680 0x7f1a9c14d9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0b72e0 msgr2=0x7f1a9c14deb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:01.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0b72e0 0x7f1a9c14deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 -- 172.21.2.137:0/271266521 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9000b1e0 con 0x7f1a9c0acd60 2021-11-15T19:27:01.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa2425700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 0x7f1a9c065fa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1a90002f70 tx=0x7f1a90017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a90019d10 con 0x7f1a9c0acd60 2021-11-15T19:27:01.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90019e70 con 0x7f1a9c0acd60 2021-11-15T19:27:01.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c14eb30 con 0x7f1a9c0acd60 2021-11-15T19:27:01.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a90025640 con 0x7f1a9c0acd60 2021-11-15T19:27:01.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.726+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c066fb0 con 0x7f1a9c0acd60 2021-11-15T19:27:01.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c0b3a50 con 0x7f1a9c0acd60 2021-11-15T19:27:01.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a9002c070 con 0x7f1a9c0acd60 2021-11-15T19:27:01.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1a8f7fe700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a7c0536a0 0x7f1a7c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1a900706f0 con 0x7f1a9c0acd60 2021-11-15T19:27:01.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1aa1c24700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a7c0536a0 0x7f1a7c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1aa1c24700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a7c0536a0 0x7f1a7c055b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1a98003330 tx=0x7f1a98006cb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.730+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a90047740 con 0x7f1a9c0acd60 2021-11-15T19:27:01.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.814+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1a9c0573d0 con 0x7f1a9c0acd60 2021-11-15T19:27:01.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1a8f7fe700 1 -- 172.21.2.137:0/271266521 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a9004ad60 con 0x7f1a9c0acd60 2021-11-15T19:27:01.826 INFO:teuthology.orchestra.run.gibba037.stdout:55834574854 2021-11-15T19:27:01.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a7c0536a0 msgr2=0x7f1a7c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a7c0536a0 0x7f1a7c055b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1a98003330 tx=0x7f1a98006cb0).stop 2021-11-15T19:27:01.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 msgr2=0x7f1a9c065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 0x7f1a9c065fa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1a90002f70 tx=0x7f1a90017000).stop 2021-11-15T19:27:01.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 shutdown_connections 2021-11-15T19:27:01.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a7c0536a0 0x7f1a7c055b60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0b72e0 0x7f1a9c14deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a9c0b4680 0x7f1a9c14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 --2- 172.21.2.137:0/271266521 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c0acd60 0x7f1a9c065fa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 >> 172.21.2.137:0/271266521 conn(0x7f1a9c064960 msgr2=0x7f1a9c140940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 shutdown_connections 2021-11-15T19:27:01.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.818+0000 7f1aa4689700 1 -- 172.21.2.137:0/271266521 wait complete. 2021-11-15T19:27:01.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2021-11-15T19:27:01.833 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-11-15T19:27:01.834 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T19:27:01.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 Processor -- start 2021-11-15T19:27:01.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- start start 2021-11-15T19:27:01.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09c8c0 0x7f82cc09cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f82cc0b3140 0x7f82cc05f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f82cc09ab00 0x7f82cc143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc09d190 con 0x7f82cc0b3140 2021-11-15T19:27:01.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc099790 con 0x7f82cc09ab00 2021-11-15T19:27:01.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0b2940 con 0x7f82cc09c8c0 2021-11-15T19:27:01.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f82cc09ab00 0x7f82cc143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f82cc09ab00 0x7f82cc143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59786/0 (socket says 172.21.2.137:59786) 2021-11-15T19:27:01.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 -- 172.21.2.137:0/2224317187 learned_addr learned my addr 172.21.2.137:0/2224317187 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 -- 172.21.2.137:0/2224317187 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09c8c0 msgr2=0x7f82cc09cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 --2- 172.21.2.137:0/2224317187 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09c8c0 0x7f82cc09cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 -- 172.21.2.137:0/2224317187 >> v2:172.21.2.111:3300/0 conn(0x7f82cc0b3140 msgr2=0x7f82cc05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:01.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 --2- 172.21.2.137:0/2224317187 >> v2:172.21.2.111:3300/0 conn(0x7f82cc0b3140 0x7f82cc05f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 -- 172.21.2.137:0/2224317187 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc099a30 con 0x7f82cc09ab00 2021-11-15T19:27:01.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82cad9d700 1 --2- 172.21.2.137:0/2224317187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc09ab00 0x7f82cc143260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f82c4002f70 tx=0x7f82c4006eb0).ready entity=mon.1 client_cookie=f3db37ebaaff78d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82c959a700 1 -- 172.21.2.137:0/2224317187 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c400d570 con 0x7f82cc09ab00 2021-11-15T19:27:01.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82c959a700 1 -- 172.21.2.137:0/2224317187 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4000e90 con 0x7f82cc09ab00 2021-11-15T19:27:01.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82c959a700 1 -- 172.21.2.137:0/2224317187 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c400d900 con 0x7f82cc09ab00 2021-11-15T19:27:01.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- 172.21.2.137:0/2224317187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc09ab00 msgr2=0x7f82cc143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/2224317187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc09ab00 0x7f82cc143260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f82c4002f70 tx=0x7f82c4006eb0).stop 2021-11-15T19:27:01.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- 172.21.2.137:0/2224317187 shutdown_connections 2021-11-15T19:27:01.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/2224317187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc09ab00 0x7f82cc143260 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/2224317187 >> v2:172.21.2.111:3300/0 conn(0x7f82cc0b3140 0x7f82cc05f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/2224317187 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09c8c0 0x7f82cc09cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- 172.21.2.137:0/2224317187 >> 172.21.2.137:0/2224317187 conn(0x7f82cc0b45b0 msgr2=0x7f82cc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- 172.21.2.137:0/2224317187 shutdown_connections 2021-11-15T19:27:01.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.874+0000 7f82d0f7c700 1 -- 172.21.2.137:0/2224317187 wait complete. 2021-11-15T19:27:01.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 Processor -- start 2021-11-15T19:27:01.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- start start 2021-11-15T19:27:01.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09ab00 0x7f82cc097f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f82cc09c8c0 0x7f82cc061990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 0x7f82cc061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc064e20 con 0x7f82cc09c8c0 2021-11-15T19:27:01.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc062820 con 0x7f82cc0b3140 2021-11-15T19:27:01.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc062a90 con 0x7f82cc09ab00 2021-11-15T19:27:01.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 0x7f82cc061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 0x7f82cc061e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59790/0 (socket says 172.21.2.137:59790) 2021-11-15T19:27:01.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 -- 172.21.2.137:0/3130704136 learned_addr learned my addr 172.21.2.137:0/3130704136 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:01.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 -- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09ab00 msgr2=0x7f82cc097f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09ab00 0x7f82cc097f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 -- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f82cc09c8c0 msgr2=0x7f82cc061990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f82cc09c8c0 0x7f82cc061990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 -- 172.21.2.137:0/3130704136 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c400b1e0 con 0x7f82cc0b3140 2021-11-15T19:27:01.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82cad9d700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 0x7f82cc061e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f82c4002f70 tx=0x7f82c4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c40119d0 con 0x7f82cc0b3140 2021-11-15T19:27:01.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4011b30 con 0x7f82cc0b3140 2021-11-15T19:27:01.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c4011e90 con 0x7f82cc0b3140 2021-11-15T19:27:01.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc065050 con 0x7f82cc0b3140 2021-11-15T19:27:01.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc062370 con 0x7f82cc0b3140 2021-11-15T19:27:01.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc0573d0 con 0x7f82cc0b3140 2021-11-15T19:27:01.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f82c4025030 con 0x7f82cc0b3140 2021-11-15T19:27:01.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82c37fe700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f82b0053660 0x7f82b0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:01.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.878+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f82c406ce90 con 0x7f82cc0b3140 2021-11-15T19:27:01.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.882+0000 7f82ca59c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f82b0053660 0x7f82b0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:01.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.882+0000 7f82ca59c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f82b0053660 0x7f82b0055b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f82b4002f70 tx=0x7f82b4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:01.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.882+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82c4047e60 con 0x7f82cc0b3140 2021-11-15T19:27:01.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.962+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82cc0ac710 con 0x7f82b0053660 2021-11-15T19:27:01.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82c37fe700 1 -- 172.21.2.137:0/3130704136 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82170 (secure 0 0 0) 0x7f82b4012450 con 0x7f82b0053660 2021-11-15T19:27:01.980 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:01.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f82b0053660 msgr2=0x7f82b0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f82b0053660 0x7f82b0055b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f82b4002f70 tx=0x7f82b4006a80).stop 2021-11-15T19:27:01.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 msgr2=0x7f82cc061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:01.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 0x7f82cc061e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f82c4002f70 tx=0x7f82c4015000).stop 2021-11-15T19:27:01.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 shutdown_connections 2021-11-15T19:27:01.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f82b0053660 0x7f82b0055b20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82cc0b3140 0x7f82cc061e80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:01.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f82cc09c8c0 0x7f82cc061990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 --2- 172.21.2.137:0/3130704136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82cc09ab00 0x7f82cc097f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:01.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 >> 172.21.2.137:0/3130704136 conn(0x7f82cc0b45b0 msgr2=0x7f82cc05cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:01.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 shutdown_connections 2021-11-15T19:27:01.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:01.970+0000 7f82d0f7c700 1 -- 172.21.2.137:0/3130704136 wait complete. 2021-11-15T19:27:01.985 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-11-15T19:27:01.987 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2021-11-15T19:27:01.356188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":704299008,"kb_used":6085568,"kb_used_data":698213804,"kb_used_omap":588,"kb_used_meta":0,"kb_avail":698213440,"statfs":{"total":721202184192,"available":714970562560,"internally_reserved":372736,"allocated":714970935296,"data_stored":714970935296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":602976,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.463326"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.090600+0000","last_change":"2021-11-15T19:26:55.090507+0000","last_active":"2021-11-15T19:26:55.090600+0000","last_peered":"2021-11-15T19:26:55.090600+0000","last_clean":"2021-11-15T19:26:55.090600+0000","last_became_active":"2021-11-15T19:26:55.090301+0000","last_became_peered":"2021-11-15T19:26:55.090301+0000","last_unstale":"2021-11-15T19:26:55.090600+0000","last_undegraded":"2021-11-15T19:26:55.090600+0000","last_fullsized":"2021-11-15T19:26:55.090600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.091352+0000","last_change":"2021-11-15T19:26:47.204497+0000","last_active":"2021-11-15T19:26:55.091352+0000","last_peered":"2021-11-15T19:26:55.091352+0000","last_clean":"2021-11-15T19:26:55.091352+0000","last_became_active":"2021-11-15T19:26:47.204269+0000","last_became_peered":"2021-11-15T19:26:47.204269+0000","last_unstale":"2021-11-15T19:26:55.091352+0000","last_undegraded":"2021-11-15T19:26:55.091352+0000","last_fullsized":"2021-11-15T19:26:55.091352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_clean_scrub_stamp":"2021-11-15T19:26:44.160636+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088186+0000","last_change":"2021-11-15T19:26:52.880420+0000","last_active":"2021-11-15T19:26:55.088186+0000","last_peered":"2021-11-15T19:26:55.088186+0000","last_clean":"2021-11-15T19:26:55.088186+0000","last_became_active":"2021-11-15T19:26:52.880242+0000","last_became_peered":"2021-11-15T19:26:52.880242+0000","last_unstale":"2021-11-15T19:26:55.088186+0000","last_undegraded":"2021-11-15T19:26:55.088186+0000","last_fullsized":"2021-11-15T19:26:55.088186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087206+0000","last_change":"2021-11-15T19:26:54.897025+0000","last_active":"2021-11-15T19:26:55.087206+0000","last_peered":"2021-11-15T19:26:55.087206+0000","last_clean":"2021-11-15T19:26:55.087206+0000","last_became_active":"2021-11-15T19:26:54.896830+0000","last_became_peered":"2021-11-15T19:26:54.896830+0000","last_unstale":"2021-11-15T19:26:55.087206+0000","last_undegraded":"2021-11-15T19:26:55.087206+0000","last_fullsized":"2021-11-15T19:26:55.087206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088771+0000","last_change":"2021-11-15T19:26:55.088620+0000","last_active":"2021-11-15T19:26:55.088771+0000","last_peered":"2021-11-15T19:26:55.088771+0000","last_clean":"2021-11-15T19:26:55.088771+0000","last_became_active":"2021-11-15T19:26:55.088441+0000","last_became_peered":"2021-11-15T19:26:55.088441+0000","last_unstale":"2021-11-15T19:26:55.088771+0000","last_undegraded":"2021-11-15T19:26:55.088771+0000","last_fullsized":"2021-11-15T19:26:55.088771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.091340+0000","last_change":"2021-11-15T19:26:52.880490+0000","last_active":"2021-11-15T19:26:55.091340+0000","last_peered":"2021-11-15T19:26:55.091340+0000","last_clean":"2021-11-15T19:26:55.091340+0000","last_became_active":"2021-11-15T19:26:52.880321+0000","last_became_peered":"2021-11-15T19:26:52.880321+0000","last_unstale":"2021-11-15T19:26:55.091340+0000","last_undegraded":"2021-11-15T19:26:55.091340+0000","last_fullsized":"2021-11-15T19:26:55.091340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.086154+0000","last_change":"2021-11-15T19:26:54.897219+0000","last_active":"2021-11-15T19:26:55.086154+0000","last_peered":"2021-11-15T19:26:55.086154+0000","last_clean":"2021-11-15T19:26:55.086154+0000","last_became_active":"2021-11-15T19:26:54.896993+0000","last_became_peered":"2021-11-15T19:26:54.896993+0000","last_unstale":"2021-11-15T19:26:55.086154+0000","last_undegraded":"2021-11-15T19:26:55.086154+0000","last_fullsized":"2021-11-15T19:26:55.086154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087572+0000","last_change":"2021-11-15T19:26:55.087407+0000","last_active":"2021-11-15T19:26:55.087572+0000","last_peered":"2021-11-15T19:26:55.087572+0000","last_clean":"2021-11-15T19:26:55.087572+0000","last_became_active":"2021-11-15T19:26:55.087225+0000","last_became_peered":"2021-11-15T19:26:55.087225+0000","last_unstale":"2021-11-15T19:26:55.087572+0000","last_undegraded":"2021-11-15T19:26:55.087572+0000","last_fullsized":"2021-11-15T19:26:55.087572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.080990+0000","last_change":"2021-11-15T19:26:53.132775+0000","last_active":"2021-11-15T19:26:55.080990+0000","last_peered":"2021-11-15T19:26:55.080990+0000","last_clean":"2021-11-15T19:26:55.080990+0000","last_became_active":"2021-11-15T19:26:53.132568+0000","last_became_peered":"2021-11-15T19:26:53.132568+0000","last_unstale":"2021-11-15T19:26:55.080990+0000","last_undegraded":"2021-11-15T19:26:55.080990+0000","last_fullsized":"2021-11-15T19:26:55.080990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.115391+0000","last_change":"2021-11-15T19:26:54.895794+0000","last_active":"2021-11-15T19:26:55.115391+0000","last_peered":"2021-11-15T19:26:55.115391+0000","last_clean":"2021-11-15T19:26:55.115391+0000","last_became_active":"2021-11-15T19:26:54.895597+0000","last_became_peered":"2021-11-15T19:26:54.895597+0000","last_unstale":"2021-11-15T19:26:55.115391+0000","last_undegraded":"2021-11-15T19:26:55.115391+0000","last_fullsized":"2021-11-15T19:26:55.115391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087885+0000","last_change":"2021-11-15T19:26:55.087572+0000","last_active":"2021-11-15T19:26:55.087885+0000","last_peered":"2021-11-15T19:26:55.087885+0000","last_clean":"2021-11-15T19:26:55.087885+0000","last_became_active":"2021-11-15T19:26:55.087350+0000","last_became_peered":"2021-11-15T19:26:55.087350+0000","last_unstale":"2021-11-15T19:26:55.087885+0000","last_undegraded":"2021-11-15T19:26:55.087885+0000","last_fullsized":"2021-11-15T19:26:55.087885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088041+0000","last_change":"2021-11-15T19:26:52.880321+0000","last_active":"2021-11-15T19:26:55.088041+0000","last_peered":"2021-11-15T19:26:55.088041+0000","last_clean":"2021-11-15T19:26:55.088041+0000","last_became_active":"2021-11-15T19:26:52.880159+0000","last_became_peered":"2021-11-15T19:26:52.880159+0000","last_unstale":"2021-11-15T19:26:55.088041+0000","last_undegraded":"2021-11-15T19:26:55.088041+0000","last_fullsized":"2021-11-15T19:26:55.088041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"20'5","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.092161+0000","last_change":"2021-11-15T19:26:54.901275+0000","last_active":"2021-11-15T19:26:55.092161+0000","last_peered":"2021-11-15T19:26:55.092161+0000","last_clean":"2021-11-15T19:26:55.092161+0000","last_became_active":"2021-11-15T19:26:54.901150+0000","last_became_peered":"2021-11-15T19:26:54.901150+0000","last_unstale":"2021-11-15T19:26:55.092161+0000","last_undegraded":"2021-11-15T19:26:55.092161+0000","last_fullsized":"2021-11-15T19:26:55.092161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088090+0000","last_change":"2021-11-15T19:26:55.087839+0000","last_active":"2021-11-15T19:26:55.088090+0000","last_peered":"2021-11-15T19:26:55.088090+0000","last_clean":"2021-11-15T19:26:55.088090+0000","last_became_active":"2021-11-15T19:26:55.087653+0000","last_became_peered":"2021-11-15T19:26:55.087653+0000","last_unstale":"2021-11-15T19:26:55.088090+0000","last_undegraded":"2021-11-15T19:26:55.088090+0000","last_fullsized":"2021-11-15T19:26:55.088090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.092503+0000","last_change":"2021-11-15T19:26:54.900862+0000","last_active":"2021-11-15T19:26:55.092503+0000","last_peered":"2021-11-15T19:26:55.092503+0000","last_clean":"2021-11-15T19:26:55.092503+0000","last_became_active":"2021-11-15T19:26:54.900700+0000","last_became_peered":"2021-11-15T19:26:54.900700+0000","last_unstale":"2021-11-15T19:26:55.092503+0000","last_undegraded":"2021-11-15T19:26:55.092503+0000","last_fullsized":"2021-11-15T19:26:55.092503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.086572+0000","last_change":"2021-11-15T19:26:52.876890+0000","last_active":"2021-11-15T19:26:55.086572+0000","last_peered":"2021-11-15T19:26:55.086572+0000","last_clean":"2021-11-15T19:26:55.086572+0000","last_became_active":"2021-11-15T19:26:52.876703+0000","last_became_peered":"2021-11-15T19:26:52.876703+0000","last_unstale":"2021-11-15T19:26:55.086572+0000","last_undegraded":"2021-11-15T19:26:55.086572+0000","last_fullsized":"2021-11-15T19:26:55.086572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087934+0000","last_change":"2021-11-15T19:26:55.087530+0000","last_active":"2021-11-15T19:26:55.087934+0000","last_peered":"2021-11-15T19:26:55.087934+0000","last_clean":"2021-11-15T19:26:55.087934+0000","last_became_active":"2021-11-15T19:26:55.087264+0000","last_became_peered":"2021-11-15T19:26:55.087264+0000","last_unstale":"2021-11-15T19:26:55.087934+0000","last_undegraded":"2021-11-15T19:26:55.087934+0000","last_fullsized":"2021-11-15T19:26:55.087934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.116088+0000","last_change":"2021-11-15T19:26:54.895796+0000","last_active":"2021-11-15T19:26:55.116088+0000","last_peered":"2021-11-15T19:26:55.116088+0000","last_clean":"2021-11-15T19:26:55.116088+0000","last_became_active":"2021-11-15T19:26:54.895595+0000","last_became_peered":"2021-11-15T19:26:54.895595+0000","last_unstale":"2021-11-15T19:26:55.116088+0000","last_undegraded":"2021-11-15T19:26:55.116088+0000","last_fullsized":"2021-11-15T19:26:55.116088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.091267+0000","last_change":"2021-11-15T19:26:52.878547+0000","last_active":"2021-11-15T19:26:55.091267+0000","last_peered":"2021-11-15T19:26:55.091267+0000","last_clean":"2021-11-15T19:26:55.091267+0000","last_became_active":"2021-11-15T19:26:52.878380+0000","last_became_peered":"2021-11-15T19:26:52.878380+0000","last_unstale":"2021-11-15T19:26:55.091267+0000","last_undegraded":"2021-11-15T19:26:55.091267+0000","last_fullsized":"2021-11-15T19:26:55.091267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088245+0000","last_change":"2021-11-15T19:26:55.087846+0000","last_active":"2021-11-15T19:26:55.088245+0000","last_peered":"2021-11-15T19:26:55.088245+0000","last_clean":"2021-11-15T19:26:55.088245+0000","last_became_active":"2021-11-15T19:26:55.087660+0000","last_became_peered":"2021-11-15T19:26:55.087660+0000","last_unstale":"2021-11-15T19:26:55.088245+0000","last_undegraded":"2021-11-15T19:26:55.088245+0000","last_fullsized":"2021-11-15T19:26:55.088245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'7","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.089068+0000","last_change":"2021-11-15T19:26:54.897440+0000","last_active":"2021-11-15T19:26:55.089068+0000","last_peered":"2021-11-15T19:26:55.089068+0000","last_clean":"2021-11-15T19:26:55.089068+0000","last_became_active":"2021-11-15T19:26:54.897263+0000","last_became_peered":"2021-11-15T19:26:54.897263+0000","last_unstale":"2021-11-15T19:26:55.089068+0000","last_undegraded":"2021-11-15T19:26:55.089068+0000","last_fullsized":"2021-11-15T19:26:55.089068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.086305+0000","last_change":"2021-11-15T19:26:52.876645+0000","last_active":"2021-11-15T19:26:55.086305+0000","last_peered":"2021-11-15T19:26:55.086305+0000","last_clean":"2021-11-15T19:26:55.086305+0000","last_became_active":"2021-11-15T19:26:52.876454+0000","last_became_peered":"2021-11-15T19:26:52.876454+0000","last_unstale":"2021-11-15T19:26:55.086305+0000","last_undegraded":"2021-11-15T19:26:55.086305+0000","last_fullsized":"2021-11-15T19:26:55.086305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.089258+0000","last_change":"2021-11-15T19:26:55.089167+0000","last_active":"2021-11-15T19:26:55.089258+0000","last_peered":"2021-11-15T19:26:55.089258+0000","last_clean":"2021-11-15T19:26:55.089258+0000","last_became_active":"2021-11-15T19:26:55.088932+0000","last_became_peered":"2021-11-15T19:26:55.088932+0000","last_unstale":"2021-11-15T19:26:55.089258+0000","last_undegraded":"2021-11-15T19:26:55.089258+0000","last_fullsized":"2021-11-15T19:26:55.089258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-11-15T19:26:56.129626+0000","last_change":"2021-11-15T19:26:54.897284+0000","last_active":"2021-11-15T19:26:56.129626+0000","last_peered":"2021-11-15T19:26:56.129626+0000","last_clean":"2021-11-15T19:26:56.129626+0000","last_became_active":"2021-11-15T19:26:54.897018+0000","last_became_peered":"2021-11-15T19:26:54.897018+0000","last_unstale":"2021-11-15T19:26:56.129626+0000","last_undegraded":"2021-11-15T19:26:56.129626+0000","last_fullsized":"2021-11-15T19:26:56.129626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.089583+0000","last_change":"2021-11-15T19:26:52.879038+0000","last_active":"2021-11-15T19:26:55.089583+0000","last_peered":"2021-11-15T19:26:55.089583+0000","last_clean":"2021-11-15T19:26:55.089583+0000","last_became_active":"2021-11-15T19:26:52.878904+0000","last_became_peered":"2021-11-15T19:26:52.878904+0000","last_unstale":"2021-11-15T19:26:55.089583+0000","last_undegraded":"2021-11-15T19:26:55.089583+0000","last_fullsized":"2021-11-15T19:26:55.089583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760584,"kb_used_data":87276792,"kb_used_omap":76,"kb_used_meta":0,"kb_avail":87276792,"statfs":{"total":90150273024,"available":89371435008,"internally_reserved":0,"allocated":89371435008,"data_stored":89371435008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78656,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760796,"kb_used_data":87276640,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":87276580,"statfs":{"total":90150273024,"available":89371217920,"internally_reserved":61440,"allocated":89371279360,"data_stored":89371279360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43255,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760952,"kb_used_data":87276592,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":87276424,"statfs":{"total":90150273024,"available":89371058176,"internally_reserved":172032,"allocated":89371230208,"data_stored":89371230208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74876,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760896,"kb_used_data":87276616,"kb_used_omap":57,"kb_used_meta":0,"kb_avail":87276480,"statfs":{"total":90150273024,"available":89371115520,"internally_reserved":139264,"allocated":89371254784,"data_stored":89371254784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58494,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.919}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760584,"kb_used_data":87276792,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":87276792,"statfs":{"total":90150273024,"available":89371435008,"internally_reserved":0,"allocated":89371435008,"data_stored":89371435008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67415,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760588,"kb_used_data":87276788,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":87276788,"statfs":{"total":90150273024,"available":89371430912,"internally_reserved":0,"allocated":89371430912,"data_stored":89371430912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69551,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760588,"kb_used_data":87276788,"kb_used_omap":106,"kb_used_meta":0,"kb_avail":87276788,"statfs":{"total":90150273024,"available":89371430912,"internally_reserved":0,"allocated":89371430912,"data_stored":89371430912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":109008,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760580,"kb_used_data":87276796,"kb_used_omap":99,"kb_used_meta":0,"kb_avail":87276796,"statfs":{"total":90150273024,"available":89371439104,"internally_reserved":0,"allocated":89371439104,"data_stored":89371439104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":101721,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]}]}} 2021-11-15T19:27:01.989 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T19:27:02.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 Processor -- start 2021-11-15T19:27:02.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 -- start start 2021-11-15T19:27:02.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd864144610 0x7fd864147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd8640a9f50 0x7fd8640aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd864148190 con 0x7fd8640b1340 2021-11-15T19:27:02.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8640b1720 con 0x7fd8640a9f50 2021-11-15T19:27:02.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86897f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd864147e70 con 0x7fd864144610 2021-11-15T19:27:02.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86259c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd8640b1340 0x7fd864143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50348/0 (socket says 172.21.2.137:50348) 2021-11-15T19:27:02.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86259c700 1 -- 172.21.2.137:0/1578821083 learned_addr learned my addr 172.21.2.137:0/1578821083 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:02.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd861d9b700 1 --2- 172.21.2.137:0/1578821083 >> v2:172.21.2.137:3300/0 conn(0x7fd864144610 0x7fd864147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd861d9b700 1 -- 172.21.2.137:0/1578821083 >> v2:172.21.2.111:3300/0 conn(0x7fd8640a9f50 msgr2=0x7fd8640aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd861d9b700 1 --2- 172.21.2.137:0/1578821083 >> v2:172.21.2.111:3300/0 conn(0x7fd8640a9f50 0x7fd8640aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd861d9b700 1 -- 172.21.2.137:0/1578821083 >> v1:172.21.2.137:6789/0 conn(0x7fd8640b1340 legacy=0x7fd864143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd861d9b700 1 -- 172.21.2.137:0/1578821083 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640af800 con 0x7fd864144610 2021-11-15T19:27:02.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd861d9b700 1 --2- 172.21.2.137:0/1578821083 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd864144610 0x7fd864147980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd84c002f70 tx=0x7fd84c006df0).ready entity=mon.1 client_cookie=841fd517fb413402 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86159a700 1 -- 172.21.2.137:0/1578821083 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd84c00d5c0 con 0x7fd864144610 2021-11-15T19:27:02.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86159a700 1 -- 172.21.2.137:0/1578821083 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c000e90 con 0x7fd864144610 2021-11-15T19:27:02.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.034+0000 7fd86159a700 1 -- 172.21.2.137:0/1578821083 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd84c00d910 con 0x7fd864144610 2021-11-15T19:27:02.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/1578821083 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd864144610 msgr2=0x7fd864147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 --2- 172.21.2.137:0/1578821083 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd864144610 0x7fd864147980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd84c002f70 tx=0x7fd84c006df0).stop 2021-11-15T19:27:02.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/1578821083 shutdown_connections 2021-11-15T19:27:02.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 --2- 172.21.2.137:0/1578821083 >> v2:172.21.2.111:3300/0 conn(0x7fd8640a9f50 0x7fd8640aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 --2- 172.21.2.137:0/1578821083 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd864144610 0x7fd864147980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/1578821083 >> 172.21.2.137:0/1578821083 conn(0x7fd8640b4e60 msgr2=0x7fd8640b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/1578821083 shutdown_connections 2021-11-15T19:27:02.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/1578821083 wait complete. 2021-11-15T19:27:02.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 Processor -- start 2021-11-15T19:27:02.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- start start 2021-11-15T19:27:02.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 0x7fd8640986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8640b1340 0x7fd8640ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd864144610 0x7fd86413d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409ad00 con 0x7fd8640b1340 2021-11-15T19:27:02.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8641566a0 con 0x7fd8640a9f50 2021-11-15T19:27:02.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640ae4e0 con 0x7fd864144610 2021-11-15T19:27:02.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 0x7fd8640986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 0x7fd8640986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59804/0 (socket says 172.21.2.137:59804) 2021-11-15T19:27:02.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 -- 172.21.2.137:0/2790134887 learned_addr learned my addr 172.21.2.137:0/2790134887 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd861d9b700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8640b1340 0x7fd8640ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 -- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd864144610 msgr2=0x7fd86413d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd864144610 0x7fd86413d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 -- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8640b1340 msgr2=0x7fd8640ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8640b1340 0x7fd8640ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 -- 172.21.2.137:0/2790134887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c00b180 con 0x7fd8640a9f50 2021-11-15T19:27:02.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd861d9b700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8640b1340 0x7fd8640ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:02.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86259c700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 0x7fd8640986c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd864062250 tx=0x7fd854007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85400ce30 con 0x7fd8640a9f50 2021-11-15T19:27:02.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8540072e0 con 0x7fd8640a9f50 2021-11-15T19:27:02.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8640ae780 con 0x7fd8640a9f50 2021-11-15T19:27:02.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd854005800 con 0x7fd8640a9f50 2021-11-15T19:27:02.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd864098150 con 0x7fd8640a9f50 2021-11-15T19:27:02.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86405faf0 con 0x7fd8640a9f50 2021-11-15T19:27:02.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd85401a060 con 0x7fd8640a9f50 2021-11-15T19:27:02.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd85b7fe700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8480535b0 0x7fd848055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd85406ab00 con 0x7fd8640a9f50 2021-11-15T19:27:02.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.038+0000 7fd861d9b700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8480535b0 0x7fd848055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.042+0000 7fd861d9b700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8480535b0 0x7fd848055a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd84c015000 tx=0x7fd84c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.042+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd854041c60 con 0x7fd8640a9f50 2021-11-15T19:27:02.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.122+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd864148190 con 0x7fd8480535b0 2021-11-15T19:27:02.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd85b7fe700 1 -- 172.21.2.137:0/2790134887 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82170 (secure 0 0 0) 0x7fd864148190 con 0x7fd8480535b0 2021-11-15T19:27:02.137 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:02.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8480535b0 msgr2=0x7fd848055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8480535b0 0x7fd848055a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd84c015000 tx=0x7fd84c014000).stop 2021-11-15T19:27:02.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 msgr2=0x7fd8640986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 0x7fd8640986c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd864062250 tx=0x7fd854007ca0).stop 2021-11-15T19:27:02.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 shutdown_connections 2021-11-15T19:27:02.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8480535b0 0x7fd848055a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd864144610 0x7fd86413d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8640b1340 0x7fd8640ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 --2- 172.21.2.137:0/2790134887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8640a9f50 0x7fd8640986c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 >> 172.21.2.137:0/2790134887 conn(0x7fd8640b4e60 msgr2=0x7fd86413ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 shutdown_connections 2021-11-15T19:27:02.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.126+0000 7fd86897f700 1 -- 172.21.2.137:0/2790134887 wait complete. 2021-11-15T19:27:02.141 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-11-15T19:27:02.144 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2021-11-15T19:27:01.356188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":704299008,"kb_used":6085568,"kb_used_data":698213804,"kb_used_omap":588,"kb_used_meta":0,"kb_avail":698213440,"statfs":{"total":721202184192,"available":714970562560,"internally_reserved":372736,"allocated":714970935296,"data_stored":714970935296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":602976,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.463326"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.090600+0000","last_change":"2021-11-15T19:26:55.090507+0000","last_active":"2021-11-15T19:26:55.090600+0000","last_peered":"2021-11-15T19:26:55.090600+0000","last_clean":"2021-11-15T19:26:55.090600+0000","last_became_active":"2021-11-15T19:26:55.090301+0000","last_became_peered":"2021-11-15T19:26:55.090301+0000","last_unstale":"2021-11-15T19:26:55.090600+0000","last_undegraded":"2021-11-15T19:26:55.090600+0000","last_fullsized":"2021-11-15T19:26:55.090600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.091352+0000","last_change":"2021-11-15T19:26:47.204497+0000","last_active":"2021-11-15T19:26:55.091352+0000","last_peered":"2021-11-15T19:26:55.091352+0000","last_clean":"2021-11-15T19:26:55.091352+0000","last_became_active":"2021-11-15T19:26:47.204269+0000","last_became_peered":"2021-11-15T19:26:47.204269+0000","last_unstale":"2021-11-15T19:26:55.091352+0000","last_undegraded":"2021-11-15T19:26:55.091352+0000","last_fullsized":"2021-11-15T19:26:55.091352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_clean_scrub_stamp":"2021-11-15T19:26:44.160636+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088186+0000","last_change":"2021-11-15T19:26:52.880420+0000","last_active":"2021-11-15T19:26:55.088186+0000","last_peered":"2021-11-15T19:26:55.088186+0000","last_clean":"2021-11-15T19:26:55.088186+0000","last_became_active":"2021-11-15T19:26:52.880242+0000","last_became_peered":"2021-11-15T19:26:52.880242+0000","last_unstale":"2021-11-15T19:26:55.088186+0000","last_undegraded":"2021-11-15T19:26:55.088186+0000","last_fullsized":"2021-11-15T19:26:55.088186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087206+0000","last_change":"2021-11-15T19:26:54.897025+0000","last_active":"2021-11-15T19:26:55.087206+0000","last_peered":"2021-11-15T19:26:55.087206+0000","last_clean":"2021-11-15T19:26:55.087206+0000","last_became_active":"2021-11-15T19:26:54.896830+0000","last_became_peered":"2021-11-15T19:26:54.896830+0000","last_unstale":"2021-11-15T19:26:55.087206+0000","last_undegraded":"2021-11-15T19:26:55.087206+0000","last_fullsized":"2021-11-15T19:26:55.087206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088771+0000","last_change":"2021-11-15T19:26:55.088620+0000","last_active":"2021-11-15T19:26:55.088771+0000","last_peered":"2021-11-15T19:26:55.088771+0000","last_clean":"2021-11-15T19:26:55.088771+0000","last_became_active":"2021-11-15T19:26:55.088441+0000","last_became_peered":"2021-11-15T19:26:55.088441+0000","last_unstale":"2021-11-15T19:26:55.088771+0000","last_undegraded":"2021-11-15T19:26:55.088771+0000","last_fullsized":"2021-11-15T19:26:55.088771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.091340+0000","last_change":"2021-11-15T19:26:52.880490+0000","last_active":"2021-11-15T19:26:55.091340+0000","last_peered":"2021-11-15T19:26:55.091340+0000","last_clean":"2021-11-15T19:26:55.091340+0000","last_became_active":"2021-11-15T19:26:52.880321+0000","last_became_peered":"2021-11-15T19:26:52.880321+0000","last_unstale":"2021-11-15T19:26:55.091340+0000","last_undegraded":"2021-11-15T19:26:55.091340+0000","last_fullsized":"2021-11-15T19:26:55.091340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.086154+0000","last_change":"2021-11-15T19:26:54.897219+0000","last_active":"2021-11-15T19:26:55.086154+0000","last_peered":"2021-11-15T19:26:55.086154+0000","last_clean":"2021-11-15T19:26:55.086154+0000","last_became_active":"2021-11-15T19:26:54.896993+0000","last_became_peered":"2021-11-15T19:26:54.896993+0000","last_unstale":"2021-11-15T19:26:55.086154+0000","last_undegraded":"2021-11-15T19:26:55.086154+0000","last_fullsized":"2021-11-15T19:26:55.086154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087572+0000","last_change":"2021-11-15T19:26:55.087407+0000","last_active":"2021-11-15T19:26:55.087572+0000","last_peered":"2021-11-15T19:26:55.087572+0000","last_clean":"2021-11-15T19:26:55.087572+0000","last_became_active":"2021-11-15T19:26:55.087225+0000","last_became_peered":"2021-11-15T19:26:55.087225+0000","last_unstale":"2021-11-15T19:26:55.087572+0000","last_undegraded":"2021-11-15T19:26:55.087572+0000","last_fullsized":"2021-11-15T19:26:55.087572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.080990+0000","last_change":"2021-11-15T19:26:53.132775+0000","last_active":"2021-11-15T19:26:55.080990+0000","last_peered":"2021-11-15T19:26:55.080990+0000","last_clean":"2021-11-15T19:26:55.080990+0000","last_became_active":"2021-11-15T19:26:53.132568+0000","last_became_peered":"2021-11-15T19:26:53.132568+0000","last_unstale":"2021-11-15T19:26:55.080990+0000","last_undegraded":"2021-11-15T19:26:55.080990+0000","last_fullsized":"2021-11-15T19:26:55.080990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.115391+0000","last_change":"2021-11-15T19:26:54.895794+0000","last_active":"2021-11-15T19:26:55.115391+0000","last_peered":"2021-11-15T19:26:55.115391+0000","last_clean":"2021-11-15T19:26:55.115391+0000","last_became_active":"2021-11-15T19:26:54.895597+0000","last_became_peered":"2021-11-15T19:26:54.895597+0000","last_unstale":"2021-11-15T19:26:55.115391+0000","last_undegraded":"2021-11-15T19:26:55.115391+0000","last_fullsized":"2021-11-15T19:26:55.115391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087885+0000","last_change":"2021-11-15T19:26:55.087572+0000","last_active":"2021-11-15T19:26:55.087885+0000","last_peered":"2021-11-15T19:26:55.087885+0000","last_clean":"2021-11-15T19:26:55.087885+0000","last_became_active":"2021-11-15T19:26:55.087350+0000","last_became_peered":"2021-11-15T19:26:55.087350+0000","last_unstale":"2021-11-15T19:26:55.087885+0000","last_undegraded":"2021-11-15T19:26:55.087885+0000","last_fullsized":"2021-11-15T19:26:55.087885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088041+0000","last_change":"2021-11-15T19:26:52.880321+0000","last_active":"2021-11-15T19:26:55.088041+0000","last_peered":"2021-11-15T19:26:55.088041+0000","last_clean":"2021-11-15T19:26:55.088041+0000","last_became_active":"2021-11-15T19:26:52.880159+0000","last_became_peered":"2021-11-15T19:26:52.880159+0000","last_unstale":"2021-11-15T19:26:55.088041+0000","last_undegraded":"2021-11-15T19:26:55.088041+0000","last_fullsized":"2021-11-15T19:26:55.088041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"20'5","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.092161+0000","last_change":"2021-11-15T19:26:54.901275+0000","last_active":"2021-11-15T19:26:55.092161+0000","last_peered":"2021-11-15T19:26:55.092161+0000","last_clean":"2021-11-15T19:26:55.092161+0000","last_became_active":"2021-11-15T19:26:54.901150+0000","last_became_peered":"2021-11-15T19:26:54.901150+0000","last_unstale":"2021-11-15T19:26:55.092161+0000","last_undegraded":"2021-11-15T19:26:55.092161+0000","last_fullsized":"2021-11-15T19:26:55.092161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088090+0000","last_change":"2021-11-15T19:26:55.087839+0000","last_active":"2021-11-15T19:26:55.088090+0000","last_peered":"2021-11-15T19:26:55.088090+0000","last_clean":"2021-11-15T19:26:55.088090+0000","last_became_active":"2021-11-15T19:26:55.087653+0000","last_became_peered":"2021-11-15T19:26:55.087653+0000","last_unstale":"2021-11-15T19:26:55.088090+0000","last_undegraded":"2021-11-15T19:26:55.088090+0000","last_fullsized":"2021-11-15T19:26:55.088090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.092503+0000","last_change":"2021-11-15T19:26:54.900862+0000","last_active":"2021-11-15T19:26:55.092503+0000","last_peered":"2021-11-15T19:26:55.092503+0000","last_clean":"2021-11-15T19:26:55.092503+0000","last_became_active":"2021-11-15T19:26:54.900700+0000","last_became_peered":"2021-11-15T19:26:54.900700+0000","last_unstale":"2021-11-15T19:26:55.092503+0000","last_undegraded":"2021-11-15T19:26:55.092503+0000","last_fullsized":"2021-11-15T19:26:55.092503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.086572+0000","last_change":"2021-11-15T19:26:52.876890+0000","last_active":"2021-11-15T19:26:55.086572+0000","last_peered":"2021-11-15T19:26:55.086572+0000","last_clean":"2021-11-15T19:26:55.086572+0000","last_became_active":"2021-11-15T19:26:52.876703+0000","last_became_peered":"2021-11-15T19:26:52.876703+0000","last_unstale":"2021-11-15T19:26:55.086572+0000","last_undegraded":"2021-11-15T19:26:55.086572+0000","last_fullsized":"2021-11-15T19:26:55.086572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.087934+0000","last_change":"2021-11-15T19:26:55.087530+0000","last_active":"2021-11-15T19:26:55.087934+0000","last_peered":"2021-11-15T19:26:55.087934+0000","last_clean":"2021-11-15T19:26:55.087934+0000","last_became_active":"2021-11-15T19:26:55.087264+0000","last_became_peered":"2021-11-15T19:26:55.087264+0000","last_unstale":"2021-11-15T19:26:55.087934+0000","last_undegraded":"2021-11-15T19:26:55.087934+0000","last_fullsized":"2021-11-15T19:26:55.087934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.116088+0000","last_change":"2021-11-15T19:26:54.895796+0000","last_active":"2021-11-15T19:26:55.116088+0000","last_peered":"2021-11-15T19:26:55.116088+0000","last_clean":"2021-11-15T19:26:55.116088+0000","last_became_active":"2021-11-15T19:26:54.895595+0000","last_became_peered":"2021-11-15T19:26:54.895595+0000","last_unstale":"2021-11-15T19:26:55.116088+0000","last_undegraded":"2021-11-15T19:26:55.116088+0000","last_fullsized":"2021-11-15T19:26:55.116088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.091267+0000","last_change":"2021-11-15T19:26:52.878547+0000","last_active":"2021-11-15T19:26:55.091267+0000","last_peered":"2021-11-15T19:26:55.091267+0000","last_clean":"2021-11-15T19:26:55.091267+0000","last_became_active":"2021-11-15T19:26:52.878380+0000","last_became_peered":"2021-11-15T19:26:52.878380+0000","last_unstale":"2021-11-15T19:26:55.091267+0000","last_undegraded":"2021-11-15T19:26:55.091267+0000","last_fullsized":"2021-11-15T19:26:55.091267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.088245+0000","last_change":"2021-11-15T19:26:55.087846+0000","last_active":"2021-11-15T19:26:55.088245+0000","last_peered":"2021-11-15T19:26:55.088245+0000","last_clean":"2021-11-15T19:26:55.088245+0000","last_became_active":"2021-11-15T19:26:55.087660+0000","last_became_peered":"2021-11-15T19:26:55.087660+0000","last_unstale":"2021-11-15T19:26:55.088245+0000","last_undegraded":"2021-11-15T19:26:55.088245+0000","last_fullsized":"2021-11-15T19:26:55.088245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'7","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.089068+0000","last_change":"2021-11-15T19:26:54.897440+0000","last_active":"2021-11-15T19:26:55.089068+0000","last_peered":"2021-11-15T19:26:55.089068+0000","last_clean":"2021-11-15T19:26:55.089068+0000","last_became_active":"2021-11-15T19:26:54.897263+0000","last_became_peered":"2021-11-15T19:26:54.897263+0000","last_unstale":"2021-11-15T19:26:55.089068+0000","last_undegraded":"2021-11-15T19:26:55.089068+0000","last_fullsized":"2021-11-15T19:26:55.089068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.086305+0000","last_change":"2021-11-15T19:26:52.876645+0000","last_active":"2021-11-15T19:26:55.086305+0000","last_peered":"2021-11-15T19:26:55.086305+0000","last_clean":"2021-11-15T19:26:55.086305+0000","last_became_active":"2021-11-15T19:26:52.876454+0000","last_became_peered":"2021-11-15T19:26:52.876454+0000","last_unstale":"2021-11-15T19:26:55.086305+0000","last_undegraded":"2021-11-15T19:26:55.086305+0000","last_fullsized":"2021-11-15T19:26:55.086305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.089258+0000","last_change":"2021-11-15T19:26:55.089167+0000","last_active":"2021-11-15T19:26:55.089258+0000","last_peered":"2021-11-15T19:26:55.089258+0000","last_clean":"2021-11-15T19:26:55.089258+0000","last_became_active":"2021-11-15T19:26:55.088932+0000","last_became_peered":"2021-11-15T19:26:55.088932+0000","last_unstale":"2021-11-15T19:26:55.089258+0000","last_undegraded":"2021-11-15T19:26:55.089258+0000","last_fullsized":"2021-11-15T19:26:55.089258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:54.885538+0000","last_clean_scrub_stamp":"2021-11-15T19:26:54.885538+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-11-15T19:26:56.129626+0000","last_change":"2021-11-15T19:26:54.897284+0000","last_active":"2021-11-15T19:26:56.129626+0000","last_peered":"2021-11-15T19:26:56.129626+0000","last_clean":"2021-11-15T19:26:56.129626+0000","last_became_active":"2021-11-15T19:26:54.897018+0000","last_became_peered":"2021-11-15T19:26:54.897018+0000","last_unstale":"2021-11-15T19:26:56.129626+0000","last_undegraded":"2021-11-15T19:26:56.129626+0000","last_fullsized":"2021-11-15T19:26:56.129626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:53.880146+0000","last_clean_scrub_stamp":"2021-11-15T19:26:53.880146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2021-11-15T19:26:55.089583+0000","last_change":"2021-11-15T19:26:52.879038+0000","last_active":"2021-11-15T19:26:55.089583+0000","last_peered":"2021-11-15T19:26:55.089583+0000","last_clean":"2021-11-15T19:26:55.089583+0000","last_became_active":"2021-11-15T19:26:52.878904+0000","last_became_peered":"2021-11-15T19:26:52.878904+0000","last_unstale":"2021-11-15T19:26:55.089583+0000","last_undegraded":"2021-11-15T19:26:55.089583+0000","last_fullsized":"2021-11-15T19:26:55.089583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760584,"kb_used_data":87276792,"kb_used_omap":76,"kb_used_meta":0,"kb_avail":87276792,"statfs":{"total":90150273024,"available":89371435008,"internally_reserved":0,"allocated":89371435008,"data_stored":89371435008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78656,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760796,"kb_used_data":87276640,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":87276580,"statfs":{"total":90150273024,"available":89371217920,"internally_reserved":61440,"allocated":89371279360,"data_stored":89371279360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43255,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760952,"kb_used_data":87276592,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":87276424,"statfs":{"total":90150273024,"available":89371058176,"internally_reserved":172032,"allocated":89371230208,"data_stored":89371230208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74876,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760896,"kb_used_data":87276616,"kb_used_omap":57,"kb_used_meta":0,"kb_avail":87276480,"statfs":{"total":90150273024,"available":89371115520,"internally_reserved":139264,"allocated":89371254784,"data_stored":89371254784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58494,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.919}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760584,"kb_used_data":87276792,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":87276792,"statfs":{"total":90150273024,"available":89371435008,"internally_reserved":0,"allocated":89371435008,"data_stored":89371435008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67415,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760588,"kb_used_data":87276788,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":87276788,"statfs":{"total":90150273024,"available":89371430912,"internally_reserved":0,"allocated":89371430912,"data_stored":89371430912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69551,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760588,"kb_used_data":87276788,"kb_used_omap":106,"kb_used_meta":0,"kb_avail":87276788,"statfs":{"total":90150273024,"available":89371430912,"internally_reserved":0,"allocated":89371430912,"data_stored":89371430912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":109008,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":760580,"kb_used_data":87276796,"kb_used_omap":99,"kb_used_meta":0,"kb_avail":87276796,"statfs":{"total":90150273024,"available":89371439104,"internally_reserved":0,"allocated":89371439104,"data_stored":89371439104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":101721,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]}]}} 2021-11-15T19:27:02.146 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-11-15T19:27:02.146 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-11-15T19:27:02.146 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-11-15T19:27:02.147 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-11-15T19:27:02.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 Processor -- start 2021-11-15T19:27:02.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 -- start start 2021-11-15T19:27:02.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 0x7f6f5c13c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6f5c0b6830 0x7f6f5c13cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0b63b0 con 0x7f6f5c0b3c00 2021-11-15T19:27:02.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c13d0d0 con 0x7f6f5c0b6830 2021-11-15T19:27:02.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f624cf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c147070 con 0x7f6f5c0b5fd0 2021-11-15T19:27:02.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f60a6c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6f5c0b3c00 0x7f6f5c142ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50366/0 (socket says 172.21.2.137:50366) 2021-11-15T19:27:02.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f60a6c700 1 -- 172.21.2.137:0/251162560 learned_addr learned my addr 172.21.2.137:0/251162560 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:02.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277436289 0 0) 0x7f6f5c0b63b0 con 0x7f6f5c0b3c00 2021-11-15T19:27:02.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f3c003260 con 0x7f6f5c0b3c00 2021-11-15T19:27:02.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2572939709 0 0) 0x7f6f3c003260 con 0x7f6f5c0b3c00 2021-11-15T19:27:02.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 msgr2=0x7f6f5c13c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 0x7f6f5c13c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 >> v2:172.21.2.111:3300/0 conn(0x7f6f5c0b6830 msgr2=0x7f6f5c13cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 --2- 172.21.2.137:0/251162560 >> v2:172.21.2.111:3300/0 conn(0x7f6f5c0b6830 0x7f6f5c13cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c146dd0 con 0x7f6f5c0b3c00 2021-11-15T19:27:02.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6f540019e0 con 0x7f6f5c0b3c00 2021-11-15T19:27:02.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 >> v1:172.21.2.137:6789/0 conn(0x7f6f5c0b3c00 legacy=0x7f6f5c142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f3c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 0x7f6f3c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f3c004bf0 0x7f6f3c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c13d0d0 con 0x7f6f3c004bf0 2021-11-15T19:27:02.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c147070 con 0x7f6f3c0037d0 2021-11-15T19:27:02.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c005300 con 0x7f6f5c0b5fd0 2021-11-15T19:27:02.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.186+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f3c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f60a6c700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f3c004bf0 0x7f6f3c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5b7fe700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 0x7f6f3c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 msgr2=0x7f6f3c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 0x7f6f3c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f3c004bf0 msgr2=0x7f6f3c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f3c004bf0 0x7f6f3c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/251162560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c003260 con 0x7f6f3c0037d0 2021-11-15T19:27:02.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5b7fe700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c0b5fd0 0x7f6f3c004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:02.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f60a6c700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f3c004bf0 0x7f6f3c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:27:02.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f3c003bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6f44002f70 tx=0x7f6f44006c90).ready entity=mon.1 client_cookie=d85a17eaa44b9958 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f44013410 con 0x7f6f3c0037d0 2021-11-15T19:27:02.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44013570 con 0x7f6f3c0037d0 2021-11-15T19:27:02.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5affd700 1 -- 172.21.2.137:0/251162560 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f440138d0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/251162560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 msgr2=0x7f6f3c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 --2- 172.21.2.137:0/251162560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f3c003bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6f44002f70 tx=0x7f6f44006c90).stop 2021-11-15T19:27:02.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f60a6c700 1 -- 172.21.2.137:0/251162560 reap_dead start 2021-11-15T19:27:02.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/251162560 shutdown_connections 2021-11-15T19:27:02.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/251162560 >> 172.21.2.137:0/251162560 conn(0x7f6f5c0624b0 msgr2=0x7f6f5c062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/251162560 shutdown_connections 2021-11-15T19:27:02.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/251162560 wait complete. 2021-11-15T19:27:02.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 Processor -- start 2021-11-15T19:27:02.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- start start 2021-11-15T19:27:02.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f5c0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f5c13f130 0x7f6f5c1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c141db0 0x7f6f5c142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c142720 con 0x7f6f5c13f130 2021-11-15T19:27:02.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c13e7c0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1404a0 con 0x7f6f5c141db0 2021-11-15T19:27:02.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f5c0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f5c0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59824/0 (socket says 172.21.2.137:59824) 2021-11-15T19:27:02.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/1156414439 learned_addr learned my addr 172.21.2.137:0/1156414439 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5b7fe700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f5c13f130 0x7f6f5c1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f60a6c700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c141db0 0x7f6f5c142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c141db0 msgr2=0x7f6f5c142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c141db0 0x7f6f5c142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f5c13f130 msgr2=0x7f6f5c1418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f5c13f130 0x7f6f5c1418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 -- 172.21.2.137:0/1156414439 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c140200 con 0x7f6f3c0037d0 2021-11-15T19:27:02.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f5bfff700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f5c0b46f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6f5c13e900 tx=0x7f6f44014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f44012840 con 0x7f6f3c0037d0 2021-11-15T19:27:02.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f440129a0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f44012d00 con 0x7f6f3c0037d0 2021-11-15T19:27:02.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c13e320 con 0x7f6f3c0037d0 2021-11-15T19:27:02.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c13de80 con 0x7f6f3c0037d0 2021-11-15T19:27:02.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c13e4b0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.190+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f4401c070 con 0x7f6f3c0037d0 2021-11-15T19:27:02.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.194+0000 7f6f597fa700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f400536d0 0x7f6f40055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.194+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6f4406c560 con 0x7f6f3c0037d0 2021-11-15T19:27:02.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.194+0000 7f6f5b7fe700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f400536d0 0x7f6f40055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.194+0000 7f6f5b7fe700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f400536d0 0x7f6f40055b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6f4c00d000 tx=0x7f6f4c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.194+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f440436c0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.306+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6f5c0573d0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.306+0000 7f6f597fa700 1 -- 172.21.2.137:0/1156414439 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f6f44046ce0 con 0x7f6f3c0037d0 2021-11-15T19:27:02.318 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:02.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f400536d0 msgr2=0x7f6f40055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f400536d0 0x7f6f40055b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6f4c00d000 tx=0x7f6f4c008040).stop 2021-11-15T19:27:02.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 msgr2=0x7f6f5c0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f5c0b46f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6f5c13e900 tx=0x7f6f44014000).stop 2021-11-15T19:27:02.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 shutdown_connections 2021-11-15T19:27:02.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f400536d0 0x7f6f40055b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f5c141db0 0x7f6f5c142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f5c13f130 0x7f6f5c1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 --2- 172.21.2.137:0/1156414439 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f3c0037d0 0x7f6f5c0b46f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 >> 172.21.2.137:0/1156414439 conn(0x7f6f5c0624b0 msgr2=0x7f6f5c146030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 shutdown_connections 2021-11-15T19:27:02.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.310+0000 7f6f624cf700 1 -- 172.21.2.137:0/1156414439 wait complete. 2021-11-15T19:27:02.324 INFO:teuthology.orchestra.run.gibba037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-15T19:27:02.325 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-11-15T19:27:02.326 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:02.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 Processor -- start 2021-11-15T19:27:02.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 -- start start 2021-11-15T19:27:02.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80acab0 0x7f1ec80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1ec80b1180 0x7f1ec80b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec80aecf0 con 0x7f1ec80af2f0 2021-11-15T19:27:02.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec806a580 con 0x7f1ec80b1180 2021-11-15T19:27:02.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.366+0000 7f1eccb8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec813f180 con 0x7f1ec80acab0 2021-11-15T19:27:02.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec6d9d700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f1ec80af2f0 0x7f1ec8069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:42878/0 (socket says 172.21.2.137:42878) 2021-11-15T19:27:02.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec6d9d700 1 -- 172.21.2.137:0/1851927757 learned_addr learned my addr 172.21.2.137:0/1851927757 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:02.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec659c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80acab0 0x7f1ec80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec5d9b700 1 --2- 172.21.2.137:0/1851927757 >> v2:172.21.2.111:3300/0 conn(0x7f1ec80b1180 0x7f1ec80b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec659c700 1 -- 172.21.2.137:0/1851927757 >> v2:172.21.2.111:3300/0 conn(0x7f1ec80b1180 msgr2=0x7f1ec80b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec659c700 1 --2- 172.21.2.137:0/1851927757 >> v2:172.21.2.111:3300/0 conn(0x7f1ec80b1180 0x7f1ec80b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec659c700 1 -- 172.21.2.137:0/1851927757 >> v1:172.21.2.111:6789/0 conn(0x7f1ec80af2f0 legacy=0x7f1ec8069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec659c700 1 -- 172.21.2.137:0/1851927757 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80aef20 con 0x7f1ec80acab0 2021-11-15T19:27:02.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec659c700 1 --2- 172.21.2.137:0/1851927757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80acab0 0x7f1ec80b2060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1eb8002f70 tx=0x7f1eb8006df0).ready entity=mon.2 client_cookie=a8a783d178e3093f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec559a700 1 -- 172.21.2.137:0/1851927757 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb800d570 con 0x7f1ec80acab0 2021-11-15T19:27:02.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec559a700 1 -- 172.21.2.137:0/1851927757 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8000e90 con 0x7f1ec80acab0 2021-11-15T19:27:02.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1ec559a700 1 -- 172.21.2.137:0/1851927757 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb800d8c0 con 0x7f1ec80acab0 2021-11-15T19:27:02.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 -- 172.21.2.137:0/1851927757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80acab0 msgr2=0x7f1ec80b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/1851927757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80acab0 0x7f1ec80b2060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1eb8002f70 tx=0x7f1eb8006df0).stop 2021-11-15T19:27:02.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 -- 172.21.2.137:0/1851927757 shutdown_connections 2021-11-15T19:27:02.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/1851927757 >> v2:172.21.2.111:3300/0 conn(0x7f1ec80b1180 0x7f1ec80b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/1851927757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80acab0 0x7f1ec80b2060 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 -- 172.21.2.137:0/1851927757 >> 172.21.2.137:0/1851927757 conn(0x7f1ec80630f0 msgr2=0x7f1ec80634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 -- 172.21.2.137:0/1851927757 shutdown_connections 2021-11-15T19:27:02.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 -- 172.21.2.137:0/1851927757 wait complete. 2021-11-15T19:27:02.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 Processor -- start 2021-11-15T19:27:02.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.370+0000 7f1eccb8d700 1 -- start start 2021-11-15T19:27:02.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 0x7f1ec813a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80af2f0 0x7f1ec8138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1ec80b1180 0x7f1ec813f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec8139850 con 0x7f1ec80b1180 2021-11-15T19:27:02.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81395b0 con 0x7f1ec80acab0 2021-11-15T19:27:02.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec8138950 con 0x7f1ec80af2f0 2021-11-15T19:27:02.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 0x7f1ec813a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 0x7f1ec813a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59840/0 (socket says 172.21.2.137:59840) 2021-11-15T19:27:02.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 -- 172.21.2.137:0/4147726571 learned_addr learned my addr 172.21.2.137:0/4147726571 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec6d9d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1ec80b1180 0x7f1ec813f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec5d9b700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80af2f0 0x7f1ec8138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 -- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80af2f0 msgr2=0x7f1ec8138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80af2f0 0x7f1ec8138460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 -- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1ec80b1180 msgr2=0x7f1ec813f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1ec80b1180 0x7f1ec813f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 -- 172.21.2.137:0/4147726571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb800b180 con 0x7f1ec80acab0 2021-11-15T19:27:02.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec659c700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 0x7f1ec813a6d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f1eb8002f70 tx=0x7f1eb8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb8016070 con 0x7f1ec80acab0 2021-11-15T19:27:02.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb800de40 con 0x7f1ec80acab0 2021-11-15T19:27:02.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb801e450 con 0x7f1ec80acab0 2021-11-15T19:27:02.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec8066570 con 0x7f1ec80acab0 2021-11-15T19:27:02.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec813fc50 con 0x7f1ec80acab0 2021-11-15T19:27:02.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec81357e0 con 0x7f1ec80acab0 2021-11-15T19:27:02.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1eb8025030 con 0x7f1ec80acab0 2021-11-15T19:27:02.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ebf7fe700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1eac0535d0 0x7f1eac055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1eb806cbf0 con 0x7f1ec80acab0 2021-11-15T19:27:02.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.374+0000 7f1ec5d9b700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1eac0535d0 0x7f1eac055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.378+0000 7f1ec5d9b700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1eac0535d0 0x7f1eac055a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1eb000b000 tx=0x7f1eb0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.378+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1eb8043c40 con 0x7f1ec80acab0 2021-11-15T19:27:02.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ec80af730 con 0x7f1ec80acab0 2021-11-15T19:27:02.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1ebf7fe700 1 -- 172.21.2.137:0/4147726571 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f1eb8023020 con 0x7f1ec80acab0 2021-11-15T19:27:02.472 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:02.472 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:02.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1eac0535d0 msgr2=0x7f1eac055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1eac0535d0 0x7f1eac055a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1eb000b000 tx=0x7f1eb0008040).stop 2021-11-15T19:27:02.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 msgr2=0x7f1ec813a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 0x7f1ec813a6d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f1eb8002f70 tx=0x7f1eb8014000).stop 2021-11-15T19:27:02.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 shutdown_connections 2021-11-15T19:27:02.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1eac0535d0 0x7f1eac055a90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1ec80b1180 0x7f1ec813f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ec80af2f0 0x7f1ec8138460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 --2- 172.21.2.137:0/4147726571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ec80acab0 0x7f1ec813a6d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 >> 172.21.2.137:0/4147726571 conn(0x7f1ec80630f0 msgr2=0x7f1ec8069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 shutdown_connections 2021-11-15T19:27:02.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.462+0000 7f1eccb8d700 1 -- 172.21.2.137:0/4147726571 wait complete. 2021-11-15T19:27:02.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:02.480 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:02.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 Processor -- start 2021-11-15T19:27:02.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 -- start start 2021-11-15T19:27:02.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7eff100b2400 0x7eff100b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff100b5330 0x7eff100b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b3e70 0x7eff100b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff10146c20 con 0x7eff100b2400 2021-11-15T19:27:02.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff10142af0 con 0x7eff100b5330 2021-11-15T19:27:02.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff17dbc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100b27e0 con 0x7eff100b3e70 2021-11-15T19:27:02.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff100b5330 0x7eff100b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff100b5330 0x7eff100b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59848/0 (socket says 172.21.2.137:59848) 2021-11-15T19:27:02.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 -- 172.21.2.137:0/71522244 learned_addr learned my addr 172.21.2.137:0/71522244 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 -- 172.21.2.137:0/71522244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b3e70 msgr2=0x7eff100b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 --2- 172.21.2.137:0/71522244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b3e70 0x7eff100b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 -- 172.21.2.137:0/71522244 >> v2:172.21.2.111:3300/0 conn(0x7eff100b2400 msgr2=0x7eff100b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 --2- 172.21.2.137:0/71522244 >> v2:172.21.2.111:3300/0 conn(0x7eff100b2400 0x7eff100b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 -- 172.21.2.137:0/71522244 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100b4d80 con 0x7eff100b5330 2021-11-15T19:27:02.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.522+0000 7eff15357700 1 --2- 172.21.2.137:0/71522244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff100b09b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7eff0c002f70 tx=0x7eff0c006eb0).ready entity=mon.1 client_cookie=318e047c7f59b79e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff14b56700 1 -- 172.21.2.137:0/71522244 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0c00d570 con 0x7eff100b5330 2021-11-15T19:27:02.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff14b56700 1 -- 172.21.2.137:0/71522244 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c000e90 con 0x7eff100b5330 2021-11-15T19:27:02.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff14b56700 1 -- 172.21.2.137:0/71522244 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0c00d900 con 0x7eff100b5330 2021-11-15T19:27:02.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/71522244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 msgr2=0x7eff100b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- 172.21.2.137:0/71522244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff100b09b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7eff0c002f70 tx=0x7eff0c006eb0).stop 2021-11-15T19:27:02.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/71522244 shutdown_connections 2021-11-15T19:27:02.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- 172.21.2.137:0/71522244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b3e70 0x7eff100b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- 172.21.2.137:0/71522244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff100b09b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- 172.21.2.137:0/71522244 >> v2:172.21.2.111:3300/0 conn(0x7eff100b2400 0x7eff100b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/71522244 >> 172.21.2.137:0/71522244 conn(0x7eff100623a0 msgr2=0x7eff10062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/71522244 shutdown_connections 2021-11-15T19:27:02.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/71522244 wait complete. 2021-11-15T19:27:02.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 Processor -- start 2021-11-15T19:27:02.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- start start 2021-11-15T19:27:02.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b2400 0x7eff10155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff100b3e70 0x7eff100b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff101516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff10140b10 con 0x7eff100b3e70 2021-11-15T19:27:02.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff10116430 con 0x7eff100b5330 2021-11-15T19:27:02.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff101129d0 con 0x7eff100b2400 2021-11-15T19:27:02.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff101516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff101516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59856/0 (socket says 172.21.2.137:59856) 2021-11-15T19:27:02.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 -- 172.21.2.137:0/1000998961 learned_addr learned my addr 172.21.2.137:0/1000998961 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 -- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b2400 msgr2=0x7eff10155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b2400 0x7eff10155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 -- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff100b3e70 msgr2=0x7eff100b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff100b3e70 0x7eff100b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 -- 172.21.2.137:0/1000998961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c00b1e0 con 0x7eff100b5330 2021-11-15T19:27:02.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff16359700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff101516a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7eff080032f0 tx=0x7eff08009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0800d4a0 con 0x7eff100b5330 2021-11-15T19:27:02.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800d600 con 0x7eff100b5330 2021-11-15T19:27:02.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff10112c70 con 0x7eff100b5330 2021-11-15T19:27:02.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0800d960 con 0x7eff100b5330 2021-11-15T19:27:02.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff10114eb0 con 0x7eff100b5330 2021-11-15T19:27:02.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff10114270 con 0x7eff100b5330 2021-11-15T19:27:02.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.526+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff08018030 con 0x7eff100b5330 2021-11-15T19:27:02.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.530+0000 7eff02ffd700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef00536a0 0x7efef0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.530+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7eff0806b310 con 0x7eff100b5330 2021-11-15T19:27:02.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.530+0000 7eff15b58700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef00536a0 0x7efef0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.530+0000 7eff15b58700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef00536a0 0x7efef0055b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7eff04002f70 tx=0x7eff040069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.530+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff10114270 con 0x7eff100b5330 2021-11-15T19:27:02.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7eff10114270 con 0x7eff100b5330 2021-11-15T19:27:02.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff02ffd700 1 -- 172.21.2.137:0/1000998961 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7eff10114270 con 0x7eff100b5330 2021-11-15T19:27:02.624 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:02.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef00536a0 msgr2=0x7efef0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef00536a0 0x7efef0055b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7eff04002f70 tx=0x7eff040069e0).stop 2021-11-15T19:27:02.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 msgr2=0x7eff101516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff101516a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7eff080032f0 tx=0x7eff08009120).stop 2021-11-15T19:27:02.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 shutdown_connections 2021-11-15T19:27:02.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef00536a0 0x7efef0055b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff100b5330 0x7eff101516a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff100b3e70 0x7eff100b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 --2- 172.21.2.137:0/1000998961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff100b2400 0x7eff10155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 >> 172.21.2.137:0/1000998961 conn(0x7eff100623a0 msgr2=0x7eff10141180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 shutdown_connections 2021-11-15T19:27:02.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.614+0000 7eff17dbc700 1 -- 172.21.2.137:0/1000998961 wait complete. 2021-11-15T19:27:02.632 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:02.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 Processor -- start 2021-11-15T19:27:02.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 -- start start 2021-11-15T19:27:02.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4d9c0b0990 0x7f4d9c0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b6180 0x7f4d9c147e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9c0b0d70 con 0x7f4d9c0b4860 2021-11-15T19:27:02.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c0b5a40 con 0x7f4d9c0b0990 2021-11-15T19:27:02.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4da11d2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0b5ce0 con 0x7f4d9c0b6180 2021-11-15T19:27:02.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4d9c0b0990 0x7f4d9c0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4d9c0b0990 0x7f4d9c0b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59860/0 (socket says 172.21.2.137:59860) 2021-11-15T19:27:02.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2707613036 learned_addr learned my addr 172.21.2.137:0/2707613036 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2707613036 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b6180 msgr2=0x7f4d9c147e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:02.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 --2- 172.21.2.137:0/2707613036 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b6180 0x7f4d9c147e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2707613036 >> v1:172.21.2.111:6789/0 conn(0x7f4d9c0b4860 legacy=0x7f4d9c147760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:02.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2707613036 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0b4060 con 0x7f4d9c0b0990 2021-11-15T19:27:02.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d9ad9d700 1 --2- 172.21.2.137:0/2707613036 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b4370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4d9c063210 tx=0x7f4d84006eb0).ready entity=mon.1 client_cookie=76cb0804bbcca28b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.674+0000 7f4d99d9b700 1 -- 172.21.2.137:0/2707613036 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8400d570 con 0x7f4d9c0b0990 2021-11-15T19:27:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d99d9b700 1 -- 172.21.2.137:0/2707613036 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84000e90 con 0x7f4d9c0b0990 2021-11-15T19:27:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d99d9b700 1 -- 172.21.2.137:0/2707613036 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8400d8c0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2707613036 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 msgr2=0x7f4d9c0b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2707613036 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b4370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4d9c063210 tx=0x7f4d84006eb0).stop 2021-11-15T19:27:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2707613036 shutdown_connections 2021-11-15T19:27:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2707613036 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b6180 0x7f4d9c147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2707613036 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b4370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2707613036 >> 172.21.2.137:0/2707613036 conn(0x7f4d9c0623a0 msgr2=0x7f4d9c062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2707613036 shutdown_connections 2021-11-15T19:27:02.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2707613036 wait complete. 2021-11-15T19:27:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 Processor -- start 2021-11-15T19:27:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- start start 2021-11-15T19:27:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b4860 0x7f4d9c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c0b6180 0x7f4d9c15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0b0270 con 0x7f4d9c0b6180 2021-11-15T19:27:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c14bdd0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c14c070 con 0x7f4d9c0b4860 2021-11-15T19:27:02.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59866/0 (socket says 172.21.2.137:59866) 2021-11-15T19:27:02.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2388371764 learned_addr learned my addr 172.21.2.137:0/2388371764 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b4860 msgr2=0x7f4d9c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b4860 0x7f4d9c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c0b6180 msgr2=0x7f4d9c15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c0b6180 0x7f4d9c15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 -- 172.21.2.137:0/2388371764 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8400b1e0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d9ad9d700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b7380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4d9c063210 tx=0x7f4d84015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8400bec0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400d8f0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c14c310 con 0x7f4d9c0b0990 2021-11-15T19:27:02.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c145a60 con 0x7f4d9c0b0990 2021-11-15T19:27:02.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8401e460 con 0x7f4d9c0b0990 2021-11-15T19:27:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c0573d0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.678+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4d84025030 con 0x7f4d9c0b0990 2021-11-15T19:27:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.682+0000 7f4d93fff700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d80053660 0x7f4d80055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.682+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4d8406cea0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.682+0000 7f4d9a59c700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d80053660 0x7f4d80055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.682+0000 7f4d9a59c700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d80053660 0x7f4d80055b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4d8c002fb0 tx=0x7f4d8c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.682+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4d84043ef0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d9c067cd0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4d93fff700 1 -- 172.21.2.137:0/2388371764 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d840230a0 con 0x7f4d9c0b0990 2021-11-15T19:27:02.775 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:02.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d80053660 msgr2=0x7f4d80055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d80053660 0x7f4d80055b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4d8c002fb0 tx=0x7f4d8c0069b0).stop 2021-11-15T19:27:02.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 msgr2=0x7f4d9c0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b7380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4d9c063210 tx=0x7f4d84015000).stop 2021-11-15T19:27:02.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 shutdown_connections 2021-11-15T19:27:02.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d80053660 0x7f4d80055b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c0b6180 0x7f4d9c15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d9c0b4860 0x7f4d9c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 --2- 172.21.2.137:0/2388371764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c0b0990 0x7f4d9c0b7380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 >> 172.21.2.137:0/2388371764 conn(0x7f4d9c0623a0 msgr2=0x7f4d9c147c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 shutdown_connections 2021-11-15T19:27:02.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.766+0000 7f4da11d2700 1 -- 172.21.2.137:0/2388371764 wait complete. 2021-11-15T19:27:02.782 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:02.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.822+0000 7f581adbe700 1 Processor -- start 2021-11-15T19:27:02.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- start start 2021-11-15T19:27:02.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 0x7f58140b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f58140b4680 0x7f58141290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58140b76c0 con 0x7f58140b72e0 2021-11-15T19:27:02.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58140b3100 con 0x7f58140b4680 2021-11-15T19:27:02.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58140b20c0 con 0x7f58140acd60 2021-11-15T19:27:02.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581935b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f58140b4680 0x7f58141290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 0x7f58140b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581935b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f58140b4680 0x7f58141290c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:38870/0 (socket says 172.21.2.137:38870) 2021-11-15T19:27:02.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 0x7f58140b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:33214/0 (socket says 172.21.2.137:33214) 2021-11-15T19:27:02.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581935b700 1 -- 172.21.2.137:0/3854256263 learned_addr learned my addr 172.21.2.137:0/3854256263 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 -- 172.21.2.137:0/3854256263 >> v2:172.21.2.111:3300/0 conn(0x7f58140b4680 msgr2=0x7f58141290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:02.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 --2- 172.21.2.137:0/3854256263 >> v2:172.21.2.111:3300/0 conn(0x7f58140b4680 0x7f58141290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 -- 172.21.2.137:0/3854256263 >> v1:172.21.2.111:6789/0 conn(0x7f58140b72e0 legacy=0x7f58140b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 -- 172.21.2.137:0/3854256263 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581412a170 con 0x7f58140acd60 2021-11-15T19:27:02.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f5813fff700 1 --2- 172.21.2.137:0/3854256263 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 0x7f58140b4190 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f580c0032f0 tx=0x7f580c0091d0).ready entity=mon.2 client_cookie=1d9bc795462991bd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f58137fe700 1 -- 172.21.2.137:0/3854256263 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c00b6c0 con 0x7f58140acd60 2021-11-15T19:27:02.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f58137fe700 1 -- 172.21.2.137:0/3854256263 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c00b820 con 0x7f58140acd60 2021-11-15T19:27:02.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f58137fe700 1 -- 172.21.2.137:0/3854256263 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c00b990 con 0x7f58140acd60 2021-11-15T19:27:02.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- 172.21.2.137:0/3854256263 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 msgr2=0x7f58140b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 --2- 172.21.2.137:0/3854256263 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 0x7f58140b4190 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f580c0032f0 tx=0x7f580c0091d0).stop 2021-11-15T19:27:02.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- 172.21.2.137:0/3854256263 shutdown_connections 2021-11-15T19:27:02.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 --2- 172.21.2.137:0/3854256263 >> v2:172.21.2.111:3300/0 conn(0x7f58140b4680 0x7f58141290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 --2- 172.21.2.137:0/3854256263 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140acd60 0x7f58140b4190 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- 172.21.2.137:0/3854256263 >> 172.21.2.137:0/3854256263 conn(0x7f5814064960 msgr2=0x7f5814064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- 172.21.2.137:0/3854256263 shutdown_connections 2021-11-15T19:27:02.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.826+0000 7f581adbe700 1 -- 172.21.2.137:0/3854256263 wait complete. 2021-11-15T19:27:02.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 Processor -- start 2021-11-15T19:27:02.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- start start 2021-11-15T19:27:02.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58140acd60 0x7f5814128700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140b4680 0x7f58140b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 0x7f5814143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5814124760 con 0x7f58140acd60 2021-11-15T19:27:02.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58140b03f0 con 0x7f58140b72e0 2021-11-15T19:27:02.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58140b0690 con 0x7f58140b4680 2021-11-15T19:27:02.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 0x7f5814143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 0x7f5814143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59882/0 (socket says 172.21.2.137:59882) 2021-11-15T19:27:02.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 -- 172.21.2.137:0/2393759619 learned_addr learned my addr 172.21.2.137:0/2393759619 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5813fff700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140b4680 0x7f58140b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5818b5a700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58140acd60 0x7f5814128700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 -- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140b4680 msgr2=0x7f58140b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140b4680 0x7f58140b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 -- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58140acd60 msgr2=0x7f5814128700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58140acd60 0x7f5814128700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 -- 172.21.2.137:0/2393759619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c009470 con 0x7f58140b72e0 2021-11-15T19:27:02.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581935b700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 0x7f5814143ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f58141250c0 tx=0x7f5804006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58040126d0 con 0x7f58140b72e0 2021-11-15T19:27:02.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804012830 con 0x7f58140b72e0 2021-11-15T19:27:02.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5814123690 con 0x7f58140b72e0 2021-11-15T19:27:02.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5804012b90 con 0x7f58140b72e0 2021-11-15T19:27:02.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5814123db0 con 0x7f58140b72e0 2021-11-15T19:27:02.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58141239b0 con 0x7f58140b72e0 2021-11-15T19:27:02.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5804022070 con 0x7f58140b72e0 2021-11-15T19:27:02.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5811ffb700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f57f40536a0 0x7f57f4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f580406bd80 con 0x7f58140b72e0 2021-11-15T19:27:02.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.830+0000 7f5818b5a700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f57f40536a0 0x7f57f4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.834+0000 7f5818b5a700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f57f40536a0 0x7f57f4055b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f580800b000 tx=0x7f5808009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.834+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5804042e40 con 0x7f58140b72e0 2021-11-15T19:27:02.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58140b3a50 con 0x7f58140b72e0 2021-11-15T19:27:02.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f5811ffb700 1 -- 172.21.2.137:0/2393759619 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7f580406d020 con 0x7f58140b72e0 2021-11-15T19:27:02.928 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:02.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f57f40536a0 msgr2=0x7f57f4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f57f40536a0 0x7f57f4055b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f580800b000 tx=0x7f5808009040).stop 2021-11-15T19:27:02.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 msgr2=0x7f5814143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 0x7f5814143ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f58141250c0 tx=0x7f5804006eb0).stop 2021-11-15T19:27:02.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 shutdown_connections 2021-11-15T19:27:02.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f57f40536a0 0x7f57f4055b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58140b72e0 0x7f5814143ee0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58140b4680 0x7f58140b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 --2- 172.21.2.137:0/2393759619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58140acd60 0x7f5814128700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 >> 172.21.2.137:0/2393759619 conn(0x7f5814064960 msgr2=0x7f5814129030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 shutdown_connections 2021-11-15T19:27:02.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.918+0000 7f581adbe700 1 -- 172.21.2.137:0/2393759619 wait complete. 2021-11-15T19:27:02.935 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:02.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 Processor -- start 2021-11-15T19:27:02.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- start start 2021-11-15T19:27:02.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe8540acd60 0x7fe8540b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8540b76c0 con 0x7fe8540b72e0 2021-11-15T19:27:02.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85412a170 con 0x7fe8540b4680 2021-11-15T19:27:02.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8540b3100 con 0x7fe8540acd60 2021-11-15T19:27:02.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe8540acd60 0x7fe8540b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe8540acd60 0x7fe8540b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59890/0 (socket says 172.21.2.137:59890) 2021-11-15T19:27:02.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 -- 172.21.2.137:0/3441547358 learned_addr learned my addr 172.21.2.137:0/3441547358 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8537fe700 1 --1- 172.21.2.137:0/3441547358 >> v1:172.21.2.137:6789/0 conn(0x7fe8540b4680 0x7fe8541290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50436/0 (socket says 172.21.2.137:50436) 2021-11-15T19:27:02.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 -- 172.21.2.137:0/3441547358 >> v1:172.21.2.137:6789/0 conn(0x7fe8540b4680 legacy=0x7fe8541290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 -- 172.21.2.137:0/3441547358 >> v1:172.21.2.111:6789/0 conn(0x7fe8540b72e0 legacy=0x7fe8540b19b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:02.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 -- 172.21.2.137:0/3441547358 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540ad8a0 con 0x7fe8540acd60 2021-11-15T19:27:02.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8527fc700 1 --2- 172.21.2.137:0/3441547358 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540acd60 0x7fe8540b4190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fe854065c40 tx=0x7fe844006eb0).ready entity=mon.1 client_cookie=61c37f43cca40089 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:02.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe851ffb700 1 -- 172.21.2.137:0/3441547358 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84400d610 con 0x7fe8540acd60 2021-11-15T19:27:02.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe851ffb700 1 -- 172.21.2.137:0/3441547358 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe844000e90 con 0x7fe8540acd60 2021-11-15T19:27:02.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe851ffb700 1 -- 172.21.2.137:0/3441547358 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84400d960 con 0x7fe8540acd60 2021-11-15T19:27:02.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- 172.21.2.137:0/3441547358 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540acd60 msgr2=0x7fe8540b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:02.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 --2- 172.21.2.137:0/3441547358 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540acd60 0x7fe8540b4190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fe854065c40 tx=0x7fe844006eb0).stop 2021-11-15T19:27:02.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- 172.21.2.137:0/3441547358 shutdown_connections 2021-11-15T19:27:02.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 --2- 172.21.2.137:0/3441547358 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540acd60 0x7fe8540b4190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:02.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- 172.21.2.137:0/3441547358 >> 172.21.2.137:0/3441547358 conn(0x7fe854064960 msgr2=0x7fe854064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:02.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- 172.21.2.137:0/3441547358 shutdown_connections 2021-11-15T19:27:02.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- 172.21.2.137:0/3441547358 wait complete. 2021-11-15T19:27:02.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 Processor -- start 2021-11-15T19:27:02.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- start start 2021-11-15T19:27:02.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8540acd60 0x7fe8540b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8540b4680 0x7fe8541420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 0x7fe8540ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:02.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8540b20c0 con 0x7fe8540acd60 2021-11-15T19:27:02.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8540ae150 con 0x7fe8540b72e0 2021-11-15T19:27:02.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8598c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85413d440 con 0x7fe8540b4680 2021-11-15T19:27:02.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8537fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 0x7fe8540ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:02.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8537fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 0x7fe8540ae930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59896/0 (socket says 172.21.2.137:59896) 2021-11-15T19:27:02.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.978+0000 7fe8537fe700 1 -- 172.21.2.137:0/4202572961 learned_addr learned my addr 172.21.2.137:0/4202572961 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:02.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8537fe700 1 -- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8540b4680 msgr2=0x7fe8541420b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:02.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8537fe700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8540b4680 0x7fe8541420b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8537fe700 1 -- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8540acd60 msgr2=0x7fe8540b6150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:02.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8537fe700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8540acd60 0x7fe8540b6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:02.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8537fe700 1 -- 172.21.2.137:0/4202572961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84400b1e0 con 0x7fe8540b72e0 2021-11-15T19:27:03.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8537fe700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 0x7fe8540ae930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe854124bd0 tx=0x7fe84c007ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84c005ae0 con 0x7fe8540b72e0 2021-11-15T19:27:03.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe854144cd0 con 0x7fe8540b72e0 2021-11-15T19:27:03.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c005c40 con 0x7fe8540b72e0 2021-11-15T19:27:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84c0070d0 con 0x7fe8540b72e0 2021-11-15T19:27:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85413d1a0 con 0x7fe8540b72e0 2021-11-15T19:27:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8540ae6d0 con 0x7fe8540b72e0 2021-11-15T19:27:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe84c01a060 con 0x7fe8540b72e0 2021-11-15T19:27:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe838053610 0x7fe838055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe84c06b4c0 con 0x7fe8540b72e0 2021-11-15T19:27:03.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe852ffd700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe838053610 0x7fe838055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe852ffd700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe838053610 0x7fe838055ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe83c000ed0 tx=0x7fe83c0068b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:02.982+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe84c042510 con 0x7fe8540b72e0 2021-11-15T19:27:03.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8540573d0 con 0x7fe8540b72e0 2021-11-15T19:27:03.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe84bfff700 1 -- 172.21.2.137:0/4202572961 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe84c018020 con 0x7fe8540b72e0 2021-11-15T19:27:03.077 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:03.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe838053610 msgr2=0x7fe838055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe838053610 0x7fe838055ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe83c000ed0 tx=0x7fe83c0068b0).stop 2021-11-15T19:27:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 msgr2=0x7fe8540ae930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 0x7fe8540ae930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe854124bd0 tx=0x7fe84c007ee0).stop 2021-11-15T19:27:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 shutdown_connections 2021-11-15T19:27:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe838053610 0x7fe838055ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8540b72e0 0x7fe8540ae930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8540b4680 0x7fe8541420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 --2- 172.21.2.137:0/4202572961 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8540acd60 0x7fe8540b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 >> 172.21.2.137:0/4202572961 conn(0x7fe854064960 msgr2=0x7fe8540624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 shutdown_connections 2021-11-15T19:27:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.066+0000 7fe8598c8700 1 -- 172.21.2.137:0/4202572961 wait complete. 2021-11-15T19:27:03.084 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:03.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 Processor -- start 2021-11-15T19:27:03.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 -- start start 2021-11-15T19:27:03.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 0x7f6bd413c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6bd40b6830 0x7f6bd413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40b63b0 con 0x7f6bd40b3c00 2021-11-15T19:27:03.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd413d0d0 con 0x7f6bd40b6830 2021-11-15T19:27:03.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bdc559700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4147070 con 0x7f6bd40b5fd0 2021-11-15T19:27:03.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 0x7f6bd413c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bd9af4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6bd40b6830 0x7f6bd413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bd9af4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6bd40b6830 0x7f6bd413cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:38898/0 (socket says 172.21.2.137:38898) 2021-11-15T19:27:03.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 0x7f6bd413c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:33238/0 (socket says 172.21.2.137:33238) 2021-11-15T19:27:03.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bd9af4700 1 -- 172.21.2.137:0/3882992514 learned_addr learned my addr 172.21.2.137:0/3882992514 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:03.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 -- 172.21.2.137:0/3882992514 >> v2:172.21.2.111:3300/0 conn(0x7f6bd40b6830 msgr2=0x7f6bd413cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 --2- 172.21.2.137:0/3882992514 >> v2:172.21.2.111:3300/0 conn(0x7f6bd40b6830 0x7f6bd413cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 -- 172.21.2.137:0/3882992514 >> v1:172.21.2.111:6789/0 conn(0x7f6bd40b3c00 legacy=0x7f6bd4142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 -- 172.21.2.137:0/3882992514 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4146dd0 con 0x7f6bd40b5fd0 2021-11-15T19:27:03.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bda2f5700 1 --2- 172.21.2.137:0/3882992514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 0x7f6bd413c6f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6bd0002f70 tx=0x7f6bd0006d90).ready entity=mon.2 client_cookie=db26404f6bfab6c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.126+0000 7f6bd92f3700 1 -- 172.21.2.137:0/3882992514 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd000d4a0 con 0x7f6bd40b5fd0 2021-11-15T19:27:03.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bd92f3700 1 -- 172.21.2.137:0/3882992514 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0000e90 con 0x7f6bd40b5fd0 2021-11-15T19:27:03.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bd92f3700 1 -- 172.21.2.137:0/3882992514 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd000d7f0 con 0x7f6bd40b5fd0 2021-11-15T19:27:03.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- 172.21.2.137:0/3882992514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 msgr2=0x7f6bd413c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 --2- 172.21.2.137:0/3882992514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 0x7f6bd413c6f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6bd0002f70 tx=0x7f6bd0006d90).stop 2021-11-15T19:27:03.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- 172.21.2.137:0/3882992514 shutdown_connections 2021-11-15T19:27:03.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 --2- 172.21.2.137:0/3882992514 >> v2:172.21.2.111:3300/0 conn(0x7f6bd40b6830 0x7f6bd413cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 --2- 172.21.2.137:0/3882992514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b5fd0 0x7f6bd413c6f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- 172.21.2.137:0/3882992514 >> 172.21.2.137:0/3882992514 conn(0x7f6bd40624b0 msgr2=0x7f6bd4062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- 172.21.2.137:0/3882992514 shutdown_connections 2021-11-15T19:27:03.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- 172.21.2.137:0/3882992514 wait complete. 2021-11-15T19:27:03.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 Processor -- start 2021-11-15T19:27:03.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- start start 2021-11-15T19:27:03.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 0x7f6bd4067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bd40b5fd0 0x7f6bd4063890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b6830 0x7f6bd4141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4066200 con 0x7f6bd40b5fd0 2021-11-15T19:27:03.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4064210 con 0x7f6bd40b3c00 2021-11-15T19:27:03.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4064600 con 0x7f6bd40b6830 2021-11-15T19:27:03.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 0x7f6bd4067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 0x7f6bd4067530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59908/0 (socket says 172.21.2.137:59908) 2021-11-15T19:27:03.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 -- 172.21.2.137:0/618029134 learned_addr learned my addr 172.21.2.137:0/618029134 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:03.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bd9af4700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bd40b5fd0 0x7f6bd4063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdaaf6700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b6830 0x7f6bd4141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 -- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b6830 msgr2=0x7f6bd4141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b6830 0x7f6bd4141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 -- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bd40b5fd0 msgr2=0x7f6bd4063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bd40b5fd0 0x7f6bd4063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 -- 172.21.2.137:0/618029134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd000b120 con 0x7f6bd40b3c00 2021-11-15T19:27:03.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bda2f5700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 0x7f6bd4067530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6bd4065ba0 tx=0x7f6bd0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd0011930 con 0x7f6bd40b3c00 2021-11-15T19:27:03.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0011a90 con 0x7f6bd40b3c00 2021-11-15T19:27:03.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.130+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd4063d80 con 0x7f6bd40b3c00 2021-11-15T19:27:03.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd0011df0 con 0x7f6bd40b3c00 2021-11-15T19:27:03.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd413ad10 con 0x7f6bd40b3c00 2021-11-15T19:27:03.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40647c0 con 0x7f6bd40b3c00 2021-11-15T19:27:03.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6bd000f070 con 0x7f6bd40b3c00 2021-11-15T19:27:03.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bc77fe700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6bb40535d0 0x7f6bb4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6bd006cf20 con 0x7f6bd40b3c00 2021-11-15T19:27:03.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bd9af4700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6bb40535d0 0x7f6bb4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bd9af4700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6bb40535d0 0x7f6bb4055a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6bc8008000 tx=0x7f6bc8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.134+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6bd0047e60 con 0x7f6bd40b3c00 2021-11-15T19:27:03.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bd40573d0 con 0x7f6bd40b3c00 2021-11-15T19:27:03.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bc77fe700 1 -- 172.21.2.137:0/618029134 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f6bd0043f70 con 0x7f6bd40b3c00 2021-11-15T19:27:03.255 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:03.256 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:26:56.084069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.111:6835/2773926386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2773926386},{"type":"v1","addr":"172.21.2.111:6835","nonce":2773926386}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:27:03.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6bb40535d0 msgr2=0x7f6bb4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6bb40535d0 0x7f6bb4055a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6bc8008000 tx=0x7f6bc8008040).stop 2021-11-15T19:27:03.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 msgr2=0x7f6bd4067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 0x7f6bd4067530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6bd4065ba0 tx=0x7f6bd0014000).stop 2021-11-15T19:27:03.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 shutdown_connections 2021-11-15T19:27:03.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6bb40535d0 0x7f6bb4055a90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bd40b6830 0x7f6bd4141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bd40b5fd0 0x7f6bd4063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 --2- 172.21.2.137:0/618029134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bd40b3c00 0x7f6bd4067530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 >> 172.21.2.137:0/618029134 conn(0x7f6bd40624b0 msgr2=0x7f6bd40b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 shutdown_connections 2021-11-15T19:27:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.246+0000 7f6bdc559700 1 -- 172.21.2.137:0/618029134 wait complete. 2021-11-15T19:27:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 5 2021-11-15T19:27:03.464 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:26:55.077984+0000', 'modified': '2021-11-15T19:26:56.084069+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.2.111:6835/2773926386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 2773926386}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 2773926386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:27:03.464 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:27:03.465 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:27:03.545 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":8.456690708,"mdsmap_epoch":5,"osdmap_epoch":21,"osdmap_epoch_barrier":21,"uptime":10.613049889999999} 2021-11-15T19:27:03.545 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 21, "osdmap_epoch_barrier": 21, "rank_uptime": 8.456690708, "state": "up:active", "uptime": 10.61304989, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:27:03.546 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-11-15T19:27:03.564 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-11-15T19:27:03.565 INFO:tasks.ceph_fuse:config is None 2021-11-15T19:27:03.565 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None} 2021-11-15T19:27:03.565 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-11-15T19:27:03.566 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:03.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 Processor -- start 2021-11-15T19:27:03.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 -- start start 2021-11-15T19:27:03.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f59f013f890 0x7f59f00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f005f730 0x7f59f005fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f0060070 con 0x7f59f00608f0 2021-11-15T19:27:03.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00ad6c0 con 0x7f59f013f890 2021-11-15T19:27:03.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59f55f0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00b1b50 con 0x7f59f005f730 2021-11-15T19:27:03.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59ef7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f005f730 0x7f59f005fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59ee7fc700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f59f013f890 0x7f59f00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59eeffd700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f59f00608f0 0x7f59f00b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:42956/0 (socket says 172.21.2.137:42956) 2021-11-15T19:27:03.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.614+0000 7f59eeffd700 1 -- 172.21.2.137:0/2565574719 learned_addr learned my addr 172.21.2.137:0/2565574719 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:03.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f005f730 msgr2=0x7f59f005fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f005f730 0x7f59f005fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/2565574719 >> v1:172.21.2.111:6789/0 conn(0x7f59f00608f0 legacy=0x7f59f00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/2565574719 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00b0c80 con 0x7f59f013f890 2021-11-15T19:27:03.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ef7fe700 1 --2- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f005f730 0x7f59f005fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:27:03.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f013f890 0x7f59f00b1660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f59e0001110 tx=0x7f59e4006df0).ready entity=mon.0 client_cookie=d600f7a25b03287a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59edffb700 1 -- 172.21.2.137:0/2565574719 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e400d4a0 con 0x7f59f013f890 2021-11-15T19:27:03.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59edffb700 1 -- 172.21.2.137:0/2565574719 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4000e90 con 0x7f59f013f890 2021-11-15T19:27:03.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59edffb700 1 -- 172.21.2.137:0/2565574719 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e400d7f0 con 0x7f59f013f890 2021-11-15T19:27:03.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f013f890 msgr2=0x7f59f00b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 --2- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f013f890 0x7f59f00b1660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f59e0001110 tx=0x7f59e4006df0).stop 2021-11-15T19:27:03.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/2565574719 shutdown_connections 2021-11-15T19:27:03.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 --2- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f005f730 0x7f59f005fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 --2- 172.21.2.137:0/2565574719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f013f890 0x7f59f00b1660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/2565574719 >> 172.21.2.137:0/2565574719 conn(0x7f59f0063980 msgr2=0x7f59f0063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/2565574719 shutdown_connections 2021-11-15T19:27:03.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/2565574719 wait complete. 2021-11-15T19:27:03.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 Processor -- start 2021-11-15T19:27:03.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- start start 2021-11-15T19:27:03.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f005f730 0x7f59f00b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 0x7f59f013b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f013f890 0x7f59f013b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f013ca90 con 0x7f59f005f730 2021-11-15T19:27:03.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f013ebf0 con 0x7f59f00608f0 2021-11-15T19:27:03.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f013a4b0 con 0x7f59f013f890 2021-11-15T19:27:03.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 0x7f59f013b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 0x7f59f013b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59924/0 (socket says 172.21.2.137:59924) 2021-11-15T19:27:03.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/1833453448 learned_addr learned my addr 172.21.2.137:0/1833453448 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:03.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ef7fe700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f013f890 0x7f59f013b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59eeffd700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f005f730 0x7f59f00b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f013f890 msgr2=0x7f59f013b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f013f890 0x7f59f013b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f005f730 msgr2=0x7f59f00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f005f730 0x7f59f00b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 -- 172.21.2.137:0/1833453448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8009470 con 0x7f59f00608f0 2021-11-15T19:27:03.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59ee7fc700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 0x7f59f013b1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f59e0001110 tx=0x7f59e4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e4016070 con 0x7f59f00608f0 2021-11-15T19:27:03.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400de90 con 0x7f59f00608f0 2021-11-15T19:27:03.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e400b180 con 0x7f59f00608f0 2021-11-15T19:27:03.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e4013e90 con 0x7f59f00608f0 2021-11-15T19:27:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.618+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f013bbb0 con 0x7f59f00608f0 2021-11-15T19:27:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f013a670 con 0x7f59f00608f0 2021-11-15T19:27:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f59e4025030 con 0x7f59f00608f0 2021-11-15T19:27:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59dffff700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59cc053660 0x7f59cc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f59e406c920 con 0x7f59f00608f0 2021-11-15T19:27:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59eeffd700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59cc053660 0x7f59cc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59eeffd700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59cc053660 0x7f59cc055b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f59e000d000 tx=0x7f59e0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.622+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f59f013a670 con 0x7f59f00608f0 2021-11-15T19:27:03.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59f013a670 con 0x7f59f00608f0 2021-11-15T19:27:03.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59dffff700 1 -- 172.21.2.137:0/1833453448 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f59f013a670 con 0x7f59f00608f0 2021-11-15T19:27:03.716 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:03.716 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:03.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59cc053660 msgr2=0x7f59cc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59cc053660 0x7f59cc055b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f59e000d000 tx=0x7f59e0009040).stop 2021-11-15T19:27:03.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 msgr2=0x7f59f013b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 0x7f59f013b1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f59e0001110 tx=0x7f59e4014000).stop 2021-11-15T19:27:03.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 shutdown_connections 2021-11-15T19:27:03.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59cc053660 0x7f59cc055b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59f013f890 0x7f59f013b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59f00608f0 0x7f59f013b1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 --2- 172.21.2.137:0/1833453448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59f005f730 0x7f59f00b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 >> 172.21.2.137:0/1833453448 conn(0x7f59f0063980 msgr2=0x7f59f00b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 shutdown_connections 2021-11-15T19:27:03.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.706+0000 7f59f55f0700 1 -- 172.21.2.137:0/1833453448 wait complete. 2021-11-15T19:27:03.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:03.724 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:03.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976e6e0700 1 Processor -- start 2021-11-15T19:27:03.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976e6e0700 1 -- start start 2021-11-15T19:27:03.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976e6e0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97680acd60 0x7f97680b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976e6e0700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680b76c0 con 0x7f97680b72e0 2021-11-15T19:27:03.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976e6e0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976812a170 con 0x7f97680b4680 2021-11-15T19:27:03.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976e6e0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b3100 con 0x7f97680acd60 2021-11-15T19:27:03.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976cc7d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f97680b4680 0x7f97681290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50482/0 (socket says 172.21.2.137:50482) 2021-11-15T19:27:03.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f976cc7d700 1 -- 172.21.2.137:0/743300972 learned_addr learned my addr 172.21.2.137:0/743300972 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:03.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245597845 0 0) 0x7f976812a170 con 0x7f97680b4680 2021-11-15T19:27:03.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9748003260 con 0x7f97680b4680 2021-11-15T19:27:03.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1936856207 0 0) 0x7f9748003260 con 0x7f97680b4680 2021-11-15T19:27:03.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97680acd60 msgr2=0x7f97680b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97680acd60 0x7f97680b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 >> v1:172.21.2.111:6789/0 conn(0x7f97680b72e0 legacy=0x7f97680b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680ad8a0 con 0x7f97680b4680 2021-11-15T19:27:03.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f97600019e0 con 0x7f97680b4680 2021-11-15T19:27:03.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 >> v1:172.21.2.137:6789/0 conn(0x7f97680b4680 legacy=0x7f97681290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97480037d0 0x7f9748003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97680acd60 0x7f9748004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97480049f0 0x7f9748004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b3100 con 0x7f97480049f0 2021-11-15T19:27:03.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748014350 con 0x7f97480037d0 2021-11-15T19:27:03.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748014490 con 0x7f97680acd60 2021-11-15T19:27:03.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.766+0000 7f9767fff700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97480037d0 0x7f9748003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9767fff700 1 -- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97680acd60 msgr2=0x7f9748004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9767fff700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97680acd60 0x7f9748004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9767fff700 1 -- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97480049f0 msgr2=0x7f9748004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9767fff700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97480049f0 0x7f9748004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9767fff700 1 -- 172.21.2.137:0/743300972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748003260 con 0x7f97480037d0 2021-11-15T19:27:03.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9767fff700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97480037d0 0x7f9748003bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9750000f70 tx=0x7f97500079e0).ready entity=mon.1 client_cookie=772e5438287f0454 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9750007cf0 con 0x7f97480037d0 2021-11-15T19:27:03.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750014410 con 0x7f97480037d0 2021-11-15T19:27:03.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f9766ffd700 1 -- 172.21.2.137:0/743300972 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9750014770 con 0x7f97480037d0 2021-11-15T19:27:03.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/743300972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97480037d0 msgr2=0x7f9748003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 --2- 172.21.2.137:0/743300972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97480037d0 0x7f9748003bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9750000f70 tx=0x7f97500079e0).stop 2021-11-15T19:27:03.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976cc7d700 1 -- 172.21.2.137:0/743300972 reap_dead start 2021-11-15T19:27:03.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/743300972 shutdown_connections 2021-11-15T19:27:03.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/743300972 >> 172.21.2.137:0/743300972 conn(0x7f9768064960 msgr2=0x7f9768064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/743300972 shutdown_connections 2021-11-15T19:27:03.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/743300972 wait complete. 2021-11-15T19:27:03.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 Processor -- start 2021-11-15T19:27:03.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- start start 2021-11-15T19:27:03.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97480037d0 0x7f9768128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 0x7f97681516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9768151bd0 0x7f9768065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b20c0 con 0x7f9768151bd0 2021-11-15T19:27:03.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680af3b0 con 0x7f9768140040 2021-11-15T19:27:03.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9768142110 con 0x7f97480037d0 2021-11-15T19:27:03.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 0x7f97681516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 0x7f97681516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59942/0 (socket says 172.21.2.137:59942) 2021-11-15T19:27:03.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 -- 172.21.2.137:0/757386718 learned_addr learned my addr 172.21.2.137:0/757386718 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:03.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 -- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97480037d0 msgr2=0x7f9768128b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97480037d0 0x7f9768128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 -- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9768151bd0 msgr2=0x7f9768065cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9768151bd0 0x7f9768065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 -- 172.21.2.137:0/757386718 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680af610 con 0x7f9768140040 2021-11-15T19:27:03.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97677fe700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 0x7f97681516e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f9768067510 tx=0x7f9758006e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f975800e470 con 0x7f9768140040 2021-11-15T19:27:03.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758000e90 con 0x7f9768140040 2021-11-15T19:27:03.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9768141dd0 con 0x7f9768140040 2021-11-15T19:27:03.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97681404a0 con 0x7f9768140040 2021-11-15T19:27:03.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f975800e800 con 0x7f9768140040 2021-11-15T19:27:03.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9740003410 con 0x7f9768140040 2021-11-15T19:27:03.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.770+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f975800f070 con 0x7f9768140040 2021-11-15T19:27:03.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.774+0000 7f97657fa700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f974c053610 0x7f974c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.774+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f975806ad20 con 0x7f9768140040 2021-11-15T19:27:03.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.774+0000 7f9767fff700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f974c053610 0x7f974c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.774+0000 7f9767fff700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f974c053610 0x7f974c055ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9750000f70 tx=0x7f9750015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.774+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9758041e20 con 0x7f9768140040 2021-11-15T19:27:03.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9740003c40 con 0x7f9768140040 2021-11-15T19:27:03.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f97657fa700 1 -- 172.21.2.137:0/757386718 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9758045440 con 0x7f9768140040 2021-11-15T19:27:03.868 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:03.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f974c053610 msgr2=0x7f974c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f974c053610 0x7f974c055ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9750000f70 tx=0x7f9750015000).stop 2021-11-15T19:27:03.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 msgr2=0x7f97681516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 0x7f97681516e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f9768067510 tx=0x7f9758006e70).stop 2021-11-15T19:27:03.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 shutdown_connections 2021-11-15T19:27:03.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f974c053610 0x7f974c055ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9768151bd0 0x7f9768065cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9768140040 0x7f97681516e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 --2- 172.21.2.137:0/757386718 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97480037d0 0x7f9768128b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 >> 172.21.2.137:0/757386718 conn(0x7f9768064960 msgr2=0x7f97680b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 shutdown_connections 2021-11-15T19:27:03.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.858+0000 7f976e6e0700 1 -- 172.21.2.137:0/757386718 wait complete. 2021-11-15T19:27:03.875 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:03.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 Processor -- start 2021-11-15T19:27:03.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- start start 2021-11-15T19:27:03.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b2400 0x7f4a240b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4a240b3e70 0x7f4a240b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a24146c20 con 0x7f4a240b5330 2021-11-15T19:27:03.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a24142af0 con 0x7f4a240b3e70 2021-11-15T19:27:03.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240b27e0 con 0x7f4a240b2400 2021-11-15T19:27:03.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a237fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4a240b5330 0x7f4a240b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50500/0 (socket says 172.21.2.137:50500) 2021-11-15T19:27:03.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a237fe700 1 -- 172.21.2.137:0/2832514559 learned_addr learned my addr 172.21.2.137:0/2832514559 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:03.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a28fa2700 1 --2- 172.21.2.137:0/2832514559 >> v2:172.21.2.137:3300/0 conn(0x7f4a240b3e70 0x7f4a240b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a28fa2700 1 -- 172.21.2.137:0/2832514559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b2400 msgr2=0x7f4a240b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:03.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a28fa2700 1 --2- 172.21.2.137:0/2832514559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b2400 0x7f4a240b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a28fa2700 1 -- 172.21.2.137:0/2832514559 >> v1:172.21.2.137:6789/0 conn(0x7f4a240b5330 legacy=0x7f4a240b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a28fa2700 1 -- 172.21.2.137:0/2832514559 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240b4d80 con 0x7f4a240b3e70 2021-11-15T19:27:03.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a28fa2700 1 --2- 172.21.2.137:0/2832514559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b3e70 0x7f4a240b5ab0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4a1c0032f0 tx=0x7f4a1c0091d0).ready entity=mon.1 client_cookie=4a25bc763e5a2ec3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a22ffd700 1 -- 172.21.2.137:0/2832514559 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1c009ea0 con 0x7f4a240b3e70 2021-11-15T19:27:03.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a22ffd700 1 -- 172.21.2.137:0/2832514559 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00b8a0 con 0x7f4a240b3e70 2021-11-15T19:27:03.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a22ffd700 1 -- 172.21.2.137:0/2832514559 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1c00ba10 con 0x7f4a240b3e70 2021-11-15T19:27:03.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- 172.21.2.137:0/2832514559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b3e70 msgr2=0x7f4a240b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/2832514559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b3e70 0x7f4a240b5ab0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4a1c0032f0 tx=0x7f4a1c0091d0).stop 2021-11-15T19:27:03.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- 172.21.2.137:0/2832514559 shutdown_connections 2021-11-15T19:27:03.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/2832514559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b3e70 0x7f4a240b5ab0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:03.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/2832514559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b2400 0x7f4a240b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- 172.21.2.137:0/2832514559 >> 172.21.2.137:0/2832514559 conn(0x7f4a240623a0 msgr2=0x7f4a24062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:03.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- 172.21.2.137:0/2832514559 shutdown_connections 2021-11-15T19:27:03.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.918+0000 7f4a2aa05700 1 -- 172.21.2.137:0/2832514559 wait complete. 2021-11-15T19:27:03.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 Processor -- start 2021-11-15T19:27:03.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- start start 2021-11-15T19:27:03.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a240b2400 0x7f4a241435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b3e70 0x7f4a241563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 0x7f4a2415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240af7a0 con 0x7f4a240b2400 2021-11-15T19:27:03.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24140150 con 0x7f4a240b5330 2021-11-15T19:27:03.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24063c80 con 0x7f4a240b3e70 2021-11-15T19:27:03.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 0x7f4a2415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 0x7f4a2415a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59954/0 (socket says 172.21.2.137:59954) 2021-11-15T19:27:03.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 -- 172.21.2.137:0/900363087 learned_addr learned my addr 172.21.2.137:0/900363087 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:03.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 -- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b3e70 msgr2=0x7f4a241563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b3e70 0x7f4a241563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 -- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a240b2400 msgr2=0x7f4a241435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:03.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a240b2400 0x7f4a241435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:03.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 -- 172.21.2.137:0/900363087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009470 con 0x7f4a240b5330 2021-11-15T19:27:03.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a28fa2700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 0x7f4a2415a020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4a24066a60 tx=0x7f4a1c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1c006ea0 con 0x7f4a240b5330 2021-11-15T19:27:03.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c021630 con 0x7f4a240b5330 2021-11-15T19:27:03.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1c021990 con 0x7f4a240b5330 2021-11-15T19:27:03.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a24159b80 con 0x7f4a240b5330 2021-11-15T19:27:03.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a24063700 con 0x7f4a240b5330 2021-11-15T19:27:03.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a24063e80 con 0x7f4a240b5330 2021-11-15T19:27:03.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a1c027020 con 0x7f4a240b5330 2021-11-15T19:27:03.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a217fa700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a080534f0 0x7f4a080559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:03.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4a1c06ce20 con 0x7f4a240b5330 2021-11-15T19:27:03.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.922+0000 7f4a23fff700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a080534f0 0x7f4a080559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:03.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.926+0000 7f4a23fff700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a080534f0 0x7f4a080559b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4a0c002f70 tx=0x7f4a0c006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:03.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:03.926+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a1c043f80 con 0x7f4a240b5330 2021-11-15T19:27:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a24159d10 con 0x7f4a240b5330 2021-11-15T19:27:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a217fa700 1 -- 172.21.2.137:0/900363087 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a1c015020 con 0x7f4a240b5330 2021-11-15T19:27:04.019 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a080534f0 msgr2=0x7f4a080559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a080534f0 0x7f4a080559b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4a0c002f70 tx=0x7f4a0c006a80).stop 2021-11-15T19:27:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 msgr2=0x7f4a2415a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 0x7f4a2415a020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4a24066a60 tx=0x7f4a1c016000).stop 2021-11-15T19:27:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 shutdown_connections 2021-11-15T19:27:04.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a080534f0 0x7f4a080559b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a240b5330 0x7f4a2415a020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a240b3e70 0x7f4a241563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 --2- 172.21.2.137:0/900363087 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a240b2400 0x7f4a241435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 >> 172.21.2.137:0/900363087 conn(0x7f4a240623a0 msgr2=0x7f4a240b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 shutdown_connections 2021-11-15T19:27:04.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.010+0000 7f4a2aa05700 1 -- 172.21.2.137:0/900363087 wait complete. 2021-11-15T19:27:04.026 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:04.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 Processor -- start 2021-11-15T19:27:04.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- start start 2021-11-15T19:27:04.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0400b0fe0 0x7fd0400afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd0400acff0 0x7fd0400af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400aedf0 con 0x7fd04013f5c0 2021-11-15T19:27:04.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400ad4a0 con 0x7fd0400acff0 2021-11-15T19:27:04.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400ae070 con 0x7fd0400b0fe0 2021-11-15T19:27:04.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0400b0fe0 0x7fd0400afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0400b0fe0 0x7fd0400afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59962/0 (socket says 172.21.2.137:59962) 2021-11-15T19:27:04.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 -- 172.21.2.137:0/1918929603 learned_addr learned my addr 172.21.2.137:0/1918929603 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:04.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 -- 172.21.2.137:0/1918929603 >> v2:172.21.2.111:3300/0 conn(0x7fd0400acff0 msgr2=0x7fd0400af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:04.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 --2- 172.21.2.137:0/1918929603 >> v2:172.21.2.111:3300/0 conn(0x7fd0400acff0 0x7fd0400af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 -- 172.21.2.137:0/1918929603 >> v1:172.21.2.111:6789/0 conn(0x7fd04013f5c0 legacy=0x7fd04013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:04.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 -- 172.21.2.137:0/1918929603 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400b13c0 con 0x7fd0400b0fe0 2021-11-15T19:27:04.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd044a05700 1 --2- 172.21.2.137:0/1918929603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd0400afde0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd0400aec90 tx=0x7fd030006f40).ready entity=mon.1 client_cookie=edfd9a5a914eb3ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd03f7fe700 1 -- 172.21.2.137:0/1918929603 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03000dc30 con 0x7fd0400b0fe0 2021-11-15T19:27:04.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd03f7fe700 1 -- 172.21.2.137:0/1918929603 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030000e90 con 0x7fd0400b0fe0 2021-11-15T19:27:04.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd03f7fe700 1 -- 172.21.2.137:0/1918929603 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03000be90 con 0x7fd0400b0fe0 2021-11-15T19:27:04.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- 172.21.2.137:0/1918929603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 msgr2=0x7fd0400afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 --2- 172.21.2.137:0/1918929603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd0400afde0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd0400aec90 tx=0x7fd030006f40).stop 2021-11-15T19:27:04.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- 172.21.2.137:0/1918929603 shutdown_connections 2021-11-15T19:27:04.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 --2- 172.21.2.137:0/1918929603 >> v2:172.21.2.111:3300/0 conn(0x7fd0400acff0 0x7fd0400af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 --2- 172.21.2.137:0/1918929603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd0400afde0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- 172.21.2.137:0/1918929603 >> 172.21.2.137:0/1918929603 conn(0x7fd0400b5f50 msgr2=0x7fd0400b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- 172.21.2.137:0/1918929603 shutdown_connections 2021-11-15T19:27:04.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- 172.21.2.137:0/1918929603 wait complete. 2021-11-15T19:27:04.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 Processor -- start 2021-11-15T19:27:04.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.070+0000 7fd046c69700 1 -- start start 2021-11-15T19:27:04.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400acff0 0x7fd040066470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd040067440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd04013f5c0 0x7fd04005c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040065070 con 0x7fd04013f5c0 2021-11-15T19:27:04.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040065310 con 0x7fd0400b0fe0 2021-11-15T19:27:04.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400638d0 con 0x7fd0400acff0 2021-11-15T19:27:04.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd040067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd040067440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59968/0 (socket says 172.21.2.137:59968) 2021-11-15T19:27:04.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 -- 172.21.2.137:0/3554439661 learned_addr learned my addr 172.21.2.137:0/3554439661 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:04.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 -- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400acff0 msgr2=0x7fd040066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400acff0 0x7fd040066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 -- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd04013f5c0 msgr2=0x7fd04005c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd04013f5c0 0x7fd04005c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 -- 172.21.2.137:0/3554439661 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03000b460 con 0x7fd0400b0fe0 2021-11-15T19:27:04.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03ffff700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd040067440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fd028002f70 tx=0x7fd028006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd028013460 con 0x7fd0400b0fe0 2021-11-15T19:27:04.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0280135c0 con 0x7fd0400b0fe0 2021-11-15T19:27:04.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd028013920 con 0x7fd0400b0fe0 2021-11-15T19:27:04.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04014de90 con 0x7fd0400b0fe0 2021-11-15T19:27:04.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04014e310 con 0x7fd0400b0fe0 2021-11-15T19:27:04.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400ad690 con 0x7fd0400b0fe0 2021-11-15T19:27:04.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd02800f070 con 0x7fd0400b0fe0 2021-11-15T19:27:04.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03dffb700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd024053610 0x7fd024055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd02806b120 con 0x7fd0400b0fe0 2021-11-15T19:27:04.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.074+0000 7fd044a05700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd024053610 0x7fd024055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.078+0000 7fd044a05700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd024053610 0x7fd024055ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd0400aec90 tx=0x7fd030006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.078+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd028068e90 con 0x7fd0400b0fe0 2021-11-15T19:27:04.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.158+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd04014e310 con 0x7fd0400b0fe0 2021-11-15T19:27:04.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.158+0000 7fd03dffb700 1 -- 172.21.2.137:0/3554439661 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd04014e310 con 0x7fd0400b0fe0 2021-11-15T19:27:04.170 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:04.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd024053610 msgr2=0x7fd024055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd024053610 0x7fd024055ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd0400aec90 tx=0x7fd030006f40).stop 2021-11-15T19:27:04.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 msgr2=0x7fd040067440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd040067440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fd028002f70 tx=0x7fd028006ec0).stop 2021-11-15T19:27:04.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 shutdown_connections 2021-11-15T19:27:04.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd024053610 0x7fd024055ad0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd04013f5c0 0x7fd04005c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400b0fe0 0x7fd040067440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 --2- 172.21.2.137:0/3554439661 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400acff0 0x7fd040066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 >> 172.21.2.137:0/3554439661 conn(0x7fd0400b5f50 msgr2=0x7fd04013eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 shutdown_connections 2021-11-15T19:27:04.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.162+0000 7fd046c69700 1 -- 172.21.2.137:0/3554439661 wait complete. 2021-11-15T19:27:04.177 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:04.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.218+0000 7fa65ec71700 1 Processor -- start 2021-11-15T19:27:04.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.218+0000 7fa65ec71700 1 -- start start 2021-11-15T19:27:04.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa6580b0fe0 0x7fa6580afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580aedf0 con 0x7fa6580acff0 2021-11-15T19:27:04.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580afbd0 con 0x7fa65813f5c0 2021-11-15T19:27:04.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6580ad4a0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65d20e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa65813f5c0 0x7fa65813c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50530/0 (socket says 172.21.2.137:50530) 2021-11-15T19:27:04.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65d20e700 1 -- 172.21.2.137:0/2126763946 learned_addr learned my addr 172.21.2.137:0/2126763946 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:04.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ca0d700 1 --2- 172.21.2.137:0/2126763946 >> v2:172.21.2.137:3300/0 conn(0x7fa6580b0fe0 0x7fa6580afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ca0d700 1 -- 172.21.2.137:0/2126763946 >> v1:172.21.2.137:6789/0 conn(0x7fa65813f5c0 legacy=0x7fa65813c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ca0d700 1 -- 172.21.2.137:0/2126763946 >> v1:172.21.2.111:6789/0 conn(0x7fa6580acff0 legacy=0x7fa6580af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:04.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ca0d700 1 -- 172.21.2.137:0/2126763946 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580b13c0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ca0d700 1 --2- 172.21.2.137:0/2126763946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa6580afde0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fa6580aec90 tx=0x7fa640006df0).ready entity=mon.1 client_cookie=a463cecf17b06aa6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa6577fe700 1 -- 172.21.2.137:0/2126763946 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64000d4a0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa6577fe700 1 -- 172.21.2.137:0/2126763946 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640000e90 con 0x7fa6580b0fe0 2021-11-15T19:27:04.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa6577fe700 1 -- 172.21.2.137:0/2126763946 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64000d7f0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2126763946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 msgr2=0x7fa6580afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2126763946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa6580afde0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fa6580aec90 tx=0x7fa640006df0).stop 2021-11-15T19:27:04.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2126763946 shutdown_connections 2021-11-15T19:27:04.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2126763946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa6580afde0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2126763946 >> 172.21.2.137:0/2126763946 conn(0x7fa6580b5f50 msgr2=0x7fa6580b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2126763946 shutdown_connections 2021-11-15T19:27:04.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2126763946 wait complete. 2021-11-15T19:27:04.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 Processor -- start 2021-11-15T19:27:04.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- start start 2021-11-15T19:27:04.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6580acff0 0x7fa658152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa658142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa65813f5c0 0x7fa658110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65810ff30 con 0x7fa6580acff0 2021-11-15T19:27:04.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658064ee0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa658065180 con 0x7fa65813f5c0 2021-11-15T19:27:04.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa658142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa658142710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59986/0 (socket says 172.21.2.137:59986) 2021-11-15T19:27:04.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 -- 172.21.2.137:0/2970601863 learned_addr learned my addr 172.21.2.137:0/2970601863 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:04.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 -- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa65813f5c0 msgr2=0x7fa658110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa65813f5c0 0x7fa658110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 -- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6580acff0 msgr2=0x7fa658152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6580acff0 0x7fa658152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 -- 172.21.2.137:0/2970601863 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64000b180 con 0x7fa6580b0fe0 2021-11-15T19:27:04.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa657fff700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa658142710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa648002f90 tx=0x7fa648006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa648013460 con 0x7fa6580b0fe0 2021-11-15T19:27:04.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6480135c0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa648013920 con 0x7fa6580b0fe0 2021-11-15T19:27:04.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658064b60 con 0x7fa6580b0fe0 2021-11-15T19:27:04.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.222+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa658142e20 con 0x7fa6580b0fe0 2021-11-15T19:27:04.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6581100a0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa64800f070 con 0x7fa6580b0fe0 2021-11-15T19:27:04.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa655ffb700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa63c053640 0x7fa63c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa64806b0e0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa65ca0d700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa63c053640 0x7fa63c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa65ca0d700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa63c053640 0x7fa63c055b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa6580aec90 tx=0x7fa640014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.226+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6581100a0 con 0x7fa6580b0fe0 2021-11-15T19:27:04.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.310+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa658064d50 con 0x7fa6580b0fe0 2021-11-15T19:27:04.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.310+0000 7fa655ffb700 1 -- 172.21.2.137:0/2970601863 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa648042240 con 0x7fa6580b0fe0 2021-11-15T19:27:04.322 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:04.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa63c053640 msgr2=0x7fa63c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa63c053640 0x7fa63c055b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa6580aec90 tx=0x7fa640014000).stop 2021-11-15T19:27:04.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 msgr2=0x7fa658142710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa658142710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa648002f90 tx=0x7fa648006df0).stop 2021-11-15T19:27:04.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 shutdown_connections 2021-11-15T19:27:04.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa63c053640 0x7fa63c055b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa65813f5c0 0x7fa658110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6580b0fe0 0x7fa658142710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 --2- 172.21.2.137:0/2970601863 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6580acff0 0x7fa658152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 >> 172.21.2.137:0/2970601863 conn(0x7fa6580b5f50 msgr2=0x7fa6580b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 shutdown_connections 2021-11-15T19:27:04.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.314+0000 7fa65ec71700 1 -- 172.21.2.137:0/2970601863 wait complete. 2021-11-15T19:27:04.329 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:27:04.329 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:04.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 Processor -- start 2021-11-15T19:27:04.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 -- start start 2021-11-15T19:27:04.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa813f890 0x7f4aa80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4aa805f730 0x7f4aa805fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa8060070 con 0x7f4aa80608f0 2021-11-15T19:27:04.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80ad6c0 con 0x7f4aa805f730 2021-11-15T19:27:04.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aae348700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80b1b50 con 0x7f4aa813f890 2021-11-15T19:27:04.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4aa805f730 0x7f4aa805fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4aa805f730 0x7f4aa805fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59990/0 (socket says 172.21.2.137:59990) 2021-11-15T19:27:04.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 -- 172.21.2.137:0/382215622 learned_addr learned my addr 172.21.2.137:0/382215622 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:04.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 -- 172.21.2.137:0/382215622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa813f890 msgr2=0x7f4aa80b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:04.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 --2- 172.21.2.137:0/382215622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa813f890 0x7f4aa80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 -- 172.21.2.137:0/382215622 >> v1:172.21.2.111:6789/0 conn(0x7f4aa80608f0 legacy=0x7f4aa80b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:04.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 -- 172.21.2.137:0/382215622 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80b0c80 con 0x7f4aa805f730 2021-11-15T19:27:04.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aac8e5700 1 --2- 172.21.2.137:0/382215622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa805f730 0x7f4aa805fb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f4aa80b3ac0 tx=0x7f4aa000b530).ready entity=mon.1 client_cookie=1bf3e508e2b42ded server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aa6ffd700 1 -- 172.21.2.137:0/382215622 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa000be70 con 0x7f4aa805f730 2021-11-15T19:27:04.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aa6ffd700 1 -- 172.21.2.137:0/382215622 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0010470 con 0x7f4aa805f730 2021-11-15T19:27:04.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.370+0000 7f4aa6ffd700 1 -- 172.21.2.137:0/382215622 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0010810 con 0x7f4aa805f730 2021-11-15T19:27:04.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/382215622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa805f730 msgr2=0x7f4aa805fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 --2- 172.21.2.137:0/382215622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa805f730 0x7f4aa805fb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f4aa80b3ac0 tx=0x7f4aa000b530).stop 2021-11-15T19:27:04.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/382215622 shutdown_connections 2021-11-15T19:27:04.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 --2- 172.21.2.137:0/382215622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa805f730 0x7f4aa805fb80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 --2- 172.21.2.137:0/382215622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa813f890 0x7f4aa80b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/382215622 >> 172.21.2.137:0/382215622 conn(0x7f4aa8063980 msgr2=0x7f4aa8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/382215622 shutdown_connections 2021-11-15T19:27:04.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/382215622 wait complete. 2021-11-15T19:27:04.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 Processor -- start 2021-11-15T19:27:04.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- start start 2021-11-15T19:27:04.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aa805f730 0x7f4aa8151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa80608f0 0x7f4aa8143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 0x7f4aa81282e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8151260 con 0x7f4aa805f730 2021-11-15T19:27:04.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8151500 con 0x7f4aa813f890 2021-11-15T19:27:04.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa81517a0 con 0x7f4aa80608f0 2021-11-15T19:27:04.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 0x7f4aa81282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 0x7f4aa81282e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:59998/0 (socket says 172.21.2.137:59998) 2021-11-15T19:27:04.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 -- 172.21.2.137:0/974269759 learned_addr learned my addr 172.21.2.137:0/974269759 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:04.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 -- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa80608f0 msgr2=0x7f4aa8143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa80608f0 0x7f4aa8143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 -- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aa805f730 msgr2=0x7f4aa8151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aa805f730 0x7f4aa8151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 -- 172.21.2.137:0/974269759 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa000b7d0 con 0x7f4aa813f890 2021-11-15T19:27:04.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aac8e5700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 0x7f4aa81282e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4aa80b3ac0 tx=0x7f4aa000b530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0018760 con 0x7f4aa813f890 2021-11-15T19:27:04.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa00188c0 con 0x7f4aa813f890 2021-11-15T19:27:04.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa8143500 con 0x7f4aa813f890 2021-11-15T19:27:04.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa813b8c0 con 0x7f4aa813f890 2021-11-15T19:27:04.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0018c20 con 0x7f4aa813f890 2021-11-15T19:27:04.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa813eca0 con 0x7f4aa813f890 2021-11-15T19:27:04.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4aa0021020 con 0x7f4aa813f890 2021-11-15T19:27:04.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aa57fa700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a880536f0 0x7f4a88055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:04.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.374+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4aa006fc40 con 0x7f4aa813f890 2021-11-15T19:27:04.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.378+0000 7f4aa7fff700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a880536f0 0x7f4a88055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:04.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.378+0000 7f4aa7fff700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a880536f0 0x7f4a88055bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4a98002f90 tx=0x7f4a980069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:04.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.378+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4aa813eca0 con 0x7f4aa813f890 2021-11-15T19:27:04.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4aa813eca0 con 0x7f4aa813f890 2021-11-15T19:27:04.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aa57fa700 1 -- 172.21.2.137:0/974269759 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f4aa813eca0 con 0x7f4aa813f890 2021-11-15T19:27:04.497 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:04.497 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:26:56.084069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.111:6835/2773926386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2773926386},{"type":"v1","addr":"172.21.2.111:6835","nonce":2773926386}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:27:04.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a880536f0 msgr2=0x7f4a88055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a880536f0 0x7f4a88055bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4a98002f90 tx=0x7f4a980069b0).stop 2021-11-15T19:27:04.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 msgr2=0x7f4aa81282e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:04.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 0x7f4aa81282e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4aa80b3ac0 tx=0x7f4aa000b530).stop 2021-11-15T19:27:04.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 shutdown_connections 2021-11-15T19:27:04.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a880536f0 0x7f4a88055bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aa813f890 0x7f4aa81282e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:04.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aa80608f0 0x7f4aa8143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 --2- 172.21.2.137:0/974269759 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aa805f730 0x7f4aa8151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:04.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 >> 172.21.2.137:0/974269759 conn(0x7f4aa8063980 msgr2=0x7f4aa80b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:04.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 shutdown_connections 2021-11-15T19:27:04.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:04.486+0000 7f4aae348700 1 -- 172.21.2.137:0/974269759 wait complete. 2021-11-15T19:27:04.501 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 5 2021-11-15T19:27:04.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:26:55.077984+0000', 'modified': '2021-11-15T19:26:56.084069+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.2.111:6835/2773926386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 2773926386}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 2773926386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:27:04.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:27:04.707 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:27:04.770 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":9.681632188,"mdsmap_epoch":5,"osdmap_epoch":21,"osdmap_epoch_barrier":21,"uptime":11.837991150000001} 2021-11-15T19:27:04.771 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 21, "osdmap_epoch_barrier": 21, "rank_uptime": 9.681632188, "state": "up:active", "uptime": 11.83799115, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:27:04.771 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:27:04.771 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:27:04.772 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:27:04.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:04.773 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:04.783 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:27:04.795 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:04.795 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:04.843 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:04.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:04.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:04.845 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:27:04.850 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:27:04.850 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:04.853 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:27:04.861 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:04.862 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:04.910 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:04.911 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:04.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:04.912 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:27:04.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:27:04.925+0000 7fcca09ee080 -1 init, newargv = 0x55dcd03078d0 newargc=9 2021-11-15T19:27:04.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14046]: starting ceph client 2021-11-15T19:27:04.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14046]: starting fuse 2021-11-15T19:27:06.018 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:27:06.030 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:06.030 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:06.092 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:06.094 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:06.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:06.095 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:27:06.104 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:27:06.104 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:27:06.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:06.105 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:27:06.105 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:27:06.106 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:27:06.106 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:27:06.106 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:27:06.107 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:06.107 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:27:06.107 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:27:06.108 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:27:06.108 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:06.108 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:27:06.109 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:27:06.109 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:27:06.109 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:27:06.110 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:06.110 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:27:06.110 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:27:06.111 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:27:06.111 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:27:06.111 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:27:06.112 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:06.112 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:27:06.112 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:27:06.146 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14046.asok 2021-11-15T19:27:06.148 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14046.asok 2021-11-15T19:27:06.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:06.149 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14046.asok status 2021-11-15T19:27:06.257 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:27:06.257 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:27:06.257 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:27:06.257 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:27:06.258 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:27:06.258 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:27:06.258 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:27:06.258 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14046", 2021-11-15T19:27:06.259 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:27:06.259 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:06.259 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:27:06.259 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:27:06.260 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4359, 2021-11-15T19:27:06.260 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:27:06.260 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:27:06.260 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:27:06.260 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4359 2021-11-15T19:27:06.261 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:06.261 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:27:06.261 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:27:06.261 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:27:06.262 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 3706298846 2021-11-15T19:27:06.262 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:27:06.262 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:06.262 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:27:06.262 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:27:06.263 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:27:06.263 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 3706298846 2021-11-15T19:27:06.263 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:06.263 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4359 172.21.2.131:0/3706298846", 2021-11-15T19:27:06.263 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/3706298846", 2021-11-15T19:27:06.264 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:27:06.264 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 5, 2021-11-15T19:27:06.264 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 21, 2021-11-15T19:27:06.264 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:27:06.264 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:27:06.265 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:27:06.265 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:27:06.267 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:06.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 Processor -- start 2021-11-15T19:27:06.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- start start 2021-11-15T19:27:06.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7a840acab0 0x7f7a840b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840b1180 0x7f7a840b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7a840af2f0 0x7f7a84142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a840aecf0 con 0x7f7a840acab0 2021-11-15T19:27:06.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8413f180 con 0x7f7a840af2f0 2021-11-15T19:27:06.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a840aef20 con 0x7f7a840b1180 2021-11-15T19:27:06.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7a840af2f0 0x7f7a84142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7a840af2f0 0x7f7a84142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60004/0 (socket says 172.21.2.137:60004) 2021-11-15T19:27:06.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 -- 172.21.2.137:0/2438837694 learned_addr learned my addr 172.21.2.137:0/2438837694 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 -- 172.21.2.137:0/2438837694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840b1180 msgr2=0x7f7a840b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 --2- 172.21.2.137:0/2438837694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840b1180 0x7f7a840b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 -- 172.21.2.137:0/2438837694 >> v2:172.21.2.111:3300/0 conn(0x7f7a840acab0 msgr2=0x7f7a840b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 --2- 172.21.2.137:0/2438837694 >> v2:172.21.2.111:3300/0 conn(0x7f7a840acab0 0x7f7a840b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 -- 172.21.2.137:0/2438837694 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840ace90 con 0x7f7a840af2f0 2021-11-15T19:27:06.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a837fe700 1 --2- 172.21.2.137:0/2438837694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84142b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7a7c0032f0 tx=0x7f7a7c00b530).ready entity=mon.1 client_cookie=8a5b6afac62d755f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a81ffb700 1 -- 172.21.2.137:0/2438837694 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7c00dd00 con 0x7f7a840af2f0 2021-11-15T19:27:06.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a81ffb700 1 -- 172.21.2.137:0/2438837694 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00de60 con 0x7f7a840af2f0 2021-11-15T19:27:06.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a81ffb700 1 -- 172.21.2.137:0/2438837694 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7c012640 con 0x7f7a840af2f0 2021-11-15T19:27:06.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- 172.21.2.137:0/2438837694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 msgr2=0x7f7a84142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- 172.21.2.137:0/2438837694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84142b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7a7c0032f0 tx=0x7f7a7c00b530).stop 2021-11-15T19:27:06.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- 172.21.2.137:0/2438837694 shutdown_connections 2021-11-15T19:27:06.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- 172.21.2.137:0/2438837694 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84142b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- 172.21.2.137:0/2438837694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840b1180 0x7f7a840b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- 172.21.2.137:0/2438837694 >> v2:172.21.2.111:3300/0 conn(0x7f7a840acab0 0x7f7a840b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- 172.21.2.137:0/2438837694 >> 172.21.2.137:0/2438837694 conn(0x7f7a840630f0 msgr2=0x7f7a840634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- 172.21.2.137:0/2438837694 shutdown_connections 2021-11-15T19:27:06.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- 172.21.2.137:0/2438837694 wait complete. 2021-11-15T19:27:06.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 Processor -- start 2021-11-15T19:27:06.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 -- start start 2021-11-15T19:27:06.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.314+0000 7f7a89537700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840acab0 0x7f7a841140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84066530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7a840b1180 0x7f7a8414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8414dd70 con 0x7f7a840b1180 2021-11-15T19:27:06.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8414dfc0 con 0x7f7a840af2f0 2021-11-15T19:27:06.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8414e260 con 0x7f7a840acab0 2021-11-15T19:27:06.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60012/0 (socket says 172.21.2.137:60012) 2021-11-15T19:27:06.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 -- 172.21.2.137:0/2244230386 learned_addr learned my addr 172.21.2.137:0/2244230386 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 -- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840acab0 msgr2=0x7f7a841140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840acab0 0x7f7a841140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 -- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7a840b1180 msgr2=0x7f7a8414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7a840b1180 0x7f7a8414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 -- 172.21.2.137:0/2244230386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c00b7d0 con 0x7f7a840af2f0 2021-11-15T19:27:06.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a827fc700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84066530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7a74002f70 tx=0x7f7a74006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7400e470 con 0x7f7a840af2f0 2021-11-15T19:27:06.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7400e5d0 con 0x7f7a840af2f0 2021-11-15T19:27:06.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8414e500 con 0x7f7a840af2f0 2021-11-15T19:27:06.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7400e930 con 0x7f7a840af2f0 2021-11-15T19:27:06.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a84110050 con 0x7f7a840af2f0 2021-11-15T19:27:06.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8414e690 con 0x7f7a840af2f0 2021-11-15T19:27:06.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a74018030 con 0x7f7a840af2f0 2021-11-15T19:27:06.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a7bfff700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7a68053610 0x7f7a68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7a7406ae30 con 0x7f7a840af2f0 2021-11-15T19:27:06.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.318+0000 7f7a82ffd700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7a68053610 0x7f7a68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.322+0000 7f7a82ffd700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7a68053610 0x7f7a68055ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7a6c002f70 tx=0x7f7a6c006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.322+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a74041f30 con 0x7f7a840af2f0 2021-11-15T19:27:06.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a840b1820 con 0x7f7a840af2f0 2021-11-15T19:27:06.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a7bfff700 1 -- 172.21.2.137:0/2244230386 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f7a74023ec0 con 0x7f7a840af2f0 2021-11-15T19:27:06.415 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:06.415 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:06.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7a68053610 msgr2=0x7f7a68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7a68053610 0x7f7a68055ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7a6c002f70 tx=0x7f7a6c006a80).stop 2021-11-15T19:27:06.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 msgr2=0x7f7a84066530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84066530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7a74002f70 tx=0x7f7a74006db0).stop 2021-11-15T19:27:06.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 shutdown_connections 2021-11-15T19:27:06.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7a68053610 0x7f7a68055ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7a840b1180 0x7f7a8414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7a840af2f0 0x7f7a84066530 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 --2- 172.21.2.137:0/2244230386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7a840acab0 0x7f7a841140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 >> 172.21.2.137:0/2244230386 conn(0x7f7a840630f0 msgr2=0x7f7a84140700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 shutdown_connections 2021-11-15T19:27:06.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.406+0000 7f7a89537700 1 -- 172.21.2.137:0/2244230386 wait complete. 2021-11-15T19:27:06.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:06.424 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:06.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 Processor -- start 2021-11-15T19:27:06.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 -- start start 2021-11-15T19:27:06.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd7040acd60 0x7fd7040b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd7040b4680 0x7fd7041290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7040b76c0 con 0x7fd7040b72e0 2021-11-15T19:27:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7040b3100 con 0x7fd7040acd60 2021-11-15T19:27:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70c0fc700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7040b20c0 con 0x7fd7040b4680 2021-11-15T19:27:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70a699700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd7040b4680 0x7fd7041290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd709e98700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd7040b72e0 0x7fd7040b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50568/0 (socket says 172.21.2.137:50568) 2021-11-15T19:27:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd709e98700 1 -- 172.21.2.137:0/180354173 learned_addr learned my addr 172.21.2.137:0/180354173 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70a699700 1 -- 172.21.2.137:0/180354173 >> v2:172.21.2.111:3300/0 conn(0x7fd7040acd60 msgr2=0x7fd7040b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70a699700 1 --2- 172.21.2.137:0/180354173 >> v2:172.21.2.111:3300/0 conn(0x7fd7040acd60 0x7fd7040b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70a699700 1 -- 172.21.2.137:0/180354173 >> v1:172.21.2.137:6789/0 conn(0x7fd7040b72e0 legacy=0x7fd7040b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70a699700 1 -- 172.21.2.137:0/180354173 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70412a170 con 0x7fd7040b4680 2021-11-15T19:27:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd70a699700 1 --2- 172.21.2.137:0/180354173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd7041290c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fd6fc0032f0 tx=0x7fd6fc0091d0).ready entity=mon.1 client_cookie=2eae0d248f0a2d3b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd708e96700 1 -- 172.21.2.137:0/180354173 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6fc009ea0 con 0x7fd7040b4680 2021-11-15T19:27:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd708e96700 1 -- 172.21.2.137:0/180354173 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc00b870 con 0x7fd7040b4680 2021-11-15T19:27:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.466+0000 7fd708e96700 1 -- 172.21.2.137:0/180354173 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6fc00b9e0 con 0x7fd7040b4680 2021-11-15T19:27:06.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/180354173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 msgr2=0x7fd7041290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/180354173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd7041290c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fd6fc0032f0 tx=0x7fd6fc0091d0).stop 2021-11-15T19:27:06.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/180354173 shutdown_connections 2021-11-15T19:27:06.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/180354173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd7041290c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/180354173 >> v2:172.21.2.111:3300/0 conn(0x7fd7040acd60 0x7fd7040b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/180354173 >> 172.21.2.137:0/180354173 conn(0x7fd704064960 msgr2=0x7fd704064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/180354173 shutdown_connections 2021-11-15T19:27:06.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/180354173 wait complete. 2021-11-15T19:27:06.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 Processor -- start 2021-11-15T19:27:06.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- start start 2021-11-15T19:27:06.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7040acd60 0x7fd704124ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd704159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7040b72e0 0x7fd7040b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70415a950 con 0x7fd7040b72e0 2021-11-15T19:27:06.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704144530 con 0x7fd7040b4680 2021-11-15T19:27:06.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd704143d50 con 0x7fd7040acd60 2021-11-15T19:27:06.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd704159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd704159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60026/0 (socket says 172.21.2.137:60026) 2021-11-15T19:27:06.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 -- 172.21.2.137:0/3672328691 learned_addr learned my addr 172.21.2.137:0/3672328691 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 -- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7040acd60 msgr2=0x7fd704124ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7040acd60 0x7fd704124ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 -- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7040b72e0 msgr2=0x7fd7040b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7040b72e0 0x7fd7040b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 -- 172.21.2.137:0/3672328691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009470 con 0x7fd7040b4680 2021-11-15T19:27:06.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd709697700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd704159a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd7040b0520 tx=0x7fd700006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd700013460 con 0x7fd7040b4680 2021-11-15T19:27:06.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000135c0 con 0x7fd7040b4680 2021-11-15T19:27:06.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd700013920 con 0x7fd7040b4680 2021-11-15T19:27:06.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd704143ff0 con 0x7fd7040b4680 2021-11-15T19:27:06.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd704142e70 con 0x7fd7040b4680 2021-11-15T19:27:06.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd704144a50 con 0x7fd7040b4680 2021-11-15T19:27:06.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd70001a060 con 0x7fd7040b4680 2021-11-15T19:27:06.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd6f6ffd700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6e40536f0 0x7fd6e4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.470+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd70006b3b0 con 0x7fd7040b4680 2021-11-15T19:27:06.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.474+0000 7fd709e98700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6e40536f0 0x7fd6e4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.474+0000 7fd709e98700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6e40536f0 0x7fd6e4055bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd704065c40 tx=0x7fd6f8007820).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.474+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd704144a50 con 0x7fd7040b4680 2021-11-15T19:27:06.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd704144a50 con 0x7fd7040b4680 2021-11-15T19:27:06.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd6f6ffd700 1 -- 172.21.2.137:0/3672328691 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd704144a50 con 0x7fd7040b4680 2021-11-15T19:27:06.567 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:06.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6e40536f0 msgr2=0x7fd6e4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6e40536f0 0x7fd6e4055bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd704065c40 tx=0x7fd6f8007820).stop 2021-11-15T19:27:06.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 msgr2=0x7fd704159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd704159a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd7040b0520 tx=0x7fd700006ec0).stop 2021-11-15T19:27:06.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 shutdown_connections 2021-11-15T19:27:06.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6e40536f0 0x7fd6e4055bb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7040b72e0 0x7fd7040b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7040b4680 0x7fd704159a10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 --2- 172.21.2.137:0/3672328691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7040acd60 0x7fd704124ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 >> 172.21.2.137:0/3672328691 conn(0x7fd704064960 msgr2=0x7fd70413ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 shutdown_connections 2021-11-15T19:27:06.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.558+0000 7fd70c0fc700 1 -- 172.21.2.137:0/3672328691 wait complete. 2021-11-15T19:27:06.574 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:06.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 Processor -- start 2021-11-15T19:27:06.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- start start 2021-11-15T19:27:06.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5af40b72e0 0x7f5af40b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5af40ad320 0x7f5af41290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af40b76c0 con 0x7f5af40acd60 2021-11-15T19:27:06.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af40b3100 con 0x7f5af40ad320 2021-11-15T19:27:06.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af412a170 con 0x7f5af40b72e0 2021-11-15T19:27:06.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5af40b72e0 0x7f5af40b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5af40b72e0 0x7f5af40b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60032/0 (socket says 172.21.2.137:60032) 2021-11-15T19:27:06.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 -- 172.21.2.137:0/1148563073 learned_addr learned my addr 172.21.2.137:0/1148563073 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 -- 172.21.2.137:0/1148563073 >> v2:172.21.2.111:3300/0 conn(0x7f5af40ad320 msgr2=0x7f5af41290c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:06.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 --2- 172.21.2.137:0/1148563073 >> v2:172.21.2.111:3300/0 conn(0x7f5af40ad320 0x7f5af41290c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 -- 172.21.2.137:0/1148563073 >> v1:172.21.2.111:6789/0 conn(0x7f5af40acd60 legacy=0x7f5af40b4190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:06.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 -- 172.21.2.137:0/1148563073 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40ad8a0 con 0x7f5af40b72e0 2021-11-15T19:27:06.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af3fff700 1 --2- 172.21.2.137:0/1148563073 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40b72e0 0x7f5af40b19b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5af4065c40 tx=0x7f5adc006eb0).ready entity=mon.1 client_cookie=abbb02edd6916024 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af2ffd700 1 -- 172.21.2.137:0/1148563073 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc00d5c0 con 0x7f5af40b72e0 2021-11-15T19:27:06.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af2ffd700 1 -- 172.21.2.137:0/1148563073 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc000e90 con 0x7f5af40b72e0 2021-11-15T19:27:06.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5af2ffd700 1 -- 172.21.2.137:0/1148563073 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc00d910 con 0x7f5af40b72e0 2021-11-15T19:27:06.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- 172.21.2.137:0/1148563073 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40b72e0 msgr2=0x7f5af40b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 --2- 172.21.2.137:0/1148563073 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40b72e0 0x7f5af40b19b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5af4065c40 tx=0x7f5adc006eb0).stop 2021-11-15T19:27:06.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- 172.21.2.137:0/1148563073 shutdown_connections 2021-11-15T19:27:06.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 --2- 172.21.2.137:0/1148563073 >> v2:172.21.2.111:3300/0 conn(0x7f5af40ad320 0x7f5af41290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 --2- 172.21.2.137:0/1148563073 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40b72e0 0x7f5af40b19b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- 172.21.2.137:0/1148563073 >> 172.21.2.137:0/1148563073 conn(0x7f5af4064960 msgr2=0x7f5af4064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- 172.21.2.137:0/1148563073 shutdown_connections 2021-11-15T19:27:06.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- 172.21.2.137:0/1148563073 wait complete. 2021-11-15T19:27:06.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 Processor -- start 2021-11-15T19:27:06.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.618+0000 7f5afa415700 1 -- start start 2021-11-15T19:27:06.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 0x7f5af413efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5af40ad320 0x7f5af4135cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5af40b72e0 0x7f5af4128380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b1500 con 0x7f5af40b72e0 2021-11-15T19:27:06.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b0fc0 con 0x7f5af40acd60 2021-11-15T19:27:06.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b1260 con 0x7f5af40ad320 2021-11-15T19:27:06.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 0x7f5af413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 0x7f5af413efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60038/0 (socket says 172.21.2.137:60038) 2021-11-15T19:27:06.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 -- 172.21.2.137:0/663124031 learned_addr learned my addr 172.21.2.137:0/663124031 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 -- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5af40ad320 msgr2=0x7f5af4135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5af40ad320 0x7f5af4135cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 -- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5af40b72e0 msgr2=0x7f5af4128380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5af40b72e0 0x7f5af4128380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 -- 172.21.2.137:0/663124031 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc00b1e0 con 0x7f5af40acd60 2021-11-15T19:27:06.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af3fff700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 0x7f5af413efc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5af40af9e0 tx=0x7f5adc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc002f70 con 0x7f5af40acd60 2021-11-15T19:27:06.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc00de70 con 0x7f5af40acd60 2021-11-15T19:27:06.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af4156370 con 0x7f5af40acd60 2021-11-15T19:27:06.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af40b05f0 con 0x7f5af40acd60 2021-11-15T19:27:06.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc011e90 con 0x7f5af40acd60 2021-11-15T19:27:06.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af4159940 con 0x7f5af40acd60 2021-11-15T19:27:06.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5adc025030 con 0x7f5af40acd60 2021-11-15T19:27:06.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af17fa700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ad8053660 0x7f5ad8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5adc06cdc0 con 0x7f5af40acd60 2021-11-15T19:27:06.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.622+0000 7f5af37fe700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ad8053660 0x7f5ad8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.626+0000 7f5af37fe700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ad8053660 0x7f5ad8055b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5ae4002fb0 tx=0x7f5ae40069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.626+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5adc043f20 con 0x7f5af40acd60 2021-11-15T19:27:06.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5af40b3a50 con 0x7f5af40acd60 2021-11-15T19:27:06.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5af17fa700 1 -- 172.21.2.137:0/663124031 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5adc047540 con 0x7f5af40acd60 2021-11-15T19:27:06.720 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:06.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ad8053660 msgr2=0x7f5ad8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ad8053660 0x7f5ad8055b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5ae4002fb0 tx=0x7f5ae40069b0).stop 2021-11-15T19:27:06.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 msgr2=0x7f5af413efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 0x7f5af413efc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5af40af9e0 tx=0x7f5adc015000).stop 2021-11-15T19:27:06.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 shutdown_connections 2021-11-15T19:27:06.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ad8053660 0x7f5ad8055b20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5af40b72e0 0x7f5af4128380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5af40ad320 0x7f5af4135cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 --2- 172.21.2.137:0/663124031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5af40acd60 0x7f5af413efc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 >> 172.21.2.137:0/663124031 conn(0x7f5af4064960 msgr2=0x7f5af405c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 shutdown_connections 2021-11-15T19:27:06.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.710+0000 7f5afa415700 1 -- 172.21.2.137:0/663124031 wait complete. 2021-11-15T19:27:06.726 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:06.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 Processor -- start 2021-11-15T19:27:06.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- start start 2021-11-15T19:27:06.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000b0fe0 0x7fd3000afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3000acff0 0x7fd3000af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3000aedf0 con 0x7fd30013f5c0 2021-11-15T19:27:06.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3000ae070 con 0x7fd3000acff0 2021-11-15T19:27:06.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3000ad470 con 0x7fd3000b0fe0 2021-11-15T19:27:06.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd304f62700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd30013f5c0 0x7fd30013c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50596/0 (socket says 172.21.2.137:50596) 2021-11-15T19:27:06.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd304f62700 1 -- 172.21.2.137:0/69133542 learned_addr learned my addr 172.21.2.137:0/69133542 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:06.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2ff7fe700 1 --2- 172.21.2.137:0/69133542 >> v2:172.21.2.137:3300/0 conn(0x7fd3000acff0 0x7fd3000af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2feffd700 1 -- 172.21.2.137:0/69133542 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228803399 0 0) 0x7fd3000aedf0 con 0x7fd30013f5c0 2021-11-15T19:27:06.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2feffd700 1 -- 172.21.2.137:0/69133542 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e0003260 con 0x7fd30013f5c0 2021-11-15T19:27:06.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/69133542 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000b0fe0 msgr2=0x7fd3000afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2ff7fe700 1 --2- 172.21.2.137:0/69133542 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000b0fe0 0x7fd3000afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/69133542 >> v1:172.21.2.137:6789/0 conn(0x7fd30013f5c0 legacy=0x7fd30013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/69133542 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3000b13c0 con 0x7fd3000acff0 2021-11-15T19:27:06.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2ff7fe700 1 --2- 172.21.2.137:0/69133542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000acff0 0x7fd3000af4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd2f0002f70 tx=0x7fd2f0006df0).ready entity=mon.1 client_cookie=b7a2dedd6d228e15 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2feffd700 1 -- 172.21.2.137:0/69133542 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f000d570 con 0x7fd3000acff0 2021-11-15T19:27:06.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2feffd700 1 -- 172.21.2.137:0/69133542 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f0000e90 con 0x7fd3000acff0 2021-11-15T19:27:06.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd2feffd700 1 -- 172.21.2.137:0/69133542 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f000d8c0 con 0x7fd3000acff0 2021-11-15T19:27:06.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- 172.21.2.137:0/69133542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000acff0 msgr2=0x7fd3000af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- 172.21.2.137:0/69133542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000acff0 0x7fd3000af4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd2f0002f70 tx=0x7fd2f0006df0).stop 2021-11-15T19:27:06.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- 172.21.2.137:0/69133542 shutdown_connections 2021-11-15T19:27:06.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- 172.21.2.137:0/69133542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000acff0 0x7fd3000af4c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- 172.21.2.137:0/69133542 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000b0fe0 0x7fd3000afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- 172.21.2.137:0/69133542 >> 172.21.2.137:0/69133542 conn(0x7fd3000b5f50 msgr2=0x7fd3000b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- 172.21.2.137:0/69133542 shutdown_connections 2021-11-15T19:27:06.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- 172.21.2.137:0/69133542 wait complete. 2021-11-15T19:27:06.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 Processor -- start 2021-11-15T19:27:06.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 -- start start 2021-11-15T19:27:06.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000acff0 0x7fd3000603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.770+0000 7fd3069c5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 0x7fd300144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd30013f5c0 0x7fd3001422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3001452b0 con 0x7fd30013f5c0 2021-11-15T19:27:06.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd300144d70 con 0x7fd3000b0fe0 2021-11-15T19:27:06.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd300145010 con 0x7fd3000acff0 2021-11-15T19:27:06.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 0x7fd300144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 0x7fd300144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60054/0 (socket says 172.21.2.137:60054) 2021-11-15T19:27:06.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/1072383015 learned_addr learned my addr 172.21.2.137:0/1072383015 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000acff0 msgr2=0x7fd3000603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000acff0 0x7fd3000603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd30013f5c0 msgr2=0x7fd3001422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd30013f5c0 0x7fd3001422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 -- 172.21.2.137:0/1072383015 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f000b180 con 0x7fd3000b0fe0 2021-11-15T19:27:06.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2ff7fe700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 0x7fd300144030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd2f0002f70 tx=0x7fd2f0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f0006b20 con 0x7fd3000b0fe0 2021-11-15T19:27:06.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f001e400 con 0x7fd3000b0fe0 2021-11-15T19:27:06.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd300144520 con 0x7fd3000b0fe0 2021-11-15T19:27:06.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f000dea0 con 0x7fd3000b0fe0 2021-11-15T19:27:06.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd300143960 con 0x7fd3000b0fe0 2021-11-15T19:27:06.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd300144bd0 con 0x7fd3000b0fe0 2021-11-15T19:27:06.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2f0025030 con 0x7fd3000b0fe0 2021-11-15T19:27:06.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2e4053520 0x7fd2e40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd2f006c680 con 0x7fd3000b0fe0 2021-11-15T19:27:06.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fffff700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2e4053520 0x7fd2e40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fffff700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2e4053520 0x7fd2e40559e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd2e8002f70 tx=0x7fd2e8006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.774+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd300144bd0 con 0x7fd3000b0fe0 2021-11-15T19:27:06.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.858+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd300144bd0 con 0x7fd3000b0fe0 2021-11-15T19:27:06.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.858+0000 7fd2fd7fa700 1 -- 172.21.2.137:0/1072383015 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd300144bd0 con 0x7fd3000b0fe0 2021-11-15T19:27:06.870 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:06.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2e4053520 msgr2=0x7fd2e40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2e4053520 0x7fd2e40559e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd2e8002f70 tx=0x7fd2e8006a80).stop 2021-11-15T19:27:06.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 msgr2=0x7fd300144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 0x7fd300144030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd2f0002f70 tx=0x7fd2f0014000).stop 2021-11-15T19:27:06.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 shutdown_connections 2021-11-15T19:27:06.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2e4053520 0x7fd2e40559e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd30013f5c0 0x7fd3001422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3000b0fe0 0x7fd300144030 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:06.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 --2- 172.21.2.137:0/1072383015 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3000acff0 0x7fd3000603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 >> 172.21.2.137:0/1072383015 conn(0x7fd3000b5f50 msgr2=0x7fd30013fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 shutdown_connections 2021-11-15T19:27:06.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.862+0000 7fd3069c5700 1 -- 172.21.2.137:0/1072383015 wait complete. 2021-11-15T19:27:06.877 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:06.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 Processor -- start 2021-11-15T19:27:06.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 -- start start 2021-11-15T19:27:06.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c065730 0x7fc96c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc96c065b10 0x7fc96c13c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c066270 con 0x7fc96c0b00a0 2021-11-15T19:27:06.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c067410 con 0x7fc96c065b10 2021-11-15T19:27:06.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.918+0000 7fc973c6f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c065fd0 con 0x7fc96c065730 2021-11-15T19:27:06.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc96c0b00a0 0x7fc96c05bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50610/0 (socket says 172.21.2.137:50610) 2021-11-15T19:27:06.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 -- 172.21.2.137:0/2401848056 learned_addr learned my addr 172.21.2.137:0/2401848056 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:06.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304784431 0 0) 0x7fc96c066270 con 0x7fc96c0b00a0 2021-11-15T19:27:06.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc954004370 con 0x7fc96c0b00a0 2021-11-15T19:27:06.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2458946490 0 0) 0x7fc954004370 con 0x7fc96c0b00a0 2021-11-15T19:27:06.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c065730 msgr2=0x7fc96c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c065730 0x7fc96c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 >> v2:172.21.2.111:3300/0 conn(0x7fc96c065b10 msgr2=0x7fc96c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 --2- 172.21.2.137:0/2401848056 >> v2:172.21.2.111:3300/0 conn(0x7fc96c065b10 0x7fc96c13c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c066f70 con 0x7fc96c0b00a0 2021-11-15T19:27:06.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fc964001a00 con 0x7fc96c0b00a0 2021-11-15T19:27:06.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 >> v1:172.21.2.137:6789/0 conn(0x7fc96c0b00a0 legacy=0x7fc96c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9540048e0 0x7fc954004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c065730 0x7fc954005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc954003180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c067410 con 0x7fc9540048e0 2021-11-15T19:27:06.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c065fd0 con 0x7fc954005d00 2021-11-15T19:27:06.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc954006410 con 0x7fc96c065730 2021-11-15T19:27:06.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc954003180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 -- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c065730 msgr2=0x7fc954005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c065730 0x7fc954005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 -- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9540048e0 msgr2=0x7fc954004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:06.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9540048e0 0x7fc954004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 -- 172.21.2.137:0/2401848056 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954004370 con 0x7fc954005d00 2021-11-15T19:27:06.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc954003180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc964001710 tx=0x7fc96c066e60).ready entity=mon.1 client_cookie=7098815e964a7c8e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96400cc60 con 0x7fc954005d00 2021-11-15T19:27:06.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400cdc0 con 0x7fc954005d00 2021-11-15T19:27:06.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc970a09700 1 -- 172.21.2.137:0/2401848056 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964004b50 con 0x7fc954005d00 2021-11-15T19:27:06.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- 172.21.2.137:0/2401848056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 msgr2=0x7fc954003180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 --2- 172.21.2.137:0/2401848056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc954003180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc964001710 tx=0x7fc96c066e60).stop 2021-11-15T19:27:06.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc97220c700 1 -- 172.21.2.137:0/2401848056 reap_dead start 2021-11-15T19:27:06.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- 172.21.2.137:0/2401848056 shutdown_connections 2021-11-15T19:27:06.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- 172.21.2.137:0/2401848056 >> 172.21.2.137:0/2401848056 conn(0x7fc96c060290 msgr2=0x7fc96c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:06.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- 172.21.2.137:0/2401848056 shutdown_connections 2021-11-15T19:27:06.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- 172.21.2.137:0/2401848056 wait complete. 2021-11-15T19:27:06.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 Processor -- start 2021-11-15T19:27:06.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- start start 2021-11-15T19:27:06.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc96c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c0acb20 0x7fc96c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc96c0ad450 0x7fc96c0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0ad020 con 0x7fc96c0ad450 2021-11-15T19:27:06.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0addc0 con 0x7fc954005d00 2021-11-15T19:27:06.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc973c6f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c139ec0 con 0x7fc96c0acb20 2021-11-15T19:27:06.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc96c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc96c0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60070/0 (socket says 172.21.2.137:60070) 2021-11-15T19:27:06.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 -- 172.21.2.137:0/1372069619 learned_addr learned my addr 172.21.2.137:0/1372069619 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:06.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 -- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c0acb20 msgr2=0x7fc96c151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c0acb20 0x7fc96c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 -- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc96c0ad450 msgr2=0x7fc96c0ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:06.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc96c0ad450 0x7fc96c0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:06.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 -- 172.21.2.137:0/1372069619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c13a160 con 0x7fc954005d00 2021-11-15T19:27:06.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc971a0b700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc96c0b58d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc968002f70 tx=0x7fc968006e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc968013460 con 0x7fc954005d00 2021-11-15T19:27:06.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.922+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680135c0 con 0x7fc954005d00 2021-11-15T19:27:06.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c0afcd0 con 0x7fc954005d00 2021-11-15T19:27:06.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc968013920 con 0x7fc954005d00 2021-11-15T19:27:06.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c10e8f0 con 0x7fc954005d00 2021-11-15T19:27:06.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c0ad190 con 0x7fc954005d00 2021-11-15T19:27:06.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc96800f070 con 0x7fc954005d00 2021-11-15T19:27:06.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc95effd700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc94c053640 0x7fc94c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:06.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc96806b570 con 0x7fc954005d00 2021-11-15T19:27:06.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc97120a700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc94c053640 0x7fc94c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:06.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc97120a700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc94c053640 0x7fc94c055b00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc960002f70 tx=0x7fc960006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:06.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:06.926+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc96c0ad190 con 0x7fc954005d00 2021-11-15T19:27:07.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc96c0ad190 con 0x7fc954005d00 2021-11-15T19:27:07.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc95effd700 1 -- 172.21.2.137:0/1372069619 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc96c0ad190 con 0x7fc954005d00 2021-11-15T19:27:07.020 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:07.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc94c053640 msgr2=0x7fc94c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc94c053640 0x7fc94c055b00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc960002f70 tx=0x7fc960006a80).stop 2021-11-15T19:27:07.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 msgr2=0x7fc96c0b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc96c0b58d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc968002f70 tx=0x7fc968006e70).stop 2021-11-15T19:27:07.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 shutdown_connections 2021-11-15T19:27:07.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc94c053640 0x7fc94c055b00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc96c0ad450 0x7fc96c0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:07.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc96c0acb20 0x7fc96c151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:07.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 --2- 172.21.2.137:0/1372069619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc954005d00 0x7fc96c0b58d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 >> 172.21.2.137:0/1372069619 conn(0x7fc96c060290 msgr2=0x7fc96c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:07.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 shutdown_connections 2021-11-15T19:27:07.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.010+0000 7fc973c6f700 1 -- 172.21.2.137:0/1372069619 wait complete. 2021-11-15T19:27:07.027 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:27:07.028 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:07.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 Processor -- start 2021-11-15T19:27:07.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 -- start start 2021-11-15T19:27:07.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 0x7f497809cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:07.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f49780b3140 0x7f497805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:07.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497809d190 con 0x7f497809ab00 2021-11-15T19:27:07.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4978099790 con 0x7f49780b3140 2021-11-15T19:27:07.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.066+0000 7f497fad1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b2940 con 0x7f497809c8c0 2021-11-15T19:27:07.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 0x7f497809cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:07.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d06c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f49780b3140 0x7f497805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:07.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 0x7f497809cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:33418/0 (socket says 172.21.2.137:33418) 2021-11-15T19:27:07.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497e06e700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f497809ab00 0x7f4978143260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:43124/0 (socket says 172.21.2.137:43124) 2021-11-15T19:27:07.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 -- 172.21.2.137:0/3432926939 learned_addr learned my addr 172.21.2.137:0/3432926939 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:07.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 -- 172.21.2.137:0/3432926939 >> v2:172.21.2.111:3300/0 conn(0x7f49780b3140 msgr2=0x7f497805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:07.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 --2- 172.21.2.137:0/3432926939 >> v2:172.21.2.111:3300/0 conn(0x7f49780b3140 0x7f497805f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 -- 172.21.2.137:0/3432926939 >> v1:172.21.2.111:6789/0 conn(0x7f497809ab00 legacy=0x7f4978143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 -- 172.21.2.137:0/3432926939 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978099a30 con 0x7f497809c8c0 2021-11-15T19:27:07.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497d86d700 1 --2- 172.21.2.137:0/3432926939 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 0x7f497809cca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4974002f70 tx=0x7f4974006eb0).ready entity=mon.2 client_cookie=ab69a6699cb4d403 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:07.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497c86b700 1 -- 172.21.2.137:0/3432926939 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f497400d570 con 0x7f497809c8c0 2021-11-15T19:27:07.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497c86b700 1 -- 172.21.2.137:0/3432926939 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974000e90 con 0x7f497809c8c0 2021-11-15T19:27:07.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497c86b700 1 -- 172.21.2.137:0/3432926939 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f497400d900 con 0x7f497809c8c0 2021-11-15T19:27:07.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 -- 172.21.2.137:0/3432926939 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 msgr2=0x7f497809cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 --2- 172.21.2.137:0/3432926939 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 0x7f497809cca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4974002f70 tx=0x7f4974006eb0).stop 2021-11-15T19:27:07.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 -- 172.21.2.137:0/3432926939 shutdown_connections 2021-11-15T19:27:07.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 --2- 172.21.2.137:0/3432926939 >> v2:172.21.2.111:3300/0 conn(0x7f49780b3140 0x7f497805f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 --2- 172.21.2.137:0/3432926939 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f497809c8c0 0x7f497809cca0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 -- 172.21.2.137:0/3432926939 >> 172.21.2.137:0/3432926939 conn(0x7f49780b45b0 msgr2=0x7f497805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:07.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 -- 172.21.2.137:0/3432926939 shutdown_connections 2021-11-15T19:27:07.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.070+0000 7f497fad1700 1 -- 172.21.2.137:0/3432926939 wait complete. 2021-11-15T19:27:07.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 Processor -- start 2021-11-15T19:27:07.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- start start 2021-11-15T19:27:07.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f497809ab00 0x7f4978060440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:07.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 0x7f497813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:07.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f49780b3140 0x7f497813b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:07.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4978139e40 con 0x7f497809ab00 2021-11-15T19:27:07.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4978062d90 con 0x7f497809c8c0 2021-11-15T19:27:07.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4978063030 con 0x7f49780b3140 2021-11-15T19:27:07.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 0x7f497813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:07.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 0x7f497813b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60088/0 (socket says 172.21.2.137:60088) 2021-11-15T19:27:07.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 -- 172.21.2.137:0/572747774 learned_addr learned my addr 172.21.2.137:0/572747774 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:07.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d86d700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f497809ab00 0x7f4978060440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:07.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 -- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f49780b3140 msgr2=0x7f497813b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f49780b3140 0x7f497813b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:07.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 -- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f497809ab00 msgr2=0x7f4978060440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f497809ab00 0x7f4978060440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 -- 172.21.2.137:0/572747774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497400b1e0 con 0x7f497809c8c0 2021-11-15T19:27:07.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d06c700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 0x7f497813b1b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f496c00c000 tx=0x7f496c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:07.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f496c010780 con 0x7f497809c8c0 2021-11-15T19:27:07.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c0108e0 con 0x7f497809c8c0 2021-11-15T19:27:07.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780634d0 con 0x7f497809c8c0 2021-11-15T19:27:07.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f496c010c40 con 0x7f497809c8c0 2021-11-15T19:27:07.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4978139950 con 0x7f497809c8c0 2021-11-15T19:27:07.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49780631f0 con 0x7f497809c8c0 2021-11-15T19:27:07.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f496c01c460 con 0x7f497809c8c0 2021-11-15T19:27:07.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f496affd700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49580536f0 0x7f4958055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:07.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f496c06bd90 con 0x7f497809c8c0 2021-11-15T19:27:07.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.074+0000 7f497d86d700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49580536f0 0x7f4958055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:07.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.078+0000 7f497d86d700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49580536f0 0x7f4958055bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4974017000 tx=0x7f4974015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:07.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.078+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f496c042e90 con 0x7f497809c8c0 2021-11-15T19:27:07.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49780573d0 con 0x7f497809c8c0 2021-11-15T19:27:07.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f496affd700 1 -- 172.21.2.137:0/572747774 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f496c0464b0 con 0x7f497809c8c0 2021-11-15T19:27:07.197 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:07.197 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:26:56.084069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.111:6835/2773926386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2773926386},{"type":"v1","addr":"172.21.2.111:6835","nonce":2773926386}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:27:07.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49580536f0 msgr2=0x7f4958055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49580536f0 0x7f4958055bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4974017000 tx=0x7f4974015000).stop 2021-11-15T19:27:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 msgr2=0x7f497813b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 0x7f497813b1b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f496c00c000 tx=0x7f496c006df0).stop 2021-11-15T19:27:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 shutdown_connections 2021-11-15T19:27:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49580536f0 0x7f4958055bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f49780b3140 0x7f497813b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f497809c8c0 0x7f497813b1b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 --2- 172.21.2.137:0/572747774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f497809ab00 0x7f4978060440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 >> 172.21.2.137:0/572747774 conn(0x7f49780b45b0 msgr2=0x7f4978143ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 shutdown_connections 2021-11-15T19:27:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:07.186+0000 7f497fad1700 1 -- 172.21.2.137:0/572747774 wait complete. 2021-11-15T19:27:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 5 2021-11-15T19:27:07.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:26:55.077984+0000', 'modified': '2021-11-15T19:26:56.084069+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.2.111:6835/2773926386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 2773926386}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 2773926386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:27:07.406 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:27:07.406 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:27:07.470 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":12.381335404,"mdsmap_epoch":5,"osdmap_epoch":21,"osdmap_epoch_barrier":21,"uptime":14.537694961} 2021-11-15T19:27:07.470 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 21, "osdmap_epoch_barrier": 21, "rank_uptime": 12.381335404, "state": "up:active", "uptime": 14.537694961, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:27:07.471 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:27:07.471 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:27:07.471 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:27:07.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:07.472 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:07.483 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:27:07.494 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:07.495 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:07.501 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:07.501 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:07.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:07.503 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:27:07.550 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:27:07.551 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:07.553 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:27:07.564 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:07.565 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:07.570 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:07.570 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:07.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:07.572 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:27:07.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[13974]: starting ceph client 2021-11-15T19:27:07.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:27:07.604+0000 7f6f138bc080 -1 init, newargv = 0x55769bacda00 newargc=9 2021-11-15T19:27:07.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[13974]: starting fuse 2021-11-15T19:27:08.714 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:27:08.725 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:08.726 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:08.778 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:08.778 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:08.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:08.780 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:27:08.785 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:27:08.786 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:27:08.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:08.786 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:27:08.787 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:27:08.787 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:27:08.787 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:27:08.788 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:27:08.788 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:27:08.788 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:27:08.789 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:27:08.789 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:27:08.789 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:27:08.790 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:27:08.790 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:27:08.790 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:27:08.791 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:27:08.791 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:27:08.791 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:27:08.792 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:27:08.792 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:27:08.792 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:27:08.792 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:27:08.793 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:27:08.793 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:27:08.793 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:27:08.828 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.13974.asok 2021-11-15T19:27:08.831 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13974.asok 2021-11-15T19:27:08.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:08.831 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13974.asok status 2021-11-15T19:27:08.878 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:27:08.878 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:27:08.879 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:27:08.879 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:27:08.879 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:27:08.879 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:27:08.879 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:27:08.880 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "13974", 2021-11-15T19:27:08.880 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:27:08.880 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:27:08.880 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:27:08.880 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:27:08.881 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 4292, 2021-11-15T19:27:08.881 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:27:08.881 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:27:08.881 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:27:08.881 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 4292 2021-11-15T19:27:08.882 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:27:08.882 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:27:08.882 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:27:08.882 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:27:08.883 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 1141602094 2021-11-15T19:27:08.883 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:27:08.883 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:27:08.883 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:27:08.883 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:27:08.884 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:27:08.884 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 1141602094 2021-11-15T19:27:08.884 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:27:08.884 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.4292 172.21.2.118:0/1141602094", 2021-11-15T19:27:08.884 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/1141602094", 2021-11-15T19:27:08.885 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:27:08.885 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 5, 2021-11-15T19:27:08.885 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 21, 2021-11-15T19:27:08.885 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:27:08.885 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:27:08.886 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:27:08.886 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:27:08.887 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:08.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 Processor -- start 2021-11-15T19:27:08.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- start start 2021-11-15T19:27:08.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbc440b1340 0x7fbc44147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:08.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbc440a9f50 0x7fbc440aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:08.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc44148190 con 0x7fbc44143f00 2021-11-15T19:27:08.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440b1720 con 0x7fbc440b1340 2021-11-15T19:27:08.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc44147e70 con 0x7fbc440a9f50 2021-11-15T19:27:08.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc41d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbc44143f00 0x7fbc44144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50642/0 (socket says 172.21.2.137:50642) 2021-11-15T19:27:08.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc41d9b700 1 -- 172.21.2.137:0/22372035 learned_addr learned my addr 172.21.2.137:0/22372035 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:08.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc42d9d700 1 --2- 172.21.2.137:0/22372035 >> v2:172.21.2.137:3300/0 conn(0x7fbc440a9f50 0x7fbc440aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:08.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc4159a700 1 -- 172.21.2.137:0/22372035 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755668835 0 0) 0x7fbc38001110 con 0x7fbc44143f00 2021-11-15T19:27:08.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc4159a700 1 -- 172.21.2.137:0/22372035 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc28003260 con 0x7fbc44143f00 2021-11-15T19:27:08.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc42d9d700 1 -- 172.21.2.137:0/22372035 >> v2:172.21.2.111:3300/0 conn(0x7fbc440b1340 msgr2=0x7fbc44147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:08.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc42d9d700 1 --2- 172.21.2.137:0/22372035 >> v2:172.21.2.111:3300/0 conn(0x7fbc440b1340 0x7fbc44147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:08.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc42d9d700 1 -- 172.21.2.137:0/22372035 >> v1:172.21.2.137:6789/0 conn(0x7fbc44143f00 legacy=0x7fbc44144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:08.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc42d9d700 1 -- 172.21.2.137:0/22372035 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440af800 con 0x7fbc440a9f50 2021-11-15T19:27:08.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc42d9d700 1 --2- 172.21.2.137:0/22372035 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440a9f50 0x7fbc440aa3a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbc3c0032f0 tx=0x7fbc3c0091d0).ready entity=mon.1 client_cookie=670d48c91617970d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:08.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc4159a700 1 -- 172.21.2.137:0/22372035 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3c00b680 con 0x7fbc440a9f50 2021-11-15T19:27:08.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc4159a700 1 -- 172.21.2.137:0/22372035 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c00b7e0 con 0x7fbc440a9f50 2021-11-15T19:27:08.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc4159a700 1 -- 172.21.2.137:0/22372035 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3c00b950 con 0x7fbc440a9f50 2021-11-15T19:27:08.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- 172.21.2.137:0/22372035 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440a9f50 msgr2=0x7fbc440aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:08.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/22372035 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440a9f50 0x7fbc440aa3a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbc3c0032f0 tx=0x7fbc3c0091d0).stop 2021-11-15T19:27:08.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- 172.21.2.137:0/22372035 shutdown_connections 2021-11-15T19:27:08.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/22372035 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440a9f50 0x7fbc440aa3a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:08.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/22372035 >> v2:172.21.2.111:3300/0 conn(0x7fbc440b1340 0x7fbc44147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:08.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- 172.21.2.137:0/22372035 >> 172.21.2.137:0/22372035 conn(0x7fbc440b4e60 msgr2=0x7fbc440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:08.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- 172.21.2.137:0/22372035 shutdown_connections 2021-11-15T19:27:08.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- 172.21.2.137:0/22372035 wait complete. 2021-11-15T19:27:08.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 Processor -- start 2021-11-15T19:27:08.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.934+0000 7fbc48bd9700 1 -- start start 2021-11-15T19:27:08.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc440a9f50 0x7fbc4409a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:08.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 0x7fbc44153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:08.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc44143f00 0x7fbc4413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:08.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4413f780 con 0x7fbc44143f00 2021-11-15T19:27:08.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4414a650 con 0x7fbc440b1340 2021-11-15T19:27:08.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4414ad20 con 0x7fbc440a9f50 2021-11-15T19:27:08.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 0x7fbc44153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:08.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 0x7fbc44153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60100/0 (socket says 172.21.2.137:60100) 2021-11-15T19:27:08.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 -- 172.21.2.137:0/339904448 learned_addr learned my addr 172.21.2.137:0/339904448 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:08.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 -- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc440a9f50 msgr2=0x7fbc4409a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:08.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc440a9f50 0x7fbc4409a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:08.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 -- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc44143f00 msgr2=0x7fbc4413fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:08.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc44143f00 0x7fbc4413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:08.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 -- 172.21.2.137:0/339904448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009470 con 0x7fbc440b1340 2021-11-15T19:27:08.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc41d9b700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 0x7fbc44153be0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fbc380012a0 tx=0x7fbc38007940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:08.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc380072e0 con 0x7fbc440b1340 2021-11-15T19:27:08.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38007440 con 0x7fbc440b1340 2021-11-15T19:27:08.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc38005800 con 0x7fbc440b1340 2021-11-15T19:27:08.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc441573d0 con 0x7fbc440b1340 2021-11-15T19:27:08.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44157700 con 0x7fbc440b1340 2021-11-15T19:27:08.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4405faf0 con 0x7fbc440b1340 2021-11-15T19:27:08.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc3801a060 con 0x7fbc440b1340 2021-11-15T19:27:08.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc337fe700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc200535d0 0x7fbc20055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:08.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbc3806b190 con 0x7fbc440b1340 2021-11-15T19:27:08.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.938+0000 7fbc4259c700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc200535d0 0x7fbc20055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:08.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.942+0000 7fbc4259c700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc200535d0 0x7fbc20055a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbc34002f70 tx=0x7fbc340069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:08.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:08.942+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc380421e0 con 0x7fbc440b1340 2021-11-15T19:27:09.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc44148190 con 0x7fbc440b1340 2021-11-15T19:27:09.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc337fe700 1 -- 172.21.2.137:0/339904448 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fbc44148190 con 0x7fbc440b1340 2021-11-15T19:27:09.036 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:09.036 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:09.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc200535d0 msgr2=0x7fbc20055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc200535d0 0x7fbc20055a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbc34002f70 tx=0x7fbc340069e0).stop 2021-11-15T19:27:09.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 msgr2=0x7fbc44153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 0x7fbc44153be0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fbc380012a0 tx=0x7fbc38007940).stop 2021-11-15T19:27:09.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 shutdown_connections 2021-11-15T19:27:09.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc200535d0 0x7fbc20055a90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc44143f00 0x7fbc4413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc440b1340 0x7fbc44153be0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 --2- 172.21.2.137:0/339904448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc440a9f50 0x7fbc4409a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 >> 172.21.2.137:0/339904448 conn(0x7fbc440b4e60 msgr2=0x7fbc440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 shutdown_connections 2021-11-15T19:27:09.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.026+0000 7fbc48bd9700 1 -- 172.21.2.137:0/339904448 wait complete. 2021-11-15T19:27:09.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:09.044 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:09.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 Processor -- start 2021-11-15T19:27:09.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- start start 2021-11-15T19:27:09.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f113c0b2400 0x7f113c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f113c0b5330 0x7f113c0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b3e70 0x7f113c0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c146c20 con 0x7f113c0b2400 2021-11-15T19:27:09.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c142af0 con 0x7f113c0b5330 2021-11-15T19:27:09.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0b27e0 con 0x7f113c0b3e70 2021-11-15T19:27:09.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f113c0b5330 0x7f113c0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f113c0b5330 0x7f113c0b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60108/0 (socket says 172.21.2.137:60108) 2021-11-15T19:27:09.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 -- 172.21.2.137:0/1644231733 learned_addr learned my addr 172.21.2.137:0/1644231733 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 -- 172.21.2.137:0/1644231733 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b3e70 msgr2=0x7f113c0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 --2- 172.21.2.137:0/1644231733 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b3e70 0x7f113c0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 -- 172.21.2.137:0/1644231733 >> v2:172.21.2.111:3300/0 conn(0x7f113c0b2400 msgr2=0x7f113c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 --2- 172.21.2.137:0/1644231733 >> v2:172.21.2.111:3300/0 conn(0x7f113c0b2400 0x7f113c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 -- 172.21.2.137:0/1644231733 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0b4d80 con 0x7f113c0b5330 2021-11-15T19:27:09.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f114156d700 1 --2- 172.21.2.137:0/1644231733 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b5330 0x7f113c0b09b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f1138002f70 tx=0x7f1138006eb0).ready entity=mon.1 client_cookie=1c8bbe8642e44550 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1140d6c700 1 -- 172.21.2.137:0/1644231733 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f113800d570 con 0x7f113c0b5330 2021-11-15T19:27:09.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1140d6c700 1 -- 172.21.2.137:0/1644231733 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138000e90 con 0x7f113c0b5330 2021-11-15T19:27:09.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1140d6c700 1 -- 172.21.2.137:0/1644231733 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f113800d900 con 0x7f113c0b5330 2021-11-15T19:27:09.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- 172.21.2.137:0/1644231733 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b5330 msgr2=0x7f113c0b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- 172.21.2.137:0/1644231733 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b5330 0x7f113c0b09b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f1138002f70 tx=0x7f1138006eb0).stop 2021-11-15T19:27:09.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- 172.21.2.137:0/1644231733 shutdown_connections 2021-11-15T19:27:09.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- 172.21.2.137:0/1644231733 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b3e70 0x7f113c0b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- 172.21.2.137:0/1644231733 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b5330 0x7f113c0b09b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 --2- 172.21.2.137:0/1644231733 >> v2:172.21.2.111:3300/0 conn(0x7f113c0b2400 0x7f113c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- 172.21.2.137:0/1644231733 >> 172.21.2.137:0/1644231733 conn(0x7f113c0623a0 msgr2=0x7f113c062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- 172.21.2.137:0/1644231733 shutdown_connections 2021-11-15T19:27:09.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.086+0000 7f1143fd2700 1 -- 172.21.2.137:0/1644231733 wait complete. 2021-11-15T19:27:09.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 Processor -- start 2021-11-15T19:27:09.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- start start 2021-11-15T19:27:09.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b2400 0x7f113c0b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 0x7f113c115a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f113c0b5330 0x7f113c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0affe0 con 0x7f113c0b5330 2021-11-15T19:27:09.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0af900 con 0x7f113c0b3e70 2021-11-15T19:27:09.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0afba0 con 0x7f113c0b2400 2021-11-15T19:27:09.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 0x7f113c115a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 0x7f113c115a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60116/0 (socket says 172.21.2.137:60116) 2021-11-15T19:27:09.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 -- 172.21.2.137:0/701073468 learned_addr learned my addr 172.21.2.137:0/701073468 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 -- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b2400 msgr2=0x7f113c0b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b2400 0x7f113c0b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 -- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f113c0b5330 msgr2=0x7f113c0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f113c0b5330 0x7f113c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 -- 172.21.2.137:0/701073468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113800b1e0 con 0x7f113c0b3e70 2021-11-15T19:27:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f114156d700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 0x7f113c115a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1138002f70 tx=0x7f1138015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1138011990 con 0x7f113c0b3e70 2021-11-15T19:27:09.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138011af0 con 0x7f113c0b3e70 2021-11-15T19:27:09.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c0ad940 con 0x7f113c0b3e70 2021-11-15T19:27:09.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c0af680 con 0x7f113c0b3e70 2021-11-15T19:27:09.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1138011e50 con 0x7f113c0b3e70 2021-11-15T19:27:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0adb00 con 0x7f113c0b3e70 2021-11-15T19:27:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1138025030 con 0x7f113c0b3e70 2021-11-15T19:27:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f112effd700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f111c053600 0x7f111c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f113806ce60 con 0x7f113c0b3e70 2021-11-15T19:27:09.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.090+0000 7f1141d6e700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f111c053600 0x7f111c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.094+0000 7f1141d6e700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f111c053600 0x7f111c055ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1130002f70 tx=0x7f11300069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.094+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1138043eb0 con 0x7f113c0b3e70 2021-11-15T19:27:09.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.174+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f113c0573d0 con 0x7f113c0b3e70 2021-11-15T19:27:09.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f112effd700 1 -- 172.21.2.137:0/701073468 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1138023070 con 0x7f113c0b3e70 2021-11-15T19:27:09.187 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f111c053600 msgr2=0x7f111c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f111c053600 0x7f111c055ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1130002f70 tx=0x7f11300069e0).stop 2021-11-15T19:27:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 msgr2=0x7f113c115a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 0x7f113c115a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1138002f70 tx=0x7f1138015000).stop 2021-11-15T19:27:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 shutdown_connections 2021-11-15T19:27:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f111c053600 0x7f111c055ac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f113c0b5330 0x7f113c0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f113c0b3e70 0x7f113c115a90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 --2- 172.21.2.137:0/701073468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f113c0b2400 0x7f113c0b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 >> 172.21.2.137:0/701073468 conn(0x7f113c0623a0 msgr2=0x7f113c146080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 shutdown_connections 2021-11-15T19:27:09.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.178+0000 7f1143fd2700 1 -- 172.21.2.137:0/701073468 wait complete. 2021-11-15T19:27:09.195 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:09.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 Processor -- start 2021-11-15T19:27:09.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- start start 2021-11-15T19:27:09.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a14065730 0x7f3a1413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a14066270 con 0x7f3a140b00a0 2021-11-15T19:27:09.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a14065fd0 con 0x7f3a14065b10 2021-11-15T19:27:09.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a14067410 con 0x7f3a14065730 2021-11-15T19:27:09.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a13fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3a14065b10 0x7f3a1413c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50672/0 (socket says 172.21.2.137:50672) 2021-11-15T19:27:09.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a13fff700 1 -- 172.21.2.137:0/4098326910 learned_addr learned my addr 172.21.2.137:0/4098326910 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:09.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a18b30700 1 --2- 172.21.2.137:0/4098326910 >> v2:172.21.2.137:3300/0 conn(0x7f3a14065730 0x7f3a1413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a137fe700 1 -- 172.21.2.137:0/4098326910 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630377124 0 0) 0x7f3a14065fd0 con 0x7f3a14065b10 2021-11-15T19:27:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a18b30700 1 -- 172.21.2.137:0/4098326910 >> v1:172.21.2.137:6789/0 conn(0x7f3a14065b10 legacy=0x7f3a1413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a18b30700 1 -- 172.21.2.137:0/4098326910 >> v1:172.21.2.111:6789/0 conn(0x7f3a140b00a0 legacy=0x7f3a1405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a18b30700 1 -- 172.21.2.137:0/4098326910 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14066f70 con 0x7f3a14065730 2021-11-15T19:27:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a18b30700 1 --2- 172.21.2.137:0/4098326910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a14065730 0x7f3a1413c2b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f3a140612c0 tx=0x7f3a04006df0).ready entity=mon.1 client_cookie=bdea69dad9f07a4d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a137fe700 1 -- 172.21.2.137:0/4098326910 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a04010980 con 0x7f3a14065730 2021-11-15T19:27:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a137fe700 1 -- 172.21.2.137:0/4098326910 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04000e90 con 0x7f3a14065730 2021-11-15T19:27:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a137fe700 1 -- 172.21.2.137:0/4098326910 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a04010cd0 con 0x7f3a14065730 2021-11-15T19:27:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4098326910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a14065730 msgr2=0x7f3a1413c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4098326910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a14065730 0x7f3a1413c2b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f3a140612c0 tx=0x7f3a04006df0).stop 2021-11-15T19:27:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4098326910 shutdown_connections 2021-11-15T19:27:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4098326910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a14065730 0x7f3a1413c2b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4098326910 >> 172.21.2.137:0/4098326910 conn(0x7f3a14060290 msgr2=0x7f3a14060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4098326910 shutdown_connections 2021-11-15T19:27:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.238+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4098326910 wait complete. 2021-11-15T19:27:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 Processor -- start 2021-11-15T19:27:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- start start 2021-11-15T19:27:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a14065730 0x7f3a1413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a14065b10 0x7f3a14153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 0x7f3a14150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140b4600 con 0x7f3a14065730 2021-11-15T19:27:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140b40e0 con 0x7f3a140b00a0 2021-11-15T19:27:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14153910 con 0x7f3a14065b10 2021-11-15T19:27:09.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 0x7f3a14150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 0x7f3a14150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60130/0 (socket says 172.21.2.137:60130) 2021-11-15T19:27:09.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 -- 172.21.2.137:0/4202722386 learned_addr learned my addr 172.21.2.137:0/4202722386 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 -- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a14065b10 msgr2=0x7f3a14153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a14065b10 0x7f3a14153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 -- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a14065730 msgr2=0x7f3a1413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a14065730 0x7f3a1413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 -- 172.21.2.137:0/4202722386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0400c290 con 0x7f3a140b00a0 2021-11-15T19:27:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a19331700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 0x7f3a14150490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3a0c003290 tx=0x7f3a0c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0c00f510 con 0x7f3a140b00a0 2021-11-15T19:27:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00f670 con 0x7f3a140b00a0 2021-11-15T19:27:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140b4360 con 0x7f3a140b00a0 2021-11-15T19:27:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140af3d0 con 0x7f3a140b00a0 2021-11-15T19:27:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0c00f7e0 con 0x7f3a140b00a0 2021-11-15T19:27:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a141407c0 con 0x7f3a140b00a0 2021-11-15T19:27:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a0c00f070 con 0x7f3a140b00a0 2021-11-15T19:27:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a11ffb700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39f8053610 0x7f39f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3a0c06b540 con 0x7f3a140b00a0 2021-11-15T19:27:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.242+0000 7f3a18b30700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39f8053610 0x7f39f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.246+0000 7f3a18b30700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39f8053610 0x7f39f8055ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3a140612c0 tx=0x7f3a04017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.246+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a141407c0 con 0x7f3a140b00a0 2021-11-15T19:27:09.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.326+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a141407c0 con 0x7f3a140b00a0 2021-11-15T19:27:09.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.326+0000 7f3a11ffb700 1 -- 172.21.2.137:0/4202722386 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a141407c0 con 0x7f3a140b00a0 2021-11-15T19:27:09.338 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:09.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39f8053610 msgr2=0x7f39f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39f8053610 0x7f39f8055ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3a140612c0 tx=0x7f3a04017000).stop 2021-11-15T19:27:09.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 msgr2=0x7f3a14150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 0x7f3a14150490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3a0c003290 tx=0x7f3a0c0090f0).stop 2021-11-15T19:27:09.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 shutdown_connections 2021-11-15T19:27:09.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39f8053610 0x7f39f8055ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a140b00a0 0x7f3a14150490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a14065b10 0x7f3a14153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 --2- 172.21.2.137:0/4202722386 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a14065730 0x7f3a1413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 >> 172.21.2.137:0/4202722386 conn(0x7f3a14060290 msgr2=0x7f3a1413cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 shutdown_connections 2021-11-15T19:27:09.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.330+0000 7f3a1ad94700 1 -- 172.21.2.137:0/4202722386 wait complete. 2021-11-15T19:27:09.345 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:09.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 Processor -- start 2021-11-15T19:27:09.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- start start 2021-11-15T19:27:09.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7facb40b2400 0x7facb40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b5330 0x7facb40b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb4146c20 con 0x7facb40b3e70 2021-11-15T19:27:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb4142af0 con 0x7facb40b2400 2021-11-15T19:27:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb40b27e0 con 0x7facb40b5330 2021-11-15T19:27:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7facb40b3e70 0x7facb40b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50686/0 (socket says 172.21.2.137:50686) 2021-11-15T19:27:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 -- 172.21.2.137:0/2886834572 learned_addr learned my addr 172.21.2.137:0/2886834572 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:09.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba0e5700 1 --2- 172.21.2.137:0/2886834572 >> v2:172.21.2.137:3300/0 conn(0x7facb40b2400 0x7facb40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facb90e3700 1 -- 172.21.2.137:0/2886834572 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033918159 0 0) 0x7facb4146c20 con 0x7facb40b3e70 2021-11-15T19:27:09.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facb90e3700 1 -- 172.21.2.137:0/2886834572 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9c003260 con 0x7facb40b3e70 2021-11-15T19:27:09.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba0e5700 1 -- 172.21.2.137:0/2886834572 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b5330 msgr2=0x7facb40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba0e5700 1 --2- 172.21.2.137:0/2886834572 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b5330 0x7facb40b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba0e5700 1 -- 172.21.2.137:0/2886834572 >> v1:172.21.2.137:6789/0 conn(0x7facb40b3e70 legacy=0x7facb40b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba0e5700 1 -- 172.21.2.137:0/2886834572 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb40b4d80 con 0x7facb40b2400 2021-11-15T19:27:09.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba0e5700 1 --2- 172.21.2.137:0/2886834572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b2400 0x7facb40b2a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7facb0002f70 tx=0x7facb0006df0).ready entity=mon.1 client_cookie=d2df144c9be26c67 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facb90e3700 1 -- 172.21.2.137:0/2886834572 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb000d570 con 0x7facb40b2400 2021-11-15T19:27:09.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facb90e3700 1 -- 172.21.2.137:0/2886834572 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0000e90 con 0x7facb40b2400 2021-11-15T19:27:09.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facb90e3700 1 -- 172.21.2.137:0/2886834572 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb000d8c0 con 0x7facb40b2400 2021-11-15T19:27:09.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- 172.21.2.137:0/2886834572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b2400 msgr2=0x7facb40b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- 172.21.2.137:0/2886834572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b2400 0x7facb40b2a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7facb0002f70 tx=0x7facb0006df0).stop 2021-11-15T19:27:09.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- 172.21.2.137:0/2886834572 shutdown_connections 2021-11-15T19:27:09.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- 172.21.2.137:0/2886834572 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b5330 0x7facb40b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- 172.21.2.137:0/2886834572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b2400 0x7facb40b2a90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- 172.21.2.137:0/2886834572 >> 172.21.2.137:0/2886834572 conn(0x7facb40623a0 msgr2=0x7facb4062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- 172.21.2.137:0/2886834572 shutdown_connections 2021-11-15T19:27:09.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- 172.21.2.137:0/2886834572 wait complete. 2021-11-15T19:27:09.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 Processor -- start 2021-11-15T19:27:09.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- start start 2021-11-15T19:27:09.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facb40b2400 0x7facb4112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b3e70 0x7facb4142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 0x7facb4152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40af580 con 0x7facb40b2400 2021-11-15T19:27:09.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41136a0 con 0x7facb40b5330 2021-11-15T19:27:09.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facbc349700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb40af2e0 con 0x7facb40b3e70 2021-11-15T19:27:09.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 0x7facb4152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 0x7facb4152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60142/0 (socket says 172.21.2.137:60142) 2021-11-15T19:27:09.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 -- 172.21.2.137:0/2933868357 learned_addr learned my addr 172.21.2.137:0/2933868357 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 -- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b3e70 msgr2=0x7facb4142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b3e70 0x7facb4142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 -- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facb40b2400 msgr2=0x7facb4112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.390+0000 7facba8e6700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facb40b2400 0x7facb4112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facba8e6700 1 -- 172.21.2.137:0/2933868357 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb000b180 con 0x7facb40b5330 2021-11-15T19:27:09.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facba8e6700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 0x7facb4152710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7facb4114b80 tx=0x7facac007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac005ba0 con 0x7facb40b5330 2021-11-15T19:27:09.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac005d00 con 0x7facb40b5330 2021-11-15T19:27:09.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac0072c0 con 0x7facb40b5330 2021-11-15T19:27:09.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb40af830 con 0x7facb40b5330 2021-11-15T19:27:09.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb4151f60 con 0x7facb40b5330 2021-11-15T19:27:09.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb41134f0 con 0x7facb40b5330 2021-11-15T19:27:09.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facac010070 con 0x7facb40b5330 2021-11-15T19:27:09.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7faca77fe700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac940536a0 0x7fac94055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7facac06b410 con 0x7facb40b5330 2021-11-15T19:27:09.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facba0e5700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac940536a0 0x7fac94055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.394+0000 7facba0e5700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac940536a0 0x7fac94055b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7facb0002f70 tx=0x7facb0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.398+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facac042570 con 0x7facb40b5330 2021-11-15T19:27:09.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facb4113830 con 0x7facb40b5330 2021-11-15T19:27:09.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7faca77fe700 1 -- 172.21.2.137:0/2933868357 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7facac045b90 con 0x7facb40b5330 2021-11-15T19:27:09.491 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac940536a0 msgr2=0x7fac94055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac940536a0 0x7fac94055b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7facb0002f70 tx=0x7facb0014000).stop 2021-11-15T19:27:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 msgr2=0x7facb4152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 0x7facb4152710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7facb4114b80 tx=0x7facac007e00).stop 2021-11-15T19:27:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 shutdown_connections 2021-11-15T19:27:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac940536a0 0x7fac94055b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facb40b5330 0x7facb4152710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facb40b3e70 0x7facb4142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 --2- 172.21.2.137:0/2933868357 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facb40b2400 0x7facb4112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 >> 172.21.2.137:0/2933868357 conn(0x7facb40623a0 msgr2=0x7facb41405f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 shutdown_connections 2021-11-15T19:27:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.482+0000 7facbc349700 1 -- 172.21.2.137:0/2933868357 wait complete. 2021-11-15T19:27:09.498 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:09.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 Processor -- start 2021-11-15T19:27:09.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- start start 2021-11-15T19:27:09.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 0x7fdde80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdde80b0550 0x7fdde814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde805cb50 con 0x7fdde814aaa0 2021-11-15T19:27:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde80b1650 con 0x7fdde80b0550 2021-11-15T19:27:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80ad030 con 0x7fdde805c770 2021-11-15T19:27:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeea57700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdde814aaa0 0x7fdde8140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50700/0 (socket says 172.21.2.137:50700) 2021-11-15T19:27:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeea57700 1 -- 172.21.2.137:0/878931406 learned_addr learned my addr 172.21.2.137:0/878931406 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145696005 0 0) 0x7fdde805cb50 con 0x7fdde814aaa0 2021-11-15T19:27:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd0003260 con 0x7fdde814aaa0 2021-11-15T19:27:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 --2- 172.21.2.137:0/878931406 >> v2:172.21.2.111:3300/0 conn(0x7fdde80b0550 0x7fdde814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddee256700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 0x7fdde80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2822563856 0 0) 0x7fddd0003260 con 0x7fdde814aaa0 2021-11-15T19:27:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 msgr2=0x7fdde80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 0x7fdde80aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 >> v2:172.21.2.111:3300/0 conn(0x7fdde80b0550 msgr2=0x7fdde814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 --2- 172.21.2.137:0/878931406 >> v2:172.21.2.111:3300/0 conn(0x7fdde80b0550 0x7fdde814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80ad2d0 con 0x7fdde814aaa0 2021-11-15T19:27:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 --2- 172.21.2.137:0/878931406 >> v2:172.21.2.111:3300/0 conn(0x7fdde80b0550 0x7fdde814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fdde00019e0 con 0x7fdde814aaa0 2021-11-15T19:27:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 >> v1:172.21.2.137:6789/0 conn(0x7fdde814aaa0 legacy=0x7fdde8140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd00037d0 0x7fddd0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddd0004500 0x7fddd0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 0x7fddd000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80b1650 con 0x7fddd00037d0 2021-11-15T19:27:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80ad030 con 0x7fddd0004500 2021-11-15T19:27:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0005300 con 0x7fdde805c770 2021-11-15T19:27:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddd0004500 0x7fddd0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 -- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 msgr2=0x7fddd000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde805c770 0x7fddd000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 -- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd00037d0 msgr2=0x7fddd0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:09.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd00037d0 0x7fddd0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 -- 172.21.2.137:0/878931406 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0003260 con 0x7fddd0004500 2021-11-15T19:27:09.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeda55700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddd0004500 0x7fddd0004980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdde4007000 tx=0x7fdde4008040).ready entity=mon.1 client_cookie=5d5f82a4dd779912 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde4011410 con 0x7fddd0004500 2021-11-15T19:27:09.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4011570 con 0x7fddd0004500 2021-11-15T19:27:09.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fdded254700 1 -- 172.21.2.137:0/878931406 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde40118d0 con 0x7fddd0004500 2021-11-15T19:27:09.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- 172.21.2.137:0/878931406 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddd0004500 msgr2=0x7fddd0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 --2- 172.21.2.137:0/878931406 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddd0004500 0x7fddd0004980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdde4007000 tx=0x7fdde4008040).stop 2021-11-15T19:27:09.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddeea57700 1 -- 172.21.2.137:0/878931406 reap_dead start 2021-11-15T19:27:09.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- 172.21.2.137:0/878931406 shutdown_connections 2021-11-15T19:27:09.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- 172.21.2.137:0/878931406 >> 172.21.2.137:0/878931406 conn(0x7fdde80631e0 msgr2=0x7fdde805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- 172.21.2.137:0/878931406 shutdown_connections 2021-11-15T19:27:09.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.542+0000 7fddf04ba700 1 -- 172.21.2.137:0/878931406 wait complete. 2021-11-15T19:27:09.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 Processor -- start 2021-11-15T19:27:09.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- start start 2021-11-15T19:27:09.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd0004500 0x7fdde80676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde8065f50 0x7fdde8147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 0x7fdde8142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8156d20 con 0x7fddd0004500 2021-11-15T19:27:09.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8063760 con 0x7fdde8141ea0 2021-11-15T19:27:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8156f00 con 0x7fdde8065f50 2021-11-15T19:27:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 0x7fdde8142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 0x7fdde8142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60164/0 (socket says 172.21.2.137:60164) 2021-11-15T19:27:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 -- 172.21.2.137:0/3044091708 learned_addr learned my addr 172.21.2.137:0/3044091708 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 -- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde8065f50 msgr2=0x7fdde8147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde8065f50 0x7fdde8147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 -- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd0004500 msgr2=0x7fdde80676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd0004500 0x7fdde80676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 -- 172.21.2.137:0/3044091708 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde81571a0 con 0x7fdde8141ea0 2021-11-15T19:27:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddeea57700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 0x7fdde8142350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fdde0001bc0 tx=0x7fdde0001a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde0004ab0 con 0x7fdde8141ea0 2021-11-15T19:27:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0004c10 con 0x7fdde8141ea0 2021-11-15T19:27:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde8064b30 con 0x7fdde8141ea0 2021-11-15T19:27:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde0007170 con 0x7fdde8141ea0 2021-11-15T19:27:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde8147cf0 con 0x7fdde8141ea0 2021-11-15T19:27:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde80638a0 con 0x7fdde8141ea0 2021-11-15T19:27:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdde001b070 con 0x7fdde8141ea0 2021-11-15T19:27:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fdddb7fe700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fddc80536a0 0x7fddc8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdde006b180 con 0x7fdde8141ea0 2021-11-15T19:27:09.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.546+0000 7fddee256700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fddc80536a0 0x7fddc8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.550+0000 7fddee256700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fddc80536a0 0x7fddc8055b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fdddc007000 tx=0x7fdddc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.550+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdde0068e90 con 0x7fdde8141ea0 2021-11-15T19:27:09.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.630+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdde80ae7f0 con 0x7fdde8141ea0 2021-11-15T19:27:09.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fdddb7fe700 1 -- 172.21.2.137:0/3044091708 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdde0019020 con 0x7fdde8141ea0 2021-11-15T19:27:09.643 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:09.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fddc80536a0 msgr2=0x7fddc8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fddc80536a0 0x7fddc8055b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fdddc007000 tx=0x7fdddc008040).stop 2021-11-15T19:27:09.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 msgr2=0x7fdde8142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 0x7fdde8142350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fdde0001bc0 tx=0x7fdde0001a20).stop 2021-11-15T19:27:09.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 shutdown_connections 2021-11-15T19:27:09.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fddc80536a0 0x7fddc8055b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdde8141ea0 0x7fdde8142350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdde8065f50 0x7fdde8147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 --2- 172.21.2.137:0/3044091708 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddd0004500 0x7fdde80676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 >> 172.21.2.137:0/3044091708 conn(0x7fdde80631e0 msgr2=0x7fdde8144210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 shutdown_connections 2021-11-15T19:27:09.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.634+0000 7fddf04ba700 1 -- 172.21.2.137:0/3044091708 wait complete. 2021-11-15T19:27:09.650 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:27:09.651 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:09.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 Processor -- start 2021-11-15T19:27:09.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 -- start start 2021-11-15T19:27:09.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f79b40b1340 0x7f79b4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f79b4143f00 0x7f79b4144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40a9f50 0x7f79b40aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b4148190 con 0x7f79b40b1340 2021-11-15T19:27:09.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b1720 con 0x7f79b4143f00 2021-11-15T19:27:09.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79bbe57700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4147e70 con 0x7f79b40a9f50 2021-11-15T19:27:09.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f79b4143f00 0x7f79b4144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f79b4143f00 0x7f79b4144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60172/0 (socket says 172.21.2.137:60172) 2021-11-15T19:27:09.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 -- 172.21.2.137:0/1086701731 learned_addr learned my addr 172.21.2.137:0/1086701731 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 -- 172.21.2.137:0/1086701731 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40a9f50 msgr2=0x7f79b40aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:09.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 --2- 172.21.2.137:0/1086701731 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40a9f50 0x7f79b40aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 -- 172.21.2.137:0/1086701731 >> v2:172.21.2.111:3300/0 conn(0x7f79b40b1340 msgr2=0x7f79b4147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:09.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 --2- 172.21.2.137:0/1086701731 >> v2:172.21.2.111:3300/0 conn(0x7f79b40b1340 0x7f79b4147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 -- 172.21.2.137:0/1086701731 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40af800 con 0x7f79b4143f00 2021-11-15T19:27:09.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.690+0000 7f79b93f2700 1 --2- 172.21.2.137:0/1086701731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b4144390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f79b0002f70 tx=0x7f79b0006eb0).ready entity=mon.1 client_cookie=8c2eec59888479b5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79b8bf1700 1 -- 172.21.2.137:0/1086701731 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79b000d570 con 0x7f79b4143f00 2021-11-15T19:27:09.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79b8bf1700 1 -- 172.21.2.137:0/1086701731 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0000e90 con 0x7f79b4143f00 2021-11-15T19:27:09.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79b8bf1700 1 -- 172.21.2.137:0/1086701731 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79b000d900 con 0x7f79b4143f00 2021-11-15T19:27:09.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/1086701731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 msgr2=0x7f79b4144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- 172.21.2.137:0/1086701731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b4144390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f79b0002f70 tx=0x7f79b0006eb0).stop 2021-11-15T19:27:09.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/1086701731 shutdown_connections 2021-11-15T19:27:09.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- 172.21.2.137:0/1086701731 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40a9f50 0x7f79b40aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- 172.21.2.137:0/1086701731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b4144390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- 172.21.2.137:0/1086701731 >> v2:172.21.2.111:3300/0 conn(0x7f79b40b1340 0x7f79b4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/1086701731 >> 172.21.2.137:0/1086701731 conn(0x7f79b40b4e60 msgr2=0x7f79b40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/1086701731 shutdown_connections 2021-11-15T19:27:09.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/1086701731 wait complete. 2021-11-15T19:27:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 Processor -- start 2021-11-15T19:27:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- start start 2021-11-15T19:27:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79b40a9f50 0x7f79b4148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40b1340 0x7f79b40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40adaa0 con 0x7f79b40a9f50 2021-11-15T19:27:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b41489f0 con 0x7f79b4143f00 2021-11-15T19:27:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4148c90 con 0x7f79b40b1340 2021-11-15T19:27:09.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b413d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60178/0 (socket says 172.21.2.137:60178) 2021-11-15T19:27:09.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 -- 172.21.2.137:0/407846158 learned_addr learned my addr 172.21.2.137:0/407846158 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:09.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 -- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40b1340 msgr2=0x7f79b40aebb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:09.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40b1340 0x7f79b40aebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 -- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79b40a9f50 msgr2=0x7f79b4148430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:09.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79b40a9f50 0x7f79b4148430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 -- 172.21.2.137:0/407846158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b000b1e0 con 0x7f79b4143f00 2021-11-15T19:27:09.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79ba3f4700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b413d9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f79ac003270 tx=0x7f79ac0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ac00d4a0 con 0x7f79b4143f00 2021-11-15T19:27:09.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00d600 con 0x7f79b4143f00 2021-11-15T19:27:09.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ac00d960 con 0x7f79b4143f00 2021-11-15T19:27:09.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b4148f30 con 0x7f79b4143f00 2021-11-15T19:27:09.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b4159cc0 con 0x7f79b4143f00 2021-11-15T19:27:09.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40adfa0 con 0x7f79b4143f00 2021-11-15T19:27:09.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79ac018030 con 0x7f79b4143f00 2021-11-15T19:27:09.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.694+0000 7f79a2ffd700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f79940536f0 0x7f7994055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:09.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.698+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f79ac06b290 con 0x7f79b4143f00 2021-11-15T19:27:09.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.698+0000 7f79b9bf3700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f79940536f0 0x7f7994055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:09.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.698+0000 7f79b9bf3700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f79940536f0 0x7f7994055bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f79a4002ef0 tx=0x7f79a4006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:09.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.698+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79b40adfa0 con 0x7f79b4143f00 2021-11-15T19:27:09.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79b40adfa0 con 0x7f79b4143f00 2021-11-15T19:27:09.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79a2ffd700 1 -- 172.21.2.137:0/407846158 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f79b40adfa0 con 0x7f79b4143f00 2021-11-15T19:27:09.816 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:09.817 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:26:56.084069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.111:6835/2773926386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2773926386},{"type":"v1","addr":"172.21.2.111:6835","nonce":2773926386}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:27:09.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f79940536f0 msgr2=0x7f7994055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f79940536f0 0x7f7994055bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f79a4002ef0 tx=0x7f79a4006890).stop 2021-11-15T19:27:09.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 msgr2=0x7f79b413d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:09.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b413d9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f79ac003270 tx=0x7f79ac0090f0).stop 2021-11-15T19:27:09.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 shutdown_connections 2021-11-15T19:27:09.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f79940536f0 0x7f7994055bb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79b4143f00 0x7f79b413d9d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:09.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79b40b1340 0x7f79b40aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 --2- 172.21.2.137:0/407846158 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79b40a9f50 0x7f79b4148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:09.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 >> 172.21.2.137:0/407846158 conn(0x7f79b40b4e60 msgr2=0x7f79b413e600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:09.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 shutdown_connections 2021-11-15T19:27:09.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:09.806+0000 7f79bbe57700 1 -- 172.21.2.137:0/407846158 wait complete. 2021-11-15T19:27:09.820 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 5 2021-11-15T19:27:10.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:26:55.077984+0000', 'modified': '2021-11-15T19:26:56.084069+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.2.111:6835/2773926386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 2773926386}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 2773926386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:27:10.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:27:10.027 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:27:10.089 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":14.999936296,"mdsmap_epoch":5,"osdmap_epoch":21,"osdmap_epoch_barrier":21,"uptime":17.156294469999999} 2021-11-15T19:27:10.089 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 21, "osdmap_epoch_barrier": 21, "rank_uptime": 14.999936296, "state": "up:active", "uptime": 17.15629447, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:27:10.090 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:27:10.090 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2021-11-15T19:27:10.090 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@gibba017.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2021-11-15T19:27:10.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.091 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:10.097 DEBUG:teuthology.orchestra.run.gibba017:> sudo modprobe fuse 2021-11-15T19:27:10.108 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:10.108 DEBUG:teuthology.orchestra.run.gibba017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:10.162 INFO:teuthology.orchestra.run.gibba017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:10.162 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:10.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.164 DEBUG:teuthology.orchestra.run.gibba017:> ls /sys/fs/fuse/connections 2021-11-15T19:27:10.169 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:27:10.170 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:10.172 DEBUG:teuthology.orchestra.run.gibba017:> sudo modprobe fuse 2021-11-15T19:27:10.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:10.182 DEBUG:teuthology.orchestra.run.gibba017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:10.221 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.gibba017.stderr:2021-11-15T19:27:10.226+0000 7f97153cf080 -1 init, newargv = 0x55ca3b559910 newargc=9 2021-11-15T19:27:10.221 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.gibba017.stderr:ceph-fuse[14057]: starting ceph client 2021-11-15T19:27:10.226 INFO:teuthology.orchestra.run.gibba017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:10.226 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:10.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.228 DEBUG:teuthology.orchestra.run.gibba017:> ls /sys/fs/fuse/connections 2021-11-15T19:27:10.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.gibba017.stderr:ceph-fuse[14057]: starting fuse 2021-11-15T19:27:10.274 INFO:teuthology.orchestra.run.gibba017.stdout:52 2021-11-15T19:27:10.275 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:27:10.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.275 DEBUG:teuthology.orchestra.run.gibba017:> sudo python3 -c ' 2021-11-15T19:27:10.276 DEBUG:teuthology.orchestra.run.gibba017:> import glob 2021-11-15T19:27:10.276 DEBUG:teuthology.orchestra.run.gibba017:> import re 2021-11-15T19:27:10.276 DEBUG:teuthology.orchestra.run.gibba017:> import os 2021-11-15T19:27:10.277 DEBUG:teuthology.orchestra.run.gibba017:> import subprocess 2021-11-15T19:27:10.277 DEBUG:teuthology.orchestra.run.gibba017:> 2021-11-15T19:27:10.277 DEBUG:teuthology.orchestra.run.gibba017:> def find_socket(client_name): 2021-11-15T19:27:10.277 DEBUG:teuthology.orchestra.run.gibba017:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2021-11-15T19:27:10.278 DEBUG:teuthology.orchestra.run.gibba017:> files = glob.glob(asok_path) 2021-11-15T19:27:10.278 DEBUG:teuthology.orchestra.run.gibba017:> 2021-11-15T19:27:10.278 DEBUG:teuthology.orchestra.run.gibba017:> # Given a non-glob path, it better be there 2021-11-15T19:27:10.279 DEBUG:teuthology.orchestra.run.gibba017:> if "*" not in asok_path: 2021-11-15T19:27:10.279 DEBUG:teuthology.orchestra.run.gibba017:> assert(len(files) == 1) 2021-11-15T19:27:10.279 DEBUG:teuthology.orchestra.run.gibba017:> return files[0] 2021-11-15T19:27:10.280 DEBUG:teuthology.orchestra.run.gibba017:> 2021-11-15T19:27:10.280 DEBUG:teuthology.orchestra.run.gibba017:> for f in files: 2021-11-15T19:27:10.280 DEBUG:teuthology.orchestra.run.gibba017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:27:10.281 DEBUG:teuthology.orchestra.run.gibba017:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:27:10.281 DEBUG:teuthology.orchestra.run.gibba017:> return f 2021-11-15T19:27:10.281 DEBUG:teuthology.orchestra.run.gibba017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:27:10.282 DEBUG:teuthology.orchestra.run.gibba017:> 2021-11-15T19:27:10.282 DEBUG:teuthology.orchestra.run.gibba017:> print(find_socket("client.2")) 2021-11-15T19:27:10.282 DEBUG:teuthology.orchestra.run.gibba017:> ' 2021-11-15T19:27:10.340 INFO:teuthology.orchestra.run.gibba017.stdout:/var/run/ceph/ceph-client.2.14057.asok 2021-11-15T19:27:10.344 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.14057.asok 2021-11-15T19:27:10.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.345 DEBUG:teuthology.orchestra.run.gibba017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.14057.asok status 2021-11-15T19:27:10.396 INFO:teuthology.orchestra.run.gibba017.stdout:{ 2021-11-15T19:27:10.396 INFO:teuthology.orchestra.run.gibba017.stdout: "metadata": { 2021-11-15T19:27:10.396 INFO:teuthology.orchestra.run.gibba017.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:27:10.397 INFO:teuthology.orchestra.run.gibba017.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:27:10.397 INFO:teuthology.orchestra.run.gibba017.stdout: "entity_id": "2", 2021-11-15T19:27:10.397 INFO:teuthology.orchestra.run.gibba017.stdout: "hostname": "gibba017", 2021-11-15T19:27:10.397 INFO:teuthology.orchestra.run.gibba017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2021-11-15T19:27:10.397 INFO:teuthology.orchestra.run.gibba017.stdout: "pid": "14057", 2021-11-15T19:27:10.398 INFO:teuthology.orchestra.run.gibba017.stdout: "root": "/" 2021-11-15T19:27:10.398 INFO:teuthology.orchestra.run.gibba017.stdout: }, 2021-11-15T19:27:10.398 INFO:teuthology.orchestra.run.gibba017.stdout: "dentry_count": 0, 2021-11-15T19:27:10.398 INFO:teuthology.orchestra.run.gibba017.stdout: "dentry_pinned_count": 0, 2021-11-15T19:27:10.399 INFO:teuthology.orchestra.run.gibba017.stdout: "id": 4654, 2021-11-15T19:27:10.399 INFO:teuthology.orchestra.run.gibba017.stdout: "inst": { 2021-11-15T19:27:10.399 INFO:teuthology.orchestra.run.gibba017.stdout: "name": { 2021-11-15T19:27:10.399 INFO:teuthology.orchestra.run.gibba017.stdout: "type": "client", 2021-11-15T19:27:10.400 INFO:teuthology.orchestra.run.gibba017.stdout: "num": 4654 2021-11-15T19:27:10.400 INFO:teuthology.orchestra.run.gibba017.stdout: }, 2021-11-15T19:27:10.400 INFO:teuthology.orchestra.run.gibba017.stdout: "addr": { 2021-11-15T19:27:10.400 INFO:teuthology.orchestra.run.gibba017.stdout: "type": "v1", 2021-11-15T19:27:10.400 INFO:teuthology.orchestra.run.gibba017.stdout: "addr": "172.21.2.117:0", 2021-11-15T19:27:10.401 INFO:teuthology.orchestra.run.gibba017.stdout: "nonce": 899473615 2021-11-15T19:27:10.401 INFO:teuthology.orchestra.run.gibba017.stdout: } 2021-11-15T19:27:10.401 INFO:teuthology.orchestra.run.gibba017.stdout: }, 2021-11-15T19:27:10.401 INFO:teuthology.orchestra.run.gibba017.stdout: "addr": { 2021-11-15T19:27:10.402 INFO:teuthology.orchestra.run.gibba017.stdout: "type": "v1", 2021-11-15T19:27:10.402 INFO:teuthology.orchestra.run.gibba017.stdout: "addr": "172.21.2.117:0", 2021-11-15T19:27:10.402 INFO:teuthology.orchestra.run.gibba017.stdout: "nonce": 899473615 2021-11-15T19:27:10.402 INFO:teuthology.orchestra.run.gibba017.stdout: }, 2021-11-15T19:27:10.402 INFO:teuthology.orchestra.run.gibba017.stdout: "inst_str": "client.4654 172.21.2.117:0/899473615", 2021-11-15T19:27:10.403 INFO:teuthology.orchestra.run.gibba017.stdout: "addr_str": "172.21.2.117:0/899473615", 2021-11-15T19:27:10.403 INFO:teuthology.orchestra.run.gibba017.stdout: "inode_count": 1, 2021-11-15T19:27:10.403 INFO:teuthology.orchestra.run.gibba017.stdout: "mds_epoch": 5, 2021-11-15T19:27:10.403 INFO:teuthology.orchestra.run.gibba017.stdout: "osd_epoch": 21, 2021-11-15T19:27:10.403 INFO:teuthology.orchestra.run.gibba017.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:27:10.404 INFO:teuthology.orchestra.run.gibba017.stdout: "blacklisted": false, 2021-11-15T19:27:10.404 INFO:teuthology.orchestra.run.gibba017.stdout: "fs_name": "cephfs" 2021-11-15T19:27:10.404 INFO:teuthology.orchestra.run.gibba017.stdout:} 2021-11-15T19:27:10.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.406 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:10.406 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:10.417 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:27:10.419 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:27:10.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.419 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:10.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.439 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:10.439 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:10.451 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:27:10.452 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:27:10.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.453 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:10.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.518 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:10.519 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:10.527 INFO:teuthology.orchestra.run.gibba017.stdout:fuseblk 2021-11-15T19:27:10.528 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-11-15T19:27:10.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:10.529 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:10.561 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-11-15T19:27:10.581 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:10.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f6054f2e700 1 Processor -- start 2021-11-15T19:27:10.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f6054f2e700 1 -- start start 2021-11-15T19:27:10.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f6054f2e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6050147980 0x7f60500aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f6054f2e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6050148190 con 0x7f60500b1340 2021-11-15T19:27:10.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f6054f2e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60500b1720 con 0x7f6050144610 2021-11-15T19:27:10.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f6054f2e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500af800 con 0x7f6050147980 2021-11-15T19:27:10.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604dd9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6050144610 0x7f60500a9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50734/0 (socket says 172.21.2.137:50734) 2021-11-15T19:27:10.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604dd9b700 1 -- 172.21.2.137:0/138511898 learned_addr learned my addr 172.21.2.137:0/138511898 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:10.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353638876 0 0) 0x7f60500b1720 con 0x7f6050144610 2021-11-15T19:27:10.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003260 con 0x7f6050144610 2021-11-15T19:27:10.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604ed9d700 1 --2- 172.21.2.137:0/138511898 >> v2:172.21.2.111:3300/0 conn(0x7f6050147980 0x7f60500aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244176080 0 0) 0x7f6030003260 con 0x7f6050144610 2021-11-15T19:27:10.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 >> v2:172.21.2.111:3300/0 conn(0x7f6050147980 msgr2=0x7f60500aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:10.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 --2- 172.21.2.137:0/138511898 >> v2:172.21.2.111:3300/0 conn(0x7f6050147980 0x7f60500aa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 >> v1:172.21.2.111:6789/0 conn(0x7f60500b1340 legacy=0x7f6050143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:10.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605005faf0 con 0x7f6050144610 2021-11-15T19:27:10.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6040001660 con 0x7f6050144610 2021-11-15T19:27:10.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 >> v1:172.21.2.137:6789/0 conn(0x7f6050144610 legacy=0x7f60500a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f60300037d0 0x7f6030003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030004500 0x7f6030004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6030005070 0x7f603000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500af800 con 0x7f6030004500 2021-11-15T19:27:10.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603000bf90 con 0x7f6030005070 2021-11-15T19:27:10.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603000c150 con 0x7f60300037d0 2021-11-15T19:27:10.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.626+0000 7f604ed9d700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6030005070 0x7f603000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 -- 172.21.2.137:0/138511898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f60300037d0 msgr2=0x7f6030003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:10.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f60300037d0 0x7f6030003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 -- 172.21.2.137:0/138511898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030004500 msgr2=0x7f6030004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:10.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030004500 0x7f6030004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 -- 172.21.2.137:0/138511898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605005faf0 con 0x7f6030005070 2021-11-15T19:27:10.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 -- 172.21.2.137:0/138511898 reap_dead start 2021-11-15T19:27:10.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6030005070 0x7f603000b750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6048007000 tx=0x7f6048008040).ready entity=mon.1 client_cookie=21fc64cb7a89eb7c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6048015070 con 0x7f6030005070 2021-11-15T19:27:10.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800c640 con 0x7f6030005070 2021-11-15T19:27:10.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604d59a700 1 -- 172.21.2.137:0/138511898 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604800a4a0 con 0x7f6030005070 2021-11-15T19:27:10.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/138511898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6030005070 msgr2=0x7f603000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6030005070 0x7f603000b750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6048007000 tx=0x7f6048008040).stop 2021-11-15T19:27:10.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/138511898 shutdown_connections 2021-11-15T19:27:10.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 --2- 172.21.2.137:0/138511898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6030005070 0x7f603000b750 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/138511898 >> 172.21.2.137:0/138511898 conn(0x7f60500b4e60 msgr2=0x7f60500b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:10.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/138511898 shutdown_connections 2021-11-15T19:27:10.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/138511898 wait complete. 2021-11-15T19:27:10.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 Processor -- start 2021-11-15T19:27:10.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- start start 2021-11-15T19:27:10.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030005070 0x7f60500ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 0x7f60500aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6050159810 0x7f6050159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500ad550 con 0x7f6030005070 2021-11-15T19:27:10.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500af1d0 con 0x7f60500ae5a0 2021-11-15T19:27:10.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500ae140 con 0x7f6050159810 2021-11-15T19:27:10.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 0x7f60500aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 0x7f60500aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60196/0 (socket says 172.21.2.137:60196) 2021-11-15T19:27:10.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 -- 172.21.2.137:0/1155580222 learned_addr learned my addr 172.21.2.137:0/1155580222 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:10.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604e59c700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030005070 0x7f60500ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604ed9d700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6050159810 0x7f6050159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 -- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6050159810 msgr2=0x7f6050159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6050159810 0x7f6050159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 -- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030005070 msgr2=0x7f60500ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030005070 0x7f60500ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 -- 172.21.2.137:0/1155580222 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6050146200 con 0x7f60500ae5a0 2021-11-15T19:27:10.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f604dd9b700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 0x7f60500aea20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f6040001020 tx=0x7f6040001a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6040007170 con 0x7f60500ae5a0 2021-11-15T19:27:10.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60400072d0 con 0x7f60500ae5a0 2021-11-15T19:27:10.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6040004920 con 0x7f60500ae5a0 2021-11-15T19:27:10.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6050145f60 con 0x7f60500ae5a0 2021-11-15T19:27:10.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.630+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60501470b0 con 0x7f60500ae5a0 2021-11-15T19:27:10.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605005fd90 con 0x7f60500ae5a0 2021-11-15T19:27:10.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6040004a80 con 0x7f60500ae5a0 2021-11-15T19:27:10.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f60477fe700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6034053640 0x7f6034055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f604006b710 con 0x7f60500ae5a0 2021-11-15T19:27:10.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f604e59c700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6034053640 0x7f6034055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f604e59c700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6034053640 0x7f6034055b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f603800a000 tx=0x7f6038008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.634+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6040042700 con 0x7f60500ae5a0 2021-11-15T19:27:10.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60500573d0 con 0x7f60500ae5a0 2021-11-15T19:27:10.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f60477fe700 1 -- 172.21.2.137:0/1155580222 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f6040045d20 con 0x7f60500ae5a0 2021-11-15T19:27:10.729 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:10.730 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:10.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6034053640 msgr2=0x7f6034055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6034053640 0x7f6034055b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f603800a000 tx=0x7f6038008040).stop 2021-11-15T19:27:10.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 msgr2=0x7f60500aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 0x7f60500aea20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f6040001020 tx=0x7f6040001a60).stop 2021-11-15T19:27:10.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 shutdown_connections 2021-11-15T19:27:10.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6034053640 0x7f6034055b00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6050159810 0x7f6050159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60500ae5a0 0x7f60500aea20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 --2- 172.21.2.137:0/1155580222 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6030005070 0x7f60500ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 >> 172.21.2.137:0/1155580222 conn(0x7f60500b4e60 msgr2=0x7f60500afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:10.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 shutdown_connections 2021-11-15T19:27:10.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.718+0000 7f6054f2e700 1 -- 172.21.2.137:0/1155580222 wait complete. 2021-11-15T19:27:10.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:10.739 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:10.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 Processor -- start 2021-11-15T19:27:10.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- start start 2021-11-15T19:27:10.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 0x7facd00afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7facd00acff0 0x7facd00af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00aedf0 con 0x7facd013f5c0 2021-11-15T19:27:10.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd00ae070 con 0x7facd00acff0 2021-11-15T19:27:10.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00ad470 con 0x7facd00b0fe0 2021-11-15T19:27:10.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7facd00acff0 0x7facd00af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7facd00acff0 0x7facd00af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60206/0 (socket says 172.21.2.137:60206) 2021-11-15T19:27:10.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 -- 172.21.2.137:0/1417212961 learned_addr learned my addr 172.21.2.137:0/1417212961 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:10.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 -- 172.21.2.137:0/1417212961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 msgr2=0x7facd00afde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:10.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 --2- 172.21.2.137:0/1417212961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 0x7facd00afde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 -- 172.21.2.137:0/1417212961 >> v1:172.21.2.111:6789/0 conn(0x7facd013f5c0 legacy=0x7facd013c640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:10.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 -- 172.21.2.137:0/1417212961 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00b13c0 con 0x7facd00acff0 2021-11-15T19:27:10.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd4e68700 1 --2- 172.21.2.137:0/1417212961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd00af4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7facd00685f0 tx=0x7facc0006f40).ready entity=mon.1 client_cookie=43b6072e384be959 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facbffff700 1 -- 172.21.2.137:0/1417212961 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facc000dc30 con 0x7facd00acff0 2021-11-15T19:27:10.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facbffff700 1 -- 172.21.2.137:0/1417212961 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0000e90 con 0x7facd00acff0 2021-11-15T19:27:10.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facbffff700 1 -- 172.21.2.137:0/1417212961 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facc000be90 con 0x7facd00acff0 2021-11-15T19:27:10.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- 172.21.2.137:0/1417212961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 msgr2=0x7facd00af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 --2- 172.21.2.137:0/1417212961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd00af4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7facd00685f0 tx=0x7facc0006f40).stop 2021-11-15T19:27:10.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- 172.21.2.137:0/1417212961 shutdown_connections 2021-11-15T19:27:10.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 --2- 172.21.2.137:0/1417212961 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd00af4c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 --2- 172.21.2.137:0/1417212961 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 0x7facd00afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- 172.21.2.137:0/1417212961 >> 172.21.2.137:0/1417212961 conn(0x7facd00b5f50 msgr2=0x7facd00b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:10.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- 172.21.2.137:0/1417212961 shutdown_connections 2021-11-15T19:27:10.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.782+0000 7facd78cd700 1 -- 172.21.2.137:0/1417212961 wait complete. 2021-11-15T19:27:10.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 Processor -- start 2021-11-15T19:27:10.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- start start 2021-11-15T19:27:10.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd0135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 0x7facd0142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facd013f5c0 0x7facd0063d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd0135720 con 0x7facd013f5c0 2021-11-15T19:27:10.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01342e0 con 0x7facd00acff0 2021-11-15T19:27:10.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd013ed20 con 0x7facd00b0fe0 2021-11-15T19:27:10.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd0135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd0135a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60208/0 (socket says 172.21.2.137:60208) 2021-11-15T19:27:10.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 -- 172.21.2.137:0/1559384099 learned_addr learned my addr 172.21.2.137:0/1559384099 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:10.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 -- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 msgr2=0x7facd0142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 0x7facd0142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 -- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facd013f5c0 msgr2=0x7facd0063d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facd013f5c0 0x7facd0063d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 -- 172.21.2.137:0/1559384099 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc000b460 con 0x7facd00acff0 2021-11-15T19:27:10.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd5669700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd0135a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7faccc002fb0 tx=0x7faccc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc013460 con 0x7facd00acff0 2021-11-15T19:27:10.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0135c0 con 0x7facd00acff0 2021-11-15T19:27:10.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd0134510 con 0x7facd00acff0 2021-11-15T19:27:10.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc013920 con 0x7facd00acff0 2021-11-15T19:27:10.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd013efc0 con 0x7facd00acff0 2021-11-15T19:27:10.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd0134000 con 0x7facd00acff0 2021-11-15T19:27:10.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faccc00f070 con 0x7facd00acff0 2021-11-15T19:27:10.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facbe7fc700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facb0053580 0x7facb0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faccc06afe0 con 0x7facd00acff0 2021-11-15T19:27:10.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.786+0000 7facd4e68700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facb0053580 0x7facb0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.790+0000 7facd4e68700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facb0053580 0x7facb0055a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7facd00685f0 tx=0x7facc0006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.790+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faccc042140 con 0x7facd00acff0 2021-11-15T19:27:10.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.870+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7facd00ad690 con 0x7facd00acff0 2021-11-15T19:27:10.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.870+0000 7facbe7fc700 1 -- 172.21.2.137:0/1559384099 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7faccc018030 con 0x7facd00acff0 2021-11-15T19:27:10.882 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:10.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facb0053580 msgr2=0x7facb0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facb0053580 0x7facb0055a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7facd00685f0 tx=0x7facc0006f40).stop 2021-11-15T19:27:10.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 msgr2=0x7facd0135a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd0135a80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7faccc002fb0 tx=0x7faccc006df0).stop 2021-11-15T19:27:10.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 shutdown_connections 2021-11-15T19:27:10.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facb0053580 0x7facb0055a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facd013f5c0 0x7facd0063d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facd00b0fe0 0x7facd0142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 --2- 172.21.2.137:0/1559384099 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facd00acff0 0x7facd0135a80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 >> 172.21.2.137:0/1559384099 conn(0x7facd00b5f50 msgr2=0x7facd00608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:10.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 shutdown_connections 2021-11-15T19:27:10.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.874+0000 7facd78cd700 1 -- 172.21.2.137:0/1559384099 wait complete. 2021-11-15T19:27:10.889 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:10.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 Processor -- start 2021-11-15T19:27:10.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 -- start start 2021-11-15T19:27:10.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb66005c770 0x7fb6600aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb660140aa0 0x7fb660140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66005cb50 con 0x7fb6600b0550 2021-11-15T19:27:10.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600b1650 con 0x7fb66005c770 2021-11-15T19:27:10.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb66541b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600ad030 con 0x7fb660140aa0 2021-11-15T19:27:10.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb65effd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb66005c770 0x7fb6600aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb65e7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb6600b0550 0x7fb66014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50770/0 (socket says 172.21.2.137:50770) 2021-11-15T19:27:10.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.930+0000 7fb65e7fc700 1 -- 172.21.2.137:0/4235626479 learned_addr learned my addr 172.21.2.137:0/4235626479 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:10.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65effd700 1 -- 172.21.2.137:0/4235626479 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb660140aa0 msgr2=0x7fb660140f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:10.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65effd700 1 --2- 172.21.2.137:0/4235626479 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb660140aa0 0x7fb660140f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65effd700 1 -- 172.21.2.137:0/4235626479 >> v1:172.21.2.137:6789/0 conn(0x7fb6600b0550 legacy=0x7fb66014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65effd700 1 -- 172.21.2.137:0/4235626479 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600ad2d0 con 0x7fb66005c770 2021-11-15T19:27:10.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65effd700 1 --2- 172.21.2.137:0/4235626479 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb66005c770 0x7fb6600aef30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb650002f70 tx=0x7fb650006df0).ready entity=mon.1 client_cookie=339bcb3d2409aede server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65dffb700 1 -- 172.21.2.137:0/4235626479 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb65000d570 con 0x7fb66005c770 2021-11-15T19:27:10.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65dffb700 1 -- 172.21.2.137:0/4235626479 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650000e90 con 0x7fb66005c770 2021-11-15T19:27:10.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65dffb700 1 -- 172.21.2.137:0/4235626479 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb65000d900 con 0x7fb66005c770 2021-11-15T19:27:10.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/4235626479 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb66005c770 msgr2=0x7fb6600aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 --2- 172.21.2.137:0/4235626479 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb66005c770 0x7fb6600aef30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb650002f70 tx=0x7fb650006df0).stop 2021-11-15T19:27:10.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/4235626479 shutdown_connections 2021-11-15T19:27:10.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 --2- 172.21.2.137:0/4235626479 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb660140aa0 0x7fb660140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 --2- 172.21.2.137:0/4235626479 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb66005c770 0x7fb6600aef30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:10.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/4235626479 >> 172.21.2.137:0/4235626479 conn(0x7fb6600631e0 msgr2=0x7fb66005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:10.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/4235626479 shutdown_connections 2021-11-15T19:27:10.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/4235626479 wait complete. 2021-11-15T19:27:10.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 Processor -- start 2021-11-15T19:27:10.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- start start 2021-11-15T19:27:10.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb66005c770 0x7fb6601426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 0x7fb660142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb660140aa0 0x7fb660159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601438e0 con 0x7fb660140aa0 2021-11-15T19:27:10.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660145870 con 0x7fb6600b0550 2021-11-15T19:27:10.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660145b10 con 0x7fb66005c770 2021-11-15T19:27:10.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 0x7fb660142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 0x7fb660142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60222/0 (socket says 172.21.2.137:60222) 2021-11-15T19:27:10.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 -- 172.21.2.137:0/205714278 learned_addr learned my addr 172.21.2.137:0/205714278 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:10.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 -- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb66005c770 msgr2=0x7fb6601426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb66005c770 0x7fb6601426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 -- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb660140aa0 msgr2=0x7fb660159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:10.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb660140aa0 0x7fb660159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:10.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 -- 172.21.2.137:0/205714278 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65000b180 con 0x7fb6600b0550 2021-11-15T19:27:10.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb65e7fc700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 0x7fb660142fb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb660144bf0 tx=0x7fb648007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb64800ce20 con 0x7fb6600b0550 2021-11-15T19:27:10.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6480072e0 con 0x7fb6600b0550 2021-11-15T19:27:10.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600673c0 con 0x7fb6600b0550 2021-11-15T19:27:10.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6601416f0 con 0x7fb6600b0550 2021-11-15T19:27:10.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb648005800 con 0x7fb6600b0550 2021-11-15T19:27:10.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.934+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6600ae7f0 con 0x7fb6600b0550 2021-11-15T19:27:10.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.938+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb648010070 con 0x7fb6600b0550 2021-11-15T19:27:10.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.938+0000 7fb657fff700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6440536f0 0x7fb644055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:10.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.938+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb64806b140 con 0x7fb6600b0550 2021-11-15T19:27:10.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.938+0000 7fb65effd700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6440536f0 0x7fb644055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:10.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.938+0000 7fb65effd700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6440536f0 0x7fb644055bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb650002f70 tx=0x7fb650015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:10.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:10.938+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb648042190 con 0x7fb6600b0550 2021-11-15T19:27:11.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.022+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6600573d0 con 0x7fb6600b0550 2021-11-15T19:27:11.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.022+0000 7fb657fff700 1 -- 172.21.2.137:0/205714278 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6480457b0 con 0x7fb6600b0550 2021-11-15T19:27:11.034 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:11.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.022+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6440536f0 msgr2=0x7fb644055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.022+0000 7fb66541b700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6440536f0 0x7fb644055bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb650002f70 tx=0x7fb650015000).stop 2021-11-15T19:27:11.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.022+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 msgr2=0x7fb660142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.022+0000 7fb66541b700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 0x7fb660142fb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb660144bf0 tx=0x7fb648007c40).stop 2021-11-15T19:27:11.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 shutdown_connections 2021-11-15T19:27:11.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6440536f0 0x7fb644055bb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb660140aa0 0x7fb660159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6600b0550 0x7fb660142fb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 --2- 172.21.2.137:0/205714278 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb66005c770 0x7fb6601426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 >> 172.21.2.137:0/205714278 conn(0x7fb6600631e0 msgr2=0x7fb6600b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 shutdown_connections 2021-11-15T19:27:11.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.026+0000 7fb66541b700 1 -- 172.21.2.137:0/205714278 wait complete. 2021-11-15T19:27:11.040 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:11.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 Processor -- start 2021-11-15T19:27:11.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- start start 2021-11-15T19:27:11.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5d9c0b0fe0 0x7f5d9c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5d9c0acff0 0x7f5d9c0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c0ad4a0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c0ae070 con 0x7f5d9c0b0fe0 2021-11-15T19:27:11.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0aedf0 con 0x7f5d9c13f5c0 2021-11-15T19:27:11.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5d9c0b0fe0 0x7f5d9c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5d9c0b0fe0 0x7f5d9c0afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60230/0 (socket says 172.21.2.137:60230) 2021-11-15T19:27:11.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 -- 172.21.2.137:0/2666585262 learned_addr learned my addr 172.21.2.137:0/2666585262 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 -- 172.21.2.137:0/2666585262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 msgr2=0x7f5d9c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 --2- 172.21.2.137:0/2666585262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 -- 172.21.2.137:0/2666585262 >> v2:172.21.2.111:3300/0 conn(0x7f5d9c0acff0 msgr2=0x7f5d9c0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 --2- 172.21.2.137:0/2666585262 >> v2:172.21.2.111:3300/0 conn(0x7f5d9c0acff0 0x7f5d9c0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 -- 172.21.2.137:0/2666585262 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c0b13c0 con 0x7f5d9c0b0fe0 2021-11-15T19:27:11.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d9affd700 1 --2- 172.21.2.137:0/2666585262 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c0afde0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5d84002f70 tx=0x7f5d84006eb0).ready entity=mon.1 client_cookie=a1b2cf753ddb06a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d99ffb700 1 -- 172.21.2.137:0/2666585262 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8400f970 con 0x7f5d9c0b0fe0 2021-11-15T19:27:11.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d99ffb700 1 -- 172.21.2.137:0/2666585262 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84000e90 con 0x7f5d9c0b0fe0 2021-11-15T19:27:11.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5d99ffb700 1 -- 172.21.2.137:0/2666585262 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8400fd00 con 0x7f5d9c0b0fe0 2021-11-15T19:27:11.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- 172.21.2.137:0/2666585262 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0b0fe0 msgr2=0x7f5d9c0afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- 172.21.2.137:0/2666585262 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c0afde0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5d84002f70 tx=0x7f5d84006eb0).stop 2021-11-15T19:27:11.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- 172.21.2.137:0/2666585262 shutdown_connections 2021-11-15T19:27:11.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- 172.21.2.137:0/2666585262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- 172.21.2.137:0/2666585262 >> v2:172.21.2.111:3300/0 conn(0x7f5d9c0acff0 0x7f5d9c0af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 --2- 172.21.2.137:0/2666585262 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c0afde0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- 172.21.2.137:0/2666585262 >> 172.21.2.137:0/2666585262 conn(0x7f5d9c0b5f50 msgr2=0x7f5d9c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- 172.21.2.137:0/2666585262 shutdown_connections 2021-11-15T19:27:11.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.082+0000 7f5da1a36700 1 -- 172.21.2.137:0/2666585262 wait complete. 2021-11-15T19:27:11.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 Processor -- start 2021-11-15T19:27:11.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- start start 2021-11-15T19:27:11.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 0x7f5d9c10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c14e130 con 0x7f5d9c0b0fe0 2021-11-15T19:27:11.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c14e3a0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c14e640 con 0x7f5d9c13f5c0 2021-11-15T19:27:11.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 0x7f5d9c10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 0x7f5d9c10fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60236/0 (socket says 172.21.2.137:60236) 2021-11-15T19:27:11.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 -- 172.21.2.137:0/3216895882 learned_addr learned my addr 172.21.2.137:0/3216895882 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 -- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 msgr2=0x7f5d9c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9a7fc700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9b7fe700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 -- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d9c0b0fe0 msgr2=0x7f5d9c14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 -- 172.21.2.137:0/3216895882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8400b1e0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9a7fc700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:11.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9b7fe700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:11.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9affd700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 0x7f5d9c10fb70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5d84002f70 tx=0x7f5d84017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84020070 con 0x7f5d9c0acff0 2021-11-15T19:27:11.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840197e0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c14e8e0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84006be0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c064bd0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c0ad690 con 0x7f5d9c0acff0 2021-11-15T19:27:11.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d84019b40 con 0x7f5d9c0acff0 2021-11-15T19:27:11.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d93fff700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d80053580 0x7f5d80055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5d8406ec40 con 0x7f5d9c0acff0 2021-11-15T19:27:11.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.086+0000 7f5d9a7fc700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d80053580 0x7f5d80055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.090+0000 7f5d9a7fc700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d80053580 0x7f5d80055a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f5d8c007000 tx=0x7f5d8c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.090+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d84045da0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d9c0573d0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5d93fff700 1 -- 172.21.2.137:0/3216895882 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5d840493c0 con 0x7f5d9c0acff0 2021-11-15T19:27:11.183 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:11.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d80053580 msgr2=0x7f5d80055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d80053580 0x7f5d80055a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f5d8c007000 tx=0x7f5d8c008040).stop 2021-11-15T19:27:11.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 msgr2=0x7f5d9c10fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 0x7f5d9c10fb70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5d84002f70 tx=0x7f5d84017000).stop 2021-11-15T19:27:11.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 shutdown_connections 2021-11-15T19:27:11.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d80053580 0x7f5d80055a40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d9c13f5c0 0x7f5d9c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d9c0b0fe0 0x7f5d9c14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 --2- 172.21.2.137:0/3216895882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d9c0acff0 0x7f5d9c10fb70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 >> 172.21.2.137:0/3216895882 conn(0x7f5d9c0b5f50 msgr2=0x7f5d9c13e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 shutdown_connections 2021-11-15T19:27:11.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.174+0000 7f5da1a36700 1 -- 172.21.2.137:0/3216895882 wait complete. 2021-11-15T19:27:11.190 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:11.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 Processor -- start 2021-11-15T19:27:11.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- start start 2021-11-15T19:27:11.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcf4c0ad930 0x7fcf4c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcf4c0b45b0 0x7fcf4c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c0ad480 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0635b0 con 0x7fcf4c0b45b0 2021-11-15T19:27:11.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0adfa0 con 0x7fcf4c0ad930 2021-11-15T19:27:11.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcf4c0ad930 0x7fcf4c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcf4c0ad930 0x7fcf4c0b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60246/0 (socket says 172.21.2.137:60246) 2021-11-15T19:27:11.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 -- 172.21.2.137:0/1638849462 learned_addr learned my addr 172.21.2.137:0/1638849462 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 -- 172.21.2.137:0/1638849462 >> v2:172.21.2.111:3300/0 conn(0x7fcf4c0b45b0 msgr2=0x7fcf4c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 --2- 172.21.2.137:0/1638849462 >> v2:172.21.2.111:3300/0 conn(0x7fcf4c0b45b0 0x7fcf4c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 -- 172.21.2.137:0/1638849462 >> v1:172.21.2.137:6789/0 conn(0x7fcf4c0ad0a0 legacy=0x7fcf4c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4959a700 1 -- 172.21.2.137:0/1638849462 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942317276 0 0) 0x7fcf4c0ad480 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 -- 172.21.2.137:0/1638849462 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c147520 con 0x7fcf4c0ad930 2021-11-15T19:27:11.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf49d9b700 1 --2- 172.21.2.137:0/1638849462 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad930 0x7fcf4c0b40c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcf3c002f70 tx=0x7fcf3c006eb0).ready entity=mon.1 client_cookie=6cac8ad9b4ef2716 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4959a700 1 -- 172.21.2.137:0/1638849462 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3c00d610 con 0x7fcf4c0ad930 2021-11-15T19:27:11.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4959a700 1 -- 172.21.2.137:0/1638849462 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c000e90 con 0x7fcf4c0ad930 2021-11-15T19:27:11.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4959a700 1 -- 172.21.2.137:0/1638849462 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3c00d960 con 0x7fcf4c0ad930 2021-11-15T19:27:11.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- 172.21.2.137:0/1638849462 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad930 msgr2=0x7fcf4c0b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- 172.21.2.137:0/1638849462 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad930 0x7fcf4c0b40c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcf3c002f70 tx=0x7fcf3c006eb0).stop 2021-11-15T19:27:11.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- 172.21.2.137:0/1638849462 shutdown_connections 2021-11-15T19:27:11.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- 172.21.2.137:0/1638849462 >> v2:172.21.2.111:3300/0 conn(0x7fcf4c0b45b0 0x7fcf4c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- 172.21.2.137:0/1638849462 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad930 0x7fcf4c0b40c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- 172.21.2.137:0/1638849462 >> 172.21.2.137:0/1638849462 conn(0x7fcf4c064960 msgr2=0x7fcf4c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- 172.21.2.137:0/1638849462 shutdown_connections 2021-11-15T19:27:11.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- 172.21.2.137:0/1638849462 wait complete. 2021-11-15T19:27:11.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 Processor -- start 2021-11-15T19:27:11.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- start start 2021-11-15T19:27:11.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 0x7fcf4c0ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf4c0ad930 0x7fcf4c111890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf4c0b45b0 0x7fcf4c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c111d80 con 0x7fcf4c0b45b0 2021-11-15T19:27:11.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c067590 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf50942700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c111150 con 0x7fcf4c0ad930 2021-11-15T19:27:11.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 0x7fcf4c0ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 0x7fcf4c0ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60250/0 (socket says 172.21.2.137:60250) 2021-11-15T19:27:11.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.234+0000 7fcf4a59c700 1 -- 172.21.2.137:0/1066979189 learned_addr learned my addr 172.21.2.137:0/1066979189 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf4a59c700 1 -- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf4c0ad930 msgr2=0x7fcf4c111890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:11.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf4a59c700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf4c0ad930 0x7fcf4c111890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf4a59c700 1 -- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf4c0b45b0 msgr2=0x7fcf4c0b0830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:11.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf4a59c700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf4c0b45b0 0x7fcf4c0b0830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf4a59c700 1 -- 172.21.2.137:0/1066979189 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c00b1e0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf4a59c700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 0x7fcf4c0ae9b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fcf34000bc0 tx=0x7fcf34007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3400ce00 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400f470 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3400f7d0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c1113f0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c110f00 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c1477c0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf34019030 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf30053610 0x7fcf30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fcf3406ac10 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf49d9b700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf30053610 0x7fcf30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf49d9b700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf30053610 0x7fcf30055ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fcf3c002f70 tx=0x7fcf3c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.238+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf34041dc0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf4c0573d0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf437fe700 1 -- 172.21.2.137:0/1066979189 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcf340453e0 con 0x7fcf4c0ad0a0 2021-11-15T19:27:11.333 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:11.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf30053610 msgr2=0x7fcf30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf30053610 0x7fcf30055ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fcf3c002f70 tx=0x7fcf3c015000).stop 2021-11-15T19:27:11.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 msgr2=0x7fcf4c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 0x7fcf4c0ae9b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fcf34000bc0 tx=0x7fcf34007a70).stop 2021-11-15T19:27:11.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 shutdown_connections 2021-11-15T19:27:11.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf30053610 0x7fcf30055ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf4c0b45b0 0x7fcf4c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf4c0ad930 0x7fcf4c111890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 --2- 172.21.2.137:0/1066979189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf4c0ad0a0 0x7fcf4c0ae9b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 >> 172.21.2.137:0/1066979189 conn(0x7fcf4c064960 msgr2=0x7fcf4c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 shutdown_connections 2021-11-15T19:27:11.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.322+0000 7fcf50942700 1 -- 172.21.2.137:0/1066979189 wait complete. 2021-11-15T19:27:11.340 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:11.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.378+0000 7f0956c52700 1 Processor -- start 2021-11-15T19:27:11.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.378+0000 7f0956c52700 1 -- start start 2021-11-15T19:27:11.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f095005fe40 0x7f09500b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500b0c80 con 0x7f095013f890 2021-11-15T19:27:11.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500b0f20 con 0x7f09500608f0 2021-11-15T19:27:11.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500ad6c0 con 0x7f095005fe40 2021-11-15T19:27:11.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f095005fe40 0x7f09500b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f095005fe40 0x7f09500b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60262/0 (socket says 172.21.2.137:60262) 2021-11-15T19:27:11.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/3923307300 learned_addr learned my addr 172.21.2.137:0/3923307300 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/3923307300 >> v1:172.21.2.137:6789/0 conn(0x7f09500608f0 legacy=0x7f09500b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/3923307300 >> v1:172.21.2.111:6789/0 conn(0x7f095013f890 legacy=0x7f095005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/3923307300 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500b11c0 con 0x7f095005fe40 2021-11-15T19:27:11.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- 172.21.2.137:0/3923307300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095005fe40 0x7f09500b1660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f09500b3ac0 tx=0x7f0948009290).ready entity=mon.1 client_cookie=54df2ef83d8e1afd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f094f7fe700 1 -- 172.21.2.137:0/3923307300 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094800b860 con 0x7f095005fe40 2021-11-15T19:27:11.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f094f7fe700 1 -- 172.21.2.137:0/3923307300 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094800b9c0 con 0x7f095005fe40 2021-11-15T19:27:11.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f094f7fe700 1 -- 172.21.2.137:0/3923307300 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094800bb30 con 0x7f095005fe40 2021-11-15T19:27:11.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/3923307300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095005fe40 msgr2=0x7f09500b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 --2- 172.21.2.137:0/3923307300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095005fe40 0x7f09500b1660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f09500b3ac0 tx=0x7f0948009290).stop 2021-11-15T19:27:11.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/3923307300 shutdown_connections 2021-11-15T19:27:11.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 --2- 172.21.2.137:0/3923307300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095005fe40 0x7f09500b1660 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/3923307300 >> 172.21.2.137:0/3923307300 conn(0x7f0950063980 msgr2=0x7f0950063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/3923307300 shutdown_connections 2021-11-15T19:27:11.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/3923307300 wait complete. 2021-11-15T19:27:11.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 Processor -- start 2021-11-15T19:27:11.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- start start 2021-11-15T19:27:11.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f095005fe40 0x7f09500670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09500608f0 0x7f095013cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 0x7f095013d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950157000 con 0x7f095005fe40 2021-11-15T19:27:11.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950157220 con 0x7f095013f890 2021-11-15T19:27:11.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0950157650 con 0x7f09500608f0 2021-11-15T19:27:11.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 0x7f095013d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 0x7f095013d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60266/0 (socket says 172.21.2.137:60266) 2021-11-15T19:27:11.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/327590160 learned_addr learned my addr 172.21.2.137:0/327590160 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09500608f0 msgr2=0x7f095013cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09500608f0 0x7f095013cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f095005fe40 msgr2=0x7f09500670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f095005fe40 0x7f09500670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 -- 172.21.2.137:0/327590160 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948009530 con 0x7f095013f890 2021-11-15T19:27:11.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f09551ef700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 0x7f095013d460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f0950157140 tx=0x7f0948016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094801f3f0 con 0x7f095013f890 2021-11-15T19:27:11.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094801f550 con 0x7f095013f890 2021-11-15T19:27:11.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095013db00 con 0x7f095013f890 2021-11-15T19:27:11.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094801f8b0 con 0x7f095013f890 2021-11-15T19:27:11.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0950066db0 con 0x7f095013f890 2021-11-15T19:27:11.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.382+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095013d950 con 0x7f095013f890 2021-11-15T19:27:11.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.386+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0948026030 con 0x7f095013f890 2021-11-15T19:27:11.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.386+0000 7f094dffb700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0934053580 0x7f0934055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.386+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f094806c750 con 0x7f095013f890 2021-11-15T19:27:11.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.386+0000 7f09549ee700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0934053580 0x7f0934055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.386+0000 7f09549ee700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0934053580 0x7f0934055a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f09500b3b00 tx=0x7f0940007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.386+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09480438b0 con 0x7f095013f890 2021-11-15T19:27:11.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09500573d0 con 0x7f095013f890 2021-11-15T19:27:11.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f094dffb700 1 -- 172.21.2.137:0/327590160 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f0948024090 con 0x7f095013f890 2021-11-15T19:27:11.479 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:11.479 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:11.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0934053580 msgr2=0x7f0934055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0934053580 0x7f0934055a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f09500b3b00 tx=0x7f0940007810).stop 2021-11-15T19:27:11.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 msgr2=0x7f095013d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 0x7f095013d460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f0950157140 tx=0x7f0948016000).stop 2021-11-15T19:27:11.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 shutdown_connections 2021-11-15T19:27:11.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0934053580 0x7f0934055a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f095013f890 0x7f095013d460 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09500608f0 0x7f095013cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 --2- 172.21.2.137:0/327590160 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f095005fe40 0x7f09500670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 >> 172.21.2.137:0/327590160 conn(0x7f0950063980 msgr2=0x7f0950063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 shutdown_connections 2021-11-15T19:27:11.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.470+0000 7f0956c52700 1 -- 172.21.2.137:0/327590160 wait complete. 2021-11-15T19:27:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:11.487 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:11.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 Processor -- start 2021-11-15T19:27:11.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- start start 2021-11-15T19:27:11.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb6080b0fe0 0x7fb6080afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb60813f5c0 0x7fb60813fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080aedf0 con 0x7fb6080acff0 2021-11-15T19:27:11.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080ad4a0 con 0x7fb60813f5c0 2021-11-15T19:27:11.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080ae070 con 0x7fb6080b0fe0 2021-11-15T19:27:11.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb6080b0fe0 0x7fb6080afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb6080b0fe0 0x7fb6080afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60272/0 (socket says 172.21.2.137:60272) 2021-11-15T19:27:11.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 -- 172.21.2.137:0/4120383641 learned_addr learned my addr 172.21.2.137:0/4120383641 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 -- 172.21.2.137:0/4120383641 >> v2:172.21.2.111:3300/0 conn(0x7fb60813f5c0 msgr2=0x7fb60813fa30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:11.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 --2- 172.21.2.137:0/4120383641 >> v2:172.21.2.111:3300/0 conn(0x7fb60813f5c0 0x7fb60813fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 -- 172.21.2.137:0/4120383641 >> v1:172.21.2.111:6789/0 conn(0x7fb6080acff0 legacy=0x7fb6080af4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:11.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 -- 172.21.2.137:0/4120383641 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080afbd0 con 0x7fb6080b0fe0 2021-11-15T19:27:11.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60e114700 1 --2- 172.21.2.137:0/4120383641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb6080afde0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb6080aec90 tx=0x7fb5fc006f40).ready entity=mon.1 client_cookie=3b90c13bcaba4fbe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60d112700 1 -- 172.21.2.137:0/4120383641 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5fc00dc30 con 0x7fb6080b0fe0 2021-11-15T19:27:11.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60d112700 1 -- 172.21.2.137:0/4120383641 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc000e90 con 0x7fb6080b0fe0 2021-11-15T19:27:11.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb60d112700 1 -- 172.21.2.137:0/4120383641 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5fc00be90 con 0x7fb6080b0fe0 2021-11-15T19:27:11.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- 172.21.2.137:0/4120383641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 msgr2=0x7fb6080afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 --2- 172.21.2.137:0/4120383641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb6080afde0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb6080aec90 tx=0x7fb5fc006f40).stop 2021-11-15T19:27:11.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- 172.21.2.137:0/4120383641 shutdown_connections 2021-11-15T19:27:11.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 --2- 172.21.2.137:0/4120383641 >> v2:172.21.2.111:3300/0 conn(0x7fb60813f5c0 0x7fb60813fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 --2- 172.21.2.137:0/4120383641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb6080afde0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- 172.21.2.137:0/4120383641 >> 172.21.2.137:0/4120383641 conn(0x7fb6080b5f50 msgr2=0x7fb6080b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- 172.21.2.137:0/4120383641 shutdown_connections 2021-11-15T19:27:11.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.530+0000 7fb610378700 1 -- 172.21.2.137:0/4120383641 wait complete. 2021-11-15T19:27:11.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 Processor -- start 2021-11-15T19:27:11.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- start start 2021-11-15T19:27:11.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6080acff0 0x7fb6080b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb608064970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb60813f5c0 0x7fb608064e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608064370 con 0x7fb60813f5c0 2021-11-15T19:27:11.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608151f10 con 0x7fb6080b0fe0 2021-11-15T19:27:11.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb608060400 con 0x7fb6080acff0 2021-11-15T19:27:11.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb608064970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb608064970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60280/0 (socket says 172.21.2.137:60280) 2021-11-15T19:27:11.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 -- 172.21.2.137:0/624637044 learned_addr learned my addr 172.21.2.137:0/624637044 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 -- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6080acff0 msgr2=0x7fb6080b40c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:11.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6080acff0 0x7fb6080b40c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 -- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb60813f5c0 msgr2=0x7fb608064e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:11.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb60813f5c0 0x7fb608064e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 -- 172.21.2.137:0/624637044 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc00b460 con 0x7fb6080b0fe0 2021-11-15T19:27:11.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60d913700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb608064970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb604002fb0 tx=0x7fb604006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb604013460 con 0x7fb6080b0fe0 2021-11-15T19:27:11.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6040135c0 con 0x7fb6080b0fe0 2021-11-15T19:27:11.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb608065350 con 0x7fb6080b0fe0 2021-11-15T19:27:11.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb608143610 con 0x7fb6080b0fe0 2021-11-15T19:27:11.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb604013920 con 0x7fb6080b0fe0 2021-11-15T19:27:11.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb608151d50 con 0x7fb6080b0fe0 2021-11-15T19:27:11.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb60400f070 con 0x7fb6080b0fe0 2021-11-15T19:27:11.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb5fb7fe700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb5e8053580 0x7fb5e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb60406b490 con 0x7fb6080b0fe0 2021-11-15T19:27:11.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.534+0000 7fb60e114700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb5e8053580 0x7fb5e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.538+0000 7fb60e114700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb5e8053580 0x7fb5e8055a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb6080aec90 tx=0x7fb5fc006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.538+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6040424e0 con 0x7fb6080b0fe0 2021-11-15T19:27:11.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.618+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb608064540 con 0x7fb6080b0fe0 2021-11-15T19:27:11.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.618+0000 7fb5fb7fe700 1 -- 172.21.2.137:0/624637044 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb604045b00 con 0x7fb6080b0fe0 2021-11-15T19:27:11.630 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:11.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb5e8053580 msgr2=0x7fb5e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb5e8053580 0x7fb5e8055a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb6080aec90 tx=0x7fb5fc006f40).stop 2021-11-15T19:27:11.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 msgr2=0x7fb608064970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb608064970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb604002fb0 tx=0x7fb604006df0).stop 2021-11-15T19:27:11.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 shutdown_connections 2021-11-15T19:27:11.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb5e8053580 0x7fb5e8055a40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb60813f5c0 0x7fb608064e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6080b0fe0 0x7fb608064970 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 --2- 172.21.2.137:0/624637044 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6080acff0 0x7fb6080b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 >> 172.21.2.137:0/624637044 conn(0x7fb6080b5f50 msgr2=0x7fb6080608b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 shutdown_connections 2021-11-15T19:27:11.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.622+0000 7fb610378700 1 -- 172.21.2.137:0/624637044 wait complete. 2021-11-15T19:27:11.637 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:11.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc17a560700 1 Processor -- start 2021-11-15T19:27:11.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc17a560700 1 -- start start 2021-11-15T19:27:11.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc17a560700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174065730 0x7fc17413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc17a560700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc174066270 con 0x7fc1740b00a0 2021-11-15T19:27:11.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc17a560700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc174065fd0 con 0x7fc174065b10 2021-11-15T19:27:11.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc17a560700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174067410 con 0x7fc174065730 2021-11-15T19:27:11.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc1737fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc174065b10 0x7fc17413c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50838/0 (socket says 172.21.2.137:50838) 2021-11-15T19:27:11.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc1737fe700 1 -- 172.21.2.137:0/373345667 learned_addr learned my addr 172.21.2.137:0/373345667 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:11.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405926688 0 0) 0x7fc174065fd0 con 0x7fc174065b10 2021-11-15T19:27:11.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc154003260 con 0x7fc174065b10 2021-11-15T19:27:11.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1993145596 0 0) 0x7fc154003260 con 0x7fc174065b10 2021-11-15T19:27:11.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174065730 msgr2=0x7fc17413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174065730 0x7fc17413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 >> v1:172.21.2.111:6789/0 conn(0x7fc1740b00a0 legacy=0x7fc17405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc174066f70 con 0x7fc174065b10 2021-11-15T19:27:11.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.678+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fc164001660 con 0x7fc174065b10 2021-11-15T19:27:11.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 >> v1:172.21.2.137:6789/0 conn(0x7fc174065b10 legacy=0x7fc17413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174065730 0x7fc154003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154003e10 0x7fc154004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc154004b10 0x7fc154004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174067410 con 0x7fc154003e10 2021-11-15T19:27:11.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15400ca70 con 0x7fc154004b10 2021-11-15T19:27:11.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540057a0 con 0x7fc174065730 2021-11-15T19:27:11.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc154004b10 0x7fc154004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174065730 msgr2=0x7fc154003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174065730 0x7fc154003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154003e10 msgr2=0x7fc154004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154003e10 0x7fc154004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/373345667 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154003260 con 0x7fc154004b10 2021-11-15T19:27:11.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc154004b10 0x7fc154004f90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc16c0012f0 tx=0x7fc16c007d60).ready entity=mon.1 client_cookie=e28c713cda8e6b81 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c006a60 con 0x7fc154004b10 2021-11-15T19:27:11.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c006bc0 con 0x7fc154004b10 2021-11-15T19:27:11.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc172ffd700 1 -- 172.21.2.137:0/373345667 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c007030 con 0x7fc154004b10 2021-11-15T19:27:11.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/373345667 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc154004b10 msgr2=0x7fc154004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 --2- 172.21.2.137:0/373345667 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc154004b10 0x7fc154004f90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc16c0012f0 tx=0x7fc16c007d60).stop 2021-11-15T19:27:11.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/373345667 reap_dead start 2021-11-15T19:27:11.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/373345667 shutdown_connections 2021-11-15T19:27:11.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/373345667 >> 172.21.2.137:0/373345667 conn(0x7fc174060290 msgr2=0x7fc174060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/373345667 shutdown_connections 2021-11-15T19:27:11.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/373345667 wait complete. 2021-11-15T19:27:11.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 Processor -- start 2021-11-15T19:27:11.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- start start 2021-11-15T19:27:11.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154004b10 0x7fc174150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174141320 0x7fc17405ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 0x7fc17410f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174140800 con 0x7fc154004b10 2021-11-15T19:27:11.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174140aa0 con 0x7fc17410f060 2021-11-15T19:27:11.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17410f9d0 con 0x7fc174141320 2021-11-15T19:27:11.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 0x7fc17410f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 0x7fc17410f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60300/0 (socket says 172.21.2.137:60300) 2021-11-15T19:27:11.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/961216607 learned_addr learned my addr 172.21.2.137:0/961216607 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174141320 msgr2=0x7fc17405ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174141320 0x7fc17405ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154004b10 msgr2=0x7fc174150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154004b10 0x7fc174150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 -- 172.21.2.137:0/961216607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740ae940 con 0x7fc17410f060 2021-11-15T19:27:11.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc178afd700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 0x7fc17410f4e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc174062df0 tx=0x7fc16c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c022070 con 0x7fc17410f060 2021-11-15T19:27:11.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c011630 con 0x7fc17410f060 2021-11-15T19:27:11.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc174140480 con 0x7fc17410f060 2021-11-15T19:27:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c006a60 con 0x7fc17410f060 2021-11-15T19:27:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.682+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1741395e0 con 0x7fc17410f060 2021-11-15T19:27:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740b0fb0 con 0x7fc17410f060 2021-11-15T19:27:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc16c011990 con 0x7fc17410f060 2021-11-15T19:27:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc1717fa700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1580536d0 0x7fc158055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc16c016020 con 0x7fc17410f060 2021-11-15T19:27:11.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc173fff700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1580536d0 0x7fc158055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc173fff700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1580536d0 0x7fc158055b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc15c002f70 tx=0x7fc15c006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.686+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc16c046de0 con 0x7fc17410f060 2021-11-15T19:27:11.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc1740573d0 con 0x7fc17410f060 2021-11-15T19:27:11.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc1717fa700 1 -- 172.21.2.137:0/961216607 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc16c04a400 con 0x7fc17410f060 2021-11-15T19:27:11.779 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:11.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1580536d0 msgr2=0x7fc158055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1580536d0 0x7fc158055b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc15c002f70 tx=0x7fc15c006a10).stop 2021-11-15T19:27:11.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 msgr2=0x7fc17410f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 0x7fc17410f4e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc174062df0 tx=0x7fc16c014000).stop 2021-11-15T19:27:11.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 shutdown_connections 2021-11-15T19:27:11.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1580536d0 0x7fc158055b90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc17410f060 0x7fc17410f4e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc174141320 0x7fc17405ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 --2- 172.21.2.137:0/961216607 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc154004b10 0x7fc174150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 >> 172.21.2.137:0/961216607 conn(0x7fc174060290 msgr2=0x7fc1740b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 shutdown_connections 2021-11-15T19:27:11.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.770+0000 7fc17a560700 1 -- 172.21.2.137:0/961216607 wait complete. 2021-11-15T19:27:11.786 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:11.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.826+0000 7f21977e1700 1 Processor -- start 2021-11-15T19:27:11.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.826+0000 7f21977e1700 1 -- start start 2021-11-15T19:27:11.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900b72e0 0x7f21900b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f21900ad320 0x7f21901290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900b76c0 con 0x7f21900acd60 2021-11-15T19:27:11.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900b3100 con 0x7f21900ad320 2021-11-15T19:27:11.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219012a170 con 0x7f21900b72e0 2021-11-15T19:27:11.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f219557d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900b72e0 0x7f21900b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2195d7e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f21900ad320 0x7f21901290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2194d7c700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f21900acd60 0x7f21900b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:43348/0 (socket says 172.21.2.137:43348) 2021-11-15T19:27:11.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2194d7c700 1 -- 172.21.2.137:0/800320485 learned_addr learned my addr 172.21.2.137:0/800320485 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:11.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2195d7e700 1 -- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900b72e0 msgr2=0x7f21900b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2195d7e700 1 --2- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900b72e0 0x7f21900b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2195d7e700 1 -- 172.21.2.137:0/800320485 >> v1:172.21.2.111:6789/0 conn(0x7f21900acd60 legacy=0x7f21900b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2195d7e700 1 -- 172.21.2.137:0/800320485 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900ad8a0 con 0x7f21900ad320 2021-11-15T19:27:11.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2195d7e700 1 --2- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900ad320 0x7f21901290c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f21880032f0 tx=0x7f21880091d0).ready entity=mon.0 client_cookie=c5b7bdb3ad330baf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2183fff700 1 -- 172.21.2.137:0/800320485 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218800b6c0 con 0x7f21900ad320 2021-11-15T19:27:11.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2183fff700 1 -- 172.21.2.137:0/800320485 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800b820 con 0x7f21900ad320 2021-11-15T19:27:11.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f2183fff700 1 -- 172.21.2.137:0/800320485 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218800b990 con 0x7f21900ad320 2021-11-15T19:27:11.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900ad320 msgr2=0x7f21901290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 --2- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900ad320 0x7f21901290c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f21880032f0 tx=0x7f21880091d0).stop 2021-11-15T19:27:11.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- 172.21.2.137:0/800320485 shutdown_connections 2021-11-15T19:27:11.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 --2- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900ad320 0x7f21901290c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 --2- 172.21.2.137:0/800320485 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900b72e0 0x7f21900b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- 172.21.2.137:0/800320485 >> 172.21.2.137:0/800320485 conn(0x7f2190064960 msgr2=0x7f2190064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- 172.21.2.137:0/800320485 shutdown_connections 2021-11-15T19:27:11.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.830+0000 7f21977e1700 1 -- 172.21.2.137:0/800320485 wait complete. 2021-11-15T19:27:11.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 Processor -- start 2021-11-15T19:27:11.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- start start 2021-11-15T19:27:11.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 0x7f21901258f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900ad320 0x7f2190126b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900b72e0 0x7f21900ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190128800 con 0x7f21900b72e0 2021-11-15T19:27:11.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190144760 con 0x7f21900acd60 2021-11-15T19:27:11.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190125de0 con 0x7f21900ad320 2021-11-15T19:27:11.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 0x7f21901258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 0x7f21901258f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60312/0 (socket says 172.21.2.137:60312) 2021-11-15T19:27:11.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 -- 172.21.2.137:0/369592542 learned_addr learned my addr 172.21.2.137:0/369592542 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 -- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900ad320 msgr2=0x7f2190126b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900ad320 0x7f2190126b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 -- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900b72e0 msgr2=0x7f21900ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900b72e0 0x7f21900ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 -- 172.21.2.137:0/369592542 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188009470 con 0x7f21900acd60 2021-11-15T19:27:11.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f219557d700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 0x7f21901258f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f218400c000 tx=0x7f2184006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2184010780 con 0x7f21900acd60 2021-11-15T19:27:11.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21840108e0 con 0x7f21900acd60 2021-11-15T19:27:11.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2190140640 con 0x7f21900acd60 2021-11-15T19:27:11.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2184010c40 con 0x7f21900acd60 2021-11-15T19:27:11.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219013fee0 con 0x7f21900acd60 2021-11-15T19:27:11.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2190127380 con 0x7f21900acd60 2021-11-15T19:27:11.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f218401c460 con 0x7f21900acd60 2021-11-15T19:27:11.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21827fc700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2170053610 0x7f2170055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f218406bde0 con 0x7f21900acd60 2021-11-15T19:27:11.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.834+0000 7f2194d7c700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2170053610 0x7f2170055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.838+0000 7f2194d7c700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2170053610 0x7f2170055ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2190065450 tx=0x7f218c007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.838+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2190127380 con 0x7f21900acd60 2021-11-15T19:27:11.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2190127380 con 0x7f21900acd60 2021-11-15T19:27:11.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21827fc700 1 -- 172.21.2.137:0/369592542 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2190127380 con 0x7f21900acd60 2021-11-15T19:27:11.932 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:11.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2170053610 msgr2=0x7f2170055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2170053610 0x7f2170055ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2190065450 tx=0x7f218c007800).stop 2021-11-15T19:27:11.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 msgr2=0x7f21901258f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 0x7f21901258f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f218400c000 tx=0x7f2184006df0).stop 2021-11-15T19:27:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 shutdown_connections 2021-11-15T19:27:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2170053610 0x7f2170055ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21900b72e0 0x7f21900ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21900ad320 0x7f2190126b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 --2- 172.21.2.137:0/369592542 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21900acd60 0x7f21901258f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 >> 172.21.2.137:0/369592542 conn(0x7f2190064960 msgr2=0x7f2190129030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 shutdown_connections 2021-11-15T19:27:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.922+0000 7f21977e1700 1 -- 172.21.2.137:0/369592542 wait complete. 2021-11-15T19:27:11.939 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:11.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 Processor -- start 2021-11-15T19:27:11.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- start start 2021-11-15T19:27:11.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fac2c0b0fe0 0x7fac2c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac2c0acff0 0x7fac2c0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 0x7fac2c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:11.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0ad4a0 con 0x7fac2c0b0fe0 2021-11-15T19:27:11.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0ae070 con 0x7fac2c0acff0 2021-11-15T19:27:11.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0aedf0 con 0x7fac2c13f5c0 2021-11-15T19:27:11.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac2c0acff0 0x7fac2c0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:11.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac2c0acff0 0x7fac2c0af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60320/0 (socket says 172.21.2.137:60320) 2021-11-15T19:27:11.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 -- 172.21.2.137:0/1049516317 learned_addr learned my addr 172.21.2.137:0/1049516317 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:11.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 -- 172.21.2.137:0/1049516317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 msgr2=0x7fac2c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 --2- 172.21.2.137:0/1049516317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 0x7fac2c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 -- 172.21.2.137:0/1049516317 >> v2:172.21.2.111:3300/0 conn(0x7fac2c0b0fe0 msgr2=0x7fac2c0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:11.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 --2- 172.21.2.137:0/1049516317 >> v2:172.21.2.111:3300/0 conn(0x7fac2c0b0fe0 0x7fac2c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 -- 172.21.2.137:0/1049516317 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0b13c0 con 0x7fac2c0acff0 2021-11-15T19:27:11.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2affd700 1 --2- 172.21.2.137:0/1049516317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c0af4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fac14002f70 tx=0x7fac14006eb0).ready entity=mon.1 client_cookie=ccda78b702f1f9c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:11.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2a7fc700 1 -- 172.21.2.137:0/1049516317 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1400d570 con 0x7fac2c0acff0 2021-11-15T19:27:11.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2a7fc700 1 -- 172.21.2.137:0/1049516317 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14000e90 con 0x7fac2c0acff0 2021-11-15T19:27:11.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac2a7fc700 1 -- 172.21.2.137:0/1049516317 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1400d900 con 0x7fac2c0acff0 2021-11-15T19:27:11.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- 172.21.2.137:0/1049516317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 msgr2=0x7fac2c0af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:11.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- 172.21.2.137:0/1049516317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c0af4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fac14002f70 tx=0x7fac14006eb0).stop 2021-11-15T19:27:11.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- 172.21.2.137:0/1049516317 shutdown_connections 2021-11-15T19:27:11.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- 172.21.2.137:0/1049516317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 0x7fac2c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- 172.21.2.137:0/1049516317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c0af4c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:11.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 --2- 172.21.2.137:0/1049516317 >> v2:172.21.2.111:3300/0 conn(0x7fac2c0b0fe0 0x7fac2c0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:11.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- 172.21.2.137:0/1049516317 >> 172.21.2.137:0/1049516317 conn(0x7fac2c0b5f50 msgr2=0x7fac2c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:11.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- 172.21.2.137:0/1049516317 shutdown_connections 2021-11-15T19:27:11.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- 172.21.2.137:0/1049516317 wait complete. 2021-11-15T19:27:12.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 Processor -- start 2021-11-15T19:27:12.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.982+0000 7fac3218f700 1 -- start start 2021-11-15T19:27:12.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac2c0b0fe0 0x7fac2c132d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 0x7fac2c1331f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1397b0 con 0x7fac2c0b0fe0 2021-11-15T19:27:12.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0638d0 con 0x7fac2c0acff0 2021-11-15T19:27:12.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c063b70 con 0x7fac2c13f5c0 2021-11-15T19:27:12.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60322/0 (socket says 172.21.2.137:60322) 2021-11-15T19:27:12.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 -- 172.21.2.137:0/2791033840 learned_addr learned my addr 172.21.2.137:0/2791033840 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 -- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 msgr2=0x7fac2c1331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 0x7fac2c1331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 -- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac2c0b0fe0 msgr2=0x7fac2c132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac2c0b0fe0 0x7fac2c132d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 -- 172.21.2.137:0/2791033840 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1400b1e0 con 0x7fac2c0acff0 2021-11-15T19:27:12.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2b7fe700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c141db0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fac1c002f70 tx=0x7fac1c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1c013460 con 0x7fac2c0acff0 2021-11-15T19:27:12.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c0135c0 con 0x7fac2c0acff0 2021-11-15T19:27:12.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c139400 con 0x7fac2c0acff0 2021-11-15T19:27:12.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c0653d0 con 0x7fac2c0acff0 2021-11-15T19:27:12.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1c013920 con 0x7fac2c0acff0 2021-11-15T19:27:12.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c063d30 con 0x7fac2c0acff0 2021-11-15T19:27:12.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac1c01a060 con 0x7fac2c0acff0 2021-11-15T19:27:12.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac28ff9700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac100536f0 0x7fac10055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fac1c06b530 con 0x7fac2c0acff0 2021-11-15T19:27:12.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.986+0000 7fac2affd700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac100536f0 0x7fac10055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.990+0000 7fac2affd700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac100536f0 0x7fac10055bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fac14002f70 tx=0x7fac14015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:11.990+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac1c042580 con 0x7fac2c0acff0 2021-11-15T19:27:12.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.070+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac2c0ad690 con 0x7fac2c0acff0 2021-11-15T19:27:12.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.070+0000 7fac28ff9700 1 -- 172.21.2.137:0/2791033840 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fac1c018030 con 0x7fac2c0acff0 2021-11-15T19:27:12.081 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:12.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.070+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac100536f0 msgr2=0x7fac10055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.070+0000 7fac3218f700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac100536f0 0x7fac10055bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fac14002f70 tx=0x7fac14015000).stop 2021-11-15T19:27:12.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.070+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 msgr2=0x7fac2c141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.070+0000 7fac3218f700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c141db0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fac1c002f70 tx=0x7fac1c006ec0).stop 2021-11-15T19:27:12.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 shutdown_connections 2021-11-15T19:27:12.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac100536f0 0x7fac10055bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac2c13f5c0 0x7fac2c1331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac2c0b0fe0 0x7fac2c132d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 --2- 172.21.2.137:0/2791033840 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac2c0acff0 0x7fac2c141db0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 >> 172.21.2.137:0/2791033840 conn(0x7fac2c0b5f50 msgr2=0x7fac2c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 shutdown_connections 2021-11-15T19:27:12.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.074+0000 7fac3218f700 1 -- 172.21.2.137:0/2791033840 wait complete. 2021-11-15T19:27:12.088 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:12.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.126+0000 7f96ecbcd700 1 Processor -- start 2021-11-15T19:27:12.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.126+0000 7f96ecbcd700 1 -- start start 2021-11-15T19:27:12.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 0x7f96e81423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80633f0 con 0x7f96e80ac8c0 2021-11-15T19:27:12.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e8067af0 con 0x7f96e8063010 2021-11-15T19:27:12.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80af790 con 0x7f96e80b1270 2021-11-15T19:27:12.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e659c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f96e8063010 0x7f96e813e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50880/0 (socket says 172.21.2.137:50880) 2021-11-15T19:27:12.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e659c700 1 -- 172.21.2.137:0/2670171129 learned_addr learned my addr 172.21.2.137:0/2670171129 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:12.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095657641 0 0) 0x7f96e8067af0 con 0x7f96e8063010 2021-11-15T19:27:12.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96c8003260 con 0x7f96e8063010 2021-11-15T19:27:12.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 0x7f96e81423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098004777 0 0) 0x7f96c8003260 con 0x7f96e8063010 2021-11-15T19:27:12.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 msgr2=0x7f96e81423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 0x7f96e81423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 >> v1:172.21.2.111:6789/0 conn(0x7f96e80ac8c0 legacy=0x7f96e813e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80afa30 con 0x7f96e8063010 2021-11-15T19:27:12.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f96d0001660 con 0x7f96e8063010 2021-11-15T19:27:12.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 >> v1:172.21.2.137:6789/0 conn(0x7f96e8063010 legacy=0x7f96e813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 0x7f96c80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8003ee0 0x7f96c8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96c8004bf0 0x7f96c800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80af790 con 0x7f96c8003ee0 2021-11-15T19:27:12.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8005320 con 0x7f96c8004bf0 2021-11-15T19:27:12.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c800bc40 con 0x7f96e80b1270 2021-11-15T19:27:12.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96c8004bf0 0x7f96c800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e659c700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 0x7f96c80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 -- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 msgr2=0x7f96c80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e80b1270 0x7f96c80037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 -- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8003ee0 msgr2=0x7f96c8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8003ee0 0x7f96c8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 -- 172.21.2.137:0/2670171129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8003260 con 0x7f96c8004bf0 2021-11-15T19:27:12.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96c8004bf0 0x7f96c800b750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f96d8007000 tx=0x7f96d8008040).ready entity=mon.1 client_cookie=d554176232499549 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800c640 con 0x7f96c8004bf0 2021-11-15T19:27:12.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800c7a0 con 0x7f96c8004bf0 2021-11-15T19:27:12.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e559a700 1 -- 172.21.2.137:0/2670171129 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800cb00 con 0x7f96c8004bf0 2021-11-15T19:27:12.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- 172.21.2.137:0/2670171129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96c8004bf0 msgr2=0x7f96c800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/2670171129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96c8004bf0 0x7f96c800b750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f96d8007000 tx=0x7f96d8008040).stop 2021-11-15T19:27:12.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 -- 172.21.2.137:0/2670171129 reap_dead start 2021-11-15T19:27:12.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- 172.21.2.137:0/2670171129 shutdown_connections 2021-11-15T19:27:12.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- 172.21.2.137:0/2670171129 >> 172.21.2.137:0/2670171129 conn(0x7f96e805bd20 msgr2=0x7f96e805c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- 172.21.2.137:0/2670171129 shutdown_connections 2021-11-15T19:27:12.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- 172.21.2.137:0/2670171129 wait complete. 2021-11-15T19:27:12.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 Processor -- start 2021-11-15T19:27:12.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- start start 2021-11-15T19:27:12.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8004bf0 0x7f96e8063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e8067590 0x7f96e814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 0x7f96e8153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8065be0 con 0x7f96c8004bf0 2021-11-15T19:27:12.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8065e80 con 0x7f96e81503c0 2021-11-15T19:27:12.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96ecbcd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e814fa30 con 0x7f96e8067590 2021-11-15T19:27:12.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 0x7f96e8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 0x7f96e8153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60344/0 (socket says 172.21.2.137:60344) 2021-11-15T19:27:12.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.130+0000 7f96e6d9d700 1 -- 172.21.2.137:0/1953868249 learned_addr learned my addr 172.21.2.137:0/1953868249 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e6d9d700 1 -- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e8067590 msgr2=0x7f96e814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e8067590 0x7f96e814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e6d9d700 1 -- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8004bf0 msgr2=0x7f96e8063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8004bf0 0x7f96e8063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e6d9d700 1 -- 172.21.2.137:0/1953868249 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8063d70 con 0x7f96e81503c0 2021-11-15T19:27:12.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e6d9d700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 0x7f96e8153000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f96e81422b0 tx=0x7f96d8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800c640 con 0x7f96e81503c0 2021-11-15T19:27:12.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8020070 con 0x7f96e81503c0 2021-11-15T19:27:12.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800a4a0 con 0x7f96e81503c0 2021-11-15T19:27:12.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8150850 con 0x7f96e81503c0 2021-11-15T19:27:12.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e8144740 con 0x7f96e81503c0 2021-11-15T19:27:12.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e814fbf0 con 0x7f96e81503c0 2021-11-15T19:27:12.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96d802c070 con 0x7f96e81503c0 2021-11-15T19:27:12.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96df7fe700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96cc053660 0x7f96cc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f96d806d0f0 con 0x7f96e81503c0 2021-11-15T19:27:12.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e659c700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96cc053660 0x7f96cc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.134+0000 7f96e659c700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96cc053660 0x7f96cc055b20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f96d0008000 tx=0x7f96d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.138+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96d8044140 con 0x7f96e81503c0 2021-11-15T19:27:12.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e80573d0 con 0x7f96e81503c0 2021-11-15T19:27:12.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96df7fe700 1 -- 172.21.2.137:0/1953868249 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f96d8047760 con 0x7f96e81503c0 2021-11-15T19:27:12.229 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:12.229 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:12.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96cc053660 msgr2=0x7f96cc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96cc053660 0x7f96cc055b20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f96d0008000 tx=0x7f96d0009040).stop 2021-11-15T19:27:12.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 msgr2=0x7f96e8153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 0x7f96e8153000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f96e81422b0 tx=0x7f96d8008040).stop 2021-11-15T19:27:12.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 shutdown_connections 2021-11-15T19:27:12.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96cc053660 0x7f96cc055b20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96e81503c0 0x7f96e8153000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96e8067590 0x7f96e814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 --2- 172.21.2.137:0/1953868249 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96c8004bf0 0x7f96e8063880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.218+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 >> 172.21.2.137:0/1953868249 conn(0x7f96e805bd20 msgr2=0x7f96e8139600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.222+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 shutdown_connections 2021-11-15T19:27:12.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.222+0000 7f96ecbcd700 1 -- 172.21.2.137:0/1953868249 wait complete. 2021-11-15T19:27:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:12.237 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:12.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7ef0a700 1 Processor -- start 2021-11-15T19:27:12.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7ef0a700 1 -- start start 2021-11-15T19:27:12.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7ef0a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6e7805c770 0x7f6e780aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7ef0a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7805cb50 con 0x7f6e780b0550 2021-11-15T19:27:12.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7ef0a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780ad030 con 0x7f6e78140aa0 2021-11-15T19:27:12.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7ef0a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780b1650 con 0x7f6e7805c770 2021-11-15T19:27:12.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7d4a7700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6e78140aa0 0x7f6e78140ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50898/0 (socket says 172.21.2.137:50898) 2021-11-15T19:27:12.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e7d4a7700 1 -- 172.21.2.137:0/4238124451 learned_addr learned my addr 172.21.2.137:0/4238124451 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:12.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769544438 0 0) 0x7f6e780ad030 con 0x7f6e78140aa0 2021-11-15T19:27:12.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e58003260 con 0x7f6e78140aa0 2021-11-15T19:27:12.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2498064867 0 0) 0x7f6e58003260 con 0x7f6e78140aa0 2021-11-15T19:27:12.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 >> v2:172.21.2.111:3300/0 conn(0x7f6e7805c770 msgr2=0x7f6e780aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 --2- 172.21.2.137:0/4238124451 >> v2:172.21.2.111:3300/0 conn(0x7f6e7805c770 0x7f6e780aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 >> v1:172.21.2.111:6789/0 conn(0x7f6e780b0550 legacy=0x7f6e7814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780ad2d0 con 0x7f6e78140aa0 2021-11-15T19:27:12.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6e700019e0 con 0x7f6e78140aa0 2021-11-15T19:27:12.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 >> v1:172.21.2.137:6789/0 conn(0x7f6e78140aa0 legacy=0x7f6e78140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e58003820 0x7f6e58003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e58004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e58005050 0x7f6e5800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780b1650 con 0x7f6e58003820 2021-11-15T19:27:12.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5800bf40 con 0x7f6e58004500 2021-11-15T19:27:12.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5800c100 con 0x7f6e58005050 2021-11-15T19:27:12.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.278+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e58004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 -- 172.21.2.137:0/4238124451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e58005050 msgr2=0x7f6e5800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e58005050 0x7f6e5800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 -- 172.21.2.137:0/4238124451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e58003820 msgr2=0x7f6e58003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e58003820 0x7f6e58003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7d4a7700 1 -- 172.21.2.137:0/4238124451 reap_dead start 2021-11-15T19:27:12.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 -- 172.21.2.137:0/4238124451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58003260 con 0x7f6e58004500 2021-11-15T19:27:12.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e58004980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f6e68000f70 tx=0x7f6e680079e0).ready entity=mon.1 client_cookie=3ffc9a5ac201f43d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e68007cf0 con 0x7f6e58004500 2021-11-15T19:27:12.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e68014410 con 0x7f6e58004500 2021-11-15T19:27:12.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e777fe700 1 -- 172.21.2.137:0/4238124451 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e68014770 con 0x7f6e58004500 2021-11-15T19:27:12.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4238124451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 msgr2=0x7f6e58004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e58004980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f6e68000f70 tx=0x7f6e680079e0).stop 2021-11-15T19:27:12.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4238124451 shutdown_connections 2021-11-15T19:27:12.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4238124451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e58004980 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4238124451 >> 172.21.2.137:0/4238124451 conn(0x7f6e780631e0 msgr2=0x7f6e7805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4238124451 shutdown_connections 2021-11-15T19:27:12.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4238124451 wait complete. 2021-11-15T19:27:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 Processor -- start 2021-11-15T19:27:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- start start 2021-11-15T19:27:12.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e78145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e78143120 0x7f6e78144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e78156710 0x7f6e78156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780638e0 con 0x7f6e78143120 2021-11-15T19:27:12.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78063b80 con 0x7f6e58004500 2021-11-15T19:27:12.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78063e20 con 0x7f6e78156710 2021-11-15T19:27:12.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e78145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e78145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60360/0 (socket says 172.21.2.137:60360) 2021-11-15T19:27:12.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 -- 172.21.2.137:0/4271011620 learned_addr learned my addr 172.21.2.137:0/4271011620 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7d4a7700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e78156710 0x7f6e78156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 -- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e78156710 msgr2=0x7f6e78156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e78156710 0x7f6e78156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e78143120 0x7f6e78144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 -- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e78143120 msgr2=0x7f6e78144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e78143120 0x7f6e78144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 -- 172.21.2.137:0/4271011620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e781416f0 con 0x7f6e58004500 2021-11-15T19:27:12.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7cca6700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e78145f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f6e60002f70 tx=0x7f6e60006de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e60009e80 con 0x7f6e58004500 2021-11-15T19:27:12.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e60013460 con 0x7f6e58004500 2021-11-15T19:27:12.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e600137c0 con 0x7f6e58004500 2021-11-15T19:27:12.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78157080 con 0x7f6e58004500 2021-11-15T19:27:12.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e78159a70 con 0x7f6e58004500 2021-11-15T19:27:12.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.282+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e78063740 con 0x7f6e58004500 2021-11-15T19:27:12.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.286+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e6001a060 con 0x7f6e58004500 2021-11-15T19:27:12.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.286+0000 7f6e75ffb700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e5c053690 0x7f6e5c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.286+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6e6006b370 con 0x7f6e58004500 2021-11-15T19:27:12.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.286+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e5c053690 0x7f6e5c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.286+0000 7f6e77fff700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e5c053690 0x7f6e5c055b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6e68017000 tx=0x7f6e68015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.286+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e78063740 con 0x7f6e58004500 2021-11-15T19:27:12.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6e78063740 con 0x7f6e58004500 2021-11-15T19:27:12.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e75ffb700 1 -- 172.21.2.137:0/4271011620 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6e78063740 con 0x7f6e58004500 2021-11-15T19:27:12.379 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:12.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e5c053690 msgr2=0x7f6e5c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e5c053690 0x7f6e5c055b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6e68017000 tx=0x7f6e68015000).stop 2021-11-15T19:27:12.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 msgr2=0x7f6e78145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e78145f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f6e60002f70 tx=0x7f6e60006de0).stop 2021-11-15T19:27:12.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 shutdown_connections 2021-11-15T19:27:12.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e5c053690 0x7f6e5c055b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e78156710 0x7f6e78156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e78143120 0x7f6e78144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 --2- 172.21.2.137:0/4271011620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e58004500 0x7f6e78145f00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 >> 172.21.2.137:0/4271011620 conn(0x7f6e780631e0 msgr2=0x7f6e7813f600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 shutdown_connections 2021-11-15T19:27:12.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.370+0000 7f6e7ef0a700 1 -- 172.21.2.137:0/4271011620 wait complete. 2021-11-15T19:27:12.386 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:12.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 Processor -- start 2021-11-15T19:27:12.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- start start 2021-11-15T19:27:12.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0d00b72e0 0x7fd0d00b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d00b76c0 con 0x7fd0d00acd60 2021-11-15T19:27:12.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d012a170 con 0x7fd0d00ad320 2021-11-15T19:27:12.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00b3100 con 0x7fd0d00b72e0 2021-11-15T19:27:12.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0d00b72e0 0x7fd0d00b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0d00b72e0 0x7fd0d00b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60368/0 (socket says 172.21.2.137:60368) 2021-11-15T19:27:12.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 -- 172.21.2.137:0/3676955231 learned_addr learned my addr 172.21.2.137:0/3676955231 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 -- 172.21.2.137:0/3676955231 >> v1:172.21.2.137:6789/0 conn(0x7fd0d00ad320 legacy=0x7fd0d01290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 -- 172.21.2.137:0/3676955231 >> v1:172.21.2.111:6789/0 conn(0x7fd0d00acd60 legacy=0x7fd0d00b4190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:12.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 -- 172.21.2.137:0/3676955231 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00ad8a0 con 0x7fd0d00b72e0 2021-11-15T19:27:12.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d4890700 1 --2- 172.21.2.137:0/3676955231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00b72e0 0x7fd0d00b19b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fd0d0065c40 tx=0x7fd0c0006eb0).ready entity=mon.1 client_cookie=c7c1bb4b60dae211 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0cf7fe700 1 -- 172.21.2.137:0/3676955231 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0c000d610 con 0x7fd0d00b72e0 2021-11-15T19:27:12.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0cf7fe700 1 -- 172.21.2.137:0/3676955231 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0000e90 con 0x7fd0d00b72e0 2021-11-15T19:27:12.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0cf7fe700 1 -- 172.21.2.137:0/3676955231 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0c000d960 con 0x7fd0d00b72e0 2021-11-15T19:27:12.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3676955231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00b72e0 msgr2=0x7fd0d00b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3676955231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00b72e0 0x7fd0d00b19b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fd0d0065c40 tx=0x7fd0c0006eb0).stop 2021-11-15T19:27:12.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3676955231 shutdown_connections 2021-11-15T19:27:12.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3676955231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00b72e0 0x7fd0d00b19b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3676955231 >> 172.21.2.137:0/3676955231 conn(0x7fd0d0064960 msgr2=0x7fd0d0064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3676955231 shutdown_connections 2021-11-15T19:27:12.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3676955231 wait complete. 2021-11-15T19:27:12.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 Processor -- start 2021-11-15T19:27:12.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.430+0000 7fd0d6af4700 1 -- start start 2021-11-15T19:27:12.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0d00acd60 0x7fd0d00b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 0x7fd0d012cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0d00b72e0 0x7fd0d012d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d012c100 con 0x7fd0d00acd60 2021-11-15T19:27:12.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d014fac0 con 0x7fd0d00ad320 2021-11-15T19:27:12.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0150840 con 0x7fd0d00b72e0 2021-11-15T19:27:12.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 0x7fd0d012cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 0x7fd0d012cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60378/0 (socket says 172.21.2.137:60378) 2021-11-15T19:27:12.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 -- 172.21.2.137:0/3612900713 learned_addr learned my addr 172.21.2.137:0/3612900713 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 -- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0d00b72e0 msgr2=0x7fd0d012d4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:12.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0d00b72e0 0x7fd0d012d4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 -- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0d00acd60 msgr2=0x7fd0d00b0420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:12.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0d00acd60 0x7fd0d00b0420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 -- 172.21.2.137:0/3612900713 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c000b1e0 con 0x7fd0d00ad320 2021-11-15T19:27:12.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cffff700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 0x7fd0d012cff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fd0b8002fb0 tx=0x7fd0b8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b8009e00 con 0x7fd0d00ad320 2021-11-15T19:27:12.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8013460 con 0x7fd0d00ad320 2021-11-15T19:27:12.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b80137c0 con 0x7fd0d00ad320 2021-11-15T19:27:12.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d0150ae0 con 0x7fd0d00ad320 2021-11-15T19:27:12.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d012d9d0 con 0x7fd0d00ad320 2021-11-15T19:27:12.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d00b3cf0 con 0x7fd0d00ad320 2021-11-15T19:27:12.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0b800f070 con 0x7fd0d00ad320 2021-11-15T19:27:12.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0b40536a0 0x7fd0b4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd0b806b030 con 0x7fd0d00ad320 2021-11-15T19:27:12.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d4890700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0b40536a0 0x7fd0b4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0d4890700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0b40536a0 0x7fd0b4055b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd0d0065c40 tx=0x7fd0c0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.434+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0b8042190 con 0x7fd0d00ad320 2021-11-15T19:27:12.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.518+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0d012dc20 con 0x7fd0d00ad320 2021-11-15T19:27:12.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.518+0000 7fd0cdffb700 1 -- 172.21.2.137:0/3612900713 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd0b8018030 con 0x7fd0d00ad320 2021-11-15T19:27:12.529 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:12.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0b40536a0 msgr2=0x7fd0b4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0b40536a0 0x7fd0b4055b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd0d0065c40 tx=0x7fd0c0015000).stop 2021-11-15T19:27:12.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 msgr2=0x7fd0d012cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 0x7fd0d012cff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fd0b8002fb0 tx=0x7fd0b8006df0).stop 2021-11-15T19:27:12.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 shutdown_connections 2021-11-15T19:27:12.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0b40536a0 0x7fd0b4055b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0d00b72e0 0x7fd0d012d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0d00ad320 0x7fd0d012cff0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 --2- 172.21.2.137:0/3612900713 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0d00acd60 0x7fd0d00b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 >> 172.21.2.137:0/3612900713 conn(0x7fd0d0064960 msgr2=0x7fd0d00b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 shutdown_connections 2021-11-15T19:27:12.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.522+0000 7fd0d6af4700 1 -- 172.21.2.137:0/3612900713 wait complete. 2021-11-15T19:27:12.536 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:12.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04eb6b0700 1 Processor -- start 2021-11-15T19:27:12.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04eb6b0700 1 -- start start 2021-11-15T19:27:12.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04eb6b0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e405c770 0x7f04e40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04eb6b0700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e405cb50 con 0x7f04e40b04c0 2021-11-15T19:27:12.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04eb6b0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e40afd30 con 0x7f04e40af090 2021-11-15T19:27:12.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04eb6b0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40ae700 con 0x7f04e405c770 2021-11-15T19:27:12.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e9c4d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f04e40af090 0x7f04e4141ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50934/0 (socket says 172.21.2.137:50934) 2021-11-15T19:27:12.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e9c4d700 1 -- 172.21.2.137:0/3440493506 learned_addr learned my addr 172.21.2.137:0/3440493506 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:12.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123170824 0 0) 0x7f04e40afd30 con 0x7f04e40af090 2021-11-15T19:27:12.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc003260 con 0x7f04e40af090 2021-11-15T19:27:12.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e944c700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e405c770 0x7f04e40aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 649079275 0 0) 0x7f04cc003260 con 0x7f04e40af090 2021-11-15T19:27:12.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e405c770 msgr2=0x7f04e40aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e405c770 0x7f04e40aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 >> v1:172.21.2.111:6789/0 conn(0x7f04e40b04c0 legacy=0x7f04e40b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40ac910 con 0x7f04e40af090 2021-11-15T19:27:12.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f04dc0019e0 con 0x7f04e40af090 2021-11-15T19:27:12.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 >> v1:172.21.2.137:6789/0 conn(0x7f04e40af090 legacy=0x7f04e4141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04cc0037d0 0x7f04cc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04cc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04cc005070 0x7f04cc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40ae700 con 0x7f04cc005070 2021-11-15T19:27:12.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc00be80 con 0x7f04cc004500 2021-11-15T19:27:12.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc00c040 con 0x7f04cc0037d0 2021-11-15T19:27:12.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e944c700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e405c770 0x7f04e40aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:12.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04cc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 -- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04cc0037d0 msgr2=0x7f04cc003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04cc0037d0 0x7f04cc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 -- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04cc005070 msgr2=0x7f04cc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04cc005070 0x7f04cc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 -- 172.21.2.137:0/3440493506 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc003260 con 0x7f04cc004500 2021-11-15T19:27:12.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.578+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04cc004980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f04d8001fa0 tx=0x7f04d8007a00).ready entity=mon.1 client_cookie=9bd75bd2403fadbf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d8007070 con 0x7f04cc004500 2021-11-15T19:27:12.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80071d0 con 0x7f04cc004500 2021-11-15T19:27:12.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d7fff700 1 -- 172.21.2.137:0/3440493506 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d8006510 con 0x7f04cc004500 2021-11-15T19:27:12.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/3440493506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 msgr2=0x7f04cc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/3440493506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04cc004980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f04d8001fa0 tx=0x7f04d8007a00).stop 2021-11-15T19:27:12.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e9c4d700 1 -- 172.21.2.137:0/3440493506 reap_dead start 2021-11-15T19:27:12.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/3440493506 shutdown_connections 2021-11-15T19:27:12.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/3440493506 >> 172.21.2.137:0/3440493506 conn(0x7f04e40631e0 msgr2=0x7f04e405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/3440493506 shutdown_connections 2021-11-15T19:27:12.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/3440493506 wait complete. 2021-11-15T19:27:12.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 Processor -- start 2021-11-15T19:27:12.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- start start 2021-11-15T19:27:12.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04e4141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e413dde0 0x7f04e4149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04e4141660 0x7f04e413a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e413f910 con 0x7f04e4141660 2021-11-15T19:27:12.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4140670 con 0x7f04cc004500 2021-11-15T19:27:12.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4140910 con 0x7f04e413dde0 2021-11-15T19:27:12.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04e4141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04e4141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60398/0 (socket says 172.21.2.137:60398) 2021-11-15T19:27:12.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 -- 172.21.2.137:0/2995867465 learned_addr learned my addr 172.21.2.137:0/2995867465 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e413dde0 0x7f04e4149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e9c4d700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04e4141660 0x7f04e413a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 -- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e413dde0 msgr2=0x7f04e4149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e413dde0 0x7f04e4149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 -- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04e4141660 msgr2=0x7f04e413a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04e4141660 0x7f04e413a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 -- 172.21.2.137:0/2995867465 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e4140bb0 con 0x7f04cc004500 2021-11-15T19:27:12.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04e944c700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04e4141050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f04e0007000 tx=0x7f04e0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e000f4e0 con 0x7f04cc004500 2021-11-15T19:27:12.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0000e90 con 0x7f04cc004500 2021-11-15T19:27:12.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e4152f40 con 0x7f04cc004500 2021-11-15T19:27:12.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e000f830 con 0x7f04cc004500 2021-11-15T19:27:12.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e413a9c0 con 0x7f04cc004500 2021-11-15T19:27:12.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e4140d40 con 0x7f04cc004500 2021-11-15T19:27:12.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04e000f990 con 0x7f04cc004500 2021-11-15T19:27:12.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d67fc700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f04c40536d0 0x7f04c4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.582+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f04e006b410 con 0x7f04cc004500 2021-11-15T19:27:12.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.586+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f04c40536d0 0x7f04c4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.586+0000 7f04e8c4b700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f04c40536d0 0x7f04c4055b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f04d8019000 tx=0x7f04d8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.586+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04e0042570 con 0x7f04cc004500 2021-11-15T19:27:12.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04e40b1c10 con 0x7f04cc004500 2021-11-15T19:27:12.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04d67fc700 1 -- 172.21.2.137:0/2995867465 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7f04e0045b90 con 0x7f04cc004500 2021-11-15T19:27:12.679 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:12.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f04c40536d0 msgr2=0x7f04c4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f04c40536d0 0x7f04c4055b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f04d8019000 tx=0x7f04d8015000).stop 2021-11-15T19:27:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 msgr2=0x7f04e4141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04e4141050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f04e0007000 tx=0x7f04e0008040).stop 2021-11-15T19:27:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 shutdown_connections 2021-11-15T19:27:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f04c40536d0 0x7f04c4055b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f04e4141660 0x7f04e413a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f04e413dde0 0x7f04e4149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 --2- 172.21.2.137:0/2995867465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f04cc004500 0x7f04e4141050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 >> 172.21.2.137:0/2995867465 conn(0x7f04e40631e0 msgr2=0x7f04e413adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 shutdown_connections 2021-11-15T19:27:12.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.670+0000 7f04eb6b0700 1 -- 172.21.2.137:0/2995867465 wait complete. 2021-11-15T19:27:12.687 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:12.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 Processor -- start 2021-11-15T19:27:12.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- start start 2021-11-15T19:27:12.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdc3c0b72e0 0x7fdc3c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdc3c0ad320 0x7fdc3c1290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c0b76c0 con 0x7fdc3c0acd60 2021-11-15T19:27:12.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3c0b3100 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3c12a170 con 0x7fdc3c0ad320 2021-11-15T19:27:12.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdc3c0ad320 0x7fdc3c1290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdc3c0ad320 0x7fdc3c1290c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60404/0 (socket says 172.21.2.137:60404) 2021-11-15T19:27:12.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 -- 172.21.2.137:0/2379194986 learned_addr learned my addr 172.21.2.137:0/2379194986 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 -- 172.21.2.137:0/2379194986 >> v2:172.21.2.111:3300/0 conn(0x7fdc3c0b72e0 msgr2=0x7fdc3c0b19b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:12.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 --2- 172.21.2.137:0/2379194986 >> v2:172.21.2.111:3300/0 conn(0x7fdc3c0b72e0 0x7fdc3c0b19b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 -- 172.21.2.137:0/2379194986 >> v1:172.21.2.137:6789/0 conn(0x7fdc3c0acd60 legacy=0x7fdc3c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 -- 172.21.2.137:0/2379194986 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0ad8a0 con 0x7fdc3c0ad320 2021-11-15T19:27:12.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc4094e700 1 --2- 172.21.2.137:0/2379194986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0ad320 0x7fdc3c1290c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fdc340032f0 tx=0x7fdc34009290).ready entity=mon.1 client_cookie=3fe62c47c13269a8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc3affd700 1 -- 172.21.2.137:0/2379194986 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3400b870 con 0x7fdc3c0ad320 2021-11-15T19:27:12.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc3affd700 1 -- 172.21.2.137:0/2379194986 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3400b9d0 con 0x7fdc3c0ad320 2021-11-15T19:27:12.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc3affd700 1 -- 172.21.2.137:0/2379194986 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3400bb80 con 0x7fdc3c0ad320 2021-11-15T19:27:12.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- 172.21.2.137:0/2379194986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0ad320 msgr2=0x7fdc3c1290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 --2- 172.21.2.137:0/2379194986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0ad320 0x7fdc3c1290c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fdc340032f0 tx=0x7fdc34009290).stop 2021-11-15T19:27:12.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- 172.21.2.137:0/2379194986 shutdown_connections 2021-11-15T19:27:12.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 --2- 172.21.2.137:0/2379194986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0ad320 0x7fdc3c1290c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 --2- 172.21.2.137:0/2379194986 >> v2:172.21.2.111:3300/0 conn(0x7fdc3c0b72e0 0x7fdc3c0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- 172.21.2.137:0/2379194986 >> 172.21.2.137:0/2379194986 conn(0x7fdc3c064960 msgr2=0x7fdc3c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- 172.21.2.137:0/2379194986 shutdown_connections 2021-11-15T19:27:12.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- 172.21.2.137:0/2379194986 wait complete. 2021-11-15T19:27:12.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 Processor -- start 2021-11-15T19:27:12.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.730+0000 7fdc423b1700 1 -- start start 2021-11-15T19:27:12.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3c0acd60 0x7fdc3c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc3c0ad320 0x7fdc3c066f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 0x7fdc3c13faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c141dd0 con 0x7fdc3c0ad320 2021-11-15T19:27:12.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c142770 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c142030 con 0x7fdc3c0acd60 2021-11-15T19:27:12.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 0x7fdc3c13faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 0x7fdc3c13faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60412/0 (socket says 172.21.2.137:60412) 2021-11-15T19:27:12.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 -- 172.21.2.137:0/966640214 learned_addr learned my addr 172.21.2.137:0/966640214 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 -- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3c0acd60 msgr2=0x7fdc3c0b0c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:12.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3c0acd60 0x7fdc3c0b0c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 -- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc3c0ad320 msgr2=0x7fdc3c066f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:12.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc3c0ad320 0x7fdc3c066f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 -- 172.21.2.137:0/966640214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc34009530 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc4094e700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 0x7fdc3c13faf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fdc340032f0 tx=0x7fdc34016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3400b870 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc340107a0 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc34010b00 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c1422d0 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3c0afdb0 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3c142490 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc34029070 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc397fa700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc1c053610 0x7fdc1c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdc3406ca70 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.734+0000 7fdc3bfff700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc1c053610 0x7fdc1c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.738+0000 7fdc3bfff700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc1c053610 0x7fdc1c055ad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fdc2c002ef0 tx=0x7fdc2c006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.738+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc34043bd0 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc3c0573d0 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc397fa700 1 -- 172.21.2.137:0/966640214 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdc3406ce60 con 0x7fdc3c0b72e0 2021-11-15T19:27:12.831 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:12.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc1c053610 msgr2=0x7fdc1c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc1c053610 0x7fdc1c055ad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fdc2c002ef0 tx=0x7fdc2c006890).stop 2021-11-15T19:27:12.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 msgr2=0x7fdc3c13faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 0x7fdc3c13faf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fdc340032f0 tx=0x7fdc34016000).stop 2021-11-15T19:27:12.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 shutdown_connections 2021-11-15T19:27:12.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc1c053610 0x7fdc1c055ad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3c0b72e0 0x7fdc3c13faf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc3c0ad320 0x7fdc3c066f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 --2- 172.21.2.137:0/966640214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3c0acd60 0x7fdc3c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 >> 172.21.2.137:0/966640214 conn(0x7fdc3c064960 msgr2=0x7fdc3c121f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 shutdown_connections 2021-11-15T19:27:12.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.822+0000 7fdc423b1700 1 -- 172.21.2.137:0/966640214 wait complete. 2021-11-15T19:27:12.838 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:12.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f523a265700 1 Processor -- start 2021-11-15T19:27:12.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f523a265700 1 -- start start 2021-11-15T19:27:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f523a265700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234144610 0x7f5234147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f523a265700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5234148190 con 0x7f52340a9f50 2021-11-15T19:27:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f523a265700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52340b1720 con 0x7f52340b1340 2021-11-15T19:27:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f523a265700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5234147e70 con 0x7f5234144610 2021-11-15T19:27:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5233fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f52340b1340 0x7f5234143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:50966/0 (socket says 172.21.2.137:50966) 2021-11-15T19:27:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5233fff700 1 -- 172.21.2.137:0/1693215508 learned_addr learned my addr 172.21.2.137:0/1693215508 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243875751 0 0) 0x7f52340b1720 con 0x7f52340b1340 2021-11-15T19:27:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5220003260 con 0x7f52340b1340 2021-11-15T19:27:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102706933 0 0) 0x7f5220003260 con 0x7f52340b1340 2021-11-15T19:27:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234144610 msgr2=0x7f5234147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234144610 0x7f5234147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 >> v1:172.21.2.111:6789/0 conn(0x7f52340a9f50 legacy=0x7f52340aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340af800 con 0x7f52340b1340 2021-11-15T19:27:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f5228001660 con 0x7f52340b1340 2021-11-15T19:27:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 >> v1:172.21.2.137:6789/0 conn(0x7f52340b1340 legacy=0x7f5234143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234144610 0x7f52200037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5220003ec0 0x7f5220004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220004b40 0x7f5220004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5234147e70 con 0x7f5220004b40 2021-11-15T19:27:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522000ba00 con 0x7f5220003ec0 2021-11-15T19:27:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522000bbc0 con 0x7f5234144610 2021-11-15T19:27:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.878+0000 7f52337fe700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5220003ec0 0x7f5220004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234144610 msgr2=0x7f52200037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234144610 0x7f52200037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220004b40 msgr2=0x7f5220004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220004b40 0x7f5220004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/1693215508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220003260 con 0x7f5220003ec0 2021-11-15T19:27:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5220003ec0 0x7f5220004500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f5224002f70 tx=0x7f5224006ca0).ready entity=mon.1 client_cookie=48a1b61cbef08ad6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5224012410 con 0x7f5220003ec0 2021-11-15T19:27:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224012570 con 0x7f5220003ec0 2021-11-15T19:27:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5232ffd700 1 -- 172.21.2.137:0/1693215508 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52240128d0 con 0x7f5220003ec0 2021-11-15T19:27:12.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/1693215508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5220003ec0 msgr2=0x7f5220004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 --2- 172.21.2.137:0/1693215508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5220003ec0 0x7f5220004500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f5224002f70 tx=0x7f5224006ca0).stop 2021-11-15T19:27:12.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5238802700 1 -- 172.21.2.137:0/1693215508 reap_dead start 2021-11-15T19:27:12.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/1693215508 shutdown_connections 2021-11-15T19:27:12.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/1693215508 >> 172.21.2.137:0/1693215508 conn(0x7f52340b4e60 msgr2=0x7f52340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/1693215508 shutdown_connections 2021-11-15T19:27:12.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/1693215508 wait complete. 2021-11-15T19:27:12.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 Processor -- start 2021-11-15T19:27:12.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- start start 2021-11-15T19:27:12.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220003ec0 0x7f5234147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 0x7f5234157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234159fa0 0x7f5234145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5234146ae0 con 0x7f5220003ec0 2021-11-15T19:27:12.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523413fdb0 con 0x7f523409a520 2021-11-15T19:27:12.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523415a980 con 0x7f5234159fa0 2021-11-15T19:27:12.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 0x7f5234157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 0x7f5234157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60430/0 (socket says 172.21.2.137:60430) 2021-11-15T19:27:12.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/4105803290 learned_addr learned my addr 172.21.2.137:0/4105803290 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:12.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5233fff700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220003ec0 0x7f5234147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5238802700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234159fa0 0x7f5234145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234159fa0 msgr2=0x7f5234145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234159fa0 0x7f5234145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220003ec0 msgr2=0x7f5234147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220003ec0 0x7f5234147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 -- 172.21.2.137:0/4105803290 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523413ffe0 con 0x7f523409a520 2021-11-15T19:27:12.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f5233fff700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220003ec0 0x7f5234147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:12.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52337fe700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 0x7f5234157190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f5224002f70 tx=0x7f5224015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5224012410 con 0x7f523409a520 2021-11-15T19:27:12.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224000e90 con 0x7f523409a520 2021-11-15T19:27:12.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522401e640 con 0x7f523409a520 2021-11-15T19:27:12.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5234144e40 con 0x7f523409a520 2021-11-15T19:27:12.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.882+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5234147c10 con 0x7f523409a520 2021-11-15T19:27:12.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5234140170 con 0x7f523409a520 2021-11-15T19:27:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5224024020 con 0x7f523409a520 2021-11-15T19:27:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f52317fa700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52140536d0 0x7f5214055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f522406caf0 con 0x7f523409a520 2021-11-15T19:27:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f5233fff700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52140536d0 0x7f5214055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f5233fff700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52140536d0 0x7f5214055b90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5228008000 tx=0x7f5228009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:12.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.886+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5224043c50 con 0x7f523409a520 2021-11-15T19:27:12.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.970+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52340573d0 con 0x7f523409a520 2021-11-15T19:27:12.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f52317fa700 1 -- 172.21.2.137:0/4105803290 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f5224047270 con 0x7f523409a520 2021-11-15T19:27:12.982 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:12.982 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:26:56.082451+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:26:53.763248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T19:26:54.085772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:12.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52140536d0 msgr2=0x7f5214055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52140536d0 0x7f5214055b90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5228008000 tx=0x7f5228009040).stop 2021-11-15T19:27:12.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 msgr2=0x7f5234157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:12.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 0x7f5234157190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f5224002f70 tx=0x7f5224015000).stop 2021-11-15T19:27:12.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 shutdown_connections 2021-11-15T19:27:12.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52140536d0 0x7f5214055b90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5234159fa0 0x7f5234145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f523409a520 0x7f5234157190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 --2- 172.21.2.137:0/4105803290 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5220003ec0 0x7f5234147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:12.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 >> 172.21.2.137:0/4105803290 conn(0x7f52340b4e60 msgr2=0x7f52340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:12.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 shutdown_connections 2021-11-15T19:27:12.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:12.974+0000 7f523a265700 1 -- 172.21.2.137:0/4105803290 wait complete. 2021-11-15T19:27:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:26:53.763248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:26:54.085772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:12.990 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:13.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 Processor -- start 2021-11-15T19:27:13.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- start start 2021-11-15T19:27:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f97d80b72e0 0x7f97d80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80ad320 0x7f97d81290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b76c0 con 0x7f97d80acd60 2021-11-15T19:27:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80b3100 con 0x7f97d80b72e0 2021-11-15T19:27:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d812a170 con 0x7f97d80ad320 2021-11-15T19:27:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f97d80b72e0 0x7f97d80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f97d80b72e0 0x7f97d80b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60436/0 (socket says 172.21.2.137:60436) 2021-11-15T19:27:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 -- 172.21.2.137:0/1791483795 learned_addr learned my addr 172.21.2.137:0/1791483795 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 -- 172.21.2.137:0/1791483795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80ad320 msgr2=0x7f97d81290c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 --2- 172.21.2.137:0/1791483795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80ad320 0x7f97d81290c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 -- 172.21.2.137:0/1791483795 >> v1:172.21.2.111:6789/0 conn(0x7f97d80acd60 legacy=0x7f97d80b4190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 -- 172.21.2.137:0/1791483795 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80ad8a0 con 0x7f97d80b72e0 2021-11-15T19:27:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dcc12700 1 --2- 172.21.2.137:0/1791483795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d80b19b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f97d80ac910 tx=0x7f97cc006eb0).ready entity=mon.1 client_cookie=d02fe796315e1965 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97d77fe700 1 -- 172.21.2.137:0/1791483795 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97cc00d570 con 0x7f97d80b72e0 2021-11-15T19:27:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97d77fe700 1 -- 172.21.2.137:0/1791483795 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc000e90 con 0x7f97d80b72e0 2021-11-15T19:27:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97d77fe700 1 -- 172.21.2.137:0/1791483795 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97cc00d8c0 con 0x7f97d80b72e0 2021-11-15T19:27:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- 172.21.2.137:0/1791483795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 msgr2=0x7f97d80b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 --2- 172.21.2.137:0/1791483795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d80b19b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f97d80ac910 tx=0x7f97cc006eb0).stop 2021-11-15T19:27:13.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- 172.21.2.137:0/1791483795 shutdown_connections 2021-11-15T19:27:13.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 --2- 172.21.2.137:0/1791483795 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80ad320 0x7f97d81290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 --2- 172.21.2.137:0/1791483795 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d80b19b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- 172.21.2.137:0/1791483795 >> 172.21.2.137:0/1791483795 conn(0x7f97d8064960 msgr2=0x7f97d8064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- 172.21.2.137:0/1791483795 shutdown_connections 2021-11-15T19:27:13.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- 172.21.2.137:0/1791483795 wait complete. 2021-11-15T19:27:13.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 Processor -- start 2021-11-15T19:27:13.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.034+0000 7f97dee76700 1 -- start start 2021-11-15T19:27:13.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80acd60 0x7f97d8142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97d80ad320 0x7f97d8120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d8120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80af7f0 con 0x7f97d80ad320 2021-11-15T19:27:13.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80afca0 con 0x7f97d80b72e0 2021-11-15T19:27:13.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80afa00 con 0x7f97d80acd60 2021-11-15T19:27:13.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d8120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d8120780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60446/0 (socket says 172.21.2.137:60446) 2021-11-15T19:27:13.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 -- 172.21.2.137:0/3472363414 learned_addr learned my addr 172.21.2.137:0/3472363414 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:13.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 -- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80acd60 msgr2=0x7f97d8142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80acd60 0x7f97d8142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 -- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97d80ad320 msgr2=0x7f97d8120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97d80ad320 0x7f97d8120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 -- 172.21.2.137:0/3472363414 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc00b1e0 con 0x7f97d80b72e0 2021-11-15T19:27:13.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dd413700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d8120780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f97d0003330 tx=0x7f97d00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d0001520 con 0x7f97d80b72e0 2021-11-15T19:27:13.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0001680 con 0x7f97d80b72e0 2021-11-15T19:27:13.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d00019e0 con 0x7f97d80b72e0 2021-11-15T19:27:13.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d811fdf0 con 0x7f97d80b72e0 2021-11-15T19:27:13.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d8128630 con 0x7f97d80b72e0 2021-11-15T19:27:13.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d811ffb0 con 0x7f97d80b72e0 2021-11-15T19:27:13.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97d0018030 con 0x7f97d80b72e0 2021-11-15T19:27:13.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97d5ffb700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97b8053640 0x7f97b8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f97d006b320 con 0x7f97d80b72e0 2021-11-15T19:27:13.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.038+0000 7f97dcc12700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97b8053640 0x7f97b8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.042+0000 7f97dcc12700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97b8053640 0x7f97b8055b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f97d80ac910 tx=0x7f97cc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.042+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97d0042530 con 0x7f97d80b72e0 2021-11-15T19:27:13.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.122+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f97d80b3a50 con 0x7f97d80b72e0 2021-11-15T19:27:13.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.122+0000 7f97d5ffb700 1 -- 172.21.2.137:0/3472363414 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f97d0045b50 con 0x7f97d80b72e0 2021-11-15T19:27:13.134 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97b8053640 msgr2=0x7f97b8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97b8053640 0x7f97b8055b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f97d80ac910 tx=0x7f97cc015000).stop 2021-11-15T19:27:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 msgr2=0x7f97d8120780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d8120780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f97d0003330 tx=0x7f97d00091a0).stop 2021-11-15T19:27:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 shutdown_connections 2021-11-15T19:27:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97b8053640 0x7f97b8055b00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97d80b72e0 0x7f97d8120780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97d80ad320 0x7f97d8120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 --2- 172.21.2.137:0/3472363414 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97d80acd60 0x7f97d8142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 >> 172.21.2.137:0/3472363414 conn(0x7f97d8064960 msgr2=0x7f97d80b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 shutdown_connections 2021-11-15T19:27:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.126+0000 7f97dee76700 1 -- 172.21.2.137:0/3472363414 wait complete. 2021-11-15T19:27:13.141 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:13.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 Processor -- start 2021-11-15T19:27:13.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 -- start start 2021-11-15T19:27:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd7a4065b10 0x7fd7a413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7a40b00a0 0x7fd7a405bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a4066270 con 0x7fd7a4065730 2021-11-15T19:27:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a4067410 con 0x7fd7a4065b10 2021-11-15T19:27:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7ab065700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4065fd0 con 0x7fd7a40b00a0 2021-11-15T19:27:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7a8e01700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd7a4065730 0x7fd7a413c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51000/0 (socket says 172.21.2.137:51000) 2021-11-15T19:27:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7a8e01700 1 -- 172.21.2.137:0/962369112 learned_addr learned my addr 172.21.2.137:0/962369112 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299173440 0 0) 0x7fd7a4066270 con 0x7fd7a4065730 2021-11-15T19:27:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.182+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd784003260 con 0x7fd7a4065730 2021-11-15T19:27:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595561627 0 0) 0x7fd784003260 con 0x7fd7a4065730 2021-11-15T19:27:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7a40b00a0 msgr2=0x7fd7a405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7a40b00a0 0x7fd7a405bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 >> v2:172.21.2.111:3300/0 conn(0x7fd7a4065b10 msgr2=0x7fd7a413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 --2- 172.21.2.137:0/962369112 >> v2:172.21.2.111:3300/0 conn(0x7fd7a4065b10 0x7fd7a413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4066f70 con 0x7fd7a4065730 2021-11-15T19:27:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd794001660 con 0x7fd7a4065730 2021-11-15T19:27:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 >> v1:172.21.2.137:6789/0 conn(0x7fd7a4065730 legacy=0x7fd7a413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7a40b00a0 0x7fd7840037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd784003ee0 0x7fd784004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd784004bf0 0x7fd784005720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4067410 con 0x7fd784004bf0 2021-11-15T19:27:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4065fd0 con 0x7fd784003ee0 2021-11-15T19:27:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840053a0 con 0x7fd7a40b00a0 2021-11-15T19:27:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd784003ee0 0x7fd784004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7a40b00a0 msgr2=0x7fd7840037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7a40b00a0 0x7fd7840037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd784004bf0 msgr2=0x7fd784005720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd784004bf0 0x7fd784005720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/962369112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784003260 con 0x7fd784003ee0 2021-11-15T19:27:13.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd784003ee0 0x7fd784004500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fd78c002f70 tx=0x7fd78c006ca0).ready entity=mon.1 client_cookie=8d879e194f1d1c97 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78c0108f0 con 0x7fd784003ee0 2021-11-15T19:27:13.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c014070 con 0x7fd784003ee0 2021-11-15T19:27:13.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a37fe700 1 -- 172.21.2.137:0/962369112 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78c010c40 con 0x7fd784003ee0 2021-11-15T19:27:13.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/962369112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd784003ee0 msgr2=0x7fd784004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 --2- 172.21.2.137:0/962369112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd784003ee0 0x7fd784004500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fd78c002f70 tx=0x7fd78c006ca0).stop 2021-11-15T19:27:13.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a9602700 1 -- 172.21.2.137:0/962369112 reap_dead start 2021-11-15T19:27:13.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/962369112 shutdown_connections 2021-11-15T19:27:13.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/962369112 >> 172.21.2.137:0/962369112 conn(0x7fd7a4060290 msgr2=0x7fd7a4060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/962369112 shutdown_connections 2021-11-15T19:27:13.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/962369112 wait complete. 2021-11-15T19:27:13.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 Processor -- start 2021-11-15T19:27:13.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- start start 2021-11-15T19:27:13.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd784003ee0 0x7fd7a414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 0x7fd7a415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7a41431a0 0x7fd7a415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4159aa0 con 0x7fd7a41431a0 2021-11-15T19:27:13.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40af700 con 0x7fd7a414c720 2021-11-15T19:27:13.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40ae050 con 0x7fd784003ee0 2021-11-15T19:27:13.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 0x7fd7a415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 0x7fd7a415a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60466/0 (socket says 172.21.2.137:60466) 2021-11-15T19:27:13.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/226576697 learned_addr learned my addr 172.21.2.137:0/226576697 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:13.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd784003ee0 msgr2=0x7fd7a414c230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:13.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd784003ee0 0x7fd7a414c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7a41431a0 msgr2=0x7fd7a415a630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:13.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7a41431a0 0x7fd7a415a630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 -- 172.21.2.137:0/226576697 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4140ad0 con 0x7fd7a414c720 2021-11-15T19:27:13.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a3fff700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 0x7fd7a415a140 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd78c002f70 tx=0x7fd78c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78c019420 con 0x7fd7a414c720 2021-11-15T19:27:13.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c000e90 con 0x7fd7a414c720 2021-11-15T19:27:13.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a4140480 con 0x7fd7a414c720 2021-11-15T19:27:13.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78c019770 con 0x7fd7a414c720 2021-11-15T19:27:13.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a4142330 con 0x7fd7a414c720 2021-11-15T19:27:13.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.186+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a4140c60 con 0x7fd7a414c720 2021-11-15T19:27:13.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.190+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd78c029070 con 0x7fd7a414c720 2021-11-15T19:27:13.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.190+0000 7fd7a1ffb700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7880536a0 0x7fd788055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.190+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd78c06c2d0 con 0x7fd7a414c720 2021-11-15T19:27:13.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.190+0000 7fd7a8e01700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7880536a0 0x7fd788055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.190+0000 7fd7a8e01700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7880536a0 0x7fd788055b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd794001370 tx=0x7fd7a4066e60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.190+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd78c043300 con 0x7fd7a414c720 2021-11-15T19:27:13.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.274+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7a40b0fb0 con 0x7fd7a414c720 2021-11-15T19:27:13.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.274+0000 7fd7a1ffb700 1 -- 172.21.2.137:0/226576697 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd78c0468e0 con 0x7fd7a414c720 2021-11-15T19:27:13.285 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:13.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7880536a0 msgr2=0x7fd788055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7880536a0 0x7fd788055b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd794001370 tx=0x7fd7a4066e60).stop 2021-11-15T19:27:13.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 msgr2=0x7fd7a415a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 0x7fd7a415a140 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd78c002f70 tx=0x7fd78c017000).stop 2021-11-15T19:27:13.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 shutdown_connections 2021-11-15T19:27:13.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7880536a0 0x7fd788055b60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7a41431a0 0x7fd7a415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7a414c720 0x7fd7a415a140 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 --2- 172.21.2.137:0/226576697 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd784003ee0 0x7fd7a414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 >> 172.21.2.137:0/226576697 conn(0x7fd7a4060290 msgr2=0x7fd7a413c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 shutdown_connections 2021-11-15T19:27:13.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.278+0000 7fd7ab065700 1 -- 172.21.2.137:0/226576697 wait complete. 2021-11-15T19:27:13.292 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:13.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 Processor -- start 2021-11-15T19:27:13.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- start start 2021-11-15T19:27:13.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 0x7fa0780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa078146c20 con 0x7fa0780b2400 2021-11-15T19:27:13.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa078142af0 con 0x7fa0780b5330 2021-11-15T19:27:13.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780b27e0 con 0x7fa0780b61c0 2021-11-15T19:27:13.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa0780b5330 0x7fa0780b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51020/0 (socket says 172.21.2.137:51020) 2021-11-15T19:27:13.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 -- 172.21.2.137:0/4127419978 learned_addr learned my addr 172.21.2.137:0/4127419978 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:13.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030827132 0 0) 0x7fa068001110 con 0x7fa0780b5330 2021-11-15T19:27:13.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa058003260 con 0x7fa0780b5330 2021-11-15T19:27:13.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa076d9d700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 0x7fa0780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1806631950 0 0) 0x7fa058003260 con 0x7fa0780b5330 2021-11-15T19:27:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 msgr2=0x7fa0780b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 0x7fa0780b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 >> v1:172.21.2.111:6789/0 conn(0x7fa0780b2400 legacy=0x7fa0780b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780b4d80 con 0x7fa0780b5330 2021-11-15T19:27:13.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa0680017f0 con 0x7fa0780b5330 2021-11-15T19:27:13.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 >> v1:172.21.2.137:6789/0 conn(0x7fa0780b5330 legacy=0x7fa0780b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0580037d0 0x7fa058003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa058004500 0x7fa058004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 0x7fa058004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780b27e0 con 0x7fa0580037d0 2021-11-15T19:27:13.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05800b8e0 con 0x7fa058004500 2021-11-15T19:27:13.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05800baa0 con 0x7fa0780b61c0 2021-11-15T19:27:13.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa058004500 0x7fa058004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 -- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 msgr2=0x7fa058004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0780b61c0 0x7fa058004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 -- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0580037d0 msgr2=0x7fa058003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0580037d0 0x7fa058003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 -- 172.21.2.137:0/4127419978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058003260 con 0x7fa058004500 2021-11-15T19:27:13.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa058004500 0x7fa058004980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa0780b6ee0 tx=0x7fa068007630).ready entity=mon.1 client_cookie=9e65b1bdd35c08f1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0680070d0 con 0x7fa058004500 2021-11-15T19:27:13.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068007230 con 0x7fa058004500 2021-11-15T19:27:13.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07559a700 1 -- 172.21.2.137:0/4127419978 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06800c9c0 con 0x7fa058004500 2021-11-15T19:27:13.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- 172.21.2.137:0/4127419978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa058004500 msgr2=0x7fa058004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 --2- 172.21.2.137:0/4127419978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa058004500 0x7fa058004980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa0780b6ee0 tx=0x7fa068007630).stop 2021-11-15T19:27:13.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa076d9d700 1 -- 172.21.2.137:0/4127419978 reap_dead start 2021-11-15T19:27:13.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- 172.21.2.137:0/4127419978 shutdown_connections 2021-11-15T19:27:13.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- 172.21.2.137:0/4127419978 >> 172.21.2.137:0/4127419978 conn(0x7fa0780623a0 msgr2=0x7fa078062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- 172.21.2.137:0/4127419978 shutdown_connections 2021-11-15T19:27:13.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- 172.21.2.137:0/4127419978 wait complete. 2021-11-15T19:27:13.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 Processor -- start 2021-11-15T19:27:13.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- start start 2021-11-15T19:27:13.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa058004500 0x7fa078064740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 0x7fa07813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0780ac910 0x7fa078144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780678d0 con 0x7fa0780ac910 2021-11-15T19:27:13.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078145ec0 con 0x7fa0780ada90 2021-11-15T19:27:13.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa07cb34700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780ae090 con 0x7fa058004500 2021-11-15T19:27:13.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 0x7fa07813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 0x7fa07813ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60484/0 (socket says 172.21.2.137:60484) 2021-11-15T19:27:13.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.338+0000 7fa075d9b700 1 -- 172.21.2.137:0/523219548 learned_addr learned my addr 172.21.2.137:0/523219548 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:13.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa075d9b700 1 -- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa058004500 msgr2=0x7fa078064740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa075d9b700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa058004500 0x7fa078064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa075d9b700 1 -- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0780ac910 msgr2=0x7fa078144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa075d9b700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0780ac910 0x7fa078144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa075d9b700 1 -- 172.21.2.137:0/523219548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780ae330 con 0x7fa0780ada90 2021-11-15T19:27:13.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa075d9b700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 0x7fa07813ee50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa0780b6ee0 tx=0x7fa068013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa068007920 con 0x7fa0780ada90 2021-11-15T19:27:13.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068001110 con 0x7fa0780ada90 2021-11-15T19:27:13.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa068004920 con 0x7fa0780ada90 2021-11-15T19:27:13.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780aebb0 con 0x7fa0780ada90 2021-11-15T19:27:13.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07813f4e0 con 0x7fa0780ada90 2021-11-15T19:27:13.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0780ae4c0 con 0x7fa0780ada90 2021-11-15T19:27:13.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa06801d030 con 0x7fa0780ada90 2021-11-15T19:27:13.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa05c0536f0 0x7fa05c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa06806c200 con 0x7fa0780ada90 2021-11-15T19:27:13.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa07659c700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa05c0536f0 0x7fa05c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa07659c700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa05c0536f0 0x7fa05c055bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fa060001fa0 tx=0x7fa0600077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.342+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa068043290 con 0x7fa0780ada90 2021-11-15T19:27:13.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.426+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0780573d0 con 0x7fa0780ada90 2021-11-15T19:27:13.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.426+0000 7fa06f7fe700 1 -- 172.21.2.137:0/523219548 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa068046870 con 0x7fa0780ada90 2021-11-15T19:27:13.437 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:13.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa05c0536f0 msgr2=0x7fa05c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa05c0536f0 0x7fa05c055bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fa060001fa0 tx=0x7fa0600077f0).stop 2021-11-15T19:27:13.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 msgr2=0x7fa07813ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 0x7fa07813ee50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa0780b6ee0 tx=0x7fa068013000).stop 2021-11-15T19:27:13.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 shutdown_connections 2021-11-15T19:27:13.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa05c0536f0 0x7fa05c055bb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0780ac910 0x7fa078144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0780ada90 0x7fa07813ee50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 --2- 172.21.2.137:0/523219548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa058004500 0x7fa078064740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 >> 172.21.2.137:0/523219548 conn(0x7fa0780623a0 msgr2=0x7fa0780b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 shutdown_connections 2021-11-15T19:27:13.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.430+0000 7fa07cb34700 1 -- 172.21.2.137:0/523219548 wait complete. 2021-11-15T19:27:13.444 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 Processor -- start 2021-11-15T19:27:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- start start 2021-11-15T19:27:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5b280b0550 0x7f5b2814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5b2814aaa0 0x7f5b28140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2805cb50 con 0x7f5b2805c770 2021-11-15T19:27:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280b1650 con 0x7f5b280b0550 2021-11-15T19:27:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280ad030 con 0x7f5b2814aaa0 2021-11-15T19:27:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b26ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f5b2805c770 0x7f5b280aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51040/0 (socket says 172.21.2.137:51040) 2021-11-15T19:27:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b26ffd700 1 -- 172.21.2.137:0/3622995141 learned_addr learned my addr 172.21.2.137:0/3622995141 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b277fe700 1 --2- 172.21.2.137:0/3622995141 >> v2:172.21.2.137:3300/0 conn(0x7f5b2814aaa0 0x7f5b28140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b25ffb700 1 -- 172.21.2.137:0/3622995141 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116999477 0 0) 0x7f5b2805cb50 con 0x7f5b2805c770 2021-11-15T19:27:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b25ffb700 1 -- 172.21.2.137:0/3622995141 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b0c003260 con 0x7f5b2805c770 2021-11-15T19:27:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b277fe700 1 -- 172.21.2.137:0/3622995141 >> v2:172.21.2.111:3300/0 conn(0x7f5b280b0550 msgr2=0x7f5b2814a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b277fe700 1 --2- 172.21.2.137:0/3622995141 >> v2:172.21.2.111:3300/0 conn(0x7f5b280b0550 0x7f5b2814a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b277fe700 1 -- 172.21.2.137:0/3622995141 >> v1:172.21.2.137:6789/0 conn(0x7f5b2805c770 legacy=0x7f5b280aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b277fe700 1 -- 172.21.2.137:0/3622995141 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280ad2d0 con 0x7f5b2814aaa0 2021-11-15T19:27:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b277fe700 1 --2- 172.21.2.137:0/3622995141 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28140aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f5b200032f0 tx=0x7f5b200091d0).ready entity=mon.1 client_cookie=bb081008b08c0aa4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b25ffb700 1 -- 172.21.2.137:0/3622995141 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2000b680 con 0x7f5b2814aaa0 2021-11-15T19:27:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b25ffb700 1 -- 172.21.2.137:0/3622995141 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000b7e0 con 0x7f5b2814aaa0 2021-11-15T19:27:13.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b25ffb700 1 -- 172.21.2.137:0/3622995141 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2000b990 con 0x7f5b2814aaa0 2021-11-15T19:27:13.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/3622995141 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 msgr2=0x7f5b28140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/3622995141 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28140aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f5b200032f0 tx=0x7f5b200091d0).stop 2021-11-15T19:27:13.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/3622995141 shutdown_connections 2021-11-15T19:27:13.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/3622995141 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28140aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/3622995141 >> v2:172.21.2.111:3300/0 conn(0x7f5b280b0550 0x7f5b2814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/3622995141 >> 172.21.2.137:0/3622995141 conn(0x7f5b280631e0 msgr2=0x7f5b2805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/3622995141 shutdown_connections 2021-11-15T19:27:13.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.486+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/3622995141 wait complete. 2021-11-15T19:27:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 Processor -- start 2021-11-15T19:27:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- start start 2021-11-15T19:27:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b2805c770 0x7f5b281488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b280b0550 0x7f5b28143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280671d0 con 0x7f5b280b0550 2021-11-15T19:27:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b28117020 con 0x7f5b2814aaa0 2021-11-15T19:27:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b281172c0 con 0x7f5b2805c770 2021-11-15T19:27:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60500/0 (socket says 172.21.2.137:60500) 2021-11-15T19:27:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 -- 172.21.2.137:0/532297486 learned_addr learned my addr 172.21.2.137:0/532297486 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 -- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b2805c770 msgr2=0x7f5b281488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b2805c770 0x7f5b281488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 -- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b280b0550 msgr2=0x7f5b28143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b280b0550 0x7f5b28143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 -- 172.21.2.137:0/532297486 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20009470 con 0x7f5b2814aaa0 2021-11-15T19:27:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b277fe700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28144460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5b200032f0 tx=0x7f5b20016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2000b680 con 0x7f5b2814aaa0 2021-11-15T19:27:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20011e50 con 0x7f5b2814aaa0 2021-11-15T19:27:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b200107a0 con 0x7f5b2814aaa0 2021-11-15T19:27:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b28117a00 con 0x7f5b2814aaa0 2021-11-15T19:27:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b28144950 con 0x7f5b2814aaa0 2021-11-15T19:27:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b28117710 con 0x7f5b2814aaa0 2021-11-15T19:27:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5b20027020 con 0x7f5b2814aaa0 2021-11-15T19:27:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b17fff700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5b040536d0 0x7f5b04055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.490+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5b2006ceb0 con 0x7f5b2814aaa0 2021-11-15T19:27:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.494+0000 7f5b26ffd700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5b040536d0 0x7f5b04055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.494+0000 7f5b26ffd700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5b040536d0 0x7f5b04055b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5b18001110 tx=0x7f5b180076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.494+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5b20043f90 con 0x7f5b2814aaa0 2021-11-15T19:27:13.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.574+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b280ae7f0 con 0x7f5b2814aaa0 2021-11-15T19:27:13.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.574+0000 7f5b17fff700 1 -- 172.21.2.137:0/532297486 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5b20015020 con 0x7f5b2814aaa0 2021-11-15T19:27:13.586 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5b040536d0 msgr2=0x7f5b04055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5b040536d0 0x7f5b04055b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5b18001110 tx=0x7f5b180076c0).stop 2021-11-15T19:27:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 msgr2=0x7f5b28144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28144460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5b200032f0 tx=0x7f5b20016000).stop 2021-11-15T19:27:13.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 shutdown_connections 2021-11-15T19:27:13.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5b040536d0 0x7f5b04055b90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b2814aaa0 0x7f5b28144460 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b280b0550 0x7f5b28143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 --2- 172.21.2.137:0/532297486 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b2805c770 0x7f5b281488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 >> 172.21.2.137:0/532297486 conn(0x7f5b280631e0 msgr2=0x7f5b281476a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 shutdown_connections 2021-11-15T19:27:13.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.578+0000 7f5b2d5b7700 1 -- 172.21.2.137:0/532297486 wait complete. 2021-11-15T19:27:13.612 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T19:27:13.614 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-11-15T19:27:13.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 Processor -- start 2021-11-15T19:27:13.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 -- start start 2021-11-15T19:27:13.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 0x7fbc3c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbc3c0b05f0 0x7fbc3c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0acdd0 con 0x7fbc3c0b2750 2021-11-15T19:27:13.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad070 con 0x7fbc3c0b05f0 2021-11-15T19:27:13.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc40dac700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b2b30 con 0x7fbc3c0b0f00 2021-11-15T19:27:13.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc3a59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbc3c0b2750 0x7fbc3c0b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51054/0 (socket says 172.21.2.137:51054) 2021-11-15T19:27:13.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc3a59c700 1 -- 172.21.2.137:0/4186422662 learned_addr learned my addr 172.21.2.137:0/4186422662 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:13.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256919981 0 0) 0x7fbc3c0acdd0 con 0x7fbc3c0b2750 2021-11-15T19:27:13.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.654+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c004370 con 0x7fbc3c0b2750 2021-11-15T19:27:13.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954252680 0 0) 0x7fbc1c004370 con 0x7fbc3c0b2750 2021-11-15T19:27:13.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 msgr2=0x7fbc3c0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 0x7fbc3c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 >> v2:172.21.2.111:3300/0 conn(0x7fbc3c0b05f0 msgr2=0x7fbc3c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 --2- 172.21.2.137:0/4186422662 >> v2:172.21.2.111:3300/0 conn(0x7fbc3c0b05f0 0x7fbc3c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0b2ca0 con 0x7fbc3c0b2750 2021-11-15T19:27:13.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fbc24001660 con 0x7fbc3c0b2750 2021-11-15T19:27:13.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 >> v1:172.21.2.137:6789/0 conn(0x7fbc3c0b2750 legacy=0x7fbc3c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 0x7fbc1c0048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc1c004ff0 0x7fbc1c005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc1c005d00 0x7fbc1c003180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad070 con 0x7fbc1c005d00 2021-11-15T19:27:13.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b2b30 con 0x7fbc1c004ff0 2021-11-15T19:27:13.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c006480 con 0x7fbc3c0b0f00 2021-11-15T19:27:13.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc1c004ff0 0x7fbc1c005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc1c005d00 0x7fbc1c003180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 -- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 msgr2=0x7fbc1c0048e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3a59c700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 0x7fbc1c0048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 0x7fbc1c0048e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 -- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc1c005d00 msgr2=0x7fbc1c003180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:13.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc1c005d00 0x7fbc1c003180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:13.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 -- 172.21.2.137:0/4186422662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c004370 con 0x7fbc1c004ff0 2021-11-15T19:27:13.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc1c005d00 0x7fbc1c003180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:13.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3a59c700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc3c0b0f00 0x7fbc1c0048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:13.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc39d9b700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc1c004ff0 0x7fbc1c005610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fbc1c005580 tx=0x7fbc2c006ca0).ready entity=mon.1 client_cookie=a897cede6ac3342 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c013410 con 0x7fbc1c004ff0 2021-11-15T19:27:13.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c013570 con 0x7fbc1c004ff0 2021-11-15T19:27:13.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3959a700 1 -- 172.21.2.137:0/4186422662 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c0138d0 con 0x7fbc1c004ff0 2021-11-15T19:27:13.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/4186422662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc1c004ff0 msgr2=0x7fbc1c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 --2- 172.21.2.137:0/4186422662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc1c004ff0 0x7fbc1c005610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fbc1c005580 tx=0x7fbc2c006ca0).stop 2021-11-15T19:27:13.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 -- 172.21.2.137:0/4186422662 reap_dead start 2021-11-15T19:27:13.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/4186422662 shutdown_connections 2021-11-15T19:27:13.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/4186422662 >> 172.21.2.137:0/4186422662 conn(0x7fbc3c0630f0 msgr2=0x7fbc3c0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:13.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/4186422662 shutdown_connections 2021-11-15T19:27:13.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/4186422662 wait complete. 2021-11-15T19:27:13.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 Processor -- start 2021-11-15T19:27:13.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- start start 2021-11-15T19:27:13.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc1c004ff0 0x7fbc3c111020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc3c151810 0x7fbc3c065520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 0x7fbc3c13bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c151c70 con 0x7fbc3c151810 2021-11-15T19:27:13.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c152100 con 0x7fbc3c065a10 2021-11-15T19:27:13.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c10f380 con 0x7fbc1c004ff0 2021-11-15T19:27:13.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 0x7fbc3c13bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 0x7fbc3c13bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60518/0 (socket says 172.21.2.137:60518) 2021-11-15T19:27:13.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 -- 172.21.2.137:0/687744758 learned_addr learned my addr 172.21.2.137:0/687744758 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:13.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 -- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc1c004ff0 msgr2=0x7fbc3c111020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc1c004ff0 0x7fbc3c111020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 -- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc3c151810 msgr2=0x7fbc3c065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:13.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc3c151810 0x7fbc3c065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:13.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 -- 172.21.2.137:0/687744758 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c10f620 con 0x7fbc3c065a10 2021-11-15T19:27:13.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc3ad9d700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 0x7fbc3c13bfc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fbc24001840 tx=0x7fbc34008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3400ce90 con 0x7fbc3c065a10 2021-11-15T19:27:13.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400f4e0 con 0x7fbc3c065a10 2021-11-15T19:27:13.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c151e60 con 0x7fbc3c065a10 2021-11-15T19:27:13.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3400f840 con 0x7fbc3c065a10 2021-11-15T19:27:13.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.658+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c0674b0 con 0x7fbc3c065a10 2021-11-15T19:27:13.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c0573d0 con 0x7fbc3c065a10 2021-11-15T19:27:13.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc34019030 con 0x7fbc3c065a10 2021-11-15T19:27:13.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc337fe700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc20053580 0x7fbc20055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:13.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbc3406b390 con 0x7fbc3c065a10 2021-11-15T19:27:13.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc3a59c700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc20053580 0x7fbc20055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:13.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc3a59c700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc20053580 0x7fbc20055a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fbc24008000 tx=0x7fbc24009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:13.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.662+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc340424f0 con 0x7fbc3c065a10 2021-11-15T19:27:13.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:13.774+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7fbc3c0b0ad0 con 0x7fbc3c065a10 2021-11-15T19:27:14.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.223+0000 7fbc337fe700 1 -- 172.21.2.137:0/687744758 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v32) v1 ==== 142+0+0 (secure 0 0 0) 0x7fbc34045b10 con 0x7fbc3c065a10 2021-11-15T19:27:14.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.223+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc20053580 msgr2=0x7fbc20055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:14.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.223+0000 7fbc40dac700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc20053580 0x7fbc20055a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fbc24008000 tx=0x7fbc24009040).stop 2021-11-15T19:27:14.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.223+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 msgr2=0x7fbc3c13bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:14.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.223+0000 7fbc40dac700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 0x7fbc3c13bfc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fbc24001840 tx=0x7fbc34008040).stop 2021-11-15T19:27:14.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 shutdown_connections 2021-11-15T19:27:14.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc20053580 0x7fbc20055a40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:14.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc3c065a10 0x7fbc3c13bfc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:14.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc3c151810 0x7fbc3c065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 --2- 172.21.2.137:0/687744758 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc1c004ff0 0x7fbc3c111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 >> 172.21.2.137:0/687744758 conn(0x7fbc3c0630f0 msgr2=0x7fbc3c0b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:14.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 shutdown_connections 2021-11-15T19:27:14.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.227+0000 7fbc40dac700 1 -- 172.21.2.137:0/687744758 wait complete. 2021-11-15T19:27:14.240 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:27:14.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.283+0000 7fb8b4fb8700 1 Processor -- start 2021-11-15T19:27:14.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.283+0000 7fb8b4fb8700 1 -- start start 2021-11-15T19:27:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b005c770 0x7fb8b00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8b00b0550 0x7fb8b014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b005cb50 con 0x7fb8b014aaa0 2021-11-15T19:27:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00b1650 con 0x7fb8b00b0550 2021-11-15T19:27:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00ad030 con 0x7fb8b005c770 2021-11-15T19:27:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8b00b0550 0x7fb8b014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8b00b0550 0x7fb8b014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60524/0 (socket says 172.21.2.137:60524) 2021-11-15T19:27:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/1512712481 learned_addr learned my addr 172.21.2.137:0/1512712481 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/1512712481 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b005c770 msgr2=0x7fb8b00aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- 172.21.2.137:0/1512712481 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b005c770 0x7fb8b00aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/1512712481 >> v1:172.21.2.137:6789/0 conn(0x7fb8b014aaa0 legacy=0x7fb8b0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/1512712481 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00ad2d0 con 0x7fb8b00b0550 2021-11-15T19:27:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- 172.21.2.137:0/1512712481 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b014a5b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb8a0002f70 tx=0x7fb8a0006eb0).ready entity=mon.1 client_cookie=bc6f6713f9f5d642 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8ad59a700 1 -- 172.21.2.137:0/1512712481 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a000d5c0 con 0x7fb8b00b0550 2021-11-15T19:27:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8ad59a700 1 -- 172.21.2.137:0/1512712481 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a0000e90 con 0x7fb8b00b0550 2021-11-15T19:27:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8ad59a700 1 -- 172.21.2.137:0/1512712481 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a000d950 con 0x7fb8b00b0550 2021-11-15T19:27:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/1512712481 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 msgr2=0x7fb8b014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/1512712481 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b014a5b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb8a0002f70 tx=0x7fb8a0006eb0).stop 2021-11-15T19:27:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/1512712481 shutdown_connections 2021-11-15T19:27:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/1512712481 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b014a5b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/1512712481 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b005c770 0x7fb8b00aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/1512712481 >> 172.21.2.137:0/1512712481 conn(0x7fb8b00631e0 msgr2=0x7fb8b005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/1512712481 shutdown_connections 2021-11-15T19:27:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/1512712481 wait complete. 2021-11-15T19:27:14.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 Processor -- start 2021-11-15T19:27:14.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- start start 2021-11-15T19:27:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8b005c770 0x7fb8b0143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b0156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b014aaa0 0x7fb8b0146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0145c60 con 0x7fb8b005c770 2021-11-15T19:27:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b01478e0 con 0x7fb8b00b0550 2021-11-15T19:27:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0147b80 con 0x7fb8b014aaa0 2021-11-15T19:27:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b0156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b0156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60528/0 (socket says 172.21.2.137:60528) 2021-11-15T19:27:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/2181797375 learned_addr learned my addr 172.21.2.137:0/2181797375 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b014aaa0 msgr2=0x7fb8b0146090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b014aaa0 0x7fb8b0146090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8b005c770 msgr2=0x7fb8b0143f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8b005c770 0x7fb8b0143f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 -- 172.21.2.137:0/2181797375 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a000b1e0 con 0x7fb8b00b0550 2021-11-15T19:27:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8add9b700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b0156fa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb8a0002f70 tx=0x7fb8a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a0006b60 con 0x7fb8b00b0550 2021-11-15T19:27:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a0011ce0 con 0x7fb8b00b0550 2021-11-15T19:27:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b0157490 con 0x7fb8b00b0550 2021-11-15T19:27:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a001e650 con 0x7fb8b00b0550 2021-11-15T19:27:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b0146580 con 0x7fb8b00b0550 2021-11-15T19:27:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.287+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b0145dd0 con 0x7fb8b00b0550 2021-11-15T19:27:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.291+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8a0025030 con 0x7fb8b00b0550 2021-11-15T19:27:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.291+0000 7fb89f7fe700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb88c053690 0x7fb88c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.291+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb8a006cf20 con 0x7fb8b00b0550 2021-11-15T19:27:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.291+0000 7fb8ae59c700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb88c053690 0x7fb88c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.291+0000 7fb8ae59c700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb88c053690 0x7fb88c055b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb8a4002fb0 tx=0x7fb8a4006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.291+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8a0047e60 con 0x7fb8b00b0550 2021-11-15T19:27:14.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.375+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb8b00ae7f0 con 0x7fb8b00b0550 2021-11-15T19:27:14.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb89f7fe700 1 -- 172.21.2.137:0/2181797375 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb8a0023020 con 0x7fb8b00b0550 2021-11-15T19:27:14.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb88c053690 msgr2=0x7fb88c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:14.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb88c053690 0x7fb88c055b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb8a4002fb0 tx=0x7fb8a4006930).stop 2021-11-15T19:27:14.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 msgr2=0x7fb8b0156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:14.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b0156fa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb8a0002f70 tx=0x7fb8a0015000).stop 2021-11-15T19:27:14.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 shutdown_connections 2021-11-15T19:27:14.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb88c053690 0x7fb88c055b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:14.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8b014aaa0 0x7fb8b0146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8b00b0550 0x7fb8b0156fa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:14.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 --2- 172.21.2.137:0/2181797375 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8b005c770 0x7fb8b0143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:14.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 >> 172.21.2.137:0/2181797375 conn(0x7fb8b00631e0 msgr2=0x7fb8b014af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:14.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 shutdown_connections 2021-11-15T19:27:14.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:14.387+0000 7fb8b4fb8700 1 -- 172.21.2.137:0/2181797375 wait complete. 2021-11-15T19:27:14.402 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:27:14.402 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:27:14.412 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:27:14.425 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:27:14.438 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:27:14.452 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:27:14.462 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:27:14.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.463 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.463 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:14.498 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:27:14.499 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:27:14.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.500 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.501 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:14.507 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:27:14.508 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:27:14.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.509 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.509 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:14.515 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T19:27:14.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:27:14.516 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T19:27:14.517 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:27:14.517 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:27:14.517 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:14.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.578 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.578 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:14.583 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:27:14.584 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:27:14.585 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:27:14.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:27:14.586 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:14.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.650 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.651 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:14.662 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:27:14.663 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:27:14.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.664 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.665 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:14.716 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:27:14.717 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:27:14.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.718 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.719 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:14.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:27:14.728 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-11-15T19:27:14.728 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-11-15T19:27:14.729 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:27:14.729 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:27:14.729 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:14.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.799 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.800 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:14.805 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:27:14.806 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:27:14.807 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:27:14.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:27:14.808 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:27:14.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.826 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.826 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:14.838 INFO:teuthology.orchestra.run.gibba017.stdout:fuseblk 2021-11-15T19:27:14.839 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-11-15T19:27:14.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.840 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.840 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:14.892 INFO:teuthology.orchestra.run.gibba017.stdout:fuseblk 2021-11-15T19:27:14.894 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-11-15T19:27:14.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.895 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.895 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:14.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:27:14.904 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2021-11-15T19:27:14.905 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2021-11-15T19:27:14.905 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba017.front.sepia.ceph.com... 2021-11-15T19:27:14.905 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:27:14.906 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:14.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:14.971 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:14.971 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:14.976 INFO:teuthology.orchestra.run.gibba017.stdout:ext2/ext3 2021-11-15T19:27:14.977 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:27:14.978 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:27:14.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:27:14.978 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:27:15.036 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:27:15.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718c8ac700 1 Processor -- start 2021-11-15T19:27:15.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718c8ac700 1 -- start start 2021-11-15T19:27:15.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718c8ac700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7188147980 0x7f71880aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718c8ac700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7188148190 con 0x7f7188144610 2021-11-15T19:27:15.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718c8ac700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880b1720 con 0x7f71880b1340 2021-11-15T19:27:15.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718c8ac700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880af800 con 0x7f7188147980 2021-11-15T19:27:15.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718659c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f71880b1340 0x7f7188143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51086/0 (socket says 172.21.2.137:51086) 2021-11-15T19:27:15.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718659c700 1 -- 172.21.2.137:0/23731570 learned_addr learned my addr 172.21.2.137:0/23731570 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:15.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337504733 0 0) 0x7f71880b1720 con 0x7f71880b1340 2021-11-15T19:27:15.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716c003260 con 0x7f71880b1340 2021-11-15T19:27:15.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 --2- 172.21.2.137:0/23731570 >> v2:172.21.2.111:3300/0 conn(0x7f7188147980 0x7f71880aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2051566543 0 0) 0x7f716c003260 con 0x7f71880b1340 2021-11-15T19:27:15.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 >> v2:172.21.2.111:3300/0 conn(0x7f7188147980 msgr2=0x7f71880aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 --2- 172.21.2.137:0/23731570 >> v2:172.21.2.111:3300/0 conn(0x7f7188147980 0x7f71880aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 >> v1:172.21.2.111:6789/0 conn(0x7f7188144610 legacy=0x7f71880a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718805faf0 con 0x7f71880b1340 2021-11-15T19:27:15.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7178001660 con 0x7f71880b1340 2021-11-15T19:27:15.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 >> v1:172.21.2.137:6789/0 conn(0x7f71880b1340 legacy=0x7f7188143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c003750 0x7f716c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f716c004500 0x7f716c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f716c004ec0 0x7f716c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71880af800 con 0x7f716c004500 2021-11-15T19:27:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c00be30 con 0x7f716c004ec0 2021-11-15T19:27:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c00bff0 con 0x7f716c003750 2021-11-15T19:27:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f716c004ec0 0x7f716c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 -- 172.21.2.137:0/23731570 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c003750 msgr2=0x7f716c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c003750 0x7f716c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 -- 172.21.2.137:0/23731570 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f716c004500 msgr2=0x7f716c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f716c004500 0x7f716c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 -- 172.21.2.137:0/23731570 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c003260 con 0x7f716c004ec0 2021-11-15T19:27:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 -- 172.21.2.137:0/23731570 reap_dead start 2021-11-15T19:27:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.083+0000 7f7186d9d700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f716c004ec0 0x7f716c00b750 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f718000a000 tx=0x7f7180008040).ready entity=mon.1 client_cookie=2e18317ab450af7d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f718000c070 con 0x7f716c004ec0 2021-11-15T19:27:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718000e7e0 con 0x7f716c004ec0 2021-11-15T19:27:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718559a700 1 -- 172.21.2.137:0/23731570 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f718000eb40 con 0x7f716c004ec0 2021-11-15T19:27:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/23731570 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f716c004ec0 msgr2=0x7f716c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f716c004ec0 0x7f716c00b750 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f718000a000 tx=0x7f7180008040).stop 2021-11-15T19:27:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/23731570 shutdown_connections 2021-11-15T19:27:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 --2- 172.21.2.137:0/23731570 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f716c004ec0 0x7f716c00b750 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/23731570 >> 172.21.2.137:0/23731570 conn(0x7f71880b4e60 msgr2=0x7f71880b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/23731570 shutdown_connections 2021-11-15T19:27:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/23731570 wait complete. 2021-11-15T19:27:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 Processor -- start 2021-11-15T19:27:15.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- start start 2021-11-15T19:27:15.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c004ec0 0x7f7188099120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71880ac870 0x7f7188145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 0x7f71880ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718809a220 con 0x7f71880ac870 2021-11-15T19:27:15.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188099970 con 0x7f71880aea10 2021-11-15T19:27:15.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7188099610 con 0x7f716c004ec0 2021-11-15T19:27:15.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 0x7f71880ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 0x7f71880ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60548/0 (socket says 172.21.2.137:60548) 2021-11-15T19:27:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 -- 172.21.2.137:0/1660380238 learned_addr learned my addr 172.21.2.137:0/1660380238 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 -- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c004ec0 msgr2=0x7f7188099120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c004ec0 0x7f7188099120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 -- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71880ac870 msgr2=0x7f7188145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71880ac870 0x7f7188145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 -- 172.21.2.137:0/1660380238 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718809a5c0 con 0x7f71880aea10 2021-11-15T19:27:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f7186d9d700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 0x7f71880ad990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f718000a000 tx=0x7f7180008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7180013640 con 0x7f71880aea10 2021-11-15T19:27:15.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71800137a0 con 0x7f71880aea10 2021-11-15T19:27:15.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7188099dd0 con 0x7f71880aea10 2021-11-15T19:27:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7188146610 con 0x7f71880aea10 2021-11-15T19:27:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7180013b00 con 0x7f71880aea10 2021-11-15T19:27:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718809a080 con 0x7f71880aea10 2021-11-15T19:27:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7180013c60 con 0x7f71880aea10 2021-11-15T19:27:15.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f71777fe700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7164053610 0x7f7164055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.087+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f718006c490 con 0x7f71880aea10 2021-11-15T19:27:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.091+0000 7f718659c700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7164053610 0x7f7164055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.091+0000 7f718659c700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7164053610 0x7f7164055ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7188062250 tx=0x7f718805f9e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.091+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f718809a080 con 0x7f71880aea10 2021-11-15T19:27:15.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f71880997d0 con 0x7f71880aea10 2021-11-15T19:27:15.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f71777fe700 1 -- 172.21.2.137:0/1660380238 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v21) v1 ==== 81+0+33645 (secure 0 0 0) 0x7f71880997d0 con 0x7f71880aea10 2021-11-15T19:27:15.184 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:15.184 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:27:15.184 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 21, 2021-11-15T19:27:15.184 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:27:15.185 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:27:15.185 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:26:56.082451+0000", 2021-11-15T19:27:15.185 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:27:15.185 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:27:15.186 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:27:15.186 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:27:15.186 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:27:15.186 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:27:15.187 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:27:15.187 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:27:15.187 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:27:15.187 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:27:15.187 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:27:15.188 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:27:15.188 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:27:15.188 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:27:15.188 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:27:15.188 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 4, 2021-11-15T19:27:15.189 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:27:15.189 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:27:15.189 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:27:15.189 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:27:15.190 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:27:15.190 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.190 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:27:15.190 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:27:15.190 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:27:15.191 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:27:15.191 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:27:15.191 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:27:15.191 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:27:15.192 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:27:15.192 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:27:15.192 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:27:15.192 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:27:15.192 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:27:15.193 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:27:15.193 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:27:15.193 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:27:15.193 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:27:15.193 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:27:15.194 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:27:15.194 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:27:15.194 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:27:15.194 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:27:15.194 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:27:15.195 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:27:15.195 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.195 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:27:15.195 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:27:15.196 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:27:15.196 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:27:15.196 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:27:15.196 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:27:15.196 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:27:15.197 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:27:15.197 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:27:15.197 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:27:15.197 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:27:15.198 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:27:15.198 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:27:15.198 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:27:15.198 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:27:15.198 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:27:15.199 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:27:15.199 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:27:15.199 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:27:15.199 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:27:15.199 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:27:15.200 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:27:15.200 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:27:15.200 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:27:15.200 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:27:15.201 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:27:15.201 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:27:15.201 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.201 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:27:15.201 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:27:15.202 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:27:15.202 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:27:15.202 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:27:15.202 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:27:15.202 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:27:15.203 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:27:15.203 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:27:15.203 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:27:15.203 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:27:15.204 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:27:15.204 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:27:15.204 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.204 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:27:15.204 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:27:15.205 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.205 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.205 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.205 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:27:15.206 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:27:15.206 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:27:15.206 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:27:15.206 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:27:15.206 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:27:15.207 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:27:15.207 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:27:15.207 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:27:15.207 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:27:15.208 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:27:15.208 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:27:15.208 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:27:15.208 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:27:15.208 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:27:15.209 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:27:15.209 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:27:15.209 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:27:15.209 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:27:15.209 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:27:15.210 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:27:15.210 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:27:15.210 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:27:15.210 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.210 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:27:15.211 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:27:15.211 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:27:15.211 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:27:15.211 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:27:15.212 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:27:15.212 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:27:15.212 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:27:15.212 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:27:15.212 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:27:15.213 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:27:15.213 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:27:15.213 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:27:15.213 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:27:15.214 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:27:15.214 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:27:15.214 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:27:15.214 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:27:15.214 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:27:15.215 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:27:15.215 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:27:15.215 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:27:15.215 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:27:15.215 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:27:15.216 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:27:15.216 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:27:15.216 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:27:15.216 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.216 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:27:15.217 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:27:15.217 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:27:15.217 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:27:15.217 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:27:15.218 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:27:15.218 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:27:15.218 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:27:15.218 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:27:15.218 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:27:15.219 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:27:15.219 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:27:15.219 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:27:15.219 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:27:15.219 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.220 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.220 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.220 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 3, 2021-11-15T19:27:15.220 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:27:15.221 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:53.763248+0000", 2021-11-15T19:27:15.221 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:27:15.221 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:27:15.221 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:27:15.221 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:27:15.222 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:27:15.222 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:27:15.222 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:27:15.222 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:27:15.222 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:27:15.223 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:27:15.223 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:27:15.223 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:27:15.223 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:27:15.224 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:27:15.224 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:27:15.224 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:27:15.224 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:27:15.224 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:27:15.225 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:27:15.225 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:27:15.225 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.225 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "20", 2021-11-15T19:27:15.225 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:27:15.226 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:27:15.226 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:27:15.226 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:27:15.226 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:27:15.226 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:27:15.227 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:27:15.227 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:27:15.227 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:27:15.227 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:27:15.227 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:27:15.228 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:27:15.228 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:27:15.228 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:27:15.228 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:27:15.228 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:27:15.229 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:27:15.229 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:27:15.229 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:27:15.229 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:27:15.230 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:27:15.230 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:27:15.230 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:27:15.230 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:27:15.230 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:27:15.231 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:27:15.231 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.231 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:27:15.231 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:27:15.232 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:27:15.232 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:27:15.232 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:27:15.232 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:27:15.232 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:27:15.233 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:27:15.233 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:27:15.233 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:27:15.233 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:27:15.234 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:27:15.234 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:27:15.234 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:27:15.234 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:27:15.234 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.235 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:27:15.235 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:27:15.235 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:27:15.235 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.235 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.236 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.236 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.236 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 4, 2021-11-15T19:27:15.236 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:27:15.237 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:54.085772+0000", 2021-11-15T19:27:15.237 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:27:15.237 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:27:15.237 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:27:15.237 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:27:15.238 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:27:15.238 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:27:15.238 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:27:15.238 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:27:15.238 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:27:15.239 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:27:15.239 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:27:15.239 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:27:15.239 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:27:15.240 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:27:15.240 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:27:15.240 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:27:15.240 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:27:15.240 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:27:15.241 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:27:15.241 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:27:15.241 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.241 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "21", 2021-11-15T19:27:15.241 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:27:15.242 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:27:15.242 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:27:15.242 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:27:15.242 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:27:15.243 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:27:15.243 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:27:15.243 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:27:15.243 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:27:15.243 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:27:15.244 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:27:15.244 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:27:15.244 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:27:15.244 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:27:15.245 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:27:15.245 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:27:15.245 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:27:15.245 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:27:15.246 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:27:15.246 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:27:15.246 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:27:15.246 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:27:15.246 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:27:15.247 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:27:15.247 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:27:15.247 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:27:15.247 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.248 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:27:15.248 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:27:15.248 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:27:15.248 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:27:15.248 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:27:15.249 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:27:15.249 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:27:15.249 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:27:15.249 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:27:15.249 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:27:15.250 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:27:15.250 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:27:15.250 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:27:15.250 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:27:15.251 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:27:15.251 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.251 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.251 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.252 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:27:15.252 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:27:15.252 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.252 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:27:15.252 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:27:15.253 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.253 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.253 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.253 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.253 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.254 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.254 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.254 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 19, 2021-11-15T19:27:15.254 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.255 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.255 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.255 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.255 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.255 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.256 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:27:15.256 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.256 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.256 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.257 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.257 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:27:15.257 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.257 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.257 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.258 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.258 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.258 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.258 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.258 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.259 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:27:15.259 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.259 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.259 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.260 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.260 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:27:15.260 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.260 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.260 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.261 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.261 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.261 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.261 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.261 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.262 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:27:15.262 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.262 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.262 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.262 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.263 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:27:15.263 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.263 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.263 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.263 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.264 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.264 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.264 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.264 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.265 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:27:15.265 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.265 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.265 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.266 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.266 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:27:15.266 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:27:15.266 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.266 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.267 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.267 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:27:15.267 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:27:15.267 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:27:15.267 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:27:15.268 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.268 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.268 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.268 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.268 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.269 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.269 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:27:15.269 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:27:15.269 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.269 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.270 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.270 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.270 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.270 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.270 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.271 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 19, 2021-11-15T19:27:15.271 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.271 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.271 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.271 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.272 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.272 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.272 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:27:15.272 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.272 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.273 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.273 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.273 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:27:15.273 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.273 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.274 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.274 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.274 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.274 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.274 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.275 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.275 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:27:15.275 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.275 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.275 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.276 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.276 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:27:15.276 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.276 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.276 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.277 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.277 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.277 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.277 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.278 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.278 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:27:15.278 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.278 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.278 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.279 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.279 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:27:15.279 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.279 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.279 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.279 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.280 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.280 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.280 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.280 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.281 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:27:15.281 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.281 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.281 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.281 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.282 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:27:15.282 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:27:15.282 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.282 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.282 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.283 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:27:15.283 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:27:15.283 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:27:15.283 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:27:15.283 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.284 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.284 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.284 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.284 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.284 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.285 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:27:15.285 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:27:15.285 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.285 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.285 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.286 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.286 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.286 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.286 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.287 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 16, 2021-11-15T19:27:15.287 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.287 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.287 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.287 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.288 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.288 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.288 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:27:15.288 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.288 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.289 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.289 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.289 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:27:15.289 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.289 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.290 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.290 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.290 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.290 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.290 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.291 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.291 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:27:15.291 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.291 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.291 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.292 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.292 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:27:15.292 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.292 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.292 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.293 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.293 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.293 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.293 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.293 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.293 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:27:15.294 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.294 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.294 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.294 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.295 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:27:15.295 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.295 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.295 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.295 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.296 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.296 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.296 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.296 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.296 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:27:15.297 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.297 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.297 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.297 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.297 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:27:15.298 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:27:15.298 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.298 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.298 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.299 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:27:15.299 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:27:15.299 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:27:15.299 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:27:15.299 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.300 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.300 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.300 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.300 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.301 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.301 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:27:15.301 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:27:15.301 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.301 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.302 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.302 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.302 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.302 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.302 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.303 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 19, 2021-11-15T19:27:15.303 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.303 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.303 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.303 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.304 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.304 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.304 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:27:15.304 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.305 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.305 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.305 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.305 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:27:15.305 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.306 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.306 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.306 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.306 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.306 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.307 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.307 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.307 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:27:15.307 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.308 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.308 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.308 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.308 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:27:15.308 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.309 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.309 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.309 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.309 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.309 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.310 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.310 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.310 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:27:15.310 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.310 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.311 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.311 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.311 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:27:15.311 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.312 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.312 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.312 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.312 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.312 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.313 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.313 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.313 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:27:15.313 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.313 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.314 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.314 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.314 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:27:15.314 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:27:15.315 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.315 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.315 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.315 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:27:15.315 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:27:15.316 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:27:15.316 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:27:15.316 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.316 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.316 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.317 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.317 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.317 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.317 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:27:15.317 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:27:15.318 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.318 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.318 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.318 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.319 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.319 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.319 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.319 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 19, 2021-11-15T19:27:15.319 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.320 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.320 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.320 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.320 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.320 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.321 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:27:15.321 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.321 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.321 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.322 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.322 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:27:15.322 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.322 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.322 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.323 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.323 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.323 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.323 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.323 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.324 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:27:15.324 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.324 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.324 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.325 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.325 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:27:15.325 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.325 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.325 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.326 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.326 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.326 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.326 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.326 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.327 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:27:15.327 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.327 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.327 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.327 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.328 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:27:15.328 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.328 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.328 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.329 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.329 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.329 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.329 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.329 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.330 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:27:15.330 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.330 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.330 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.330 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.331 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:27:15.331 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:27:15.331 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.331 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.332 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.332 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:27:15.332 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:27:15.332 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:27:15.332 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:27:15.333 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.333 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.333 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.333 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.333 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.334 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.334 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:27:15.334 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:27:15.334 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.335 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.335 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.335 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.335 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.335 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.336 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.336 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 18, 2021-11-15T19:27:15.336 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.336 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.336 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.337 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.337 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.337 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.337 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:27:15.338 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.338 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.338 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.338 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.338 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:27:15.339 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.339 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.339 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.339 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.339 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.340 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.340 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.340 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.340 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:27:15.340 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.341 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.341 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.341 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.341 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:27:15.342 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.342 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.342 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.342 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.342 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.343 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.343 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.343 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.343 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:27:15.343 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.344 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.344 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.344 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.344 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:27:15.345 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.345 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.345 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.345 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.345 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.346 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.346 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.346 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.346 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:27:15.346 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.347 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.347 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.347 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.348 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:27:15.348 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:27:15.348 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.348 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.348 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.349 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:27:15.349 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:27:15.349 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:27:15.349 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:27:15.349 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.350 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.350 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.350 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.350 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.351 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.351 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:27:15.351 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:27:15.351 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.351 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.352 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.352 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.352 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.352 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.352 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.353 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 19, 2021-11-15T19:27:15.353 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.353 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.353 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.353 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.354 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.354 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.354 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:27:15.354 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.355 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.355 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.355 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.355 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:27:15.355 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.356 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.356 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.356 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.356 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.357 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.357 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.357 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.357 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:27:15.357 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.358 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.358 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.358 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.358 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:27:15.358 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.359 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.359 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.359 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.359 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.359 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.360 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.360 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.360 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:27:15.360 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.360 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.361 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.361 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.361 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:27:15.361 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.361 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.362 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.362 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.362 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.362 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.362 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.363 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.363 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:27:15.363 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.363 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.363 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.364 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.364 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:27:15.364 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:27:15.364 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.365 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.365 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.365 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:27:15.365 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:27:15.365 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:27:15.366 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:27:15.366 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.366 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.366 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.367 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.367 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.367 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.367 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:27:15.367 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:27:15.368 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:27:15.368 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:27:15.368 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:27:15.368 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:27:15.368 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:27:15.369 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:27:15.369 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:27:15.369 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 16, 2021-11-15T19:27:15.369 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:27:15.369 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:27:15.370 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:27:15.370 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.370 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.370 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.370 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:27:15.371 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.371 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.371 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.371 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.372 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:27:15.372 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.372 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.372 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.372 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.373 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:27:15.373 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.373 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.373 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.373 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:27:15.374 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.374 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.374 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.374 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.374 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:27:15.375 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.375 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.375 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.375 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.375 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:27:15.376 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.376 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.376 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.376 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:27:15.376 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.377 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.377 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.377 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.377 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:27:15.378 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.378 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.378 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.378 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.378 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:27:15.379 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:27:15.379 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.379 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:27:15.379 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:27:15.379 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.380 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.380 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.380 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:27:15.380 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:27:15.380 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:27:15.381 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.381 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.381 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.381 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:27:15.381 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:27:15.382 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:27:15.382 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:27:15.382 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:27:15.382 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:27:15.383 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:27:15.383 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:15.383 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.383 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:27:15.383 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:27:15.384 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.384 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:27:15.384 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.384 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.385 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.385 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.385 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.385 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:27:15.385 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.386 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.386 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.386 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:27:15.386 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.386 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.387 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.387 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.387 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.387 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:27:15.387 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.388 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.388 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.388 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:27:15.388 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.389 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.389 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.389 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.389 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.389 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:27:15.390 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.390 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.390 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.390 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:27:15.390 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.391 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.391 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.391 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.391 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.391 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:27:15.392 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.392 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.392 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.392 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:27:15.392 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.393 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.393 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.393 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.393 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.393 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:27:15.394 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.394 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.394 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.394 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:27:15.394 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.395 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.395 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.395 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.395 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.395 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:27:15.396 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.396 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.396 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.396 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:27:15.396 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.397 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.397 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.397 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.397 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.398 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:27:15.398 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.398 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.398 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:15.398 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:27:15.399 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:27:15.399 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:27:15.399 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:27:15.399 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:27:15.399 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:27:15.400 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:27:15.400 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:27:15.400 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.400 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:27:15.400 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:27:15.401 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:27:15.401 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:27:15.401 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:27:15.401 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:27:15.402 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:27:15.402 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:27:15.402 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:27:15.402 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:27:15.402 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:27:15.403 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:27:15.403 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:27:15.403 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:27:15.403 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:15.404 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:15.404 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:27:15.404 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:27:15.404 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:27:15.404 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:27:15.405 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:27:15.405 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:27:15.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7164053610 msgr2=0x7f7164055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7164053610 0x7f7164055ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7188062250 tx=0x7f718805f9e0).stop 2021-11-15T19:27:15.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 msgr2=0x7f71880ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 0x7f71880ad990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f718000a000 tx=0x7f7180008040).stop 2021-11-15T19:27:15.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 shutdown_connections 2021-11-15T19:27:15.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7164053610 0x7f7164055ad0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f71880aea10 0x7f71880ad990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f71880ac870 0x7f7188145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 --2- 172.21.2.137:0/1660380238 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f716c004ec0 0x7f7188099120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 >> 172.21.2.137:0/1660380238 conn(0x7f71880b4e60 msgr2=0x7f71880b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:15.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 shutdown_connections 2021-11-15T19:27:15.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.175+0000 7f718c8ac700 1 -- 172.21.2.137:0/1660380238 wait complete. 2021-11-15T19:27:15.410 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:15.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 Processor -- start 2021-11-15T19:27:15.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 -- start start 2021-11-15T19:27:15.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe5100acab0 0x7fe5100b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe5100b1180 0x7fe5100b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100aecf0 con 0x7fe5100af2f0 2021-11-15T19:27:15.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51013f180 con 0x7fe5100acab0 2021-11-15T19:27:15.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe517262700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100aef20 con 0x7fe5100b1180 2021-11-15T19:27:15.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe5100b1180 0x7fe5100b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe5100b1180 0x7fe5100b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60560/0 (socket says 172.21.2.137:60560) 2021-11-15T19:27:15.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 -- 172.21.2.137:0/3245086143 learned_addr learned my addr 172.21.2.137:0/3245086143 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:15.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 -- 172.21.2.137:0/3245086143 >> v2:172.21.2.111:3300/0 conn(0x7fe5100acab0 msgr2=0x7fe5100b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 --2- 172.21.2.137:0/3245086143 >> v2:172.21.2.111:3300/0 conn(0x7fe5100acab0 0x7fe5100b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 -- 172.21.2.137:0/3245086143 >> v1:172.21.2.111:6789/0 conn(0x7fe5100af2f0 legacy=0x7fe510142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 -- 172.21.2.137:0/3245086143 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100ace90 con 0x7fe5100b1180 2021-11-15T19:27:15.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50ffff700 1 --2- 172.21.2.137:0/3245086143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100b1180 0x7fe5100b2550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe5100b2bd0 tx=0x7fe504006eb0).ready entity=mon.1 client_cookie=e599c0218bc66bd5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50f7fe700 1 -- 172.21.2.137:0/3245086143 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50400d5c0 con 0x7fe5100b1180 2021-11-15T19:27:15.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50f7fe700 1 -- 172.21.2.137:0/3245086143 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe504000e90 con 0x7fe5100b1180 2021-11-15T19:27:15.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.471+0000 7fe50f7fe700 1 -- 172.21.2.137:0/3245086143 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50400d910 con 0x7fe5100b1180 2021-11-15T19:27:15.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/3245086143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100b1180 msgr2=0x7fe5100b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 --2- 172.21.2.137:0/3245086143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100b1180 0x7fe5100b2550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe5100b2bd0 tx=0x7fe504006eb0).stop 2021-11-15T19:27:15.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/3245086143 shutdown_connections 2021-11-15T19:27:15.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 --2- 172.21.2.137:0/3245086143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100b1180 0x7fe5100b2550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 --2- 172.21.2.137:0/3245086143 >> v2:172.21.2.111:3300/0 conn(0x7fe5100acab0 0x7fe5100b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/3245086143 >> 172.21.2.137:0/3245086143 conn(0x7fe5100630f0 msgr2=0x7fe5100634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:15.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/3245086143 shutdown_connections 2021-11-15T19:27:15.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/3245086143 wait complete. 2021-11-15T19:27:15.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 Processor -- start 2021-11-15T19:27:15.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- start start 2021-11-15T19:27:15.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 0x7fe510138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5100af2f0 0x7fe510140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5100b1180 0x7fe510159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51013aac0 con 0x7fe5100b1180 2021-11-15T19:27:15.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe510133360 con 0x7fe5100acab0 2021-11-15T19:27:15.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe510133600 con 0x7fe5100af2f0 2021-11-15T19:27:15.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 0x7fe510138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 0x7fe510138b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60564/0 (socket says 172.21.2.137:60564) 2021-11-15T19:27:15.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 -- 172.21.2.137:0/1084666166 learned_addr learned my addr 172.21.2.137:0/1084666166 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:15.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 -- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5100af2f0 msgr2=0x7fe510140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5100af2f0 0x7fe510140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 -- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5100b1180 msgr2=0x7fe510159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5100b1180 0x7fe510159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 -- 172.21.2.137:0/1084666166 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50400b1e0 con 0x7fe5100acab0 2021-11-15T19:27:15.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe514ffe700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 0x7fe510138b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe500002f70 tx=0x7fe500006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe500013460 con 0x7fe5100acab0 2021-11-15T19:27:15.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5000135c0 con 0x7fe5100acab0 2021-11-15T19:27:15.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe510133aa0 con 0x7fe5100acab0 2021-11-15T19:27:15.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe500013920 con 0x7fe5100acab0 2021-11-15T19:27:15.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5101423e0 con 0x7fe5100acab0 2021-11-15T19:27:15.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51013a910 con 0x7fe5100acab0 2021-11-15T19:27:15.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.475+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe50000f070 con 0x7fe5100acab0 2021-11-15T19:27:15.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.479+0000 7fe50dffb700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4f0053610 0x7fe4f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.479+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe50006b400 con 0x7fe5100acab0 2021-11-15T19:27:15.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.479+0000 7fe50ffff700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4f0053610 0x7fe4f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.479+0000 7fe50ffff700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4f0053610 0x7fe4f0055ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe5100b2bd0 tx=0x7fe504015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.479+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe500042450 con 0x7fe5100acab0 2021-11-15T19:27:15.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5101337c0 con 0x7fe5100acab0 2021-11-15T19:27:15.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe50dffb700 1 -- 172.21.2.137:0/1084666166 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7fe500045a70 con 0x7fe5100acab0 2021-11-15T19:27:15.594 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:15.594 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:26:56.084069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.111:6835/2773926386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2773926386},{"type":"v1","addr":"172.21.2.111:6835","nonce":2773926386}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:27:15.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4f0053610 msgr2=0x7fe4f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4f0053610 0x7fe4f0055ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe5100b2bd0 tx=0x7fe504015000).stop 2021-11-15T19:27:15.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 msgr2=0x7fe510138b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 0x7fe510138b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe500002f70 tx=0x7fe500006ec0).stop 2021-11-15T19:27:15.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 shutdown_connections 2021-11-15T19:27:15.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4f0053610 0x7fe4f0055ad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5100b1180 0x7fe510159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5100af2f0 0x7fe510140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 --2- 172.21.2.137:0/1084666166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5100acab0 0x7fe510138b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 >> 172.21.2.137:0/1084666166 conn(0x7fe5100630f0 msgr2=0x7fe51005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:15.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 shutdown_connections 2021-11-15T19:27:15.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.587+0000 7fe517262700 1 -- 172.21.2.137:0/1084666166 wait complete. 2021-11-15T19:27:15.598 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 5 2021-11-15T19:27:15.601 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:27:15.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6063dcf700 1 Processor -- start 2021-11-15T19:27:15.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6063dcf700 1 -- start start 2021-11-15T19:27:15.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6063dcf700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f605c140aa0 0x7f605c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6063dcf700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c05cb50 con 0x7f605c05c770 2021-11-15T19:27:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6063dcf700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c0ad030 con 0x7f605c0b0550 2021-11-15T19:27:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6063dcf700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c0b1650 con 0x7f605c140aa0 2021-11-15T19:27:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f606136a700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f605c0b0550 0x7f605c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51124/0 (socket says 172.21.2.137:51124) 2021-11-15T19:27:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f606136a700 1 -- 172.21.2.137:0/2268537775 learned_addr learned my addr 172.21.2.137:0/2268537775 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:15.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380465548 0 0) 0x7f605c0ad030 con 0x7f605c0b0550 2021-11-15T19:27:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6044003260 con 0x7f605c0b0550 2021-11-15T19:27:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f606236c700 1 --2- 172.21.2.137:0/2268537775 >> v2:172.21.2.111:3300/0 conn(0x7f605c140aa0 0x7f605c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057859755 0 0) 0x7f6044003260 con 0x7f605c0b0550 2021-11-15T19:27:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 >> v2:172.21.2.111:3300/0 conn(0x7f605c140aa0 msgr2=0x7f605c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 --2- 172.21.2.137:0/2268537775 >> v2:172.21.2.111:3300/0 conn(0x7f605c140aa0 0x7f605c140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 >> v1:172.21.2.111:6789/0 conn(0x7f605c05c770 legacy=0x7f605c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0ad2d0 con 0x7f605c0b0550 2021-11-15T19:27:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6058001660 con 0x7f605c0b0550 2021-11-15T19:27:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 >> v1:172.21.2.137:6789/0 conn(0x7f605c0b0550 legacy=0x7f605c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6044003820 0x7f6044003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.643+0000 7f6060b69700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6044004500 0x7f6044004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044004f70 0x7f604400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0b1650 con 0x7f6044004f70 2021-11-15T19:27:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604400be50 con 0x7f6044003820 2021-11-15T19:27:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604400c010 con 0x7f6044004500 2021-11-15T19:27:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6044003820 0x7f6044003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 -- 172.21.2.137:0/2268537775 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6044004500 msgr2=0x7f6044004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6044004500 0x7f6044004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 -- 172.21.2.137:0/2268537775 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044004f70 msgr2=0x7f604400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044004f70 0x7f604400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 -- 172.21.2.137:0/2268537775 reap_dead start 2021-11-15T19:27:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 -- 172.21.2.137:0/2268537775 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044003260 con 0x7f6044003820 2021-11-15T19:27:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6061b6b700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6044003820 0x7f6044003c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f6050001fa0 tx=0x7f6050007a00).ready entity=mon.1 client_cookie=b290f3d1caadb50f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6050007070 con 0x7f6044003820 2021-11-15T19:27:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60500071d0 con 0x7f6044003820 2021-11-15T19:27:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6060b69700 1 -- 172.21.2.137:0/2268537775 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6050006510 con 0x7f6044003820 2021-11-15T19:27:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2268537775 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6044003820 msgr2=0x7f6044003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:15.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6044003820 0x7f6044003c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f6050001fa0 tx=0x7f6050007a00).stop 2021-11-15T19:27:15.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2268537775 shutdown_connections 2021-11-15T19:27:15.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2268537775 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6044003820 0x7f6044003c20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:15.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2268537775 >> 172.21.2.137:0/2268537775 conn(0x7f605c0631e0 msgr2=0x7f605c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2268537775 shutdown_connections 2021-11-15T19:27:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2268537775 wait complete. 2021-11-15T19:27:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 Processor -- start 2021-11-15T19:27:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- start start 2021-11-15T19:27:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044003820 0x7f605c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f605c1416f0 0x7f605c14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 0x7f605c067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c144100 con 0x7f6044003820 2021-11-15T19:27:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1599d0 con 0x7f605c066be0 2021-11-15T19:27:15.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1429a0 con 0x7f605c1416f0 2021-11-15T19:27:15.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 0x7f605c067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 0x7f605c067090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60586/0 (socket says 172.21.2.137:60586) 2021-11-15T19:27:15.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 -- 172.21.2.137:0/2841582428 learned_addr learned my addr 172.21.2.137:0/2841582428 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:15.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 -- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f605c1416f0 msgr2=0x7f605c14de30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:15.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f605c1416f0 0x7f605c14de30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 -- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044003820 msgr2=0x7f605c156460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:15.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044003820 0x7f605c156460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:15.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 -- 172.21.2.137:0/2841582428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c142c40 con 0x7f605c066be0 2021-11-15T19:27:15.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f606236c700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 0x7f605c067090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f605c14ebb0 tx=0x7f6054008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605400c070 con 0x7f605c066be0 2021-11-15T19:27:15.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540135e0 con 0x7f605c066be0 2021-11-15T19:27:15.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6054013940 con 0x7f605c066be0 2021-11-15T19:27:15.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c14c230 con 0x7f605c066be0 2021-11-15T19:27:15.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c141d20 con 0x7f605c066be0 2021-11-15T19:27:15.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c159b10 con 0x7f605c066be0 2021-11-15T19:27:15.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.647+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6054013aa0 con 0x7f605c066be0 2021-11-15T19:27:15.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.651+0000 7f604effd700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f603c053640 0x7f603c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:15.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.651+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f605406aa00 con 0x7f605c066be0 2021-11-15T19:27:15.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.651+0000 7f6061b6b700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f603c053640 0x7f603c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:15.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.651+0000 7f6061b6b700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f603c053640 0x7f603c055b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6050001fa0 tx=0x7f6050015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:15.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.651+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6054041b60 con 0x7f605c066be0 2021-11-15T19:27:15.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:15.759+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f605c0ae7f0 con 0x7f605c066be0 2021-11-15T19:27:16.232 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:27:16.226+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:27:16.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.235+0000 7f604effd700 1 -- 172.21.2.137:0/2841582428 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6054045180 con 0x7f605c066be0 2021-11-15T19:27:16.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f603c053640 msgr2=0x7f603c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f603c053640 0x7f603c055b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6050001fa0 tx=0x7f6050015000).stop 2021-11-15T19:27:16.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 msgr2=0x7f605c067090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 0x7f605c067090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f605c14ebb0 tx=0x7f6054008040).stop 2021-11-15T19:27:16.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 shutdown_connections 2021-11-15T19:27:16.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f603c053640 0x7f603c055b00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:16.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f605c066be0 0x7f605c067090 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:16.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f605c1416f0 0x7f605c14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 --2- 172.21.2.137:0/2841582428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6044003820 0x7f605c156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 >> 172.21.2.137:0/2841582428 conn(0x7f605c0631e0 msgr2=0x7f605c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:16.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 shutdown_connections 2021-11-15T19:27:16.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.239+0000 7f6063dcf700 1 -- 172.21.2.137:0/2841582428 wait complete. 2021-11-15T19:27:16.250 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:27:16.253 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:16.257 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:27:16.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 Processor -- start 2021-11-15T19:27:16.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 -- start start 2021-11-15T19:27:16.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff9ec0ac8c0 0x7ff9ec063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 0x7ff9ec13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec13edb0 con 0x7ff9ec05efb0 2021-11-15T19:27:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec067af0 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9f26db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0af790 con 0x7ff9ec0b1270 2021-11-15T19:27:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9eb7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff9ec0ac8c0 0x7ff9ec063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9ebfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff9ec05efb0 0x7ff9ec1423d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51140/0 (socket says 172.21.2.137:51140) 2021-11-15T19:27:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.295+0000 7ff9ebfff700 1 -- 172.21.2.137:0/3081810567 learned_addr learned my addr 172.21.2.137:0/3081810567 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eaffd700 1 -- 172.21.2.137:0/3081810567 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007956573 0 0) 0x7ff9dc001110 con 0x7ff9ec05efb0 2021-11-15T19:27:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/3081810567 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 msgr2=0x7ff9ec13e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- 172.21.2.137:0/3081810567 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 0x7ff9ec13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/3081810567 >> v1:172.21.2.137:6789/0 conn(0x7ff9ec05efb0 legacy=0x7ff9ec1423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/3081810567 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0afa30 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- 172.21.2.137:0/3081810567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec063010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff9d4002f70 tx=0x7ff9d4006df0).ready entity=mon.1 client_cookie=d8adf7afa80c17a0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:16.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eaffd700 1 -- 172.21.2.137:0/3081810567 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4010930 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eaffd700 1 -- 172.21.2.137:0/3081810567 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4000e90 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eaffd700 1 -- 172.21.2.137:0/3081810567 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4010c80 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/3081810567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 msgr2=0x7ff9ec063010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 --2- 172.21.2.137:0/3081810567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec063010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff9d4002f70 tx=0x7ff9d4006df0).stop 2021-11-15T19:27:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/3081810567 shutdown_connections 2021-11-15T19:27:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 --2- 172.21.2.137:0/3081810567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec063010 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 --2- 172.21.2.137:0/3081810567 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 0x7ff9ec13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/3081810567 >> 172.21.2.137:0/3081810567 conn(0x7ff9ec05bd20 msgr2=0x7ff9ec05c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:16.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/3081810567 shutdown_connections 2021-11-15T19:27:16.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/3081810567 wait complete. 2021-11-15T19:27:16.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 Processor -- start 2021-11-15T19:27:16.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- start start 2021-11-15T19:27:16.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9ec05efb0 0x7ff9ec063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 0x7ff9ec151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec139620 con 0x7ff9ec05efb0 2021-11-15T19:27:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec065300 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec139880 con 0x7ff9ec0b1270 2021-11-15T19:27:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60598/0 (socket says 172.21.2.137:60598) 2021-11-15T19:27:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/2480938621 learned_addr learned my addr 172.21.2.137:0/2480938621 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 msgr2=0x7ff9ec151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 0x7ff9ec151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9ec05efb0 msgr2=0x7ff9ec063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9ec05efb0 0x7ff9ec063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 -- 172.21.2.137:0/2480938621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d400c290 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9eb7fe700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec0b56c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff9d4002f70 tx=0x7ff9d4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4023440 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d400c030 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec065560 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec063900 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.299+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4023790 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec0656f0 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff9d400e040 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9e97fa700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9d0053690 0x7ff9d0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6155+0+0 (secure 0 0 0) 0x7ff9d406d2c0 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9ebfff700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9d0053690 0x7ff9d0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9ebfff700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9d0053690 0x7ff9d0055b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff9dc000bc0 tx=0x7ff9dc001250).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.303+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9d40442c0 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.411+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9ec142ae0 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9e97fa700 1 -- 172.21.2.137:0/2480938621 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1774 (secure 0 0 0) 0x7ff9d40478e0 con 0x7ff9ec0ac8c0 2021-11-15T19:27:16.421 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:16.422 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1978555787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1978555787},{"type":"v1","addr":"172.21.2.137:6833","nonce":1978555787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:26:55.077984+0000","modified":"2021-11-15T19:27:16.231592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":22,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T19:27:16.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9d0053690 msgr2=0x7ff9d0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9d0053690 0x7ff9d0055b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff9dc000bc0 tx=0x7ff9dc001250).stop 2021-11-15T19:27:16.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 msgr2=0x7ff9ec0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec0b56c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff9d4002f70 tx=0x7ff9d4017000).stop 2021-11-15T19:27:16.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 shutdown_connections 2021-11-15T19:27:16.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9d0053690 0x7ff9d0055b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:16.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9ec0b1270 0x7ff9ec151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9ec0ac8c0 0x7ff9ec0b56c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:16.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 --2- 172.21.2.137:0/2480938621 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9ec05efb0 0x7ff9ec063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 >> 172.21.2.137:0/2480938621 conn(0x7ff9ec05bd20 msgr2=0x7ff9ec0afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:16.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 shutdown_connections 2021-11-15T19:27:16.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.415+0000 7ff9f26db700 1 -- 172.21.2.137:0/2480938621 wait complete. 2021-11-15T19:27:16.426 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 6 2021-11-15T19:27:16.429 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:27:16.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.471+0000 7f8458953700 1 Processor -- start 2021-11-15T19:27:16.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.471+0000 7f8458953700 1 -- start start 2021-11-15T19:27:16.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84540b72e0 0x7f84540b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 0x7f84540b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540b76c0 con 0x7f84540b4680 2021-11-15T19:27:16.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540b3100 con 0x7f84540b72e0 2021-11-15T19:27:16.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845412a170 con 0x7f84540acd60 2021-11-15T19:27:16.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84540b72e0 0x7f84540b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:16.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84540b72e0 0x7f84540b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60606/0 (socket says 172.21.2.137:60606) 2021-11-15T19:27:16.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 -- 172.21.2.137:0/167873201 learned_addr learned my addr 172.21.2.137:0/167873201 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:16.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 -- 172.21.2.137:0/167873201 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 msgr2=0x7f84540b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:16.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 --2- 172.21.2.137:0/167873201 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 0x7f84540b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 -- 172.21.2.137:0/167873201 >> v1:172.21.2.111:6789/0 conn(0x7f84540b4680 legacy=0x7f8454143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:16.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 -- 172.21.2.137:0/167873201 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540ad8a0 con 0x7f84540b72e0 2021-11-15T19:27:16.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845259c700 1 --2- 172.21.2.137:0/167873201 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f84540b19b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f84540ad1d0 tx=0x7f843c006eb0).ready entity=mon.1 client_cookie=4f9b2479e6845185 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:16.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845159a700 1 -- 172.21.2.137:0/167873201 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843c00d570 con 0x7f84540b72e0 2021-11-15T19:27:16.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845159a700 1 -- 172.21.2.137:0/167873201 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c000e90 con 0x7f84540b72e0 2021-11-15T19:27:16.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f845159a700 1 -- 172.21.2.137:0/167873201 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843c00d8c0 con 0x7f84540b72e0 2021-11-15T19:27:16.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- 172.21.2.137:0/167873201 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 msgr2=0x7f84540b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- 172.21.2.137:0/167873201 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f84540b19b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f84540ad1d0 tx=0x7f843c006eb0).stop 2021-11-15T19:27:16.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- 172.21.2.137:0/167873201 shutdown_connections 2021-11-15T19:27:16.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- 172.21.2.137:0/167873201 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 0x7f84540b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- 172.21.2.137:0/167873201 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f84540b19b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:16.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- 172.21.2.137:0/167873201 >> 172.21.2.137:0/167873201 conn(0x7f8454064960 msgr2=0x7f8454064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:16.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- 172.21.2.137:0/167873201 shutdown_connections 2021-11-15T19:27:16.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- 172.21.2.137:0/167873201 wait complete. 2021-11-15T19:27:16.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 Processor -- start 2021-11-15T19:27:16.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- start start 2021-11-15T19:27:16.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 0x7f8454159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84540b4680 0x7f84541277b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f8454127ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541330f0 con 0x7f84540b4680 2021-11-15T19:27:16.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540b1190 con 0x7f84540b72e0 2021-11-15T19:27:16.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8458953700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540afaa0 con 0x7f84540acd60 2021-11-15T19:27:16.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8452d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f8454127ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:16.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8452d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f8454127ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60610/0 (socket says 172.21.2.137:60610) 2021-11-15T19:27:16.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.475+0000 7f8452d9d700 1 -- 172.21.2.137:0/2854153252 learned_addr learned my addr 172.21.2.137:0/2854153252 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:16.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8452d9d700 1 -- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 msgr2=0x7f8454159b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:16.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8452d9d700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 0x7f8454159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8452d9d700 1 -- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84540b4680 msgr2=0x7f84541277b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:16.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8452d9d700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84540b4680 0x7f84541277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:16.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8452d9d700 1 -- 172.21.2.137:0/2854153252 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c00b1e0 con 0x7f84540b72e0 2021-11-15T19:27:16.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8452d9d700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f8454127ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f844c003310 tx=0x7f844c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:16.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f844c001500 con 0x7f84540b72e0 2021-11-15T19:27:16.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c001660 con 0x7f84540b72e0 2021-11-15T19:27:16.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f844c0019c0 con 0x7f84540b72e0 2021-11-15T19:27:16.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84540af800 con 0x7f84540b72e0 2021-11-15T19:27:16.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454128210 con 0x7f84540b72e0 2021-11-15T19:27:16.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540b3a50 con 0x7f84540b72e0 2021-11-15T19:27:16.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f844c018030 con 0x7f84540b72e0 2021-11-15T19:27:16.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f844b7fe700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84380536a0 0x7f8438055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:16.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f844c06b380 con 0x7f84540b72e0 2021-11-15T19:27:16.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f845259c700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84380536a0 0x7f8438055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:16.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.479+0000 7f845259c700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84380536a0 0x7f8438055b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f84540ad1d0 tx=0x7f843c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:16.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.483+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f844c042470 con 0x7f84540b72e0 2021-11-15T19:27:16.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:16.591+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84540573d0 con 0x7f84540b72e0 2021-11-15T19:27:17.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f844b7fe700 1 -- 172.21.2.137:0/2854153252 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f844c016020 con 0x7f84540b72e0 2021-11-15T19:27:17.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84380536a0 msgr2=0x7f8438055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:17.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84380536a0 0x7f8438055b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f84540ad1d0 tx=0x7f843c015000).stop 2021-11-15T19:27:17.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 msgr2=0x7f8454127ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:17.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f8454127ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f844c003310 tx=0x7f844c0090f0).stop 2021-11-15T19:27:17.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 shutdown_connections 2021-11-15T19:27:17.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84380536a0 0x7f8438055b60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:17.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84540b72e0 0x7f8454127ca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:17.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84540b4680 0x7f84541277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:17.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 --2- 172.21.2.137:0/2854153252 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84540acd60 0x7f8454159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:17.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 >> 172.21.2.137:0/2854153252 conn(0x7f8454064960 msgr2=0x7f84540b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:17.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 shutdown_connections 2021-11-15T19:27:17.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.247+0000 7f8458953700 1 -- 172.21.2.137:0/2854153252 wait complete. 2021-11-15T19:27:17.263 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:27:17.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 Processor -- start 2021-11-15T19:27:17.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 -- start start 2021-11-15T19:27:17.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb51805fd20 0x7fb5180af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:17.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb5180b10b0 0x7fb5180b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:17.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb518147f70 con 0x7fb5180b0610 2021-11-15T19:27:17.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb518060100 con 0x7fb5180b10b0 2021-11-15T19:27:17.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb51e41d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb518147cd0 con 0x7fb51805fd20 2021-11-15T19:27:17.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb51805fd20 0x7fb5180af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:17.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb51805fd20 0x7fb5180af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60618/0 (socket says 172.21.2.137:60618) 2021-11-15T19:27:17.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 -- 172.21.2.137:0/1127163022 learned_addr learned my addr 172.21.2.137:0/1127163022 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:17.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 -- 172.21.2.137:0/1127163022 >> v2:172.21.2.111:3300/0 conn(0x7fb5180b10b0 msgr2=0x7fb5180b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:17.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 --2- 172.21.2.137:0/1127163022 >> v2:172.21.2.111:3300/0 conn(0x7fb5180b10b0 0x7fb5180b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:17.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 -- 172.21.2.137:0/1127163022 >> v1:172.21.2.111:6789/0 conn(0x7fb5180b0610 legacy=0x7fb5180aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:17.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 -- 172.21.2.137:0/1127163022 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180a9ed0 con 0x7fb51805fd20 2021-11-15T19:27:17.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb517fff700 1 --2- 172.21.2.137:0/1127163022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb5180af800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fb5180b4db0 tx=0x7fb508006eb0).ready entity=mon.1 client_cookie=2811283cdc8d4362 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:17.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.307+0000 7fb516ffd700 1 -- 172.21.2.137:0/1127163022 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50800d5c0 con 0x7fb51805fd20 2021-11-15T19:27:17.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb516ffd700 1 -- 172.21.2.137:0/1127163022 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508000e90 con 0x7fb51805fd20 2021-11-15T19:27:17.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb516ffd700 1 -- 172.21.2.137:0/1127163022 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50800d910 con 0x7fb51805fd20 2021-11-15T19:27:17.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1127163022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 msgr2=0x7fb5180af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:17.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1127163022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb5180af800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fb5180b4db0 tx=0x7fb508006eb0).stop 2021-11-15T19:27:17.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1127163022 shutdown_connections 2021-11-15T19:27:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1127163022 >> v2:172.21.2.111:3300/0 conn(0x7fb5180b10b0 0x7fb5180b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1127163022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb5180af800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1127163022 >> 172.21.2.137:0/1127163022 conn(0x7fb5180b4e60 msgr2=0x7fb5180b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1127163022 shutdown_connections 2021-11-15T19:27:17.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1127163022 wait complete. 2021-11-15T19:27:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 Processor -- start 2021-11-15T19:27:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- start start 2021-11-15T19:27:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb518063900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5180b0610 0x7fb518099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb5180b10b0 0x7fb518097ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51813fb70 con 0x7fb5180b0610 2021-11-15T19:27:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb518099300 con 0x7fb51805fd20 2021-11-15T19:27:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180995a0 con 0x7fb5180b10b0 2021-11-15T19:27:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb518063900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb518063900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60624/0 (socket says 172.21.2.137:60624) 2021-11-15T19:27:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 -- 172.21.2.137:0/1774171149 learned_addr learned my addr 172.21.2.137:0/1774171149 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:17.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 -- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb5180b10b0 msgr2=0x7fb518097ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:17.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb5180b10b0 0x7fb518097ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:17.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 -- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5180b0610 msgr2=0x7fb518099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:17.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5180b0610 0x7fb518099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:17.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 -- 172.21.2.137:0/1774171149 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50800b1e0 con 0x7fb51805fd20 2021-11-15T19:27:17.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb517fff700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb518063900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fb5180b4db0 tx=0x7fb508015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:17.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50800d940 con 0x7fb51805fd20 2021-11-15T19:27:17.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508011c60 con 0x7fb51805fd20 2021-11-15T19:27:17.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50801e460 con 0x7fb51805fd20 2021-11-15T19:27:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518099840 con 0x7fb51805fd20 2021-11-15T19:27:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb518098390 con 0x7fb51805fd20 2021-11-15T19:27:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518098fc0 con 0x7fb51805fd20 2021-11-15T19:27:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.311+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb508025030 con 0x7fb51805fd20 2021-11-15T19:27:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.315+0000 7fb5157fa700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4f8053570 0x7fb4f8055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.315+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fb50806ce70 con 0x7fb51805fd20 2021-11-15T19:27:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.315+0000 7fb5177fe700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4f8053570 0x7fb4f8055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.315+0000 7fb5177fe700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4f8053570 0x7fb4f8055a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb50c002f70 tx=0x7fb50c0069f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.315+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb518098fc0 con 0x7fb51805fd20 2021-11-15T19:27:17.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:17.399+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb518098fc0 con 0x7fb51805fd20 2021-11-15T19:27:18.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb5157fa700 1 -- 172.21.2.137:0/1774171149 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb518098fc0 con 0x7fb51805fd20 2021-11-15T19:27:18.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4f8053570 msgr2=0x7fb4f8055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:18.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4f8053570 0x7fb4f8055a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb50c002f70 tx=0x7fb50c0069f0).stop 2021-11-15T19:27:18.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 msgr2=0x7fb518063900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:18.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb518063900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fb5180b4db0 tx=0x7fb508015000).stop 2021-11-15T19:27:18.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 shutdown_connections 2021-11-15T19:27:18.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4f8053570 0x7fb4f8055a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb5180b10b0 0x7fb518097ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5180b0610 0x7fb518099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 --2- 172.21.2.137:0/1774171149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb51805fd20 0x7fb518063900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.263+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 >> 172.21.2.137:0/1774171149 conn(0x7fb5180b4e60 msgr2=0x7fb518147020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:18.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.267+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 shutdown_connections 2021-11-15T19:27:18.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.267+0000 7fb51e41d700 1 -- 172.21.2.137:0/1774171149 wait complete. 2021-11-15T19:27:18.276 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:27:18.280 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:27:18.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 Processor -- start 2021-11-15T19:27:18.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- start start 2021-11-15T19:27:18.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7ff0097260 0x7f7ff0097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff00b2c30 0x7f7ff00990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ff00969e0 0x7f7ff00995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff00ad150 con 0x7f7ff0097260 2021-11-15T19:27:18.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff00aca80 con 0x7f7ff00969e0 2021-11-15T19:27:18.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00accb0 con 0x7f7ff00b2c30 2021-11-15T19:27:18.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ff00969e0 0x7f7ff00995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:18.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ff00969e0 0x7f7ff00995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60636/0 (socket says 172.21.2.137:60636) 2021-11-15T19:27:18.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 -- 172.21.2.137:0/2328967778 learned_addr learned my addr 172.21.2.137:0/2328967778 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:18.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 -- 172.21.2.137:0/2328967778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff00b2c30 msgr2=0x7f7ff00990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:18.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 --2- 172.21.2.137:0/2328967778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff00b2c30 0x7f7ff00990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:18.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 -- 172.21.2.137:0/2328967778 >> v2:172.21.2.111:3300/0 conn(0x7f7ff0097260 msgr2=0x7f7ff0097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:18.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 --2- 172.21.2.137:0/2328967778 >> v2:172.21.2.111:3300/0 conn(0x7f7ff0097260 0x7f7ff0097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:18.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 -- 172.21.2.137:0/2328967778 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0097c50 con 0x7f7ff00969e0 2021-11-15T19:27:18.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff691b700 1 --2- 172.21.2.137:0/2328967778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff00995d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f7fe80032f0 tx=0x7f7fe8009290).ready entity=mon.1 client_cookie=bc3a00a7971cf6d4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:18.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff5118700 1 -- 172.21.2.137:0/2328967778 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe800b870 con 0x7f7ff00969e0 2021-11-15T19:27:18.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff5118700 1 -- 172.21.2.137:0/2328967778 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe800b9d0 con 0x7f7ff00969e0 2021-11-15T19:27:18.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff5118700 1 -- 172.21.2.137:0/2328967778 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe800bb40 con 0x7f7ff00969e0 2021-11-15T19:27:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- 172.21.2.137:0/2328967778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 msgr2=0x7f7ff00995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- 172.21.2.137:0/2328967778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff00995d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f7fe80032f0 tx=0x7f7fe8009290).stop 2021-11-15T19:27:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- 172.21.2.137:0/2328967778 shutdown_connections 2021-11-15T19:27:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- 172.21.2.137:0/2328967778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff00995d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- 172.21.2.137:0/2328967778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff00b2c30 0x7f7ff00990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 --2- 172.21.2.137:0/2328967778 >> v2:172.21.2.111:3300/0 conn(0x7f7ff0097260 0x7f7ff0097640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- 172.21.2.137:0/2328967778 >> 172.21.2.137:0/2328967778 conn(0x7f7ff00b7070 msgr2=0x7f7ff00b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- 172.21.2.137:0/2328967778 shutdown_connections 2021-11-15T19:27:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.327+0000 7f7ff837e700 1 -- 172.21.2.137:0/2328967778 wait complete. 2021-11-15T19:27:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 Processor -- start 2021-11-15T19:27:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- start start 2021-11-15T19:27:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff005f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff0097260 0x7f7ff009ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ff00b2c30 0x7f7ff00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff009ba40 con 0x7f7ff00b2c30 2021-11-15T19:27:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff0062400 con 0x7f7ff00969e0 2021-11-15T19:27:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff009a000 con 0x7f7ff0097260 2021-11-15T19:27:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff005f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff005f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60638/0 (socket says 172.21.2.137:60638) 2021-11-15T19:27:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 -- 172.21.2.137:0/4269848964 learned_addr learned my addr 172.21.2.137:0/4269848964 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff5919700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff0097260 0x7f7ff009ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff691b700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ff00b2c30 0x7f7ff00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 -- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff0097260 msgr2=0x7f7ff009ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff0097260 0x7f7ff009ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 -- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ff00b2c30 msgr2=0x7f7ff00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ff00b2c30 0x7f7ff00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 -- 172.21.2.137:0/4269848964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8009530 con 0x7f7ff00969e0 2021-11-15T19:27:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff691b700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ff00b2c30 0x7f7ff00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff611a700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff005f9e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f7fe4002f70 tx=0x7f7fe4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe4013460 con 0x7f7ff00969e0 2021-11-15T19:27:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe40135c0 con 0x7f7ff00969e0 2021-11-15T19:27:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff009a2a0 con 0x7f7ff00969e0 2021-11-15T19:27:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe4013920 con 0x7f7ff00969e0 2021-11-15T19:27:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff009b110 con 0x7f7ff00969e0 2021-11-15T19:27:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff0062590 con 0x7f7ff00969e0 2021-11-15T19:27:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fe401a060 con 0x7f7ff00969e0 2021-11-15T19:27:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7fe37fe700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fd00536a0 0x7f7fd0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f7fe406b2a0 con 0x7f7ff00969e0 2021-11-15T19:27:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.331+0000 7f7ff5919700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fd00536a0 0x7f7fd0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.335+0000 7f7ff5919700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fd00536a0 0x7f7fd0055b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7fec00a000 tx=0x7f7fec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.335+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ff0062590 con 0x7f7ff00969e0 2021-11-15T19:27:18.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:18.419+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7ff009b3f0 con 0x7f7ff00969e0 2021-11-15T19:27:19.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7fe37fe700 1 -- 172.21.2.137:0/4269848964 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7fe4045f90 con 0x7f7ff00969e0 2021-11-15T19:27:19.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fd00536a0 msgr2=0x7f7fd0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:19.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fd00536a0 0x7f7fd0055b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7fec00a000 tx=0x7f7fec008040).stop 2021-11-15T19:27:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 msgr2=0x7f7ff005f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff005f9e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f7fe4002f70 tx=0x7f7fe4006ec0).stop 2021-11-15T19:27:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 shutdown_connections 2021-11-15T19:27:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fd00536a0 0x7f7fd0055b60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:19.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ff00b2c30 0x7f7ff00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:19.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ff0097260 0x7f7ff009ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:19.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 --2- 172.21.2.137:0/4269848964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ff00969e0 0x7f7ff005f9e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:19.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 >> 172.21.2.137:0/4269848964 conn(0x7f7ff00b7070 msgr2=0x7f7ff0140f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:19.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 shutdown_connections 2021-11-15T19:27:19.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.283+0000 7f7ff837e700 1 -- 172.21.2.137:0/4269848964 wait complete. 2021-11-15T19:27:19.294 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:27:19.298 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:27:19.299 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:27:19.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:27:19.299 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:27:19.299 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:27:19.300 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:27:19.300 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:27:19.300 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:27:19.305 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:27:19.305 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:27:19.306 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:27:19.307 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:27:19.308 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:27:19.309 DEBUG:teuthology.parallel:result is None 2021-11-15T19:27:19.345 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:27:19.351 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:27:19.352 DEBUG:teuthology.parallel:result is None 2021-11-15T19:27:19.352 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:27:19.389 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:27:19.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.395+0000 7f23bd001700 1 Processor -- start 2021-11-15T19:27:19.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.395+0000 7f23bd001700 1 -- start start 2021-11-15T19:27:19.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f23b80b2400 0x7f23b80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:19.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f23b80b3e70 0x7f23b80b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:19.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b8146c20 con 0x7f23b80b5330 2021-11-15T19:27:19.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b8142af0 con 0x7f23b80b2400 2021-11-15T19:27:19.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80b27e0 con 0x7f23b80b3e70 2021-11-15T19:27:19.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f23b80b3e70 0x7f23b80b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:19.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f23b80b3e70 0x7f23b80b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60660/0 (socket says 172.21.2.137:60660) 2021-11-15T19:27:19.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 -- 172.21.2.137:0/2410260892 learned_addr learned my addr 172.21.2.137:0/2410260892 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:19.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 -- 172.21.2.137:0/2410260892 >> v2:172.21.2.111:3300/0 conn(0x7f23b80b2400 msgr2=0x7f23b80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:19.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 --2- 172.21.2.137:0/2410260892 >> v2:172.21.2.111:3300/0 conn(0x7f23b80b2400 0x7f23b80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:19.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 -- 172.21.2.137:0/2410260892 >> v1:172.21.2.111:6789/0 conn(0x7f23b80b5330 legacy=0x7f23b80b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:19.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 -- 172.21.2.137:0/2410260892 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80b4d80 con 0x7f23b80b3e70 2021-11-15T19:27:19.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b759e700 1 --2- 172.21.2.137:0/2410260892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b5ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f23b80b6ee0 tx=0x7f23b0009290).ready entity=mon.1 client_cookie=30bb7be78699fcb4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:19.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b5d9b700 1 -- 172.21.2.137:0/2410260892 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23b000b830 con 0x7f23b80b3e70 2021-11-15T19:27:19.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b5d9b700 1 -- 172.21.2.137:0/2410260892 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000b990 con 0x7f23b80b3e70 2021-11-15T19:27:19.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b5d9b700 1 -- 172.21.2.137:0/2410260892 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23b000bb40 con 0x7f23b80b3e70 2021-11-15T19:27:19.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/2410260892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 msgr2=0x7f23b80b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:19.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- 172.21.2.137:0/2410260892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b5ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f23b80b6ee0 tx=0x7f23b0009290).stop 2021-11-15T19:27:19.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/2410260892 shutdown_connections 2021-11-15T19:27:19.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- 172.21.2.137:0/2410260892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b5ab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:19.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- 172.21.2.137:0/2410260892 >> v2:172.21.2.111:3300/0 conn(0x7f23b80b2400 0x7f23b80b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:19.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/2410260892 >> 172.21.2.137:0/2410260892 conn(0x7f23b80623a0 msgr2=0x7f23b8062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:19.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/2410260892 shutdown_connections 2021-11-15T19:27:19.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/2410260892 wait complete. 2021-11-15T19:27:19.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 Processor -- start 2021-11-15T19:27:19.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- start start 2021-11-15T19:27:19.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b80b2400 0x7f23b815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:19.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:19.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b80b5330 0x7f23b8063db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:19.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81565f0 con 0x7f23b80b2400 2021-11-15T19:27:19.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80642a0 con 0x7f23b80b3e70 2021-11-15T19:27:19.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80644f0 con 0x7f23b80b5330 2021-11-15T19:27:19.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:19.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60666/0 (socket says 172.21.2.137:60666) 2021-11-15T19:27:19.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 -- 172.21.2.137:0/634095387 learned_addr learned my addr 172.21.2.137:0/634095387 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:19.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 -- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b80b5330 msgr2=0x7f23b8063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:19.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b80b5330 0x7f23b8063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:19.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 -- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b80b2400 msgr2=0x7f23b815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:19.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b80b2400 0x7f23b815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:19.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 -- 172.21.2.137:0/634095387 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009530 con 0x7f23b80b3e70 2021-11-15T19:27:19.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23b659c700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b9b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f23a8000f70 tx=0x7f23a8007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:19.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a800ce80 con 0x7f23b80b3e70 2021-11-15T19:27:19.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8013450 con 0x7f23b80b3e70 2021-11-15T19:27:19.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a80137b0 con 0x7f23b80b3e70 2021-11-15T19:27:19.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b8064790 con 0x7f23b80b3e70 2021-11-15T19:27:19.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.399+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b8156cf0 con 0x7f23b80b3e70 2021-11-15T19:27:19.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8064920 con 0x7f23b80b3e70 2021-11-15T19:27:19.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23a8010070 con 0x7f23b80b3e70 2021-11-15T19:27:19.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23affff700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f239c0536a0 0x7f239c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:19.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f23a806afc0 con 0x7f23b80b3e70 2021-11-15T19:27:19.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23b6d9d700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f239c0536a0 0x7f239c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:19.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23b6d9d700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f239c0536a0 0x7f239c055b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f23a0002f70 tx=0x7f23a00069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:19.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.403+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23a80422f0 con 0x7f23b80b3e70 2021-11-15T19:27:19.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:19.499+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f23b80573d0 con 0x7f23b80b3e70 2021-11-15T19:27:20.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.291+0000 7f23affff700 1 -- 172.21.2.137:0/634095387 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23a8013910 con 0x7f23b80b3e70 2021-11-15T19:27:20.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.291+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f239c0536a0 msgr2=0x7f239c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.291+0000 7f23bd001700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f239c0536a0 0x7f239c055b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f23a0002f70 tx=0x7f23a00069e0).stop 2021-11-15T19:27:20.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.291+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 msgr2=0x7f23b80b9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.291+0000 7f23bd001700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b9b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f23a8000f70 tx=0x7f23a8007c30).stop 2021-11-15T19:27:20.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 shutdown_connections 2021-11-15T19:27:20.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f239c0536a0 0x7f239c055b60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23b80b5330 0x7f23b8063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23b80b3e70 0x7f23b80b9b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 --2- 172.21.2.137:0/634095387 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23b80b2400 0x7f23b815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 >> 172.21.2.137:0/634095387 conn(0x7f23b80623a0 msgr2=0x7f23b80b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 shutdown_connections 2021-11-15T19:27:20.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.295+0000 7f23bd001700 1 -- 172.21.2.137:0/634095387 wait complete. 2021-11-15T19:27:20.304 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:27:20.307 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:27:20.307 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:27:20.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 Processor -- start 2021-11-15T19:27:20.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 -- start start 2021-11-15T19:27:20.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb230144610 0x7fb230147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2300a9f50 0x7fb2300aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb230148190 con 0x7fb2300b1340 2021-11-15T19:27:20.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2300b1720 con 0x7fb230144610 2021-11-15T19:27:20.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb230147e70 con 0x7fb2300a9f50 2021-11-15T19:27:20.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb230144610 0x7fb230147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb230144610 0x7fb230147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60672/0 (socket says 172.21.2.137:60672) 2021-11-15T19:27:20.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 -- 172.21.2.137:0/2991529594 learned_addr learned my addr 172.21.2.137:0/2991529594 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:20.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 -- 172.21.2.137:0/2991529594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2300a9f50 msgr2=0x7fb2300aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 --2- 172.21.2.137:0/2991529594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2300a9f50 0x7fb2300aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 -- 172.21.2.137:0/2991529594 >> v1:172.21.2.111:6789/0 conn(0x7fb2300b1340 legacy=0x7fb230143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 -- 172.21.2.137:0/2991529594 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300af800 con 0x7fb230144610 2021-11-15T19:27:20.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22e7fc700 1 --2- 172.21.2.137:0/2991529594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb230144610 0x7fb230147980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb230062250 tx=0x7fb228009290).ready entity=mon.1 client_cookie=3db384e732e7a402 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22dffb700 1 -- 172.21.2.137:0/2991529594 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb22800b830 con 0x7fb230144610 2021-11-15T19:27:20.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22dffb700 1 -- 172.21.2.137:0/2991529594 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22800b990 con 0x7fb230144610 2021-11-15T19:27:20.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb22dffb700 1 -- 172.21.2.137:0/2991529594 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb22800bb00 con 0x7fb230144610 2021-11-15T19:27:20.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 -- 172.21.2.137:0/2991529594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb230144610 msgr2=0x7fb230147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.351+0000 7fb2353d3700 1 --2- 172.21.2.137:0/2991529594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb230144610 0x7fb230147980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb230062250 tx=0x7fb228009290).stop 2021-11-15T19:27:20.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/2991529594 shutdown_connections 2021-11-15T19:27:20.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 --2- 172.21.2.137:0/2991529594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb2300a9f50 0x7fb2300aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 --2- 172.21.2.137:0/2991529594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb230144610 0x7fb230147980 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/2991529594 >> 172.21.2.137:0/2991529594 conn(0x7fb2300b4e60 msgr2=0x7fb2300b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/2991529594 shutdown_connections 2021-11-15T19:27:20.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/2991529594 wait complete. 2021-11-15T19:27:20.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 Processor -- start 2021-11-15T19:27:20.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- start start 2021-11-15T19:27:20.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 0x7fb2300aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2300b1340 0x7fb2300b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb230144610 0x7fb230142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23014ab40 con 0x7fb2300b1340 2021-11-15T19:27:20.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23014a600 con 0x7fb2300a9f50 2021-11-15T19:27:20.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23014a8a0 con 0x7fb230144610 2021-11-15T19:27:20.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 0x7fb2300aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 0x7fb2300aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60678/0 (socket says 172.21.2.137:60678) 2021-11-15T19:27:20.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 -- 172.21.2.137:0/947275838 learned_addr learned my addr 172.21.2.137:0/947275838 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:20.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22e7fc700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2300b1340 0x7fb2300b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22f7fe700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb230144610 0x7fb230142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 -- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb230144610 msgr2=0x7fb230142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb230144610 0x7fb230142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 -- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2300b1340 msgr2=0x7fb2300b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2300b1340 0x7fb2300b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 -- 172.21.2.137:0/947275838 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228009530 con 0x7fb2300a9f50 2021-11-15T19:27:20.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22f7fe700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb230144610 0x7fb230142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:20.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22effd700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 0x7fb2300aed50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fb218002ef0 tx=0x7fb218006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb218012410 con 0x7fb2300a9f50 2021-11-15T19:27:20.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218012570 con 0x7fb2300a9f50 2021-11-15T19:27:20.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2180128d0 con 0x7fb2300a9f50 2021-11-15T19:27:20.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2300b07c0 con 0x7fb2300a9f50 2021-11-15T19:27:20.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2300ac4b0 con 0x7fb2300a9f50 2021-11-15T19:27:20.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23005faf0 con 0x7fb2300a9f50 2021-11-15T19:27:20.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb21800f030 con 0x7fb2300a9f50 2021-11-15T19:27:20.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb227fff700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2140536a0 0x7fb214055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb21806b3c0 con 0x7fb2300a9f50 2021-11-15T19:27:20.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.355+0000 7fb22e7fc700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2140536a0 0x7fb214055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.359+0000 7fb22e7fc700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2140536a0 0x7fb214055b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb228018000 tx=0x7fb228016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.359+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb218042850 con 0x7fb2300a9f50 2021-11-15T19:27:20.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb2300573d0 con 0x7fb2300a9f50 2021-11-15T19:27:20.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb227fff700 1 -- 172.21.2.137:0/947275838 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+5627 (secure 0 0 0) 0x7fb218045e70 con 0x7fb2300a9f50 2021-11-15T19:27:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:20.476 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:27:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:27:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:27:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:27:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:27:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:27:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:27:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:27:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:27:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:27:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:27:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:27:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:27:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:27:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:27:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:27:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:27:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:27:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:27:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:27:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:27:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:27:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:27:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:27:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:27:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:27:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:27:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow r", 2021-11-15T19:27:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow rw", 2021-11-15T19:27:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rwx" 2021-11-15T19:27:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:27:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:27:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:27:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow r", 2021-11-15T19:27:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow rw", 2021-11-15T19:27:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rwx" 2021-11-15T19:27:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:27:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:27:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:27:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow r", 2021-11-15T19:27:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow rw", 2021-11-15T19:27:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rwx" 2021-11-15T19:27:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:27:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:27:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:27:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:27:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:27:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.bootstrap-mds", 2021-11-15T19:27:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBwtJJhvczzNhAA2DgtmtsvllABAhqUN91TPA==", 2021-11-15T19:27:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile bootstrap-mds" 2021-11-15T19:27:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.bootstrap-mgr", 2021-11-15T19:27:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBwtJJhLu7zNhAAe+UBZ6EJGlxWyIdOaI3ekg==", 2021-11-15T19:27:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile bootstrap-mgr" 2021-11-15T19:27:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.bootstrap-osd", 2021-11-15T19:27:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBwtJJh7w30NhAAEint/kB81+PUq4J6Y5syXA==", 2021-11-15T19:27:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile bootstrap-osd" 2021-11-15T19:27:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.bootstrap-rbd", 2021-11-15T19:27:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBwtJJh2Cn0NhAAjGNW7r1a5RFdnJvXUGF9RQ==", 2021-11-15T19:27:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile bootstrap-rbd" 2021-11-15T19:27:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-11-15T19:27:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBwtJJhU0j0NhAAp43RDqGDDNxDj0fWWVRfZg==", 2021-11-15T19:27:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-11-15T19:27:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.bootstrap-rgw", 2021-11-15T19:27:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBwtJJhImj0NhAANp+SY4v6qqeOcvB4geYAKg==", 2021-11-15T19:27:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile bootstrap-rgw" 2021-11-15T19:27:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:27:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:27:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:27:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:27:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:27:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:27:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:27:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:27:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:27:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:27:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:27:20.519 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:27:20.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2140536a0 msgr2=0x7fb214055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2140536a0 0x7fb214055b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb228018000 tx=0x7fb228016000).stop 2021-11-15T19:27:20.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 msgr2=0x7fb2300aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 0x7fb2300aed50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fb218002ef0 tx=0x7fb218006d50).stop 2021-11-15T19:27:20.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 shutdown_connections 2021-11-15T19:27:20.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb2140536a0 0x7fb214055b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb230144610 0x7fb230142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2300b1340 0x7fb2300b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 --2- 172.21.2.137:0/947275838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2300a9f50 0x7fb2300aed50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 >> 172.21.2.137:0/947275838 conn(0x7fb2300b4e60 msgr2=0x7fb230144ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 shutdown_connections 2021-11-15T19:27:20.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.467+0000 7fb2353d3700 1 -- 172.21.2.137:0/947275838 wait complete. 2021-11-15T19:27:20.523 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-11-15T19:27:20.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 Processor -- start 2021-11-15T19:27:20.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 -- start start 2021-11-15T19:27:20.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe51805c770 0x7fe5180aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe518140aa0 0x7fe518140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51805cb50 con 0x7fe5180b0550 2021-11-15T19:27:20.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5180b1650 con 0x7fe51805c770 2021-11-15T19:27:20.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe51c9eb700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5180ad030 con 0x7fe518140aa0 2021-11-15T19:27:20.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe518140aa0 0x7fe518140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe518140aa0 0x7fe518140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60690/0 (socket says 172.21.2.137:60690) 2021-11-15T19:27:20.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 -- 172.21.2.137:0/1752689270 learned_addr learned my addr 172.21.2.137:0/1752689270 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:20.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 -- 172.21.2.137:0/1752689270 >> v2:172.21.2.111:3300/0 conn(0x7fe51805c770 msgr2=0x7fe5180aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 --2- 172.21.2.137:0/1752689270 >> v2:172.21.2.111:3300/0 conn(0x7fe51805c770 0x7fe5180aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 -- 172.21.2.137:0/1752689270 >> v1:172.21.2.111:6789/0 conn(0x7fe5180b0550 legacy=0x7fe51814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 -- 172.21.2.137:0/1752689270 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5180ad2d0 con 0x7fe518140aa0 2021-11-15T19:27:20.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.567+0000 7fe516d9d700 1 --2- 172.21.2.137:0/1752689270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe518140aa0 0x7fe518140ef0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fe5180aee10 tx=0x7fe510009290).ready entity=mon.1 client_cookie=d6b29bd9f56507bb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51559a700 1 -- 172.21.2.137:0/1752689270 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51000b830 con 0x7fe518140aa0 2021-11-15T19:27:20.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51559a700 1 -- 172.21.2.137:0/1752689270 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51000b990 con 0x7fe518140aa0 2021-11-15T19:27:20.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51559a700 1 -- 172.21.2.137:0/1752689270 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51000bb40 con 0x7fe518140aa0 2021-11-15T19:27:20.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/1752689270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe518140aa0 msgr2=0x7fe518140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/1752689270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe518140aa0 0x7fe518140ef0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fe5180aee10 tx=0x7fe510009290).stop 2021-11-15T19:27:20.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/1752689270 shutdown_connections 2021-11-15T19:27:20.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/1752689270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe518140aa0 0x7fe518140ef0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/1752689270 >> v2:172.21.2.111:3300/0 conn(0x7fe51805c770 0x7fe5180aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/1752689270 >> 172.21.2.137:0/1752689270 conn(0x7fe5180631e0 msgr2=0x7fe51805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/1752689270 shutdown_connections 2021-11-15T19:27:20.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/1752689270 wait complete. 2021-11-15T19:27:20.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 Processor -- start 2021-11-15T19:27:20.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- start start 2021-11-15T19:27:20.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 0x7fe518145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5180b0550 0x7fe518145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe518140aa0 0x7fe518156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5181446d0 con 0x7fe5180b0550 2021-11-15T19:27:20.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe518066fe0 con 0x7fe51805c770 2021-11-15T19:27:20.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe518141c80 con 0x7fe518140aa0 2021-11-15T19:27:20.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 0x7fe518145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 0x7fe518145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60692/0 (socket says 172.21.2.137:60692) 2021-11-15T19:27:20.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 -- 172.21.2.137:0/642766810 learned_addr learned my addr 172.21.2.137:0/642766810 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:20.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 -- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe518140aa0 msgr2=0x7fe518156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe518140aa0 0x7fe518156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 -- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5180b0550 msgr2=0x7fe518145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5180b0550 0x7fe518145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 -- 172.21.2.137:0/642766810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510009530 con 0x7fe51805c770 2021-11-15T19:27:20.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51659c700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 0x7fe518145880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fe518144a20 tx=0x7fe500006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe500013460 con 0x7fe51805c770 2021-11-15T19:27:20.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5000135c0 con 0x7fe51805c770 2021-11-15T19:27:20.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe500013920 con 0x7fe51805c770 2021-11-15T19:27:20.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe518142350 con 0x7fe51805c770 2021-11-15T19:27:20.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe518146260 con 0x7fe51805c770 2021-11-15T19:27:20.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.571+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5180ae7f0 con 0x7fe51805c770 2021-11-15T19:27:20.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.575+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe50001a060 con 0x7fe51805c770 2021-11-15T19:27:20.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.575+0000 7fe50f7fe700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4fc053690 0x7fe4fc055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.575+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe50006b180 con 0x7fe51805c770 2021-11-15T19:27:20.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.575+0000 7fe515d9b700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4fc053690 0x7fe4fc055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.575+0000 7fe515d9b700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4fc053690 0x7fe4fc055b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe508002f90 tx=0x7fe5080069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.575+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe500042500 con 0x7fe51805c770 2021-11-15T19:27:20.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.688+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe5180573d0 con 0x7fe51805c770 2021-11-15T19:27:20.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe50f7fe700 1 -- 172.21.2.137:0/642766810 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v3) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe500018030 con 0x7fe51805c770 2021-11-15T19:27:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4fc053690 msgr2=0x7fe4fc055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4fc053690 0x7fe4fc055b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe508002f90 tx=0x7fe5080069b0).stop 2021-11-15T19:27:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 msgr2=0x7fe518145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 0x7fe518145880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fe518144a20 tx=0x7fe500006ec0).stop 2021-11-15T19:27:20.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 shutdown_connections 2021-11-15T19:27:20.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4fc053690 0x7fe4fc055b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe518140aa0 0x7fe518156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5180b0550 0x7fe518145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 --2- 172.21.2.137:0/642766810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe51805c770 0x7fe518145880 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 >> 172.21.2.137:0/642766810 conn(0x7fe5180631e0 msgr2=0x7fe51813f680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 shutdown_connections 2021-11-15T19:27:20.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.700+0000 7fe51c9eb700 1 -- 172.21.2.137:0/642766810 wait complete. 2021-11-15T19:27:20.711 INFO:teuthology.orchestra.run.gibba037.stderr:updated 2021-11-15T19:27:20.714 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-11-15T19:27:20.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.756+0000 7ff4bb0d6700 1 Processor -- start 2021-11-15T19:27:20.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.756+0000 7ff4bb0d6700 1 -- start start 2021-11-15T19:27:20.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.756+0000 7ff4bb0d6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff4b4065730 0x7ff4b413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b4066270 con 0x7ff4b4065b10 2021-11-15T19:27:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b4065fd0 con 0x7ff4b40b00a0 2021-11-15T19:27:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b4067410 con 0x7ff4b4065730 2021-11-15T19:27:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b9673700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff4b40b00a0 0x7ff4b405bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51252/0 (socket says 172.21.2.137:51252) 2021-11-15T19:27:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b9673700 1 -- 172.21.2.137:0/962099627 learned_addr learned my addr 172.21.2.137:0/962099627 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 --2- 172.21.2.137:0/962099627 >> v2:172.21.2.137:3300/0 conn(0x7ff4b4065730 0x7ff4b413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 -- 172.21.2.137:0/962099627 >> v1:172.21.2.137:6789/0 conn(0x7ff4b40b00a0 legacy=0x7ff4b405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 -- 172.21.2.137:0/962099627 >> v1:172.21.2.111:6789/0 conn(0x7ff4b4065b10 legacy=0x7ff4b413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 -- 172.21.2.137:0/962099627 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4066f70 con 0x7ff4b4065730 2021-11-15T19:27:20.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 --2- 172.21.2.137:0/962099627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065730 0x7ff4b413c2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff4b40612c0 tx=0x7ff4a4006e80).ready entity=mon.1 client_cookie=1b63c29bf76c72d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b37fe700 1 -- 172.21.2.137:0/962099627 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4a400a820 con 0x7ff4b4065730 2021-11-15T19:27:20.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b37fe700 1 -- 172.21.2.137:0/962099627 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4000e90 con 0x7ff4b4065730 2021-11-15T19:27:20.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b37fe700 1 -- 172.21.2.137:0/962099627 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4a400ab70 con 0x7ff4b4065730 2021-11-15T19:27:20.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/962099627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065730 msgr2=0x7ff4b413c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/962099627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065730 0x7ff4b413c2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff4b40612c0 tx=0x7ff4a4006e80).stop 2021-11-15T19:27:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/962099627 shutdown_connections 2021-11-15T19:27:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/962099627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065730 0x7ff4b413c2b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/962099627 >> 172.21.2.137:0/962099627 conn(0x7ff4b4060290 msgr2=0x7ff4b4060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/962099627 shutdown_connections 2021-11-15T19:27:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/962099627 wait complete. 2021-11-15T19:27:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 Processor -- start 2021-11-15T19:27:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- start start 2021-11-15T19:27:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4b4065730 0x7ff4b4140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 0x7ff4b410e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4b40b00a0 0x7ff4b40b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41418d0 con 0x7ff4b4065730 2021-11-15T19:27:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b410f310 con 0x7ff4b4065b10 2021-11-15T19:27:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4140970 con 0x7ff4b40b00a0 2021-11-15T19:27:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 0x7ff4b410e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4b4065730 0x7ff4b4140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 0x7ff4b410e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60710/0 (socket says 172.21.2.137:60710) 2021-11-15T19:27:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 -- 172.21.2.137:0/186837669 learned_addr learned my addr 172.21.2.137:0/186837669 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b8e72700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4b4065730 0x7ff4b4140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:39702/0 (socket says 172.21.2.137:39702) 2021-11-15T19:27:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b9673700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4b40b00a0 0x7ff4b40b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 -- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4b40b00a0 msgr2=0x7ff4b40b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4b40b00a0 0x7ff4b40b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 -- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4b4065730 msgr2=0x7ff4b4140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4b4065730 0x7ff4b4140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 -- 172.21.2.137:0/186837669 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a400c310 con 0x7ff4b4065b10 2021-11-15T19:27:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b3fff700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 0x7ff4b410e8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7ff49c001fa0 tx=0x7ff49c007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49c007030 con 0x7ff4b4065b10 2021-11-15T19:27:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c007190 con 0x7ff4b4065b10 2021-11-15T19:27:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b4142de0 con 0x7ff4b4065b10 2021-11-15T19:27:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49c006510 con 0x7ff4b4065b10 2021-11-15T19:27:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.760+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b4150280 con 0x7ff4b4065b10 2021-11-15T19:27:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b40af7a0 con 0x7ff4b4065b10 2021-11-15T19:27:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff49c010030 con 0x7ff4b4065b10 2021-11-15T19:27:20.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4b1ffb700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4980536a0 0x7ff498055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff49c06b140 con 0x7ff4b4065b10 2021-11-15T19:27:20.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4b8e72700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4980536a0 0x7ff498055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4b8e72700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4980536a0 0x7ff498055b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff4a401b000 tx=0x7ff4b4066160).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.764+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4b40af7a0 con 0x7ff4b4065b10 2021-11-15T19:27:20.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.876+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff4b40af7a0 con 0x7ff4b4065b10 2021-11-15T19:27:20.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4b1ffb700 1 -- 172.21.2.137:0/186837669 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v4) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff4b40af7a0 con 0x7ff4b4065b10 2021-11-15T19:27:20.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4980536a0 msgr2=0x7ff498055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4980536a0 0x7ff498055b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff4a401b000 tx=0x7ff4b4066160).stop 2021-11-15T19:27:20.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 msgr2=0x7ff4b410e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 0x7ff4b410e8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7ff49c001fa0 tx=0x7ff49c007c00).stop 2021-11-15T19:27:20.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 shutdown_connections 2021-11-15T19:27:20.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4980536a0 0x7ff498055b60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4b40b00a0 0x7ff4b40b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4b4065b10 0x7ff4b410e8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 --2- 172.21.2.137:0/186837669 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4b4065730 0x7ff4b4140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 >> 172.21.2.137:0/186837669 conn(0x7ff4b4060290 msgr2=0x7ff4b413d260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 shutdown_connections 2021-11-15T19:27:20.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.880+0000 7ff4bb0d6700 1 -- 172.21.2.137:0/186837669 wait complete. 2021-11-15T19:27:20.889 INFO:teuthology.orchestra.run.gibba037.stderr:updated 2021-11-15T19:27:20.892 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-11-15T19:27:20.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f629a02b700 1 Processor -- start 2021-11-15T19:27:20.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f629a02b700 1 -- start start 2021-11-15T19:27:20.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f629a02b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 0x7f629414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f629a02b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629405cb50 con 0x7f629405c770 2021-11-15T19:27:20.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f629a02b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940ad030 con 0x7f629414aaa0 2021-11-15T19:27:20.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f629a02b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62940b1650 con 0x7f62940b0550 2021-11-15T19:27:20.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f6293fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f629414aaa0 0x7f6294140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51264/0 (socket says 172.21.2.137:51264) 2021-11-15T19:27:20.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f6293fff700 1 -- 172.21.2.137:0/2841937802 learned_addr learned my addr 172.21.2.137:0/2841937802 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:20.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904225929 0 0) 0x7f62940ad030 con 0x7f629414aaa0 2021-11-15T19:27:20.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6274003260 con 0x7f629414aaa0 2021-11-15T19:27:20.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838376683 0 0) 0x7f6274003260 con 0x7f629414aaa0 2021-11-15T19:27:20.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 msgr2=0x7f629414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f6292ffd700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 0x7f629414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 0x7f629414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:20.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 >> v1:172.21.2.111:6789/0 conn(0x7f629405c770 legacy=0x7f62940aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940ad2d0 con 0x7f629414aaa0 2021-11-15T19:27:20.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f628c0019e0 con 0x7f629414aaa0 2021-11-15T19:27:20.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 >> v1:172.21.2.137:6789/0 conn(0x7f629414aaa0 legacy=0x7f6294140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6274003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 0x7f6274004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6274004b10 0x7f6274004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940b1650 con 0x7f6274004b10 2021-11-15T19:27:20.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627400b8e0 con 0x7f6274003750 2021-11-15T19:27:20.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627400baa0 con 0x7f62940b0550 2021-11-15T19:27:20.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62937fe700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6274003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62937fe700 1 -- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 msgr2=0x7f6274004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62937fe700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940b0550 0x7f6274004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62937fe700 1 -- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6274004b10 msgr2=0x7f6274004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:20.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62937fe700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6274004b10 0x7f6274004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.936+0000 7f62937fe700 1 -- 172.21.2.137:0/2841937802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274003260 con 0x7f6274003750 2021-11-15T19:27:20.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6274003b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6284000f70 tx=0x7f62840079e0).ready entity=mon.1 client_cookie=418b08e017bc7a94 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6284007cf0 con 0x7f6274003750 2021-11-15T19:27:20.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6284014410 con 0x7f6274003750 2021-11-15T19:27:20.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62927fc700 1 -- 172.21.2.137:0/2841937802 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6284014770 con 0x7f6274003750 2021-11-15T19:27:20.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2841937802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 msgr2=0x7f6274003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 --2- 172.21.2.137:0/2841937802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6274003b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6284000f70 tx=0x7f62840079e0).stop 2021-11-15T19:27:20.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6293fff700 1 -- 172.21.2.137:0/2841937802 reap_dead start 2021-11-15T19:27:20.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2841937802 shutdown_connections 2021-11-15T19:27:20.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2841937802 >> 172.21.2.137:0/2841937802 conn(0x7f62940631e0 msgr2=0x7f629405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:20.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2841937802 shutdown_connections 2021-11-15T19:27:20.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2841937802 wait complete. 2021-11-15T19:27:20.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 Processor -- start 2021-11-15T19:27:20.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- start start 2021-11-15T19:27:20.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6294065d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62940655c0 0x7f6294143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940641a0 0x7f6294144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6294066d70 con 0x7f62940655c0 2021-11-15T19:27:20.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6294117320 con 0x7f6274003750 2021-11-15T19:27:20.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62941175c0 con 0x7f62940641a0 2021-11-15T19:27:20.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6294065d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6294065d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60724/0 (socket says 172.21.2.137:60724) 2021-11-15T19:27:20.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 -- 172.21.2.137:0/2586375002 learned_addr learned my addr 172.21.2.137:0/2586375002 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:20.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 -- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940641a0 msgr2=0x7f6294144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940641a0 0x7f6294144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 -- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62940655c0 msgr2=0x7f6294143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:20.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62940655c0 0x7f6294143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:20.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 -- 172.21.2.137:0/2586375002 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294065120 con 0x7f6274003750 2021-11-15T19:27:20.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f62937fe700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6294065d40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f6284000f70 tx=0x7f6284015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6284013840 con 0x7f6274003750 2021-11-15T19:27:20.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62840139a0 con 0x7f6274003750 2021-11-15T19:27:20.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62941448f0 con 0x7f6274003750 2021-11-15T19:27:20.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6294063da0 con 0x7f6274003750 2021-11-15T19:27:20.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6284013d00 con 0x7f6274003750 2021-11-15T19:27:20.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62940652b0 con 0x7f6274003750 2021-11-15T19:27:20.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6284022470 con 0x7f6274003750 2021-11-15T19:27:20.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6290ff9700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62780536f0 0x7f6278055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:20.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f628401c040 con 0x7f6274003750 2021-11-15T19:27:20.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.940+0000 7f6292ffd700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62780536f0 0x7f6278055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:20.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.944+0000 7f6292ffd700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62780536f0 0x7f6278055bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f627c007000 tx=0x7f627c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:20.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:20.944+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6284044050 con 0x7f6274003750 2021-11-15T19:27:21.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.056+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f62940573d0 con 0x7f6274003750 2021-11-15T19:27:21.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f6290ff9700 1 -- 172.21.2.137:0/2586375002 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6284047670 con 0x7f6274003750 2021-11-15T19:27:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62780536f0 msgr2=0x7f6278055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62780536f0 0x7f6278055bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f627c007000 tx=0x7f627c008040).stop 2021-11-15T19:27:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 msgr2=0x7f6294065d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6294065d40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f6284000f70 tx=0x7f6284015000).stop 2021-11-15T19:27:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 shutdown_connections 2021-11-15T19:27:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62780536f0 0x7f6278055bb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62940641a0 0x7f6294144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62940655c0 0x7f6294143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 --2- 172.21.2.137:0/2586375002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6274003750 0x7f6294065d40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 >> 172.21.2.137:0/2586375002 conn(0x7f62940631e0 msgr2=0x7f629414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 shutdown_connections 2021-11-15T19:27:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.068+0000 7f629a02b700 1 -- 172.21.2.137:0/2586375002 wait complete. 2021-11-15T19:27:21.078 INFO:teuthology.orchestra.run.gibba037.stderr:updated 2021-11-15T19:27:21.081 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-11-15T19:27:21.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 Processor -- start 2021-11-15T19:27:21.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 -- start start 2021-11-15T19:27:21.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc05c770 0x7fdbdc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdbdc140aa0 0x7fdbdc140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc05cb50 con 0x7fdbdc0b0550 2021-11-15T19:27:21.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b1650 con 0x7fdbdc140aa0 2021-11-15T19:27:21.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe26ca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0ad030 con 0x7fdbdc05c770 2021-11-15T19:27:21.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe0c67700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdbdc140aa0 0x7fdbdc140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe0c67700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdbdc140aa0 0x7fdbdc140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60734/0 (socket says 172.21.2.137:60734) 2021-11-15T19:27:21.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.124+0000 7fdbe0c67700 1 -- 172.21.2.137:0/2241876655 learned_addr learned my addr 172.21.2.137:0/2241876655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe0c67700 1 -- 172.21.2.137:0/2241876655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc05c770 msgr2=0x7fdbdc0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:21.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe0c67700 1 --2- 172.21.2.137:0/2241876655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc05c770 0x7fdbdc0aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe0c67700 1 -- 172.21.2.137:0/2241876655 >> v1:172.21.2.111:6789/0 conn(0x7fdbdc0b0550 legacy=0x7fdbdc14a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:21.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe0c67700 1 -- 172.21.2.137:0/2241876655 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0ad2d0 con 0x7fdbdc140aa0 2021-11-15T19:27:21.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe0c67700 1 --2- 172.21.2.137:0/2241876655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc140aa0 0x7fdbdc140f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fdbdc0adfd0 tx=0x7fdbd4009290).ready entity=mon.1 client_cookie=81000c8fd0735fd8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdaffd700 1 -- 172.21.2.137:0/2241876655 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd400b860 con 0x7fdbdc140aa0 2021-11-15T19:27:21.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdaffd700 1 -- 172.21.2.137:0/2241876655 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400b9c0 con 0x7fdbdc140aa0 2021-11-15T19:27:21.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdaffd700 1 -- 172.21.2.137:0/2241876655 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd400bb70 con 0x7fdbdc140aa0 2021-11-15T19:27:21.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2241876655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc140aa0 msgr2=0x7fdbdc140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2241876655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc140aa0 0x7fdbdc140f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fdbdc0adfd0 tx=0x7fdbd4009290).stop 2021-11-15T19:27:21.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2241876655 shutdown_connections 2021-11-15T19:27:21.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2241876655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc140aa0 0x7fdbdc140f10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2241876655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc05c770 0x7fdbdc0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2241876655 >> 172.21.2.137:0/2241876655 conn(0x7fdbdc0631e0 msgr2=0x7fdbdc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2241876655 shutdown_connections 2021-11-15T19:27:21.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2241876655 wait complete. 2021-11-15T19:27:21.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 Processor -- start 2021-11-15T19:27:21.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- start start 2021-11-15T19:27:21.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbdc05c770 0x7fdbdc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 0x7fdbdc143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc140aa0 0x7fdbdc146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc145a20 con 0x7fdbdc05c770 2021-11-15T19:27:21.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc143040 con 0x7fdbdc0b0550 2021-11-15T19:27:21.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc147ff0 con 0x7fdbdc140aa0 2021-11-15T19:27:21.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 0x7fdbdc143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 0x7fdbdc143d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60740/0 (socket says 172.21.2.137:60740) 2021-11-15T19:27:21.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 -- 172.21.2.137:0/2052956535 learned_addr learned my addr 172.21.2.137:0/2052956535 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 -- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc140aa0 msgr2=0x7fdbdc146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc140aa0 0x7fdbdc146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 -- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbdc05c770 msgr2=0x7fdbdc14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbdc05c770 0x7fdbdc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 -- 172.21.2.137:0/2052956535 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4009530 con 0x7fdbdc0b0550 2021-11-15T19:27:21.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbdb7fe700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 0x7fdbdc143d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fdbdc143570 tx=0x7fdbc4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc4013460 con 0x7fdbdc0b0550 2021-11-15T19:27:21.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc40135c0 con 0x7fdbdc0b0550 2021-11-15T19:27:21.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc143650 con 0x7fdbdc0b0550 2021-11-15T19:27:21.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc144280 con 0x7fdbdc0b0550 2021-11-15T19:27:21.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc4013920 con 0x7fdbdc0b0550 2021-11-15T19:27:21.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.128+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc0ae7f0 con 0x7fdbdc0b0550 2021-11-15T19:27:21.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.132+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdbc400f070 con 0x7fdbdc0b0550 2021-11-15T19:27:21.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.132+0000 7fdbd97fa700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdbc00536d0 0x7fdbc0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.132+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fdbc406b120 con 0x7fdbdc0b0550 2021-11-15T19:27:21.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.132+0000 7fdbdbfff700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdbc00536d0 0x7fdbc0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.132+0000 7fdbdbfff700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdbc00536d0 0x7fdbc0055b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fdbcc002fb0 tx=0x7fdbcc0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.132+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdbc40424a0 con 0x7fdbdc0b0550 2021-11-15T19:27:21.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.248+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdbdc0573d0 con 0x7fdbdc0b0550 2021-11-15T19:27:21.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbd97fa700 1 -- 172.21.2.137:0/2052956535 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdbc4045ac0 con 0x7fdbdc0b0550 2021-11-15T19:27:21.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdbc00536d0 msgr2=0x7fdbc0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdbc00536d0 0x7fdbc0055b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fdbcc002fb0 tx=0x7fdbcc0069b0).stop 2021-11-15T19:27:21.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 msgr2=0x7fdbdc143d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 0x7fdbdc143d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fdbdc143570 tx=0x7fdbc4006df0).stop 2021-11-15T19:27:21.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 shutdown_connections 2021-11-15T19:27:21.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdbc00536d0 0x7fdbc0055b90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbdc140aa0 0x7fdbdc146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbdc0b0550 0x7fdbdc143d90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 --2- 172.21.2.137:0/2052956535 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbdc05c770 0x7fdbdc14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 >> 172.21.2.137:0/2052956535 conn(0x7fdbdc0631e0 msgr2=0x7fdbdc140f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 shutdown_connections 2021-11-15T19:27:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.260+0000 7fdbe26ca700 1 -- 172.21.2.137:0/2052956535 wait complete. 2021-11-15T19:27:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:updated 2021-11-15T19:27:21.273 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-11-15T19:27:21.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.316+0000 7fcf4465d700 1 Processor -- start 2021-11-15T19:27:21.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.316+0000 7fcf4465d700 1 -- start start 2021-11-15T19:27:21.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcf3c05c770 0x7fcf3c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 0x7fcf3c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c05cb50 con 0x7fcf3c0b0550 2021-11-15T19:27:21.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b1650 con 0x7fcf3c05c770 2021-11-15T19:27:21.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0ad030 con 0x7fcf3c140aa0 2021-11-15T19:27:21.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fcf3c0b0550 0x7fcf3c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51296/0 (socket says 172.21.2.137:51296) 2021-11-15T19:27:21.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 -- 172.21.2.137:0/3030977854 learned_addr learned my addr 172.21.2.137:0/3030977854 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:21.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf42bfa700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 0x7fcf3c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf423f9700 1 --2- 172.21.2.137:0/3030977854 >> v2:172.21.2.111:3300/0 conn(0x7fcf3c05c770 0x7fcf3c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369312258 0 0) 0x7fcf3c05cb50 con 0x7fcf3c0b0550 2021-11-15T19:27:21.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf24003260 con 0x7fcf3c0b0550 2021-11-15T19:27:21.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283386148 0 0) 0x7fcf24003260 con 0x7fcf3c0b0550 2021-11-15T19:27:21.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 msgr2=0x7fcf3c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 0x7fcf3c140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 >> v2:172.21.2.111:3300/0 conn(0x7fcf3c05c770 msgr2=0x7fcf3c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 --2- 172.21.2.137:0/3030977854 >> v2:172.21.2.111:3300/0 conn(0x7fcf3c05c770 0x7fcf3c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0ad2d0 con 0x7fcf3c0b0550 2021-11-15T19:27:21.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fcf30001660 con 0x7fcf3c0b0550 2021-11-15T19:27:21.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 >> v1:172.21.2.137:6789/0 conn(0x7fcf3c0b0550 legacy=0x7fcf3c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 0x7fcf240037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf24004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf240049f0 0x7fcf24004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b1650 con 0x7fcf240049f0 2021-11-15T19:27:21.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0ad030 con 0x7fcf24003d50 2021-11-15T19:27:21.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2400b780 con 0x7fcf3c140aa0 2021-11-15T19:27:21.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf24004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf42bfa700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf240049f0 0x7fcf24004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf423f9700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 0x7fcf240037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 -- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 msgr2=0x7fcf240037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c140aa0 0x7fcf240037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 -- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf240049f0 msgr2=0x7fcf24004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf240049f0 0x7fcf24004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 -- 172.21.2.137:0/3030977854 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf24003260 con 0x7fcf24003d50 2021-11-15T19:27:21.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf24004500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fcf30001370 tx=0x7fcf30001d80).ready entity=mon.1 client_cookie=a44a4c640293f69e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf300070d0 con 0x7fcf24003d50 2021-11-15T19:27:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30007230 con 0x7fcf24003d50 2021-11-15T19:27:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf413f7700 1 -- 172.21.2.137:0/3030977854 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3000c8f0 con 0x7fcf24003d50 2021-11-15T19:27:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- 172.21.2.137:0/3030977854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 msgr2=0x7fcf24004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 --2- 172.21.2.137:0/3030977854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf24004500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fcf30001370 tx=0x7fcf30001d80).stop 2021-11-15T19:27:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf42bfa700 1 -- 172.21.2.137:0/3030977854 reap_dead start 2021-11-15T19:27:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- 172.21.2.137:0/3030977854 shutdown_connections 2021-11-15T19:27:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- 172.21.2.137:0/3030977854 >> 172.21.2.137:0/3030977854 conn(0x7fcf3c0631e0 msgr2=0x7fcf3c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- 172.21.2.137:0/3030977854 shutdown_connections 2021-11-15T19:27:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- 172.21.2.137:0/3030977854 wait complete. 2021-11-15T19:27:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 Processor -- start 2021-11-15T19:27:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.320+0000 7fcf4465d700 1 -- start start 2021-11-15T19:27:21.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf3c144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf3c140e80 0x7fcf3c147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c147a70 0x7fcf3c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c1451f0 con 0x7fcf3c140e80 2021-11-15T19:27:21.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0671e0 con 0x7fcf24003d50 2021-11-15T19:27:21.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c1429d0 con 0x7fcf3c147a70 2021-11-15T19:27:21.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf3c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf3c144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60758/0 (socket says 172.21.2.137:60758) 2021-11-15T19:27:21.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 -- 172.21.2.137:0/915836786 learned_addr learned my addr 172.21.2.137:0/915836786 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf42bfa700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c147a70 0x7fcf3c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf3c140e80 0x7fcf3c147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 -- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c147a70 msgr2=0x7fcf3c156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c147a70 0x7fcf3c156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 -- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf3c140e80 msgr2=0x7fcf3c147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf3c140e80 0x7fcf3c147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 -- 172.21.2.137:0/915836786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c144f50 con 0x7fcf24003d50 2021-11-15T19:27:21.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf423f9700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf3c144890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fcf3800b000 tx=0x7fcf38008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3800e6c0 con 0x7fcf24003d50 2021-11-15T19:27:21.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3800e820 con 0x7fcf24003d50 2021-11-15T19:27:21.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c141390 con 0x7fcf24003d50 2021-11-15T19:27:21.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c142e30 con 0x7fcf24003d50 2021-11-15T19:27:21.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3800eb80 con 0x7fcf24003d50 2021-11-15T19:27:21.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c142810 con 0x7fcf24003d50 2021-11-15T19:27:21.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf38024070 con 0x7fcf24003d50 2021-11-15T19:27:21.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf2f7fe700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf1c053690 0x7fcf1c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fcf3806c0f0 con 0x7fcf24003d50 2021-11-15T19:27:21.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf1c053690 0x7fcf1c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.324+0000 7fcf41bf8700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf1c053690 0x7fcf1c055b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcf30019000 tx=0x7fcf30015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.328+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf38043410 con 0x7fcf24003d50 2021-11-15T19:27:21.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.440+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcf3c144d80 con 0x7fcf24003d50 2021-11-15T19:27:21.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf2f7fe700 1 -- 172.21.2.137:0/915836786 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcf38046a30 con 0x7fcf24003d50 2021-11-15T19:27:21.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf1c053690 msgr2=0x7fcf1c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf1c053690 0x7fcf1c055b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcf30019000 tx=0x7fcf30015000).stop 2021-11-15T19:27:21.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 msgr2=0x7fcf3c144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf3c144890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fcf3800b000 tx=0x7fcf38008040).stop 2021-11-15T19:27:21.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 shutdown_connections 2021-11-15T19:27:21.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcf1c053690 0x7fcf1c055b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcf3c147a70 0x7fcf3c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcf3c140e80 0x7fcf3c147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 --2- 172.21.2.137:0/915836786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcf24003d50 0x7fcf3c144890 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 >> 172.21.2.137:0/915836786 conn(0x7fcf3c0631e0 msgr2=0x7fcf3c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 shutdown_connections 2021-11-15T19:27:21.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.452+0000 7fcf4465d700 1 -- 172.21.2.137:0/915836786 wait complete. 2021-11-15T19:27:21.463 INFO:teuthology.orchestra.run.gibba037.stderr:updated 2021-11-15T19:27:21.466 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-11-15T19:27:21.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 Processor -- start 2021-11-15T19:27:21.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- start start 2021-11-15T19:27:21.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40b0fe0 0x7f44c40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f44c40acff0 0x7f44c40af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f44c413f5c0 0x7f44c413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c40ae070 con 0x7f44c40acff0 2021-11-15T19:27:21.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c40ad470 con 0x7f44c413f5c0 2021-11-15T19:27:21.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40aedf0 con 0x7f44c40b0fe0 2021-11-15T19:27:21.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f44c413f5c0 0x7f44c413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f44c413f5c0 0x7f44c413fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60768/0 (socket says 172.21.2.137:60768) 2021-11-15T19:27:21.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 -- 172.21.2.137:0/1649409002 learned_addr learned my addr 172.21.2.137:0/1649409002 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 -- 172.21.2.137:0/1649409002 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40b0fe0 msgr2=0x7f44c40afde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:21.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 --2- 172.21.2.137:0/1649409002 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40b0fe0 0x7f44c40afde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 -- 172.21.2.137:0/1649409002 >> v2:172.21.2.111:3300/0 conn(0x7f44c40acff0 msgr2=0x7f44c40af4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:21.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 --2- 172.21.2.137:0/1649409002 >> v2:172.21.2.111:3300/0 conn(0x7f44c40acff0 0x7f44c40af4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 -- 172.21.2.137:0/1649409002 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40b13c0 con 0x7f44c413f5c0 2021-11-15T19:27:21.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c2d9d700 1 --2- 172.21.2.137:0/1649409002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c413f5c0 0x7f44c413fa00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f44c40ade90 tx=0x7f44b4006eb0).ready entity=mon.1 client_cookie=569ae9b04e5e3df4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c159a700 1 -- 172.21.2.137:0/1649409002 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44b400d570 con 0x7f44c413f5c0 2021-11-15T19:27:21.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c159a700 1 -- 172.21.2.137:0/1649409002 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4000e90 con 0x7f44c413f5c0 2021-11-15T19:27:21.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c159a700 1 -- 172.21.2.137:0/1649409002 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44b400d8c0 con 0x7f44c413f5c0 2021-11-15T19:27:21.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- 172.21.2.137:0/1649409002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c413f5c0 msgr2=0x7f44c413fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/1649409002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c413f5c0 0x7f44c413fa00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f44c40ade90 tx=0x7f44b4006eb0).stop 2021-11-15T19:27:21.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- 172.21.2.137:0/1649409002 shutdown_connections 2021-11-15T19:27:21.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/1649409002 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c413f5c0 0x7f44c413fa00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/1649409002 >> v2:172.21.2.111:3300/0 conn(0x7f44c40acff0 0x7f44c40af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/1649409002 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40b0fe0 0x7f44c40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- 172.21.2.137:0/1649409002 >> 172.21.2.137:0/1649409002 conn(0x7f44c40b5f50 msgr2=0x7f44c40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- 172.21.2.137:0/1649409002 shutdown_connections 2021-11-15T19:27:21.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- 172.21.2.137:0/1649409002 wait complete. 2021-11-15T19:27:21.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 Processor -- start 2021-11-15T19:27:21.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- start start 2021-11-15T19:27:21.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40acff0 0x7f44c405c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 0x7f44c4063d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44c413f5c0 0x7f44c4159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4067650 con 0x7f44c413f5c0 2021-11-15T19:27:21.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4066040 con 0x7f44c40b0fe0 2021-11-15T19:27:21.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.532+0000 7f44c8b2f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c410fe10 con 0x7f44c40acff0 2021-11-15T19:27:21.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 0x7f44c4063d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 0x7f44c4063d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60776/0 (socket says 172.21.2.137:60776) 2021-11-15T19:27:21.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 -- 172.21.2.137:0/259377890 learned_addr learned my addr 172.21.2.137:0/259377890 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 -- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40acff0 msgr2=0x7f44c405c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40acff0 0x7f44c405c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 -- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44c413f5c0 msgr2=0x7f44c4159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44c413f5c0 0x7f44c4159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 -- 172.21.2.137:0/259377890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b400b1e0 con 0x7f44c40b0fe0 2021-11-15T19:27:21.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c1d9b700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 0x7f44c4063d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f44bc003330 tx=0x7f44bc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44bc001710 con 0x7f44c40b0fe0 2021-11-15T19:27:21.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc001870 con 0x7f44c40b0fe0 2021-11-15T19:27:21.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c4065da0 con 0x7f44c40b0fe0 2021-11-15T19:27:21.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44bc001bd0 con 0x7f44c40b0fe0 2021-11-15T19:27:21.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c4067250 con 0x7f44c40b0fe0 2021-11-15T19:27:21.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c40ad690 con 0x7f44c40b0fe0 2021-11-15T19:27:21.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f44bc018030 con 0x7f44c40b0fe0 2021-11-15T19:27:21.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44b37fe700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44a00536f0 0x7f44a0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f44bc06b550 con 0x7f44c40b0fe0 2021-11-15T19:27:21.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c259c700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44a00536f0 0x7f44a0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.536+0000 7f44c259c700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44a00536f0 0x7f44a0055bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f44b8002fb0 tx=0x7f44b80069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.540+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44bc041e90 con 0x7f44c40b0fe0 2021-11-15T19:27:21.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.648+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f44c40573d0 con 0x7f44c40b0fe0 2021-11-15T19:27:21.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.660+0000 7f44b37fe700 1 -- 172.21.2.137:0/259377890 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f44bc0463b0 con 0x7f44c40b0fe0 2021-11-15T19:27:21.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44a00536f0 msgr2=0x7f44a0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44a00536f0 0x7f44a0055bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f44b8002fb0 tx=0x7f44b80069b0).stop 2021-11-15T19:27:21.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 msgr2=0x7f44c4063d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 0x7f44c4063d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f44bc003330 tx=0x7f44bc0091d0).stop 2021-11-15T19:27:21.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 shutdown_connections 2021-11-15T19:27:21.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44a00536f0 0x7f44a0055bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44c413f5c0 0x7f44c4159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44c40b0fe0 0x7f44c4063d60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 --2- 172.21.2.137:0/259377890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44c40acff0 0x7f44c405c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 >> 172.21.2.137:0/259377890 conn(0x7f44c40b5f50 msgr2=0x7f44c40b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 shutdown_connections 2021-11-15T19:27:21.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.664+0000 7f44c8b2f700 1 -- 172.21.2.137:0/259377890 wait complete. 2021-11-15T19:27:21.676 INFO:teuthology.orchestra.run.gibba037.stderr:updated 2021-11-15T19:27:21.678 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:21.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.720+0000 7fab59865700 1 Processor -- start 2021-11-15T19:27:21.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.720+0000 7fab59865700 1 -- start start 2021-11-15T19:27:21.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fab540b1340 0x7fab54147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 0x7fab540aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab54148190 con 0x7fab54143f00 2021-11-15T19:27:21.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540b1720 con 0x7fab540b1340 2021-11-15T19:27:21.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab54147e70 con 0x7fab540a9f50 2021-11-15T19:27:21.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab52ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fab540b1340 0x7fab54147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 0x7fab540aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab52ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fab540b1340 0x7fab54147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:39776/0 (socket says 172.21.2.137:39776) 2021-11-15T19:27:21.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 0x7fab540aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:34122/0 (socket says 172.21.2.137:34122) 2021-11-15T19:27:21.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab52ffd700 1 -- 172.21.2.137:0/1835355042 learned_addr learned my addr 172.21.2.137:0/1835355042 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab527fc700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fab54143f00 0x7fab54144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:43822/0 (socket says 172.21.2.137:43822) 2021-11-15T19:27:21.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 -- 172.21.2.137:0/1835355042 >> v2:172.21.2.111:3300/0 conn(0x7fab540b1340 msgr2=0x7fab54147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 --2- 172.21.2.137:0/1835355042 >> v2:172.21.2.111:3300/0 conn(0x7fab540b1340 0x7fab54147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 -- 172.21.2.137:0/1835355042 >> v1:172.21.2.111:6789/0 conn(0x7fab54143f00 legacy=0x7fab54144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 -- 172.21.2.137:0/1835355042 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540af800 con 0x7fab540a9f50 2021-11-15T19:27:21.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab537fe700 1 --2- 172.21.2.137:0/1835355042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 0x7fab540aa3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fab4c0032f0 tx=0x7fab4c0091d0).ready entity=mon.2 client_cookie=44827a28923b5614 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab51ffb700 1 -- 172.21.2.137:0/1835355042 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4c00b6c0 con 0x7fab540a9f50 2021-11-15T19:27:21.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab51ffb700 1 -- 172.21.2.137:0/1835355042 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00b820 con 0x7fab540a9f50 2021-11-15T19:27:21.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab51ffb700 1 -- 172.21.2.137:0/1835355042 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4c00b990 con 0x7fab540a9f50 2021-11-15T19:27:21.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- 172.21.2.137:0/1835355042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 msgr2=0x7fab540aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 --2- 172.21.2.137:0/1835355042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 0x7fab540aa3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fab4c0032f0 tx=0x7fab4c0091d0).stop 2021-11-15T19:27:21.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- 172.21.2.137:0/1835355042 shutdown_connections 2021-11-15T19:27:21.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 --2- 172.21.2.137:0/1835355042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540a9f50 0x7fab540aa3a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 --2- 172.21.2.137:0/1835355042 >> v2:172.21.2.111:3300/0 conn(0x7fab540b1340 0x7fab54147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- 172.21.2.137:0/1835355042 >> 172.21.2.137:0/1835355042 conn(0x7fab540b4e60 msgr2=0x7fab540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- 172.21.2.137:0/1835355042 shutdown_connections 2021-11-15T19:27:21.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 -- 172.21.2.137:0/1835355042 wait complete. 2021-11-15T19:27:21.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.724+0000 7fab59865700 1 Processor -- start 2021-11-15T19:27:21.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- start start 2021-11-15T19:27:21.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 0x7fab54098090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540b1340 0x7fab54157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab54143f00 0x7fab54098ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540997c0 con 0x7fab54143f00 2021-11-15T19:27:21.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5409a840 con 0x7fab540a9f50 2021-11-15T19:27:21.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5414b410 con 0x7fab540b1340 2021-11-15T19:27:21.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 0x7fab54098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 0x7fab54098090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60788/0 (socket says 172.21.2.137:60788) 2021-11-15T19:27:21.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 -- 172.21.2.137:0/1258152212 learned_addr learned my addr 172.21.2.137:0/1258152212 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab527fc700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540b1340 0x7fab54157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab537fe700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab54143f00 0x7fab54098ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 -- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540b1340 msgr2=0x7fab54157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540b1340 0x7fab54157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 -- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab54143f00 msgr2=0x7fab54098ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab54143f00 0x7fab54098ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 -- 172.21.2.137:0/1258152212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c009470 con 0x7fab540a9f50 2021-11-15T19:27:21.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab52ffd700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 0x7fab54098090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fab4400c000 tx=0x7fab44008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44013610 con 0x7fab540a9f50 2021-11-15T19:27:21.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44013770 con 0x7fab540a9f50 2021-11-15T19:27:21.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5409aa70 con 0x7fab540a9f50 2021-11-15T19:27:21.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44013ad0 con 0x7fab540a9f50 2021-11-15T19:27:21.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5413f740 con 0x7fab540a9f50 2021-11-15T19:27:21.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5405faf0 con 0x7fab540a9f50 2021-11-15T19:27:21.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab44013c30 con 0x7fab540a9f50 2021-11-15T19:27:21.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab43fff700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab30053610 0x7fab30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fab4406b400 con 0x7fab540a9f50 2021-11-15T19:27:21.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab527fc700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab30053610 0x7fab30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.728+0000 7fab527fc700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab30053610 0x7fab30055ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fab4800d000 tx=0x7fab48009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.732+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab44042890 con 0x7fab540a9f50 2021-11-15T19:27:21.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.816+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab54099230 con 0x7fab540a9f50 2021-11-15T19:27:21.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.816+0000 7fab43fff700 1 -- 172.21.2.137:0/1258152212 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+13181 (secure 0 0 0) 0x7fab44045eb0 con 0x7fab540a9f50 2021-11-15T19:27:21.825 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:21.825 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":25,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:27:20.284791+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:21.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab30053610 msgr2=0x7fab30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab30053610 0x7fab30055ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fab4800d000 tx=0x7fab48009040).stop 2021-11-15T19:27:21.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 msgr2=0x7fab54098090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 0x7fab54098090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fab4400c000 tx=0x7fab44008040).stop 2021-11-15T19:27:21.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 shutdown_connections 2021-11-15T19:27:21.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab30053610 0x7fab30055ad0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab54143f00 0x7fab54098ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab540b1340 0x7fab54157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 --2- 172.21.2.137:0/1258152212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab540a9f50 0x7fab54098090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 >> 172.21.2.137:0/1258152212 conn(0x7fab540b4e60 msgr2=0x7fab540b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 shutdown_connections 2021-11-15T19:27:21.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.820+0000 7fab59865700 1 -- 172.21.2.137:0/1258152212 wait complete. 2021-11-15T19:27:21.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:27:21.833 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:21.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 Processor -- start 2021-11-15T19:27:21.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 -- start start 2021-11-15T19:27:21.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0c9c05c770 0x7f0c9c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 0x7f0c9c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c05cb50 con 0x7f0c9c14aaa0 2021-11-15T19:27:21.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0b1650 con 0x7f0c9c05c770 2021-11-15T19:27:21.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0ca1839700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0ad030 con 0x7f0c9c0b0550 2021-11-15T19:27:21.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0c9c14aaa0 0x7f0c9c140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51344/0 (socket says 172.21.2.137:51344) 2021-11-15T19:27:21.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 -- 172.21.2.137:0/1669848137 learned_addr learned my addr 172.21.2.137:0/1669848137 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:21.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9affd700 1 --2- 172.21.2.137:0/1669848137 >> v2:172.21.2.111:3300/0 conn(0x7f0c9c05c770 0x7f0c9c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9a7fc700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 0x7f0c9c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344707370 0 0) 0x7f0c9c05cb50 con 0x7f0c9c14aaa0 2021-11-15T19:27:21.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c7c003260 con 0x7f0c9c14aaa0 2021-11-15T19:27:21.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198373711 0 0) 0x7f0c7c003260 con 0x7f0c9c14aaa0 2021-11-15T19:27:21.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 msgr2=0x7f0c9c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 0x7f0c9c14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 >> v2:172.21.2.111:3300/0 conn(0x7f0c9c05c770 msgr2=0x7f0c9c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 --2- 172.21.2.137:0/1669848137 >> v2:172.21.2.111:3300/0 conn(0x7f0c9c05c770 0x7f0c9c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:21.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0ad2d0 con 0x7f0c9c14aaa0 2021-11-15T19:27:21.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f0c940019e0 con 0x7f0c9c14aaa0 2021-11-15T19:27:21.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 >> v1:172.21.2.137:6789/0 conn(0x7f0c9c14aaa0 legacy=0x7f0c9c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 0x7f0c7c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c003d50 0x7f0c7c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c7c0049f0 0x7f0c7c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0b1650 con 0x7f0c7c003d50 2021-11-15T19:27:21.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0ad030 con 0x7f0c7c0049f0 2021-11-15T19:27:21.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c00b780 con 0x7f0c9c0b0550 2021-11-15T19:27:21.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c7c0049f0 0x7f0c7c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 -- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 msgr2=0x7f0c7c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c0b0550 0x7f0c7c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 -- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c003d50 msgr2=0x7f0c7c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:21.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c003d50 0x7f0c7c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.928+0000 7f0c9b7fe700 1 -- 172.21.2.137:0/1669848137 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c003260 con 0x7f0c7c0049f0 2021-11-15T19:27:21.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9b7fe700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c7c0049f0 0x7f0c7c004e70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f0c940016f0 tx=0x7f0c94002100).ready entity=mon.1 client_cookie=eec541337565fa71 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c9400cbb0 con 0x7f0c7c0049f0 2021-11-15T19:27:21.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9400cd10 con 0x7f0c7c0049f0 2021-11-15T19:27:21.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c99ffb700 1 -- 172.21.2.137:0/1669848137 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c94005b80 con 0x7f0c7c0049f0 2021-11-15T19:27:21.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/1669848137 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c7c0049f0 msgr2=0x7f0c7c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 --2- 172.21.2.137:0/1669848137 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c7c0049f0 0x7f0c7c004e70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f0c940016f0 tx=0x7f0c94002100).stop 2021-11-15T19:27:21.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9b7fe700 1 -- 172.21.2.137:0/1669848137 reap_dead start 2021-11-15T19:27:21.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/1669848137 shutdown_connections 2021-11-15T19:27:21.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/1669848137 >> 172.21.2.137:0/1669848137 conn(0x7f0c9c0631e0 msgr2=0x7f0c9c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:21.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/1669848137 shutdown_connections 2021-11-15T19:27:21.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/1669848137 wait complete. 2021-11-15T19:27:21.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 Processor -- start 2021-11-15T19:27:21.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- start start 2021-11-15T19:27:21.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c0049f0 0x7f0c9c148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 0x7f0c9c117380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c142cc0 0x7f0c9c143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c066960 con 0x7f0c7c0049f0 2021-11-15T19:27:21.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c065f80 con 0x7f0c9c0658f0 2021-11-15T19:27:21.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c066220 con 0x7f0c9c142cc0 2021-11-15T19:27:21.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 0x7f0c9c117380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 0x7f0c9c117380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60806/0 (socket says 172.21.2.137:60806) 2021-11-15T19:27:21.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 -- 172.21.2.137:0/516644092 learned_addr learned my addr 172.21.2.137:0/516644092 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:21.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 -- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c142cc0 msgr2=0x7f0c9c143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c142cc0 0x7f0c9c143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 -- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c0049f0 msgr2=0x7f0c9c148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:21.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c0049f0 0x7f0c9c148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:21.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 -- 172.21.2.137:0/516644092 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0664c0 con 0x7f0c9c0658f0 2021-11-15T19:27:21.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c9a7fc700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 0x7f0c9c117380 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f0c8400c000 tx=0x7f0c84006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c84016070 con 0x7f0c9c0658f0 2021-11-15T19:27:21.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c84000e90 con 0x7f0c9c0658f0 2021-11-15T19:27:21.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c84010970 con 0x7f0c9c0658f0 2021-11-15T19:27:21.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c143630 con 0x7f0c9c0658f0 2021-11-15T19:27:21.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c143940 con 0x7f0c9c0658f0 2021-11-15T19:27:21.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.932+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c066650 con 0x7f0c9c0658f0 2021-11-15T19:27:21.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.936+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c84010ad0 con 0x7f0c9c0658f0 2021-11-15T19:27:21.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.936+0000 7f0c93fff700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c800536f0 0x7f0c80055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:21.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.936+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0c8406b840 con 0x7f0c9c0658f0 2021-11-15T19:27:21.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.936+0000 7f0c9affd700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c800536f0 0x7f0c80055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:21.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.936+0000 7f0c9affd700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c800536f0 0x7f0c80055bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f0c8c00c000 tx=0x7f0c8c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:21.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:21.936+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c84042bc0 con 0x7f0c9c0658f0 2021-11-15T19:27:22.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.020+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c9c0ae7f0 con 0x7f0c9c0658f0 2021-11-15T19:27:22.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.020+0000 7f0c93fff700 1 -- 172.21.2.137:0/516644092 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c840461e0 con 0x7f0c9c0658f0 2021-11-15T19:27:22.028 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:22.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c800536f0 msgr2=0x7f0c80055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c800536f0 0x7f0c80055bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f0c8c00c000 tx=0x7f0c8c006df0).stop 2021-11-15T19:27:22.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 msgr2=0x7f0c9c117380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 0x7f0c9c117380 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f0c8400c000 tx=0x7f0c84006df0).stop 2021-11-15T19:27:22.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 shutdown_connections 2021-11-15T19:27:22.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c800536f0 0x7f0c80055bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c9c142cc0 0x7f0c9c143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c9c0658f0 0x7f0c9c117380 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 --2- 172.21.2.137:0/516644092 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c7c0049f0 0x7f0c9c148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 >> 172.21.2.137:0/516644092 conn(0x7f0c9c0631e0 msgr2=0x7f0c9c0b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:22.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 shutdown_connections 2021-11-15T19:27:22.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.024+0000 7f0ca1839700 1 -- 172.21.2.137:0/516644092 wait complete. 2021-11-15T19:27:22.036 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:22.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f850604e700 1 Processor -- start 2021-11-15T19:27:22.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f850604e700 1 -- start start 2021-11-15T19:27:22.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f850604e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85000acff0 0x7f850013c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f850604e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000aedf0 con 0x7f85000afde0 2021-11-15T19:27:22.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f850604e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000afbd0 con 0x7f85000b0fe0 2021-11-15T19:27:22.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f850604e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000ae070 con 0x7f85000acff0 2021-11-15T19:27:22.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f84ff7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f85000b0fe0 0x7f85000af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51364/0 (socket says 172.21.2.137:51364) 2021-11-15T19:27:22.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f84ff7fe700 1 -- 172.21.2.137:0/2019975685 learned_addr learned my addr 172.21.2.137:0/2019975685 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.080+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256796172 0 0) 0x7f85000afbd0 con 0x7f85000b0fe0 2021-11-15T19:27:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e0003260 con 0x7f85000b0fe0 2021-11-15T19:27:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476383550 0 0) 0x7f84e0003260 con 0x7f85000b0fe0 2021-11-15T19:27:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85000acff0 msgr2=0x7f850013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85000acff0 0x7f850013c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 >> v1:172.21.2.111:6789/0 conn(0x7f85000afde0 legacy=0x7f850013f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000ad440 con 0x7f85000b0fe0 2021-11-15T19:27:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f84e8001660 con 0x7f85000b0fe0 2021-11-15T19:27:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 >> v1:172.21.2.137:6789/0 conn(0x7f85000b0fe0 legacy=0x7f85000af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84e00037d0 0x7f84e0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85000acff0 0x7f84e0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e0004b40 0x7f84e0004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000ae070 con 0x7f84e0004b40 2021-11-15T19:27:22.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0005720 con 0x7f84e00037d0 2021-11-15T19:27:22.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00058e0 con 0x7f85000acff0 2021-11-15T19:27:22.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84e00037d0 0x7f84e0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 -- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85000acff0 msgr2=0x7f84e0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85000acff0 0x7f84e0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 -- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e0004b40 msgr2=0x7f84e0004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e0004b40 0x7f84e0004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 -- 172.21.2.137:0/2019975685 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0003260 con 0x7f84e00037d0 2021-11-15T19:27:22.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84e00037d0 0x7f84e0003bd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f85000b04d0 tx=0x7f84e8001d60).ready entity=mon.1 client_cookie=b5a6a675495d05fc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e80070d0 con 0x7f84e00037d0 2021-11-15T19:27:22.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e8007230 con 0x7f84e00037d0 2021-11-15T19:27:22.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fe7fc700 1 -- 172.21.2.137:0/2019975685 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e800c8f0 con 0x7f84e00037d0 2021-11-15T19:27:22.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2019975685 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84e00037d0 msgr2=0x7f84e0003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 --2- 172.21.2.137:0/2019975685 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84e00037d0 0x7f84e0003bd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f85000b04d0 tx=0x7f84e8001d60).stop 2021-11-15T19:27:22.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 -- 172.21.2.137:0/2019975685 reap_dead start 2021-11-15T19:27:22.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2019975685 shutdown_connections 2021-11-15T19:27:22.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2019975685 >> 172.21.2.137:0/2019975685 conn(0x7f85000b5f50 msgr2=0x7f85000b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:22.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2019975685 shutdown_connections 2021-11-15T19:27:22.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2019975685 wait complete. 2021-11-15T19:27:22.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 Processor -- start 2021-11-15T19:27:22.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- start start 2021-11-15T19:27:22.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e00037d0 0x7f85000673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85001346d0 0x7f8500065ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 0x7f850014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500066a00 con 0x7f84e00037d0 2021-11-15T19:27:22.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500066ca0 con 0x7f850014db80 2021-11-15T19:27:22.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8500066f40 con 0x7f85001346d0 2021-11-15T19:27:22.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 0x7f850014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 0x7f850014e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60828/0 (socket says 172.21.2.137:60828) 2021-11-15T19:27:22.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 -- 172.21.2.137:0/2836168 learned_addr learned my addr 172.21.2.137:0/2836168 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:22.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e00037d0 0x7f85000673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 -- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85001346d0 msgr2=0x7f8500065ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85001346d0 0x7f8500065ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 -- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e00037d0 msgr2=0x7f85000673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e00037d0 0x7f85000673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 -- 172.21.2.137:0/2836168 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000663e0 con 0x7f850014db80 2021-11-15T19:27:22.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fffff700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 0x7f850014e000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f84e8001370 tx=0x7f84f800a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f800cea0 con 0x7f850014db80 2021-11-15T19:27:22.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8005c30 con 0x7f850014db80 2021-11-15T19:27:22.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850014e4f0 con 0x7f850014db80 2021-11-15T19:27:22.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f8007070 con 0x7f850014db80 2021-11-15T19:27:22.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.084+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85001512f0 con 0x7f850014db80 2021-11-15T19:27:22.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8500067100 con 0x7f850014db80 2021-11-15T19:27:22.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f84f801b060 con 0x7f850014db80 2021-11-15T19:27:22.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f84fcff9700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84e40535b0 0x7f84e4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f84f806ae00 con 0x7f850014db80 2021-11-15T19:27:22.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84e40535b0 0x7f84e4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f84ff7fe700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84e40535b0 0x7f84e4055a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f84e8016000 tx=0x7f84e8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.088+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84f8042180 con 0x7f850014db80 2021-11-15T19:27:22.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.172+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85000573d0 con 0x7f850014db80 2021-11-15T19:27:22.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.172+0000 7f84fcff9700 1 -- 172.21.2.137:0/2836168 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84f8019030 con 0x7f850014db80 2021-11-15T19:27:22.180 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:22.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84e40535b0 msgr2=0x7f84e4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84e40535b0 0x7f84e4055a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f84e8016000 tx=0x7f84e8015000).stop 2021-11-15T19:27:22.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 msgr2=0x7f850014e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 0x7f850014e000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f84e8001370 tx=0x7f84f800a060).stop 2021-11-15T19:27:22.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 shutdown_connections 2021-11-15T19:27:22.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84e40535b0 0x7f84e4055a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f850014db80 0x7f850014e000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85001346d0 0x7f8500065ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 --2- 172.21.2.137:0/2836168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84e00037d0 0x7f85000673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 >> 172.21.2.137:0/2836168 conn(0x7f85000b5f50 msgr2=0x7f850013cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:22.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 shutdown_connections 2021-11-15T19:27:22.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.176+0000 7f850604e700 1 -- 172.21.2.137:0/2836168 wait complete. 2021-11-15T19:27:22.187 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:27:22.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 Processor -- start 2021-11-15T19:27:22.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 -- start start 2021-11-15T19:27:22.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d4144610 0x7f90d4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d4148190 con 0x7f90d40b1340 2021-11-15T19:27:22.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40b1720 con 0x7f90d40a9f50 2021-11-15T19:27:22.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4147e70 con 0x7f90d4144610 2021-11-15T19:27:22.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90daa4b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f90d40a9f50 0x7f90d40aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51384/0 (socket says 172.21.2.137:51384) 2021-11-15T19:27:22.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90daa4b700 1 -- 172.21.2.137:0/1061637622 learned_addr learned my addr 172.21.2.137:0/1061637622 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:22.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269043929 0 0) 0x7f90d40b1720 con 0x7f90d40a9f50 2021-11-15T19:27:22.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90bc003260 con 0x7f90d40a9f50 2021-11-15T19:27:22.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 204396030 0 0) 0x7f90bc003260 con 0x7f90d40a9f50 2021-11-15T19:27:22.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d4144610 msgr2=0x7f90d4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d4144610 0x7f90d4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 >> v1:172.21.2.111:6789/0 conn(0x7f90d40b1340 legacy=0x7f90d4143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40af800 con 0x7f90d40a9f50 2021-11-15T19:27:22.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f90cc0019e0 con 0x7f90d40a9f50 2021-11-15T19:27:22.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 >> v1:172.21.2.137:6789/0 conn(0x7f90d40a9f50 legacy=0x7f90d40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90bc0037d0 0x7f90bc003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc004500 0x7f90bc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d4144610 0x7f90bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4147e70 con 0x7f90bc004500 2021-11-15T19:27:22.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0052e0 con 0x7f90bc0037d0 2021-11-15T19:27:22.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00bc40 con 0x7f90d4144610 2021-11-15T19:27:22.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90bc0037d0 0x7f90bc003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 -- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d4144610 msgr2=0x7f90bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d4144610 0x7f90bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 -- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc004500 msgr2=0x7f90bc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc004500 0x7f90bc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 -- 172.21.2.137:0/1061637622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc003260 con 0x7f90bc0037d0 2021-11-15T19:27:22.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90da24a700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90bc0037d0 0x7f90bc003bd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f90c8000f70 tx=0x7f90c80079e0).ready entity=mon.1 client_cookie=2cd6710bb1d6411d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c8007cf0 con 0x7f90bc0037d0 2021-11-15T19:27:22.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8014410 con 0x7f90bc0037d0 2021-11-15T19:27:22.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90d9248700 1 -- 172.21.2.137:0/1061637622 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c8014770 con 0x7f90bc0037d0 2021-11-15T19:27:22.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1061637622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90bc0037d0 msgr2=0x7f90bc003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1061637622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90bc0037d0 0x7f90bc003bd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f90c8000f70 tx=0x7f90c80079e0).stop 2021-11-15T19:27:22.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.232+0000 7f90daa4b700 1 -- 172.21.2.137:0/1061637622 reap_dead start 2021-11-15T19:27:22.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1061637622 shutdown_connections 2021-11-15T19:27:22.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1061637622 >> 172.21.2.137:0/1061637622 conn(0x7f90d40b4e60 msgr2=0x7f90d40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:22.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1061637622 shutdown_connections 2021-11-15T19:27:22.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1061637622 wait complete. 2021-11-15T19:27:22.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 Processor -- start 2021-11-15T19:27:22.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- start start 2021-11-15T19:27:22.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc0037d0 0x7f90d413ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d40995d0 0x7f90d40983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 0x7f90d40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40af240 con 0x7f90bc0037d0 2021-11-15T19:27:22.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40ac920 con 0x7f90d4098890 2021-11-15T19:27:22.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40acb50 con 0x7f90d40995d0 2021-11-15T19:27:22.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 0x7f90d40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 0x7f90d40ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60846/0 (socket says 172.21.2.137:60846) 2021-11-15T19:27:22.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 -- 172.21.2.137:0/1438972051 learned_addr learned my addr 172.21.2.137:0/1438972051 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:22.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 -- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d40995d0 msgr2=0x7f90d40983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d40995d0 0x7f90d40983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 -- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc0037d0 msgr2=0x7f90d413ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc0037d0 0x7f90d413ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 -- 172.21.2.137:0/1438972051 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40ac2a0 con 0x7f90d4098890 2021-11-15T19:27:22.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90daa4b700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 0x7f90d40ae340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f90d40adb20 tx=0x7f90d40abfb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90cc004ab0 con 0x7f90d4098890 2021-11-15T19:27:22.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc004c10 con 0x7f90d4098890 2021-11-15T19:27:22.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40ac540 con 0x7f90d4098890 2021-11-15T19:27:22.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d4097df0 con 0x7f90d4098890 2021-11-15T19:27:22.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90cc0070d0 con 0x7f90d4098890 2021-11-15T19:27:22.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d405faf0 con 0x7f90d4098890 2021-11-15T19:27:22.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f90cc01b070 con 0x7f90d4098890 2021-11-15T19:27:22.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90c77fe700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90b40536f0 0x7f90b4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f90cc06ae40 con 0x7f90d4098890 2021-11-15T19:27:22.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.236+0000 7f90da24a700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90b40536f0 0x7f90b4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.240+0000 7f90da24a700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90b40536f0 0x7f90b4055bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f90c8000f70 tx=0x7f90c8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.240+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90cc042160 con 0x7f90d4098890 2021-11-15T19:27:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.324+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90d40ae050 con 0x7f90d4098890 2021-11-15T19:27:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.324+0000 7f90c77fe700 1 -- 172.21.2.137:0/1438972051 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v25) v1 ==== 84+0+143 (secure 0 0 0) 0x7f90cc045780 con 0x7f90d4098890 2021-11-15T19:27:22.332 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:22.332 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:27:22.333 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:22.333 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:27:22.333 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:27:22.333 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:27:22.333 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:27:22.334 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:27:22.334 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:27:22.334 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:27:22.334 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:27:22.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90b40536f0 msgr2=0x7f90b4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90b40536f0 0x7f90b4055bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f90c8000f70 tx=0x7f90c8015000).stop 2021-11-15T19:27:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 msgr2=0x7f90d40ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 0x7f90d40ae340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f90d40adb20 tx=0x7f90d40abfb0).stop 2021-11-15T19:27:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 shutdown_connections 2021-11-15T19:27:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90b40536f0 0x7f90b4055bb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d4098890 0x7f90d40ae340 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d40995d0 0x7f90d40983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 --2- 172.21.2.137:0/1438972051 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90bc0037d0 0x7f90d413ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 >> 172.21.2.137:0/1438972051 conn(0x7f90d40b4e60 msgr2=0x7f90d40aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:22.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 shutdown_connections 2021-11-15T19:27:22.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.328+0000 7f90dc4ae700 1 -- 172.21.2.137:0/1438972051 wait complete. 2021-11-15T19:27:22.339 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:27:22.339 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:27:22.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 Processor -- start 2021-11-15T19:27:22.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 -- start start 2021-11-15T19:27:22.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe35c065730 0x7fe35c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c0b00a0 0x7fe35c05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c066270 con 0x7fe35c065b10 2021-11-15T19:27:22.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c067410 con 0x7fe35c065730 2021-11-15T19:27:22.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe361e4e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c065fd0 con 0x7fe35c0b00a0 2021-11-15T19:27:22.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe35b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe35c065730 0x7fe35c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe35affd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe35c065b10 0x7fe35c13c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51408/0 (socket says 172.21.2.137:51408) 2021-11-15T19:27:22.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.384+0000 7fe35affd700 1 -- 172.21.2.137:0/3627311877 learned_addr learned my addr 172.21.2.137:0/3627311877 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:22.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35b7fe700 1 -- 172.21.2.137:0/3627311877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c0b00a0 msgr2=0x7fe35c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:22.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35b7fe700 1 --2- 172.21.2.137:0/3627311877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c0b00a0 0x7fe35c05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35b7fe700 1 -- 172.21.2.137:0/3627311877 >> v1:172.21.2.137:6789/0 conn(0x7fe35c065b10 legacy=0x7fe35c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35b7fe700 1 -- 172.21.2.137:0/3627311877 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c066f70 con 0x7fe35c065730 2021-11-15T19:27:22.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35b7fe700 1 --2- 172.21.2.137:0/3627311877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c065730 0x7fe35c13c2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fe34c002f70 tx=0x7fe34c006df0).ready entity=mon.1 client_cookie=26d8465fe68822e5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35a7fc700 1 -- 172.21.2.137:0/3627311877 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe34c00f970 con 0x7fe35c065730 2021-11-15T19:27:22.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35a7fc700 1 -- 172.21.2.137:0/3627311877 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c000e90 con 0x7fe35c065730 2021-11-15T19:27:22.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35a7fc700 1 -- 172.21.2.137:0/3627311877 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe34c00fcc0 con 0x7fe35c065730 2021-11-15T19:27:22.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/3627311877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c065730 msgr2=0x7fe35c13c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 --2- 172.21.2.137:0/3627311877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c065730 0x7fe35c13c2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fe34c002f70 tx=0x7fe34c006df0).stop 2021-11-15T19:27:22.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/3627311877 shutdown_connections 2021-11-15T19:27:22.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 --2- 172.21.2.137:0/3627311877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c0b00a0 0x7fe35c05bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 --2- 172.21.2.137:0/3627311877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c065730 0x7fe35c13c2b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:22.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/3627311877 >> 172.21.2.137:0/3627311877 conn(0x7fe35c060290 msgr2=0x7fe35c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:22.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/3627311877 shutdown_connections 2021-11-15T19:27:22.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/3627311877 wait complete. 2021-11-15T19:27:22.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 Processor -- start 2021-11-15T19:27:22.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- start start 2021-11-15T19:27:22.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c065730 0x7fe35c0ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe35c065b10 0x7fe35c0b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 0x7fe35c0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c142b30 con 0x7fe35c065b10 2021-11-15T19:27:22.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0b3530 con 0x7fe35c0b00a0 2021-11-15T19:27:22.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0b6300 con 0x7fe35c065730 2021-11-15T19:27:22.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 0x7fe35c0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 0x7fe35c0b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60862/0 (socket says 172.21.2.137:60862) 2021-11-15T19:27:22.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 -- 172.21.2.137:0/2123482955 learned_addr learned my addr 172.21.2.137:0/2123482955 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:22.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 -- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c065730 msgr2=0x7fe35c0ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c065730 0x7fe35c0ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 -- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe35c065b10 msgr2=0x7fe35c0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:22.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe35c065b10 0x7fe35c0b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:22.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 -- 172.21.2.137:0/2123482955 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c00b180 con 0x7fe35c0b00a0 2021-11-15T19:27:22.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe35bfff700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 0x7fe35c0b4c90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fe3540032f0 tx=0x7fe3540091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe35400d4a0 con 0x7fe35c0b00a0 2021-11-15T19:27:22.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35400d600 con 0x7fe35c0b00a0 2021-11-15T19:27:22.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c138d40 con 0x7fe35c0b00a0 2021-11-15T19:27:22.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c0b5180 con 0x7fe35c0b00a0 2021-11-15T19:27:22.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe35400d960 con 0x7fe35c0b00a0 2021-11-15T19:27:22.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c0b0fb0 con 0x7fe35c0b00a0 2021-11-15T19:27:22.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.388+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe354018030 con 0x7fe35c0b00a0 2021-11-15T19:27:22.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.392+0000 7fe358ff9700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe340053660 0x7fe340055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:22.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.392+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe35406b1d0 con 0x7fe35c0b00a0 2021-11-15T19:27:22.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.392+0000 7fe35b7fe700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe340053660 0x7fe340055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:22.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.392+0000 7fe35b7fe700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe340053660 0x7fe340055b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe34c002f70 tx=0x7fe34c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:22.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.392+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe354042550 con 0x7fe35c0b00a0 2021-11-15T19:27:22.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:22.476+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe35c0b64c0 con 0x7fe35c0b00a0 2021-11-15T19:27:23.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe358ff9700 1 -- 172.21.2.137:0/2123482955 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v26) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe35c0b64c0 con 0x7fe35c0b00a0 2021-11-15T19:27:23.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe340053660 msgr2=0x7fe340055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:23.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe340053660 0x7fe340055b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe34c002f70 tx=0x7fe34c017000).stop 2021-11-15T19:27:23.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 msgr2=0x7fe35c0b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:23.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 0x7fe35c0b4c90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fe3540032f0 tx=0x7fe3540091a0).stop 2021-11-15T19:27:23.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 shutdown_connections 2021-11-15T19:27:23.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe340053660 0x7fe340055b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:23.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe35c0b00a0 0x7fe35c0b4c90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:23.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe35c065b10 0x7fe35c0b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:23.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 --2- 172.21.2.137:0/2123482955 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe35c065730 0x7fe35c0ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:23.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 >> 172.21.2.137:0/2123482955 conn(0x7fe35c060290 msgr2=0x7fe35c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:23.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 shutdown_connections 2021-11-15T19:27:23.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.320+0000 7fe361e4e700 1 -- 172.21.2.137:0/2123482955 wait complete. 2021-11-15T19:27:23.329 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:27:23.333 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:27:23.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20f0cf4700 1 Processor -- start 2021-11-15T19:27:23.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20f0cf4700 1 -- start start 2021-11-15T19:27:23.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20f0cf4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f20ec14b670 0x7f20ec14da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:23.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20f0cf4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0b76c0 con 0x7f20ec0b72e0 2021-11-15T19:27:23.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20f0cf4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0b3de0 con 0x7f20ec0631f0 2021-11-15T19:27:23.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20f0cf4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec0b4080 con 0x7f20ec14b670 2021-11-15T19:27:23.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20ead9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f20ec14b670 0x7f20ec14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:23.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20e9d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f20ec0631f0 0x7f20ec0b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51420/0 (socket says 172.21.2.137:51420) 2021-11-15T19:27:23.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.380+0000 7f20e9d9b700 1 -- 172.21.2.137:0/1528038384 learned_addr learned my addr 172.21.2.137:0/1528038384 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:23.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ead9d700 1 -- 172.21.2.137:0/1528038384 >> v1:172.21.2.137:6789/0 conn(0x7f20ec0631f0 legacy=0x7f20ec0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:23.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ead9d700 1 -- 172.21.2.137:0/1528038384 >> v1:172.21.2.111:6789/0 conn(0x7f20ec0b72e0 legacy=0x7f20ec0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:23.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ead9d700 1 -- 172.21.2.137:0/1528038384 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0b4320 con 0x7f20ec14b670 2021-11-15T19:27:23.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ead9d700 1 --2- 172.21.2.137:0/1528038384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec14b670 0x7f20ec14da60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f20ec060010 tx=0x7f20dc006df0).ready entity=mon.1 client_cookie=cd88758dbd9cc6b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:23.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20e959a700 1 -- 172.21.2.137:0/1528038384 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc00d5c0 con 0x7f20ec14b670 2021-11-15T19:27:23.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20e959a700 1 -- 172.21.2.137:0/1528038384 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc000e90 con 0x7f20ec14b670 2021-11-15T19:27:23.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20e959a700 1 -- 172.21.2.137:0/1528038384 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc00d910 con 0x7f20ec14b670 2021-11-15T19:27:23.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/1528038384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec14b670 msgr2=0x7f20ec14da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:23.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/1528038384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec14b670 0x7f20ec14da60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f20ec060010 tx=0x7f20dc006df0).stop 2021-11-15T19:27:23.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/1528038384 shutdown_connections 2021-11-15T19:27:23.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/1528038384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec14b670 0x7f20ec14da60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:23.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/1528038384 >> 172.21.2.137:0/1528038384 conn(0x7f20ec064960 msgr2=0x7f20ec064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:23.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/1528038384 shutdown_connections 2021-11-15T19:27:23.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/1528038384 wait complete. 2021-11-15T19:27:23.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 Processor -- start 2021-11-15T19:27:23.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- start start 2021-11-15T19:27:23.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 0x7f20ec113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:23.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f20ec0b72e0 0x7f20ec113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:23.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f20ec14b670 0x7f20ec156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:23.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec156a60 con 0x7f20ec14b670 2021-11-15T19:27:23.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1140a0 con 0x7f20ec0631f0 2021-11-15T19:27:23.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec114340 con 0x7f20ec0b72e0 2021-11-15T19:27:23.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 0x7f20ec113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:23.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 0x7f20ec113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60874/0 (socket says 172.21.2.137:60874) 2021-11-15T19:27:23.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 -- 172.21.2.137:0/2524931872 learned_addr learned my addr 172.21.2.137:0/2524931872 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:23.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 -- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f20ec0b72e0 msgr2=0x7f20ec113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:23.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f20ec0b72e0 0x7f20ec113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:23.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 -- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f20ec14b670 msgr2=0x7f20ec156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:23.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f20ec14b670 0x7f20ec156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:23.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 -- 172.21.2.137:0/2524931872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc00b180 con 0x7f20ec0631f0 2021-11-15T19:27:23.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20ea59c700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 0x7f20ec113b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f20e4003310 tx=0x7f20e40091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:23.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20e40016f0 con 0x7f20ec0631f0 2021-11-15T19:27:23.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4001850 con 0x7f20ec0631f0 2021-11-15T19:27:23.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec159b70 con 0x7f20ec0631f0 2021-11-15T19:27:23.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20e4001bb0 con 0x7f20ec0631f0 2021-11-15T19:27:23.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec141fa0 con 0x7f20ec0631f0 2021-11-15T19:27:23.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec159d00 con 0x7f20ec0631f0 2021-11-15T19:27:23.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f20e4018030 con 0x7f20ec0631f0 2021-11-15T19:27:23.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20db7fe700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20c8053580 0x7f20c8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:23.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.384+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f20e406b5d0 con 0x7f20ec0631f0 2021-11-15T19:27:23.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.388+0000 7f20e9d9b700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20c8053580 0x7f20c8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:23.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.388+0000 7f20e9d9b700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20c8053580 0x7f20c8055a40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f20ec065450 tx=0x7f20e0007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:23.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.388+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20e4041e90 con 0x7f20ec0631f0 2021-11-15T19:27:23.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:23.476+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f20ec0573d0 con 0x7f20ec0631f0 2021-11-15T19:27:23.602 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:23.605 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:23.609 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:23.613 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:23.616 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:24.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.408+0000 7f20db7fe700 1 -- 172.21.2.137:0/2524931872 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v28) v1 ==== 125+0+0 (secure 0 0 0) 0x7f20e40463e0 con 0x7f20ec0631f0 2021-11-15T19:27:24.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20c8053580 msgr2=0x7f20c8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20c8053580 0x7f20c8055a40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f20ec065450 tx=0x7f20e0007800).stop 2021-11-15T19:27:24.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 msgr2=0x7f20ec113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 0x7f20ec113b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f20e4003310 tx=0x7f20e40091d0).stop 2021-11-15T19:27:24.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 shutdown_connections 2021-11-15T19:27:24.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20c8053580 0x7f20c8055a40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f20ec14b670 0x7f20ec156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f20ec0b72e0 0x7f20ec113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 --2- 172.21.2.137:0/2524931872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f20ec0631f0 0x7f20ec113b00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 >> 172.21.2.137:0/2524931872 conn(0x7f20ec064960 msgr2=0x7f20ec062790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 shutdown_connections 2021-11-15T19:27:24.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.412+0000 7f20f0cf4700 1 -- 172.21.2.137:0/2524931872 wait complete. 2021-11-15T19:27:24.420 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:27:24.430 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:27:24.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.476+0000 7f6f1ff6c700 1 Processor -- start 2021-11-15T19:27:24.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.476+0000 7f6f1ff6c700 1 -- start start 2021-11-15T19:27:24.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b5fd0 0x7f6f1813c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6f180b3c00 0x7f6f1813cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180b63b0 con 0x7f6f180b6830 2021-11-15T19:27:24.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1813d0d0 con 0x7f6f180b3c00 2021-11-15T19:27:24.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18147070 con 0x7f6f180b5fd0 2021-11-15T19:27:24.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6f180b3c00 0x7f6f1813cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6f180b3c00 0x7f6f1813cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60886/0 (socket says 172.21.2.137:60886) 2021-11-15T19:27:24.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 -- 172.21.2.137:0/1024703727 learned_addr learned my addr 172.21.2.137:0/1024703727 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 -- 172.21.2.137:0/1024703727 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b5fd0 msgr2=0x7f6f1813c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:24.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 --2- 172.21.2.137:0/1024703727 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b5fd0 0x7f6f1813c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 -- 172.21.2.137:0/1024703727 >> v1:172.21.2.111:6789/0 conn(0x7f6f180b6830 legacy=0x7f6f18142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:24.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 -- 172.21.2.137:0/1024703727 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18146dd0 con 0x7f6f180b3c00 2021-11-15T19:27:24.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1e509700 1 --2- 172.21.2.137:0/1024703727 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b3c00 0x7f6f1813cbe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6f180b65f0 tx=0x7f6f10009290).ready entity=mon.1 client_cookie=8a5f8143dec38323 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1cd06700 1 -- 172.21.2.137:0/1024703727 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1000b860 con 0x7f6f180b3c00 2021-11-15T19:27:24.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1cd06700 1 -- 172.21.2.137:0/1024703727 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1000b9c0 con 0x7f6f180b3c00 2021-11-15T19:27:24.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1cd06700 1 -- 172.21.2.137:0/1024703727 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1000bb70 con 0x7f6f180b3c00 2021-11-15T19:27:24.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/1024703727 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b3c00 msgr2=0x7f6f1813cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/1024703727 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b3c00 0x7f6f1813cbe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6f180b65f0 tx=0x7f6f10009290).stop 2021-11-15T19:27:24.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/1024703727 shutdown_connections 2021-11-15T19:27:24.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/1024703727 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b3c00 0x7f6f1813cbe0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/1024703727 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b5fd0 0x7f6f1813c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/1024703727 >> 172.21.2.137:0/1024703727 conn(0x7f6f180624b0 msgr2=0x7f6f18062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/1024703727 shutdown_connections 2021-11-15T19:27:24.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/1024703727 wait complete. 2021-11-15T19:27:24.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 Processor -- start 2021-11-15T19:27:24.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- start start 2021-11-15T19:27:24.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f180b3c00 0x7f6f1815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 0x7f6f18146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b6830 0x7f6f18156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18063a10 con 0x7f6f180b3c00 2021-11-15T19:27:24.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18159df0 con 0x7f6f180b5fd0 2021-11-15T19:27:24.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1815a090 con 0x7f6f180b6830 2021-11-15T19:27:24.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 0x7f6f18146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 0x7f6f18146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60890/0 (socket says 172.21.2.137:60890) 2021-11-15T19:27:24.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 -- 172.21.2.137:0/2134251875 learned_addr learned my addr 172.21.2.137:0/2134251875 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 -- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b6830 msgr2=0x7f6f18156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b6830 0x7f6f18156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 -- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f180b3c00 msgr2=0x7f6f1815a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f180b3c00 0x7f6f1815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 -- 172.21.2.137:0/2134251875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f10009530 con 0x7f6f180b5fd0 2021-11-15T19:27:24.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1d507700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 0x7f6f18146030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6f08002f10 tx=0x7f6f08006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f08009e00 con 0x7f6f180b5fd0 2021-11-15T19:27:24.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800f510 con 0x7f6f180b5fd0 2021-11-15T19:27:24.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f180aeb00 con 0x7f6f180b5fd0 2021-11-15T19:27:24.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0800f680 con 0x7f6f180b5fd0 2021-11-15T19:27:24.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.480+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1815aa20 con 0x7f6f180b5fd0 2021-11-15T19:27:24.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1815a250 con 0x7f6f180b5fd0 2021-11-15T19:27:24.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f0800f070 con 0x7f6f180b5fd0 2021-11-15T19:27:24.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f06ffd700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ef8053580 0x7f6ef8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f6f0806b150 con 0x7f6f180b5fd0 2021-11-15T19:27:24.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f1dd08700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ef8053580 0x7f6ef8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f1dd08700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ef8053580 0x7f6ef8055a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6f14002f70 tx=0x7f6f14006a70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.484+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f08042320 con 0x7f6f180b5fd0 2021-11-15T19:27:24.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.592+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6f18146af0 con 0x7f6f180b5fd0 2021-11-15T19:27:24.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f06ffd700 1 -- 172.21.2.137:0/2134251875 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v9) v1 ==== 187+0+0 (secure 0 0 0) 0x7f6f08045940 con 0x7f6f180b5fd0 2021-11-15T19:27:24.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ef8053580 msgr2=0x7f6ef8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ef8053580 0x7f6ef8055a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6f14002f70 tx=0x7f6f14006a70).stop 2021-11-15T19:27:24.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 msgr2=0x7f6f18146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 0x7f6f18146030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6f08002f10 tx=0x7f6f08006d60).stop 2021-11-15T19:27:24.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 shutdown_connections 2021-11-15T19:27:24.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ef8053580 0x7f6ef8055a40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f180b6830 0x7f6f18156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f180b5fd0 0x7f6f18146030 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 --2- 172.21.2.137:0/2134251875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f180b3c00 0x7f6f1815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 >> 172.21.2.137:0/2134251875 conn(0x7f6f180624b0 msgr2=0x7f6f180b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 shutdown_connections 2021-11-15T19:27:24.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.608+0000 7f6f1ff6c700 1 -- 172.21.2.137:0/2134251875 wait complete. 2021-11-15T19:27:24.618 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 5 and data pool 6 2021-11-15T19:27:24.622 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:24.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.664+0000 7f7ca509a700 1 Processor -- start 2021-11-15T19:27:24.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.664+0000 7f7ca509a700 1 -- start start 2021-11-15T19:27:24.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ca0144610 0x7f7ca0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca0148190 con 0x7f7ca00b1340 2021-11-15T19:27:24.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00b1720 con 0x7f7ca00a9f50 2021-11-15T19:27:24.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0147e70 con 0x7f7ca0144610 2021-11-15T19:27:24.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7ca00a9f50 0x7f7ca00aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51462/0 (socket says 172.21.2.137:51462) 2021-11-15T19:27:24.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 -- 172.21.2.137:0/1656998054 learned_addr learned my addr 172.21.2.137:0/1656998054 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:24.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9e59c700 1 --2- 172.21.2.137:0/1656998054 >> v2:172.21.2.137:3300/0 conn(0x7f7ca0144610 0x7f7ca0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9e59c700 1 -- 172.21.2.137:0/1656998054 >> v1:172.21.2.137:6789/0 conn(0x7f7ca00a9f50 legacy=0x7f7ca00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9e59c700 1 -- 172.21.2.137:0/1656998054 >> v1:172.21.2.111:6789/0 conn(0x7f7ca00b1340 legacy=0x7f7ca0143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:24.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9e59c700 1 -- 172.21.2.137:0/1656998054 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00af800 con 0x7f7ca0144610 2021-11-15T19:27:24.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9e59c700 1 --2- 172.21.2.137:0/1656998054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca0147980 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7ca0062250 tx=0x7f7c90006df0).ready entity=mon.1 client_cookie=b831681e869550a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9dd9b700 1 -- 172.21.2.137:0/1656998054 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9000d5c0 con 0x7f7ca0144610 2021-11-15T19:27:24.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9dd9b700 1 -- 172.21.2.137:0/1656998054 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90000e90 con 0x7f7ca0144610 2021-11-15T19:27:24.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9dd9b700 1 -- 172.21.2.137:0/1656998054 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9000d910 con 0x7f7ca0144610 2021-11-15T19:27:24.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/1656998054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 msgr2=0x7f7ca0147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 --2- 172.21.2.137:0/1656998054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca0147980 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7ca0062250 tx=0x7f7c90006df0).stop 2021-11-15T19:27:24.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/1656998054 shutdown_connections 2021-11-15T19:27:24.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 --2- 172.21.2.137:0/1656998054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca0147980 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/1656998054 >> 172.21.2.137:0/1656998054 conn(0x7f7ca00b4e60 msgr2=0x7f7ca00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/1656998054 shutdown_connections 2021-11-15T19:27:24.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/1656998054 wait complete. 2021-11-15T19:27:24.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 Processor -- start 2021-11-15T19:27:24.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- start start 2021-11-15T19:27:24.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ca00a9f50 0x7f7ca00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ca00b1340 0x7f7ca009a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca014a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00ac6b0 con 0x7f7ca00b1340 2021-11-15T19:27:24.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00ac950 con 0x7f7ca0144610 2021-11-15T19:27:24.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00ace90 con 0x7f7ca00a9f50 2021-11-15T19:27:24.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca014a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca014a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60920/0 (socket says 172.21.2.137:60920) 2021-11-15T19:27:24.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 -- 172.21.2.137:0/3535496562 learned_addr learned my addr 172.21.2.137:0/3535496562 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 -- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ca00a9f50 msgr2=0x7f7ca00aedb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:24.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ca00a9f50 0x7f7ca00aedb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 -- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ca00b1340 msgr2=0x7f7ca009a360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:24.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ca00b1340 0x7f7ca009a360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 -- 172.21.2.137:0/3535496562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9000b180 con 0x7f7ca0144610 2021-11-15T19:27:24.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c9f59e700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca014a6c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f7ca005cfa0 tx=0x7f7c98007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c98005ba0 con 0x7f7ca0144610 2021-11-15T19:27:24.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98005d00 con 0x7f7ca0144610 2021-11-15T19:27:24.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00ad330 con 0x7f7ca0144610 2021-11-15T19:27:24.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c980072c0 con 0x7f7ca0144610 2021-11-15T19:27:24.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00ad7d0 con 0x7f7ca0144610 2021-11-15T19:27:24.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca00ad050 con 0x7f7ca0144610 2021-11-15T19:27:24.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c9801a060 con 0x7f7ca0144610 2021-11-15T19:27:24.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.668+0000 7f7c97fff700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c840535b0 0x7f7c84055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.672+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7c9806b450 con 0x7f7ca0144610 2021-11-15T19:27:24.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.672+0000 7f7c9ed9d700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c840535b0 0x7f7c84055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.672+0000 7f7c9ed9d700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c840535b0 0x7f7c84055a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7c88002f90 tx=0x7f7c88006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.672+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c980425b0 con 0x7f7ca0144610 2021-11-15T19:27:24.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.756+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca005faf0 con 0x7f7ca0144610 2021-11-15T19:27:24.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.756+0000 7f7c97fff700 1 -- 172.21.2.137:0/3535496562 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f7c98018020 con 0x7f7ca0144610 2021-11-15T19:27:24.764 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:24.764 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":29,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:27:24.601741+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:27:22.499670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T19:27:23.496407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:24.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c840535b0 msgr2=0x7f7c84055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c840535b0 0x7f7c84055a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7c88002f90 tx=0x7f7c88006930).stop 2021-11-15T19:27:24.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 msgr2=0x7f7ca014a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca014a6c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f7ca005cfa0 tx=0x7f7c98007f40).stop 2021-11-15T19:27:24.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 shutdown_connections 2021-11-15T19:27:24.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c840535b0 0x7f7c84055a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ca0144610 0x7f7ca014a6c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ca00b1340 0x7f7ca009a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 --2- 172.21.2.137:0/3535496562 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ca00a9f50 0x7f7ca00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 >> 172.21.2.137:0/3535496562 conn(0x7f7ca00b4e60 msgr2=0x7f7ca00af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 shutdown_connections 2021-11-15T19:27:24.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.760+0000 7f7ca509a700 1 -- 172.21.2.137:0/3535496562 wait complete. 2021-11-15T19:27:24.771 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:24.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 Processor -- start 2021-11-15T19:27:24.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- start start 2021-11-15T19:27:24.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900608f0 0x7fc89013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc89005f730 0x7fc89005fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc890060070 con 0x7fc8900b1660 2021-11-15T19:27:24.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900ad6c0 con 0x7fc89005f730 2021-11-15T19:27:24.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900b0c80 con 0x7fc8900608f0 2021-11-15T19:27:24.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc89005f730 0x7fc89005fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc89005f730 0x7fc89005fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60924/0 (socket says 172.21.2.137:60924) 2021-11-15T19:27:24.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 -- 172.21.2.137:0/3100991186 learned_addr learned my addr 172.21.2.137:0/3100991186 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 -- 172.21.2.137:0/3100991186 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900608f0 msgr2=0x7fc89013f890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:24.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 --2- 172.21.2.137:0/3100991186 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900608f0 0x7fc89013f890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 -- 172.21.2.137:0/3100991186 >> v1:172.21.2.111:6789/0 conn(0x7fc8900b1660 legacy=0x7fc8900b2710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:24.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 -- 172.21.2.137:0/3100991186 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900b0f20 con 0x7fc89005f730 2021-11-15T19:27:24.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88f59e700 1 --2- 172.21.2.137:0/3100991186 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc89005fb80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fc8900b3ac0 tx=0x7fc88800b530).ready entity=mon.1 client_cookie=9fa116d193407dfd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88dd9b700 1 -- 172.21.2.137:0/3100991186 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88800be70 con 0x7fc89005f730 2021-11-15T19:27:24.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88dd9b700 1 -- 172.21.2.137:0/3100991186 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888010470 con 0x7fc89005f730 2021-11-15T19:27:24.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88dd9b700 1 -- 172.21.2.137:0/3100991186 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc888010810 con 0x7fc89005f730 2021-11-15T19:27:24.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- 172.21.2.137:0/3100991186 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 msgr2=0x7fc89005fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- 172.21.2.137:0/3100991186 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc89005fb80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fc8900b3ac0 tx=0x7fc88800b530).stop 2021-11-15T19:27:24.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- 172.21.2.137:0/3100991186 shutdown_connections 2021-11-15T19:27:24.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- 172.21.2.137:0/3100991186 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc89005fb80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- 172.21.2.137:0/3100991186 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900608f0 0x7fc89013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- 172.21.2.137:0/3100991186 >> 172.21.2.137:0/3100991186 conn(0x7fc890063980 msgr2=0x7fc890063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- 172.21.2.137:0/3100991186 shutdown_connections 2021-11-15T19:27:24.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- 172.21.2.137:0/3100991186 wait complete. 2021-11-15T19:27:24.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 Processor -- start 2021-11-15T19:27:24.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- start start 2021-11-15T19:27:24.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc890066db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8900608f0 0x7fc89013e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900b1660 0x7fc890159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89013e550 con 0x7fc8900608f0 2021-11-15T19:27:24.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89013a320 con 0x7fc89005f730 2021-11-15T19:27:24.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc8951ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89013a5c0 con 0x7fc8900b1660 2021-11-15T19:27:24.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc890066db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc890066db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60932/0 (socket says 172.21.2.137:60932) 2021-11-15T19:27:24.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 -- 172.21.2.137:0/2430528559 learned_addr learned my addr 172.21.2.137:0/2430528559 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 -- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900b1660 msgr2=0x7fc890159f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:24.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900b1660 0x7fc890159f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 -- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8900608f0 msgr2=0x7fc89013e060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:24.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8900608f0 0x7fc89013e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.816+0000 7fc88ed9d700 1 -- 172.21.2.137:0/2430528559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88800b7d0 con 0x7fc89005f730 2021-11-15T19:27:24.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc88ed9d700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc890066db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fc880002ef0 tx=0x7fc880006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc880012410 con 0x7fc89005f730 2021-11-15T19:27:24.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880012570 con 0x7fc89005f730 2021-11-15T19:27:24.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc890159aa0 con 0x7fc89005f730 2021-11-15T19:27:24.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc890139fa0 con 0x7fc89005f730 2021-11-15T19:27:24.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8800128d0 con 0x7fc89005f730 2021-11-15T19:27:24.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc890159c30 con 0x7fc89005f730 2021-11-15T19:27:24.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc88000f030 con 0x7fc89005f730 2021-11-15T19:27:24.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc8740536f0 0x7fc874055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc88006b5d0 con 0x7fc89005f730 2021-11-15T19:27:24.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc88e59c700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc8740536f0 0x7fc874055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc88e59c700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc8740536f0 0x7fc874055bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc878002fb0 tx=0x7fc878006950).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.820+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc880042730 con 0x7fc89005f730 2021-11-15T19:27:24.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.904+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8900573d0 con 0x7fc89005f730 2021-11-15T19:27:24.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.904+0000 7fc887fff700 1 -- 172.21.2.137:0/2430528559 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fc880045d50 con 0x7fc89005f730 2021-11-15T19:27:24.912 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:24.913 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":29,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:27:24.601741+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:27:22.499670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T19:27:23.496407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:24.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc8740536f0 msgr2=0x7fc874055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc8740536f0 0x7fc874055bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc878002fb0 tx=0x7fc878006950).stop 2021-11-15T19:27:24.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 msgr2=0x7fc890066db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc890066db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fc880002ef0 tx=0x7fc880006d50).stop 2021-11-15T19:27:24.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 shutdown_connections 2021-11-15T19:27:24.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc8740536f0 0x7fc874055bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8900b1660 0x7fc890159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8900608f0 0x7fc89013e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 --2- 172.21.2.137:0/2430528559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc89005f730 0x7fc890066db0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 >> 172.21.2.137:0/2430528559 conn(0x7fc890063980 msgr2=0x7fc89013f500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 shutdown_connections 2021-11-15T19:27:24.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.908+0000 7fc8951ae700 1 -- 172.21.2.137:0/2430528559 wait complete. 2021-11-15T19:27:24.920 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:27:24.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.964+0000 7fb9c62c8700 1 Processor -- start 2021-11-15T19:27:24.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.964+0000 7fb9c62c8700 1 -- start start 2021-11-15T19:27:24.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb9c005c770 0x7fb9c00b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb9c00af7a0 0x7fb9c00653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c00658a0 con 0x7fb9c013a4e0 2021-11-15T19:27:24.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c005cb50 con 0x7fb9c00af7a0 2021-11-15T19:27:24.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c00af140 con 0x7fb9c005c770 2021-11-15T19:27:24.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb9c005c770 0x7fb9c00b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb9c005c770 0x7fb9c00b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60938/0 (socket says 172.21.2.137:60938) 2021-11-15T19:27:24.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/3094936879 learned_addr learned my addr 172.21.2.137:0/3094936879 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/3094936879 >> v2:172.21.2.111:3300/0 conn(0x7fb9c00af7a0 msgr2=0x7fb9c00653b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:24.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- 172.21.2.137:0/3094936879 >> v2:172.21.2.111:3300/0 conn(0x7fb9c00af7a0 0x7fb9c00653b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/3094936879 >> v1:172.21.2.111:6789/0 conn(0x7fb9c013a4e0 legacy=0x7fb9c013a910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:24.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/3094936879 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00af3e0 con 0x7fb9c005c770 2021-11-15T19:27:24.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- 172.21.2.137:0/3094936879 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c00b0a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fb9c00620e0 tx=0x7fb9b0006eb0).ready entity=mon.1 client_cookie=bd7f117eccb1db47 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9beffd700 1 -- 172.21.2.137:0/3094936879 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b000d5c0 con 0x7fb9c005c770 2021-11-15T19:27:24.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9beffd700 1 -- 172.21.2.137:0/3094936879 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0000e90 con 0x7fb9c005c770 2021-11-15T19:27:24.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9beffd700 1 -- 172.21.2.137:0/3094936879 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b000d910 con 0x7fb9c005c770 2021-11-15T19:27:24.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/3094936879 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 msgr2=0x7fb9c00b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/3094936879 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c00b0a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fb9c00620e0 tx=0x7fb9b0006eb0).stop 2021-11-15T19:27:24.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/3094936879 shutdown_connections 2021-11-15T19:27:24.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/3094936879 >> v2:172.21.2.111:3300/0 conn(0x7fb9c00af7a0 0x7fb9c00653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/3094936879 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c00b0a30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:24.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/3094936879 >> 172.21.2.137:0/3094936879 conn(0x7fb9c00631e0 msgr2=0x7fb9c005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:24.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/3094936879 shutdown_connections 2021-11-15T19:27:24.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/3094936879 wait complete. 2021-11-15T19:27:24.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 Processor -- start 2021-11-15T19:27:24.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- start start 2021-11-15T19:27:24.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9c00af7a0 0x7fb9c00b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9c013a4e0 0x7fb9c0156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01359d0 con 0x7fb9c013a4e0 2021-11-15T19:27:24.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0159ac0 con 0x7fb9c005c770 2021-11-15T19:27:24.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0142bd0 con 0x7fb9c00af7a0 2021-11-15T19:27:24.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c0156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60944/0 (socket says 172.21.2.137:60944) 2021-11-15T19:27:24.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/683816823 learned_addr learned my addr 172.21.2.137:0/683816823 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:24.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9c00af7a0 msgr2=0x7fb9c00b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9c00af7a0 0x7fb9c00b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9c013a4e0 msgr2=0x7fb9c0156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:24.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9c013a4e0 0x7fb9c0156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:24.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 -- 172.21.2.137:0/683816823 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b000b1e0 con 0x7fb9c005c770 2021-11-15T19:27:24.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bffff700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c0156520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb9c00620e0 tx=0x7fb9b0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b0002f70 con 0x7fb9c005c770 2021-11-15T19:27:24.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b000de70 con 0x7fb9c005c770 2021-11-15T19:27:24.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c0135bc0 con 0x7fb9c005c770 2021-11-15T19:27:24.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b001e460 con 0x7fb9c005c770 2021-11-15T19:27:24.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.968+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0142f50 con 0x7fb9c005c770 2021-11-15T19:27:24.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c0159c50 con 0x7fb9c005c770 2021-11-15T19:27:24.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9b0025030 con 0x7fb9c005c770 2021-11-15T19:27:24.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9bd7fa700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb9a4053640 0x7fb9a4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:24.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb9b006cf30 con 0x7fb9c005c770 2021-11-15T19:27:24.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9bf7fe700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb9a4053640 0x7fb9a4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:24.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9bf7fe700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb9a4053640 0x7fb9a4055b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb9a8002fb0 tx=0x7fb9a80069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:24.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:24.972+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9c0159c50 con 0x7fb9c005c770 2021-11-15T19:27:25.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.084+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb9c013a2a0 con 0x7fb9c005c770 2021-11-15T19:27:25.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.612+0000 7fb9bd7fa700 1 -- 172.21.2.137:0/683816823 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb9b0023020 con 0x7fb9c005c770 2021-11-15T19:27:25.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.612+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb9a4053640 msgr2=0x7fb9a4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.612+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb9a4053640 0x7fb9a4055b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb9a8002fb0 tx=0x7fb9a80069b0).stop 2021-11-15T19:27:25.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.612+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 msgr2=0x7fb9c0156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.612+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c0156520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb9c00620e0 tx=0x7fb9b0015000).stop 2021-11-15T19:27:25.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 shutdown_connections 2021-11-15T19:27:25.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb9a4053640 0x7fb9a4055b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9c013a4e0 0x7fb9c0156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9c00af7a0 0x7fb9c00b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 --2- 172.21.2.137:0/683816823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9c005c770 0x7fb9c0156520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 >> 172.21.2.137:0/683816823 conn(0x7fb9c00631e0 msgr2=0x7fb9c0130060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:25.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 shutdown_connections 2021-11-15T19:27:25.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.616+0000 7fb9c62c8700 1 -- 172.21.2.137:0/683816823 wait complete. 2021-11-15T19:27:25.627 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:25.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 Processor -- start 2021-11-15T19:27:25.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 -- start start 2021-11-15T19:27:25.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500b1340 0x7f8b50147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8b50143f00 0x7f8b50144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8b500a9f50 0x7f8b500aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b50148190 con 0x7f8b50143f00 2021-11-15T19:27:25.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500b1720 con 0x7f8b500a9f50 2021-11-15T19:27:25.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b5745e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50147e70 con 0x7f8b500b1340 2021-11-15T19:27:25.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8b500a9f50 0x7f8b500aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8b500a9f50 0x7f8b500aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60956/0 (socket says 172.21.2.137:60956) 2021-11-15T19:27:25.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 -- 172.21.2.137:0/1701989332 learned_addr learned my addr 172.21.2.137:0/1701989332 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:25.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 -- 172.21.2.137:0/1701989332 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500b1340 msgr2=0x7f8b50147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:25.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 --2- 172.21.2.137:0/1701989332 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500b1340 0x7f8b50147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 -- 172.21.2.137:0/1701989332 >> v2:172.21.2.111:3300/0 conn(0x7f8b50143f00 msgr2=0x7f8b50144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:25.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 --2- 172.21.2.137:0/1701989332 >> v2:172.21.2.111:3300/0 conn(0x7f8b50143f00 0x7f8b50144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.672+0000 7f8b559fb700 1 -- 172.21.2.137:0/1701989332 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500af800 con 0x7f8b500a9f50 2021-11-15T19:27:25.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 --2- 172.21.2.137:0/1701989332 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b500a9f50 0x7f8b500aa370 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f8b480032f0 tx=0x7f8b48009290).ready entity=mon.1 client_cookie=1e1071bd9af57b6a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:25.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3ffff700 1 -- 172.21.2.137:0/1701989332 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4800b870 con 0x7f8b500a9f50 2021-11-15T19:27:25.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3ffff700 1 -- 172.21.2.137:0/1701989332 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800b9d0 con 0x7f8b500a9f50 2021-11-15T19:27:25.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3ffff700 1 -- 172.21.2.137:0/1701989332 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4800bb40 con 0x7f8b500a9f50 2021-11-15T19:27:25.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/1701989332 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b500a9f50 msgr2=0x7f8b500aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- 172.21.2.137:0/1701989332 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b500a9f50 0x7f8b500aa370 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f8b480032f0 tx=0x7f8b48009290).stop 2021-11-15T19:27:25.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/1701989332 shutdown_connections 2021-11-15T19:27:25.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- 172.21.2.137:0/1701989332 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b500a9f50 0x7f8b500aa370 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- 172.21.2.137:0/1701989332 >> v2:172.21.2.111:3300/0 conn(0x7f8b50143f00 0x7f8b50144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- 172.21.2.137:0/1701989332 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500b1340 0x7f8b50147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/1701989332 >> 172.21.2.137:0/1701989332 conn(0x7f8b500b4e60 msgr2=0x7f8b500b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:25.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/1701989332 shutdown_connections 2021-11-15T19:27:25.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/1701989332 wait complete. 2021-11-15T19:27:25.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 Processor -- start 2021-11-15T19:27:25.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- start start 2021-11-15T19:27:25.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500a9f50 0x7f8b5013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b500b1340 0x7f8b5009a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 0x7f8b50142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50142580 con 0x7f8b500b1340 2021-11-15T19:27:25.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501427a0 con 0x7f8b50143f00 2021-11-15T19:27:25.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50142a40 con 0x7f8b500a9f50 2021-11-15T19:27:25.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 0x7f8b50142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 0x7f8b50142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60962/0 (socket says 172.21.2.137:60962) 2021-11-15T19:27:25.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 -- 172.21.2.137:0/3914356001 learned_addr learned my addr 172.21.2.137:0/3914356001 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:25.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b551fa700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500a9f50 0x7f8b5013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 -- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500a9f50 msgr2=0x7f8b5013fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500a9f50 0x7f8b5013fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 -- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b500b1340 msgr2=0x7f8b5009a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b500b1340 0x7f8b5009a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 -- 172.21.2.137:0/3914356001 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48009530 con 0x7f8b50143f00 2021-11-15T19:27:25.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b559fb700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 0x7f8b50142090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8b501426c0 tx=0x7f8b48016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:25.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4800b870 con 0x7f8b50143f00 2021-11-15T19:27:25.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48020620 con 0x7f8b50143f00 2021-11-15T19:27:25.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b500ac670 con 0x7f8b50143f00 2021-11-15T19:27:25.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b48020980 con 0x7f8b50143f00 2021-11-15T19:27:25.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b500ae450 con 0x7f8b50143f00 2021-11-15T19:27:25.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50142c00 con 0x7f8b50143f00 2021-11-15T19:27:25.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.676+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b48026020 con 0x7f8b50143f00 2021-11-15T19:27:25.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.680+0000 7f8b3e7fc700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b30053720 0x7f8b30055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.680+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8b4806c6a0 con 0x7f8b50143f00 2021-11-15T19:27:25.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.680+0000 7f8b551fa700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b30053720 0x7f8b30055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.680+0000 7f8b551fa700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b30053720 0x7f8b30055be0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8b4c00a000 tx=0x7f8b4c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:25.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.680+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b480438b0 con 0x7f8b50143f00 2021-11-15T19:27:25.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.788+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b500573d0 con 0x7f8b50143f00 2021-11-15T19:27:25.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.788+0000 7f8b3e7fc700 1 -- 172.21.2.137:0/3914356001 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f8b48015090 con 0x7f8b50143f00 2021-11-15T19:27:25.796 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:25.796 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:27:25.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b30053720 msgr2=0x7f8b30055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b30053720 0x7f8b30055be0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8b4c00a000 tx=0x7f8b4c008040).stop 2021-11-15T19:27:25.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 msgr2=0x7f8b50142090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 0x7f8b50142090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8b501426c0 tx=0x7f8b48016000).stop 2021-11-15T19:27:25.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 shutdown_connections 2021-11-15T19:27:25.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b30053720 0x7f8b30055be0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b50143f00 0x7f8b50142090 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b500b1340 0x7f8b5009a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 --2- 172.21.2.137:0/3914356001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b500a9f50 0x7f8b5013fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 >> 172.21.2.137:0/3914356001 conn(0x7f8b500b4e60 msgr2=0x7f8b5013e510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:25.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 shutdown_connections 2021-11-15T19:27:25.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.792+0000 7f8b5745e700 1 -- 172.21.2.137:0/3914356001 wait complete. 2021-11-15T19:27:25.800 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:27:25.811 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:25.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 Processor -- start 2021-11-15T19:27:25.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 -- start start 2021-11-15T19:27:25.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 0x7f41b8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f41b80a9f50 0x7f41b80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b8148190 con 0x7f41b8143f00 2021-11-15T19:27:25.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80b1720 con 0x7f41b80a9f50 2021-11-15T19:27:25.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bf42a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8147e70 con 0x7f41b80b1340 2021-11-15T19:27:25.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 0x7f41b8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd9c7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f41b80a9f50 0x7f41b80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd9c7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f41b80a9f50 0x7f41b80aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:39966/0 (socket says 172.21.2.137:39966) 2021-11-15T19:27:25.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 0x7f41b8147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:34306/0 (socket says 172.21.2.137:34306) 2021-11-15T19:27:25.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd9c7700 1 -- 172.21.2.137:0/620381851 learned_addr learned my addr 172.21.2.137:0/620381851 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:25.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 -- 172.21.2.137:0/620381851 >> v2:172.21.2.111:3300/0 conn(0x7f41b80a9f50 msgr2=0x7f41b80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:25.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 --2- 172.21.2.137:0/620381851 >> v2:172.21.2.111:3300/0 conn(0x7f41b80a9f50 0x7f41b80aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 -- 172.21.2.137:0/620381851 >> v1:172.21.2.111:6789/0 conn(0x7f41b8143f00 legacy=0x7f41b8144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 -- 172.21.2.137:0/620381851 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80af800 con 0x7f41b80b1340 2021-11-15T19:27:25.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.856+0000 7f41bd1c6700 1 --2- 172.21.2.137:0/620381851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 0x7f41b8147980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f41ac002f70 tx=0x7f41ac006df0).ready entity=mon.2 client_cookie=b2d0ccb5891ed193 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:25.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41abfff700 1 -- 172.21.2.137:0/620381851 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac00d570 con 0x7f41b80b1340 2021-11-15T19:27:25.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41abfff700 1 -- 172.21.2.137:0/620381851 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac000e90 con 0x7f41b80b1340 2021-11-15T19:27:25.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41abfff700 1 -- 172.21.2.137:0/620381851 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac00d8c0 con 0x7f41b80b1340 2021-11-15T19:27:25.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/620381851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 msgr2=0x7f41b8147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 --2- 172.21.2.137:0/620381851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 0x7f41b8147980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f41ac002f70 tx=0x7f41ac006df0).stop 2021-11-15T19:27:25.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/620381851 shutdown_connections 2021-11-15T19:27:25.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 --2- 172.21.2.137:0/620381851 >> v2:172.21.2.111:3300/0 conn(0x7f41b80a9f50 0x7f41b80aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 --2- 172.21.2.137:0/620381851 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b80b1340 0x7f41b8147980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/620381851 >> 172.21.2.137:0/620381851 conn(0x7f41b80b4e60 msgr2=0x7f41b80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:25.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/620381851 shutdown_connections 2021-11-15T19:27:25.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/620381851 wait complete. 2021-11-15T19:27:25.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 Processor -- start 2021-11-15T19:27:25.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- start start 2021-11-15T19:27:25.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 0x7f41b81413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f41b80b1340 0x7f41b813ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b8143f00 0x7f41b813ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80ad150 con 0x7f41b80b1340 2021-11-15T19:27:25.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b813ffa0 con 0x7f41b80a9f50 2021-11-15T19:27:25.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b814a2f0 con 0x7f41b8143f00 2021-11-15T19:27:25.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 0x7f41b81413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 0x7f41b81413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60972/0 (socket says 172.21.2.137:60972) 2021-11-15T19:27:25.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 -- 172.21.2.137:0/4075055205 learned_addr learned my addr 172.21.2.137:0/4075055205 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:25.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 -- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b8143f00 msgr2=0x7f41b813ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b8143f00 0x7f41b813ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 -- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f41b80b1340 msgr2=0x7f41b813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f41b80b1340 0x7f41b813ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 -- 172.21.2.137:0/4075055205 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac00b180 con 0x7f41b80a9f50 2021-11-15T19:27:25.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bd1c6700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 0x7f41b81413d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f41ac002f70 tx=0x7f41ac014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:25.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac00dea0 con 0x7f41b80a9f50 2021-11-15T19:27:25.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac01e400 con 0x7f41b80a9f50 2021-11-15T19:27:25.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac01e760 con 0x7f41b80a9f50 2021-11-15T19:27:25.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b80acdd0 con 0x7f41b80a9f50 2021-11-15T19:27:25.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b8140aa0 con 0x7f41b80a9f50 2021-11-15T19:27:25.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.860+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b805faf0 con 0x7f41b80a9f50 2021-11-15T19:27:25.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.864+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f41ac025030 con 0x7f41b80a9f50 2021-11-15T19:27:25.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.864+0000 7f41aa7fc700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4198053720 0x7f4198055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:25.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.864+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f41ac06c910 con 0x7f41b80a9f50 2021-11-15T19:27:25.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.864+0000 7f41bc9c5700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4198053720 0x7f4198055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:25.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.864+0000 7f41bc9c5700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4198053720 0x7f4198055be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f41b805cfa0 tx=0x7f41b4007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:25.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.864+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41ac043960 con 0x7f41b80a9f50 2021-11-15T19:27:25.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41b81400e0 con 0x7f41b80a9f50 2021-11-15T19:27:25.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41aa7fc700 1 -- 172.21.2.137:0/4075055205 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f41ac023090 con 0x7f41b80a9f50 2021-11-15T19:27:25.954 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:25.954 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":30,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:27:25.608051+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:27:22.499670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T19:27:23.496407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:25.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4198053720 msgr2=0x7f4198055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4198053720 0x7f4198055be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f41b805cfa0 tx=0x7f41b4007810).stop 2021-11-15T19:27:25.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 msgr2=0x7f41b81413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:25.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 0x7f41b81413d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f41ac002f70 tx=0x7f41ac014000).stop 2021-11-15T19:27:25.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 shutdown_connections 2021-11-15T19:27:25.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4198053720 0x7f4198055be0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41b8143f00 0x7f41b813ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f41b80b1340 0x7f41b813ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:25.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 --2- 172.21.2.137:0/4075055205 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41b80a9f50 0x7f41b81413d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:25.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 >> 172.21.2.137:0/4075055205 conn(0x7f41b80b4e60 msgr2=0x7f41b80afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:25.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 shutdown_connections 2021-11-15T19:27:25.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:25.948+0000 7f41bf42a700 1 -- 172.21.2.137:0/4075055205 wait complete. 2021-11-15T19:27:25.961 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:27:26.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.008+0000 7fd352d21700 1 Processor -- start 2021-11-15T19:27:26.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.008+0000 7fd352d21700 1 -- start start 2021-11-15T19:27:26.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.008+0000 7fd352d21700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd34c0969e0 0x7fd34c0997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c0aca80 con 0x7fd34c0b2c30 2021-11-15T19:27:26.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c0accb0 con 0x7fd34c097260 2021-11-15T19:27:26.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0ad150 con 0x7fd34c0969e0 2021-11-15T19:27:26.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd350abd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd34c097260 0x7fd34c0990e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51530/0 (socket says 172.21.2.137:51530) 2021-11-15T19:27:26.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd350abd700 1 -- 172.21.2.137:0/3547477093 learned_addr learned my addr 172.21.2.137:0/3547477093 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:26.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968344502 0 0) 0x7fd34c0accb0 con 0x7fd34c097260 2021-11-15T19:27:26.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd338003260 con 0x7fd34c097260 2021-11-15T19:27:26.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972105997 0 0) 0x7fd338003260 con 0x7fd34c097260 2021-11-15T19:27:26.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd34c0969e0 msgr2=0x7fd34c0997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd34c0969e0 0x7fd34c0997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 >> v1:172.21.2.111:6789/0 conn(0x7fd34c0b2c30 legacy=0x7fd34c05f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c097c50 con 0x7fd34c097260 2021-11-15T19:27:26.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd340001660 con 0x7fd34c097260 2021-11-15T19:27:26.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 >> v1:172.21.2.137:6789/0 conn(0x7fd34c097260 legacy=0x7fd34c0990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3380037d0 0x7fd338003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd338004500 0x7fd338004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd338005070 0x7fd33800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800bed0 con 0x7fd338004500 2021-11-15T19:27:26.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800c040 con 0x7fd338005070 2021-11-15T19:27:26.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800c200 con 0x7fd3380037d0 2021-11-15T19:27:26.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd338005070 0x7fd33800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 -- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3380037d0 msgr2=0x7fd338003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3380037d0 0x7fd338003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 -- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd338004500 msgr2=0x7fd338004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd338004500 0x7fd338004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 -- 172.21.2.137:0/3547477093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338003260 con 0x7fd338005070 2021-11-15T19:27:26.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd338005070 0x7fd33800b750 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fd3440032f0 tx=0x7fd344009b80).ready entity=mon.1 client_cookie=e88e394b0071b15c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd344011440 con 0x7fd338005070 2021-11-15T19:27:26.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3440115a0 con 0x7fd338005070 2021-11-15T19:27:26.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34b7fe700 1 -- 172.21.2.137:0/3547477093 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd344011900 con 0x7fd338005070 2021-11-15T19:27:26.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- 172.21.2.137:0/3547477093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd338005070 msgr2=0x7fd33800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 --2- 172.21.2.137:0/3547477093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd338005070 0x7fd33800b750 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fd3440032f0 tx=0x7fd344009b80).stop 2021-11-15T19:27:26.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd3512be700 1 -- 172.21.2.137:0/3547477093 reap_dead start 2021-11-15T19:27:26.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- 172.21.2.137:0/3547477093 shutdown_connections 2021-11-15T19:27:26.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- 172.21.2.137:0/3547477093 >> 172.21.2.137:0/3547477093 conn(0x7fd34c0b7070 msgr2=0x7fd34c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- 172.21.2.137:0/3547477093 shutdown_connections 2021-11-15T19:27:26.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- 172.21.2.137:0/3547477093 wait complete. 2021-11-15T19:27:26.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 Processor -- start 2021-11-15T19:27:26.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- start start 2021-11-15T19:27:26.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd338005070 0x7fd34c093b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 0x7fd34c152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd34c0617a0 0x7fd34c155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0620e0 con 0x7fd34c0617a0 2021-11-15T19:27:26.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c152390 con 0x7fd34c095d30 2021-11-15T19:27:26.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd352d21700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c152630 con 0x7fd338005070 2021-11-15T19:27:26.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 0x7fd34c152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 0x7fd34c152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:60994/0 (socket says 172.21.2.137:60994) 2021-11-15T19:27:26.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.012+0000 7fd34bfff700 1 -- 172.21.2.137:0/3272993382 learned_addr learned my addr 172.21.2.137:0/3272993382 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:26.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd34bfff700 1 -- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd338005070 msgr2=0x7fd34c093b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd34bfff700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd338005070 0x7fd34c093b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd34bfff700 1 -- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd34c0617a0 msgr2=0x7fd34c155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd34bfff700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd34c0617a0 0x7fd34c155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd34bfff700 1 -- 172.21.2.137:0/3272993382 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c152fc0 con 0x7fd34c095d30 2021-11-15T19:27:26.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd34bfff700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 0x7fd34c152ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fd33c000f70 tx=0x7fd33c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd33c009e70 con 0x7fd34c095d30 2021-11-15T19:27:26.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c013460 con 0x7fd34c095d30 2021-11-15T19:27:26.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c152090 con 0x7fd34c095d30 2021-11-15T19:27:26.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd33c0137c0 con 0x7fd34c095d30 2021-11-15T19:27:26.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c155d90 con 0x7fd34c095d30 2021-11-15T19:27:26.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c1527f0 con 0x7fd34c095d30 2021-11-15T19:27:26.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd33c01a060 con 0x7fd34c095d30 2021-11-15T19:27:26.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd349ffb700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd32c0536f0 0x7fd32c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd33c06b310 con 0x7fd34c095d30 2021-11-15T19:27:26.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd350abd700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd32c0536f0 0x7fd32c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.016+0000 7fd350abd700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd32c0536f0 0x7fd32c055bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd34c0b4c10 tx=0x7fd340001590).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.020+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd33c042360 con 0x7fd34c095d30 2021-11-15T19:27:26.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.132+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd34c0addd0 con 0x7fd34c095d30 2021-11-15T19:27:26.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd349ffb700 1 -- 172.21.2.137:0/3272993382 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v9) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd33c018020 con 0x7fd34c095d30 2021-11-15T19:27:26.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd32c0536f0 msgr2=0x7fd32c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd32c0536f0 0x7fd32c055bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd34c0b4c10 tx=0x7fd340001590).stop 2021-11-15T19:27:26.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 msgr2=0x7fd34c152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 0x7fd34c152ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fd33c000f70 tx=0x7fd33c006dc0).stop 2021-11-15T19:27:26.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 shutdown_connections 2021-11-15T19:27:26.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd32c0536f0 0x7fd32c055bb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd34c0617a0 0x7fd34c155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd34c095d30 0x7fd34c152ad0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 --2- 172.21.2.137:0/3272993382 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd338005070 0x7fd34c093b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 >> 172.21.2.137:0/3272993382 conn(0x7fd34c0b7070 msgr2=0x7fd34c0980d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 shutdown_connections 2021-11-15T19:27:26.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.144+0000 7fd352d21700 1 -- 172.21.2.137:0/3272993382 wait complete. 2021-11-15T19:27:26.155 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:27:26.158 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:27:26.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cf4a8700 1 Processor -- start 2021-11-15T19:27:26.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cf4a8700 1 -- start start 2021-11-15T19:27:26.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cf4a8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f54c80b0830 0x7f54c80af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cf4a8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c8147f70 con 0x7f54c805fd20 2021-11-15T19:27:26.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cf4a8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c8060100 con 0x7f54c80b10b0 2021-11-15T19:27:26.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cf4a8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c8147cd0 con 0x7f54c80b0830 2021-11-15T19:27:26.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cda45700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f54c80b10b0 0x7f54c80aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51552/0 (socket says 172.21.2.137:51552) 2021-11-15T19:27:26.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cda45700 1 -- 172.21.2.137:0/1673193018 learned_addr learned my addr 172.21.2.137:0/1673193018 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:26.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088375027 0 0) 0x7f54c8060100 con 0x7f54c80b10b0 2021-11-15T19:27:26.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b0003260 con 0x7f54c80b10b0 2021-11-15T19:27:26.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cca43700 1 --2- 172.21.2.137:0/1673193018 >> v2:172.21.2.111:3300/0 conn(0x7f54c80b0830 0x7f54c80af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1134977047 0 0) 0x7f54b0003260 con 0x7f54c80b10b0 2021-11-15T19:27:26.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 >> v2:172.21.2.111:3300/0 conn(0x7f54c80b0830 msgr2=0x7f54c80af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 --2- 172.21.2.137:0/1673193018 >> v2:172.21.2.111:3300/0 conn(0x7f54c80b0830 0x7f54c80af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 >> v1:172.21.2.111:6789/0 conn(0x7f54c805fd20 legacy=0x7f54c80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80a9ed0 con 0x7f54c80b10b0 2021-11-15T19:27:26.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f54c00019e0 con 0x7f54c80b10b0 2021-11-15T19:27:26.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 >> v1:172.21.2.137:6789/0 conn(0x7f54c80b10b0 legacy=0x7f54c80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54b0003820 0x7f54b0003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0004500 0x7f54b0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54b0004f90 0x7f54b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8147cd0 con 0x7f54b0004f90 2021-11-15T19:27:26.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b000be80 con 0x7f54b0003820 2021-11-15T19:27:26.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b000c040 con 0x7f54b0004500 2021-11-15T19:27:26.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54b0003820 0x7f54b0003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cda45700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54b0004f90 0x7f54b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 -- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0004500 msgr2=0x7f54b0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0004500 0x7f54b0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 -- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54b0004f90 msgr2=0x7f54b000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54b0004f90 0x7f54b000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 -- 172.21.2.137:0/1673193018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0003260 con 0x7f54b0003820 2021-11-15T19:27:26.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cda45700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54b0004f90 0x7f54b000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:26.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cda45700 1 -- 172.21.2.137:0/1673193018 reap_dead start 2021-11-15T19:27:26.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54cd244700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54b0003820 0x7f54b0003c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f54c80b4db0 tx=0x7f54c4007a00).ready entity=mon.1 client_cookie=2eef9d022e9eac9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c4007d10 con 0x7f54b0003820 2021-11-15T19:27:26.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4007030 con 0x7f54b0003820 2021-11-15T19:27:26.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.208+0000 7f54b7fff700 1 -- 172.21.2.137:0/1673193018 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c4007390 con 0x7f54b0003820 2021-11-15T19:27:26.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1673193018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54b0003820 msgr2=0x7f54b0003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54b0003820 0x7f54b0003c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f54c80b4db0 tx=0x7f54c4007a00).stop 2021-11-15T19:27:26.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1673193018 shutdown_connections 2021-11-15T19:27:26.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1673193018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54b0003820 0x7f54b0003c40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1673193018 >> 172.21.2.137:0/1673193018 conn(0x7f54c80b4e60 msgr2=0x7f54c80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1673193018 shutdown_connections 2021-11-15T19:27:26.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1673193018 wait complete. 2021-11-15T19:27:26.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 Processor -- start 2021-11-15T19:27:26.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- start start 2021-11-15T19:27:26.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0003820 0x7f54c8156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 0x7f54c80ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54c815a370 0x7f54c815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8142b10 con 0x7f54c815a370 2021-11-15T19:27:26.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8156d30 con 0x7f54c8143920 2021-11-15T19:27:26.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815ace0 con 0x7f54b0003820 2021-11-15T19:27:26.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 0x7f54c80ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 0x7f54c80ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32784/0 (socket says 172.21.2.137:32784) 2021-11-15T19:27:26.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 -- 172.21.2.137:0/1417171985 learned_addr learned my addr 172.21.2.137:0/1417171985 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:26.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 -- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0003820 msgr2=0x7f54c8156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0003820 0x7f54c8156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 -- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54c815a370 msgr2=0x7f54c815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54c815a370 0x7f54c815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 -- 172.21.2.137:0/1417171985 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c8159f10 con 0x7f54c8143920 2021-11-15T19:27:26.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cca43700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 0x7f54c80ae330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f54c80634a0 tx=0x7f54b8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54b8016070 con 0x7f54c8143920 2021-11-15T19:27:26.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8000e90 con 0x7f54c8143920 2021-11-15T19:27:26.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c8142870 con 0x7f54c8143920 2021-11-15T19:27:26.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54b8011970 con 0x7f54c8143920 2021-11-15T19:27:26.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c8142ce0 con 0x7f54c8143920 2021-11-15T19:27:26.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c81479f0 con 0x7f54c8143920 2021-11-15T19:27:26.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f54b8011ad0 con 0x7f54c8143920 2021-11-15T19:27:26.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54b67fc700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54a8053610 0x7f54a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f54b806b850 con 0x7f54c8143920 2021-11-15T19:27:26.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.212+0000 7f54cd244700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54a8053610 0x7f54a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.216+0000 7f54cd244700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54a8053610 0x7f54a8055ad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f54c80b4db0 tx=0x7f54c4013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.216+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54b80429b0 con 0x7f54c8143920 2021-11-15T19:27:26.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.328+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f54c815a0a0 con 0x7f54c8143920 2021-11-15T19:27:26.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54b67fc700 1 -- 172.21.2.137:0/1417171985 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v10) v1 ==== 184+0+0 (secure 0 0 0) 0x7f54b8006980 con 0x7f54c8143920 2021-11-15T19:27:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54a8053610 msgr2=0x7f54a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54a8053610 0x7f54a8055ad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f54c80b4db0 tx=0x7f54c4013000).stop 2021-11-15T19:27:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 msgr2=0x7f54c80ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 0x7f54c80ae330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f54c80634a0 tx=0x7f54b8008040).stop 2021-11-15T19:27:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 shutdown_connections 2021-11-15T19:27:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54a8053610 0x7f54a8055ad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54c815a370 0x7f54c815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54c8143920 0x7f54c80ae330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 --2- 172.21.2.137:0/1417171985 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54b0003820 0x7f54c8156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 >> 172.21.2.137:0/1417171985 conn(0x7f54c80b4e60 msgr2=0x7f54c8144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 shutdown_connections 2021-11-15T19:27:26.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.340+0000 7f54cf4a8700 1 -- 172.21.2.137:0/1417171985 wait complete. 2021-11-15T19:27:26.351 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:27:26.354 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:27:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 Processor -- start 2021-11-15T19:27:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- start start 2021-11-15T19:27:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8f5c09c720 0x7f8f5c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8f5c0b2830 0x7f8f5c1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c09aa40 con 0x7f8f5c1447d0 2021-11-15T19:27:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c09b170 con 0x7f8f5c09c720 2021-11-15T19:27:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0b34c0 con 0x7f8f5c0b2830 2021-11-15T19:27:26.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8f5c0b2830 0x7f8f5c1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8f5c0b2830 0x7f8f5c1442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32792/0 (socket says 172.21.2.137:32792) 2021-11-15T19:27:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 -- 172.21.2.137:0/3569147388 learned_addr learned my addr 172.21.2.137:0/3569147388 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 -- 172.21.2.137:0/3569147388 >> v2:172.21.2.111:3300/0 conn(0x7f8f5c09c720 msgr2=0x7f8f5c143df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 --2- 172.21.2.137:0/3569147388 >> v2:172.21.2.111:3300/0 conn(0x7f8f5c09c720 0x7f8f5c143df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 -- 172.21.2.137:0/3569147388 >> v1:172.21.2.111:6789/0 conn(0x7f8f5c1447d0 legacy=0x7f8f5c13fed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 -- 172.21.2.137:0/3569147388 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c09acd0 con 0x7f8f5c0b2830 2021-11-15T19:27:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5b7fe700 1 --2- 172.21.2.137:0/3569147388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c0b2830 0x7f8f5c1442e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f8f5c09c490 tx=0x7f8f4c006eb0).ready entity=mon.1 client_cookie=71519abb03c62789 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5affd700 1 -- 172.21.2.137:0/3569147388 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f4c00d5c0 con 0x7f8f5c0b2830 2021-11-15T19:27:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5affd700 1 -- 172.21.2.137:0/3569147388 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c000e90 con 0x7f8f5c0b2830 2021-11-15T19:27:26.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5affd700 1 -- 172.21.2.137:0/3569147388 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f4c00d910 con 0x7f8f5c0b2830 2021-11-15T19:27:26.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- 172.21.2.137:0/3569147388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c0b2830 msgr2=0x7f8f5c1442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- 172.21.2.137:0/3569147388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c0b2830 0x7f8f5c1442e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f8f5c09c490 tx=0x7f8f4c006eb0).stop 2021-11-15T19:27:26.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- 172.21.2.137:0/3569147388 shutdown_connections 2021-11-15T19:27:26.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- 172.21.2.137:0/3569147388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c0b2830 0x7f8f5c1442e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- 172.21.2.137:0/3569147388 >> v2:172.21.2.111:3300/0 conn(0x7f8f5c09c720 0x7f8f5c143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- 172.21.2.137:0/3569147388 >> 172.21.2.137:0/3569147388 conn(0x7f8f5c0b45e0 msgr2=0x7f8f5c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- 172.21.2.137:0/3569147388 shutdown_connections 2021-11-15T19:27:26.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- 172.21.2.137:0/3569147388 wait complete. 2021-11-15T19:27:26.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 Processor -- start 2021-11-15T19:27:26.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- start start 2021-11-15T19:27:26.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 0x7f8f5c143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8f5c0b2830 0x7f8f5c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8f5c1447d0 0x7f8f5c0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0ac150 con 0x7f8f5c0b2830 2021-11-15T19:27:26.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0ac3f0 con 0x7f8f5c09c720 2021-11-15T19:27:26.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f6248b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0ac690 con 0x7f8f5c1447d0 2021-11-15T19:27:26.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 0x7f8f5c143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 0x7f8f5c143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32794/0 (socket says 172.21.2.137:32794) 2021-11-15T19:27:26.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.404+0000 7f8f5bfff700 1 -- 172.21.2.137:0/1679469691 learned_addr learned my addr 172.21.2.137:0/1679469691 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:26.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5bfff700 1 -- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8f5c1447d0 msgr2=0x7f8f5c0b0f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:26.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5bfff700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8f5c1447d0 0x7f8f5c0b0f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5bfff700 1 -- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8f5c0b2830 msgr2=0x7f8f5c0b0a60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:27:26.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5bfff700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8f5c0b2830 0x7f8f5c0b0a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5bfff700 1 -- 172.21.2.137:0/1679469691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c00b1e0 con 0x7f8f5c09c720 2021-11-15T19:27:26.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5bfff700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 0x7f8f5c143e50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f8f50002fb0 tx=0x7f8f50006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f50013460 con 0x7f8f5c09c720 2021-11-15T19:27:26.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f500135c0 con 0x7f8f5c09c720 2021-11-15T19:27:26.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f50013920 con 0x7f8f5c09c720 2021-11-15T19:27:26.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c066de0 con 0x7f8f5c09c720 2021-11-15T19:27:26.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c0ae110 con 0x7f8f5c09c720 2021-11-15T19:27:26.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c0b1660 con 0x7f8f5c09c720 2021-11-15T19:27:26.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f5000f070 con 0x7f8f5c09c720 2021-11-15T19:27:26.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f597fa700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f3c053660 0x7f8f3c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8f5006b520 con 0x7f8f5c09c720 2021-11-15T19:27:26.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5b7fe700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f3c053660 0x7f8f3c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.408+0000 7f8f5b7fe700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f3c053660 0x7f8f3c055b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8f5c09c490 tx=0x7f8f4c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.412+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f50042570 con 0x7f8f5c09c720 2021-11-15T19:27:26.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.520+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8f5c144bb0 con 0x7f8f5c09c720 2021-11-15T19:27:26.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.532+0000 7f8f597fa700 1 -- 172.21.2.137:0/1679469691 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8f50045b90 con 0x7f8f5c09c720 2021-11-15T19:27:26.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f3c053660 msgr2=0x7f8f3c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f3c053660 0x7f8f3c055b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8f5c09c490 tx=0x7f8f4c015000).stop 2021-11-15T19:27:26.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 msgr2=0x7f8f5c143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 0x7f8f5c143e50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f8f50002fb0 tx=0x7f8f50006df0).stop 2021-11-15T19:27:26.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 shutdown_connections 2021-11-15T19:27:26.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f3c053660 0x7f8f3c055b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8f5c1447d0 0x7f8f5c0b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8f5c0b2830 0x7f8f5c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:26.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 --2- 172.21.2.137:0/1679469691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8f5c09c720 0x7f8f5c143e50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 >> 172.21.2.137:0/1679469691 conn(0x7f8f5c0b45e0 msgr2=0x7f8f5c141dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 shutdown_connections 2021-11-15T19:27:26.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.536+0000 7f8f6248b700 1 -- 172.21.2.137:0/1679469691 wait complete. 2021-11-15T19:27:26.544 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:27:26.547 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:26.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 Processor -- start 2021-11-15T19:27:26.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- start start 2021-11-15T19:27:26.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5da00b1340 0x7f5da0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da0143f00 0x7f5da0144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5da00a9f50 0x7f5da00aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da0148190 con 0x7f5da00a9f50 2021-11-15T19:27:26.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da00b1720 con 0x7f5da00b1340 2021-11-15T19:27:26.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0147e70 con 0x7f5da0143f00 2021-11-15T19:27:26.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5da00b1340 0x7f5da0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5da00b1340 0x7f5da0147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32802/0 (socket says 172.21.2.137:32802) 2021-11-15T19:27:26.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 -- 172.21.2.137:0/4234540890 learned_addr learned my addr 172.21.2.137:0/4234540890 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:26.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9ed9d700 1 --2- 172.21.2.137:0/4234540890 >> v2:172.21.2.111:3300/0 conn(0x7f5da00a9f50 0x7f5da00aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9dd9b700 1 --2- 172.21.2.137:0/4234540890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da0143f00 0x7f5da0144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 -- 172.21.2.137:0/4234540890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da0143f00 msgr2=0x7f5da0144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 --2- 172.21.2.137:0/4234540890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da0143f00 0x7f5da0144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 -- 172.21.2.137:0/4234540890 >> v2:172.21.2.111:3300/0 conn(0x7f5da00a9f50 msgr2=0x7f5da00aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:26.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 --2- 172.21.2.137:0/4234540890 >> v2:172.21.2.111:3300/0 conn(0x7f5da00a9f50 0x7f5da00aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 -- 172.21.2.137:0/4234540890 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da00af800 con 0x7f5da00b1340 2021-11-15T19:27:26.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9e59c700 1 --2- 172.21.2.137:0/4234540890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da00b1340 0x7f5da0147980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f5d88002f70 tx=0x7f5d88006eb0).ready entity=mon.1 client_cookie=ffd5db0062e66834 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9d59a700 1 -- 172.21.2.137:0/4234540890 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8800d570 con 0x7f5da00b1340 2021-11-15T19:27:26.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9d59a700 1 -- 172.21.2.137:0/4234540890 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d88000e90 con 0x7f5da00b1340 2021-11-15T19:27:26.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5d9d59a700 1 -- 172.21.2.137:0/4234540890 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8800d900 con 0x7f5da00b1340 2021-11-15T19:27:26.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- 172.21.2.137:0/4234540890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da00b1340 msgr2=0x7f5da0147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- 172.21.2.137:0/4234540890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da00b1340 0x7f5da0147980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f5d88002f70 tx=0x7f5d88006eb0).stop 2021-11-15T19:27:26.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- 172.21.2.137:0/4234540890 shutdown_connections 2021-11-15T19:27:26.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- 172.21.2.137:0/4234540890 >> v2:172.21.2.111:3300/0 conn(0x7f5da00a9f50 0x7f5da00aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- 172.21.2.137:0/4234540890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da0143f00 0x7f5da0144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 --2- 172.21.2.137:0/4234540890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da00b1340 0x7f5da0147980 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- 172.21.2.137:0/4234540890 >> 172.21.2.137:0/4234540890 conn(0x7f5da00b4e60 msgr2=0x7f5da00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- 172.21.2.137:0/4234540890 shutdown_connections 2021-11-15T19:27:26.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.592+0000 7f5da49b7700 1 -- 172.21.2.137:0/4234540890 wait complete. 2021-11-15T19:27:26.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 Processor -- start 2021-11-15T19:27:26.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- start start 2021-11-15T19:27:26.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5da00a9f50 0x7f5da00b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da00b1340 0x7f5da013d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 0x7f5da013db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da01495e0 con 0x7f5da00a9f50 2021-11-15T19:27:26.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015aa10 con 0x7f5da0143f00 2021-11-15T19:27:26.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da009a3c0 con 0x7f5da00b1340 2021-11-15T19:27:26.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 0x7f5da013db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 0x7f5da013db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32812/0 (socket says 172.21.2.137:32812) 2021-11-15T19:27:26.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 -- 172.21.2.137:0/1103960070 learned_addr learned my addr 172.21.2.137:0/1103960070 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:26.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9e59c700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5da00a9f50 0x7f5da00b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9dd9b700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da00b1340 0x7f5da013d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 -- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da00b1340 msgr2=0x7f5da013d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da00b1340 0x7f5da013d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 -- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5da00a9f50 msgr2=0x7f5da00b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5da00a9f50 0x7f5da00b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 -- 172.21.2.137:0/1103960070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8800b1e0 con 0x7f5da0143f00 2021-11-15T19:27:26.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9ed9d700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 0x7f5da013db60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f5d9800a000 tx=0x7f5d98008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d980127e0 con 0x7f5da0143f00 2021-11-15T19:27:26.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98012940 con 0x7f5da0143f00 2021-11-15T19:27:26.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da0099c60 con 0x7f5da0143f00 2021-11-15T19:27:26.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d98012ca0 con 0x7f5da0143f00 2021-11-15T19:27:26.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da013e050 con 0x7f5da0143f00 2021-11-15T19:27:26.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da009a500 con 0x7f5da0143f00 2021-11-15T19:27:26.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d98013480 con 0x7f5da0143f00 2021-11-15T19:27:26.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d977fe700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d840536a0 0x7f5d84055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:26.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5d9806bc30 con 0x7f5da0143f00 2021-11-15T19:27:26.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9e59c700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d840536a0 0x7f5d84055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:26.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.596+0000 7f5d9e59c700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d840536a0 0x7f5d84055b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5d8801c000 tx=0x7f5d88015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:26.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.600+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d98042d30 con 0x7f5da0143f00 2021-11-15T19:27:26.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5da005faf0 con 0x7f5da0143f00 2021-11-15T19:27:26.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5d977fe700 1 -- 172.21.2.137:0/1103960070 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f5d98012e00 con 0x7f5da0143f00 2021-11-15T19:27:26.717 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:26.717 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:27:26.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d840536a0 msgr2=0x7f5d84055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d840536a0 0x7f5d84055b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5d8801c000 tx=0x7f5d88015000).stop 2021-11-15T19:27:26.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 msgr2=0x7f5da013db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:26.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 0x7f5da013db60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f5d9800a000 tx=0x7f5d98008040).stop 2021-11-15T19:27:26.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 shutdown_connections 2021-11-15T19:27:26.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d840536a0 0x7f5d84055b60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5da0143f00 0x7f5da013db60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5da00b1340 0x7f5da013d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 --2- 172.21.2.137:0/1103960070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5da00a9f50 0x7f5da00b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:26.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 >> 172.21.2.137:0/1103960070 conn(0x7f5da00b4e60 msgr2=0x7f5da0145c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:26.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 shutdown_connections 2021-11-15T19:27:26.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:26.712+0000 7f5da49b7700 1 -- 172.21.2.137:0/1103960070 wait complete. 2021-11-15T19:27:26.720 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:27:26.925 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:27:24.602277+0000', 'modified': '2021-11-15T19:27:25.606904+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4855}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4855': {'gid': 4855, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/2316902828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 2316902828}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 2316902828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:27:26.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:27:26.927 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:27:26.995 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":4855,"want_state":"up:active","state":"up:active","rank_uptime":2.3834765999999998,"mdsmap_epoch":10,"osdmap_epoch":31,"osdmap_epoch_barrier":29,"uptime":7.6461151809999999} 2021-11-15T19:27:26.996 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 4855, "mdsmap_epoch": 10, "osdmap_epoch": 31, "osdmap_epoch_barrier": 29, "rank_uptime": 2.3834766, "state": "up:active", "uptime": 7.646115181, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:27:26.996 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:27:27.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f492ac26700 1 Processor -- start 2021-11-15T19:27:27.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f492ac26700 1 -- start start 2021-11-15T19:27:27.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f492ac26700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4924144610 0x7f4924147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f492ac26700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4924148190 con 0x7f49240a9f50 2021-11-15T19:27:27.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f492ac26700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240b1720 con 0x7f49240b1340 2021-11-15T19:27:27.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f492ac26700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4924147e70 con 0x7f4924144610 2021-11-15T19:27:27.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f49289c2700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f49240b1340 0x7f4924143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51598/0 (socket says 172.21.2.137:51598) 2021-11-15T19:27:27.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f49289c2700 1 -- 172.21.2.137:0/1403819916 learned_addr learned my addr 172.21.2.137:0/1403819916 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:27.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f4923fff700 1 --2- 172.21.2.137:0/1403819916 >> v2:172.21.2.137:3300/0 conn(0x7f4924144610 0x7f4924147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f4923fff700 1 -- 172.21.2.137:0/1403819916 >> v1:172.21.2.137:6789/0 conn(0x7f49240b1340 legacy=0x7f4924143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f4923fff700 1 -- 172.21.2.137:0/1403819916 >> v1:172.21.2.111:6789/0 conn(0x7f49240a9f50 legacy=0x7f49240aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f4923fff700 1 -- 172.21.2.137:0/1403819916 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240af800 con 0x7f4924144610 2021-11-15T19:27:27.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f4923fff700 1 --2- 172.21.2.137:0/1403819916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4924144610 0x7f4924147980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4924062250 tx=0x7f4918006df0).ready entity=mon.1 client_cookie=b0f1bfdbdb11cc49 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f49237fe700 1 -- 172.21.2.137:0/1403819916 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491800d5c0 con 0x7f4924144610 2021-11-15T19:27:27.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f49237fe700 1 -- 172.21.2.137:0/1403819916 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4918000e90 con 0x7f4924144610 2021-11-15T19:27:27.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.040+0000 7f49237fe700 1 -- 172.21.2.137:0/1403819916 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491800d910 con 0x7f4924144610 2021-11-15T19:27:27.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/1403819916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4924144610 msgr2=0x7f4924147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 --2- 172.21.2.137:0/1403819916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4924144610 0x7f4924147980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4924062250 tx=0x7f4918006df0).stop 2021-11-15T19:27:27.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/1403819916 shutdown_connections 2021-11-15T19:27:27.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 --2- 172.21.2.137:0/1403819916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4924144610 0x7f4924147980 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/1403819916 >> 172.21.2.137:0/1403819916 conn(0x7f49240b4e60 msgr2=0x7f49240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/1403819916 shutdown_connections 2021-11-15T19:27:27.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/1403819916 wait complete. 2021-11-15T19:27:27.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 Processor -- start 2021-11-15T19:27:27.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- start start 2021-11-15T19:27:27.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f49240a9f50 0x7f4924098550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 0x7f4924159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4924144610 0x7f4924157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241413e0 con 0x7f49240a9f50 2021-11-15T19:27:27.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924156a20 con 0x7f49240b1340 2021-11-15T19:27:27.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4924156cc0 con 0x7f4924144610 2021-11-15T19:27:27.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 0x7f4924159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 0x7f4924159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32824/0 (socket says 172.21.2.137:32824) 2021-11-15T19:27:27.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 -- 172.21.2.137:0/857603075 learned_addr learned my addr 172.21.2.137:0/857603075 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 -- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4924144610 msgr2=0x7f4924157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4924144610 0x7f4924157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 -- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f49240a9f50 msgr2=0x7f4924098550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f49240a9f50 0x7f4924098550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 -- 172.21.2.137:0/857603075 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491800b180 con 0x7f49240b1340 2021-11-15T19:27:27.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4923fff700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 0x7f4924159ea0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4924062250 tx=0x7f4918012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4918002f70 con 0x7f49240b1340 2021-11-15T19:27:27.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4918013d50 con 0x7f49240b1340 2021-11-15T19:27:27.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491801f640 con 0x7f49240b1340 2021-11-15T19:27:27.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924145360 con 0x7f49240b1340 2021-11-15T19:27:27.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492415a390 con 0x7f49240b1340 2021-11-15T19:27:27.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4924156e80 con 0x7f49240b1340 2021-11-15T19:27:27.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f491801c070 con 0x7f49240b1340 2021-11-15T19:27:27.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4921ffb700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49040536f0 0x7f4904055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.044+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f491806c480 con 0x7f49240b1340 2021-11-15T19:27:27.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.048+0000 7f49289c2700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49040536f0 0x7f4904055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.048+0000 7f49289c2700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49040536f0 0x7f4904055bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f492405cfa0 tx=0x7f4914007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.048+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4918043580 con 0x7f49240b1340 2021-11-15T19:27:27.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4924148190 con 0x7f49240b1340 2021-11-15T19:27:27.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f4921ffb700 1 -- 172.21.2.137:0/857603075 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f4924148190 con 0x7f49240b1340 2021-11-15T19:27:27.137 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:27.137 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":31,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:27:26.620514+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:27:22.499670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T19:27:23.496407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:27:27.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49040536f0 msgr2=0x7f4904055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49040536f0 0x7f4904055bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f492405cfa0 tx=0x7f4914007800).stop 2021-11-15T19:27:27.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 msgr2=0x7f4924159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 0x7f4924159ea0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4924062250 tx=0x7f4918012000).stop 2021-11-15T19:27:27.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 shutdown_connections 2021-11-15T19:27:27.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f49040536f0 0x7f4904055bb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4924144610 0x7f4924157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f49240b1340 0x7f4924159ea0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 --2- 172.21.2.137:0/857603075 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f49240a9f50 0x7f4924098550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 >> 172.21.2.137:0/857603075 conn(0x7f49240b4e60 msgr2=0x7f49240aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 shutdown_connections 2021-11-15T19:27:27.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.132+0000 7f492ac26700 1 -- 172.21.2.137:0/857603075 wait complete. 2021-11-15T19:27:27.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:27:22.499670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:27:23.496407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:27:27.146 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:27:27.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 Processor -- start 2021-11-15T19:27:27.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 -- start start 2021-11-15T19:27:27.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa8c805c770 0x7fa8c80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa8c8140aa0 0x7fa8c8140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c805cb50 con 0x7fa8c80b0550 2021-11-15T19:27:27.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80b1650 con 0x7fa8c805c770 2021-11-15T19:27:27.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8cd194700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80ad030 con 0x7fa8c8140aa0 2021-11-15T19:27:27.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c659c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa8c80b0550 0x7fa8c814a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51614/0 (socket says 172.21.2.137:51614) 2021-11-15T19:27:27.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c659c700 1 -- 172.21.2.137:0/3353295989 learned_addr learned my addr 172.21.2.137:0/3353295989 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:27.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c759e700 1 --2- 172.21.2.137:0/3353295989 >> v2:172.21.2.137:3300/0 conn(0x7fa8c8140aa0 0x7fa8c8140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c759e700 1 -- 172.21.2.137:0/3353295989 >> v2:172.21.2.111:3300/0 conn(0x7fa8c805c770 msgr2=0x7fa8c80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c759e700 1 --2- 172.21.2.137:0/3353295989 >> v2:172.21.2.111:3300/0 conn(0x7fa8c805c770 0x7fa8c80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c759e700 1 -- 172.21.2.137:0/3353295989 >> v1:172.21.2.137:6789/0 conn(0x7fa8c80b0550 legacy=0x7fa8c814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c759e700 1 -- 172.21.2.137:0/3353295989 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80ad2d0 con 0x7fa8c8140aa0 2021-11-15T19:27:27.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c759e700 1 --2- 172.21.2.137:0/3353295989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c8140aa0 0x7fa8c8140ef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fa8b8001110 tx=0x7fa8c00091d0).ready entity=mon.1 client_cookie=4c825075ccd8b78a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c5d9b700 1 -- 172.21.2.137:0/3353295989 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c0009ea0 con 0x7fa8c8140aa0 2021-11-15T19:27:27.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c5d9b700 1 -- 172.21.2.137:0/3353295989 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c000b730 con 0x7fa8c8140aa0 2021-11-15T19:27:27.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.192+0000 7fa8c5d9b700 1 -- 172.21.2.137:0/3353295989 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c000b8a0 con 0x7fa8c8140aa0 2021-11-15T19:27:27.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/3353295989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c8140aa0 msgr2=0x7fa8c8140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 --2- 172.21.2.137:0/3353295989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c8140aa0 0x7fa8c8140ef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fa8b8001110 tx=0x7fa8c00091d0).stop 2021-11-15T19:27:27.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/3353295989 shutdown_connections 2021-11-15T19:27:27.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 --2- 172.21.2.137:0/3353295989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c8140aa0 0x7fa8c8140ef0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 --2- 172.21.2.137:0/3353295989 >> v2:172.21.2.111:3300/0 conn(0x7fa8c805c770 0x7fa8c80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/3353295989 >> 172.21.2.137:0/3353295989 conn(0x7fa8c80631e0 msgr2=0x7fa8c805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/3353295989 shutdown_connections 2021-11-15T19:27:27.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/3353295989 wait complete. 2021-11-15T19:27:27.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 Processor -- start 2021-11-15T19:27:27.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- start start 2021-11-15T19:27:27.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 0x7fa8c81562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8c80b0550 0x7fa8c8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8c8140aa0 0x7fa8c814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8141a00 con 0x7fa8c8140aa0 2021-11-15T19:27:27.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8143b00 con 0x7fa8c805c770 2021-11-15T19:27:27.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8143da0 con 0x7fa8c80b0550 2021-11-15T19:27:27.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 0x7fa8c81562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 0x7fa8c81562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32840/0 (socket says 172.21.2.137:32840) 2021-11-15T19:27:27.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 -- 172.21.2.137:0/1920753061 learned_addr learned my addr 172.21.2.137:0/1920753061 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 -- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8c80b0550 msgr2=0x7fa8c8065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8c80b0550 0x7fa8c8065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 -- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8c8140aa0 msgr2=0x7fa8c814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8c8140aa0 0x7fa8c814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 -- 172.21.2.137:0/1920753061 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0009470 con 0x7fa8c805c770 2021-11-15T19:27:27.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c6d9d700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 0x7fa8c81562e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fa8b0002f70 tx=0x7fa8b0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8b0013460 con 0x7fa8c805c770 2021-11-15T19:27:27.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b00135c0 con 0x7fa8c805c770 2021-11-15T19:27:27.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c81416f0 con 0x7fa8c805c770 2021-11-15T19:27:27.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8b0013920 con 0x7fa8c805c770 2021-11-15T19:27:27.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c8065aa0 con 0x7fa8c805c770 2021-11-15T19:27:27.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c80ae7f0 con 0x7fa8c805c770 2021-11-15T19:27:27.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8b001a060 con 0x7fa8c805c770 2021-11-15T19:27:27.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8bffff700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8ac053610 0x7fa8ac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa8b006b390 con 0x7fa8c805c770 2021-11-15T19:27:27.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.196+0000 7fa8c659c700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8ac053610 0x7fa8ac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.200+0000 7fa8c659c700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8ac053610 0x7fa8ac055ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa8b80011d0 tx=0x7fa8b80077d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.200+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8b00424f0 con 0x7fa8c805c770 2021-11-15T19:27:27.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa8c805db30 con 0x7fa8c805c770 2021-11-15T19:27:27.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8bffff700 1 -- 172.21.2.137:0/1920753061 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa8b0045b10 con 0x7fa8c805c770 2021-11-15T19:27:27.290 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:27:27.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8ac053610 msgr2=0x7fa8ac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8ac053610 0x7fa8ac055ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa8b80011d0 tx=0x7fa8b80077d0).stop 2021-11-15T19:27:27.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 msgr2=0x7fa8c81562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 0x7fa8c81562e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fa8b0002f70 tx=0x7fa8b0006ec0).stop 2021-11-15T19:27:27.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 shutdown_connections 2021-11-15T19:27:27.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8ac053610 0x7fa8ac055ad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8c8140aa0 0x7fa8c814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8c80b0550 0x7fa8c8065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 --2- 172.21.2.137:0/1920753061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8c805c770 0x7fa8c81562e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 >> 172.21.2.137:0/1920753061 conn(0x7fa8c80631e0 msgr2=0x7fa8c813ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 shutdown_connections 2021-11-15T19:27:27.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.284+0000 7fa8cd194700 1 -- 172.21.2.137:0/1920753061 wait complete. 2021-11-15T19:27:27.298 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:27:27.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 Processor -- start 2021-11-15T19:27:27.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 -- start start 2021-11-15T19:27:27.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbad8065730 0x7fbad813c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 0x7fbad813c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad8066270 con 0x7fbad80b00a0 2021-11-15T19:27:27.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad8067410 con 0x7fbad8065730 2021-11-15T19:27:27.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8065fd0 con 0x7fbad8065b10 2021-11-15T19:27:27.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbad8065730 0x7fbad813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbad8065730 0x7fbad813c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32844/0 (socket says 172.21.2.137:32844) 2021-11-15T19:27:27.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 -- 172.21.2.137:0/2664554347 learned_addr learned my addr 172.21.2.137:0/2664554347 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 -- 172.21.2.137:0/2664554347 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 msgr2=0x7fbad813c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:27.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 --2- 172.21.2.137:0/2664554347 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 0x7fbad813c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 -- 172.21.2.137:0/2664554347 >> v1:172.21.2.111:6789/0 conn(0x7fbad80b00a0 legacy=0x7fbad805bd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:27.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 -- 172.21.2.137:0/2664554347 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8066f70 con 0x7fbad8065730 2021-11-15T19:27:27.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad7fff700 1 --2- 172.21.2.137:0/2664554347 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad813c2b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fbad8060dc0 tx=0x7fbac8006e40).ready entity=mon.1 client_cookie=3552fb166079d200 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad6ffd700 1 -- 172.21.2.137:0/2664554347 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac800bcb0 con 0x7fbad8065730 2021-11-15T19:27:27.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad6ffd700 1 -- 172.21.2.137:0/2664554347 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8000e90 con 0x7fbad8065730 2021-11-15T19:27:27.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbad6ffd700 1 -- 172.21.2.137:0/2664554347 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac80155e0 con 0x7fbad8065730 2021-11-15T19:27:27.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.344+0000 7fbade728700 1 -- 172.21.2.137:0/2664554347 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 msgr2=0x7fbad813c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 --2- 172.21.2.137:0/2664554347 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad813c2b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fbad8060dc0 tx=0x7fbac8006e40).stop 2021-11-15T19:27:27.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/2664554347 shutdown_connections 2021-11-15T19:27:27.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 --2- 172.21.2.137:0/2664554347 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 0x7fbad813c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 --2- 172.21.2.137:0/2664554347 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad813c2b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/2664554347 >> 172.21.2.137:0/2664554347 conn(0x7fbad8060290 msgr2=0x7fbad8060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/2664554347 shutdown_connections 2021-11-15T19:27:27.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/2664554347 wait complete. 2021-11-15T19:27:27.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 Processor -- start 2021-11-15T19:27:27.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- start start 2021-11-15T19:27:27.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad80ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 0x7fbad80acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbad80b00a0 0x7fbad81369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81426b0 con 0x7fbad80b00a0 2021-11-15T19:27:27.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80afd00 con 0x7fbad8065730 2021-11-15T19:27:27.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8142de0 con 0x7fbad8065b10 2021-11-15T19:27:27.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad80ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad80ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32850/0 (socket says 172.21.2.137:32850) 2021-11-15T19:27:27.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 -- 172.21.2.137:0/762330914 learned_addr learned my addr 172.21.2.137:0/762330914 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 -- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 msgr2=0x7fbad80acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 0x7fbad80acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 -- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbad80b00a0 msgr2=0x7fbad81369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbad80b00a0 0x7fbad81369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 -- 172.21.2.137:0/762330914 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac800d4d0 con 0x7fbad8065730 2021-11-15T19:27:27.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad7fff700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad80ae2a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fbad80ada10 tx=0x7fbac8018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac8009070 con 0x7fbad8065730 2021-11-15T19:27:27.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8015c70 con 0x7fbad8065730 2021-11-15T19:27:27.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad8143080 con 0x7fbad8065730 2021-11-15T19:27:27.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad8142ae0 con 0x7fbad8065730 2021-11-15T19:27:27.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac800be40 con 0x7fbad8065730 2021-11-15T19:27:27.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab0003410 con 0x7fbad8065730 2021-11-15T19:27:27.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbac801e3f0 con 0x7fbad8065730 2021-11-15T19:27:27.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad57fa700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbab80536f0 0x7fbab8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.348+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbac806c980 con 0x7fbad8065730 2021-11-15T19:27:27.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.352+0000 7fbad77fe700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbab80536f0 0x7fbab8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.352+0000 7fbad77fe700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbab80536f0 0x7fbab8055bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbacc002fb0 tx=0x7fbacc0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.352+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbac80439b0 con 0x7fbad8065730 2021-11-15T19:27:27.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbab0003c40 con 0x7fbad8065730 2021-11-15T19:27:27.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbad57fa700 1 -- 172.21.2.137:0/762330914 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbac8046f90 con 0x7fbad8065730 2021-11-15T19:27:27.442 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:27.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbab80536f0 msgr2=0x7fbab8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbab80536f0 0x7fbab8055bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbacc002fb0 tx=0x7fbacc0069b0).stop 2021-11-15T19:27:27.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 msgr2=0x7fbad80ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad80ae2a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fbad80ada10 tx=0x7fbac8018000).stop 2021-11-15T19:27:27.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 shutdown_connections 2021-11-15T19:27:27.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbab80536f0 0x7fbab8055bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbad80b00a0 0x7fbad81369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbad8065b10 0x7fbad80acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 --2- 172.21.2.137:0/762330914 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbad8065730 0x7fbad80ae2a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 >> 172.21.2.137:0/762330914 conn(0x7fbad8060290 msgr2=0x7fbad805c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 shutdown_connections 2021-11-15T19:27:27.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.436+0000 7fbade728700 1 -- 172.21.2.137:0/762330914 wait complete. 2021-11-15T19:27:27.449 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:27:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 Processor -- start 2021-11-15T19:27:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 -- start start 2021-11-15T19:27:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa44c065730 0x7fa44c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c065b10 0x7fa44c13c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c066270 con 0x7fa44c0b00a0 2021-11-15T19:27:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c067410 con 0x7fa44c065730 2021-11-15T19:27:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa453158700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c065fd0 con 0x7fa44c065b10 2021-11-15T19:27:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa450ef4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa44c065730 0x7fa44c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa44bfff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c065b10 0x7fa44c13c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa4516f5700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fa44c0b00a0 0x7fa44c05bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:44134/0 (socket says 172.21.2.137:44134) 2021-11-15T19:27:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.496+0000 7fa4516f5700 1 -- 172.21.2.137:0/211877512 learned_addr learned my addr 172.21.2.137:0/211877512 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/211877512 >> v2:172.21.2.111:3300/0 conn(0x7fa44c065730 msgr2=0x7fa44c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- 172.21.2.137:0/211877512 >> v2:172.21.2.111:3300/0 conn(0x7fa44c065730 0x7fa44c13c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/211877512 >> v1:172.21.2.111:6789/0 conn(0x7fa44c0b00a0 legacy=0x7fa44c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/211877512 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c066f70 con 0x7fa44c065b10 2021-11-15T19:27:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa450ef4700 1 --2- 172.21.2.137:0/211877512 >> v2:172.21.2.111:3300/0 conn(0x7fa44c065730 0x7fa44c13c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:27:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- 172.21.2.137:0/211877512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c065b10 0x7fa44c13c7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa434002f70 tx=0x7fa434006df0).ready entity=mon.2 client_cookie=8fb55174d31ac9c6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44b7fe700 1 -- 172.21.2.137:0/211877512 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa434014070 con 0x7fa44c065b10 2021-11-15T19:27:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44b7fe700 1 -- 172.21.2.137:0/211877512 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434000e90 con 0x7fa44c065b10 2021-11-15T19:27:27.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44b7fe700 1 -- 172.21.2.137:0/211877512 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43400fb60 con 0x7fa44c065b10 2021-11-15T19:27:27.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/211877512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c065b10 msgr2=0x7fa44c13c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 --2- 172.21.2.137:0/211877512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c065b10 0x7fa44c13c7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa434002f70 tx=0x7fa434006df0).stop 2021-11-15T19:27:27.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/211877512 shutdown_connections 2021-11-15T19:27:27.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 --2- 172.21.2.137:0/211877512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c065b10 0x7fa44c13c7a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 --2- 172.21.2.137:0/211877512 >> v2:172.21.2.111:3300/0 conn(0x7fa44c065730 0x7fa44c13c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/211877512 >> 172.21.2.137:0/211877512 conn(0x7fa44c060290 msgr2=0x7fa44c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/211877512 shutdown_connections 2021-11-15T19:27:27.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/211877512 wait complete. 2021-11-15T19:27:27.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 Processor -- start 2021-11-15T19:27:27.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- start start 2021-11-15T19:27:27.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa44c065730 0x7fa44c147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 0x7fa44c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c0b00a0 0x7fa44c0ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0af5c0 con 0x7fa44c065730 2021-11-15T19:27:27.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c141730 con 0x7fa44c065b10 2021-11-15T19:27:27.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c142100 con 0x7fa44c0b00a0 2021-11-15T19:27:27.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 0x7fa44c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 0x7fa44c0add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32866/0 (socket says 172.21.2.137:32866) 2021-11-15T19:27:27.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/3891304041 learned_addr learned my addr 172.21.2.137:0/3891304041 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa450ef4700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa44c065730 0x7fa44c147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa4516f5700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c0b00a0 0x7fa44c0ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c0b00a0 msgr2=0x7fa44c0ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c0b00a0 0x7fa44c0ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa44c065730 msgr2=0x7fa44c147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa44c065730 0x7fa44c147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 -- 172.21.2.137:0/3891304041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c00b180 con 0x7fa44c065b10 2021-11-15T19:27:27.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa44bfff700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 0x7fa44c0add70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fa434002f70 tx=0x7fa434016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa434010d50 con 0x7fa44c065b10 2021-11-15T19:27:27.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43401c440 con 0x7fa44c065b10 2021-11-15T19:27:27.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43400b180 con 0x7fa44c065b10 2021-11-15T19:27:27.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43401c7a0 con 0x7fa44c065b10 2021-11-15T19:27:27.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.500+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c1423a0 con 0x7fa44c065b10 2021-11-15T19:27:27.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c149510 con 0x7fa44c065b10 2021-11-15T19:27:27.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa434022020 con 0x7fa44c065b10 2021-11-15T19:27:27.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa449ffb700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4300536d0 0x7fa430055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa43406d440 con 0x7fa44c065b10 2021-11-15T19:27:27.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa450ef4700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4300536d0 0x7fa430055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa450ef4700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4300536d0 0x7fa430055b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa43c00b000 tx=0x7fa43c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.504+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4340445a0 con 0x7fa44c065b10 2021-11-15T19:27:27.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa44c1425c0 con 0x7fa44c065b10 2021-11-15T19:27:27.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa449ffb700 1 -- 172.21.2.137:0/3891304041 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa434047bc0 con 0x7fa44c065b10 2021-11-15T19:27:27.595 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:27.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4300536d0 msgr2=0x7fa430055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4300536d0 0x7fa430055b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa43c00b000 tx=0x7fa43c008040).stop 2021-11-15T19:27:27.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 msgr2=0x7fa44c0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 0x7fa44c0add70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fa434002f70 tx=0x7fa434016000).stop 2021-11-15T19:27:27.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 shutdown_connections 2021-11-15T19:27:27.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4300536d0 0x7fa430055b90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44c0b00a0 0x7fa44c0ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa44c065b10 0x7fa44c0add70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 --2- 172.21.2.137:0/3891304041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa44c065730 0x7fa44c147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 >> 172.21.2.137:0/3891304041 conn(0x7fa44c060290 msgr2=0x7fa44c05cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 shutdown_connections 2021-11-15T19:27:27.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.588+0000 7fa453158700 1 -- 172.21.2.137:0/3891304041 wait complete. 2021-11-15T19:27:27.602 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:27:27.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde56a7d700 1 Processor -- start 2021-11-15T19:27:27.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde56a7d700 1 -- start start 2021-11-15T19:27:27.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde56a7d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fde500b72e0 0x7fde500b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde56a7d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500b76c0 con 0x7fde500acd60 2021-11-15T19:27:27.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde56a7d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5012a170 con 0x7fde500ad320 2021-11-15T19:27:27.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde56a7d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500b3100 con 0x7fde500b72e0 2021-11-15T19:27:27.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde5501a700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fde500ad320 0x7fde501290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51656/0 (socket says 172.21.2.137:51656) 2021-11-15T19:27:27.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde5501a700 1 -- 172.21.2.137:0/3987170147 learned_addr learned my addr 172.21.2.137:0/3987170147 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:27.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942044144 0 0) 0x7fde5012a170 con 0x7fde500ad320 2021-11-15T19:27:27.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde54819700 1 --2- 172.21.2.137:0/3987170147 >> v2:172.21.2.111:3300/0 conn(0x7fde500b72e0 0x7fde500b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde30003260 con 0x7fde500ad320 2021-11-15T19:27:27.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670866149 0 0) 0x7fde30003260 con 0x7fde500ad320 2021-11-15T19:27:27.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 >> v2:172.21.2.111:3300/0 conn(0x7fde500b72e0 msgr2=0x7fde500b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/3987170147 >> v2:172.21.2.111:3300/0 conn(0x7fde500b72e0 0x7fde500b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 >> v1:172.21.2.111:6789/0 conn(0x7fde500acd60 legacy=0x7fde500b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.648+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500ad8a0 con 0x7fde500ad320 2021-11-15T19:27:27.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fde480019e0 con 0x7fde500ad320 2021-11-15T19:27:27.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 >> v1:172.21.2.137:6789/0 conn(0x7fde500ad320 legacy=0x7fde501290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003750 0x7fde30003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30004500 0x7fde30004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004ec0 0x7fde3000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b3100 con 0x7fde30004500 2021-11-15T19:27:27.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3000bda0 con 0x7fde30003750 2021-11-15T19:27:27.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3000bf60 con 0x7fde30004ec0 2021-11-15T19:27:27.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003750 0x7fde30003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4ffff700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30004500 0x7fde30004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004ec0 0x7fde3000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 -- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004ec0 msgr2=0x7fde3000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde30004ec0 0x7fde3000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 -- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30004500 msgr2=0x7fde30004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30004500 0x7fde30004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 -- 172.21.2.137:0/3987170147 reap_dead start 2021-11-15T19:27:27.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 -- 172.21.2.137:0/3987170147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30003260 con 0x7fde30003750 2021-11-15T19:27:27.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003750 0x7fde30003b70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fde4000a000 tx=0x7fde40008040).ready entity=mon.1 client_cookie=6b274e5616745d04 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde40013670 con 0x7fde30003750 2021-11-15T19:27:27.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde400137d0 con 0x7fde30003750 2021-11-15T19:27:27.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4f7fe700 1 -- 172.21.2.137:0/3987170147 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde40013b30 con 0x7fde30003750 2021-11-15T19:27:27.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/3987170147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003750 msgr2=0x7fde30003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003750 0x7fde30003b70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fde4000a000 tx=0x7fde40008040).stop 2021-11-15T19:27:27.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/3987170147 shutdown_connections 2021-11-15T19:27:27.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 --2- 172.21.2.137:0/3987170147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde30003750 0x7fde30003b70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/3987170147 >> 172.21.2.137:0/3987170147 conn(0x7fde50064960 msgr2=0x7fde50064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/3987170147 shutdown_connections 2021-11-15T19:27:27.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/3987170147 wait complete. 2021-11-15T19:27:27.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 Processor -- start 2021-11-15T19:27:27.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- start start 2021-11-15T19:27:27.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30003750 0x7fde500b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde500b0f80 0x7fde500afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 0x7fde500b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500af930 con 0x7fde30003750 2021-11-15T19:27:27.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50141f90 con 0x7fde5013fb60 2021-11-15T19:27:27.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde50142230 con 0x7fde500b0f80 2021-11-15T19:27:27.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 0x7fde500b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 0x7fde500b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32888/0 (socket says 172.21.2.137:32888) 2021-11-15T19:27:27.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 -- 172.21.2.137:0/1080375684 learned_addr learned my addr 172.21.2.137:0/1080375684 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde54819700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30003750 0x7fde500b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4ffff700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde500b0f80 0x7fde500afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 -- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde500b0f80 msgr2=0x7fde500afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde500b0f80 0x7fde500afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 -- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30003750 msgr2=0x7fde500b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30003750 0x7fde500b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 -- 172.21.2.137:0/1080375684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde501426d0 con 0x7fde5013fb60 2021-11-15T19:27:27.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde5501a700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 0x7fde500b0010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fde500ae9d0 tx=0x7fde500ada30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde48010710 con 0x7fde5013fb60 2021-11-15T19:27:27.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48010870 con 0x7fde5013fb60 2021-11-15T19:27:27.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500af510 con 0x7fde5013fb60 2021-11-15T19:27:27.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde48010bd0 con 0x7fde5013fb60 2021-11-15T19:27:27.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.652+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500b06a0 con 0x7fde5013fb60 2021-11-15T19:27:27.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde501423f0 con 0x7fde5013fb60 2021-11-15T19:27:27.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde48010d30 con 0x7fde5013fb60 2021-11-15T19:27:27.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde4dffb700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde340536a0 0x7fde34055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fde4806bce0 con 0x7fde5013fb60 2021-11-15T19:27:27.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde54819700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde340536a0 0x7fde34055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde54819700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde340536a0 0x7fde34055b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fde4001b000 tx=0x7fde40008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.656+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde48042de0 con 0x7fde5013fb60 2021-11-15T19:27:27.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde500b3a50 con 0x7fde5013fb60 2021-11-15T19:27:27.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde4dffb700 1 -- 172.21.2.137:0/1080375684 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+10 (secure 0 0 0) 0x7fde48046400 con 0x7fde5013fb60 2021-11-15T19:27:27.746 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:27:27.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde340536a0 msgr2=0x7fde34055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde340536a0 0x7fde34055b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fde4001b000 tx=0x7fde40008040).stop 2021-11-15T19:27:27.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 msgr2=0x7fde500b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 0x7fde500b0010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fde500ae9d0 tx=0x7fde500ada30).stop 2021-11-15T19:27:27.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 shutdown_connections 2021-11-15T19:27:27.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde340536a0 0x7fde34055b60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde5013fb60 0x7fde500b0010 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde500b0f80 0x7fde500afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 --2- 172.21.2.137:0/1080375684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde30003750 0x7fde500b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 >> 172.21.2.137:0/1080375684 conn(0x7fde50064960 msgr2=0x7fde50140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 shutdown_connections 2021-11-15T19:27:27.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.740+0000 7fde56a7d700 1 -- 172.21.2.137:0/1080375684 wait complete. 2021-11-15T19:27:27.753 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:27:27.753 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:27.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 Processor -- start 2021-11-15T19:27:27.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 -- start start 2021-11-15T19:27:27.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13100ac3c0 0x7f13100ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f13100b2d50 0x7f13101440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1310097c50 con 0x7f13101445b0 2021-11-15T19:27:27.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100ac120 con 0x7f13100b2d50 2021-11-15T19:27:27.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f131675b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310061100 con 0x7f13100ac3c0 2021-11-15T19:27:27.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130ffff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13100ac3c0 0x7f13100ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f1314cf8700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f13101445b0 0x7f131005f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:44166/0 (socket says 172.21.2.137:44166) 2021-11-15T19:27:27.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130f7fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f13100b2d50 0x7f13101440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f1314cf8700 1 -- 172.21.2.137:0/1137808264 learned_addr learned my addr 172.21.2.137:0/1137808264 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:27.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130ffff700 1 -- 172.21.2.137:0/1137808264 >> v2:172.21.2.111:3300/0 conn(0x7f13100b2d50 msgr2=0x7f13101440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:27.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130ffff700 1 --2- 172.21.2.137:0/1137808264 >> v2:172.21.2.111:3300/0 conn(0x7f13100b2d50 0x7f13101440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130ffff700 1 -- 172.21.2.137:0/1137808264 >> v1:172.21.2.111:6789/0 conn(0x7f13101445b0 legacy=0x7f131005f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130ffff700 1 -- 172.21.2.137:0/1137808264 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100979b0 con 0x7f13100ac3c0 2021-11-15T19:27:27.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.800+0000 7f130ffff700 1 --2- 172.21.2.137:0/1137808264 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13100ac3c0 0x7f13100ac7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1304002f70 tx=0x7f1304006df0).ready entity=mon.2 client_cookie=1cdec15f5558235f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130effd700 1 -- 172.21.2.137:0/1137808264 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130400d570 con 0x7f13100ac3c0 2021-11-15T19:27:27.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130effd700 1 -- 172.21.2.137:0/1137808264 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304000e90 con 0x7f13100ac3c0 2021-11-15T19:27:27.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130effd700 1 -- 172.21.2.137:0/1137808264 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130400d8c0 con 0x7f13100ac3c0 2021-11-15T19:27:27.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/1137808264 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13100ac3c0 msgr2=0x7f13100ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 --2- 172.21.2.137:0/1137808264 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13100ac3c0 0x7f13100ac7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1304002f70 tx=0x7f1304006df0).stop 2021-11-15T19:27:27.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/1137808264 shutdown_connections 2021-11-15T19:27:27.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 --2- 172.21.2.137:0/1137808264 >> v2:172.21.2.111:3300/0 conn(0x7f13100b2d50 0x7f13101440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 --2- 172.21.2.137:0/1137808264 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13100ac3c0 0x7f13100ac7a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/1137808264 >> 172.21.2.137:0/1137808264 conn(0x7f13100b7070 msgr2=0x7f13100b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/1137808264 shutdown_connections 2021-11-15T19:27:27.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/1137808264 wait complete. 2021-11-15T19:27:27.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 Processor -- start 2021-11-15T19:27:27.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- start start 2021-11-15T19:27:27.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f13100ac3c0 0x7f13100af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13101445b0 0x7f13100b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 0x7f1310153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310096880 con 0x7f13100ac3c0 2021-11-15T19:27:27.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131009a750 con 0x7f131009a240 2021-11-15T19:27:27.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131009a9f0 con 0x7f13101445b0 2021-11-15T19:27:27.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 0x7f1310153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 0x7f1310153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32902/0 (socket says 172.21.2.137:32902) 2021-11-15T19:27:27.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 -- 172.21.2.137:0/2638196450 learned_addr learned my addr 172.21.2.137:0/2638196450 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:27.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 -- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13101445b0 msgr2=0x7f13100b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13101445b0 0x7f13100b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 -- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f13100ac3c0 msgr2=0x7f13100af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f13100ac3c0 0x7f13100af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 -- 172.21.2.137:0/2638196450 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130400b180 con 0x7f131009a240 2021-11-15T19:27:27.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f1314cf8700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 0x7f1310153670 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f13100675a0 tx=0x7f1308007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1308005ba0 con 0x7f131009a240 2021-11-15T19:27:27.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308005d00 con 0x7f131009a240 2021-11-15T19:27:27.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131009ac90 con 0x7f131009a240 2021-11-15T19:27:27.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13080072c0 con 0x7f131009a240 2021-11-15T19:27:27.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1310153d80 con 0x7f131009a240 2021-11-15T19:27:27.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1310067c60 con 0x7f131009a240 2021-11-15T19:27:27.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1308010070 con 0x7f131009a240 2021-11-15T19:27:27.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.804+0000 7f130d7fa700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12f00536a0 0x7f12f0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:27.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.808+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f130806b320 con 0x7f131009a240 2021-11-15T19:27:27.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.808+0000 7f130ffff700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12f00536a0 0x7f12f0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:27.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.808+0000 7f130ffff700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12f00536a0 0x7f12f0055b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1304002f70 tx=0x7f1304014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:27.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.808+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1308042370 con 0x7f131009a240 2021-11-15T19:27:27.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.916+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13100573d0 con 0x7f131009a240 2021-11-15T19:27:27.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.916+0000 7f130d7fa700 1 -- 172.21.2.137:0/2638196450 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f1308045990 con 0x7f131009a240 2021-11-15T19:27:27.924 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:27.925 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:27:27.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12f00536a0 msgr2=0x7f12f0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12f00536a0 0x7f12f0055b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1304002f70 tx=0x7f1304014000).stop 2021-11-15T19:27:27.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 msgr2=0x7f1310153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:27.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 0x7f1310153670 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f13100675a0 tx=0x7f1308007f00).stop 2021-11-15T19:27:27.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 shutdown_connections 2021-11-15T19:27:27.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12f00536a0 0x7f12f0055b60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f131009a240 0x7f1310153670 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:27.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f13101445b0 0x7f13100b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 --2- 172.21.2.137:0/2638196450 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f13100ac3c0 0x7f13100af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:27.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 >> 172.21.2.137:0/2638196450 conn(0x7f13100b7070 msgr2=0x7f13100980e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:27.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 shutdown_connections 2021-11-15T19:27:27.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:27.920+0000 7f131675b700 1 -- 172.21.2.137:0/2638196450 wait complete. 2021-11-15T19:27:27.928 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:27:28.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:27:24.602277+0000', 'modified': '2021-11-15T19:27:25.606904+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4855}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4855': {'gid': 4855, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/2316902828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 2316902828}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 2316902828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:27:28.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:27:28.134 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:27:28.214 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":4855,"want_state":"up:active","state":"up:active","rank_uptime":3.6015388509999999,"mdsmap_epoch":10,"osdmap_epoch":31,"osdmap_epoch_barrier":29,"uptime":8.8641762400000008} 2021-11-15T19:27:28.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 4855, "mdsmap_epoch": 10, "osdmap_epoch": 31, "osdmap_epoch_barrier": 29, "rank_uptime": 3.601538851, "state": "up:active", "uptime": 8.86417624, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:27:28.215 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:27:28.215 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:27:28.215 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:27:28.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:28.216 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:28.227 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:27:28.238 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:28.239 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:28.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:28.246 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:28.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:28.247 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:27:28.251 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:27:28.251 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:28.253 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:27:28.260 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:28.260 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:28.265 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:28.266 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:28.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:28.267 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:27:28.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14132]: starting ceph client 2021-11-15T19:27:28.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:27:28.285+0000 7f8408180080 -1 init, newargv = 0x56302a358c00 newargc=9 2021-11-15T19:27:28.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14132]: starting fuse 2021-11-15T19:27:29.393 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:27:29.405 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:27:29.406 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:27:29.456 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:27:29.456 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:27:29.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:29.458 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:27:29.463 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:27:29.464 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:27:29.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:29.465 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:27:29.465 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:27:29.465 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:27:29.466 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:27:29.466 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:27:29.466 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.467 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:27:29.467 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:27:29.468 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:27:29.468 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.468 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:27:29.469 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:27:29.469 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:27:29.470 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:27:29.470 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.471 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:27:29.471 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:27:29.471 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:27:29.472 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:27:29.472 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:27:29.473 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.473 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:27:29.473 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:27:29.540 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14132.asok 2021-11-15T19:27:29.542 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14132.asok 2021-11-15T19:27:29.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:29.543 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14132.asok status 2021-11-15T19:27:29.590 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:27:29.591 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:27:29.591 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:27:29.591 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:27:29.591 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:27:29.592 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:27:29.592 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:27:29.592 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14132", 2021-11-15T19:27:29.592 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:27:29.592 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:29.593 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:27:29.593 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:27:29.593 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 5050, 2021-11-15T19:27:29.593 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:27:29.594 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:27:29.594 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:27:29.594 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 5050 2021-11-15T19:27:29.594 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:29.594 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:27:29.595 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:27:29.595 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:27:29.595 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2706761833 2021-11-15T19:27:29.595 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:27:29.596 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:29.596 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:27:29.596 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:27:29.596 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:27:29.596 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2706761833 2021-11-15T19:27:29.597 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:27:29.597 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.5050 172.21.2.131:0/2706761833", 2021-11-15T19:27:29.597 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2706761833", 2021-11-15T19:27:29.597 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:27:29.597 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 10, 2021-11-15T19:27:29.598 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 31, 2021-11-15T19:27:29.598 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:27:29.598 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:27:29.598 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:27:29.599 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:27:29.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:29.600 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:29.601 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:29.606 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:27:29.607 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:27:29.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:29.607 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:29.617 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-11-15T19:27:29.676 INFO:teuthology.orchestra.run.gibba037.stdout:{"mds_min_caps_per_client":"100"} 2021-11-15T19:27:29.676 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-11-15T19:27:29.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:27:29.677 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:27:29.677 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:27:29.683 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:27:29.683 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:27:29.684 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:27:29.685 DEBUG:teuthology.orchestra.run.gibba031:> import sys 2021-11-15T19:27:29.685 DEBUG:teuthology.orchestra.run.gibba031:> import time 2021-11-15T19:27:29.685 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:27:29.686 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.686 DEBUG:teuthology.orchestra.run.gibba031:> n = 1000 2021-11-15T19:27:29.687 DEBUG:teuthology.orchestra.run.gibba031:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T19:27:29.687 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.687 DEBUG:teuthology.orchestra.run.gibba031:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T19:27:29.688 DEBUG:teuthology.orchestra.run.gibba031:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T19:27:29.688 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:27:29.688 DEBUG:teuthology.orchestra.run.gibba031:> for i in range(0, n): 2021-11-15T19:27:29.689 DEBUG:teuthology.orchestra.run.gibba031:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T19:27:29.689 DEBUG:teuthology.orchestra.run.gibba031:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T19:27:29.689 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content'"'"') 2021-11-15T19:27:29.690 DEBUG:teuthology.orchestra.run.gibba031:> if True: 2021-11-15T19:27:29.690 DEBUG:teuthology.orchestra.run.gibba031:> f.flush() 2021-11-15T19:27:29.691 DEBUG:teuthology.orchestra.run.gibba031:> os.fsync(f.fileno()) 2021-11-15T19:27:29.691 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:27:43.990 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:44.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 Processor -- start 2021-11-15T19:27:44.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 -- start start 2021-11-15T19:27:44.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df413ce00 0x7f3df4142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3df40b6830 0x7f3df41433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df40b63b0 con 0x7f3df40b5fd0 2021-11-15T19:27:44.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df4147070 con 0x7f3df40b6830 2021-11-15T19:27:44.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfbe55700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4146dd0 con 0x7f3df413ce00 2021-11-15T19:27:44.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df9bf1700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3df40b5fd0 0x7f3df413c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51690/0 (socket says 172.21.2.137:51690) 2021-11-15T19:27:44.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df9bf1700 1 -- 172.21.2.137:0/958700101 learned_addr learned my addr 172.21.2.137:0/958700101 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:44.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957098533 0 0) 0x7f3df40b63b0 con 0x7f3df40b5fd0 2021-11-15T19:27:44.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ddc003260 con 0x7f3df40b5fd0 2021-11-15T19:27:44.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621980663 0 0) 0x7f3ddc003260 con 0x7f3df40b5fd0 2021-11-15T19:27:44.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfa3f2700 1 --2- 172.21.2.137:0/958700101 >> v2:172.21.2.111:3300/0 conn(0x7f3df40b6830 0x7f3df41433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df413ce00 msgr2=0x7f3df4142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df413ce00 0x7f3df4142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df413ce00 0x7f3df4142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 >> v2:172.21.2.111:3300/0 conn(0x7f3df40b6830 msgr2=0x7f3df41433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 --2- 172.21.2.137:0/958700101 >> v2:172.21.2.111:3300/0 conn(0x7f3df40b6830 0x7f3df41433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4146af0 con 0x7f3df40b5fd0 2021-11-15T19:27:44.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3df00017e0 con 0x7f3df40b5fd0 2021-11-15T19:27:44.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 >> v1:172.21.2.137:6789/0 conn(0x7f3df40b5fd0 legacy=0x7f3df413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc0037d0 0x7f3ddc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ddc004500 0x7f3ddc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ddc005020 0x7f3ddc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4147070 con 0x7f3ddc0037d0 2021-11-15T19:27:44.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4146dd0 con 0x7f3ddc004500 2021-11-15T19:27:44.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc00bf00 con 0x7f3ddc005020 2021-11-15T19:27:44.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df413ce00 0x7f3df4142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:44.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3dfa3f2700 1 --2- 172.21.2.137:0/958700101 >> v2:172.21.2.111:3300/0 conn(0x7f3df40b6830 0x7f3df41433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:44.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ddc004500 0x7f3ddc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df9bf1700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc0037d0 0x7f3ddc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 -- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ddc005020 msgr2=0x7f3ddc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ddc005020 0x7f3ddc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 -- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc0037d0 msgr2=0x7f3ddc003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc0037d0 0x7f3ddc003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 -- 172.21.2.137:0/958700101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc003260 con 0x7f3ddc004500 2021-11-15T19:27:44.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df9bf1700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc0037d0 0x7f3ddc003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:44.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df93f0700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ddc004500 0x7f3ddc004980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f3de8007000 tx=0x7f3de8008040).ready entity=mon.1 client_cookie=efedc59c06ddbb56 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de8012430 con 0x7f3ddc004500 2021-11-15T19:27:44.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800c030 con 0x7f3ddc004500 2021-11-15T19:27:44.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.098+0000 7f3df8bef700 1 -- 172.21.2.137:0/958700101 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de8012780 con 0x7f3ddc004500 2021-11-15T19:27:44.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/958700101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ddc004500 msgr2=0x7f3ddc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/958700101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ddc004500 0x7f3ddc004980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f3de8007000 tx=0x7f3de8008040).stop 2021-11-15T19:27:44.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfa3f2700 1 -- 172.21.2.137:0/958700101 reap_dead start 2021-11-15T19:27:44.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/958700101 shutdown_connections 2021-11-15T19:27:44.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/958700101 >> 172.21.2.137:0/958700101 conn(0x7f3df40624b0 msgr2=0x7f3df4062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/958700101 shutdown_connections 2021-11-15T19:27:44.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/958700101 wait complete. 2021-11-15T19:27:44.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 Processor -- start 2021-11-15T19:27:44.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- start start 2021-11-15T19:27:44.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc004500 0x7f3df413d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 0x7f3df4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df41418c0 0x7f3df4139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df405cc90 con 0x7f3ddc004500 2021-11-15T19:27:44.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4141660 con 0x7f3df405c830 2021-11-15T19:27:44.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4155c30 con 0x7f3df41418c0 2021-11-15T19:27:44.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 0x7f3df4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 0x7f3df4156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32922/0 (socket says 172.21.2.137:32922) 2021-11-15T19:27:44.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 -- 172.21.2.137:0/4040805538 learned_addr learned my addr 172.21.2.137:0/4040805538 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 -- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df41418c0 msgr2=0x7f3df4139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df41418c0 0x7f3df4139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 -- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc004500 msgr2=0x7f3df413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc004500 0x7f3df413d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 -- 172.21.2.137:0/4040805538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4155ed0 con 0x7f3df405c830 2021-11-15T19:27:44.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3df93f0700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 0x7f3df4156370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3df4156250 tx=0x7f3de8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de80116e0 con 0x7f3df405c830 2021-11-15T19:27:44.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8011840 con 0x7f3df405c830 2021-11-15T19:27:44.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df413d8f0 con 0x7f3df405c830 2021-11-15T19:27:44.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de8011ba0 con 0x7f3df405c830 2021-11-15T19:27:44.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df4156860 con 0x7f3df405c830 2021-11-15T19:27:44.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df41414c0 con 0x7f3df405c830 2021-11-15T19:27:44.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3de8024030 con 0x7f3df405c830 2021-11-15T19:27:44.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3de6ffd700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3dd40536a0 0x7f3dd4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.102+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3de806c960 con 0x7f3df405c830 2021-11-15T19:27:44.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.106+0000 7f3df9bf1700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3dd40536a0 0x7f3dd4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.106+0000 7f3df9bf1700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3dd40536a0 0x7f3dd4055b60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3df0008000 tx=0x7f3df0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.106+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3df41414c0 con 0x7f3df405c830 2021-11-15T19:27:44.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3df4156060 con 0x7f3df405c830 2021-11-15T19:27:44.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3de6ffd700 1 -- 172.21.2.137:0/4040805538 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f3de8022070 con 0x7f3df405c830 2021-11-15T19:27:44.224 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:44.225 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:27:44.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3dd40536a0 msgr2=0x7f3dd4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3dd40536a0 0x7f3dd4055b60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3df0008000 tx=0x7f3df0009040).stop 2021-11-15T19:27:44.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 msgr2=0x7f3df4156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 0x7f3df4156370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3df4156250 tx=0x7f3de8008040).stop 2021-11-15T19:27:44.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 shutdown_connections 2021-11-15T19:27:44.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3dd40536a0 0x7f3dd4055b60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3df41418c0 0x7f3df4139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3df405c830 0x7f3df4156370 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 --2- 172.21.2.137:0/4040805538 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ddc004500 0x7f3df413d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 >> 172.21.2.137:0/4040805538 conn(0x7f3df40624b0 msgr2=0x7f3df40b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 shutdown_connections 2021-11-15T19:27:44.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.218+0000 7f3dfbe55700 1 -- 172.21.2.137:0/4040805538 wait complete. 2021-11-15T19:27:44.229 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:27:44.231 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-15T19:27:44.288 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T19:27:44.289 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T19:27:44.289 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:44.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 Processor -- start 2021-11-15T19:27:44.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 -- start start 2021-11-15T19:27:44.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 0x7f9a4c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c0b0c80 con 0x7f9a4c0608f0 2021-11-15T19:27:44.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c0b0f20 con 0x7f9a4c13f890 2021-11-15T19:27:44.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0ad6c0 con 0x7f9a4c05fe40 2021-11-15T19:27:44.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a513dd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9a4c13f890 0x7f9a4c05f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51714/0 (socket says 172.21.2.137:51714) 2021-11-15T19:27:44.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a513dd700 1 -- 172.21.2.137:0/706816888 learned_addr learned my addr 172.21.2.137:0/706816888 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:44.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036684837 0 0) 0x7f9a4c0b0f20 con 0x7f9a4c13f890 2021-11-15T19:27:44.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a34003260 con 0x7f9a4c13f890 2021-11-15T19:27:44.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 0x7f9a4c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873195478 0 0) 0x7f9a34003260 con 0x7f9a4c13f890 2021-11-15T19:27:44.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 msgr2=0x7f9a4c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 0x7f9a4c0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 >> v1:172.21.2.111:6789/0 conn(0x7f9a4c0608f0 legacy=0x7f9a4c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0b11c0 con 0x7f9a4c13f890 2021-11-15T19:27:44.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9a40001660 con 0x7f9a4c13f890 2021-11-15T19:27:44.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 >> v1:172.21.2.137:6789/0 conn(0x7f9a4c13f890 legacy=0x7f9a4c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a340037d0 0x7f9a34003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 0x7f9a34004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a34004b10 0x7f9a34004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0ad6c0 con 0x7f9a340037d0 2021-11-15T19:27:44.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3400b8e0 con 0x7f9a34004b10 2021-11-15T19:27:44.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3400baa0 con 0x7f9a4c05fe40 2021-11-15T19:27:44.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a34004b10 0x7f9a34004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a51bde700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a340037d0 0x7f9a34003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a513dd700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 0x7f9a34004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 -- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 msgr2=0x7f9a34004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c05fe40 0x7f9a34004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 -- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a340037d0 msgr2=0x7f9a34003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a340037d0 0x7f9a34003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 -- 172.21.2.137:0/706816888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34003260 con 0x7f9a34004b10 2021-11-15T19:27:44.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a51bde700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a340037d0 0x7f9a34003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:27:44.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a523df700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a34004b10 0x7f9a34004f90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f9a340054d0 tx=0x7f9a44008040).ready entity=mon.1 client_cookie=d4fc8cdacd18335 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4400c070 con 0x7f9a34004b10 2021-11-15T19:27:44.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4400e5e0 con 0x7f9a34004b10 2021-11-15T19:27:44.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a50bdc700 1 -- 172.21.2.137:0/706816888 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4400e940 con 0x7f9a34004b10 2021-11-15T19:27:44.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.334+0000 7f9a53e42700 1 -- 172.21.2.137:0/706816888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a34004b10 msgr2=0x7f9a34004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 --2- 172.21.2.137:0/706816888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a34004b10 0x7f9a34004f90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f9a340054d0 tx=0x7f9a44008040).stop 2021-11-15T19:27:44.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 -- 172.21.2.137:0/706816888 reap_dead start 2021-11-15T19:27:44.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/706816888 shutdown_connections 2021-11-15T19:27:44.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/706816888 >> 172.21.2.137:0/706816888 conn(0x7f9a4c063980 msgr2=0x7f9a4c063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/706816888 shutdown_connections 2021-11-15T19:27:44.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/706816888 wait complete. 2021-11-15T19:27:44.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 Processor -- start 2021-11-15T19:27:44.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- start start 2021-11-15T19:27:44.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a34004b10 0x7f9a4c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c128ac0 0x7f9a4c13b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 0x7f9a4c13bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0b5eb0 con 0x7f9a34004b10 2021-11-15T19:27:44.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0b6d70 con 0x7f9a4c13e450 2021-11-15T19:27:44.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c13f530 con 0x7f9a4c128ac0 2021-11-15T19:27:44.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 0x7f9a4c13bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 0x7f9a4c13bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32942/0 (socket says 172.21.2.137:32942) 2021-11-15T19:27:44.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 -- 172.21.2.137:0/4034950140 learned_addr learned my addr 172.21.2.137:0/4034950140 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 -- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c128ac0 msgr2=0x7f9a4c13b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c128ac0 0x7f9a4c13b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 -- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a34004b10 msgr2=0x7f9a4c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a34004b10 0x7f9a4c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 -- 172.21.2.137:0/4034950140 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c13c2a0 con 0x7f9a4c13e450 2021-11-15T19:27:44.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a523df700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 0x7f9a4c13bdb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f9a4c0b5ff0 tx=0x7f9a44008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4400eec0 con 0x7f9a4c13e450 2021-11-15T19:27:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44023070 con 0x7f9a4c13e450 2021-11-15T19:27:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c13b4c0 con 0x7f9a4c13e450 2021-11-15T19:27:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4401f930 con 0x7f9a4c13e450 2021-11-15T19:27:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c122310 con 0x7f9a4c13e450 2021-11-15T19:27:44.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c060cd0 con 0x7f9a4c13e450 2021-11-15T19:27:44.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a4402f070 con 0x7f9a4c13e450 2021-11-15T19:27:44.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a3effd700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a2c0534f0 0x7f9a2c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9a44070700 con 0x7f9a4c13e450 2021-11-15T19:27:44.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.338+0000 7f9a51bde700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a2c0534f0 0x7f9a2c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.342+0000 7f9a51bde700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a2c0534f0 0x7f9a2c0559b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9a48008000 tx=0x7f9a48009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.342+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a44047800 con 0x7f9a4c13e450 2021-11-15T19:27:44.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a4c0573d0 con 0x7f9a4c13e450 2021-11-15T19:27:44.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a3effd700 1 -- 172.21.2.137:0/4034950140 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f9a4402d020 con 0x7f9a4c13e450 2021-11-15T19:27:44.460 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:44.461 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:27:44.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a2c0534f0 msgr2=0x7f9a2c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a2c0534f0 0x7f9a2c0559b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9a48008000 tx=0x7f9a48009040).stop 2021-11-15T19:27:44.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 msgr2=0x7f9a4c13bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 0x7f9a4c13bdb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f9a4c0b5ff0 tx=0x7f9a44008040).stop 2021-11-15T19:27:44.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 shutdown_connections 2021-11-15T19:27:44.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a2c0534f0 0x7f9a2c0559b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a4c13e450 0x7f9a4c13bdb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a4c128ac0 0x7f9a4c13b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 --2- 172.21.2.137:0/4034950140 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a34004b10 0x7f9a4c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 >> 172.21.2.137:0/4034950140 conn(0x7f9a4c063980 msgr2=0x7f9a4c064970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 shutdown_connections 2021-11-15T19:27:44.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.454+0000 7f9a53e42700 1 -- 172.21.2.137:0/4034950140 wait complete. 2021-11-15T19:27:44.465 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:27:44.468 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T19:27:44.524 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T19:27:44.524 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T19:27:44.525 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:27:44.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.566+0000 7f7e2e7ed700 1 Processor -- start 2021-11-15T19:27:44.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.566+0000 7f7e2e7ed700 1 -- start start 2021-11-15T19:27:44.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e2e7ed700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7e280b1130 0x7f7e2813fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e2e7ed700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e281401d0 0x7f7e28140640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e2e7ed700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e28141bc0 con 0x7f7e2805fb80 2021-11-15T19:27:44.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e2e7ed700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e28097ff0 con 0x7f7e280b1130 2021-11-15T19:27:44.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e2e7ed700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2809a1f0 con 0x7f7e281401d0 2021-11-15T19:27:44.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e277fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7e280b1130 0x7f7e2813fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e2cd8a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e281401d0 0x7f7e28140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e27fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f7e2805fb80 0x7f7e2809a690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:44220/0 (socket says 172.21.2.137:44220) 2021-11-15T19:27:44.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e27fff700 1 -- 172.21.2.137:0/552844472 learned_addr learned my addr 172.21.2.137:0/552844472 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:27:44.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e277fe700 1 -- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e281401d0 msgr2=0x7f7e28140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e277fe700 1 --2- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e281401d0 0x7f7e28140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e277fe700 1 -- 172.21.2.137:0/552844472 >> v1:172.21.2.111:6789/0 conn(0x7f7e2805fb80 legacy=0x7f7e2809a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e277fe700 1 -- 172.21.2.137:0/552844472 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280b1660 con 0x7f7e280b1130 2021-11-15T19:27:44.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.570+0000 7f7e277fe700 1 --2- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e280b1130 0x7f7e2813fce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7e18002f70 tx=0x7f7e18006df0).ready entity=mon.0 client_cookie=6289fb281769bee2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e26ffd700 1 -- 172.21.2.137:0/552844472 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e1800d570 con 0x7f7e280b1130 2021-11-15T19:27:44.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e26ffd700 1 -- 172.21.2.137:0/552844472 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18000e90 con 0x7f7e280b1130 2021-11-15T19:27:44.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e26ffd700 1 -- 172.21.2.137:0/552844472 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e1800d8c0 con 0x7f7e280b1130 2021-11-15T19:27:44.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e280b1130 msgr2=0x7f7e2813fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e280b1130 0x7f7e2813fce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7e18002f70 tx=0x7f7e18006df0).stop 2021-11-15T19:27:44.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/552844472 shutdown_connections 2021-11-15T19:27:44.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e281401d0 0x7f7e28140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/552844472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e280b1130 0x7f7e2813fce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/552844472 >> 172.21.2.137:0/552844472 conn(0x7f7e280b4e60 msgr2=0x7f7e280b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/552844472 shutdown_connections 2021-11-15T19:27:44.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/552844472 wait complete. 2021-11-15T19:27:44.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 Processor -- start 2021-11-15T19:27:44.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- start start 2021-11-15T19:27:44.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e2805fb80 0x7f7e28142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e280b1130 0x7f7e280628e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 0x7f7e28062dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280676f0 con 0x7f7e2805fb80 2021-11-15T19:27:44.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280acd80 con 0x7f7e281401d0 2021-11-15T19:27:44.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28067450 con 0x7f7e280b1130 2021-11-15T19:27:44.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 0x7f7e28062dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 0x7f7e28062dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32954/0 (socket says 172.21.2.137:32954) 2021-11-15T19:27:44.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 -- 172.21.2.137:0/3292655296 learned_addr learned my addr 172.21.2.137:0/3292655296 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e277fe700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e280b1130 0x7f7e280628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e27fff700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e2805fb80 0x7f7e28142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 -- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e280b1130 msgr2=0x7f7e280628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e280b1130 0x7f7e280628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 -- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e2805fb80 msgr2=0x7f7e28142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e2805fb80 0x7f7e28142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 -- 172.21.2.137:0/3292655296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1800b180 con 0x7f7e281401d0 2021-11-15T19:27:44.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2cd8a700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 0x7f7e28062dd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f7e280627b0 tx=0x7f7e200091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e2000c7f0 con 0x7f7e281401d0 2021-11-15T19:27:44.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000c950 con 0x7f7e281401d0 2021-11-15T19:27:44.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e2000ccb0 con 0x7f7e281401d0 2021-11-15T19:27:44.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e280ae100 con 0x7f7e281401d0 2021-11-15T19:27:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.574+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e280ac2a0 con 0x7f7e281401d0 2021-11-15T19:27:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e280acef0 con 0x7f7e281401d0 2021-11-15T19:27:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e20022070 con 0x7f7e281401d0 2021-11-15T19:27:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e257fa700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e0c053610 0x7f7e0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7e2006c070 con 0x7f7e281401d0 2021-11-15T19:27:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e27fff700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e0c053610 0x7f7e0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e27fff700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e0c053610 0x7f7e0c055ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7e1000b000 tx=0x7f7e10009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.578+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e280acef0 con 0x7f7e281401d0 2021-11-15T19:27:44.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.686+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e280acec0 con 0x7f7e281401d0 2021-11-15T19:27:44.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.686+0000 7f7e257fa700 1 -- 172.21.2.137:0/3292655296 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f7e20016070 con 0x7f7e281401d0 2021-11-15T19:27:44.695 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:27:44.695 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:27:44.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e0c053610 msgr2=0x7f7e0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e0c053610 0x7f7e0c055ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7e1000b000 tx=0x7f7e10009040).stop 2021-11-15T19:27:44.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 msgr2=0x7f7e28062dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 0x7f7e28062dd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f7e280627b0 tx=0x7f7e200091d0).stop 2021-11-15T19:27:44.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 shutdown_connections 2021-11-15T19:27:44.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e0c053610 0x7f7e0c055ad0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e281401d0 0x7f7e28062dd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e280b1130 0x7f7e280628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 --2- 172.21.2.137:0/3292655296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e2805fb80 0x7f7e28142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 >> 172.21.2.137:0/3292655296 conn(0x7f7e280b4e60 msgr2=0x7f7e28139930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 shutdown_connections 2021-11-15T19:27:44.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.690+0000 7f7e2e7ed700 1 -- 172.21.2.137:0/3292655296 wait complete. 2021-11-15T19:27:44.699 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:27:44.702 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-11-15T19:27:44.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 Processor -- start 2021-11-15T19:27:44.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 -- start start 2021-11-15T19:27:44.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe11c0b0fe0 0x7fe11c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c0acff0 0x7fe11c0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0aedf0 con 0x7fe11c13f5c0 2021-11-15T19:27:44.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0ad4a0 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.746+0000 7fe12116c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0ae070 con 0x7fe11c0acff0 2021-11-15T19:27:44.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c0acff0 0x7fe11c0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c0acff0 0x7fe11c0af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:34532/0 (socket says 172.21.2.137:34532) 2021-11-15T19:27:44.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11ad9d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe11c0b0fe0 0x7fe11c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11a59c700 1 -- 172.21.2.137:0/3473569127 learned_addr learned my addr 172.21.2.137:0/3473569127 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11b59e700 1 --1- 172.21.2.137:0/3473569127 >> v1:172.21.2.111:6789/0 conn(0x7fe11c13f5c0 0x7fe11c13c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:44232/0 (socket says 172.21.2.137:44232) 2021-11-15T19:27:44.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11ad9d700 1 -- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c0acff0 msgr2=0x7fe11c0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c0acff0 0x7fe11c0af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11ad9d700 1 -- 172.21.2.137:0/3473569127 >> v1:172.21.2.111:6789/0 conn(0x7fe11c13f5c0 legacy=0x7fe11c13c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11ad9d700 1 -- 172.21.2.137:0/3473569127 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0b13c0 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c0afde0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe10c002f70 tx=0x7fe10c006df0).ready entity=mon.0 client_cookie=3ac0a2210ea6801a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe119d9b700 1 -- 172.21.2.137:0/3473569127 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10c00d570 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe119d9b700 1 -- 172.21.2.137:0/3473569127 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c000e90 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe119d9b700 1 -- 172.21.2.137:0/3473569127 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10c00d8c0 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0b0fe0 msgr2=0x7fe11c0afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 --2- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c0afde0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe10c002f70 tx=0x7fe10c006df0).stop 2021-11-15T19:27:44.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- 172.21.2.137:0/3473569127 shutdown_connections 2021-11-15T19:27:44.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 --2- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c0acff0 0x7fe11c0af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 --2- 172.21.2.137:0/3473569127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c0afde0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- 172.21.2.137:0/3473569127 >> 172.21.2.137:0/3473569127 conn(0x7fe11c0b5f50 msgr2=0x7fe11c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- 172.21.2.137:0/3473569127 shutdown_connections 2021-11-15T19:27:44.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- 172.21.2.137:0/3473569127 wait complete. 2021-11-15T19:27:44.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 Processor -- start 2021-11-15T19:27:44.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- start start 2021-11-15T19:27:44.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0acff0 0x7fe11c138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c060480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c13f5c0 0x7fe11c1325d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c063d40 con 0x7fe11c0acff0 2021-11-15T19:27:44.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0644b0 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.750+0000 7fe12116c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c063f70 con 0x7fe11c13f5c0 2021-11-15T19:27:44.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c060480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c060480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32966/0 (socket says 172.21.2.137:32966) 2021-11-15T19:27:44.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/84772910 learned_addr learned my addr 172.21.2.137:0/84772910 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0acff0 0x7fe11c138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11b59e700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c13f5c0 0x7fe11c1325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c13f5c0 msgr2=0x7fe11c1325d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c13f5c0 0x7fe11c1325d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0acff0 msgr2=0x7fe11c138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0acff0 0x7fe11c138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/84772910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c00b180 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c060480 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fe10400c000 tx=0x7fe104008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe113fff700 1 -- 172.21.2.137:0/84772910 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1040136e0 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe113fff700 1 -- 172.21.2.137:0/84772910 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104013840 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c064210 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe113fff700 1 -- 172.21.2.137:0/84772910 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe104013ba0 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c063830 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe113fff700 1 -- 172.21.2.137:0/84772910 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe104023070 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe113fff700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1000536d0 0x7fe100055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe113fff700 1 -- 172.21.2.137:0/84772910 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe10406bc60 con 0x7fe11c0b0fe0 2021-11-15T19:27:44.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1000536d0 0x7fe100055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 Processor -- start 2021-11-15T19:27:44.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 -- start start 2021-11-15T19:27:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 0x24bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x24875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2481890 0x2481d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x23e2d50 con 0x2485bc0 2021-11-15T19:27:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x23f64b0 con 0x2487160 2021-11-15T19:27:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x23d6c20 con 0x2481890 2021-11-15T19:27:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x24875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x24875c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32972/0 (socket says 172.21.2.137:32972) 2021-11-15T19:27:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/1637955520 learned_addr learned my addr 172.21.2.137:0/1637955520 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/1637955520 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2481890 msgr2=0x2481d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2481890 0x2481d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/1637955520 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 msgr2=0x24bd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 0x24bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 -- 172.21.2.137:0/1637955520 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x242ecb0 con 0x2487160 2021-11-15T19:27:44.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1000536d0 0x7fe100055b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe10c018000 tx=0x7fe10c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.754+0000 7fe11a59c700 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x24875c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x24bd310 tx=0x7fe10401e040).ready entity=mon.1 client_cookie=e361a845b359eff6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12116c700 1 -- 172.21.2.137:0/1637955520 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe104046160 con 0x2487160 2021-11-15T19:27:44.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12116c700 1 -- 172.21.2.137:0/1637955520 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1040467f0 con 0x2487160 2021-11-15T19:27:44.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12116c700 1 -- 172.21.2.137:0/1637955520 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe104042a60 con 0x2487160 2021-11-15T19:27:44.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1637955520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 msgr2=0x24875c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x24875c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x24bd310 tx=0x7fe10401e040).stop 2021-11-15T19:27:44.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1637955520 shutdown_connections 2021-11-15T19:27:44.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2481890 0x2481d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x24875c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1637955520 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 0x24bd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1637955520 >> 172.21.2.137:0/1637955520 conn(0x2483640 msgr2=0x2484480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1637955520 shutdown_connections 2021-11-15T19:27:44.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1637955520 wait complete. 2021-11-15T19:27:44.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- start start 2021-11-15T19:27:44.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 Processor -- start 2021-11-15T19:27:44.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 0x2491050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2487160 0x248c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 0x248ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x2491540 con 0x2485bc0 2021-11-15T19:27:44.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x248cf60 con 0x248f740 2021-11-15T19:27:44.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x248c030 con 0x2487160 2021-11-15T19:27:44.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 10 client.0 ll_register_callbacks cb 0x23ea2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:27:44.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 0x248ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 0x248ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32980/0 (socket says 172.21.2.137:32980) 2021-11-15T19:27:44.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 -- 172.21.2.137:0/3452861655 learned_addr learned my addr 172.21.2.137:0/3452861655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 -- 172.21.2.137:0/3452861655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2487160 msgr2=0x248c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2487160 0x248c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 -- 172.21.2.137:0/3452861655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 msgr2=0x2491050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 0x2491050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 -- 172.21.2.137:0/3452861655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c063830 con 0x248f740 2021-11-15T19:27:44.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11b59e700 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 0x248ca70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x2491680 tx=0x7fe114005970).ready entity=mon.1 client_cookie=6a81e67f42815334 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:27:44.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 1 -- 172.21.2.137:0/3452861655 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe114014430 con 0x248f740 2021-11-15T19:27:44.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 1 -- 172.21.2.137:0/3452861655 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe114014590 con 0x248f740 2021-11-15T19:27:44.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23ec570 con 0x248f740 2021-11-15T19:27:44.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 1 -- 172.21.2.137:0/3452861655 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe114014750 con 0x248f740 2021-11-15T19:27:44.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 10 client.5074 fetch_fsmap learned FSMap version 10 2021-11-15T19:27:44.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x23e5e50 con 0x248f740 2021-11-15T19:27:44.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 1 -- 172.21.2.137:0/3452861655 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23ec570 con 0x248f740 2021-11-15T19:27:44.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 1 -- 172.21.2.137:0/3452861655 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fe1140133e0 con 0x248f740 2021-11-15T19:27:44.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 10 client.5074 fetch_fsmap finished waiting for FSMap version 10 2021-11-15T19:27:44.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 10 client.5074 resolve_mds: resolved ID 'a' to GID 4855 2021-11-15T19:27:44.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 20 client.5074 populate_metadata read hostname 'gibba037' 2021-11-15T19:27:44.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x24cb440 0x24cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 4 client.5074 mds_command: new command op to 4855 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T19:27:44.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 --> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23e48e0 con 0x24cb440 2021-11-15T19:27:44.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x24cb440 0x24cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe0f9ffb700 10 client.5074 ms_handle_connect on v2:172.21.2.137:6832/2316902828 2021-11-15T19:27:44.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.758+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x24cb440 0x24cb820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8ceb0f2584b4ed6e server_cookie=86ed228259381dd in_seq=0 out_seq=0 2021-11-15T19:27:44.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe0f9ffb700 1 -- 172.21.2.137:0/3452861655 <== mds.0 v2:172.21.2.137:6832/2316902828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x23e48e0 con 0x24cb440 2021-11-15T19:27:44.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe0f9ffb700 10 client.5074 handle_command_reply: tid=0 2021-11-15T19:27:44.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 client.5074 shutdown 2021-11-15T19:27:44.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 msgr2=0x248ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 0x248ca70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x2491680 tx=0x7fe114005970).stop 2021-11-15T19:27:44.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 shutdown_connections 2021-11-15T19:27:44.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x24cb440 0x24cb820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x248f740 0x248ca70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2487160 0x248c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/3452861655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2485bc0 0x2491050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 >> 172.21.2.137:0/3452861655 conn(0x2481890 msgr2=0x2484480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe0f9ffb700 0 client.5074 ms_handle_reset on v2:172.21.2.137:6832/2316902828 2021-11-15T19:27:44.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 shutdown_connections 2021-11-15T19:27:44.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 1 -- 172.21.2.137:0/3452861655 wait complete. 2021-11-15T19:27:44.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.762+0000 7fe12b3b0740 20 client.5074 trim_cache size 0 max 16384 2021-11-15T19:27:44.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 Processor -- start 2021-11-15T19:27:44.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 -- start start 2021-11-15T19:27:44.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 0x2482600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2487160 0x2488b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x248f740 0x2489040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x2491d30 con 0x2487160 2021-11-15T19:27:44.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x2457150 con 0x2485bc0 2021-11-15T19:27:44.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x244a300 con 0x248f740 2021-11-15T19:27:44.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe11ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 0x2482600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe11ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 0x2482600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32984/0 (socket says 172.21.2.137:32984) 2021-11-15T19:27:44.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.766+0000 7fe11ad9d700 1 -- 172.21.2.137:0/116682871 learned_addr learned my addr 172.21.2.137:0/116682871 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 -- 172.21.2.137:0/116682871 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x248f740 msgr2=0x2489040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:44.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x248f740 0x2489040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 -- 172.21.2.137:0/116682871 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2487160 msgr2=0x2488b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:27:44.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2487160 0x2488b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 -- 172.21.2.137:0/116682871 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23ee750 con 0x2485bc0 2021-11-15T19:27:44.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 0x2482600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fe10c02b000 tx=0x7fe10c012000).ready entity=mon.1 client_cookie=4a189164fd8208cc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0fbfff700 1 -- 172.21.2.137:0/116682871 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10c026070 con 0x2485bc0 2021-11-15T19:27:44.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0fbfff700 1 -- 172.21.2.137:0/116682871 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c027040 con 0x2485bc0 2021-11-15T19:27:44.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0fbfff700 1 -- 172.21.2.137:0/116682871 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10c02a280 con 0x2485bc0 2021-11-15T19:27:44.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/116682871 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 msgr2=0x2482600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:27:44.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 0x2482600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fe10c02b000 tx=0x7fe10c012000).stop 2021-11-15T19:27:44.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/116682871 shutdown_connections 2021-11-15T19:27:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x248f740 0x2489040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x2487160 0x2488b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/116682871 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2485bc0 0x2482600 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:27:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/116682871 >> 172.21.2.137:0/116682871 conn(0x2481890 msgr2=0x248c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:27:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/116682871 shutdown_connections 2021-11-15T19:27:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/116682871 wait complete. 2021-11-15T19:27:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- start start 2021-11-15T19:27:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 Processor -- start 2021-11-15T19:27:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2485bc0 0x248baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x2487b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x248f740 0x251b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x251f6a0 con 0x248f740 2021-11-15T19:27:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x248d7d0 con 0x2487160 2021-11-15T19:27:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x248da70 con 0x2485bc0 2021-11-15T19:27:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 10 client.0 ll_register_callbacks cb 0x2490db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:27:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x2487b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x2487b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:32992/0 (socket says 172.21.2.137:32992) 2021-11-15T19:27:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 -- 172.21.2.137:0/1772502635 learned_addr learned my addr 172.21.2.137:0/1772502635 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:27:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 -- 172.21.2.137:0/1772502635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2485bc0 msgr2=0x248baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2485bc0 0x248baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 -- 172.21.2.137:0/1772502635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x248f740 msgr2=0x251b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:27:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x248f740 0x251b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:27:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 -- 172.21.2.137:0/1772502635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0b13c0 con 0x2487160 2021-11-15T19:27:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11a59c700 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x2487b40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x248d6f0 tx=0x7fe104042ef0).ready entity=mon.1 client_cookie=a526e29d23368efa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:27:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0faffd700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:27:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0faffd700 1 -- 172.21.2.137:0/1772502635 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe104033070 con 0x2487160 2021-11-15T19:27:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0faffd700 1 -- 172.21.2.137:0/1772502635 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe104038c40 con 0x2487160 2021-11-15T19:27:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1040467f0 con 0x2487160 2021-11-15T19:27:44.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0faffd700 1 -- 172.21.2.137:0/1772502635 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe104038e00 con 0x2487160 2021-11-15T19:27:44.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 10 client.5080 fetch_fsmap learned FSMap version 10 2021-11-15T19:27:44.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x23eb140 con 0x2487160 2021-11-15T19:27:44.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0faffd700 1 -- 172.21.2.137:0/1772502635 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1040467f0 con 0x2487160 2021-11-15T19:27:44.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe0faffd700 1 -- 172.21.2.137:0/1772502635 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fe10406b8b0 con 0x2487160 2021-11-15T19:27:44.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 10 client.5080 fetch_fsmap finished waiting for FSMap version 10 2021-11-15T19:27:44.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 10 client.5080 resolve_mds: resolved ID 'a' to GID 4855 2021-11-15T19:27:44.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 20 client.5080 populate_metadata read hostname 'gibba037' 2021-11-15T19:27:44.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x251bc90 0x248df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:27:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 4 client.5080 mds_command: new command op to 4855 tid=0[{"prefix": "cache drop"}] 2021-11-15T19:27:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 --> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x22da590 con 0x251bc90 2021-11-15T19:27:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.770+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x251bc90 0x248df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:27:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.774+0000 7fe11ad9d700 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x251bc90 0x248df10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5922348844c66afc server_cookie=c7611c60539c3ab in_seq=0 out_seq=0 2021-11-15T19:27:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:27:44.774+0000 7fe0faffd700 10 client.5080 ms_handle_connect on v2:172.21.2.137:6832/2316902828 2021-11-15T19:27:53.662 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:53.665 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:53.669 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:53.672 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:27:53.676 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:23.714 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:23.719 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:23.723 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:23.726 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:23.730 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:29.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe0faffd700 1 -- 172.21.2.137:0/1772502635 <== mds.0 v2:172.21.2.137:6832/2316902828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x7fe10c023190 con 0x251bc90 2021-11-15T19:28:29.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe0faffd700 10 client.5080 handle_command_reply: tid=0 2021-11-15T19:28:29.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 client.5080 shutdown 2021-11-15T19:28:29.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 msgr2=0x2487b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x2487b40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x248d6f0 tx=0x7fe104042ef0).stop 2021-11-15T19:28:29.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 shutdown_connections 2021-11-15T19:28:29.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:6832/2316902828,v1:172.21.2.137:6833/2316902828] conn(0x251bc90 0x248df10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x248f740 0x251b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x2487160 0x2487b40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 --2- 172.21.2.137:0/1772502635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x2485bc0 0x248baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 >> 172.21.2.137:0/1772502635 conn(0x2481890 msgr2=0x24825e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:29.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe0faffd700 0 client.5080 ms_handle_reset on v2:172.21.2.137:6832/2316902828 2021-11-15T19:28:29.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 shutdown_connections 2021-11-15T19:28:29.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 1 -- 172.21.2.137:0/1772502635 wait complete. 2021-11-15T19:28:29.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12b3b0740 20 client.5080 trim_cache size 0 max 16384 2021-11-15T19:28:29.113 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:28:29.114 INFO:teuthology.orchestra.run.gibba037.stdout: "client_recall": { 2021-11-15T19:28:29.114 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": 0, 2021-11-15T19:28:29.114 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "(0) Success", 2021-11-15T19:28:29.115 INFO:teuthology.orchestra.run.gibba037.stdout: "recalled": 920 2021-11-15T19:28:29.115 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.115 INFO:teuthology.orchestra.run.gibba037.stdout: "flush_journal": { 2021-11-15T19:28:29.116 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": 0, 2021-11-15T19:28:29.116 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "" 2021-11-15T19:28:29.116 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.116 INFO:teuthology.orchestra.run.gibba037.stdout: "trim_cache": { 2021-11-15T19:28:29.117 INFO:teuthology.orchestra.run.gibba037.stdout: "trimmed": 900 2021-11-15T19:28:29.117 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.117 INFO:teuthology.orchestra.run.gibba037.stdout: "cache": { 2021-11-15T19:28:29.117 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": { 2021-11-15T19:28:29.118 INFO:teuthology.orchestra.run.gibba037.stdout: "items": 2497, 2021-11-15T19:28:29.118 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes": 431696 2021-11-15T19:28:29.118 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.118 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.119 INFO:teuthology.orchestra.run.gibba037.stdout: "duration": 44.329978990000001 2021-11-15T19:28:29.119 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:28:29.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1000536d0 msgr2=0x7fe100055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1000536d0 0x7fe100055b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe10c018000 tx=0x7fe10c014000).stop 2021-11-15T19:28:29.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 msgr2=0x7fe11c060480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c060480 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fe10400c000 tx=0x7fe104008040).stop 2021-11-15T19:28:29.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 shutdown_connections 2021-11-15T19:28:29.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1000536d0 0x7fe100055b90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe11c13f5c0 0x7fe11c1325d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe11c0b0fe0 0x7fe11c060480 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 --2- 172.21.2.137:0/84772910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe11c0acff0 0x7fe11c138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 >> 172.21.2.137:0/84772910 conn(0x7fe11c0b5f50 msgr2=0x7fe11c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:29.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 shutdown_connections 2021-11-15T19:28:29.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.104+0000 7fe12116c700 1 -- 172.21.2.137:0/84772910 wait complete. 2021-11-15T19:28:29.124 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:28:29.125 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:29.133 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:29.146 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:29.159 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:29.173 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:29.202 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:28:29.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:29.203 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:29.203 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:29.209 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:28:29.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:28:29.210 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:28:29.211 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:28:29.211 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:29.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:29.268 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:29.268 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:29.269 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14132]: fuse finished with error 0 and tester_r 0 2021-11-15T19:28:29.272 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:28:29.272 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:28:29.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:28:29.384 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:29.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:29.429 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:29.430 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:28:29.439 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:28:29.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:29.441 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:28:29.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:28:29.442 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:28:29.451 INFO:teuthology.orchestra.run.gibba018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:28:29.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:29.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:29.453 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:29.453 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:28:29.463 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:28:29.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:29.464 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:28:29.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:28:29.465 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:28:29.474 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:28:29.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:29.475 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:28:29.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.580+0000 7f9169f34700 1 Processor -- start 2021-11-15T19:28:29.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.580+0000 7f9169f34700 1 -- start start 2021-11-15T19:28:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f91640b0c60 0x7f9164149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9164060990 con 0x7f9164143270 2021-11-15T19:28:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91641425f0 con 0x7f91640605b0 2021-11-15T19:28:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640abcb0 con 0x7f91640b0c60 2021-11-15T19:28:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f91640605b0 0x7f916413efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51782/0 (socket says 172.21.2.137:51782) 2021-11-15T19:28:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 -- 172.21.2.137:0/130724342 learned_addr learned my addr 172.21.2.137:0/130724342 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658462915 0 0) 0x7f91641425f0 con 0x7f91640605b0 2021-11-15T19:28:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9144003260 con 0x7f91640605b0 2021-11-15T19:28:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1724694502 0 0) 0x7f9144003260 con 0x7f91640605b0 2021-11-15T19:28:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 >> v2:172.21.2.111:3300/0 conn(0x7f91640b0c60 msgr2=0x7f9164149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 --2- 172.21.2.137:0/130724342 >> v2:172.21.2.111:3300/0 conn(0x7f91640b0c60 0x7f9164149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 >> v1:172.21.2.111:6789/0 conn(0x7f9164143270 legacy=0x7f916413f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164142890 con 0x7f91640605b0 2021-11-15T19:28:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f914c001660 con 0x7f91640605b0 2021-11-15T19:28:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 >> v1:172.21.2.137:6789/0 conn(0x7f91640605b0 legacy=0x7f916413efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144003820 0x7f9144003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9144004500 0x7f9144004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144005050 0x7f9144007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640abcb0 con 0x7f9144005050 2021-11-15T19:28:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144007f20 con 0x7f9144003820 2021-11-15T19:28:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91440080e0 con 0x7f9144004500 2021-11-15T19:28:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144003820 0x7f9144003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 -- 172.21.2.137:0/130724342 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9144004500 msgr2=0x7f9144004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9144004500 0x7f9144004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 -- 172.21.2.137:0/130724342 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144005050 msgr2=0x7f9144007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144005050 0x7f9144007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 -- 172.21.2.137:0/130724342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144003260 con 0x7f9144003820 2021-11-15T19:28:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9163fff700 1 -- 172.21.2.137:0/130724342 reap_dead start 2021-11-15T19:28:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91637fe700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144003820 0x7f9144003c20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f91640b0810 tx=0x7f9164098610).ready entity=mon.1 client_cookie=f55b8c3bc53d0b28 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f914c0070d0 con 0x7f9144003820 2021-11-15T19:28:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c007230 con 0x7f9144003820 2021-11-15T19:28:29.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f91627fc700 1 -- 172.21.2.137:0/130724342 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f914c00c8f0 con 0x7f9144003820 2021-11-15T19:28:29.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- 172.21.2.137:0/130724342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144003820 msgr2=0x7f9144003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144003820 0x7f9144003c20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f91640b0810 tx=0x7f9164098610).stop 2021-11-15T19:28:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- 172.21.2.137:0/130724342 shutdown_connections 2021-11-15T19:28:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 --2- 172.21.2.137:0/130724342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144003820 0x7f9144003c20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- 172.21.2.137:0/130724342 >> 172.21.2.137:0/130724342 conn(0x7f91640b4e60 msgr2=0x7f91640b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- 172.21.2.137:0/130724342 shutdown_connections 2021-11-15T19:28:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- 172.21.2.137:0/130724342 wait complete. 2021-11-15T19:28:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 Processor -- start 2021-11-15T19:28:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.584+0000 7f9169f34700 1 -- start start 2021-11-15T19:28:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144003820 0x7f9164062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91640637c0 0x7f9164064dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 0x7f91640652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640af3d0 con 0x7f9144003820 2021-11-15T19:28:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9164065950 con 0x7f91640ae770 2021-11-15T19:28:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9164065bf0 con 0x7f91640637c0 2021-11-15T19:28:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 0x7f91640652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 0x7f91640652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33016/0 (socket says 172.21.2.137:33016) 2021-11-15T19:28:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 -- 172.21.2.137:0/95419296 learned_addr learned my addr 172.21.2.137:0/95419296 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 -- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91640637c0 msgr2=0x7f9164064dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91640637c0 0x7f9164064dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 -- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144003820 msgr2=0x7f9164062e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144003820 0x7f9164062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 -- 172.21.2.137:0/95419296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164063360 con 0x7f91640ae770 2021-11-15T19:28:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9163fff700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 0x7f91640652b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f916405da70 tx=0x7f915c00a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:29.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915c005a20 con 0x7f91640ae770 2021-11-15T19:28:29.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c005b80 con 0x7f91640ae770 2021-11-15T19:28:29.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91640af0c0 con 0x7f91640ae770 2021-11-15T19:28:29.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916414dd40 con 0x7f91640ae770 2021-11-15T19:28:29.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915c007070 con 0x7f91640ae770 2021-11-15T19:28:29.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91640657a0 con 0x7f91640ae770 2021-11-15T19:28:29.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f915c01b060 con 0x7f91640ae770 2021-11-15T19:28:29.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9160ff9700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9148053720 0x7f9148055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f915c06b100 con 0x7f91640ae770 2021-11-15T19:28:29.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.588+0000 7f91637fe700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9148053720 0x7f9148055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:29.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.592+0000 7f91637fe700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9148053720 0x7f9148055be0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f91640b0810 tx=0x7f914c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:29.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.592+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f915c0420f0 con 0x7f91640ae770 2021-11-15T19:28:29.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.672+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f91640634f0 con 0x7f91640ae770 2021-11-15T19:28:29.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9160ff9700 1 -- 172.21.2.137:0/95419296 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v31) v1 ==== 81+0+33645 (secure 0 0 0) 0x7f915c019020 con 0x7f91640ae770 2021-11-15T19:28:29.679 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:29.679 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:28:29.679 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 31, 2021-11-15T19:28:29.679 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:28:29.680 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:28:29.680 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:27:26.620514+0000", 2021-11-15T19:28:29.680 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:28:29.680 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:28:29.681 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:28:29.681 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:28:29.681 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:28:29.681 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:28:29.681 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:28:29.682 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:28:29.682 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:28:29.682 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:29.683 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:28:29.683 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:28:29.683 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:28:29.683 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:28:29.683 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:28:29.684 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 6, 2021-11-15T19:28:29.684 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:28:29.684 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:28:29.684 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:28:29.684 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:28:29.685 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:28:29.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.685 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:28:29.685 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:28:29.686 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:28:29.686 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:28:29.686 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:28:29.686 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:28:29.687 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:28:29.687 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:28:29.687 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:28:29.687 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:28:29.687 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:28:29.688 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:28:29.688 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:28:29.688 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:28:29.688 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:28:29.689 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:28:29.689 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:28:29.689 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:28:29.689 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:28:29.689 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:28:29.690 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:28:29.690 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:28:29.690 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:28:29.690 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.690 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:28:29.691 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:28:29.691 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:28:29.691 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:28:29.691 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:28:29.692 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:28:29.692 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:28:29.692 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:28:29.692 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:28:29.692 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:28:29.693 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:28:29.693 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:28:29.693 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:28:29.693 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:28:29.694 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:28:29.694 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:28:29.694 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:28:29.694 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:28:29.695 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:28:29.695 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:28:29.695 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:28:29.695 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:28:29.696 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:28:29.696 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:28:29.696 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:28:29.696 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:28:29.696 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:28:29.697 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.697 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:28:29.697 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:28:29.697 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:28:29.698 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:28:29.698 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:28:29.698 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:28:29.698 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:28:29.698 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:28:29.699 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:28:29.699 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:28:29.699 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:28:29.699 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:28:29.700 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:28:29.700 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.700 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:28:29.700 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:28:29.700 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.701 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.701 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:28:29.701 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:28:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:28:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:28:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:28:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:28:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:28:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:28:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:28:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:28:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:28:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:28:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:28:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:28:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:28:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:28:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:28:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:28:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:28:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:28:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:28:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:28:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:28:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:28:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:28:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:28:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:28:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:28:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:28:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:28:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:28:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:28:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:28:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:28:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:28:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:28:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:28:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:28:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:28:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:28:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:28:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:28:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:28:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:28:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:28:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:28:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:28:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:28:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:28:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:28:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:28:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:28:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:28:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:28:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:28:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:28:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:28:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:28:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:28:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:28:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:28:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:28:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:28:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:28:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 5, 2021-11-15T19:28:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:28:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:27:22.499670+0000", 2021-11-15T19:28:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:28:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:28:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:28:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:28:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:28:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:28:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:28:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:28:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:28:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:28:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:28:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:28:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:28:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:28:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:28:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:28:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:28:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:28:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:28:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:28:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "29", 2021-11-15T19:28:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:28:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:28:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:28:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:28:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:28:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:28:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:28:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:28:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:28:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:28:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:28:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:28:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:28:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:28:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:28:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:28:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:28:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:28:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:28:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:28:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:28:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:28:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:28:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:28:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:28:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:28:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:28:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:28:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:28:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:28:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:28:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:28:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:28:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:28:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:28:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:28:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:28:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:28:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:28:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:28:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:28:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:28:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:28:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:28:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 6, 2021-11-15T19:28:29.735 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:28:29.735 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:27:23.496407+0000", 2021-11-15T19:28:29.735 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:28:29.735 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:28:29.735 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:28:29.736 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:28:29.736 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:28:29.736 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:28:29.736 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:28:29.737 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:28:29.737 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:28:29.737 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:28:29.737 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:28:29.737 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:28:29.738 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:28:29.738 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:28:29.738 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:28:29.738 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:28:29.739 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:28:29.739 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:28:29.739 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:28:29.739 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:28:29.739 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.740 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "31", 2021-11-15T19:28:29.740 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:28:29.740 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:28:29.740 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:28:29.741 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:28:29.741 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:28:29.741 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:28:29.741 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:28:29.741 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:28:29.742 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:28:29.742 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:28:29.742 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:28:29.742 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:28:29.743 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:28:29.743 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:28:29.743 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:28:29.743 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:28:29.743 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:28:29.744 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:28:29.744 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:28:29.744 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:28:29.744 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:28:29.744 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:28:29.745 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:28:29.745 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:28:29.745 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:28:29.745 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:28:29.745 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.746 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:28:29.746 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:28:29.746 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:28:29.746 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:28:29.747 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:28:29.747 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:28:29.747 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:28:29.747 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:28:29.748 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:28:29.748 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:28:29.748 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:28:29.748 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:28:29.748 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:28:29.749 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:28:29.749 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:28:29.749 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.749 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.750 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.750 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:29.750 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:28:29.750 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.751 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:28:29.751 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:28:29.751 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.751 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.752 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.752 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.752 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.752 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.752 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.753 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:29.753 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.753 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.753 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.754 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.754 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.754 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.754 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:28:29.755 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.755 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.755 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.755 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.756 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:28:29.756 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.756 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.756 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.757 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.757 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.757 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.758 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.758 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:28:29.758 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.758 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.759 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.759 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.759 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:28:29.759 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.760 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.760 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.760 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.760 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.761 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.761 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.761 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.761 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:28:29.762 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.762 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.762 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.762 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.763 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:28:29.763 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.763 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.763 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.764 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.764 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.764 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.764 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.765 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.765 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:28:29.765 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.765 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.766 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.766 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.766 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:28:29.766 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:29.766 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.767 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.767 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.767 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:28:29.767 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:28:29.768 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:28:29.768 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:28:29.768 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.768 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.769 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.769 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.769 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.769 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.770 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:28:29.770 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:28:29.770 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.770 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.770 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.771 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.771 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.771 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.771 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.772 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 29, 2021-11-15T19:28:29.772 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.772 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.772 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.773 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.773 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.773 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.773 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:28:29.774 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.774 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.774 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.774 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.775 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:28:29.775 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.775 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.775 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.775 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.776 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.776 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.776 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.776 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.777 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:28:29.777 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.777 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.777 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.778 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.778 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:28:29.778 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.778 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.779 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.779 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.779 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.779 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.780 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.780 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.780 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:28:29.780 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.781 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.781 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.781 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:28:29.781 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.782 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.782 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.782 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.782 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.783 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.783 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.783 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.783 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:28:29.783 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.784 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.784 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.784 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.784 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:28:29.785 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:29.785 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.785 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.785 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.786 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:28:29.786 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:28:29.786 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:28:29.786 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:28:29.787 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.787 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.787 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.787 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.788 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.788 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.788 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:28:29.788 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:28:29.788 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.789 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.789 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.789 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.789 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.790 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.790 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.790 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 26, 2021-11-15T19:28:29.790 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.791 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.791 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.791 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.792 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.792 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:28:29.792 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.792 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.793 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.793 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.793 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:28:29.793 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.793 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.794 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.794 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.794 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.794 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.795 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.795 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.795 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:28:29.795 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.796 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.796 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.796 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.796 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:28:29.797 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.797 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.797 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.797 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.798 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.798 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.798 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.798 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.798 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:28:29.799 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.799 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.799 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.799 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:28:29.800 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.800 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.800 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.801 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.801 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.801 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.801 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.802 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.802 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:28:29.802 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.802 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.803 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.803 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.803 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:28:29.803 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:29.804 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.804 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.804 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.804 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:28:29.805 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:28:29.805 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:28:29.805 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:28:29.805 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.805 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.806 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.806 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.806 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.806 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.807 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:28:29.807 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:28:29.807 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.807 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.808 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.808 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.808 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.809 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.809 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.809 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:29.809 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.809 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.810 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.810 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.810 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.810 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.811 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:28:29.811 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.811 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.811 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.812 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.812 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:28:29.812 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.812 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.812 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.813 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.813 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.813 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.813 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.814 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.814 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:28:29.814 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.814 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.815 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.815 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.815 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:28:29.815 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.815 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.816 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.816 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.816 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.816 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.817 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.817 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.817 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:28:29.817 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.818 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.818 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.818 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.818 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:28:29.819 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.819 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.819 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.819 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.819 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.820 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.820 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.820 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.821 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:28:29.821 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.821 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.821 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.822 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.822 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:28:29.822 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:29.822 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.823 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.823 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.823 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:28:29.823 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:28:29.823 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:28:29.824 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:28:29.824 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.824 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.824 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.825 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.825 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.825 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.826 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:28:29.826 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:28:29.826 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.826 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.827 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.827 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.827 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.827 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.828 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.828 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:29.828 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.828 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.829 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.829 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.829 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.829 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.830 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:28:29.830 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.830 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.830 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.831 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.831 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:28:29.831 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.831 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.831 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.832 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.832 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.832 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.832 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.833 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.833 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:28:29.833 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.833 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.833 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.834 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.834 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:28:29.834 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.834 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.835 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.835 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.835 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.835 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.836 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.836 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.836 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:28:29.836 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.836 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.837 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.837 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.837 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:28:29.837 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.838 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.838 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.838 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.838 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.839 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.839 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.839 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.839 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:28:29.839 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.840 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.840 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.840 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.840 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:28:29.841 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:29.841 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.841 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.841 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.841 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:28:29.842 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:28:29.842 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:28:29.842 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:28:29.842 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.843 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.843 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.843 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.843 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.843 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.844 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:28:29.844 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:28:29.844 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.844 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.845 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.845 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.845 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.845 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.845 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.846 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:29.846 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.846 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.846 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.847 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.847 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.847 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.847 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:28:29.847 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.848 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.848 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.848 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.848 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:28:29.849 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.849 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.849 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.849 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.850 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.850 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.850 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.850 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.851 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:28:29.851 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.851 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.851 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.852 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.852 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:28:29.852 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.852 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.852 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.853 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.853 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.853 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.854 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.854 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.854 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:28:29.854 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.854 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.855 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.855 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.855 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:28:29.855 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.855 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.856 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.856 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.856 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.856 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.857 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.857 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.857 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:28:29.857 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.858 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.858 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.858 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:28:29.859 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:29.859 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.859 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.859 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.860 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:28:29.860 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:28:29.860 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:28:29.860 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:28:29.861 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.861 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.861 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.861 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.862 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.862 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.862 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:28:29.863 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:28:29.863 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.863 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.863 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.863 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.864 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.864 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.864 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.864 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 26, 2021-11-15T19:28:29.865 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.865 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.865 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.865 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.866 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.866 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.866 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:28:29.866 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.866 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.867 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.867 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.867 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:28:29.867 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.868 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.868 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.868 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.868 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.869 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.869 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:28:29.870 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.870 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.870 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.870 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.871 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:28:29.871 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.871 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.871 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.872 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.872 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.872 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.872 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.872 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.873 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:28:29.873 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.873 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.873 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.874 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.874 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:28:29.874 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.874 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.875 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.875 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.875 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.875 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.875 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.876 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.876 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:28:29.876 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.876 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.877 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.877 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.877 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:28:29.877 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:29.878 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.878 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.878 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.878 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:28:29.878 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:28:29.879 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:28:29.879 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:28:29.879 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.879 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.879 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.880 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.880 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.880 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.880 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:28:29.880 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:28:29.881 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:29.881 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:29.881 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:29.881 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:29.882 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:29.882 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:29.882 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:29.882 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 29, 2021-11-15T19:28:29.883 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:29.883 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:29.883 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:29.883 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.883 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.884 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.884 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:28:29.884 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.884 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.884 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.885 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.885 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:28:29.885 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.885 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.886 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.886 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.886 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:29.886 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.887 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.887 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.887 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:28:29.887 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.887 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.888 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.888 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.888 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:28:29.888 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.889 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.889 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.889 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.889 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:29.889 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.890 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.890 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.890 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:28:29.890 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.891 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.891 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.891 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.891 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:28:29.891 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.892 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.892 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.892 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.892 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:29.893 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:29.893 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.893 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:29.893 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:28:29.893 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.894 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.894 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.894 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:29.894 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:28:29.895 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:29.895 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.895 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.895 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.895 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:28:29.896 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:28:29.896 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:28:29.896 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:28:29.896 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:29.896 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:29.897 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:29.897 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:29.897 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.897 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:29.898 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:28:29.898 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.898 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:28:29.898 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.898 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.899 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.899 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.899 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.899 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:28:29.900 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.900 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.900 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.900 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:28:29.900 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.901 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.901 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.901 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.901 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.901 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:28:29.902 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.902 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.902 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.902 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:28:29.903 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.903 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.903 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.903 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.903 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.904 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:28:29.904 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.904 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.905 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.905 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:28:29.905 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.905 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.906 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.906 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.906 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.906 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:28:29.907 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.907 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.907 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.907 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:28:29.907 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.908 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.908 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.908 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.908 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.909 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:28:29.909 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.909 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.909 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.909 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:28:29.910 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.910 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.910 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.910 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.911 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.911 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:28:29.911 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.911 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.911 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.912 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:28:29.912 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.912 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.912 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.913 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.913 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.913 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:28:29.913 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.913 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.914 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:29.914 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:28:29.914 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:29.914 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:29.914 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:29.915 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:29.915 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:29.915 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:28:29.915 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:29.915 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.916 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:29.916 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:28:29.916 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:28:29.916 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:28:29.917 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:28:29.917 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:28:29.917 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:28:29.917 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:28:29.918 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:28:29.918 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:28:29.918 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:28:29.918 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:28:29.918 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:28:29.919 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:28:29.919 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:29.919 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:29.919 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:28:29.920 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:28:29.920 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:28:29.920 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:28:29.920 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:28:29.920 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:28:29.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9148053720 msgr2=0x7f9148055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9148053720 0x7f9148055be0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f91640b0810 tx=0x7f914c015000).stop 2021-11-15T19:28:29.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 msgr2=0x7f91640652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 0x7f91640652b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f916405da70 tx=0x7f915c00a060).stop 2021-11-15T19:28:29.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 shutdown_connections 2021-11-15T19:28:29.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9148053720 0x7f9148055be0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91640ae770 0x7f91640652b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91640637c0 0x7f9164064dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 --2- 172.21.2.137:0/95419296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9144003820 0x7f9164062e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 >> 172.21.2.137:0/95419296 conn(0x7f91640b4e60 msgr2=0x7f91640997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:29.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 shutdown_connections 2021-11-15T19:28:29.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.676+0000 7f9169f34700 1 -- 172.21.2.137:0/95419296 wait complete. 2021-11-15T19:28:29.925 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:29.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 Processor -- start 2021-11-15T19:28:29.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 -- start start 2021-11-15T19:28:29.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1cfc144610 0x7f1cfc147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 0x7f1cfc0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc148190 con 0x7f1cfc0b1340 2021-11-15T19:28:29.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0b1720 con 0x7f1cfc144610 2021-11-15T19:28:29.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d0313d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc147e70 con 0x7f1cfc0a9f50 2021-11-15T19:28:29.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d00ed9700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1cfc0b1340 0x7f1cfc143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51802/0 (socket says 172.21.2.137:51802) 2021-11-15T19:28:29.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1d00ed9700 1 -- 172.21.2.137:0/1352293359 learned_addr learned my addr 172.21.2.137:0/1352293359 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:29.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.980+0000 7f1cfbfff700 1 --2- 172.21.2.137:0/1352293359 >> v2:172.21.2.137:3300/0 conn(0x7f1cfc144610 0x7f1cfc147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:29.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1352293359 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 msgr2=0x7f1cfc0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:29.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- 172.21.2.137:0/1352293359 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 0x7f1cfc0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1352293359 >> v1:172.21.2.137:6789/0 conn(0x7f1cfc0b1340 legacy=0x7f1cfc143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfb7fe700 1 -- 172.21.2.137:0/1352293359 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417459691 0 0) 0x7f1cec001110 con 0x7f1cfc0b1340 2021-11-15T19:28:29.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1352293359 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0af800 con 0x7f1cfc144610 2021-11-15T19:28:29.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- 172.21.2.137:0/1352293359 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc144610 0x7f1cfc147980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f1cf0002f70 tx=0x7f1cf0006df0).ready entity=mon.1 client_cookie=ba50a668207a6003 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:29.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfb7fe700 1 -- 172.21.2.137:0/1352293359 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf000d570 con 0x7f1cfc144610 2021-11-15T19:28:29.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfb7fe700 1 -- 172.21.2.137:0/1352293359 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0000e90 con 0x7f1cfc144610 2021-11-15T19:28:29.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfb7fe700 1 -- 172.21.2.137:0/1352293359 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf000d8c0 con 0x7f1cfc144610 2021-11-15T19:28:29.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1352293359 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc144610 msgr2=0x7f1cfc147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1352293359 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc144610 0x7f1cfc147980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f1cf0002f70 tx=0x7f1cf0006df0).stop 2021-11-15T19:28:29.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1352293359 shutdown_connections 2021-11-15T19:28:29.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1352293359 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc144610 0x7f1cfc147980 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:29.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1352293359 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 0x7f1cfc0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1352293359 >> 172.21.2.137:0/1352293359 conn(0x7f1cfc0b4e60 msgr2=0x7f1cfc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:29.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1352293359 shutdown_connections 2021-11-15T19:28:29.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1352293359 wait complete. 2021-11-15T19:28:29.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 Processor -- start 2021-11-15T19:28:29.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- start start 2021-11-15T19:28:29.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 0x7f1cfc097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 0x7f1cfc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cfc144610 0x7f1cfc1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:29.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc09a830 con 0x7f1cfc144610 2021-11-15T19:28:29.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc1488f0 con 0x7f1cfc0b1340 2021-11-15T19:28:29.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc148b90 con 0x7f1cfc0a9f50 2021-11-15T19:28:29.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 0x7f1cfc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:29.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 0x7f1cfc1573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33030/0 (socket says 172.21.2.137:33030) 2021-11-15T19:28:29.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1397849134 learned_addr learned my addr 172.21.2.137:0/1397849134 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:29.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 msgr2=0x7f1cfc097df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 0x7f1cfc097df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cfc144610 msgr2=0x7f1cfc1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:29.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cfc144610 0x7f1cfc1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:29.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 -- 172.21.2.137:0/1397849134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf000b180 con 0x7f1cfc0b1340 2021-11-15T19:28:29.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cfbfff700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 0x7f1cfc1573a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f1cf0002f70 tx=0x7f1cf0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:29.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf0006b20 con 0x7f1cfc0b1340 2021-11-15T19:28:29.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf000de20 con 0x7f1cfc0b1340 2021-11-15T19:28:29.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf001e460 con 0x7f1cfc0b1340 2021-11-15T19:28:29.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc09a0f0 con 0x7f1cfc0b1340 2021-11-15T19:28:29.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.984+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc0982e0 con 0x7f1cfc0b1340 2021-11-15T19:28:30.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc05faf0 con 0x7f1cfc0b1340 2021-11-15T19:28:30.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cf001a040 con 0x7f1cfc0b1340 2021-11-15T19:28:30.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1cf9ffb700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1cdc0536a0 0x7f1cdc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:30.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1cf006c980 con 0x7f1cfc0b1340 2021-11-15T19:28:30.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1d00ed9700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1cdc0536a0 0x7f1cdc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:30.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1d00ed9700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1cdc0536a0 0x7f1cdc055b60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1cec000ed0 tx=0x7f1cec0078a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:30.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:29.988+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cf0043a50 con 0x7f1cfc0b1340 2021-11-15T19:28:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cfc0573d0 con 0x7f1cfc0b1340 2021-11-15T19:28:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1cf9ffb700 1 -- 172.21.2.137:0/1397849134 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f1cf0023090 con 0x7f1cfc0b1340 2021-11-15T19:28:30.101 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:30.101 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:27:25.606904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2316902828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2316902828},{"type":"v1","addr":"172.21.2.137:6833","nonce":2316902828}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:28:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1cdc0536a0 msgr2=0x7f1cdc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1cdc0536a0 0x7f1cdc055b60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1cec000ed0 tx=0x7f1cec0078a0).stop 2021-11-15T19:28:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 msgr2=0x7f1cfc1573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 0x7f1cfc1573a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f1cf0002f70 tx=0x7f1cf0015000).stop 2021-11-15T19:28:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 shutdown_connections 2021-11-15T19:28:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1cdc0536a0 0x7f1cdc055b60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cfc144610 0x7f1cfc1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cfc0b1340 0x7f1cfc1573a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 --2- 172.21.2.137:0/1397849134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cfc0a9f50 0x7f1cfc097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 >> 172.21.2.137:0/1397849134 conn(0x7f1cfc0b4e60 msgr2=0x7f1cfc0aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 shutdown_connections 2021-11-15T19:28:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.096+0000 7f1d0313d700 1 -- 172.21.2.137:0/1397849134 wait complete. 2021-11-15T19:28:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 10 2021-11-15T19:28:30.108 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:28:30.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedb1a96700 1 Processor -- start 2021-11-15T19:28:30.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedb1a96700 1 -- start start 2021-11-15T19:28:30.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedb1a96700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:30.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedb1a96700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac066410 con 0x7fedac0679a0 2021-11-15T19:28:30.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedb1a96700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac066170 con 0x7fedac0b1ee0 2021-11-15T19:28:30.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedb1a96700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac05ff00 con 0x7fedac0b67c0 2021-11-15T19:28:30.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedaaffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fedac0b1ee0 0x7fedac0b00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51818/0 (socket says 172.21.2.137:51818) 2021-11-15T19:28:30.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedaaffd700 1 -- 172.21.2.137:0/3772024694 learned_addr learned my addr 172.21.2.137:0/3772024694 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:30.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedab7fe700 1 --2- 172.21.2.137:0/3772024694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:30.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedab7fe700 1 -- 172.21.2.137:0/3772024694 >> v1:172.21.2.137:6789/0 conn(0x7fedac0b1ee0 legacy=0x7fedac0b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedab7fe700 1 -- 172.21.2.137:0/3772024694 >> v1:172.21.2.111:6789/0 conn(0x7fedac0679a0 legacy=0x7fedac14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedab7fe700 1 -- 172.21.2.137:0/3772024694 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0b6ba0 con 0x7fedac0b67c0 2021-11-15T19:28:30.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.156+0000 7fedab7fe700 1 --2- 172.21.2.137:0/3772024694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac0afbe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fed94002f70 tx=0x7fed94006d90).ready entity=mon.2 client_cookie=7ce4ae011f26d94a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:30.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedaa7fc700 1 -- 172.21.2.137:0/3772024694 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9400f680 con 0x7fedac0b67c0 2021-11-15T19:28:30.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedaa7fc700 1 -- 172.21.2.137:0/3772024694 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94000e90 con 0x7fedac0b67c0 2021-11-15T19:28:30.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedaa7fc700 1 -- 172.21.2.137:0/3772024694 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9400f9d0 con 0x7fedac0b67c0 2021-11-15T19:28:30.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- 172.21.2.137:0/3772024694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 msgr2=0x7fedac0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3772024694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac0afbe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fed94002f70 tx=0x7fed94006d90).stop 2021-11-15T19:28:30.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- 172.21.2.137:0/3772024694 shutdown_connections 2021-11-15T19:28:30.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3772024694 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac0afbe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:30.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- 172.21.2.137:0/3772024694 >> 172.21.2.137:0/3772024694 conn(0x7fedac064420 msgr2=0x7fedac0b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:30.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- 172.21.2.137:0/3772024694 shutdown_connections 2021-11-15T19:28:30.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- 172.21.2.137:0/3772024694 wait complete. 2021-11-15T19:28:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 Processor -- start 2021-11-15T19:28:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- start start 2021-11-15T19:28:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fedac0679a0 0x7fedac0b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 0x7fedac159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac144890 con 0x7fedac0679a0 2021-11-15T19:28:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac144560 con 0x7fedac0b1ee0 2021-11-15T19:28:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedb1a96700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac144020 con 0x7fedac0b67c0 2021-11-15T19:28:30.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedaaffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 0x7fedac159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:30.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedab7fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fedac0679a0 0x7fedac0b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:30.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedaaffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 0x7fedac159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33044/0 (socket says 172.21.2.137:33044) 2021-11-15T19:28:30.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedaaffd700 1 -- 172.21.2.137:0/3562712109 learned_addr learned my addr 172.21.2.137:0/3562712109 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:30.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.160+0000 7fedabfff700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:30.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedab7fe700 1 -- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 msgr2=0x7fedac15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedab7fe700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:30.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedab7fe700 1 -- 172.21.2.137:0/3562712109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 msgr2=0x7fedac159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:30.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedab7fe700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 0x7fedac159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:30.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedab7fe700 1 -- 172.21.2.137:0/3562712109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9400b120 con 0x7fedac0679a0 2021-11-15T19:28:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedaaffd700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 0x7fedac159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:28:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedab7fe700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fedac0679a0 0x7fedac0b5160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fed94002f70 tx=0x7fed94015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed94011d30 con 0x7fedac0679a0 2021-11-15T19:28:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400f300 con 0x7fedac0679a0 2021-11-15T19:28:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac1442c0 con 0x7fedac0679a0 2021-11-15T19:28:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed94006210 con 0x7fedac0679a0 2021-11-15T19:28:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac156420 con 0x7fedac0679a0 2021-11-15T19:28:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac156640 con 0x7fedac0679a0 2021-11-15T19:28:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed9400f070 con 0x7fedac0679a0 2021-11-15T19:28:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7feda8ff9700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed90053610 0x7fed90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fed9406caa0 con 0x7fedac0679a0 2021-11-15T19:28:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedaaffd700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed90053610 0x7fed90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.164+0000 7fedaaffd700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed90053610 0x7fed90055ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fed9c00d000 tx=0x7fed9c007c40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:30.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.168+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed94043a70 con 0x7fedac0679a0 2021-11-15T19:28:30.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:30.272+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fedac0573d0 con 0x7fedac0679a0 2021-11-15T19:28:31.166 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:28:31.163+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:28:31.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7feda8ff9700 1 -- 172.21.2.137:0/3562712109 <== mon.0 v2:172.21.2.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7fed94047090 con 0x7fedac0679a0 2021-11-15T19:28:31.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed90053610 msgr2=0x7fed90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed90053610 0x7fed90055ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fed9c00d000 tx=0x7fed9c007c40).stop 2021-11-15T19:28:31.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fedac0679a0 msgr2=0x7fedac0b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fedac0679a0 0x7fedac0b5160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fed94002f70 tx=0x7fed94015000).stop 2021-11-15T19:28:31.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 shutdown_connections 2021-11-15T19:28:31.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed90053610 0x7fed90055ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fedac0b67c0 0x7fedac15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fedac0b1ee0 0x7fedac159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 --2- 172.21.2.137:0/3562712109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fedac0679a0 0x7fedac0b5160 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 >> 172.21.2.137:0/3562712109 conn(0x7fedac064420 msgr2=0x7fedac14a340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:31.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 shutdown_connections 2021-11-15T19:28:31.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.176+0000 7fedb1a96700 1 -- 172.21.2.137:0/3562712109 wait complete. 2021-11-15T19:28:31.183 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:28:31.187 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:31.199 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:28:31.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f155b911700 1 Processor -- start 2021-11-15T19:28:31.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f155b911700 1 -- start start 2021-11-15T19:28:31.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f155b911700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f155409c8c0 0x7f155409cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f155b911700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155409d190 con 0x7f155409ab00 2021-11-15T19:28:31.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f155b911700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155405fe40 con 0x7f15540b3140 2021-11-15T19:28:31.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f155b911700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1554099790 con 0x7f155409c8c0 2021-11-15T19:28:31.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1558eac700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f15540b3140 0x7f155405f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51850/0 (socket says 172.21.2.137:51850) 2021-11-15T19:28:31.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1558eac700 1 -- 172.21.2.137:0/4192377704 learned_addr learned my addr 172.21.2.137:0/4192377704 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:31.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780388127 0 0) 0x7f155405fe40 con 0x7f15540b3140 2021-11-15T19:28:31.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c003260 con 0x7f15540b3140 2021-11-15T19:28:31.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 --2- 172.21.2.137:0/4192377704 >> v2:172.21.2.111:3300/0 conn(0x7f155409c8c0 0x7f155409cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2703616326 0 0) 0x7f153c003260 con 0x7f15540b3140 2021-11-15T19:28:31.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 >> v2:172.21.2.111:3300/0 conn(0x7f155409c8c0 msgr2=0x7f155409cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:31.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 --2- 172.21.2.137:0/4192377704 >> v2:172.21.2.111:3300/0 conn(0x7f155409c8c0 0x7f155409cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 >> v1:172.21.2.111:6789/0 conn(0x7f155409ab00 legacy=0x7f1554143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:31.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540b2940 con 0x7f15540b3140 2021-11-15T19:28:31.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1544001660 con 0x7f15540b3140 2021-11-15T19:28:31.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 >> v1:172.21.2.137:6789/0 conn(0x7f15540b3140 legacy=0x7f155405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f153c003820 0x7f153c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f153c004500 0x7f153c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c004f70 0x7f153c00fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1554099790 con 0x7f153c004f70 2021-11-15T19:28:31.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c010260 con 0x7f153c003820 2021-11-15T19:28:31.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c010420 con 0x7f153c004500 2021-11-15T19:28:31.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f153c003820 0x7f153c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1558eac700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f153c004500 0x7f153c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1559eae700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c004f70 0x7f153c00fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 -- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f153c004500 msgr2=0x7f153c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:31.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f153c004500 0x7f153c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 -- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c004f70 msgr2=0x7f153c00fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:31.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c004f70 0x7f153c00fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1559eae700 1 -- 172.21.2.137:0/4192377704 reap_dead start 2021-11-15T19:28:31.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 -- 172.21.2.137:0/4192377704 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c003260 con 0x7f153c003820 2021-11-15T19:28:31.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f15596ad700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f153c003820 0x7f153c003c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f155000a000 tx=0x7f1550008040).ready entity=mon.1 client_cookie=8023e437682d3e1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:31.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.236+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1550013670 con 0x7f153c003820 2021-11-15T19:28:31.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500137d0 con 0x7f153c003820 2021-11-15T19:28:31.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1543fff700 1 -- 172.21.2.137:0/4192377704 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1550013b30 con 0x7f153c003820 2021-11-15T19:28:31.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/4192377704 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f153c003820 msgr2=0x7f153c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f153c003820 0x7f153c003c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f155000a000 tx=0x7f1550008040).stop 2021-11-15T19:28:31.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/4192377704 shutdown_connections 2021-11-15T19:28:31.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 --2- 172.21.2.137:0/4192377704 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f153c003820 0x7f153c003c20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/4192377704 >> 172.21.2.137:0/4192377704 conn(0x7f15540b45b0 msgr2=0x7f155405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:31.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/4192377704 shutdown_connections 2021-11-15T19:28:31.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/4192377704 wait complete. 2021-11-15T19:28:31.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 Processor -- start 2021-11-15T19:28:31.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- start start 2021-11-15T19:28:31.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c003820 0x7f15540987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 0x7f15540ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1554066980 0x7f15540aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540acf10 con 0x7f153c003820 2021-11-15T19:28:31.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540ad1b0 con 0x7f1554065f60 2021-11-15T19:28:31.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1554065d10 con 0x7f1554066980 2021-11-15T19:28:31.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 0x7f15540ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 0x7f15540ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33078/0 (socket says 172.21.2.137:33078) 2021-11-15T19:28:31.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 -- 172.21.2.137:0/1561069815 learned_addr learned my addr 172.21.2.137:0/1561069815 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:31.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 -- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1554066980 msgr2=0x7f15540aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1554066980 0x7f15540aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 -- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c003820 msgr2=0x7f15540987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c003820 0x7f15540987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 -- 172.21.2.137:0/1561069815 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540af250 con 0x7f1554065f60 2021-11-15T19:28:31.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f1558eac700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 0x7f15540ae870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f154400b000 tx=0x7f15540b2ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:31.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1544010710 con 0x7f1554065f60 2021-11-15T19:28:31.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544010870 con 0x7f1554065f60 2021-11-15T19:28:31.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1544010bd0 con 0x7f1554065f60 2021-11-15T19:28:31.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15540acc00 con 0x7f1554065f60 2021-11-15T19:28:31.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1554140330 con 0x7f1554065f60 2021-11-15T19:28:31.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1554099a30 con 0x7f1554065f60 2021-11-15T19:28:31.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1544010d30 con 0x7f1554065f60 2021-11-15T19:28:31.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f15427fc700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1534053720 0x7f1534055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.240+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f154406bc80 con 0x7f1554065f60 2021-11-15T19:28:31.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.244+0000 7f15596ad700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1534053720 0x7f1534055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.244+0000 7f15596ad700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1534053720 0x7f1534055be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f155000a000 tx=0x7f1550008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:31.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.244+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1544042c80 con 0x7f1554065f60 2021-11-15T19:28:31.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15540573d0 con 0x7f1554065f60 2021-11-15T19:28:31.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f15427fc700 1 -- 172.21.2.137:0/1561069815 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1776 (secure 0 0 0) 0x7f15440462a0 con 0x7f1554065f60 2021-11-15T19:28:31.360 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:31.360 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":11,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:27:24.602277+0000","modified":"2021-11-15T19:28:31.169248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T19:28:31.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1534053720 msgr2=0x7f1534055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1534053720 0x7f1534055be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f155000a000 tx=0x7f1550008040).stop 2021-11-15T19:28:31.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 msgr2=0x7f15540ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 0x7f15540ae870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f154400b000 tx=0x7f15540b2ad0).stop 2021-11-15T19:28:31.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 shutdown_connections 2021-11-15T19:28:31.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1534053720 0x7f1534055be0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1554066980 0x7f15540aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1554065f60 0x7f15540ae870 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 --2- 172.21.2.137:0/1561069815 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f153c003820 0x7f15540987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 >> 172.21.2.137:0/1561069815 conn(0x7f15540b45b0 msgr2=0x7f1554143d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:31.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 shutdown_connections 2021-11-15T19:28:31.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.356+0000 7f155b911700 1 -- 172.21.2.137:0/1561069815 wait complete. 2021-11-15T19:28:31.364 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 11 2021-11-15T19:28:31.367 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:28:31.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.412+0000 7f4892295700 1 Processor -- start 2021-11-15T19:28:31.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.412+0000 7f4892295700 1 -- start start 2021-11-15T19:28:31.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f488c05c770 0x7f488c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 0x7f488c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f488c14aaa0 0x7f488c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0b1650 con 0x7f488c05c770 2021-11-15T19:28:31.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c05cb50 con 0x7f488c14aaa0 2021-11-15T19:28:31.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0ad030 con 0x7f488c0b0550 2021-11-15T19:28:31.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f488c14aaa0 0x7f488c140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f488c14aaa0 0x7f488c140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33086/0 (socket says 172.21.2.137:33086) 2021-11-15T19:28:31.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 -- 172.21.2.137:0/908881306 learned_addr learned my addr 172.21.2.137:0/908881306 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:31.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 -- 172.21.2.137:0/908881306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 msgr2=0x7f488c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:31.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 --2- 172.21.2.137:0/908881306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 0x7f488c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 -- 172.21.2.137:0/908881306 >> v2:172.21.2.111:3300/0 conn(0x7f488c05c770 msgr2=0x7f488c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:31.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 --2- 172.21.2.137:0/908881306 >> v2:172.21.2.111:3300/0 conn(0x7f488c05c770 0x7f488c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 -- 172.21.2.137:0/908881306 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0ad2d0 con 0x7f488c14aaa0 2021-11-15T19:28:31.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4890832700 1 --2- 172.21.2.137:0/908881306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c14aaa0 0x7f488c140aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f48840032f0 tx=0x7f4884009290).ready entity=mon.1 client_cookie=da6b4a2d09fbe88a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:31.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488affd700 1 -- 172.21.2.137:0/908881306 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488400b870 con 0x7f488c14aaa0 2021-11-15T19:28:31.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488affd700 1 -- 172.21.2.137:0/908881306 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488400b9d0 con 0x7f488c14aaa0 2021-11-15T19:28:31.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488affd700 1 -- 172.21.2.137:0/908881306 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488400bb40 con 0x7f488c14aaa0 2021-11-15T19:28:31.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- 172.21.2.137:0/908881306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c14aaa0 msgr2=0x7f488c140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- 172.21.2.137:0/908881306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c14aaa0 0x7f488c140aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f48840032f0 tx=0x7f4884009290).stop 2021-11-15T19:28:31.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- 172.21.2.137:0/908881306 shutdown_connections 2021-11-15T19:28:31.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- 172.21.2.137:0/908881306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c14aaa0 0x7f488c140aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:31.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- 172.21.2.137:0/908881306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 0x7f488c14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- 172.21.2.137:0/908881306 >> v2:172.21.2.111:3300/0 conn(0x7f488c05c770 0x7f488c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- 172.21.2.137:0/908881306 >> 172.21.2.137:0/908881306 conn(0x7f488c0631e0 msgr2=0x7f488c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:31.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- 172.21.2.137:0/908881306 shutdown_connections 2021-11-15T19:28:31.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- 172.21.2.137:0/908881306 wait complete. 2021-11-15T19:28:31.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 Processor -- start 2021-11-15T19:28:31.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- start start 2021-11-15T19:28:31.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 0x7f488c149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 0x7f488c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f488c14aaa0 0x7f488c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c156400 con 0x7f488c14aaa0 2021-11-15T19:28:31.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c144730 con 0x7f488c05c770 2021-11-15T19:28:31.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f4892295700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c159ec0 con 0x7f488c0b0550 2021-11-15T19:28:31.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 0x7f488c149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 0x7f488c149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33090/0 (socket says 172.21.2.137:33090) 2021-11-15T19:28:31.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 -- 172.21.2.137:0/3873660563 learned_addr learned my addr 172.21.2.137:0/3873660563 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:31.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 -- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 msgr2=0x7f488c1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 0x7f488c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 -- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f488c14aaa0 msgr2=0x7f488c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:31.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f488c14aaa0 0x7f488c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:31.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 -- 172.21.2.137:0/3873660563 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009530 con 0x7f488c05c770 2021-11-15T19:28:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.416+0000 7f488bfff700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 0x7f488c149bd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f488c063e50 tx=0x7f4874006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4874013460 con 0x7f488c05c770 2021-11-15T19:28:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740135c0 con 0x7f488c05c770 2021-11-15T19:28:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c063b80 con 0x7f488c05c770 2021-11-15T19:28:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4874013920 con 0x7f488c05c770 2021-11-15T19:28:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c1416f0 con 0x7f488c05c770 2021-11-15T19:28:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c0639b0 con 0x7f488c05c770 2021-11-15T19:28:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f487401a060 con 0x7f488c05c770 2021-11-15T19:28:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f48897fa700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48700536a0 0x7f4870055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f487406b360 con 0x7f488c05c770 2021-11-15T19:28:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f488b7fe700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48700536a0 0x7f4870055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.420+0000 7f488b7fe700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48700536a0 0x7f4870055b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f487c002f70 tx=0x7f487c006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:31.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.424+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4874042470 con 0x7f488c05c770 2021-11-15T19:28:31.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:31.532+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f488c0ae7f0 con 0x7f488c05c770 2021-11-15T19:28:32.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.180+0000 7f48897fa700 1 -- 172.21.2.137:0/3873660563 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4874045a90 con 0x7f488c05c770 2021-11-15T19:28:32.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48700536a0 msgr2=0x7f4870055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:32.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48700536a0 0x7f4870055b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f487c002f70 tx=0x7f487c006960).stop 2021-11-15T19:28:32.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 msgr2=0x7f488c149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:32.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 0x7f488c149bd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f488c063e50 tx=0x7f4874006e20).stop 2021-11-15T19:28:32.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 shutdown_connections 2021-11-15T19:28:32.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48700536a0 0x7f4870055b60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:32.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f488c14aaa0 0x7f488c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:32.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f488c0b0550 0x7f488c1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:32.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 --2- 172.21.2.137:0/3873660563 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f488c05c770 0x7f488c149bd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:32.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 >> 172.21.2.137:0/3873660563 conn(0x7f488c0631e0 msgr2=0x7f488c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:32.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 shutdown_connections 2021-11-15T19:28:32.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.184+0000 7f4892295700 1 -- 172.21.2.137:0/3873660563 wait complete. 2021-11-15T19:28:32.193 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:28:32.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 Processor -- start 2021-11-15T19:28:32.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- start start 2021-11-15T19:28:32.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efe8405fd20 0x7efe840af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:32.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efe840b10b0 0x7efe840b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:32.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe84147f70 con 0x7efe840b0610 2021-11-15T19:28:32.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe84060100 con 0x7efe840b10b0 2021-11-15T19:28:32.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe84147cd0 con 0x7efe8405fd20 2021-11-15T19:28:32.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe89b82700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efe8405fd20 0x7efe840af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:32.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8a383700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efe840b0610 0x7efe840aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51882/0 (socket says 172.21.2.137:51882) 2021-11-15T19:28:32.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8a383700 1 -- 172.21.2.137:0/2100055941 learned_addr learned my addr 172.21.2.137:0/2100055941 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:32.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe89b82700 1 -- 172.21.2.137:0/2100055941 >> v2:172.21.2.111:3300/0 conn(0x7efe840b10b0 msgr2=0x7efe840b0120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:32.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe89b82700 1 --2- 172.21.2.137:0/2100055941 >> v2:172.21.2.111:3300/0 conn(0x7efe840b10b0 0x7efe840b0120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:32.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe89b82700 1 -- 172.21.2.137:0/2100055941 >> v1:172.21.2.137:6789/0 conn(0x7efe840b0610 legacy=0x7efe840aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:32.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe89b82700 1 -- 172.21.2.137:0/2100055941 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840a9ed0 con 0x7efe8405fd20 2021-11-15T19:28:32.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe89b82700 1 --2- 172.21.2.137:0/2100055941 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe840af800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7efe80002f70 tx=0x7efe80006df0).ready entity=mon.1 client_cookie=5224f080a5c0a180 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:32.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe88b80700 1 -- 172.21.2.137:0/2100055941 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8000d5c0 con 0x7efe8405fd20 2021-11-15T19:28:32.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe88b80700 1 -- 172.21.2.137:0/2100055941 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80000e90 con 0x7efe8405fd20 2021-11-15T19:28:32.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe88b80700 1 -- 172.21.2.137:0/2100055941 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8000d950 con 0x7efe8405fd20 2021-11-15T19:28:32.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- 172.21.2.137:0/2100055941 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 msgr2=0x7efe840af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:32.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 --2- 172.21.2.137:0/2100055941 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe840af800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7efe80002f70 tx=0x7efe80006df0).stop 2021-11-15T19:28:32.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- 172.21.2.137:0/2100055941 shutdown_connections 2021-11-15T19:28:32.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 --2- 172.21.2.137:0/2100055941 >> v2:172.21.2.111:3300/0 conn(0x7efe840b10b0 0x7efe840b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:32.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 --2- 172.21.2.137:0/2100055941 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe840af800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:32.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- 172.21.2.137:0/2100055941 >> 172.21.2.137:0/2100055941 conn(0x7efe840b4e60 msgr2=0x7efe840b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:32.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- 172.21.2.137:0/2100055941 shutdown_connections 2021-11-15T19:28:32.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.244+0000 7efe8bde6700 1 -- 172.21.2.137:0/2100055941 wait complete. 2021-11-15T19:28:32.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 Processor -- start 2021-11-15T19:28:32.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- start start 2021-11-15T19:28:32.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe84067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:32.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe840b0610 0x7efe84062940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:32.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe840b10b0 0x7efe84156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:32.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840add40 con 0x7efe840b0610 2021-11-15T19:28:32.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840adaa0 con 0x7efe8405fd20 2021-11-15T19:28:32.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe84064030 con 0x7efe840b10b0 2021-11-15T19:28:32.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe84067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:32.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe84067520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33108/0 (socket says 172.21.2.137:33108) 2021-11-15T19:28:32.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 -- 172.21.2.137:0/3420552463 learned_addr learned my addr 172.21.2.137:0/3420552463 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:32.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 -- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe840b10b0 msgr2=0x7efe84156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:32.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe840b10b0 0x7efe84156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:32.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 -- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe840b0610 msgr2=0x7efe84062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:32.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe840b0610 0x7efe84062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:32.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 -- 172.21.2.137:0/3420552463 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8000b180 con 0x7efe8405fd20 2021-11-15T19:28:32.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89b82700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe84067520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7efe80002f70 tx=0x7efe80014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:32.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80016070 con 0x7efe8405fd20 2021-11-15T19:28:32.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000de50 con 0x7efe8405fd20 2021-11-15T19:28:32.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84062e30 con 0x7efe8405fd20 2021-11-15T19:28:32.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8001e450 con 0x7efe8405fd20 2021-11-15T19:28:32.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84156e60 con 0x7efe8405fd20 2021-11-15T19:28:32.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe840641f0 con 0x7efe8405fd20 2021-11-15T19:28:32.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe80025030 con 0x7efe8405fd20 2021-11-15T19:28:32.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe72ffd700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe64053610 0x7efe64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:32.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6155+0+0 (secure 0 0 0) 0x7efe8006cb30 con 0x7efe8405fd20 2021-11-15T19:28:32.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.248+0000 7efe89381700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe64053610 0x7efe64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:32.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.252+0000 7efe89381700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe64053610 0x7efe64055ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7efe74002ef0 tx=0x7efe74006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:32.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.252+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe80043c40 con 0x7efe8405fd20 2021-11-15T19:28:32.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:32.336+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe840b0a70 con 0x7efe8405fd20 2021-11-15T19:28:33.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe72ffd700 1 -- 172.21.2.137:0/3420552463 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 185+0+0 (secure 0 0 0) 0x7efe80023020 con 0x7efe8405fd20 2021-11-15T19:28:33.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe64053610 msgr2=0x7efe64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:33.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe64053610 0x7efe64055ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7efe74002ef0 tx=0x7efe74006910).stop 2021-11-15T19:28:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 msgr2=0x7efe84067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe84067520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7efe80002f70 tx=0x7efe80014000).stop 2021-11-15T19:28:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 shutdown_connections 2021-11-15T19:28:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe64053610 0x7efe64055ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe840b10b0 0x7efe84156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe840b0610 0x7efe84062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 --2- 172.21.2.137:0/3420552463 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe8405fd20 0x7efe84067520 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 >> 172.21.2.137:0/3420552463 conn(0x7efe840b4e60 msgr2=0x7efe84146220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 shutdown_connections 2021-11-15T19:28:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.216+0000 7efe8bde6700 1 -- 172.21.2.137:0/3420552463 wait complete. 2021-11-15T19:28:33.223 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:28:33.227 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:28:33.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 Processor -- start 2021-11-15T19:28:33.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 -- start start 2021-11-15T19:28:33.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3b2013f890 0x7f3b200b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:33.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2005fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:33.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b20060070 con 0x7f3b200608f0 2021-11-15T19:28:33.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200ad6c0 con 0x7f3b2013f890 2021-11-15T19:28:33.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b2785e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200b1b50 con 0x7f3b2005f730 2021-11-15T19:28:33.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b255fa700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f3b200608f0 0x7f3b200b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:44388/0 (socket says 172.21.2.137:44388) 2021-11-15T19:28:33.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b255fa700 1 -- 172.21.2.137:0/1152202678 learned_addr learned my addr 172.21.2.137:0/1152202678 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:33.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b25dfb700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2005fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:33.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.280+0000 7f3b24df9700 1 --2- 172.21.2.137:0/1152202678 >> v2:172.21.2.111:3300/0 conn(0x7f3b2013f890 0x7f3b200b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:33.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b24df9700 1 -- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 msgr2=0x7f3b2005fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:33.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b24df9700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2005fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:33.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b24df9700 1 -- 172.21.2.137:0/1152202678 >> v1:172.21.2.111:6789/0 conn(0x7f3b200608f0 legacy=0x7f3b200b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:33.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b24df9700 1 -- 172.21.2.137:0/1152202678 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200b0c80 con 0x7f3b2013f890 2021-11-15T19:28:33.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2005fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:28:33.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b24df9700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b2013f890 0x7f3b200b1660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3b1c002f70 tx=0x7f3b1c006df0).ready entity=mon.0 client_cookie=8d73acaf14cfd439 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:33.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b13fff700 1 -- 172.21.2.137:0/1152202678 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1c00d570 con 0x7f3b2013f890 2021-11-15T19:28:33.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b13fff700 1 -- 172.21.2.137:0/1152202678 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c000e90 con 0x7f3b2013f890 2021-11-15T19:28:33.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b13fff700 1 -- 172.21.2.137:0/1152202678 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1c00d8c0 con 0x7f3b2013f890 2021-11-15T19:28:33.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b2013f890 msgr2=0x7f3b200b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:33.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b2013f890 0x7f3b200b1660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3b1c002f70 tx=0x7f3b1c006df0).stop 2021-11-15T19:28:33.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- 172.21.2.137:0/1152202678 shutdown_connections 2021-11-15T19:28:33.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2005fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:33.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 --2- 172.21.2.137:0/1152202678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b2013f890 0x7f3b200b1660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:33.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- 172.21.2.137:0/1152202678 >> 172.21.2.137:0/1152202678 conn(0x7f3b20063980 msgr2=0x7f3b20063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:33.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- 172.21.2.137:0/1152202678 shutdown_connections 2021-11-15T19:28:33.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- 172.21.2.137:0/1152202678 wait complete. 2021-11-15T19:28:33.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 Processor -- start 2021-11-15T19:28:33.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- start start 2021-11-15T19:28:33.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2013bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:33.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b200608f0 0x7f3b20122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:33.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 0x7f3b20122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:33.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2013d430 con 0x7f3b200608f0 2021-11-15T19:28:33.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201231f0 con 0x7f3b2013f890 2021-11-15T19:28:33.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b2785e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20141cf0 con 0x7f3b2005f730 2021-11-15T19:28:33.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 0x7f3b20122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:33.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 0x7f3b20122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33122/0 (socket says 172.21.2.137:33122) 2021-11-15T19:28:33.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 -- 172.21.2.137:0/3233134214 learned_addr learned my addr 172.21.2.137:0/3233134214 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:33.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b255fa700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2013bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:33.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 -- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 msgr2=0x7f3b2013bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:33.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2013bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:33.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 -- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b200608f0 msgr2=0x7f3b20122810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:33.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b200608f0 0x7f3b20122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:33.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 -- 172.21.2.137:0/3233134214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18009470 con 0x7f3b2013f890 2021-11-15T19:28:33.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b255fa700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2013bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:28:33.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b25dfb700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 0x7f3b20122d00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f3b1800c000 tx=0x7f3b180091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:33.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1800c850 con 0x7f3b2013f890 2021-11-15T19:28:33.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1800c9b0 con 0x7f3b2013f890 2021-11-15T19:28:33.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.284+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1800cd10 con 0x7f3b2013f890 2021-11-15T19:28:33.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c00b180 con 0x7f3b2013f890 2021-11-15T19:28:33.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2013ab30 con 0x7f3b2013f890 2021-11-15T19:28:33.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2013af70 con 0x7f3b2013f890 2021-11-15T19:28:33.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b18022070 con 0x7f3b2013f890 2021-11-15T19:28:33.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b127fc700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3b00053580 0x7f3b00055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:33.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f3b1806c220 con 0x7f3b2013f890 2021-11-15T19:28:33.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b255fa700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3b00053580 0x7f3b00055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:33.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b255fa700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3b00053580 0x7f3b00055a40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3b14008000 tx=0x7f3b14009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:33.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.288+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b18043350 con 0x7f3b2013f890 2021-11-15T19:28:33.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:33.372+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b200573d0 con 0x7f3b2013f890 2021-11-15T19:28:34.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b127fc700 1 -- 172.21.2.137:0/3233134214 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3b18016020 con 0x7f3b2013f890 2021-11-15T19:28:34.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3b00053580 msgr2=0x7f3b00055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3b00053580 0x7f3b00055a40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3b14008000 tx=0x7f3b14009040).stop 2021-11-15T19:28:34.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 msgr2=0x7f3b20122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 0x7f3b20122d00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f3b1800c000 tx=0x7f3b180091d0).stop 2021-11-15T19:28:34.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 shutdown_connections 2021-11-15T19:28:34.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3b00053580 0x7f3b00055a40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3b2013f890 0x7f3b20122d00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3b200608f0 0x7f3b20122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 --2- 172.21.2.137:0/3233134214 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3b2005f730 0x7f3b2013bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 >> 172.21.2.137:0/3233134214 conn(0x7f3b20063980 msgr2=0x7f3b2005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:34.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 shutdown_connections 2021-11-15T19:28:34.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.224+0000 7f3b2785e700 1 -- 172.21.2.137:0/3233134214 wait complete. 2021-11-15T19:28:34.231 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:28:34.234 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:28:34.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 Processor -- start 2021-11-15T19:28:34.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- start start 2021-11-15T19:28:34.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f41600b0550 0x7f416014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f416014aaa0 0x7f4160140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416005cb50 con 0x7f416005c770 2021-11-15T19:28:34.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41600b1650 con 0x7f41600b0550 2021-11-15T19:28:34.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ad030 con 0x7f416014aaa0 2021-11-15T19:28:34.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f416005c770 0x7f41600aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51910/0 (socket says 172.21.2.137:51910) 2021-11-15T19:28:34.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415ffff700 1 -- 172.21.2.137:0/485498804 learned_addr learned my addr 172.21.2.137:0/485498804 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:34.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415f7fe700 1 --2- 172.21.2.137:0/485498804 >> v2:172.21.2.137:3300/0 conn(0x7f41600b0550 0x7f416014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415f7fe700 1 -- 172.21.2.137:0/485498804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f416014aaa0 msgr2=0x7f4160140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:34.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415f7fe700 1 --2- 172.21.2.137:0/485498804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f416014aaa0 0x7f4160140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415f7fe700 1 -- 172.21.2.137:0/485498804 >> v1:172.21.2.137:6789/0 conn(0x7f416005c770 legacy=0x7f41600aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415f7fe700 1 -- 172.21.2.137:0/485498804 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600ad2d0 con 0x7f41600b0550 2021-11-15T19:28:34.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415f7fe700 1 --2- 172.21.2.137:0/485498804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41600b0550 0x7f416014a5b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f4148002f70 tx=0x7f4148006df0).ready entity=mon.1 client_cookie=ad40212de586e033 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:34.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415effd700 1 -- 172.21.2.137:0/485498804 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800d570 con 0x7f41600b0550 2021-11-15T19:28:34.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415effd700 1 -- 172.21.2.137:0/485498804 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148000e90 con 0x7f41600b0550 2021-11-15T19:28:34.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f415effd700 1 -- 172.21.2.137:0/485498804 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800d8c0 con 0x7f41600b0550 2021-11-15T19:28:34.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- 172.21.2.137:0/485498804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41600b0550 msgr2=0x7f416014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- 172.21.2.137:0/485498804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41600b0550 0x7f416014a5b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f4148002f70 tx=0x7f4148006df0).stop 2021-11-15T19:28:34.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- 172.21.2.137:0/485498804 shutdown_connections 2021-11-15T19:28:34.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- 172.21.2.137:0/485498804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f41600b0550 0x7f416014a5b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- 172.21.2.137:0/485498804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f416014aaa0 0x7f4160140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- 172.21.2.137:0/485498804 >> 172.21.2.137:0/485498804 conn(0x7f41600631e0 msgr2=0x7f416005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:34.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- 172.21.2.137:0/485498804 shutdown_connections 2021-11-15T19:28:34.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- 172.21.2.137:0/485498804 wait complete. 2021-11-15T19:28:34.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 Processor -- start 2021-11-15T19:28:34.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- start start 2021-11-15T19:28:34.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416005c770 0x7f4160063b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41600b0550 0x7f4160159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 0x7f416015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160157760 con 0x7f416005c770 2021-11-15T19:28:34.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160144850 con 0x7f416014aaa0 2021-11-15T19:28:34.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f416692b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160066f70 con 0x7f41600b0550 2021-11-15T19:28:34.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.288+0000 7f4164ec8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 0x7f416015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 0x7f416015a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33134/0 (socket says 172.21.2.137:33134) 2021-11-15T19:28:34.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 -- 172.21.2.137:0/3004016302 learned_addr learned my addr 172.21.2.137:0/3004016302 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:34.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 -- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41600b0550 msgr2=0x7f4160159c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:34.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41600b0550 0x7f4160159c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 -- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416005c770 msgr2=0x7f4160063b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:34.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416005c770 0x7f4160063b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 -- 172.21.2.137:0/3004016302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414800b180 con 0x7f416014aaa0 2021-11-15T19:28:34.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f4164ec8700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 0x7f416015a130 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f41580032f0 tx=0x7f4158009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:34.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415800d580 con 0x7f416014aaa0 2021-11-15T19:28:34.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415800d6e0 con 0x7f416014aaa0 2021-11-15T19:28:34.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415800da40 con 0x7f416014aaa0 2021-11-15T19:28:34.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4160067210 con 0x7f416014aaa0 2021-11-15T19:28:34.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160066810 con 0x7f416014aaa0 2021-11-15T19:28:34.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41600ae7f0 con 0x7f416014aaa0 2021-11-15T19:28:34.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f415800dba0 con 0x7f416014aaa0 2021-11-15T19:28:34.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f41440536a0 0x7f4144055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f415806bae0 con 0x7f416014aaa0 2021-11-15T19:28:34.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415ffff700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f41440536a0 0x7f4144055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415ffff700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f41440536a0 0x7f4144055b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f41600620e0 tx=0x7f41500077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:34.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.292+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4158042e10 con 0x7f416014aaa0 2021-11-15T19:28:34.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.376+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f41600573d0 con 0x7f416014aaa0 2021-11-15T19:28:34.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.388+0000 7f415d7fa700 1 -- 172.21.2.137:0/3004016302 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4158046430 con 0x7f416014aaa0 2021-11-15T19:28:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f41440536a0 msgr2=0x7f4144055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f41440536a0 0x7f4144055b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f41600620e0 tx=0x7f41500077f0).stop 2021-11-15T19:28:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 msgr2=0x7f416015a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 0x7f416015a130 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f41580032f0 tx=0x7f4158009220).stop 2021-11-15T19:28:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 shutdown_connections 2021-11-15T19:28:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f41440536a0 0x7f4144055b60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f416014aaa0 0x7f416015a130 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41600b0550 0x7f4160159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 --2- 172.21.2.137:0/3004016302 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416005c770 0x7f4160063b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 >> 172.21.2.137:0/3004016302 conn(0x7f41600631e0 msgr2=0x7f41600b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:34.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 shutdown_connections 2021-11-15T19:28:34.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.392+0000 7f416692b700 1 -- 172.21.2.137:0/3004016302 wait complete. 2021-11-15T19:28:34.401 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-11-15T19:28:34.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dc1fdb700 1 Processor -- start 2021-11-15T19:28:34.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dc1fdb700 1 -- start start 2021-11-15T19:28:34.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dc1fdb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 0x7f4dbc147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dc1fdb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc148190 con 0x7f4dbc0b1340 2021-11-15T19:28:34.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dc1fdb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0b1720 con 0x7f4dbc0a9f50 2021-11-15T19:28:34.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dc1fdb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc147e70 con 0x7f4dbc144610 2021-11-15T19:28:34.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dbbfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4dbc0a9f50 0x7f4dbc0aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51924/0 (socket says 172.21.2.137:51924) 2021-11-15T19:28:34.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.448+0000 7f4dbbfff700 1 -- 172.21.2.137:0/3880448614 learned_addr learned my addr 172.21.2.137:0/3880448614 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:34.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790668989 0 0) 0x7f4dbc0b1720 con 0x7f4dbc0a9f50 2021-11-15T19:28:34.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c003260 con 0x7f4dbc0a9f50 2021-11-15T19:28:34.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 200346926 0 0) 0x7f4d9c003260 con 0x7f4dbc0a9f50 2021-11-15T19:28:34.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 msgr2=0x7f4dbc147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:34.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 0x7f4dbc147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 >> v1:172.21.2.111:6789/0 conn(0x7f4dbc0b1340 legacy=0x7f4dbc143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:34.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0af800 con 0x7f4dbc0a9f50 2021-11-15T19:28:34.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4db40019e0 con 0x7f4dbc0a9f50 2021-11-15T19:28:34.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 >> v1:172.21.2.137:6789/0 conn(0x7f4dbc0a9f50 legacy=0x7f4dbc0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 0x7f4d9c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c003ec0 0x7f4d9c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4d9c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc147e70 con 0x7f4d9c003ec0 2021-11-15T19:28:34.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c00ba00 con 0x7f4d9c004b40 2021-11-15T19:28:34.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c00bbc0 con 0x7f4dbc144610 2021-11-15T19:28:34.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4d9c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 0x7f4d9c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbaffd700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c003ec0 0x7f4d9c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 -- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 msgr2=0x7f4d9c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:34.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 0x7f4d9c0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 -- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c003ec0 msgr2=0x7f4d9c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:34.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d9c003ec0 0x7f4d9c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:34.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 -- 172.21.2.137:0/3880448614 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c003260 con 0x7f4d9c004b40 2021-11-15T19:28:34.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc144610 0x7f4d9c0037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:28:34.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4d9c004fc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f4dbc05cfa0 tx=0x7f4dbc0abfb0).ready entity=mon.1 client_cookie=cdc94009f7f50477 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:34.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db400cbe0 con 0x7f4d9c004b40 2021-11-15T19:28:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400cd40 con 0x7f4d9c004b40 2021-11-15T19:28:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dba7fc700 1 -- 172.21.2.137:0/3880448614 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db4005b80 con 0x7f4d9c004b40 2021-11-15T19:28:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/3880448614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 msgr2=0x7f4d9c004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/3880448614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4d9c004fc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f4dbc05cfa0 tx=0x7f4dbc0abfb0).stop 2021-11-15T19:28:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbbfff700 1 -- 172.21.2.137:0/3880448614 reap_dead start 2021-11-15T19:28:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/3880448614 shutdown_connections 2021-11-15T19:28:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/3880448614 >> 172.21.2.137:0/3880448614 conn(0x7f4dbc0b4e60 msgr2=0x7f4dbc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/3880448614 shutdown_connections 2021-11-15T19:28:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/3880448614 wait complete. 2021-11-15T19:28:34.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 Processor -- start 2021-11-15T19:28:34.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- start start 2021-11-15T19:28:34.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4dbc144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4dbc147060 0x7f4dbc159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc099450 0x7f4dbc15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc147900 con 0x7f4dbc147060 2021-11-15T19:28:34.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0adc60 con 0x7f4d9c004b40 2021-11-15T19:28:34.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dc1fdb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0adf00 con 0x7f4dbc099450 2021-11-15T19:28:34.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4dbc144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4dbc144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33152/0 (socket says 172.21.2.137:33152) 2021-11-15T19:28:34.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 -- 172.21.2.137:0/2476166696 learned_addr learned my addr 172.21.2.137:0/2476166696 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:34.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 -- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc099450 msgr2=0x7f4dbc15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc099450 0x7f4dbc15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 -- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4dbc147060 msgr2=0x7f4dbc159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:34.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4dbc147060 0x7f4dbc159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:34.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 -- 172.21.2.137:0/2476166696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc15a560 con 0x7f4d9c004b40 2021-11-15T19:28:34.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.452+0000 7f4dbb7fe700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4dbc144d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f4da4008000 tx=0x7f4da4009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:34.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da400de50 con 0x7f4d9c004b40 2021-11-15T19:28:34.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400f440 con 0x7f4d9c004b40 2021-11-15T19:28:34.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc15a750 con 0x7f4d9c004b40 2021-11-15T19:28:34.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da400f7a0 con 0x7f4d9c004b40 2021-11-15T19:28:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc134550 con 0x7f4d9c004b40 2021-11-15T19:28:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc05faf0 con 0x7f4d9c004b40 2021-11-15T19:28:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4da400f900 con 0x7f4d9c004b40 2021-11-15T19:28:34.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4da00536d0 0x7f4da0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:34.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f4da406b200 con 0x7f4d9c004b40 2021-11-15T19:28:34.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4dbaffd700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4da00536d0 0x7f4da0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:34.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4dbaffd700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4da00536d0 0x7f4da0055b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4dac00a000 tx=0x7f4dac008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:34.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.456+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4da4042640 con 0x7f4d9c004b40 2021-11-15T19:28:34.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:34.568+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f4dbc0573d0 con 0x7f4d9c004b40 2021-11-15T19:28:35.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.232+0000 7f4db8ff9700 1 -- 172.21.2.137:0/2476166696 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v83) v1 ==== 139+0+0 (secure 0 0 0) 0x7f4da4045c60 con 0x7f4d9c004b40 2021-11-15T19:28:35.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.236+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4da00536d0 msgr2=0x7f4da0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:35.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.236+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4da00536d0 0x7f4da0055b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4dac00a000 tx=0x7f4dac008040).stop 2021-11-15T19:28:35.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.236+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 msgr2=0x7f4dbc144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:35.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.236+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4dbc144d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f4da4008000 tx=0x7f4da4009040).stop 2021-11-15T19:28:35.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 shutdown_connections 2021-11-15T19:28:35.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4da00536d0 0x7f4da0055b90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:35.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4dbc099450 0x7f4dbc15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:35.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4dbc147060 0x7f4dbc159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:35.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 --2- 172.21.2.137:0/2476166696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d9c004b40 0x7f4dbc144d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:35.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 >> 172.21.2.137:0/2476166696 conn(0x7f4dbc0b4e60 msgr2=0x7f4dbc13dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:35.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 shutdown_connections 2021-11-15T19:28:35.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.240+0000 7f4dc1fdb700 1 -- 172.21.2.137:0/2476166696 wait complete. 2021-11-15T19:28:35.270 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T19:28:35.270 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T19:28:35.271 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-11-15T19:28:35.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 Processor -- start 2021-11-15T19:28:35.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- start start 2021-11-15T19:28:35.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b00b1340 0x7f84b0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:35.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84b00a9f50 0x7f84b00aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:35.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b0148190 con 0x7f84b0143f00 2021-11-15T19:28:35.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00b1720 con 0x7f84b00a9f50 2021-11-15T19:28:35.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0147e70 con 0x7f84b00b1340 2021-11-15T19:28:35.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b5546700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f84b0143f00 0x7f84b0144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51946/0 (socket says 172.21.2.137:51946) 2021-11-15T19:28:35.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b5546700 1 -- 172.21.2.137:0/4190998090 learned_addr learned my addr 172.21.2.137:0/4190998090 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:35.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b6548700 1 --2- 172.21.2.137:0/4190998090 >> v2:172.21.2.137:3300/0 conn(0x7f84b00a9f50 0x7f84b00aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:35.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b6548700 1 -- 172.21.2.137:0/4190998090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b00b1340 msgr2=0x7f84b0147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:35.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b6548700 1 --2- 172.21.2.137:0/4190998090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b00b1340 0x7f84b0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:35.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b6548700 1 -- 172.21.2.137:0/4190998090 >> v1:172.21.2.137:6789/0 conn(0x7f84b0143f00 legacy=0x7f84b0144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:35.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b6548700 1 -- 172.21.2.137:0/4190998090 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00af800 con 0x7f84b00a9f50 2021-11-15T19:28:35.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b6548700 1 --2- 172.21.2.137:0/4190998090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00a9f50 0x7f84b00aa370 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f84a80032f0 tx=0x7f84a80091d0).ready entity=mon.1 client_cookie=7498431d9e5d3ede server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:35.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b4d45700 1 -- 172.21.2.137:0/4190998090 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a8009ea0 con 0x7f84b00a9f50 2021-11-15T19:28:35.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b4d45700 1 -- 172.21.2.137:0/4190998090 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a800b8a0 con 0x7f84b00a9f50 2021-11-15T19:28:35.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b4d45700 1 -- 172.21.2.137:0/4190998090 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a800ba10 con 0x7f84b00a9f50 2021-11-15T19:28:35.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- 172.21.2.137:0/4190998090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00a9f50 msgr2=0x7f84b00aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:35.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- 172.21.2.137:0/4190998090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00a9f50 0x7f84b00aa370 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f84a80032f0 tx=0x7f84a80091d0).stop 2021-11-15T19:28:35.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- 172.21.2.137:0/4190998090 shutdown_connections 2021-11-15T19:28:35.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- 172.21.2.137:0/4190998090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00a9f50 0x7f84b00aa370 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:35.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- 172.21.2.137:0/4190998090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b00b1340 0x7f84b0147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:35.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- 172.21.2.137:0/4190998090 >> 172.21.2.137:0/4190998090 conn(0x7f84b00b4e60 msgr2=0x7f84b00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- 172.21.2.137:0/4190998090 shutdown_connections 2021-11-15T19:28:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- 172.21.2.137:0/4190998090 wait complete. 2021-11-15T19:28:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 Processor -- start 2021-11-15T19:28:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- start start 2021-11-15T19:28:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b00a9f50 0x7f84b013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 0x7f84b00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b0143f00 0x7f84b01489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01428f0 con 0x7f84b00a9f50 2021-11-15T19:28:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0142b90 con 0x7f84b00b1340 2021-11-15T19:28:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b7fab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0142e30 con 0x7f84b0143f00 2021-11-15T19:28:35.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b5546700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 0x7f84b00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:35.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b5546700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 0x7f84b00b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33168/0 (socket says 172.21.2.137:33168) 2021-11-15T19:28:35.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.324+0000 7f84b5546700 1 -- 172.21.2.137:0/463127172 learned_addr learned my addr 172.21.2.137:0/463127172 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:35.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5546700 1 -- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b0143f00 msgr2=0x7f84b01489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:35.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5546700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b0143f00 0x7f84b01489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:35.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5546700 1 -- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b00a9f50 msgr2=0x7f84b013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:35.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5546700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b00a9f50 0x7f84b013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:35.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5546700 1 -- 172.21.2.137:0/463127172 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8009470 con 0x7f84b00b1340 2021-11-15T19:28:35.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5546700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 0x7f84b00b3fd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f84b005cfa0 tx=0x7f84ac007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:35.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ac00ce30 con 0x7f84b00b1340 2021-11-15T19:28:35.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac0072e0 con 0x7f84b00b1340 2021-11-15T19:28:35.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00ad510 con 0x7f84b00b1340 2021-11-15T19:28:35.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ac005800 con 0x7f84b00b1340 2021-11-15T19:28:35.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0148e90 con 0x7f84b00b1340 2021-11-15T19:28:35.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b01487e0 con 0x7f84b00b1340 2021-11-15T19:28:35.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f84ac010070 con 0x7f84b00b1340 2021-11-15T19:28:35.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84900536f0 0x7f8490055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:35.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f84ac06acf0 con 0x7f84b00b1340 2021-11-15T19:28:35.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5d47700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84900536f0 0x7f8490055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:35.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84b5d47700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84900536f0 0x7f8490055bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f84a4002f70 tx=0x7f84a40069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:35.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.328+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84ac042020 con 0x7f84b00b1340 2021-11-15T19:28:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:35.444+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f84b0148190 con 0x7f84b00b1340 2021-11-15T19:28:36.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.237+0000 7f84a2ffd700 1 -- 172.21.2.137:0/463127172 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v84) v1 ==== 147+0+0 (secure 0 0 0) 0x7f84b0148190 con 0x7f84b00b1340 2021-11-15T19:28:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84900536f0 msgr2=0x7f8490055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84900536f0 0x7f8490055bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f84a4002f70 tx=0x7f84a40069e0).stop 2021-11-15T19:28:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 msgr2=0x7f84b00b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 0x7f84b00b3fd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f84b005cfa0 tx=0x7f84ac007c40).stop 2021-11-15T19:28:36.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 shutdown_connections 2021-11-15T19:28:36.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84900536f0 0x7f8490055bb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b0143f00 0x7f84b01489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b00b1340 0x7f84b00b3fd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 --2- 172.21.2.137:0/463127172 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b00a9f50 0x7f84b013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 >> 172.21.2.137:0/463127172 conn(0x7f84b00b4e60 msgr2=0x7f84b0145b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:36.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 shutdown_connections 2021-11-15T19:28:36.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.241+0000 7f84b7fab700 1 -- 172.21.2.137:0/463127172 wait complete. 2021-11-15T19:28:36.249 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:28:36.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 Processor -- start 2021-11-15T19:28:36.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- start start 2021-11-15T19:28:36.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9f3c065b10 0x7f9f3c13c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9f3c0b00a0 0x7f9f3c05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c066270 con 0x7f9f3c065730 2021-11-15T19:28:36.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c067410 con 0x7f9f3c065b10 2021-11-15T19:28:36.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c065fd0 con 0x7f9f3c0b00a0 2021-11-15T19:28:36.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9f3c0b00a0 0x7f9f3c05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9f3c0b00a0 0x7f9f3c05bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33178/0 (socket says 172.21.2.137:33178) 2021-11-15T19:28:36.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 -- 172.21.2.137:0/4182205251 learned_addr learned my addr 172.21.2.137:0/4182205251 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:36.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 -- 172.21.2.137:0/4182205251 >> v2:172.21.2.111:3300/0 conn(0x7f9f3c065b10 msgr2=0x7f9f3c13c9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:36.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 --2- 172.21.2.137:0/4182205251 >> v2:172.21.2.111:3300/0 conn(0x7f9f3c065b10 0x7f9f3c13c9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 -- 172.21.2.137:0/4182205251 >> v1:172.21.2.111:6789/0 conn(0x7f9f3c065730 legacy=0x7f9f3c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:36.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 -- 172.21.2.137:0/4182205251 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c066f70 con 0x7f9f3c0b00a0 2021-11-15T19:28:36.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f3b7fe700 1 --2- 172.21.2.137:0/4182205251 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c0b00a0 0x7f9f3c05bd20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9f3c0612c0 tx=0x7f9f3400b530).ready entity=mon.1 client_cookie=26edd726f5d9d19 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f39ffb700 1 -- 172.21.2.137:0/4182205251 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f340155e0 con 0x7f9f3c0b00a0 2021-11-15T19:28:36.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f39ffb700 1 -- 172.21.2.137:0/4182205251 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34015740 con 0x7f9f3c0b00a0 2021-11-15T19:28:36.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f39ffb700 1 -- 172.21.2.137:0/4182205251 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f34015aa0 con 0x7f9f3c0b00a0 2021-11-15T19:28:36.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- 172.21.2.137:0/4182205251 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c0b00a0 msgr2=0x7f9f3c05bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 --2- 172.21.2.137:0/4182205251 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c0b00a0 0x7f9f3c05bd20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9f3c0612c0 tx=0x7f9f3400b530).stop 2021-11-15T19:28:36.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- 172.21.2.137:0/4182205251 shutdown_connections 2021-11-15T19:28:36.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 --2- 172.21.2.137:0/4182205251 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c0b00a0 0x7f9f3c05bd20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 --2- 172.21.2.137:0/4182205251 >> v2:172.21.2.111:3300/0 conn(0x7f9f3c065b10 0x7f9f3c13c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- 172.21.2.137:0/4182205251 >> 172.21.2.137:0/4182205251 conn(0x7f9f3c060290 msgr2=0x7f9f3c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:36.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- 172.21.2.137:0/4182205251 shutdown_connections 2021-11-15T19:28:36.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.301+0000 7f9f414ff700 1 -- 172.21.2.137:0/4182205251 wait complete. 2021-11-15T19:28:36.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 Processor -- start 2021-11-15T19:28:36.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- start start 2021-11-15T19:28:36.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 0x7f9f3c0ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f3c065b10 0x7f9f3c140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f3c0b00a0 0x7f9f3c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0ae7d0 con 0x7f9f3c0b00a0 2021-11-15T19:28:36.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0aea70 con 0x7f9f3c065730 2021-11-15T19:28:36.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c143790 con 0x7f9f3c065b10 2021-11-15T19:28:36.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 0x7f9f3c0ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 0x7f9f3c0ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33180/0 (socket says 172.21.2.137:33180) 2021-11-15T19:28:36.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 -- 172.21.2.137:0/263651365 learned_addr learned my addr 172.21.2.137:0/263651365 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:36.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 -- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f3c065b10 msgr2=0x7f9f3c140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f3c065b10 0x7f9f3c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 -- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f3c0b00a0 msgr2=0x7f9f3c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f3c0b00a0 0x7f9f3c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 -- 172.21.2.137:0/263651365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3400b7d0 con 0x7f9f3c065730 2021-11-15T19:28:36.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3affd700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 0x7f9f3c0ad790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9f24002f90 tx=0x7f9f24006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f24013460 con 0x7f9f3c065730 2021-11-15T19:28:36.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240135c0 con 0x7f9f3c065730 2021-11-15T19:28:36.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c1432f0 con 0x7f9f3c065730 2021-11-15T19:28:36.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f24013920 con 0x7f9f3c065730 2021-11-15T19:28:36.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c0acb30 con 0x7f9f3c065730 2021-11-15T19:28:36.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c143950 con 0x7f9f3c065730 2021-11-15T19:28:36.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f2401a060 con 0x7f9f3c065730 2021-11-15T19:28:36.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f33fff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f20053580 0x7f9f20055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9f2406b0f0 con 0x7f9f3c065730 2021-11-15T19:28:36.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.305+0000 7f9f3a7fc700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f20053580 0x7f9f20055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.309+0000 7f9f3a7fc700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f20053580 0x7f9f20055a40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9f2c002fb0 tx=0x7f9f2c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.309+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f24042420 con 0x7f9f3c065730 2021-11-15T19:28:36.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.393+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9f3c0573d0 con 0x7f9f3c065730 2021-11-15T19:28:36.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.401+0000 7f9f33fff700 1 -- 172.21.2.137:0/263651365 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9f24018020 con 0x7f9f3c065730 2021-11-15T19:28:36.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f20053580 msgr2=0x7f9f20055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f20053580 0x7f9f20055a40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9f2c002fb0 tx=0x7f9f2c0069b0).stop 2021-11-15T19:28:36.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 msgr2=0x7f9f3c0ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 0x7f9f3c0ad790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9f24002f90 tx=0x7f9f24006df0).stop 2021-11-15T19:28:36.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 shutdown_connections 2021-11-15T19:28:36.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f20053580 0x7f9f20055a40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f3c0b00a0 0x7f9f3c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f3c065b10 0x7f9f3c140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 --2- 172.21.2.137:0/263651365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f3c065730 0x7f9f3c0ad790 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 >> 172.21.2.137:0/263651365 conn(0x7f9f3c060290 msgr2=0x7f9f3c13fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:36.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 shutdown_connections 2021-11-15T19:28:36.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.405+0000 7f9f414ff700 1 -- 172.21.2.137:0/263651365 wait complete. 2021-11-15T19:28:36.413 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:28:36.414 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:36.422 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:36.435 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:36.448 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:36.461 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:28:36.471 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:28:36.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:36.472 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:36.472 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:36.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:36.477 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:28:36.478 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:28:36.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:36.479 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:36.479 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:28:36.499 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:28:36.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:36.500 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:28:36.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:36.501 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:36.502 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:28:36.507 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:28:36.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:28:36.509 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:28:36.509 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:28:36.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 Processor -- start 2021-11-15T19:28:36.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 -- start start 2021-11-15T19:28:36.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f30ec0b1340 0x7f30ec147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30ec143f00 0x7f30ec144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec148190 con 0x7f30ec0a9f50 2021-11-15T19:28:36.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec0b1720 con 0x7f30ec0b1340 2021-11-15T19:28:36.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f3a7c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec147e70 con 0x7f30ec143f00 2021-11-15T19:28:36.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f2019700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f30ec0a9f50 0x7f30ec0aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51970/0 (socket says 172.21.2.137:51970) 2021-11-15T19:28:36.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f2019700 1 -- 172.21.2.137:0/1047560908 learned_addr learned my addr 172.21.2.137:0/1047560908 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:36.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1017700 1 --2- 172.21.2.137:0/1047560908 >> v2:172.21.2.137:3300/0 conn(0x7f30ec143f00 0x7f30ec144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1818700 1 --2- 172.21.2.137:0/1047560908 >> v2:172.21.2.111:3300/0 conn(0x7f30ec0b1340 0x7f30ec147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1017700 1 -- 172.21.2.137:0/1047560908 >> v2:172.21.2.111:3300/0 conn(0x7f30ec0b1340 msgr2=0x7f30ec147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:36.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1017700 1 --2- 172.21.2.137:0/1047560908 >> v2:172.21.2.111:3300/0 conn(0x7f30ec0b1340 0x7f30ec147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1017700 1 -- 172.21.2.137:0/1047560908 >> v1:172.21.2.137:6789/0 conn(0x7f30ec0a9f50 legacy=0x7f30ec0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1017700 1 -- 172.21.2.137:0/1047560908 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0af800 con 0x7f30ec143f00 2021-11-15T19:28:36.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f0816700 1 -- 172.21.2.137:0/1047560908 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358683333 0 0) 0x7f30e4001490 con 0x7f30ec0a9f50 2021-11-15T19:28:36.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1818700 1 --2- 172.21.2.137:0/1047560908 >> v2:172.21.2.111:3300/0 conn(0x7f30ec0b1340 0x7f30ec147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:28:36.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f1017700 1 --2- 172.21.2.137:0/1047560908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec143f00 0x7f30ec144390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8006df0).ready entity=mon.1 client_cookie=d83215371f58f6cc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f0816700 1 -- 172.21.2.137:0/1047560908 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e800d5c0 con 0x7f30ec143f00 2021-11-15T19:28:36.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f0816700 1 -- 172.21.2.137:0/1047560908 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8000e90 con 0x7f30ec143f00 2021-11-15T19:28:36.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.565+0000 7f30f0816700 1 -- 172.21.2.137:0/1047560908 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e800d910 con 0x7f30ec143f00 2021-11-15T19:28:36.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/1047560908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec143f00 msgr2=0x7f30ec144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/1047560908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec143f00 0x7f30ec144390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8006df0).stop 2021-11-15T19:28:36.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/1047560908 shutdown_connections 2021-11-15T19:28:36.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/1047560908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec143f00 0x7f30ec144390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/1047560908 >> v2:172.21.2.111:3300/0 conn(0x7f30ec0b1340 0x7f30ec147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/1047560908 >> 172.21.2.137:0/1047560908 conn(0x7f30ec0b4e60 msgr2=0x7f30ec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:36.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/1047560908 shutdown_connections 2021-11-15T19:28:36.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/1047560908 wait complete. 2021-11-15T19:28:36.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 Processor -- start 2021-11-15T19:28:36.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- start start 2021-11-15T19:28:36.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30ec0a9f50 0x7f30ec159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 0x7f30ec0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30ec143f00 0x7f30ec09a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec098950 con 0x7f30ec0a9f50 2021-11-15T19:28:36.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec099ec0 con 0x7f30ec0b1340 2021-11-15T19:28:36.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec149f50 con 0x7f30ec143f00 2021-11-15T19:28:36.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 0x7f30ec0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 0x7f30ec0b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33196/0 (socket says 172.21.2.137:33196) 2021-11-15T19:28:36.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 -- 172.21.2.137:0/3821533350 learned_addr learned my addr 172.21.2.137:0/3821533350 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:36.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1818700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30ec0a9f50 0x7f30ec159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f2019700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30ec143f00 0x7f30ec09a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 -- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30ec143f00 msgr2=0x7f30ec09a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30ec143f00 0x7f30ec09a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 -- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30ec0a9f50 msgr2=0x7f30ec159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30ec0a9f50 0x7f30ec159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 -- 172.21.2.137:0/3821533350 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e800b180 con 0x7f30ec0b1340 2021-11-15T19:28:36.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f1017700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 0x7f30ec0b3dc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e801e400 con 0x7f30ec0b1340 2021-11-15T19:28:36.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e801e560 con 0x7f30ec0b1340 2021-11-15T19:28:36.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e801e8c0 con 0x7f30ec0b1340 2021-11-15T19:28:36.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec14a1f0 con 0x7f30ec0b1340 2021-11-15T19:28:36.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec149c40 con 0x7f30ec0b1340 2021-11-15T19:28:36.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec05faf0 con 0x7f30ec0b1340 2021-11-15T19:28:36.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f30e8025030 con 0x7f30ec0b1340 2021-11-15T19:28:36.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30deffd700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc053720 0x7f30cc055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.569+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f30e806c740 con 0x7f30ec0b1340 2021-11-15T19:28:36.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.573+0000 7f30f1818700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc053720 0x7f30cc055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.573+0000 7f30f1818700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc053720 0x7f30cc055be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f30e000b000 tx=0x7f30e0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.573+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f30e8043ab0 con 0x7f30ec0b1340 2021-11-15T19:28:36.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.653+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f30ec0573d0 con 0x7f30ec0b1340 2021-11-15T19:28:36.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30deffd700 1 -- 172.21.2.137:0/3821533350 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+28827 (secure 0 0 0) 0x7f30e8047090 con 0x7f30ec0b1340 2021-11-15T19:28:36.659 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:36.659 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:28:36.659 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 34, 2021-11-15T19:28:36.660 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:28:36.660 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:28:36.660 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:28:34.216102+0000", 2021-11-15T19:28:36.660 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:28:36.661 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:28:36.661 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:28:36.661 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:28:36.661 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:28:36.661 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:28:36.662 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:28:36.662 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:28:36.662 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:28:36.662 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:36.663 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:28:36.663 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:28:36.663 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:28:36.663 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:28:36.664 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:28:36.664 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 6, 2021-11-15T19:28:36.664 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:28:36.664 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:28:36.665 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:28:36.665 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:28:36.665 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:28:36.665 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.665 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:28:36.666 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:28:36.666 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:28:36.666 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:28:36.666 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:28:36.667 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:28:36.667 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:28:36.667 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:28:36.667 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:28:36.668 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:28:36.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:28:36.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:28:36.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:28:36.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:28:36.669 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:28:36.669 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:28:36.669 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:28:36.669 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:28:36.670 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:28:36.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:28:36.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:28:36.670 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:28:36.671 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:28:36.671 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.671 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:28:36.671 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:28:36.671 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:28:36.672 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:28:36.672 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:28:36.672 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:28:36.672 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:28:36.673 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:28:36.673 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:28:36.673 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:28:36.673 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:28:36.673 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:28:36.674 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:28:36.674 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:28:36.674 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:28:36.674 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:28:36.675 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:28:36.675 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:28:36.675 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:28:36.675 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:28:36.676 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:28:36.676 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:28:36.676 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:28:36.676 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:28:36.676 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:28:36.677 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:28:36.677 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:28:36.677 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.677 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:28:36.678 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:28:36.678 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:28:36.678 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:28:36.678 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:28:36.678 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:28:36.679 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:28:36.679 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:28:36.679 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:28:36.679 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:28:36.680 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:28:36.680 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:28:36.680 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:28:36.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.680 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:28:36.681 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:28:36.681 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.681 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.681 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.682 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:28:36.682 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:28:36.682 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:28:36.682 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:28:36.683 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:28:36.683 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:28:36.683 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:28:36.683 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:28:36.684 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:28:36.684 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:28:36.684 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:28:36.684 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:28:36.684 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:28:36.685 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:28:36.685 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:28:36.685 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:28:36.685 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:28:36.686 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:28:36.686 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:28:36.686 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:28:36.686 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:28:36.686 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:28:36.687 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:28:36.687 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.687 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:28:36.687 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:28:36.688 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:28:36.688 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:28:36.688 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:28:36.688 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:28:36.688 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:28:36.689 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:28:36.689 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:28:36.689 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:28:36.689 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:28:36.690 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:28:36.690 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:28:36.690 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:28:36.690 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:28:36.691 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:28:36.691 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:28:36.691 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:28:36.691 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:28:36.691 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:28:36.692 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:28:36.692 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:28:36.692 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:28:36.692 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:28:36.693 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:28:36.693 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:28:36.693 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:28:36.693 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.693 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:28:36.694 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:28:36.694 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:28:36.694 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:28:36.694 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:28:36.695 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:28:36.695 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:28:36.695 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:28:36.695 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:28:36.696 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:28:36.696 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:28:36.696 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:28:36.696 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:28:36.696 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:28:36.697 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.697 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.697 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:36.697 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:28:36.698 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.698 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:28:36.698 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:28:36.698 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.698 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.699 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.699 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.699 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.699 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.700 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.700 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:36.700 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.700 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.700 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.701 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:28:36.702 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.702 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.703 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:28:36.703 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.703 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.703 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.703 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.704 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.704 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.704 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.705 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:28:36.705 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.705 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.705 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.705 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.706 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:28:36.706 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.706 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.707 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.707 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.707 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.707 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.707 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.708 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:28:36.708 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.708 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.708 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.709 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.709 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:28:36.709 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.709 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.709 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.710 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.710 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.710 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.710 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.711 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:28:36.711 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.711 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.712 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.712 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:28:36.712 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:28:36.712 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.713 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.713 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.713 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:28:36.713 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:28:36.713 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:28:36.714 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:28:36.714 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.714 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.714 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.715 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.715 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.715 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.715 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:28:36.716 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:28:36.716 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.716 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.716 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.716 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.717 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.717 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.717 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.717 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 29, 2021-11-15T19:28:36.718 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.718 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.718 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.718 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.718 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.719 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.719 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:28:36.719 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.719 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.720 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.720 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:28:36.720 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.721 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.721 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.721 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.721 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.721 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.722 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.722 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.722 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:28:36.722 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.723 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.723 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.723 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:28:36.724 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.724 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.724 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.724 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.724 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.725 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.725 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.725 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.725 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:28:36.726 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.726 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.726 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.726 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.727 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:28:36.727 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.727 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.727 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.728 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.728 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.728 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.729 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:28:36.729 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.729 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.729 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.730 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:28:36.730 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:28:36.730 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.730 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.731 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.731 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:28:36.731 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:28:36.731 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:28:36.732 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:28:36.732 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.732 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.732 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.732 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.733 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.733 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.733 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:28:36.733 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:28:36.734 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.734 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.734 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.734 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.734 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.735 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.735 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.735 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 26, 2021-11-15T19:28:36.735 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.736 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.736 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.736 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.736 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.737 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.737 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:28:36.737 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.737 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.737 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.738 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.738 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:28:36.738 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.738 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.739 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.739 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.739 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.739 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.740 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.740 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.740 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:28:36.740 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.740 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.741 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.741 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.741 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:28:36.741 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.742 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.742 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.742 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.742 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.742 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.743 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.743 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.743 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:28:36.743 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.744 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.744 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.744 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.744 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:28:36.744 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.745 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.745 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.745 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.745 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.746 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.746 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.746 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.746 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:28:36.746 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.747 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.747 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.747 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.747 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:28:36.747 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:28:36.748 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.748 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.748 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.748 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:28:36.749 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:28:36.749 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:28:36.749 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:28:36.749 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.749 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.750 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.750 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.750 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.750 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.751 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:28:36.751 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:28:36.751 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.751 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.751 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.752 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.752 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.752 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.752 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.753 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:36.753 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.753 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.753 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.753 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.754 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.754 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.754 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:28:36.754 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.755 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.755 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.755 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.755 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:28:36.755 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.756 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.756 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.756 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.756 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.757 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.757 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:28:36.757 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.758 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.758 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.758 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.758 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:28:36.759 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.759 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.759 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.759 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.760 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.760 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.760 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.760 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.760 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:28:36.761 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.761 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.761 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.761 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.762 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:28:36.762 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.762 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.762 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.763 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.763 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.763 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.763 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.763 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.764 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:28:36.764 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.764 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.764 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.765 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.765 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:28:36.765 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:28:36.765 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.765 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.766 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.766 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:28:36.766 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:28:36.766 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:28:36.767 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:28:36.767 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.767 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.767 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.767 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.768 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.768 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.768 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:28:36.768 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:28:36.769 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.769 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.769 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.769 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.769 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.770 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.770 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.770 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:36.770 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.771 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.771 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.771 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.771 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.771 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.772 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:28:36.772 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.772 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.772 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.773 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.773 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:28:36.773 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.773 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.773 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.774 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.774 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.774 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.774 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.775 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.775 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:28:36.775 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.775 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.775 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.776 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.776 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:28:36.776 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.776 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.777 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.777 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.777 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.777 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.778 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.778 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.778 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:28:36.778 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.778 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.779 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.779 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.779 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:28:36.779 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.780 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.780 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.780 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.780 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.780 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.781 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.781 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:28:36.781 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.782 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.782 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.782 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.782 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:28:36.782 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:28:36.783 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.783 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.783 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.783 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:28:36.784 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:28:36.784 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:28:36.784 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:28:36.784 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.784 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.785 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.785 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.785 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.785 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.785 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:28:36.786 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:28:36.786 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.786 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.786 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.787 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.787 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.787 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.787 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.788 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 28, 2021-11-15T19:28:36.788 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.788 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.788 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.788 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.789 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.789 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.789 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:28:36.789 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.789 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.790 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.790 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.790 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:28:36.790 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.791 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.791 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.791 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.791 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.792 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.792 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.792 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.792 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:28:36.793 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.793 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.793 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.793 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.793 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:28:36.794 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.794 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.794 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.794 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.795 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.795 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.795 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.795 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.795 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:28:36.796 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.796 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.796 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.796 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:28:36.797 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.797 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.797 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.797 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.798 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.798 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.798 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.798 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.799 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:28:36.799 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.799 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.799 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.800 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:28:36.800 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:28:36.800 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.800 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.801 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.801 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:28:36.801 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:28:36.801 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:28:36.802 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:28:36.802 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.802 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.802 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.803 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.803 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.803 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.803 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:28:36.803 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:28:36.804 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.804 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.804 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.804 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.805 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.805 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 26, 2021-11-15T19:28:36.805 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.806 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.806 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.806 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.806 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.807 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.807 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:28:36.807 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.807 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.808 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.808 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.808 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:28:36.808 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.808 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.809 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.809 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.809 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.809 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.810 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.810 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.810 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:28:36.810 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.811 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.811 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.811 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.811 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:28:36.811 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.812 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.812 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.812 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.812 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.813 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.813 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.813 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.813 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:28:36.814 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.814 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.814 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.814 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.814 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:28:36.815 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.815 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.815 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.815 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.816 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.816 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.816 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.817 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:28:36.817 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.817 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.817 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.818 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.818 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:28:36.818 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:28:36.818 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.818 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.819 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.819 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:28:36.819 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:28:36.819 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:28:36.820 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:28:36.820 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.820 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.820 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.820 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.821 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.821 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.821 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:28:36.821 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:28:36.822 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:28:36.822 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:28:36.822 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:28:36.822 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:28:36.823 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:28:36.823 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:28:36.823 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:28:36.823 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 29, 2021-11-15T19:28:36.824 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:28:36.824 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:28:36.824 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:28:36.824 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.824 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.825 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.825 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:28:36.825 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.825 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.826 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.826 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.826 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:28:36.826 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.826 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.827 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.827 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.827 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:28:36.827 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.828 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.828 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.828 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:28:36.828 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.829 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.829 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.829 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.829 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:28:36.829 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.830 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.830 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.830 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.830 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:28:36.831 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.831 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.831 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.831 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:28:36.832 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.832 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.832 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.832 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.832 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:28:36.833 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.833 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.833 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.833 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.834 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:28:36.834 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:28:36.834 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.834 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:28:36.835 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:28:36.835 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.835 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.835 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.835 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:28:36.836 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:28:36.836 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:28:36.836 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.836 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.837 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.837 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:28:36.837 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:28:36.837 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:28:36.837 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:28:36.838 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:28:36.838 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:28:36.838 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:28:36.838 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:36.839 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.839 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:36.839 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:28:36.839 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.839 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:28:36.840 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.840 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.840 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.840 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.841 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.841 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:28:36.841 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.841 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.841 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.842 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:28:36.842 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.842 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.842 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.843 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.843 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.843 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:28:36.843 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.843 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.844 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.844 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:28:36.844 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.844 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.844 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.845 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.845 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.845 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:28:36.845 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.846 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.846 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.846 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:28:36.846 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.846 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.847 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.847 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.847 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.847 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:28:36.848 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.848 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.848 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.848 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:28:36.848 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.849 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.849 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.849 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.849 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.850 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:28:36.850 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.850 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.850 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.850 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:28:36.851 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.851 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.851 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.851 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.852 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.852 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:28:36.852 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.852 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.852 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.853 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:28:36.853 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.853 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.853 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.853 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.854 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.854 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:28:36.854 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.854 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.855 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:36.855 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:28:36.855 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:28:36.855 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:28:36.856 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:28:36.856 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:28:36.856 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:28:36.856 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:28:36.856 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:28:36.857 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.857 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:28:36.857 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:28:36.857 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:28:36.858 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:28:36.858 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:28:36.858 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:28:36.858 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/2316902828": "2021-11-16T19:28:30.281351+0000", 2021-11-15T19:28:36.859 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/2316902828": "2021-11-16T19:28:30.281351+0000" 2021-11-15T19:28:36.859 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.859 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:28:36.859 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:28:36.859 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:28:36.860 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:28:36.860 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:28:36.860 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:28:36.860 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:28:36.861 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:28:36.861 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:36.861 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:36.861 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:28:36.861 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:28:36.862 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:28:36.862 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:28:36.862 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:28:36.862 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:28:36.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc053720 msgr2=0x7f30cc055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc053720 0x7f30cc055be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f30e000b000 tx=0x7f30e0008040).stop 2021-11-15T19:28:36.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 msgr2=0x7f30ec0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 0x7f30ec0b3dc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8014000).stop 2021-11-15T19:28:36.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 shutdown_connections 2021-11-15T19:28:36.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30cc053720 0x7f30cc055be0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30ec143f00 0x7f30ec09a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30ec0b1340 0x7f30ec0b3dc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 --2- 172.21.2.137:0/3821533350 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30ec0a9f50 0x7f30ec159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 >> 172.21.2.137:0/3821533350 conn(0x7f30ec0b4e60 msgr2=0x7f30ec13e730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:36.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 shutdown_connections 2021-11-15T19:28:36.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.657+0000 7f30f3a7c700 1 -- 172.21.2.137:0/3821533350 wait complete. 2021-11-15T19:28:36.867 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:36.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 Processor -- start 2021-11-15T19:28:36.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- start start 2021-11-15T19:28:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb214144610 0x7fb214147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb214148190 con 0x7fb2140a9f50 2021-11-15T19:28:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140b1720 con 0x7fb2140b1340 2021-11-15T19:28:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb214147e70 con 0x7fb214144610 2021-11-15T19:28:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb21259c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb2140b1340 0x7fb214143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:51984/0 (socket says 172.21.2.137:51984) 2021-11-15T19:28:36.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb21259c700 1 -- 172.21.2.137:0/3885152081 learned_addr learned my addr 172.21.2.137:0/3885152081 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:36.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb211d9b700 1 --2- 172.21.2.137:0/3885152081 >> v2:172.21.2.137:3300/0 conn(0x7fb214144610 0x7fb214147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb211d9b700 1 -- 172.21.2.137:0/3885152081 >> v1:172.21.2.137:6789/0 conn(0x7fb2140b1340 legacy=0x7fb214143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb211d9b700 1 -- 172.21.2.137:0/3885152081 >> v1:172.21.2.111:6789/0 conn(0x7fb2140a9f50 legacy=0x7fb2140aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:36.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb21159a700 1 -- 172.21.2.137:0/3885152081 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578494081 0 0) 0x7fb2140b1720 con 0x7fb2140b1340 2021-11-15T19:28:36.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb211d9b700 1 -- 172.21.2.137:0/3885152081 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140af800 con 0x7fb214144610 2021-11-15T19:28:36.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb211d9b700 1 --2- 172.21.2.137:0/3885152081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb214144610 0x7fb214147980 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fb214062250 tx=0x7fb208006df0).ready entity=mon.1 client_cookie=18484afc83453d0c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb21159a700 1 -- 172.21.2.137:0/3885152081 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20800d5c0 con 0x7fb214144610 2021-11-15T19:28:36.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb21159a700 1 -- 172.21.2.137:0/3885152081 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208000e90 con 0x7fb214144610 2021-11-15T19:28:36.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb21159a700 1 -- 172.21.2.137:0/3885152081 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20800d910 con 0x7fb214144610 2021-11-15T19:28:36.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- 172.21.2.137:0/3885152081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb214144610 msgr2=0x7fb214147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 --2- 172.21.2.137:0/3885152081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb214144610 0x7fb214147980 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fb214062250 tx=0x7fb208006df0).stop 2021-11-15T19:28:36.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- 172.21.2.137:0/3885152081 shutdown_connections 2021-11-15T19:28:36.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 --2- 172.21.2.137:0/3885152081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb214144610 0x7fb214147980 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:36.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- 172.21.2.137:0/3885152081 >> 172.21.2.137:0/3885152081 conn(0x7fb2140b4e60 msgr2=0x7fb2140b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:36.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- 172.21.2.137:0/3885152081 shutdown_connections 2021-11-15T19:28:36.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.925+0000 7fb218b3a700 1 -- 172.21.2.137:0/3885152081 wait complete. 2021-11-15T19:28:36.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 Processor -- start 2021-11-15T19:28:36.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- start start 2021-11-15T19:28:36.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 0x7fb2140b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2140b1340 0x7fb21413d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb214144610 0x7fb21413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140ae460 con 0x7fb2140b1340 2021-11-15T19:28:36.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140af190 con 0x7fb2140a9f50 2021-11-15T19:28:36.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140adf20 con 0x7fb214144610 2021-11-15T19:28:36.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 0x7fb2140b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 0x7fb2140b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33210/0 (socket says 172.21.2.137:33210) 2021-11-15T19:28:36.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 -- 172.21.2.137:0/1875708791 learned_addr learned my addr 172.21.2.137:0/1875708791 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:36.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 -- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb214144610 msgr2=0x7fb21413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb214144610 0x7fb21413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 -- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2140b1340 msgr2=0x7fb21413d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:36.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2140b1340 0x7fb21413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:36.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 -- 172.21.2.137:0/1875708791 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20800b180 con 0x7fb2140a9f50 2021-11-15T19:28:36.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb21259c700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 0x7fb2140b3a40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fb204000ed0 tx=0x7fb204007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20400ce50 con 0x7fb2140a9f50 2021-11-15T19:28:36.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2040072e0 con 0x7fb2140a9f50 2021-11-15T19:28:36.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2140ae1c0 con 0x7fb2140a9f50 2021-11-15T19:28:36.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb204005610 con 0x7fb2140a9f50 2021-11-15T19:28:36.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2140ac2a0 con 0x7fb2140a9f50 2021-11-15T19:28:36.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21405faf0 con 0x7fb2140a9f50 2021-11-15T19:28:36.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb20401a060 con 0x7fb2140a9f50 2021-11-15T19:28:36.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb2037fe700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1f00536d0 0x7fb1f0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:36.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb20406aea0 con 0x7fb2140a9f50 2021-11-15T19:28:36.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.929+0000 7fb211d9b700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1f00536d0 0x7fb1f0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:36.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.933+0000 7fb211d9b700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1f00536d0 0x7fb1f0055b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fb214062250 tx=0x7fb208012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:36.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:36.933+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2040422e0 con 0x7fb2140a9f50 2021-11-15T19:28:37.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2140573d0 con 0x7fb2140a9f50 2021-11-15T19:28:37.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb2037fe700 1 -- 172.21.2.137:0/1875708791 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1208 (secure 0 0 0) 0x7fb204018020 con 0x7fb2140a9f50 2021-11-15T19:28:37.047 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:37.048 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":5104,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/2915194632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2915194632},{"type":"v1","addr":"172.21.2.137:6833","nonce":2915194632}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":12}],"filesystems":[]} 2021-11-15T19:28:37.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1f00536d0 msgr2=0x7fb1f0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1f00536d0 0x7fb1f0055b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fb214062250 tx=0x7fb208012000).stop 2021-11-15T19:28:37.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 msgr2=0x7fb2140b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 0x7fb2140b3a40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fb204000ed0 tx=0x7fb204007ac0).stop 2021-11-15T19:28:37.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 shutdown_connections 2021-11-15T19:28:37.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1f00536d0 0x7fb1f0055b90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:37.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb214144610 0x7fb21413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb2140b1340 0x7fb21413d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 --2- 172.21.2.137:0/1875708791 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb2140a9f50 0x7fb2140b3a40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:37.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 >> 172.21.2.137:0/1875708791 conn(0x7fb2140b4e60 msgr2=0x7fb214149150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:37.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 shutdown_connections 2021-11-15T19:28:37.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.045+0000 7fb218b3a700 1 -- 172.21.2.137:0/1875708791 wait complete. 2021-11-15T19:28:37.054 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 12 2021-11-15T19:28:37.056 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:37.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 Processor -- start 2021-11-15T19:28:37.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- start start 2021-11-15T19:28:37.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efc140ac3c0 0x7efc140ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efc140b2d50 0x7efc141440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc141445b0 0x7efc14144a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc140ac120 con 0x7efc140b2d50 2021-11-15T19:28:37.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc14097c50 con 0x7efc140ac3c0 2021-11-15T19:28:37.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc14144f20 con 0x7efc141445b0 2021-11-15T19:28:37.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efc140ac3c0 0x7efc140ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:37.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efc140ac3c0 0x7efc140ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33216/0 (socket says 172.21.2.137:33216) 2021-11-15T19:28:37.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 -- 172.21.2.137:0/4060524655 learned_addr learned my addr 172.21.2.137:0/4060524655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:37.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 -- 172.21.2.137:0/4060524655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc141445b0 msgr2=0x7efc14144a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:37.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 --2- 172.21.2.137:0/4060524655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc141445b0 0x7efc14144a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 -- 172.21.2.137:0/4060524655 >> v2:172.21.2.111:3300/0 conn(0x7efc140b2d50 msgr2=0x7efc141440c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:37.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 --2- 172.21.2.137:0/4060524655 >> v2:172.21.2.111:3300/0 conn(0x7efc140b2d50 0x7efc141440c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 -- 172.21.2.137:0/4060524655 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140979b0 con 0x7efc140ac3c0 2021-11-15T19:28:37.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc12ffd700 1 --2- 172.21.2.137:0/4060524655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc140ac3c0 0x7efc140ac7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04006eb0).ready entity=mon.1 client_cookie=572adb6420a9fd9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:37.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc11ffb700 1 -- 172.21.2.137:0/4060524655 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc04010b60 con 0x7efc140ac3c0 2021-11-15T19:28:37.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc11ffb700 1 -- 172.21.2.137:0/4060524655 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04000e90 con 0x7efc140ac3c0 2021-11-15T19:28:37.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc11ffb700 1 -- 172.21.2.137:0/4060524655 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc040183d0 con 0x7efc140ac3c0 2021-11-15T19:28:37.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- 172.21.2.137:0/4060524655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc140ac3c0 msgr2=0x7efc140ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- 172.21.2.137:0/4060524655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc140ac3c0 0x7efc140ac7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04006eb0).stop 2021-11-15T19:28:37.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- 172.21.2.137:0/4060524655 shutdown_connections 2021-11-15T19:28:37.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- 172.21.2.137:0/4060524655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc141445b0 0x7efc14144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- 172.21.2.137:0/4060524655 >> v2:172.21.2.111:3300/0 conn(0x7efc140b2d50 0x7efc141440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 --2- 172.21.2.137:0/4060524655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc140ac3c0 0x7efc140ac7a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:37.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- 172.21.2.137:0/4060524655 >> 172.21.2.137:0/4060524655 conn(0x7efc140b7070 msgr2=0x7efc140b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:37.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- 172.21.2.137:0/4060524655 shutdown_connections 2021-11-15T19:28:37.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.105+0000 7efc19965700 1 -- 172.21.2.137:0/4060524655 wait complete. 2021-11-15T19:28:37.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 Processor -- start 2021-11-15T19:28:37.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- start start 2021-11-15T19:28:37.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc140ac3c0 0x7efc140ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc141445b0 0x7efc1414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 0x7efc1414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14151b60 con 0x7efc141445b0 2021-11-15T19:28:37.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1414eaa0 con 0x7efc1414e100 2021-11-15T19:28:37.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1409cc60 con 0x7efc140ac3c0 2021-11-15T19:28:37.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 0x7efc1414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:37.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 0x7efc1414e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33224/0 (socket says 172.21.2.137:33224) 2021-11-15T19:28:37.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 -- 172.21.2.137:0/781846662 learned_addr learned my addr 172.21.2.137:0/781846662 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:37.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 -- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc140ac3c0 msgr2=0x7efc140ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc140ac3c0 0x7efc140ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 -- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc141445b0 msgr2=0x7efc1414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc141445b0 0x7efc1414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 -- 172.21.2.137:0/781846662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0400b1e0 con 0x7efc1414e100 2021-11-15T19:28:37.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc137fe700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 0x7efc1414e5b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7efc0c003330 tx=0x7efc0c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:37.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0c001520 con 0x7efc1414e100 2021-11-15T19:28:37.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c001680 con 0x7efc1414e100 2021-11-15T19:28:37.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0c001a20 con 0x7efc1414e100 2021-11-15T19:28:37.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc140aeb40 con 0x7efc1414e100 2021-11-15T19:28:37.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc140b6d60 con 0x7efc1414e100 2021-11-15T19:28:37.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14066c00 con 0x7efc1414e100 2021-11-15T19:28:37.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc0c018030 con 0x7efc1414e100 2021-11-15T19:28:37.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc0bfff700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbf80536f0 0x7efbf8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efc0c06b240 con 0x7efc1414e100 2021-11-15T19:28:37.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.109+0000 7efc12ffd700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbf80536f0 0x7efbf8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:37.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.113+0000 7efc12ffd700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbf80536f0 0x7efbf8055bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:37.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.113+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc0c041e90 con 0x7efc1414e100 2021-11-15T19:28:37.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc1409cda0 con 0x7efc1414e100 2021-11-15T19:28:37.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc0bfff700 1 -- 172.21.2.137:0/781846662 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1208 (secure 0 0 0) 0x7efc0c016070 con 0x7efc1414e100 2021-11-15T19:28:37.224 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:37.224 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/2279045715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2279045715},{"type":"v1","addr":"172.21.2.111:6835","nonce":2279045715}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":5104,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/2915194632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2915194632},{"type":"v1","addr":"172.21.2.137:6833","nonce":2915194632}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":12}],"filesystems":[]} 2021-11-15T19:28:37.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbf80536f0 msgr2=0x7efbf8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbf80536f0 0x7efbf8055bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04017000).stop 2021-11-15T19:28:37.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 msgr2=0x7efc1414e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 0x7efc1414e5b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7efc0c003330 tx=0x7efc0c0091a0).stop 2021-11-15T19:28:37.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 shutdown_connections 2021-11-15T19:28:37.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbf80536f0 0x7efbf8055bb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:37.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc1414e100 0x7efc1414e5b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:37.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc141445b0 0x7efc1414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 --2- 172.21.2.137:0/781846662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc140ac3c0 0x7efc140ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 >> 172.21.2.137:0/781846662 conn(0x7efc140b7070 msgr2=0x7efc140b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:37.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 shutdown_connections 2021-11-15T19:28:37.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.221+0000 7efc19965700 1 -- 172.21.2.137:0/781846662 wait complete. 2021-11-15T19:28:37.228 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 12 2021-11-15T19:28:37.231 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:28:37.231 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:28:37.232 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:28:37.232 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:28:37.232 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:28:37.233 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:28:37.233 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:28:37.233 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:28:37.237 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:28:37.238 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:28:37.239 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:28:37.240 DEBUG:teuthology.parallel:result is None 2021-11-15T19:28:37.245 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:28:37.246 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:28:37.247 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:28:37.248 DEBUG:teuthology.parallel:result is None 2021-11-15T19:28:37.248 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:28:37.272 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:28:37.280 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:28:37.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 Processor -- start 2021-11-15T19:28:37.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 -- start start 2021-11-15T19:28:37.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6c9c05c770 0x7f6c9c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c140aa0 0x7f6c9c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c05cb50 con 0x7f6c9c0b0550 2021-11-15T19:28:37.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b1650 con 0x7f6c9c05c770 2021-11-15T19:28:37.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6ca096c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0ad030 con 0x7f6c9c140aa0 2021-11-15T19:28:37.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6c9a59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6c9c05c770 0x7f6c9c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:37.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6c99d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6c9c0b0550 0x7f6c9c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52028/0 (socket says 172.21.2.137:52028) 2021-11-15T19:28:37.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.297+0000 7f6c99d9b700 1 -- 172.21.2.137:0/263341135 learned_addr learned my addr 172.21.2.137:0/263341135 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:37.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/263341135 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c140aa0 msgr2=0x7f6c9c140f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:37.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- 172.21.2.137:0/263341135 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c140aa0 0x7f6c9c140f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/263341135 >> v1:172.21.2.137:6789/0 conn(0x7f6c9c0b0550 legacy=0x7f6c9c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9959a700 1 -- 172.21.2.137:0/263341135 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297070937 0 0) 0x7f6c9c05cb50 con 0x7f6c9c0b0550 2021-11-15T19:28:37.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/263341135 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0ad2d0 con 0x7f6c9c05c770 2021-11-15T19:28:37.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- 172.21.2.137:0/263341135 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c0aef30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6c84002f70 tx=0x7f6c84006df0).ready entity=mon.1 client_cookie=709d6d0b1c4fe1f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:37.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9959a700 1 -- 172.21.2.137:0/263341135 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c8400d570 con 0x7f6c9c05c770 2021-11-15T19:28:37.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9959a700 1 -- 172.21.2.137:0/263341135 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84000e90 con 0x7f6c9c05c770 2021-11-15T19:28:37.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9959a700 1 -- 172.21.2.137:0/263341135 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c8400d8c0 con 0x7f6c9c05c770 2021-11-15T19:28:37.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/263341135 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 msgr2=0x7f6c9c0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 --2- 172.21.2.137:0/263341135 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c0aef30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6c84002f70 tx=0x7f6c84006df0).stop 2021-11-15T19:28:37.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/263341135 shutdown_connections 2021-11-15T19:28:37.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 --2- 172.21.2.137:0/263341135 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c140aa0 0x7f6c9c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 --2- 172.21.2.137:0/263341135 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c0aef30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:37.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/263341135 >> 172.21.2.137:0/263341135 conn(0x7f6c9c0631e0 msgr2=0x7f6c9c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:37.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/263341135 shutdown_connections 2021-11-15T19:28:37.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/263341135 wait complete. 2021-11-15T19:28:37.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 Processor -- start 2021-11-15T19:28:37.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- start start 2021-11-15T19:28:37.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c0b0550 0x7f6c9c065a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c9c140aa0 0x7f6c9c1435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1571b0 con 0x7f6c9c140aa0 2021-11-15T19:28:37.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c141800 con 0x7f6c9c05c770 2021-11-15T19:28:37.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c141aa0 con 0x7f6c9c0b0550 2021-11-15T19:28:37.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:37.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33250/0 (socket says 172.21.2.137:33250) 2021-11-15T19:28:37.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/769728680 learned_addr learned my addr 172.21.2.137:0/769728680 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:37.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c0b0550 msgr2=0x7f6c9c065a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c0b0550 0x7f6c9c065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c9c140aa0 msgr2=0x7f6c9c1435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:37.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c9c140aa0 0x7f6c9c1435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:37.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 -- 172.21.2.137:0/769728680 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8400b180 con 0x7f6c9c05c770 2021-11-15T19:28:37.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c9a59c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c142c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f6c9c141720 tx=0x7f6c84015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:37.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c8400d8f0 con 0x7f6c9c05c770 2021-11-15T19:28:37.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84011ca0 con 0x7f6c9c05c770 2021-11-15T19:28:37.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c066750 con 0x7f6c9c05c770 2021-11-15T19:28:37.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c156ce0 con 0x7f6c9c05c770 2021-11-15T19:28:37.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c8401e460 con 0x7f6c9c05c770 2021-11-15T19:28:37.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.301+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74003410 con 0x7f6c9c05c770 2021-11-15T19:28:37.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.305+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c84025030 con 0x7f6c9c05c770 2021-11-15T19:28:37.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.305+0000 7f6c937fe700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c800536f0 0x7f6c80055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:37.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.305+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6c8406cbd0 con 0x7f6c9c05c770 2021-11-15T19:28:37.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.305+0000 7f6c99d9b700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c800536f0 0x7f6c80055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:37.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.305+0000 7f6c99d9b700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c800536f0 0x7f6c80055bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f6c8c000ed0 tx=0x7f6c8c0076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:37.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.305+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c84043f00 con 0x7f6c9c05c770 2021-11-15T19:28:37.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:37.397+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6c74003c40 con 0x7f6c9c05c770 2021-11-15T19:28:38.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.305+0000 7f6c937fe700 1 -- 172.21.2.137:0/769728680 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6c84023020 con 0x7f6c9c05c770 2021-11-15T19:28:38.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c800536f0 msgr2=0x7f6c80055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c800536f0 0x7f6c80055bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f6c8c000ed0 tx=0x7f6c8c0076c0).stop 2021-11-15T19:28:38.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 msgr2=0x7f6c9c142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c142c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f6c9c141720 tx=0x7f6c84015000).stop 2021-11-15T19:28:38.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 shutdown_connections 2021-11-15T19:28:38.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c800536f0 0x7f6c80055bb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c9c140aa0 0x7f6c9c1435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c9c0b0550 0x7f6c9c065a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 --2- 172.21.2.137:0/769728680 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c9c05c770 0x7f6c9c142c10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 >> 172.21.2.137:0/769728680 conn(0x7f6c9c0631e0 msgr2=0x7f6c9c13f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 shutdown_connections 2021-11-15T19:28:38.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.309+0000 7f6ca096c700 1 -- 172.21.2.137:0/769728680 wait complete. 2021-11-15T19:28:38.314 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:28:38.317 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:28:38.318 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:28:38.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 Processor -- start 2021-11-15T19:28:38.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- start start 2021-11-15T19:28:38.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa8400b2d50 0x7fa84005f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa84005fed0 0x7fa840060380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa840097c50 con 0x7fa8400ac3c0 2021-11-15T19:28:38.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400ac120 con 0x7fa84005fed0 2021-11-15T19:28:38.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400979b0 con 0x7fa8400b2d50 2021-11-15T19:28:38.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83e59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa8400ac3c0 0x7fa8400ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52038/0 (socket says 172.21.2.137:52038) 2021-11-15T19:28:38.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83e59c700 1 -- 172.21.2.137:0/3853471787 learned_addr learned my addr 172.21.2.137:0/3853471787 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:38.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83dd9b700 1 --2- 172.21.2.137:0/3853471787 >> v2:172.21.2.137:3300/0 conn(0x7fa8400b2d50 0x7fa84005f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83dd9b700 1 -- 172.21.2.137:0/3853471787 >> v2:172.21.2.111:3300/0 conn(0x7fa84005fed0 msgr2=0x7fa840060380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83dd9b700 1 --2- 172.21.2.137:0/3853471787 >> v2:172.21.2.111:3300/0 conn(0x7fa84005fed0 0x7fa840060380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83dd9b700 1 -- 172.21.2.137:0/3853471787 >> v1:172.21.2.137:6789/0 conn(0x7fa8400ac3c0 legacy=0x7fa8400ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83dd9b700 1 -- 172.21.2.137:0/3853471787 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400aceb0 con 0x7fa8400b2d50 2021-11-15T19:28:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83dd9b700 1 --2- 172.21.2.137:0/3853471787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8400b2d50 0x7fa84005f9e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fa834002f70 tx=0x7fa834006df0).ready entity=mon.1 client_cookie=605aeeb66271cdb0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83d59a700 1 -- 172.21.2.137:0/3853471787 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa83400d5c0 con 0x7fa8400b2d50 2021-11-15T19:28:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83d59a700 1 -- 172.21.2.137:0/3853471787 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834000e90 con 0x7fa8400b2d50 2021-11-15T19:28:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa83d59a700 1 -- 172.21.2.137:0/3853471787 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa83400d910 con 0x7fa8400b2d50 2021-11-15T19:28:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- 172.21.2.137:0/3853471787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8400b2d50 msgr2=0x7fa84005f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 --2- 172.21.2.137:0/3853471787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8400b2d50 0x7fa84005f9e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fa834002f70 tx=0x7fa834006df0).stop 2021-11-15T19:28:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- 172.21.2.137:0/3853471787 shutdown_connections 2021-11-15T19:28:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 --2- 172.21.2.137:0/3853471787 >> v2:172.21.2.111:3300/0 conn(0x7fa84005fed0 0x7fa840060380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 --2- 172.21.2.137:0/3853471787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8400b2d50 0x7fa84005f9e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- 172.21.2.137:0/3853471787 >> 172.21.2.137:0/3853471787 conn(0x7fa8400b7070 msgr2=0x7fa8400b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- 172.21.2.137:0/3853471787 shutdown_connections 2021-11-15T19:28:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.417+0000 7fa844ac4700 1 -- 172.21.2.137:0/3853471787 wait complete. 2021-11-15T19:28:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 Processor -- start 2021-11-15T19:28:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- start start 2021-11-15T19:28:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 0x7fa8401425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8400ac3c0 0x7fa84009a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8400966c0 0x7fa84009ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa840065350 con 0x7fa8400ac3c0 2021-11-15T19:28:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84009b730 con 0x7fa84005fed0 2021-11-15T19:28:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84009b8a0 con 0x7fa8400966c0 2021-11-15T19:28:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 0x7fa8401425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 0x7fa8401425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33262/0 (socket says 172.21.2.137:33262) 2021-11-15T19:28:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 -- 172.21.2.137:0/2497918972 learned_addr learned my addr 172.21.2.137:0/2497918972 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 -- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8400966c0 msgr2=0x7fa84009ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8400966c0 0x7fa84009ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 -- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8400ac3c0 msgr2=0x7fa84009a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8400ac3c0 0x7fa84009a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 -- 172.21.2.137:0/2497918972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83400b180 con 0x7fa84005fed0 2021-11-15T19:28:38.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83e59c700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 0x7fa8401425c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fa840064ad0 tx=0x7fa830007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa83000ce20 con 0x7fa84005fed0 2021-11-15T19:28:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8300072e0 con 0x7fa84005fed0 2021-11-15T19:28:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa840066b90 con 0x7fa84005fed0 2021-11-15T19:28:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa830005800 con 0x7fa84005fed0 2021-11-15T19:28:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8400663c0 con 0x7fa84005fed0 2021-11-15T19:28:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84009b540 con 0x7fa84005fed0 2021-11-15T19:28:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa830010070 con 0x7fa84005fed0 2021-11-15T19:28:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa82f7fe700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa81c053610 0x7fa81c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa83006ac40 con 0x7fa84005fed0 2021-11-15T19:28:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.421+0000 7fa83dd9b700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa81c053610 0x7fa81c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.425+0000 7fa83dd9b700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa81c053610 0x7fa81c055ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa834002f70 tx=0x7fa834014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.425+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8300420d0 con 0x7fa84005fed0 2021-11-15T19:28:38.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa840067c60 con 0x7fa84005fed0 2021-11-15T19:28:38.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa82f7fe700 1 -- 172.21.2.137:0/2497918972 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fa8300456f0 con 0x7fa84005fed0 2021-11-15T19:28:38.539 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:38.539 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:28:38.540 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:28:38.540 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.540 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:28:38.540 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:28:38.541 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.541 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:28:38.541 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.541 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.542 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.542 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.542 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.542 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.543 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:28:38.543 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:28:38.543 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.543 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:28:38.543 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.544 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.544 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.544 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.544 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.544 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.545 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:28:38.545 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:28:38.545 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.545 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.546 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.546 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.546 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.546 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.546 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.547 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:28:38.547 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:28:38.547 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.547 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.548 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.548 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.548 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.548 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.548 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.549 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:28:38.549 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:28:38.549 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.549 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.550 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.550 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.550 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.550 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.550 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.551 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:28:38.551 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:28:38.551 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.551 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.552 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.552 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.552 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.552 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.552 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.553 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:28:38.553 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:28:38.553 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.553 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.554 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.554 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.554 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.554 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.554 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.555 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:28:38.555 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:28:38.555 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.555 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.556 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.556 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.556 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.556 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.556 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.557 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:28:38.557 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:28:38.557 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.557 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.557 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.558 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.558 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.558 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.558 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.558 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:28:38.559 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:28:38.559 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.559 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.559 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.560 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.560 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.560 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.560 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.560 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:28:38.561 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:28:38.561 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.561 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:28:38.561 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:28:38.561 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:28:38.562 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.562 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.562 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.562 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:28:38.563 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:28:38.563 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.563 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:28:38.563 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:28:38.563 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:28:38.564 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.564 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.564 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.564 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:28:38.565 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:28:38.565 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.565 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:28:38.565 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:28:38.565 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:28:38.566 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.566 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.566 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.566 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:28:38.566 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:28:38.567 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.567 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:28:38.567 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:28:38.567 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:28:38.568 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.568 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.568 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.568 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.568 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:28:38.569 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:28:38.569 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.569 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:28:38.569 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:28:38.570 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.570 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.570 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:38.570 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:38.570 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:28:38.571 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:28:38.571 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:28:38.571 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:28:38.571 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:28:38.572 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:28:38.572 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.572 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:38.572 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:28:38.572 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:28:38.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa81c053610 msgr2=0x7fa81c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa81c053610 0x7fa81c055ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa834002f70 tx=0x7fa834014000).stop 2021-11-15T19:28:38.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 msgr2=0x7fa8401425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 0x7fa8401425c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fa840064ad0 tx=0x7fa830007ca0).stop 2021-11-15T19:28:38.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 shutdown_connections 2021-11-15T19:28:38.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa81c053610 0x7fa81c055ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8400966c0 0x7fa84009ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8400ac3c0 0x7fa84009a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 --2- 172.21.2.137:0/2497918972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa84005fed0 0x7fa8401425c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 >> 172.21.2.137:0/2497918972 conn(0x7fa8400b7070 msgr2=0x7fa840140910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 shutdown_connections 2021-11-15T19:28:38.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.537+0000 7fa844ac4700 1 -- 172.21.2.137:0/2497918972 wait complete. 2021-11-15T19:28:38.577 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:28:38.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 Processor -- start 2021-11-15T19:28:38.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- start start 2021-11-15T19:28:38.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4ca80b12f0 0x7f4ca813ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 0x7f4ca813f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca8096940 con 0x7f4ca80b1e70 2021-11-15T19:28:38.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80966a0 con 0x7f4ca80b12f0 2021-11-15T19:28:38.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80aaff0 con 0x7f4ca813f2d0 2021-11-15T19:28:38.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca77fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4ca80b12f0 0x7f4ca813ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca7fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4ca80b1e70 0x7f4ca80ab490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52052/0 (socket says 172.21.2.137:52052) 2021-11-15T19:28:38.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca7fff700 1 -- 172.21.2.137:0/128277248 learned_addr learned my addr 172.21.2.137:0/128277248 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:38.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca77fe700 1 -- 172.21.2.137:0/128277248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 msgr2=0x7f4ca813f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:38.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca77fe700 1 --2- 172.21.2.137:0/128277248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 0x7f4ca813f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca77fe700 1 -- 172.21.2.137:0/128277248 >> v1:172.21.2.137:6789/0 conn(0x7f4ca80b1e70 legacy=0x7f4ca80ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca77fe700 1 -- 172.21.2.137:0/128277248 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80962b0 con 0x7f4ca80b12f0 2021-11-15T19:28:38.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca77fe700 1 --2- 172.21.2.137:0/128277248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca813ede0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f4c90001110 tx=0x7f4c98006df0).ready entity=mon.1 client_cookie=1c64b794bf0eaed9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca6ffd700 1 -- 172.21.2.137:0/128277248 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9800d570 con 0x7f4ca80b12f0 2021-11-15T19:28:38.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca6ffd700 1 -- 172.21.2.137:0/128277248 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98000e90 con 0x7f4ca80b12f0 2021-11-15T19:28:38.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4ca6ffd700 1 -- 172.21.2.137:0/128277248 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9800d8c0 con 0x7f4ca80b12f0 2021-11-15T19:28:38.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- 172.21.2.137:0/128277248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 msgr2=0x7f4ca813ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/128277248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca813ede0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f4c90001110 tx=0x7f4c98006df0).stop 2021-11-15T19:28:38.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- 172.21.2.137:0/128277248 shutdown_connections 2021-11-15T19:28:38.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/128277248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca813ede0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/128277248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 0x7f4ca813f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- 172.21.2.137:0/128277248 >> 172.21.2.137:0/128277248 conn(0x7f4ca80b2a20 msgr2=0x7f4ca80b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- 172.21.2.137:0/128277248 shutdown_connections 2021-11-15T19:28:38.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- 172.21.2.137:0/128277248 wait complete. 2021-11-15T19:28:38.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 Processor -- start 2021-11-15T19:28:38.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.629+0000 7f4cae2b0700 1 -- start start 2021-11-15T19:28:38.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca80992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4ca80b1e70 0x7f4ca814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 0x7f4ca813c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca814e840 con 0x7f4ca80b1e70 2021-11-15T19:28:38.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca813d910 con 0x7f4ca80b12f0 2021-11-15T19:28:38.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca813dbb0 con 0x7f4ca813f2d0 2021-11-15T19:28:38.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca80992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca80992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33276/0 (socket says 172.21.2.137:33276) 2021-11-15T19:28:38.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 -- 172.21.2.137:0/1180529456 learned_addr learned my addr 172.21.2.137:0/1180529456 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:38.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 -- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 msgr2=0x7f4ca813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 0x7f4ca813c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 -- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4ca80b1e70 msgr2=0x7f4ca814e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4ca80b1e70 0x7f4ca814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 -- 172.21.2.137:0/1180529456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9800b180 con 0x7f4ca80b12f0 2021-11-15T19:28:38.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca7fff700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca80992d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f4c900011d0 tx=0x7f4c90007bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c900072e0 con 0x7f4ca80b12f0 2021-11-15T19:28:38.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90007440 con 0x7f4ca80b12f0 2021-11-15T19:28:38.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c90005800 con 0x7f4ca80b12f0 2021-11-15T19:28:38.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca813de50 con 0x7f4ca80b12f0 2021-11-15T19:28:38.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8142010 con 0x7f4ca80b12f0 2021-11-15T19:28:38.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca813dfe0 con 0x7f4ca80b12f0 2021-11-15T19:28:38.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c90010070 con 0x7f4ca80b12f0 2021-11-15T19:28:38.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca57fa700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c8c053660 0x7f4c8c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4c9006afe0 con 0x7f4ca80b12f0 2021-11-15T19:28:38.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.633+0000 7f4ca77fe700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c8c053660 0x7f4c8c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.637+0000 7f4ca77fe700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c8c053660 0x7f4c8c055b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4c90001110 tx=0x7f4c98014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.637+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c90042360 con 0x7f4ca80b12f0 2021-11-15T19:28:38.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.717+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca80b2250 con 0x7f4ca80b12f0 2021-11-15T19:28:38.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.717+0000 7f4ca57fa700 1 -- 172.21.2.137:0/1180529456 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f4c90045980 con 0x7f4ca80b12f0 2021-11-15T19:28:38.721 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:38.721 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":36,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:28:38.291901+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:28:38.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c8c053660 msgr2=0x7f4c8c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c8c053660 0x7f4c8c055b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4c90001110 tx=0x7f4c98014000).stop 2021-11-15T19:28:38.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 msgr2=0x7f4ca80992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca80992d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f4c900011d0 tx=0x7f4c90007bc0).stop 2021-11-15T19:28:38.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 shutdown_connections 2021-11-15T19:28:38.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c8c053660 0x7f4c8c055b20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4ca813f2d0 0x7f4ca813c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4ca80b1e70 0x7f4ca814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 --2- 172.21.2.137:0/1180529456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4ca80b12f0 0x7f4ca80992d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 >> 172.21.2.137:0/1180529456 conn(0x7f4ca80b2a20 msgr2=0x7f4ca805c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 shutdown_connections 2021-11-15T19:28:38.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.721+0000 7f4cae2b0700 1 -- 172.21.2.137:0/1180529456 wait complete. 2021-11-15T19:28:38.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:28:38.729 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:28:38.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 Processor -- start 2021-11-15T19:28:38.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 -- start start 2021-11-15T19:28:38.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 0x7efcb00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efcb00b0550 0x7efcb014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb005cb50 con 0x7efcb014aaa0 2021-11-15T19:28:38.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb00b1650 con 0x7efcb00b0550 2021-11-15T19:28:38.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.781+0000 7efcb63c7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00ad030 con 0x7efcb005c770 2021-11-15T19:28:38.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb4964700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efcb014aaa0 0x7efcb0140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52068/0 (socket says 172.21.2.137:52068) 2021-11-15T19:28:38.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb4964700 1 -- 172.21.2.137:0/2394244045 learned_addr learned my addr 172.21.2.137:0/2394244045 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:38.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082470762 0 0) 0x7efcb005cb50 con 0x7efcb014aaa0 2021-11-15T19:28:38.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc90003260 con 0x7efcb014aaa0 2021-11-15T19:28:38.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaf7fe700 1 --2- 172.21.2.137:0/2394244045 >> v2:172.21.2.111:3300/0 conn(0x7efcb00b0550 0x7efcb014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 0x7efcb00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636077782 0 0) 0x7efc90003260 con 0x7efcb014aaa0 2021-11-15T19:28:38.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 msgr2=0x7efcb00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:38.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 0x7efcb00aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 >> v2:172.21.2.111:3300/0 conn(0x7efcb00b0550 msgr2=0x7efcb014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:38.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 --2- 172.21.2.137:0/2394244045 >> v2:172.21.2.111:3300/0 conn(0x7efcb00b0550 0x7efcb014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb00ad2d0 con 0x7efcb014aaa0 2021-11-15T19:28:38.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7efca80019e0 con 0x7efcb014aaa0 2021-11-15T19:28:38.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 >> v1:172.21.2.137:6789/0 conn(0x7efcb014aaa0 legacy=0x7efcb0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc900037d0 0x7efc90003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc90004500 0x7efc90004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 0x7efc90004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00b1650 con 0x7efc90004500 2021-11-15T19:28:38.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00ad030 con 0x7efc900037d0 2021-11-15T19:28:38.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9000b8d0 con 0x7efcb005c770 2021-11-15T19:28:38.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc900037d0 0x7efc90003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb4964700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 0x7efc90004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaf7fe700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc90004500 0x7efc90004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 -- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 msgr2=0x7efc90004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:38.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb005c770 0x7efc90004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 -- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc90004500 msgr2=0x7efc90004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:38.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc90004500 0x7efc90004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 -- 172.21.2.137:0/2394244045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90003260 con 0x7efc900037d0 2021-11-15T19:28:38.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaffff700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc900037d0 0x7efc90003bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efc9800a000 tx=0x7efc98008040).ready entity=mon.1 client_cookie=2fa912e5cb8bdcac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc98013670 con 0x7efc900037d0 2021-11-15T19:28:38.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980137d0 con 0x7efc900037d0 2021-11-15T19:28:38.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcaeffd700 1 -- 172.21.2.137:0/2394244045 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc98013b30 con 0x7efc900037d0 2021-11-15T19:28:38.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 -- 172.21.2.137:0/2394244045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc900037d0 msgr2=0x7efc90003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 --2- 172.21.2.137:0/2394244045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc900037d0 0x7efc90003bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efc9800a000 tx=0x7efc98008040).stop 2021-11-15T19:28:38.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb4964700 1 -- 172.21.2.137:0/2394244045 reap_dead start 2021-11-15T19:28:38.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 -- 172.21.2.137:0/2394244045 shutdown_connections 2021-11-15T19:28:38.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 -- 172.21.2.137:0/2394244045 >> 172.21.2.137:0/2394244045 conn(0x7efcb00631e0 msgr2=0x7efcb005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 -- 172.21.2.137:0/2394244045 shutdown_connections 2021-11-15T19:28:38.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 -- 172.21.2.137:0/2394244045 wait complete. 2021-11-15T19:28:38.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 Processor -- start 2021-11-15T19:28:38.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.785+0000 7efcb63c7700 1 -- start start 2021-11-15T19:28:38.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc900037d0 0x7efcb00b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 0x7efcb01563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb0159f80 0x7efcb015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0066200 con 0x7efc900037d0 2021-11-15T19:28:38.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0063b10 con 0x7efcb00678f0 2021-11-15T19:28:38.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0159b20 con 0x7efcb0159f80 2021-11-15T19:28:38.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 0x7efcb01563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 0x7efcb01563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33296/0 (socket says 172.21.2.137:33296) 2021-11-15T19:28:38.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 -- 172.21.2.137:0/1078321770 learned_addr learned my addr 172.21.2.137:0/1078321770 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:38.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaffff700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc900037d0 0x7efcb00b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb4964700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb0159f80 0x7efcb015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 -- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb0159f80 msgr2=0x7efcb015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb0159f80 0x7efcb015a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 -- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc900037d0 msgr2=0x7efcb00b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc900037d0 0x7efcb00b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 -- 172.21.2.137:0/1078321770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0063870 con 0x7efcb00678f0 2021-11-15T19:28:38.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaf7fe700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 0x7efcb01563d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7efcb0147ca0 tx=0x7efca0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca000c070 con 0x7efcb00678f0 2021-11-15T19:28:38.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0000e90 con 0x7efcb00678f0 2021-11-15T19:28:38.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb01568c0 con 0x7efcb00678f0 2021-11-15T19:28:38.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca00135e0 con 0x7efcb00678f0 2021-11-15T19:28:38.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb0147390 con 0x7efcb00678f0 2021-11-15T19:28:38.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb00ae7f0 con 0x7efcb00678f0 2021-11-15T19:28:38.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efca0019020 con 0x7efcb00678f0 2021-11-15T19:28:38.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcad7fa700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc940535b0 0x7efc94055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7efca006ac30 con 0x7efcb00678f0 2021-11-15T19:28:38.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.789+0000 7efcaffff700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc940535b0 0x7efc94055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.793+0000 7efcaffff700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc940535b0 0x7efc94055a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7efc98019000 tx=0x7efc98008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.793+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efca00420c0 con 0x7efcb00678f0 2021-11-15T19:28:38.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.873+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efcb00573d0 con 0x7efcb00678f0 2021-11-15T19:28:38.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.873+0000 7efcad7fa700 1 -- 172.21.2.137:0/1078321770 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7efca00456e0 con 0x7efcb00678f0 2021-11-15T19:28:38.877 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:28:38.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc940535b0 msgr2=0x7efc94055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc940535b0 0x7efc94055a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7efc98019000 tx=0x7efc98008040).stop 2021-11-15T19:28:38.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 msgr2=0x7efcb01563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 0x7efcb01563d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7efcb0147ca0 tx=0x7efca0008040).stop 2021-11-15T19:28:38.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 shutdown_connections 2021-11-15T19:28:38.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc940535b0 0x7efc94055a70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efcb0159f80 0x7efcb015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efcb00678f0 0x7efcb01563d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 --2- 172.21.2.137:0/1078321770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc900037d0 0x7efcb00b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:38.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 >> 172.21.2.137:0/1078321770 conn(0x7efcb00631e0 msgr2=0x7efcb014b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 shutdown_connections 2021-11-15T19:28:38.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.877+0000 7efcb63c7700 1 -- 172.21.2.137:0/1078321770 wait complete. 2021-11-15T19:28:38.884 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:28:38.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.933+0000 7f6d8b12b700 1 Processor -- start 2021-11-15T19:28:38.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.933+0000 7f6d8b12b700 1 -- start start 2021-11-15T19:28:38.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d840acd60 0x7f6d840b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6d840b4680 0x7f6d841290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840b76c0 con 0x7f6d840b72e0 2021-11-15T19:28:38.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840b3100 con 0x7f6d840b4680 2021-11-15T19:28:38.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840b20c0 con 0x7f6d840acd60 2021-11-15T19:28:38.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d88ec7700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6d840b72e0 0x7f6d840b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52084/0 (socket says 172.21.2.137:52084) 2021-11-15T19:28:38.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d88ec7700 1 -- 172.21.2.137:0/259773078 learned_addr learned my addr 172.21.2.137:0/259773078 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:38.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- 172.21.2.137:0/259773078 >> v2:172.21.2.137:3300/0 conn(0x7f6d840acd60 0x7f6d840b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/259773078 >> v2:172.21.2.111:3300/0 conn(0x7f6d840b4680 msgr2=0x7f6d841290c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:38.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- 172.21.2.137:0/259773078 >> v2:172.21.2.111:3300/0 conn(0x7f6d840b4680 0x7f6d841290c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/259773078 >> v1:172.21.2.137:6789/0 conn(0x7f6d840b72e0 legacy=0x7f6d840b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/259773078 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8412a170 con 0x7f6d840acd60 2021-11-15T19:28:38.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- 172.21.2.137:0/259773078 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840acd60 0x7f6d840b4190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f6d74002f70 tx=0x7f6d74006df0).ready entity=mon.1 client_cookie=55c8480a48c39120 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d837fe700 1 -- 172.21.2.137:0/259773078 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7400d5c0 con 0x7f6d840acd60 2021-11-15T19:28:38.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d837fe700 1 -- 172.21.2.137:0/259773078 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74000e90 con 0x7f6d840acd60 2021-11-15T19:28:38.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d837fe700 1 -- 172.21.2.137:0/259773078 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7400d910 con 0x7f6d840acd60 2021-11-15T19:28:38.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/259773078 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840acd60 msgr2=0x7f6d840b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/259773078 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840acd60 0x7f6d840b4190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f6d74002f70 tx=0x7f6d74006df0).stop 2021-11-15T19:28:38.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/259773078 shutdown_connections 2021-11-15T19:28:38.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/259773078 >> v2:172.21.2.111:3300/0 conn(0x7f6d840b4680 0x7f6d841290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/259773078 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840acd60 0x7f6d840b4190 secure :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0x7f6d74002f70 tx=0x7f6d74006df0).stop 2021-11-15T19:28:38.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/259773078 >> 172.21.2.137:0/259773078 conn(0x7f6d84064960 msgr2=0x7f6d84064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:38.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/259773078 shutdown_connections 2021-11-15T19:28:38.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/259773078 wait complete. 2021-11-15T19:28:38.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 Processor -- start 2021-11-15T19:28:38.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- start start 2021-11-15T19:28:38.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d840b4680 0x7f6d84067720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 0x7f6d84137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d841427a0 0x7f6d84123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84066ec0 con 0x7f6d841427a0 2021-11-15T19:28:38.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840670f0 con 0x7f6d840b72e0 2021-11-15T19:28:38.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840666a0 con 0x7f6d840b4680 2021-11-15T19:28:38.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 0x7f6d84137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 0x7f6d84137980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33312/0 (socket says 172.21.2.137:33312) 2021-11-15T19:28:38.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/1549003554 learned_addr learned my addr 172.21.2.137:0/1549003554 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:38.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d840b4680 msgr2=0x7f6d84067720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d840b4680 0x7f6d84067720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d841427a0 msgr2=0x7f6d84123690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:38.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d841427a0 0x7f6d84123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:38.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 -- 172.21.2.137:0/1549003554 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7400b180 con 0x7f6d840b72e0 2021-11-15T19:28:38.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d83fff700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 0x7f6d84137980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6d84125910 tx=0x7f6d74014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7401e400 con 0x7f6d840b72e0 2021-11-15T19:28:38.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7401e560 con 0x7f6d840b72e0 2021-11-15T19:28:38.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7401e8c0 con 0x7f6d840b72e0 2021-11-15T19:28:38.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d84066940 con 0x7f6d840b72e0 2021-11-15T19:28:38.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.937+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d84138380 con 0x7f6d840b72e0 2021-11-15T19:28:38.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d840b3a50 con 0x7f6d840b72e0 2021-11-15T19:28:38.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d74025030 con 0x7f6d840b72e0 2021-11-15T19:28:38.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d81ffb700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d64053660 0x7f6d64055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:38.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6d7406c5f0 con 0x7f6d840b72e0 2021-11-15T19:28:38.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d88ec7700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d64053660 0x7f6d64055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:38.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d88ec7700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d64053660 0x7f6d64055b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f6d84065c40 tx=0x7f6d78007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:38.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:38.941+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d74043a80 con 0x7f6d840b72e0 2021-11-15T19:28:39.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d8405db30 con 0x7f6d840b72e0 2021-11-15T19:28:39.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d81ffb700 1 -- 172.21.2.137:0/1549003554 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d74023020 con 0x7f6d840b72e0 2021-11-15T19:28:39.028 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:28:39.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d64053660 msgr2=0x7f6d64055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d64053660 0x7f6d64055b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f6d84065c40 tx=0x7f6d78007860).stop 2021-11-15T19:28:39.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 msgr2=0x7f6d84137980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 0x7f6d84137980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6d84125910 tx=0x7f6d74014000).stop 2021-11-15T19:28:39.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 shutdown_connections 2021-11-15T19:28:39.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d64053660 0x7f6d64055b20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:39.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d841427a0 0x7f6d84123690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d840b72e0 0x7f6d84137980 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:39.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 --2- 172.21.2.137:0/1549003554 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d840b4680 0x7f6d84067720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.025+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 >> 172.21.2.137:0/1549003554 conn(0x7f6d84064960 msgr2=0x7f6d84138860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:39.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.029+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 shutdown_connections 2021-11-15T19:28:39.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.029+0000 7f6d8b12b700 1 -- 172.21.2.137:0/1549003554 wait complete. 2021-11-15T19:28:39.036 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:28:39.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 Processor -- start 2021-11-15T19:28:39.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- start start 2021-11-15T19:28:39.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f74080b1340 0x7f7408147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7408143f00 0x7f7408144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080a9f50 0x7f74080aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7408148190 con 0x7f74080b1340 2021-11-15T19:28:39.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74080b1720 con 0x7f7408143f00 2021-11-15T19:28:39.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408147e70 con 0x7f74080a9f50 2021-11-15T19:28:39.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7408143f00 0x7f7408144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:39.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7408143f00 0x7f7408144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33320/0 (socket says 172.21.2.137:33320) 2021-11-15T19:28:39.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 -- 172.21.2.137:0/3243895222 learned_addr learned my addr 172.21.2.137:0/3243895222 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:39.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 -- 172.21.2.137:0/3243895222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080a9f50 msgr2=0x7f74080aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:39.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 --2- 172.21.2.137:0/3243895222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080a9f50 0x7f74080aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 -- 172.21.2.137:0/3243895222 >> v2:172.21.2.111:3300/0 conn(0x7f74080b1340 msgr2=0x7f7408147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:39.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 --2- 172.21.2.137:0/3243895222 >> v2:172.21.2.111:3300/0 conn(0x7f74080b1340 0x7f7408147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 -- 172.21.2.137:0/3243895222 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080af800 con 0x7f7408143f00 2021-11-15T19:28:39.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740ce99700 1 --2- 172.21.2.137:0/3243895222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f7408144390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f73fc002f70 tx=0x7f73fc006eb0).ready entity=mon.1 client_cookie=a973242fe6cfc0e1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:39.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f73fbfff700 1 -- 172.21.2.137:0/3243895222 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00d570 con 0x7f7408143f00 2021-11-15T19:28:39.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f73fbfff700 1 -- 172.21.2.137:0/3243895222 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc000e90 con 0x7f7408143f00 2021-11-15T19:28:39.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f73fbfff700 1 -- 172.21.2.137:0/3243895222 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00d900 con 0x7f7408143f00 2021-11-15T19:28:39.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- 172.21.2.137:0/3243895222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 msgr2=0x7f7408144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- 172.21.2.137:0/3243895222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f7408144390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f73fc002f70 tx=0x7f73fc006eb0).stop 2021-11-15T19:28:39.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- 172.21.2.137:0/3243895222 shutdown_connections 2021-11-15T19:28:39.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- 172.21.2.137:0/3243895222 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080a9f50 0x7f74080aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- 172.21.2.137:0/3243895222 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f7408144390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:39.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- 172.21.2.137:0/3243895222 >> v2:172.21.2.111:3300/0 conn(0x7f74080b1340 0x7f7408147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- 172.21.2.137:0/3243895222 >> 172.21.2.137:0/3243895222 conn(0x7f74080b4e60 msgr2=0x7f74080b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:39.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- 172.21.2.137:0/3243895222 shutdown_connections 2021-11-15T19:28:39.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- 172.21.2.137:0/3243895222 wait complete. 2021-11-15T19:28:39.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 Processor -- start 2021-11-15T19:28:39.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- start start 2021-11-15T19:28:39.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f74080a9f50 0x7f7408148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080b1340 0x7f74080aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f740813d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.085+0000 7f740f8fe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74080adaa0 con 0x7f74080a9f50 2021-11-15T19:28:39.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740f8fe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74081489f0 con 0x7f7408143f00 2021-11-15T19:28:39.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740f8fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408148c90 con 0x7f74080b1340 2021-11-15T19:28:39.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f740813d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:39.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f740813d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33326/0 (socket says 172.21.2.137:33326) 2021-11-15T19:28:39.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 -- 172.21.2.137:0/1830959391 learned_addr learned my addr 172.21.2.137:0/1830959391 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:39.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 -- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080b1340 msgr2=0x7f74080aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080b1340 0x7f74080aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 -- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f74080a9f50 msgr2=0x7f7408148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f74080a9f50 0x7f7408148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 -- 172.21.2.137:0/1830959391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc00b1e0 con 0x7f7408143f00 2021-11-15T19:28:39.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740de9b700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f740813d9d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f7400003270 tx=0x7f74000090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:39.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f740000d4a0 con 0x7f7408143f00 2021-11-15T19:28:39.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000d600 con 0x7f7408143f00 2021-11-15T19:28:39.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f740000d960 con 0x7f7408143f00 2021-11-15T19:28:39.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408148f30 con 0x7f7408143f00 2021-11-15T19:28:39.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7408159cc0 con 0x7f7408143f00 2021-11-15T19:28:39.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74080adfa0 con 0x7f7408143f00 2021-11-15T19:28:39.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7400018030 con 0x7f7408143f00 2021-11-15T19:28:39.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f73fa7fc700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73e80536a0 0x7f73e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f740006af20 con 0x7f7408143f00 2021-11-15T19:28:39.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740d69a700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73e80536a0 0x7f73e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:39.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.089+0000 7f740d69a700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73e80536a0 0x7f73e8055b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f7404002ef0 tx=0x7f7404006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:39.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.093+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f74080adfa0 con 0x7f7408143f00 2021-11-15T19:28:39.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74080adfa0 con 0x7f7408143f00 2021-11-15T19:28:39.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f73fa7fc700 1 -- 172.21.2.137:0/1830959391 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+143 (secure 0 0 0) 0x7f74080adfa0 con 0x7f7408143f00 2021-11-15T19:28:39.179 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:39.179 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:28:39.179 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:39.180 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:28:39.180 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:28:39.180 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:28:39.180 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:28:39.181 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:28:39.181 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:28:39.181 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:28:39.181 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:28:39.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73e80536a0 msgr2=0x7f73e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73e80536a0 0x7f73e8055b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f7404002ef0 tx=0x7f7404006910).stop 2021-11-15T19:28:39.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 msgr2=0x7f740813d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f740813d9d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f7400003270 tx=0x7f74000090f0).stop 2021-11-15T19:28:39.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 shutdown_connections 2021-11-15T19:28:39.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73e80536a0 0x7f73e8055b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:39.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7408143f00 0x7f740813d9d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:39.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f74080b1340 0x7f74080aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 --2- 172.21.2.137:0/1830959391 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f74080a9f50 0x7f7408148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 >> 172.21.2.137:0/1830959391 conn(0x7f74080b4e60 msgr2=0x7f740813e600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:39.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 shutdown_connections 2021-11-15T19:28:39.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.177+0000 7f740f8fe700 1 -- 172.21.2.137:0/1830959391 wait complete. 2021-11-15T19:28:39.186 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:28:39.186 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:28:39.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 Processor -- start 2021-11-15T19:28:39.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- start start 2021-11-15T19:28:39.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fad780b0550 0x7fad7814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7805cb50 con 0x7fad7805c770 2021-11-15T19:28:39.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780ad030 con 0x7fad7814aaa0 2021-11-15T19:28:39.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780b1650 con 0x7fad780b0550 2021-11-15T19:28:39.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7dc2b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fad7814aaa0 0x7fad78140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52114/0 (socket says 172.21.2.137:52114) 2021-11-15T19:28:39.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7dc2b700 1 -- 172.21.2.137:0/3585189502 learned_addr learned my addr 172.21.2.137:0/3585189502 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:39.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7cc29700 1 --2- 172.21.2.137:0/3585189502 >> v2:172.21.2.137:3300/0 conn(0x7fad780b0550 0x7fad7814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:39.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7cc29700 1 -- 172.21.2.137:0/3585189502 >> v1:172.21.2.137:6789/0 conn(0x7fad7814aaa0 legacy=0x7fad78140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7cc29700 1 -- 172.21.2.137:0/3585189502 >> v1:172.21.2.111:6789/0 conn(0x7fad7805c770 legacy=0x7fad780aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:39.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7cc29700 1 -- 172.21.2.137:0/3585189502 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780ad2d0 con 0x7fad780b0550 2021-11-15T19:28:39.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7cc29700 1 --2- 172.21.2.137:0/3585189502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad780b0550 0x7fad7814a5b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fad780aee10 tx=0x7fad6c006df0).ready entity=mon.1 client_cookie=706896b6035c2c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:39.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad6bfff700 1 -- 172.21.2.137:0/3585189502 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad6c00d4a0 con 0x7fad780b0550 2021-11-15T19:28:39.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad6bfff700 1 -- 172.21.2.137:0/3585189502 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c000e90 con 0x7fad780b0550 2021-11-15T19:28:39.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad6bfff700 1 -- 172.21.2.137:0/3585189502 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad6c00d7f0 con 0x7fad780b0550 2021-11-15T19:28:39.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- 172.21.2.137:0/3585189502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad780b0550 msgr2=0x7fad7814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:39.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3585189502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad780b0550 0x7fad7814a5b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fad780aee10 tx=0x7fad6c006df0).stop 2021-11-15T19:28:39.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- 172.21.2.137:0/3585189502 shutdown_connections 2021-11-15T19:28:39.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3585189502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad780b0550 0x7fad7814a5b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:39.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- 172.21.2.137:0/3585189502 >> 172.21.2.137:0/3585189502 conn(0x7fad780631e0 msgr2=0x7fad7805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:39.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- 172.21.2.137:0/3585189502 shutdown_connections 2021-11-15T19:28:39.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- 172.21.2.137:0/3585189502 wait complete. 2021-11-15T19:28:39.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 Processor -- start 2021-11-15T19:28:39.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- start start 2021-11-15T19:28:39.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 0x7fad78066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad780b0550 0x7fad78147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad7814aaa0 0x7fad78159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78159bb0 con 0x7fad780b0550 2021-11-15T19:28:39.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78143130 con 0x7fad7805c770 2021-11-15T19:28:39.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.237+0000 7fad7f68e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad781433d0 con 0x7fad7814aaa0 2021-11-15T19:28:39.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 0x7fad78066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:39.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 0x7fad78066ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33336/0 (socket says 172.21.2.137:33336) 2021-11-15T19:28:39.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 -- 172.21.2.137:0/3220631637 learned_addr learned my addr 172.21.2.137:0/3220631637 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:39.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 -- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad7814aaa0 msgr2=0x7fad78159fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:39.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad7814aaa0 0x7fad78159fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 -- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad780b0550 msgr2=0x7fad78147220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:39.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad780b0550 0x7fad78147220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:39.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 -- 172.21.2.137:0/3220631637 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c00b180 con 0x7fad7805c770 2021-11-15T19:28:39.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7d42a700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 0x7fad78066ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fad74002ef0 tx=0x7fad74006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:39.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad74009ea0 con 0x7fad7805c770 2021-11-15T19:28:39.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74002320 con 0x7fad7805c770 2021-11-15T19:28:39.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad78067310 con 0x7fad7805c770 2021-11-15T19:28:39.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad74002680 con 0x7fad7805c770 2021-11-15T19:28:39.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7815a4d0 con 0x7fad7805c770 2021-11-15T19:28:39.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78159d20 con 0x7fad7805c770 2021-11-15T19:28:39.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad7400f030 con 0x7fad7805c770 2021-11-15T19:28:39.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad6a7fc700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad580536a0 0x7fad58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:39.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fad7406b380 con 0x7fad7805c770 2021-11-15T19:28:39.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7cc29700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad580536a0 0x7fad58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:39.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.241+0000 7fad7cc29700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad580536a0 0x7fad58055b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fad780aee10 tx=0x7fad6c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:39.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.245+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad78159d20 con 0x7fad7805c770 2021-11-15T19:28:39.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:39.329+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fad78159d20 con 0x7fad7805c770 2021-11-15T19:28:40.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.273+0000 7fad6a7fc700 1 -- 172.21.2.137:0/3220631637 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v37) v1 ==== 133+0+0 (secure 0 0 0) 0x7fad78159d20 con 0x7fad7805c770 2021-11-15T19:28:40.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.277+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad580536a0 msgr2=0x7fad58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:40.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.277+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad580536a0 0x7fad58055b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fad780aee10 tx=0x7fad6c014000).stop 2021-11-15T19:28:40.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.277+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 msgr2=0x7fad78066ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:40.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.277+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 0x7fad78066ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fad74002ef0 tx=0x7fad74006d50).stop 2021-11-15T19:28:40.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 shutdown_connections 2021-11-15T19:28:40.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad580536a0 0x7fad58055b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:40.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad7814aaa0 0x7fad78159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:40.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad780b0550 0x7fad78147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:40.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 --2- 172.21.2.137:0/3220631637 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad7805c770 0x7fad78066ad0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:40.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 >> 172.21.2.137:0/3220631637 conn(0x7fad780631e0 msgr2=0x7fad78140300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:40.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 shutdown_connections 2021-11-15T19:28:40.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.281+0000 7fad7f68e700 1 -- 172.21.2.137:0/3220631637 wait complete. 2021-11-15T19:28:40.285 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:28:40.295 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:28:40.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 Processor -- start 2021-11-15T19:28:40.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- start start 2021-11-15T19:28:40.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0b72e0 0x7f870c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:40.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f870c0ad320 0x7f870c1290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:40.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c0b76c0 con 0x7f870c0acd60 2021-11-15T19:28:40.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c0b3100 con 0x7f870c0ad320 2021-11-15T19:28:40.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c12a170 con 0x7f870c0b72e0 2021-11-15T19:28:40.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f870c0ad320 0x7f870c1290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:40.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f870c0ad320 0x7f870c1290c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33346/0 (socket says 172.21.2.137:33346) 2021-11-15T19:28:40.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 -- 172.21.2.137:0/2760781475 learned_addr learned my addr 172.21.2.137:0/2760781475 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:40.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f870bfff700 1 --2- 172.21.2.137:0/2760781475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0b72e0 0x7f870c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:40.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 -- 172.21.2.137:0/2760781475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0b72e0 msgr2=0x7f870c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:40.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 --2- 172.21.2.137:0/2760781475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0b72e0 0x7f870c0b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:40.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 -- 172.21.2.137:0/2760781475 >> v1:172.21.2.111:6789/0 conn(0x7f870c0acd60 legacy=0x7f870c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:40.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 -- 172.21.2.137:0/2760781475 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0ad8a0 con 0x7f870c0ad320 2021-11-15T19:28:40.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8710fba700 1 --2- 172.21.2.137:0/2760781475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c1290c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f870c065450 tx=0x7f8704009290).ready entity=mon.1 client_cookie=1117c5fd1b300551 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f870affd700 1 -- 172.21.2.137:0/2760781475 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f870400b860 con 0x7f870c0ad320 2021-11-15T19:28:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f870affd700 1 -- 172.21.2.137:0/2760781475 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400b9c0 con 0x7f870c0ad320 2021-11-15T19:28:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f870affd700 1 -- 172.21.2.137:0/2760781475 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f870400bb70 con 0x7f870c0ad320 2021-11-15T19:28:40.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- 172.21.2.137:0/2760781475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 msgr2=0x7f870c1290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:40.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 --2- 172.21.2.137:0/2760781475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c1290c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f870c065450 tx=0x7f8704009290).stop 2021-11-15T19:28:40.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- 172.21.2.137:0/2760781475 shutdown_connections 2021-11-15T19:28:40.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 --2- 172.21.2.137:0/2760781475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c1290c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:40.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 --2- 172.21.2.137:0/2760781475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0b72e0 0x7f870c0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:40.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- 172.21.2.137:0/2760781475 >> 172.21.2.137:0/2760781475 conn(0x7f870c064960 msgr2=0x7f870c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:40.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- 172.21.2.137:0/2760781475 shutdown_connections 2021-11-15T19:28:40.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- 172.21.2.137:0/2760781475 wait complete. 2021-11-15T19:28:40.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 Processor -- start 2021-11-15T19:28:40.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.345+0000 7f8712a1d700 1 -- start start 2021-11-15T19:28:40.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0acd60 0x7f870c1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:40.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:40.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f870c0b72e0 0x7f870c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:40.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1531c0 con 0x7f870c0b72e0 2021-11-15T19:28:40.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c153460 con 0x7f870c0ad320 2021-11-15T19:28:40.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0ae660 con 0x7f870c0acd60 2021-11-15T19:28:40.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:40.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33350/0 (socket says 172.21.2.137:33350) 2021-11-15T19:28:40.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 -- 172.21.2.137:0/3421745123 learned_addr learned my addr 172.21.2.137:0/3421745123 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:40.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 -- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0acd60 msgr2=0x7f870c1428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:40.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0acd60 0x7f870c1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:40.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 -- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f870c0b72e0 msgr2=0x7f870c14fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:40.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f870c0b72e0 0x7f870c14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:40.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 -- 172.21.2.137:0/3421745123 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704009530 con 0x7f870c0ad320 2021-11-15T19:28:40.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870b7fe700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c153900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f8700001fa0 tx=0x7f8700007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:40.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f870000ce80 con 0x7f870c0ad320 2021-11-15T19:28:40.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700007240 con 0x7f870c0ad320 2021-11-15T19:28:40.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8700006510 con 0x7f870c0ad320 2021-11-15T19:28:40.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c142da0 con 0x7f870c0ad320 2021-11-15T19:28:40.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c124950 con 0x7f870c0ad320 2021-11-15T19:28:40.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c0aec20 con 0x7f870c0ad320 2021-11-15T19:28:40.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8700010030 con 0x7f870c0ad320 2021-11-15T19:28:40.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f87097fa700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86ec053610 0x7f86ec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:40.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f870006b3e0 con 0x7f870c0ad320 2021-11-15T19:28:40.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870bfff700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86ec053610 0x7f86ec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:40.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.349+0000 7f870bfff700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86ec053610 0x7f86ec055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f86fc007000 tx=0x7f86fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:40.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.353+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f870c0aec20 con 0x7f870c0ad320 2021-11-15T19:28:40.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:40.437+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f870c0aec20 con 0x7f870c0ad320 2021-11-15T19:28:41.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f87097fa700 1 -- 172.21.2.137:0/3421745123 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v38) v1 ==== 125+0+0 (secure 0 0 0) 0x7f870c0aec20 con 0x7f870c0ad320 2021-11-15T19:28:41.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86ec053610 msgr2=0x7f86ec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86ec053610 0x7f86ec055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f86fc007000 tx=0x7f86fc008040).stop 2021-11-15T19:28:41.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 msgr2=0x7f870c153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c153900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f8700001fa0 tx=0x7f8700007c30).stop 2021-11-15T19:28:41.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 shutdown_connections 2021-11-15T19:28:41.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86ec053610 0x7f86ec055ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f870c0b72e0 0x7f870c14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f870c0ad320 0x7f870c153900 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 --2- 172.21.2.137:0/3421745123 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f870c0acd60 0x7f870c1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 >> 172.21.2.137:0/3421745123 conn(0x7f870c064960 msgr2=0x7f870c0b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 shutdown_connections 2021-11-15T19:28:41.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.281+0000 7f8712a1d700 1 -- 172.21.2.137:0/3421745123 wait complete. 2021-11-15T19:28:41.286 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:28:41.290 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:28:41.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 Processor -- start 2021-11-15T19:28:41.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 -- start start 2021-11-15T19:28:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 0x7f914413c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f91440b3c00 0x7f914413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440b63b0 con 0x7f91440b6830 2021-11-15T19:28:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914413d0d0 con 0x7f91440b3c00 2021-11-15T19:28:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914c757700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144147070 con 0x7f91440b5fd0 2021-11-15T19:28:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f9149cf2700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f91440b6830 0x7f9144142ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52144/0 (socket says 172.21.2.137:52144) 2021-11-15T19:28:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f9149cf2700 1 -- 172.21.2.137:0/2094651924 learned_addr learned my addr 172.21.2.137:0/2094651924 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970798015 0 0) 0x7f91440b63b0 con 0x7f91440b6830 2021-11-15T19:28:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912c003260 con 0x7f91440b6830 2021-11-15T19:28:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914acf4700 1 --2- 172.21.2.137:0/2094651924 >> v2:172.21.2.111:3300/0 conn(0x7f91440b3c00 0x7f914413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f914a4f3700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 0x7f914413c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088202976 0 0) 0x7f912c003260 con 0x7f91440b6830 2021-11-15T19:28:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 msgr2=0x7f914413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 0x7f914413c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 >> v2:172.21.2.111:3300/0 conn(0x7f91440b3c00 msgr2=0x7f914413cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 --2- 172.21.2.137:0/2094651924 >> v2:172.21.2.111:3300/0 conn(0x7f91440b3c00 0x7f914413cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144146dd0 con 0x7f91440b6830 2021-11-15T19:28:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9134001660 con 0x7f91440b6830 2021-11-15T19:28:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 >> v1:172.21.2.137:6789/0 conn(0x7f91440b6830 legacy=0x7f9144142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.341+0000 7f91494f1700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 0x7f912c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f912c003e00 0x7f912c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f912c0049f0 0x7f912c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914413d0d0 con 0x7f912c003e00 2021-11-15T19:28:41.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144147070 con 0x7f912c0049f0 2021-11-15T19:28:41.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c00b8e0 con 0x7f91440b5fd0 2021-11-15T19:28:41.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f912c0049f0 0x7f912c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 -- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 msgr2=0x7f912c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91440b5fd0 0x7f912c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 -- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f912c003e00 msgr2=0x7f912c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f912c003e00 0x7f912c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 -- 172.21.2.137:0/2094651924 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c003260 con 0x7f912c0049f0 2021-11-15T19:28:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f912c0049f0 0x7f912c004e70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f913c00a000 tx=0x7f913c008040).ready entity=mon.1 client_cookie=cf57e3b9e8f366f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913c00c070 con 0x7f912c0049f0 2021-11-15T19:28:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00e5f0 con 0x7f912c0049f0 2021-11-15T19:28:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91494f1700 1 -- 172.21.2.137:0/2094651924 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913c00e950 con 0x7f912c0049f0 2021-11-15T19:28:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2094651924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f912c0049f0 msgr2=0x7f912c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 --2- 172.21.2.137:0/2094651924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f912c0049f0 0x7f912c004e70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f913c00a000 tx=0x7f913c008040).stop 2021-11-15T19:28:41.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914acf4700 1 -- 172.21.2.137:0/2094651924 reap_dead start 2021-11-15T19:28:41.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2094651924 shutdown_connections 2021-11-15T19:28:41.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2094651924 >> 172.21.2.137:0/2094651924 conn(0x7f91440624b0 msgr2=0x7f9144062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2094651924 shutdown_connections 2021-11-15T19:28:41.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2094651924 wait complete. 2021-11-15T19:28:41.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 Processor -- start 2021-11-15T19:28:41.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- start start 2021-11-15T19:28:41.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f912c0049f0 0x7f91440653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 0x7f9144139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f914413a340 0x7f9144156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91441569d0 con 0x7f914413a340 2021-11-15T19:28:41.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440acbc0 con 0x7f9144067200 2021-11-15T19:28:41.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91440648f0 con 0x7f912c0049f0 2021-11-15T19:28:41.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 0x7f9144139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 0x7f9144139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33370/0 (socket says 172.21.2.137:33370) 2021-11-15T19:28:41.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 -- 172.21.2.137:0/2978204037 learned_addr learned my addr 172.21.2.137:0/2978204037 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:41.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 -- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f912c0049f0 msgr2=0x7f91440653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f912c0049f0 0x7f91440653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 -- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f914413a340 msgr2=0x7f9144156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f914413a340 0x7f9144156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 -- 172.21.2.137:0/2978204037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144063820 con 0x7f9144067200 2021-11-15T19:28:41.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f9149cf2700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 0x7f9144139e50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f9144064a80 tx=0x7f9134001b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9134007170 con 0x7f9144067200 2021-11-15T19:28:41.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91340072d0 con 0x7f9144067200 2021-11-15T19:28:41.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9134004920 con 0x7f9144067200 2021-11-15T19:28:41.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9144063ac0 con 0x7f9144067200 2021-11-15T19:28:41.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91440aeb20 con 0x7f9144067200 2021-11-15T19:28:41.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144156b10 con 0x7f9144067200 2021-11-15T19:28:41.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f913401b070 con 0x7f9144067200 2021-11-15T19:28:41.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91337fe700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91240536a0 0x7f9124055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.345+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f913406b230 con 0x7f9144067200 2021-11-15T19:28:41.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.349+0000 7f914a4f3700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91240536a0 0x7f9124055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.349+0000 7f914a4f3700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91240536a0 0x7f9124055b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f914000a000 tx=0x7f9140008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.349+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9134042400 con 0x7f9144067200 2021-11-15T19:28:41.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.465+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f9144146af0 con 0x7f9144067200 2021-11-15T19:28:41.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f91337fe700 1 -- 172.21.2.137:0/2978204037 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v14) v1 ==== 187+0+0 (secure 0 0 0) 0x7f9134045a20 con 0x7f9144067200 2021-11-15T19:28:41.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91240536a0 msgr2=0x7f9124055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91240536a0 0x7f9124055b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f914000a000 tx=0x7f9140008040).stop 2021-11-15T19:28:41.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 msgr2=0x7f9144139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 0x7f9144139e50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f9144064a80 tx=0x7f9134001b30).stop 2021-11-15T19:28:41.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 shutdown_connections 2021-11-15T19:28:41.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91240536a0 0x7f9124055b60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f914413a340 0x7f9144156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9144067200 0x7f9144139e50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 --2- 172.21.2.137:0/2978204037 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f912c0049f0 0x7f91440653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 >> 172.21.2.137:0/2978204037 conn(0x7f91440624b0 msgr2=0x7f91440b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 shutdown_connections 2021-11-15T19:28:41.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.481+0000 7f914c757700 1 -- 172.21.2.137:0/2978204037 wait complete. 2021-11-15T19:28:41.488 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 7 and data pool 8 2021-11-15T19:28:41.491 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:28:41.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 Processor -- start 2021-11-15T19:28:41.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- start start 2021-11-15T19:28:41.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 0x7fee2c0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c148190 con 0x7fee2c0b1340 2021-11-15T19:28:41.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c0b1720 con 0x7fee2c144610 2021-11-15T19:28:41.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0af800 con 0x7fee2c147980 2021-11-15T19:28:41.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fee2c144610 0x7fee2c0a9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52174/0 (socket says 172.21.2.137:52174) 2021-11-15T19:28:41.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 -- 172.21.2.137:0/4262033500 learned_addr learned my addr 172.21.2.137:0/4262033500 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:41.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292817857 0 0) 0x7fee2c0b1720 con 0x7fee2c144610 2021-11-15T19:28:41.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee0c003260 con 0x7fee2c144610 2021-11-15T19:28:41.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 0x7fee2c0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3155353361 0 0) 0x7fee0c003260 con 0x7fee2c144610 2021-11-15T19:28:41.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 msgr2=0x7fee2c0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 0x7fee2c0aa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 >> v1:172.21.2.111:6789/0 conn(0x7fee2c0b1340 legacy=0x7fee2c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c05faf0 con 0x7fee2c144610 2021-11-15T19:28:41.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fee1c001660 con 0x7fee2c144610 2021-11-15T19:28:41.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 >> v1:172.21.2.137:6789/0 conn(0x7fee2c144610 legacy=0x7fee2c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c0037d0 0x7fee0c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 0x7fee0c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee0c004b10 0x7fee0c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0af800 con 0x7fee0c0037d0 2021-11-15T19:28:41.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c00b990 con 0x7fee0c004b10 2021-11-15T19:28:41.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c00bb50 con 0x7fee2c147980 2021-11-15T19:28:41.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee0c004b10 0x7fee0c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2ad9d700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c0037d0 0x7fee0c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 -- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 msgr2=0x7fee0c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c147980 0x7fee0c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 -- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c0037d0 msgr2=0x7fee0c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c0037d0 0x7fee0c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 -- 172.21.2.137:0/4262033500 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c05faf0 con 0x7fee0c004b10 2021-11-15T19:28:41.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee0c004b10 0x7fee0c004f90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fee24007000 tx=0x7fee24008040).ready entity=mon.1 client_cookie=f2a933b43a621ab9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2400c640 con 0x7fee0c004b10 2021-11-15T19:28:41.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2400c7a0 con 0x7fee0c004b10 2021-11-15T19:28:41.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee29d9b700 1 -- 172.21.2.137:0/4262033500 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2400cb00 con 0x7fee0c004b10 2021-11-15T19:28:41.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- 172.21.2.137:0/4262033500 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee0c004b10 msgr2=0x7fee0c004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 --2- 172.21.2.137:0/4262033500 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee0c004b10 0x7fee0c004f90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fee24007000 tx=0x7fee24008040).stop 2021-11-15T19:28:41.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 -- 172.21.2.137:0/4262033500 reap_dead start 2021-11-15T19:28:41.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- 172.21.2.137:0/4262033500 shutdown_connections 2021-11-15T19:28:41.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- 172.21.2.137:0/4262033500 >> 172.21.2.137:0/4262033500 conn(0x7fee2c0b4e60 msgr2=0x7fee2c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- 172.21.2.137:0/4262033500 shutdown_connections 2021-11-15T19:28:41.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- 172.21.2.137:0/4262033500 wait complete. 2021-11-15T19:28:41.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 Processor -- start 2021-11-15T19:28:41.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- start start 2021-11-15T19:28:41.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c004b10 0x7fee2c0ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 0x7fee2c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c098af0 0x7fee2c098f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c149760 con 0x7fee0c004b10 2021-11-15T19:28:41.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0ac3d0 con 0x7fee2c148df0 2021-11-15T19:28:41.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee310f4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0ac670 con 0x7fee2c098af0 2021-11-15T19:28:41.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 0x7fee2c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 0x7fee2c149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33406/0 (socket says 172.21.2.137:33406) 2021-11-15T19:28:41.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 -- 172.21.2.137:0/4141814284 learned_addr learned my addr 172.21.2.137:0/4141814284 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:41.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2ad9d700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c004b10 0x7fee2c0ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2b59e700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c098af0 0x7fee2c098f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 -- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c098af0 msgr2=0x7fee2c098f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c098af0 0x7fee2c098f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 -- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c004b10 msgr2=0x7fee2c0ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c004b10 0x7fee2c0ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.541+0000 7fee2a59c700 1 -- 172.21.2.137:0/4141814284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c099460 con 0x7fee2c148df0 2021-11-15T19:28:41.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee2ad9d700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c004b10 0x7fee2c0ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:28:41.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee2a59c700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 0x7fee2c149270 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fee1c001000 tx=0x7fee1c001b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c007170 con 0x7fee2c148df0 2021-11-15T19:28:41.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0072d0 con 0x7fee2c148df0 2021-11-15T19:28:41.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c09a0d0 con 0x7fee2c148df0 2021-11-15T19:28:41.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c004920 con 0x7fee2c148df0 2021-11-15T19:28:41.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c13d880 con 0x7fee2c148df0 2021-11-15T19:28:41.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c0ac830 con 0x7fee2c148df0 2021-11-15T19:28:41.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee1c004a80 con 0x7fee2c148df0 2021-11-15T19:28:41.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee100535b0 0x7fee10055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fee1c06b660 con 0x7fee2c148df0 2021-11-15T19:28:41.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee2ad9d700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee100535b0 0x7fee10055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee2ad9d700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee100535b0 0x7fee10055a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fee1400d000 tx=0x7fee14009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.545+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee1c0426c0 con 0x7fee2c148df0 2021-11-15T19:28:41.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.633+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee2c05fd90 con 0x7fee2c148df0 2021-11-15T19:28:41.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.633+0000 7fee23fff700 1 -- 172.21.2.137:0/4141814284 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16064 (secure 0 0 0) 0x7fee1c045ce0 con 0x7fee2c148df0 2021-11-15T19:28:41.637 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:41.637 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":40,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:28:41.473774+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:28:39.350040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T19:28:40.459226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:28:41.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.633+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee100535b0 msgr2=0x7fee10055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.633+0000 7fee310f4700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee100535b0 0x7fee10055a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fee1400d000 tx=0x7fee14009040).stop 2021-11-15T19:28:41.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.633+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 msgr2=0x7fee2c149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.633+0000 7fee310f4700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 0x7fee2c149270 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fee1c001000 tx=0x7fee1c001b30).stop 2021-11-15T19:28:41.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 shutdown_connections 2021-11-15T19:28:41.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee100535b0 0x7fee10055a70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee2c098af0 0x7fee2c098f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee2c148df0 0x7fee2c149270 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 --2- 172.21.2.137:0/4141814284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee0c004b10 0x7fee2c0ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 >> 172.21.2.137:0/4141814284 conn(0x7fee2c0b4e60 msgr2=0x7fee2c1471a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 shutdown_connections 2021-11-15T19:28:41.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.637+0000 7fee310f4700 1 -- 172.21.2.137:0/4141814284 wait complete. 2021-11-15T19:28:41.644 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:28:41.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 Processor -- start 2021-11-15T19:28:41.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- start start 2021-11-15T19:28:41.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc6a40b3140 0x7fc6a409cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a409d190 con 0x7fc6a409c8c0 2021-11-15T19:28:41.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a405fe40 con 0x7fc6a409ab00 2021-11-15T19:28:41.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a4099790 con 0x7fc6a40b3140 2021-11-15T19:28:41.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc6a40b3140 0x7fc6a409cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc6a40b3140 0x7fc6a409cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33414/0 (socket says 172.21.2.137:33414) 2021-11-15T19:28:41.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 -- 172.21.2.137:0/3694075483 learned_addr learned my addr 172.21.2.137:0/3694075483 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:41.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 -- 172.21.2.137:0/3694075483 >> v1:172.21.2.137:6789/0 conn(0x7fc6a409ab00 legacy=0x7fc6a4143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 -- 172.21.2.137:0/3694075483 >> v1:172.21.2.111:6789/0 conn(0x7fc6a409c8c0 legacy=0x7fc6a405f730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:41.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 -- 172.21.2.137:0/3694075483 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40b2940 con 0x7fc6a40b3140 2021-11-15T19:28:41.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a2ffd700 1 --2- 172.21.2.137:0/3694075483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a409cca0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fc6a405d5e0 tx=0x7fc68c006eb0).ready entity=mon.1 client_cookie=84334b08f63b9ec0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a27fc700 1 -- 172.21.2.137:0/3694075483 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc68c00d610 con 0x7fc6a40b3140 2021-11-15T19:28:41.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a27fc700 1 -- 172.21.2.137:0/3694075483 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c000e90 con 0x7fc6a40b3140 2021-11-15T19:28:41.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a27fc700 1 -- 172.21.2.137:0/3694075483 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc68c00d960 con 0x7fc6a40b3140 2021-11-15T19:28:41.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/3694075483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 msgr2=0x7fc6a409cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/3694075483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a409cca0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fc6a405d5e0 tx=0x7fc68c006eb0).stop 2021-11-15T19:28:41.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/3694075483 shutdown_connections 2021-11-15T19:28:41.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/3694075483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a409cca0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/3694075483 >> 172.21.2.137:0/3694075483 conn(0x7fc6a40b45b0 msgr2=0x7fc6a405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/3694075483 shutdown_connections 2021-11-15T19:28:41.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.693+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/3694075483 wait complete. 2021-11-15T19:28:41.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 Processor -- start 2021-11-15T19:28:41.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- start start 2021-11-15T19:28:41.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc6a409ab00 0x7fc6a4145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc6a409c8c0 0x7fc6a40b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a408f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40ae6b0 con 0x7fc6a409ab00 2021-11-15T19:28:41.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40aff50 con 0x7fc6a40b3140 2021-11-15T19:28:41.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40ae410 con 0x7fc6a409c8c0 2021-11-15T19:28:41.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a408f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a408f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33418/0 (socket says 172.21.2.137:33418) 2021-11-15T19:28:41.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 -- 172.21.2.137:0/597369875 learned_addr learned my addr 172.21.2.137:0/597369875 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:41.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 -- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc6a409c8c0 msgr2=0x7fc6a40b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc6a409c8c0 0x7fc6a40b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 -- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc6a409ab00 msgr2=0x7fc6a4145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc6a409ab00 0x7fc6a4145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 -- 172.21.2.137:0/597369875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c00b1e0 con 0x7fc6a40b3140 2021-11-15T19:28:41.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a3fff700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a408f8b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fc6a405c3b0 tx=0x7fc69c007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c00e4a0 con 0x7fc6a40b3140 2021-11-15T19:28:41.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00e600 con 0x7fc6a40b3140 2021-11-15T19:28:41.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c00e960 con 0x7fc6a40b3140 2021-11-15T19:28:41.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a40ae8c0 con 0x7fc6a40b3140 2021-11-15T19:28:41.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a40b08a0 con 0x7fc6a40b3140 2021-11-15T19:28:41.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a40b0110 con 0x7fc6a40b3140 2021-11-15T19:28:41.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc69c019030 con 0x7fc6a40b3140 2021-11-15T19:28:41.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a0ff9700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc688053660 0x7fc688055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc69c06b200 con 0x7fc6a40b3140 2021-11-15T19:28:41.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.697+0000 7fc6a37fe700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc688053660 0x7fc688055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.701+0000 7fc6a37fe700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc688053660 0x7fc688055b20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fc694002fb0 tx=0x7fc6940069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.701+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6a40b0110 con 0x7fc6a40b3140 2021-11-15T19:28:41.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a40b00e0 con 0x7fc6a40b3140 2021-11-15T19:28:41.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a0ff9700 1 -- 172.21.2.137:0/597369875 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16064 (secure 0 0 0) 0x7fc69c017090 con 0x7fc6a40b3140 2021-11-15T19:28:41.787 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:41.787 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":40,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:28:41.473774+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:28:39.350040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T19:28:40.459226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:28:41.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc688053660 msgr2=0x7fc688055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc688053660 0x7fc688055b20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fc694002fb0 tx=0x7fc6940069b0).stop 2021-11-15T19:28:41.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 msgr2=0x7fc6a408f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a408f8b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fc6a405c3b0 tx=0x7fc69c007f40).stop 2021-11-15T19:28:41.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 shutdown_connections 2021-11-15T19:28:41.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc688053660 0x7fc688055b20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc6a40b3140 0x7fc6a408f8b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:41.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc6a409c8c0 0x7fc6a40b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 --2- 172.21.2.137:0/597369875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc6a409ab00 0x7fc6a4145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 >> 172.21.2.137:0/597369875 conn(0x7fc6a40b45b0 msgr2=0x7fc6a41427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 shutdown_connections 2021-11-15T19:28:41.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.785+0000 7fc6a9f6c700 1 -- 172.21.2.137:0/597369875 wait complete. 2021-11-15T19:28:41.794 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:28:41.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 Processor -- start 2021-11-15T19:28:41.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 -- start start 2021-11-15T19:28:41.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3778065730 0x7f377813c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778066270 con 0x7f37780b00a0 2021-11-15T19:28:41.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778065fd0 con 0x7f3778065b10 2021-11-15T19:28:41.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778067410 con 0x7f3778065730 2021-11-15T19:28:41.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3776ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3778065b10 0x7f377813c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52210/0 (socket says 172.21.2.137:52210) 2021-11-15T19:28:41.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3776ffd700 1 -- 172.21.2.137:0/1995734790 learned_addr learned my addr 172.21.2.137:0/1995734790 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:41.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429164649 0 0) 0x7f3778065fd0 con 0x7f3778065b10 2021-11-15T19:28:41.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3758003260 con 0x7f3778065b10 2021-11-15T19:28:41.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1462134167 0 0) 0x7f3758003260 con 0x7f3778065b10 2021-11-15T19:28:41.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3778065730 msgr2=0x7f377813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3778065730 0x7f377813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 >> v1:172.21.2.111:6789/0 conn(0x7f37780b00a0 legacy=0x7f377805bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778066f70 con 0x7f3778065b10 2021-11-15T19:28:41.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3760001660 con 0x7f3778065b10 2021-11-15T19:28:41.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 >> v1:172.21.2.137:6789/0 conn(0x7f3778065b10 legacy=0x7f377813c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3778065730 0x7f3758003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758003e10 0x7f3758004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3758004b10 0x7f3758004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778067410 con 0x7f3758003e10 2021-11-15T19:28:41.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375800b960 con 0x7f3758004b10 2021-11-15T19:28:41.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375800bb20 con 0x7f3778065730 2021-11-15T19:28:41.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3758004b10 0x7f3758004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 -- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3778065730 msgr2=0x7f3758003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3778065730 0x7f3758003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 -- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758003e10 msgr2=0x7f3758004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:41.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758003e10 0x7f3758004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 -- 172.21.2.137:0/1995734790 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758003260 con 0x7f3758004b10 2021-11-15T19:28:41.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f3777fff700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3758004b10 0x7f3758004f90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f3770002320 tx=0x7f3770007d80).ready entity=mon.1 client_cookie=3996c2a5cb2ff45b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3770006890 con 0x7f3758004b10 2021-11-15T19:28:41.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37700069f0 con 0x7f3758004b10 2021-11-15T19:28:41.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f37767fc700 1 -- 172.21.2.137:0/1995734790 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3770006d50 con 0x7f3758004b10 2021-11-15T19:28:41.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 -- 172.21.2.137:0/1995734790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3758004b10 msgr2=0x7f3758004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.845+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1995734790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3758004b10 0x7f3758004f90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f3770002320 tx=0x7f3770007d80).stop 2021-11-15T19:28:41.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3777fff700 1 -- 172.21.2.137:0/1995734790 reap_dead start 2021-11-15T19:28:41.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1995734790 shutdown_connections 2021-11-15T19:28:41.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1995734790 >> 172.21.2.137:0/1995734790 conn(0x7f3778060290 msgr2=0x7f3778060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:41.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1995734790 shutdown_connections 2021-11-15T19:28:41.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1995734790 wait complete. 2021-11-15T19:28:41.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 Processor -- start 2021-11-15T19:28:41.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- start start 2021-11-15T19:28:41.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758004b10 0x7f377814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 0x7f3778112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f37780aed50 0x7f37781373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778150f20 con 0x7f3758004b10 2021-11-15T19:28:41.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37781534a0 con 0x7f377810e8f0 2021-11-15T19:28:41.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377810ee70 con 0x7f37780aed50 2021-11-15T19:28:41.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 0x7f3778112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 0x7f3778112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33438/0 (socket says 172.21.2.137:33438) 2021-11-15T19:28:41.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 -- 172.21.2.137:0/1459659977 learned_addr learned my addr 172.21.2.137:0/1459659977 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:41.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 -- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f37780aed50 msgr2=0x7f37781373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f37780aed50 0x7f37781373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 -- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758004b10 msgr2=0x7f377814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:41.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758004b10 0x7f377814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:41.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 -- 172.21.2.137:0/1459659977 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377810f110 con 0x7f377810e8f0 2021-11-15T19:28:41.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3776ffd700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 0x7f3778112b70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f37780b0040 tx=0x7f37780652b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3760007310 con 0x7f377810e8f0 2021-11-15T19:28:41.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760015070 con 0x7f377810e8f0 2021-11-15T19:28:41.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3760011a90 con 0x7f377810e8f0 2021-11-15T19:28:41.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780af1d0 con 0x7f377810e8f0 2021-11-15T19:28:41.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778137ac0 con 0x7f377810e8f0 2021-11-15T19:28:41.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37781535e0 con 0x7f377810e8f0 2021-11-15T19:28:41.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3760011bf0 con 0x7f377810e8f0 2021-11-15T19:28:41.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3774ff9700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f375c0536a0 0x7f375c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:41.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f376006f250 con 0x7f377810e8f0 2021-11-15T19:28:41.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.849+0000 7f37777fe700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f375c0536a0 0x7f375c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:41.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.853+0000 7f37777fe700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f375c0536a0 0x7f375c055b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f3768002f70 tx=0x7f3768006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:41.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.853+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37600463b0 con 0x7f377810e8f0 2021-11-15T19:28:41.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:41.961+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f37780b0fb0 con 0x7f377810e8f0 2021-11-15T19:28:42.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.493+0000 7f3774ff9700 1 -- 172.21.2.137:0/1459659977 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f37600499d0 con 0x7f377810e8f0 2021-11-15T19:28:42.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f375c0536a0 msgr2=0x7f375c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f375c0536a0 0x7f375c055b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f3768002f70 tx=0x7f3768006a10).stop 2021-11-15T19:28:42.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 msgr2=0x7f3778112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 0x7f3778112b70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f37780b0040 tx=0x7f37780652b0).stop 2021-11-15T19:28:42.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 shutdown_connections 2021-11-15T19:28:42.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f375c0536a0 0x7f375c055b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f37780aed50 0x7f37781373b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f377810e8f0 0x7f3778112b70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 --2- 172.21.2.137:0/1459659977 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3758004b10 0x7f377814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 >> 172.21.2.137:0/1459659977 conn(0x7f3778060290 msgr2=0x7f37780b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:42.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 shutdown_connections 2021-11-15T19:28:42.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.497+0000 7f377dbfa700 1 -- 172.21.2.137:0/1459659977 wait complete. 2021-11-15T19:28:42.504 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 Processor -- start 2021-11-15T19:28:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 -- start start 2021-11-15T19:28:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fba300acab0 0x7fba300b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fba300af2f0 0x7fba300b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba300aecf0 con 0x7fba300b1180 2021-11-15T19:28:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3013f180 con 0x7fba300af2f0 2021-11-15T19:28:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba35b12700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300aef20 con 0x7fba300acab0 2021-11-15T19:28:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fba300acab0 0x7fba300b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fba300acab0 0x7fba300b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33444/0 (socket says 172.21.2.137:33444) 2021-11-15T19:28:42.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 -- 172.21.2.137:0/1858929147 learned_addr learned my addr 172.21.2.137:0/1858929147 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:42.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 -- 172.21.2.137:0/1858929147 >> v2:172.21.2.111:3300/0 conn(0x7fba300af2f0 msgr2=0x7fba300b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 --2- 172.21.2.137:0/1858929147 >> v2:172.21.2.111:3300/0 conn(0x7fba300af2f0 0x7fba300b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 -- 172.21.2.137:0/1858929147 >> v1:172.21.2.111:6789/0 conn(0x7fba300b1180 legacy=0x7fba30142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.553+0000 7fba2f7fe700 1 -- 172.21.2.137:0/1858929147 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300ace90 con 0x7fba300acab0 2021-11-15T19:28:42.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2f7fe700 1 --2- 172.21.2.137:0/1858929147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300acab0 0x7fba300b2060 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fba300b2bd0 tx=0x7fba24006eb0).ready entity=mon.1 client_cookie=f4cca4dc7b884a7a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2e7fc700 1 -- 172.21.2.137:0/1858929147 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba2400d5c0 con 0x7fba300acab0 2021-11-15T19:28:42.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2e7fc700 1 -- 172.21.2.137:0/1858929147 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba24000e90 con 0x7fba300acab0 2021-11-15T19:28:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2e7fc700 1 -- 172.21.2.137:0/1858929147 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba2400d910 con 0x7fba300acab0 2021-11-15T19:28:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/1858929147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300acab0 msgr2=0x7fba300b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 --2- 172.21.2.137:0/1858929147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300acab0 0x7fba300b2060 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fba300b2bd0 tx=0x7fba24006eb0).stop 2021-11-15T19:28:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/1858929147 shutdown_connections 2021-11-15T19:28:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 --2- 172.21.2.137:0/1858929147 >> v2:172.21.2.111:3300/0 conn(0x7fba300af2f0 0x7fba300b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 --2- 172.21.2.137:0/1858929147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300acab0 0x7fba300b2060 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/1858929147 >> 172.21.2.137:0/1858929147 conn(0x7fba300630f0 msgr2=0x7fba300634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/1858929147 shutdown_connections 2021-11-15T19:28:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/1858929147 wait complete. 2021-11-15T19:28:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 Processor -- start 2021-11-15T19:28:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- start start 2021-11-15T19:28:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba300acab0 0x7fba301556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba300af2f0 0x7fba301408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 0x7fba30144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3005c370 con 0x7fba300af2f0 2021-11-15T19:28:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3005c610 con 0x7fba300b1180 2021-11-15T19:28:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba30143c90 con 0x7fba300acab0 2021-11-15T19:28:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 0x7fba30144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 0x7fba30144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33452/0 (socket says 172.21.2.137:33452) 2021-11-15T19:28:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 -- 172.21.2.137:0/3141295176 learned_addr learned my addr 172.21.2.137:0/3141295176 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 -- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba300acab0 msgr2=0x7fba301556d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba300acab0 0x7fba301556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 -- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba300af2f0 msgr2=0x7fba301408a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba300af2f0 0x7fba301408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 -- 172.21.2.137:0/3141295176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2400b1e0 con 0x7fba300b1180 2021-11-15T19:28:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2ffff700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 0x7fba30144130 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fba280032f0 tx=0x7fba28009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba2800d580 con 0x7fba300b1180 2021-11-15T19:28:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2800d6e0 con 0x7fba300b1180 2021-11-15T19:28:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba30140d90 con 0x7fba300b1180 2021-11-15T19:28:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3005bf20 con 0x7fba300b1180 2021-11-15T19:28:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba2800da40 con 0x7fba300b1180 2021-11-15T19:28:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba30142540 con 0x7fba300b1180 2021-11-15T19:28:42.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba2800dba0 con 0x7fba300b1180 2021-11-15T19:28:42.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2cff9700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba10053660 0x7fba10055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.557+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fba2806bd90 con 0x7fba300b1180 2021-11-15T19:28:42.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.561+0000 7fba2f7fe700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba10053660 0x7fba10055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.561+0000 7fba2f7fe700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba10053660 0x7fba10055b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fba300b2bd0 tx=0x7fba24015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.561+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba30142540 con 0x7fba300b1180 2021-11-15T19:28:42.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba30142540 con 0x7fba300b1180 2021-11-15T19:28:42.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba2cff9700 1 -- 172.21.2.137:0/3141295176 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fba30142540 con 0x7fba300b1180 2021-11-15T19:28:42.674 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:42.674 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:28:42.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba10053660 msgr2=0x7fba10055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba10053660 0x7fba10055b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fba300b2bd0 tx=0x7fba24015000).stop 2021-11-15T19:28:42.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 msgr2=0x7fba30144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 0x7fba30144130 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fba280032f0 tx=0x7fba28009220).stop 2021-11-15T19:28:42.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 shutdown_connections 2021-11-15T19:28:42.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba10053660 0x7fba10055b20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba300b1180 0x7fba30144130 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba300af2f0 0x7fba301408a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 --2- 172.21.2.137:0/3141295176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba300acab0 0x7fba301556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 >> 172.21.2.137:0/3141295176 conn(0x7fba300630f0 msgr2=0x7fba300b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:42.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 shutdown_connections 2021-11-15T19:28:42.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.673+0000 7fba35b12700 1 -- 172.21.2.137:0/3141295176 wait complete. 2021-11-15T19:28:42.678 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:28:42.682 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:28:42.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.729+0000 7faa130d4700 1 Processor -- start 2021-11-15T19:28:42.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.729+0000 7faa130d4700 1 -- start start 2021-11-15T19:28:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b3390 0x7faa0c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faa0c141f20 0x7faa0c1423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c060e60 con 0x7faa0c060a80 2021-11-15T19:28:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0b2da0 con 0x7faa0c141f20 2021-11-15T19:28:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0b1f30 con 0x7faa0c0b3390 2021-11-15T19:28:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa10e70700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7faa0c060a80 0x7faa0c1433f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52240/0 (socket says 172.21.2.137:52240) 2021-11-15T19:28:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa10e70700 1 -- 172.21.2.137:0/2398194298 learned_addr learned my addr 172.21.2.137:0/2398194298 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258740999 0 0) 0x7faa0c060e60 con 0x7faa0c060a80 2021-11-15T19:28:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9ec003260 con 0x7faa0c060a80 2021-11-15T19:28:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647598348 0 0) 0x7fa9ec003260 con 0x7faa0c060a80 2021-11-15T19:28:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b3390 msgr2=0x7faa0c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b3390 0x7faa0c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 >> v2:172.21.2.111:3300/0 conn(0x7faa0c141f20 msgr2=0x7faa0c1423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/2398194298 >> v2:172.21.2.111:3300/0 conn(0x7faa0c141f20 0x7faa0c1423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c142cb0 con 0x7faa0c060a80 2021-11-15T19:28:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa9fc001660 con 0x7faa0c060a80 2021-11-15T19:28:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 >> v1:172.21.2.137:6789/0 conn(0x7faa0c060a80 legacy=0x7faa0c1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b3390 0x7fa9ec0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7fa9ec004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9ec004bf0 0x7fa9ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0b2da0 con 0x7fa9ec004bf0 2021-11-15T19:28:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0b1f30 con 0x7fa9ec003ee0 2021-11-15T19:28:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0053a0 con 0x7faa0c0b3390 2021-11-15T19:28:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7fa9ec004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 -- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b3390 msgr2=0x7fa9ec0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b3390 0x7fa9ec0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 -- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9ec004bf0 msgr2=0x7fa9ec00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9ec004bf0 0x7fa9ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 -- 172.21.2.137:0/2398194298 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec003260 con 0x7fa9ec003ee0 2021-11-15T19:28:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7fa9ec004500 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fa9f4002f70 tx=0x7fa9f4006ca0).ready entity=mon.1 client_cookie=5aaa478257d1d6d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9f4012410 con 0x7fa9ec003ee0 2021-11-15T19:28:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4012570 con 0x7fa9ec003ee0 2021-11-15T19:28:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa0b7fe700 1 -- 172.21.2.137:0/2398194298 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9f40128d0 con 0x7fa9ec003ee0 2021-11-15T19:28:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- 172.21.2.137:0/2398194298 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 msgr2=0x7fa9ec004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 --2- 172.21.2.137:0/2398194298 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7fa9ec004500 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fa9f4002f70 tx=0x7fa9f4006ca0).stop 2021-11-15T19:28:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa11671700 1 -- 172.21.2.137:0/2398194298 reap_dead start 2021-11-15T19:28:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- 172.21.2.137:0/2398194298 shutdown_connections 2021-11-15T19:28:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- 172.21.2.137:0/2398194298 >> 172.21.2.137:0/2398194298 conn(0x7faa0c0b4590 msgr2=0x7faa0c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- 172.21.2.137:0/2398194298 shutdown_connections 2021-11-15T19:28:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- 172.21.2.137:0/2398194298 wait complete. 2021-11-15T19:28:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 Processor -- start 2021-11-15T19:28:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- start start 2021-11-15T19:28:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7faa0c0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c0af340 0x7faa0c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0af950 0x7faa0c09c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c09c8c0 con 0x7faa0c0af340 2021-11-15T19:28:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c156ee0 con 0x7fa9ec003ee0 2021-11-15T19:28:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa130d4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c09a120 con 0x7faa0c0af950 2021-11-15T19:28:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa10e70700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7faa0c0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa10e70700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7faa0c0aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33474/0 (socket says 172.21.2.137:33474) 2021-11-15T19:28:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.733+0000 7faa10e70700 1 -- 172.21.2.137:0/697448550 learned_addr learned my addr 172.21.2.137:0/697448550 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa10e70700 1 -- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0af950 msgr2=0x7faa0c09c3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa10e70700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0af950 0x7faa0c09c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa10e70700 1 -- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c0af340 msgr2=0x7faa0c09bee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa10e70700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c0af340 0x7faa0c09bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa10e70700 1 -- 172.21.2.137:0/697448550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c09a3c0 con 0x7fa9ec003ee0 2021-11-15T19:28:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa10e70700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7faa0c0aee50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fa9fc001370 tx=0x7faa0c0b20a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc007170 con 0x7fa9ec003ee0 2021-11-15T19:28:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0072d0 con 0x7fa9ec003ee0 2021-11-15T19:28:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c09a660 con 0x7fa9ec003ee0 2021-11-15T19:28:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c157500 con 0x7fa9ec003ee0 2021-11-15T19:28:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc004920 con 0x7fa9ec003ee0 2021-11-15T19:28:42.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c0b1780 con 0x7fa9ec003ee0 2021-11-15T19:28:42.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9fc01b070 con 0x7fa9ec003ee0 2021-11-15T19:28:42.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053610 0x7fa9f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa9fc06b300 con 0x7fa9ec003ee0 2021-11-15T19:28:42.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa0bfff700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053610 0x7fa9f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa0bfff700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053610 0x7fa9f0055ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa9f4002f70 tx=0x7fa9f4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.737+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa0c0b1780 con 0x7fa9ec003ee0 2021-11-15T19:28:42.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa0c09a7f0 con 0x7fa9ec003ee0 2021-11-15T19:28:42.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa09ffb700 1 -- 172.21.2.137:0/697448550 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fa9fc0422d0 con 0x7fa9ec003ee0 2021-11-15T19:28:42.825 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:42.825 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":41,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:28:42.479080+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:28:39.350040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T19:28:40.459226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:28:42.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053610 msgr2=0x7fa9f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053610 0x7fa9f0055ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa9f4002f70 tx=0x7fa9f4015000).stop 2021-11-15T19:28:42.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 msgr2=0x7faa0c0aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7faa0c0aee50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fa9fc001370 tx=0x7faa0c0b20a0).stop 2021-11-15T19:28:42.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 shutdown_connections 2021-11-15T19:28:42.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053610 0x7fa9f0055ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0af950 0x7faa0c09c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c0af340 0x7faa0c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 --2- 172.21.2.137:0/697448550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9ec003ee0 0x7faa0c0aee50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.821+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 >> 172.21.2.137:0/697448550 conn(0x7faa0c0b4590 msgr2=0x7faa0c143740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:42.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.825+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 shutdown_connections 2021-11-15T19:28:42.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.825+0000 7faa130d4700 1 -- 172.21.2.137:0/697448550 wait complete. 2021-11-15T19:28:42.832 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:28:42.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 Processor -- start 2021-11-15T19:28:42.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- start start 2021-11-15T19:28:42.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7c2009c720 0x7f7c20143df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 0x7f7c20140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2009aa40 con 0x7f7c200b2830 2021-11-15T19:28:42.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2009b170 con 0x7f7c2009c720 2021-11-15T19:28:42.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b34c0 con 0x7f7c201449f0 2021-11-15T19:28:42.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c24e48700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7c200b2830 0x7f7c201442e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52264/0 (socket says 172.21.2.137:52264) 2021-11-15T19:28:42.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c24e48700 1 -- 172.21.2.137:0/750563293 learned_addr learned my addr 172.21.2.137:0/750563293 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:42.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393600649 0 0) 0x7f7c2009aa40 con 0x7f7c200b2830 2021-11-15T19:28:42.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003260 con 0x7f7c200b2830 2021-11-15T19:28:42.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 0x7f7c20140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25649700 1 --2- 172.21.2.137:0/750563293 >> v2:172.21.2.111:3300/0 conn(0x7f7c2009c720 0x7f7c20143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4275240273 0 0) 0x7f7c08003260 con 0x7f7c200b2830 2021-11-15T19:28:42.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 msgr2=0x7f7c20140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 0x7f7c20140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 >> v2:172.21.2.111:3300/0 conn(0x7f7c2009c720 msgr2=0x7f7c20143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 --2- 172.21.2.137:0/750563293 >> v2:172.21.2.111:3300/0 conn(0x7f7c2009c720 0x7f7c20143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2009acd0 con 0x7f7c200b2830 2021-11-15T19:28:42.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7c14001660 con 0x7f7c200b2830 2021-11-15T19:28:42.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 >> v1:172.21.2.137:6789/0 conn(0x7f7c200b2830 legacy=0x7f7c201442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 0x7f7c080037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c08003e00 0x7f7c08004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c080049f0 0x7f7c08004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2009b170 con 0x7f7c08003e00 2021-11-15T19:28:42.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b34c0 con 0x7f7c080049f0 2021-11-15T19:28:42.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800b8e0 con 0x7f7c201449f0 2021-11-15T19:28:42.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c080049f0 0x7f7c08004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c24e48700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c08003e00 0x7f7c08004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25649700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 0x7f7c080037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 -- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 msgr2=0x7f7c080037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c201449f0 0x7f7c080037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 -- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c08003e00 msgr2=0x7f7c08004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:42.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c08003e00 0x7f7c08004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:42.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 -- 172.21.2.137:0/750563293 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08003260 con 0x7f7c080049f0 2021-11-15T19:28:42.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c24e48700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c08003e00 0x7f7c08004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:28:42.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c080049f0 0x7f7c08004e70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7c1800a000 tx=0x7f7c18008040).ready entity=mon.1 client_cookie=fe154b64d7c050f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1800c070 con 0x7f7c080049f0 2021-11-15T19:28:42.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180137e0 con 0x7f7c080049f0 2021-11-15T19:28:42.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c13fff700 1 -- 172.21.2.137:0/750563293 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c18013b40 con 0x7f7c080049f0 2021-11-15T19:28:42.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- 172.21.2.137:0/750563293 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c080049f0 msgr2=0x7f7c08004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 --2- 172.21.2.137:0/750563293 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c080049f0 0x7f7c08004e70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7c1800a000 tx=0x7f7c18008040).stop 2021-11-15T19:28:42.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c25e4a700 1 -- 172.21.2.137:0/750563293 reap_dead start 2021-11-15T19:28:42.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- 172.21.2.137:0/750563293 shutdown_connections 2021-11-15T19:28:42.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- 172.21.2.137:0/750563293 >> 172.21.2.137:0/750563293 conn(0x7f7c200b45e0 msgr2=0x7f7c2005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:42.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- 172.21.2.137:0/750563293 shutdown_connections 2021-11-15T19:28:42.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.885+0000 7f7c278ad700 1 -- 172.21.2.137:0/750563293 wait complete. 2021-11-15T19:28:42.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 Processor -- start 2021-11-15T19:28:42.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- start start 2021-11-15T19:28:42.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c080049f0 0x7f7c200b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 0x7f7c2014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c20064ec0 0x7f7c2014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200655a0 con 0x7f7c080049f0 2021-11-15T19:28:42.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2014d9b0 con 0x7f7c200657d0 2021-11-15T19:28:42.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20065d30 con 0x7f7c20064ec0 2021-11-15T19:28:42.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 0x7f7c2014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 0x7f7c2014ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33492/0 (socket says 172.21.2.137:33492) 2021-11-15T19:28:42.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 -- 172.21.2.137:0/550948996 learned_addr learned my addr 172.21.2.137:0/550948996 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:42.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 -- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c20064ec0 msgr2=0x7f7c2014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c20064ec0 0x7f7c2014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 -- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c080049f0 msgr2=0x7f7c200b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:42.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c080049f0 0x7f7c200b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:42.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 -- 172.21.2.137:0/550948996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20143810 con 0x7f7c200657d0 2021-11-15T19:28:42.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c24e48700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 0x7f7c2014ddd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7c200acd20 tx=0x7f7c14009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c14007170 con 0x7f7c200657d0 2021-11-15T19:28:42.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c140072d0 con 0x7f7c200657d0 2021-11-15T19:28:42.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20143ab0 con 0x7f7c200657d0 2021-11-15T19:28:42.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2014e9d0 con 0x7f7c200657d0 2021-11-15T19:28:42.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c14004920 con 0x7f7c200657d0 2021-11-15T19:28:42.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20143650 con 0x7f7c200657d0 2021-11-15T19:28:42.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c1401b060 con 0x7f7c200657d0 2021-11-15T19:28:42.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c127fc700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c000534f0 0x7f7c000559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:42.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7c1406b570 con 0x7f7c200657d0 2021-11-15T19:28:42.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.889+0000 7f7c25649700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c000534f0 0x7f7c000559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:42.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.893+0000 7f7c25649700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c000534f0 0x7f7c000559b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7c1c008000 tx=0x7f7c1c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:42.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:42.893+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c14042560 con 0x7f7c200657d0 2021-11-15T19:28:43.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.005+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7c20143c40 con 0x7f7c200657d0 2021-11-15T19:28:43.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c127fc700 1 -- 172.21.2.137:0/550948996 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7c14019030 con 0x7f7c200657d0 2021-11-15T19:28:43.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c000534f0 msgr2=0x7f7c000559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c000534f0 0x7f7c000559b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7c1c008000 tx=0x7f7c1c008040).stop 2021-11-15T19:28:43.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 msgr2=0x7f7c2014ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 0x7f7c2014ddd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7c200acd20 tx=0x7f7c14009040).stop 2021-11-15T19:28:43.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 shutdown_connections 2021-11-15T19:28:43.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7c000534f0 0x7f7c000559b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7c20064ec0 0x7f7c2014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7c200657d0 0x7f7c2014ddd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 --2- 172.21.2.137:0/550948996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7c080049f0 0x7f7c200b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 >> 172.21.2.137:0/550948996 conn(0x7f7c200b45e0 msgr2=0x7f7c20062800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 shutdown_connections 2021-11-15T19:28:43.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.017+0000 7f7c278ad700 1 -- 172.21.2.137:0/550948996 wait complete. 2021-11-15T19:28:43.023 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:28:43.026 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:28:43.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdb05411700 1 Processor -- start 2021-11-15T19:28:43.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdb05411700 1 -- start start 2021-11-15T19:28:43.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdb05411700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdb0013f890 0x7fdb000b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdb05411700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb000b0c80 con 0x7fdb000608f0 2021-11-15T19:28:43.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdb05411700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb000b0f20 con 0x7fdb0005f730 2021-11-15T19:28:43.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdb05411700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb000ad6c0 con 0x7fdb0013f890 2021-11-15T19:28:43.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdaff7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdb0005f730 0x7fdb0005fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52280/0 (socket says 172.21.2.137:52280) 2021-11-15T19:28:43.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdaff7fe700 1 -- 172.21.2.137:0/4101081756 learned_addr learned my addr 172.21.2.137:0/4101081756 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:43.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347147698 0 0) 0x7fdb000b0f20 con 0x7fdb0005f730 2021-11-15T19:28:43.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae0003260 con 0x7fdb0005f730 2021-11-15T19:28:43.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafe7fc700 1 --2- 172.21.2.137:0/4101081756 >> v2:172.21.2.111:3300/0 conn(0x7fdb0013f890 0x7fdb000b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 573516745 0 0) 0x7fdae0003260 con 0x7fdb0005f730 2021-11-15T19:28:43.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 >> v2:172.21.2.111:3300/0 conn(0x7fdb0013f890 msgr2=0x7fdb000b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 --2- 172.21.2.137:0/4101081756 >> v2:172.21.2.111:3300/0 conn(0x7fdb0013f890 0x7fdb000b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 >> v1:172.21.2.111:6789/0 conn(0x7fdb000608f0 legacy=0x7fdb000b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000b11c0 con 0x7fdb0005f730 2021-11-15T19:28:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fdaf80019e0 con 0x7fdb0005f730 2021-11-15T19:28:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 >> v1:172.21.2.137:6789/0 conn(0x7fdb0005f730 legacy=0x7fdb0005fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0003750 0x7fdae0003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.077+0000 7fdafdffb700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdae0004500 0x7fdae0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdae0004ec0 0x7fdae000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000ad6c0 con 0x7fdae0004500 2021-11-15T19:28:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae000bd80 con 0x7fdae0004ec0 2021-11-15T19:28:43.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae000bf40 con 0x7fdae0003750 2021-11-15T19:28:43.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdae0004500 0x7fdae0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdae0004ec0 0x7fdae000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafeffd700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0003750 0x7fdae0003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 -- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0003750 msgr2=0x7fdae0003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0003750 0x7fdae0003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 -- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdae0004500 msgr2=0x7fdae0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdae0004500 0x7fdae0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 -- 172.21.2.137:0/4101081756 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0003260 con 0x7fdae0004ec0 2021-11-15T19:28:43.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 -- 172.21.2.137:0/4101081756 reap_dead start 2021-11-15T19:28:43.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaff7fe700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdae0004ec0 0x7fdae000b750 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fdb000b3ac0 tx=0x7fdb000ae010).ready entity=mon.1 client_cookie=e4c4d01cd7667a88 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf800cd70 con 0x7fdae0004ec0 2021-11-15T19:28:43.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8005990 con 0x7fdae0004ec0 2021-11-15T19:28:43.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafdffb700 1 -- 172.21.2.137:0/4101081756 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf8005cf0 con 0x7fdae0004ec0 2021-11-15T19:28:43.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/4101081756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdae0004ec0 msgr2=0x7fdae000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdae0004ec0 0x7fdae000b750 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fdb000b3ac0 tx=0x7fdb000ae010).stop 2021-11-15T19:28:43.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/4101081756 shutdown_connections 2021-11-15T19:28:43.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 --2- 172.21.2.137:0/4101081756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdae0004ec0 0x7fdae000b750 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/4101081756 >> 172.21.2.137:0/4101081756 conn(0x7fdb00063980 msgr2=0x7fdb00063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/4101081756 shutdown_connections 2021-11-15T19:28:43.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/4101081756 wait complete. 2021-11-15T19:28:43.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 Processor -- start 2021-11-15T19:28:43.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- start start 2021-11-15T19:28:43.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0004ec0 0x7fdb000b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 0x7fdb0012bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb0012a230 0x7fdb0012bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb001284a0 con 0x7fdb0012a230 2021-11-15T19:28:43.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00143890 con 0x7fdb000b46d0 2021-11-15T19:28:43.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00143b30 con 0x7fdae0004ec0 2021-11-15T19:28:43.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 0x7fdb0012bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 0x7fdb0012bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33512/0 (socket says 172.21.2.137:33512) 2021-11-15T19:28:43.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 -- 172.21.2.137:0/1752770106 learned_addr learned my addr 172.21.2.137:0/1752770106 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 -- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0004ec0 msgr2=0x7fdb000b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0004ec0 0x7fdb000b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 -- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb0012a230 msgr2=0x7fdb0012bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb0012a230 0x7fdb0012bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 -- 172.21.2.137:0/1752770106 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00129500 con 0x7fdb000b46d0 2021-11-15T19:28:43.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafe7fc700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 0x7fdb0012bb00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fdae80030b0 tx=0x7fdae8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae80135f0 con 0x7fdb000b46d0 2021-11-15T19:28:43.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8000e90 con 0x7fdb000b46d0 2021-11-15T19:28:43.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae8013940 con 0x7fdb000b46d0 2021-11-15T19:28:43.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb00155260 con 0x7fdb000b46d0 2021-11-15T19:28:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb00142e50 con 0x7fdb000b46d0 2021-11-15T19:28:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb00060cd0 con 0x7fdb000b46d0 2021-11-15T19:28:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdae8013aa0 con 0x7fdb000b46d0 2021-11-15T19:28:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaf7fff700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae4053540 0x7fdae4055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdae806b940 con 0x7fdb000b46d0 2021-11-15T19:28:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.081+0000 7fdafeffd700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae4053540 0x7fdae4055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.085+0000 7fdafeffd700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae4053540 0x7fdae4055a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fdaf000b000 tx=0x7fdaf0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.085+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdae8042990 con 0x7fdb000b46d0 2021-11-15T19:28:43.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.193+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdb000573d0 con 0x7fdb000b46d0 2021-11-15T19:28:43.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.205+0000 7fdaf7fff700 1 -- 172.21.2.137:0/1752770106 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdae8017020 con 0x7fdb000b46d0 2021-11-15T19:28:43.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae4053540 msgr2=0x7fdae4055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae4053540 0x7fdae4055a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fdaf000b000 tx=0x7fdaf0009040).stop 2021-11-15T19:28:43.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 msgr2=0x7fdb0012bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 0x7fdb0012bb00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fdae80030b0 tx=0x7fdae8008040).stop 2021-11-15T19:28:43.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 shutdown_connections 2021-11-15T19:28:43.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae4053540 0x7fdae4055a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb0012a230 0x7fdb0012bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb000b46d0 0x7fdb0012bb00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 --2- 172.21.2.137:0/1752770106 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdae0004ec0 0x7fdb000b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 >> 172.21.2.137:0/1752770106 conn(0x7fdb00063980 msgr2=0x7fdb00128850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 shutdown_connections 2021-11-15T19:28:43.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.209+0000 7fdb05411700 1 -- 172.21.2.137:0/1752770106 wait complete. 2021-11-15T19:28:43.213 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:28:43.216 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:28:43.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 Processor -- start 2021-11-15T19:28:43.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- start start 2021-11-15T19:28:43.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f188c061830 0x7f188c060a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f188c0b2a40 0x7f188c14ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c061c10 con 0x7f188c14b210 2021-11-15T19:28:43.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c0adde0 con 0x7f188c061830 2021-11-15T19:28:43.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c061100 con 0x7f188c0b2a40 2021-11-15T19:28:43.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f188c0b2a40 0x7f188c14ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f188c0b2a40 0x7f188c14ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33522/0 (socket says 172.21.2.137:33522) 2021-11-15T19:28:43.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 -- 172.21.2.137:0/3082774130 learned_addr learned my addr 172.21.2.137:0/3082774130 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 -- 172.21.2.137:0/3082774130 >> v2:172.21.2.111:3300/0 conn(0x7f188c061830 msgr2=0x7f188c060a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 --2- 172.21.2.137:0/3082774130 >> v2:172.21.2.111:3300/0 conn(0x7f188c061830 0x7f188c060a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 -- 172.21.2.137:0/3082774130 >> v1:172.21.2.111:6789/0 conn(0x7f188c14b210 legacy=0x7f188c05f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 -- 172.21.2.137:0/3082774130 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0ac690 con 0x7f188c0b2a40 2021-11-15T19:28:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188b7fe700 1 --2- 172.21.2.137:0/3082774130 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c0b2a40 0x7f188c14ad20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f188c0b7e10 tx=0x7f187c006eb0).ready entity=mon.1 client_cookie=e8c9ff972831e791 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188affd700 1 -- 172.21.2.137:0/3082774130 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c00d5c0 con 0x7f188c0b2a40 2021-11-15T19:28:43.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188affd700 1 -- 172.21.2.137:0/3082774130 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c000e90 con 0x7f188c0b2a40 2021-11-15T19:28:43.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f188affd700 1 -- 172.21.2.137:0/3082774130 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c00d910 con 0x7f188c0b2a40 2021-11-15T19:28:43.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- 172.21.2.137:0/3082774130 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c0b2a40 msgr2=0x7f188c14ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 --2- 172.21.2.137:0/3082774130 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c0b2a40 0x7f188c14ad20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f188c0b7e10 tx=0x7f187c006eb0).stop 2021-11-15T19:28:43.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- 172.21.2.137:0/3082774130 shutdown_connections 2021-11-15T19:28:43.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 --2- 172.21.2.137:0/3082774130 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c0b2a40 0x7f188c14ad20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 --2- 172.21.2.137:0/3082774130 >> v2:172.21.2.111:3300/0 conn(0x7f188c061830 0x7f188c060a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- 172.21.2.137:0/3082774130 >> 172.21.2.137:0/3082774130 conn(0x7f188c0b7070 msgr2=0x7f188c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- 172.21.2.137:0/3082774130 shutdown_connections 2021-11-15T19:28:43.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.269+0000 7f1892785700 1 -- 172.21.2.137:0/3082774130 wait complete. 2021-11-15T19:28:43.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 Processor -- start 2021-11-15T19:28:43.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- start start 2021-11-15T19:28:43.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 0x7f188c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f188c0b2a40 0x7f188c148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f188c14b210 0x7f188c149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c09c830 con 0x7f188c0b2a40 2021-11-15T19:28:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c09ca60 con 0x7f188c061830 2021-11-15T19:28:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c09cd00 con 0x7f188c14b210 2021-11-15T19:28:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 0x7f188c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 0x7f188c0b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33526/0 (socket says 172.21.2.137:33526) 2021-11-15T19:28:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 -- 172.21.2.137:0/1589715457 learned_addr learned my addr 172.21.2.137:0/1589715457 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 -- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f188c14b210 msgr2=0x7f188c149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f188c14b210 0x7f188c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 -- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f188c0b2a40 msgr2=0x7f188c148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f188c0b2a40 0x7f188c148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 -- 172.21.2.137:0/1589715457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c00b1e0 con 0x7f188c061830 2021-11-15T19:28:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188bfff700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 0x7f188c0b0900 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f1874002f70 tx=0x7f1874006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1874013460 con 0x7f188c061830 2021-11-15T19:28:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18740135c0 con 0x7f188c061830 2021-11-15T19:28:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1874013920 con 0x7f188c061830 2021-11-15T19:28:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c09baf0 con 0x7f188c061830 2021-11-15T19:28:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c065330 con 0x7f188c061830 2021-11-15T19:28:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c09cec0 con 0x7f188c061830 2021-11-15T19:28:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f187401a060 con 0x7f188c061830 2021-11-15T19:28:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f18897fa700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f18700535d0 0x7f1870055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f187406b5a0 con 0x7f188c061830 2021-11-15T19:28:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.273+0000 7f188b7fe700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f18700535d0 0x7f1870055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.277+0000 7f188b7fe700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f18700535d0 0x7f1870055a90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f188c0b7e10 tx=0x7f187c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.277+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f18740425f0 con 0x7f188c061830 2021-11-15T19:28:43.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.389+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f188c0ac930 con 0x7f188c061830 2021-11-15T19:28:43.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f18897fa700 1 -- 172.21.2.137:0/1589715457 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1874018030 con 0x7f188c061830 2021-11-15T19:28:43.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f18700535d0 msgr2=0x7f1870055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f18700535d0 0x7f1870055a90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f188c0b7e10 tx=0x7f187c015000).stop 2021-11-15T19:28:43.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 msgr2=0x7f188c0b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 0x7f188c0b0900 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f1874002f70 tx=0x7f1874006ec0).stop 2021-11-15T19:28:43.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 shutdown_connections 2021-11-15T19:28:43.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f18700535d0 0x7f1870055a90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f188c14b210 0x7f188c149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f188c0b2a40 0x7f188c148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 --2- 172.21.2.137:0/1589715457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f188c061830 0x7f188c0b0900 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 >> 172.21.2.137:0/1589715457 conn(0x7f188c0b7070 msgr2=0x7f188c0b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 shutdown_connections 2021-11-15T19:28:43.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.401+0000 7f1892785700 1 -- 172.21.2.137:0/1589715457 wait complete. 2021-11-15T19:28:43.406 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:28:43.410 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:43.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 Processor -- start 2021-11-15T19:28:43.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 -- start start 2021-11-15T19:28:43.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 0x7f7b280b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7b280af2f0 0x7f7b280b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b280aecf0 con 0x7f7b280b1180 2021-11-15T19:28:43.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2813f180 con 0x7f7b280af2f0 2021-11-15T19:28:43.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.457+0000 7f7b2d0ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280aef20 con 0x7f7b280acab0 2021-11-15T19:28:43.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 0x7f7b280b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2759e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7b280af2f0 0x7f7b280b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 0x7f7b280b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:35102/0 (socket says 172.21.2.137:35102) 2021-11-15T19:28:43.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 -- 172.21.2.137:0/2710831745 learned_addr learned my addr 172.21.2.137:0/2710831745 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2659c700 1 --1- 172.21.2.137:0/2710831745 >> v1:172.21.2.111:6789/0 conn(0x7f7b280b1180 0x7f7b28142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:44808/0 (socket says 172.21.2.137:44808) 2021-11-15T19:28:43.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 -- 172.21.2.137:0/2710831745 >> v2:172.21.2.111:3300/0 conn(0x7f7b280af2f0 msgr2=0x7f7b280b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 --2- 172.21.2.137:0/2710831745 >> v2:172.21.2.111:3300/0 conn(0x7f7b280af2f0 0x7f7b280b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 -- 172.21.2.137:0/2710831745 >> v1:172.21.2.111:6789/0 conn(0x7f7b280b1180 legacy=0x7f7b28142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 -- 172.21.2.137:0/2710831745 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280ace90 con 0x7f7b280acab0 2021-11-15T19:28:43.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b26d9d700 1 --2- 172.21.2.137:0/2710831745 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 0x7f7b280b2060 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7b18002f70 tx=0x7f7b18006eb0).ready entity=mon.2 client_cookie=1989f4c3fa216881 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b25d9b700 1 -- 172.21.2.137:0/2710831745 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b1800d570 con 0x7f7b280acab0 2021-11-15T19:28:43.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b25d9b700 1 -- 172.21.2.137:0/2710831745 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18000e90 con 0x7f7b280acab0 2021-11-15T19:28:43.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b25d9b700 1 -- 172.21.2.137:0/2710831745 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b1800d900 con 0x7f7b280acab0 2021-11-15T19:28:43.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2710831745 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 msgr2=0x7f7b280b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2710831745 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 0x7f7b280b2060 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7b18002f70 tx=0x7f7b18006eb0).stop 2021-11-15T19:28:43.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2710831745 shutdown_connections 2021-11-15T19:28:43.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2710831745 >> v2:172.21.2.111:3300/0 conn(0x7f7b280af2f0 0x7f7b280b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2710831745 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280acab0 0x7f7b280b2060 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2710831745 >> 172.21.2.137:0/2710831745 conn(0x7f7b280630f0 msgr2=0x7f7b280634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2710831745 shutdown_connections 2021-11-15T19:28:43.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2710831745 wait complete. 2021-11-15T19:28:43.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 Processor -- start 2021-11-15T19:28:43.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 -- start start 2021-11-15T19:28:43.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b280acab0 0x7f7b28136a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280af2f0 0x7f7b28155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.461+0000 7f7b2d0ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 0x7f7b281372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2d0ae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28156470 con 0x7f7b280acab0 2021-11-15T19:28:43.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2d0ae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b281555a0 con 0x7f7b280b1180 2021-11-15T19:28:43.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2d0ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28155840 con 0x7f7b280af2f0 2021-11-15T19:28:43.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 0x7f7b281372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 0x7f7b281372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33538/0 (socket says 172.21.2.137:33538) 2021-11-15T19:28:43.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 -- 172.21.2.137:0/2455624597 learned_addr learned my addr 172.21.2.137:0/2455624597 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b26d9d700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b280acab0 0x7f7b28136a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2659c700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280af2f0 0x7f7b28155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 -- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280af2f0 msgr2=0x7f7b28155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280af2f0 0x7f7b28155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 -- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b280acab0 msgr2=0x7f7b28136a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b280acab0 0x7f7b28136a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 -- 172.21.2.137:0/2455624597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1800b1e0 con 0x7f7b280b1180 2021-11-15T19:28:43.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2759e700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 0x7f7b281372d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f7b20006e00 tx=0x7f7b200091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b20009620 con 0x7f7b280b1180 2021-11-15T19:28:43.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000c850 con 0x7f7b280b1180 2021-11-15T19:28:43.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2000cbb0 con 0x7f7b280b1180 2021-11-15T19:28:43.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b28155ae0 con 0x7f7b280b1180 2021-11-15T19:28:43.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28066ba0 con 0x7f7b280b1180 2021-11-15T19:28:43.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280b1820 con 0x7f7b280b1180 2021-11-15T19:28:43.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b20022070 con 0x7f7b280b1180 2021-11-15T19:28:43.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b1ffff700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7b0c0536d0 0x7f7b0c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7b2006c010 con 0x7f7b280b1180 2021-11-15T19:28:43.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.465+0000 7f7b26d9d700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7b0c0536d0 0x7f7b0c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.469+0000 7f7b26d9d700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7b0c0536d0 0x7f7b0c055b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7b1801a000 tx=0x7f7b18015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.469+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b20043170 con 0x7f7b280b1180 2021-11-15T19:28:43.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.577+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b280573d0 con 0x7f7b280b1180 2021-11-15T19:28:43.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.577+0000 7f7b1ffff700 1 -- 172.21.2.137:0/2455624597 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f7b20046790 con 0x7f7b280b1180 2021-11-15T19:28:43.581 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:43.581 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:28:43.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7b0c0536d0 msgr2=0x7f7b0c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7b0c0536d0 0x7f7b0c055b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7b1801a000 tx=0x7f7b18015000).stop 2021-11-15T19:28:43.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 msgr2=0x7f7b281372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 0x7f7b281372d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f7b20006e00 tx=0x7f7b200091d0).stop 2021-11-15T19:28:43.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 shutdown_connections 2021-11-15T19:28:43.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7b0c0536d0 0x7f7b0c055b90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b280b1180 0x7f7b281372d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b280af2f0 0x7f7b28155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 --2- 172.21.2.137:0/2455624597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b280acab0 0x7f7b28136a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 >> 172.21.2.137:0/2455624597 conn(0x7f7b280630f0 msgr2=0x7f7b280b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 shutdown_connections 2021-11-15T19:28:43.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.581+0000 7f7b2d0ae700 1 -- 172.21.2.137:0/2455624597 wait complete. 2021-11-15T19:28:43.585 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:28:43.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:28:41.474267+0000', 'modified': '2021-11-15T19:28:42.480660+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5191}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5191': {'gid': 5191, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/105473297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 105473297}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 105473297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:28:43.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:28:43.791 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:28:43.855 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5191,"want_state":"up:active","state":"up:active","rank_uptime":2.3732505339999999,"mdsmap_epoch":15,"osdmap_epoch":42,"osdmap_epoch_barrier":41,"uptime":6.5781455219999998} 2021-11-15T19:28:43.856 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5191, "mdsmap_epoch": 15, "osdmap_epoch": 42, "osdmap_epoch_barrier": 41, "rank_uptime": 2.373250534, "state": "up:active", "uptime": 6.578145522, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:28:43.857 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:28:43.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 Processor -- start 2021-11-15T19:28:43.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 -- start start 2021-11-15T19:28:43.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 0x7fb9740ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb9740b2d50 0x7fb9741440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb9741445b0 0x7fb974144a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9740ac120 con 0x7fb9740b2d50 2021-11-15T19:28:43.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb974097c50 con 0x7fb9741445b0 2021-11-15T19:28:43.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb97a077700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974144f30 con 0x7fb9740ac3c0 2021-11-15T19:28:43.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb9741445b0 0x7fb974144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb9741445b0 0x7fb974144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33548/0 (socket says 172.21.2.137:33548) 2021-11-15T19:28:43.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 -- 172.21.2.137:0/1551922340 learned_addr learned my addr 172.21.2.137:0/1551922340 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 -- 172.21.2.137:0/1551922340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 msgr2=0x7fb9740ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 --2- 172.21.2.137:0/1551922340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 0x7fb9740ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 -- 172.21.2.137:0/1551922340 >> v2:172.21.2.111:3300/0 conn(0x7fb9740b2d50 msgr2=0x7fb9741440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:43.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 --2- 172.21.2.137:0/1551922340 >> v2:172.21.2.111:3300/0 conn(0x7fb9740b2d50 0x7fb9741440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 -- 172.21.2.137:0/1551922340 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740979b0 con 0x7fb9741445b0 2021-11-15T19:28:43.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb973fff700 1 --2- 172.21.2.137:0/1551922340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9741445b0 0x7fb974144a40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fb96c0032f0 tx=0x7fb96c009290).ready entity=mon.1 client_cookie=a1a38b26697d5df9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb9727fc700 1 -- 172.21.2.137:0/1551922340 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96c00b870 con 0x7fb9741445b0 2021-11-15T19:28:43.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb9727fc700 1 -- 172.21.2.137:0/1551922340 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00b9d0 con 0x7fb9741445b0 2021-11-15T19:28:43.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.905+0000 7fb9727fc700 1 -- 172.21.2.137:0/1551922340 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96c00bb40 con 0x7fb9741445b0 2021-11-15T19:28:43.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/1551922340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9741445b0 msgr2=0x7fb974144a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- 172.21.2.137:0/1551922340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9741445b0 0x7fb974144a40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fb96c0032f0 tx=0x7fb96c009290).stop 2021-11-15T19:28:43.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/1551922340 shutdown_connections 2021-11-15T19:28:43.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- 172.21.2.137:0/1551922340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9741445b0 0x7fb974144a40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:43.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- 172.21.2.137:0/1551922340 >> v2:172.21.2.111:3300/0 conn(0x7fb9740b2d50 0x7fb9741440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- 172.21.2.137:0/1551922340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 0x7fb9740ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/1551922340 >> 172.21.2.137:0/1551922340 conn(0x7fb9740b7070 msgr2=0x7fb9740b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:43.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/1551922340 shutdown_connections 2021-11-15T19:28:43.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/1551922340 wait complete. 2021-11-15T19:28:43.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 Processor -- start 2021-11-15T19:28:43.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- start start 2021-11-15T19:28:43.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 0x7fb974158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9741445b0 0x7fb974159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 0x7fb974159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974157890 con 0x7fb9741445b0 2021-11-15T19:28:43.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974064d60 con 0x7fb97409ce90 2021-11-15T19:28:43.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97413bd40 con 0x7fb9740ac3c0 2021-11-15T19:28:43.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 0x7fb974159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 0x7fb974159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33554/0 (socket says 172.21.2.137:33554) 2021-11-15T19:28:43.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 -- 172.21.2.137:0/437523971 learned_addr learned my addr 172.21.2.137:0/437523971 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:43.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 -- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 msgr2=0x7fb974158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 0x7fb974158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 -- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9741445b0 msgr2=0x7fb974159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:43.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9741445b0 0x7fb974159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:43.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 -- 172.21.2.137:0/437523971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c009530 con 0x7fb97409ce90 2021-11-15T19:28:43.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb973fff700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 0x7fb974159e80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fb974065260 tx=0x7fb96c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96c00b870 con 0x7fb97409ce90 2021-11-15T19:28:43.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c01f420 con 0x7fb97409ce90 2021-11-15T19:28:43.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96c01f780 con 0x7fb97409ce90 2021-11-15T19:28:43.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb974064f90 con 0x7fb97409ce90 2021-11-15T19:28:43.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9741594a0 con 0x7fb97409ce90 2021-11-15T19:28:43.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb974067c60 con 0x7fb97409ce90 2021-11-15T19:28:43.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.909+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb96c026030 con 0x7fb97409ce90 2021-11-15T19:28:43.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.913+0000 7fb970ff9700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb954053540 0x7fb954055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:43.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.913+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb96c06c6b0 con 0x7fb97409ce90 2021-11-15T19:28:43.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.913+0000 7fb9737fe700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb954053540 0x7fb954055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:43.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.913+0000 7fb9737fe700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb954053540 0x7fb954055a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fb964002f70 tx=0x7fb9640069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:43.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.913+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb96c043700 con 0x7fb97409ce90 2021-11-15T19:28:43.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9740573d0 con 0x7fb97409ce90 2021-11-15T19:28:43.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb970ff9700 1 -- 172.21.2.137:0/437523971 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fb96c046d20 con 0x7fb97409ce90 2021-11-15T19:28:44.000 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:44.000 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":42,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:28:43.493938+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:28:39.350040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T19:28:40.459226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:28:44.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb954053540 msgr2=0x7fb954055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb954053540 0x7fb954055a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fb964002f70 tx=0x7fb9640069e0).stop 2021-11-15T19:28:44.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 msgr2=0x7fb974159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 0x7fb974159e80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fb974065260 tx=0x7fb96c016000).stop 2021-11-15T19:28:44.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 shutdown_connections 2021-11-15T19:28:44.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb954053540 0x7fb954055a00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb97409ce90 0x7fb974159e80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb9741445b0 0x7fb974159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 --2- 172.21.2.137:0/437523971 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb9740ac3c0 0x7fb974158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 >> 172.21.2.137:0/437523971 conn(0x7fb9740b7070 msgr2=0x7fb9740b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 shutdown_connections 2021-11-15T19:28:44.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:43.997+0000 7fb97a077700 1 -- 172.21.2.137:0/437523971 wait complete. 2021-11-15T19:28:44.007 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:28:39.350040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:28:40.459226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:28:44.008 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:28:44.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2799ee700 1 Processor -- start 2021-11-15T19:28:44.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2799ee700 1 -- start start 2021-11-15T19:28:44.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2799ee700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd274140aa0 0x7fd274140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2799ee700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27405cb50 con 0x7fd27405c770 2021-11-15T19:28:44.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2799ee700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740ad030 con 0x7fd2740b0550 2021-11-15T19:28:44.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2799ee700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740b1650 con 0x7fd274140aa0 2021-11-15T19:28:44.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2727fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd2740b0550 0x7fd27414a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52342/0 (socket says 172.21.2.137:52342) 2021-11-15T19:28:44.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2727fc700 1 -- 172.21.2.137:0/1184907526 learned_addr learned my addr 172.21.2.137:0/1184907526 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:44.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711936123 0 0) 0x7fd2740ad030 con 0x7fd2740b0550 2021-11-15T19:28:44.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd254003260 con 0x7fd2740b0550 2021-11-15T19:28:44.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2737fe700 1 --2- 172.21.2.137:0/1184907526 >> v2:172.21.2.111:3300/0 conn(0x7fd274140aa0 0x7fd274140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1317003671 0 0) 0x7fd254003260 con 0x7fd2740b0550 2021-11-15T19:28:44.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 >> v2:172.21.2.111:3300/0 conn(0x7fd274140aa0 msgr2=0x7fd274140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 --2- 172.21.2.137:0/1184907526 >> v2:172.21.2.111:3300/0 conn(0x7fd274140aa0 0x7fd274140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 >> v1:172.21.2.111:6789/0 conn(0x7fd27405c770 legacy=0x7fd2740aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740ad2d0 con 0x7fd2740b0550 2021-11-15T19:28:44.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd25c001660 con 0x7fd2740b0550 2021-11-15T19:28:44.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 >> v1:172.21.2.137:6789/0 conn(0x7fd2740b0550 legacy=0x7fd27414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd254003820 0x7fd254003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254004500 0x7fd254004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254004f70 0x7fd25400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740b1650 con 0x7fd254004f70 2021-11-15T19:28:44.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25400be50 con 0x7fd254003820 2021-11-15T19:28:44.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25400c010 con 0x7fd254004500 2021-11-15T19:28:44.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd272ffd700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd254003820 0x7fd254003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd272ffd700 1 -- 172.21.2.137:0/1184907526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254004500 msgr2=0x7fd254004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd272ffd700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254004500 0x7fd254004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd272ffd700 1 -- 172.21.2.137:0/1184907526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254004f70 msgr2=0x7fd25400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd272ffd700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254004f70 0x7fd25400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd2737fe700 1 -- 172.21.2.137:0/1184907526 reap_dead start 2021-11-15T19:28:44.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.057+0000 7fd272ffd700 1 -- 172.21.2.137:0/1184907526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254003260 con 0x7fd254003820 2021-11-15T19:28:44.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd272ffd700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd254003820 0x7fd254003c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd264001fa0 tx=0x7fd264007a00).ready entity=mon.1 client_cookie=4110102686e9a7f7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd264007070 con 0x7fd254003820 2021-11-15T19:28:44.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2640071d0 con 0x7fd254003820 2021-11-15T19:28:44.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd271ffb700 1 -- 172.21.2.137:0/1184907526 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd264006510 con 0x7fd254003820 2021-11-15T19:28:44.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/1184907526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd254003820 msgr2=0x7fd254003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd254003820 0x7fd254003c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd264001fa0 tx=0x7fd264007a00).stop 2021-11-15T19:28:44.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/1184907526 shutdown_connections 2021-11-15T19:28:44.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 --2- 172.21.2.137:0/1184907526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd254003820 0x7fd254003c20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/1184907526 >> 172.21.2.137:0/1184907526 conn(0x7fd2740631e0 msgr2=0x7fd27405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/1184907526 shutdown_connections 2021-11-15T19:28:44.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/1184907526 wait complete. 2021-11-15T19:28:44.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 Processor -- start 2021-11-15T19:28:44.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- start start 2021-11-15T19:28:44.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254003820 0x7fd274156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2741416f0 0x7fd27414de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 0x7fd274067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd274144100 con 0x7fd254003820 2021-11-15T19:28:44.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2741599d0 con 0x7fd274066be0 2021-11-15T19:28:44.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2741429a0 con 0x7fd2741416f0 2021-11-15T19:28:44.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 0x7fd274067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 0x7fd274067090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33574/0 (socket says 172.21.2.137:33574) 2021-11-15T19:28:44.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 -- 172.21.2.137:0/903914046 learned_addr learned my addr 172.21.2.137:0/903914046 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd272ffd700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254003820 0x7fd274156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2727fc700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2741416f0 0x7fd27414de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 -- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2741416f0 msgr2=0x7fd27414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2741416f0 0x7fd27414de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 -- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254003820 msgr2=0x7fd274156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254003820 0x7fd274156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 -- 172.21.2.137:0/903914046 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274142c40 con 0x7fd274066be0 2021-11-15T19:28:44.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2727fc700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2741416f0 0x7fd27414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:28:44.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd272ffd700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254003820 0x7fd274156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:28:44.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2737fe700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 0x7fd274067090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fd27414ebb0 tx=0x7fd26c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26c00c070 con 0x7fd274066be0 2021-11-15T19:28:44.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0135e0 con 0x7fd274066be0 2021-11-15T19:28:44.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27414c230 con 0x7fd274066be0 2021-11-15T19:28:44.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26c013940 con 0x7fd274066be0 2021-11-15T19:28:44.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd274141d20 con 0x7fd274066be0 2021-11-15T19:28:44.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd274159b10 con 0x7fd274066be0 2021-11-15T19:28:44.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.061+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd26c013aa0 con 0x7fd274066be0 2021-11-15T19:28:44.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.065+0000 7fd26bfff700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd258053640 0x7fd258055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.065+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd26c06aa00 con 0x7fd274066be0 2021-11-15T19:28:44.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.065+0000 7fd272ffd700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd258053640 0x7fd258055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.065+0000 7fd272ffd700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd258053640 0x7fd258055b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd264019000 tx=0x7fd264015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.065+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd26c041b60 con 0x7fd274066be0 2021-11-15T19:28:44.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.145+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd2740ae7f0 con 0x7fd274066be0 2021-11-15T19:28:44.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.145+0000 7fd26bfff700 1 -- 172.21.2.137:0/903914046 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd26c045180 con 0x7fd274066be0 2021-11-15T19:28:44.149 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:28:44.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd258053640 msgr2=0x7fd258055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd258053640 0x7fd258055b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd264019000 tx=0x7fd264015000).stop 2021-11-15T19:28:44.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 msgr2=0x7fd274067090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 0x7fd274067090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fd27414ebb0 tx=0x7fd26c008040).stop 2021-11-15T19:28:44.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 shutdown_connections 2021-11-15T19:28:44.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd258053640 0x7fd258055b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd274066be0 0x7fd274067090 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2741416f0 0x7fd27414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 --2- 172.21.2.137:0/903914046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254003820 0x7fd274156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 >> 172.21.2.137:0/903914046 conn(0x7fd2740631e0 msgr2=0x7fd2740b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 shutdown_connections 2021-11-15T19:28:44.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.149+0000 7fd2799ee700 1 -- 172.21.2.137:0/903914046 wait complete. 2021-11-15T19:28:44.156 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:28:44.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 Processor -- start 2021-11-15T19:28:44.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 -- start start 2021-11-15T19:28:44.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f07240b0550 0x7f072414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f072414aaa0 0x7f0724140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072405cb50 con 0x7f072405c770 2021-11-15T19:28:44.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240b1650 con 0x7f07240b0550 2021-11-15T19:28:44.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f0729386700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240ad030 con 0x7f072414aaa0 2021-11-15T19:28:44.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.205+0000 7f07237fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f072414aaa0 0x7f0724140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f072414aaa0 0x7f0724140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33580/0 (socket says 172.21.2.137:33580) 2021-11-15T19:28:44.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 -- 172.21.2.137:0/2578717088 learned_addr learned my addr 172.21.2.137:0/2578717088 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 -- 172.21.2.137:0/2578717088 >> v2:172.21.2.111:3300/0 conn(0x7f07240b0550 msgr2=0x7f072414a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:44.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 --2- 172.21.2.137:0/2578717088 >> v2:172.21.2.111:3300/0 conn(0x7f07240b0550 0x7f072414a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 -- 172.21.2.137:0/2578717088 >> v1:172.21.2.111:6789/0 conn(0x7f072405c770 legacy=0x7f07240aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:44.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 -- 172.21.2.137:0/2578717088 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240ad2d0 con 0x7f072414aaa0 2021-11-15T19:28:44.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f07237fe700 1 --2- 172.21.2.137:0/2578717088 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072414aaa0 0x7f0724140aa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f07240aee10 tx=0x7f071c009290).ready entity=mon.1 client_cookie=1f4e5a6ea4ed52da server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0721ffb700 1 -- 172.21.2.137:0/2578717088 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f071c00b830 con 0x7f072414aaa0 2021-11-15T19:28:44.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0721ffb700 1 -- 172.21.2.137:0/2578717088 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c00b990 con 0x7f072414aaa0 2021-11-15T19:28:44.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0721ffb700 1 -- 172.21.2.137:0/2578717088 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f071c00bb40 con 0x7f072414aaa0 2021-11-15T19:28:44.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/2578717088 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072414aaa0 msgr2=0x7f0724140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 --2- 172.21.2.137:0/2578717088 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072414aaa0 0x7f0724140aa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f07240aee10 tx=0x7f071c009290).stop 2021-11-15T19:28:44.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/2578717088 shutdown_connections 2021-11-15T19:28:44.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 --2- 172.21.2.137:0/2578717088 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072414aaa0 0x7f0724140aa0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 --2- 172.21.2.137:0/2578717088 >> v2:172.21.2.111:3300/0 conn(0x7f07240b0550 0x7f072414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/2578717088 >> 172.21.2.137:0/2578717088 conn(0x7f07240631e0 msgr2=0x7f072405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/2578717088 shutdown_connections 2021-11-15T19:28:44.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/2578717088 wait complete. 2021-11-15T19:28:44.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 Processor -- start 2021-11-15T19:28:44.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- start start 2021-11-15T19:28:44.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 0x7f07240b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f07240b0550 0x7f0724159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f072414aaa0 0x7f0724159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724147130 con 0x7f07240b0550 2021-11-15T19:28:44.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724142970 con 0x7f072405c770 2021-11-15T19:28:44.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0724142c10 con 0x7f072414aaa0 2021-11-15T19:28:44.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 0x7f07240b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 0x7f07240b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33584/0 (socket says 172.21.2.137:33584) 2021-11-15T19:28:44.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 -- 172.21.2.137:0/3948880125 learned_addr learned my addr 172.21.2.137:0/3948880125 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 -- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f072414aaa0 msgr2=0x7f0724159f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:44.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f072414aaa0 0x7f0724159f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 -- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f07240b0550 msgr2=0x7f0724159aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:28:44.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f07240b0550 0x7f0724159aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 -- 172.21.2.137:0/3948880125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009530 con 0x7f072405c770 2021-11-15T19:28:44.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0722ffd700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 0x7f07240b3550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f0714002ef0 tx=0x7f0714006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0714012410 con 0x7f072405c770 2021-11-15T19:28:44.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714012570 con 0x7f072405c770 2021-11-15T19:28:44.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07241425f0 con 0x7f072405c770 2021-11-15T19:28:44.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07140128d0 con 0x7f072405c770 2021-11-15T19:28:44.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0724147780 con 0x7f072405c770 2021-11-15T19:28:44.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.209+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07241472a0 con 0x7f072405c770 2021-11-15T19:28:44.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.213+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f071400f030 con 0x7f072405c770 2021-11-15T19:28:44.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.213+0000 7f071bfff700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f07080536f0 0x7f0708055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.213+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f071406b760 con 0x7f072405c770 2021-11-15T19:28:44.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.213+0000 7f07227fc700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f07080536f0 0x7f0708055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.213+0000 7f07227fc700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f07080536f0 0x7f0708055bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f070c002ef0 tx=0x7f070c006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.213+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07241472a0 con 0x7f072405c770 2021-11-15T19:28:44.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07241427e0 con 0x7f072405c770 2021-11-15T19:28:44.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f071bfff700 1 -- 172.21.2.137:0/3948880125 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07140461e0 con 0x7f072405c770 2021-11-15T19:28:44.300 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:28:44.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f07080536f0 msgr2=0x7f0708055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f07080536f0 0x7f0708055bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f070c002ef0 tx=0x7f070c006890).stop 2021-11-15T19:28:44.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 msgr2=0x7f07240b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 0x7f07240b3550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f0714002ef0 tx=0x7f0714006d50).stop 2021-11-15T19:28:44.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 shutdown_connections 2021-11-15T19:28:44.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f07080536f0 0x7f0708055bb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f072414aaa0 0x7f0724159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f07240b0550 0x7f0724159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 --2- 172.21.2.137:0/3948880125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f072405c770 0x7f07240b3550 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 >> 172.21.2.137:0/3948880125 conn(0x7f07240631e0 msgr2=0x7f0724140390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 shutdown_connections 2021-11-15T19:28:44.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.297+0000 7f0729386700 1 -- 172.21.2.137:0/3948880125 wait complete. 2021-11-15T19:28:44.307 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:28:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 Processor -- start 2021-11-15T19:28:44.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- start start 2021-11-15T19:28:44.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6bb4065b10 0x7f6bb413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb40b00a0 0x7f6bb405bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb4066270 con 0x7f6bb4065730 2021-11-15T19:28:44.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb4067410 con 0x7f6bb4065b10 2021-11-15T19:28:44.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4065fd0 con 0x7f6bb40b00a0 2021-11-15T19:28:44.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb2ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6bb4065730 0x7f6bb413c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52374/0 (socket says 172.21.2.137:52374) 2021-11-15T19:28:44.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb2ffd700 1 -- 172.21.2.137:0/1140170120 learned_addr learned my addr 172.21.2.137:0/1140170120 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:28:44.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/1140170120 >> v2:172.21.2.137:3300/0 conn(0x7f6bb4065b10 0x7f6bb413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb27fc700 1 -- 172.21.2.137:0/1140170120 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb40b00a0 msgr2=0x7f6bb405bd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:28:44.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/1140170120 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb40b00a0 0x7f6bb405bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb27fc700 1 -- 172.21.2.137:0/1140170120 >> v1:172.21.2.137:6789/0 conn(0x7f6bb4065730 legacy=0x7f6bb413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb27fc700 1 -- 172.21.2.137:0/1140170120 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4066f70 con 0x7f6bb4065b10 2021-11-15T19:28:44.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/1140170120 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065b10 0x7f6bb413c9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f6ba4002f70 tx=0x7f6ba4006e80).ready entity=mon.1 client_cookie=7594349cd3c54d3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb1ffb700 1 -- 172.21.2.137:0/1140170120 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ba400a880 con 0x7f6bb4065b10 2021-11-15T19:28:44.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb1ffb700 1 -- 172.21.2.137:0/1140170120 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4000e90 con 0x7f6bb4065b10 2021-11-15T19:28:44.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb1ffb700 1 -- 172.21.2.137:0/1140170120 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ba400ac10 con 0x7f6bb4065b10 2021-11-15T19:28:44.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- 172.21.2.137:0/1140170120 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065b10 msgr2=0x7f6bb413c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 --2- 172.21.2.137:0/1140170120 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065b10 0x7f6bb413c9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f6ba4002f70 tx=0x7f6ba4006e80).stop 2021-11-15T19:28:44.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- 172.21.2.137:0/1140170120 shutdown_connections 2021-11-15T19:28:44.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 --2- 172.21.2.137:0/1140170120 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065b10 0x7f6bb413c9c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 --2- 172.21.2.137:0/1140170120 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb40b00a0 0x7f6bb405bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- 172.21.2.137:0/1140170120 >> 172.21.2.137:0/1140170120 conn(0x7f6bb4060290 msgr2=0x7f6bb4060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- 172.21.2.137:0/1140170120 shutdown_connections 2021-11-15T19:28:44.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.357+0000 7f6bb938a700 1 -- 172.21.2.137:0/1140170120 wait complete. 2021-11-15T19:28:44.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 Processor -- start 2021-11-15T19:28:44.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- start start 2021-11-15T19:28:44.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 0x7f6bb40adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb4065b10 0x7f6bb4157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bb40b00a0 0x7f6bb41396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb410ff40 con 0x7f6bb40b00a0 2021-11-15T19:28:44.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40acd40 con 0x7f6bb4065730 2021-11-15T19:28:44.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40acfe0 con 0x7f6bb4065b10 2021-11-15T19:28:44.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 0x7f6bb40adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 0x7f6bb40adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33598/0 (socket says 172.21.2.137:33598) 2021-11-15T19:28:44.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 -- 172.21.2.137:0/2890765894 learned_addr learned my addr 172.21.2.137:0/2890765894 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb37fe700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bb40b00a0 0x7f6bb41396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 -- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb4065b10 msgr2=0x7f6bb4157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb4065b10 0x7f6bb4157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb4065b10 0x7f6bb4157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 -- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bb40b00a0 msgr2=0x7f6bb41396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bb40b00a0 0x7f6bb41396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 -- 172.21.2.137:0/2890765894 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba400c310 con 0x7f6bb4065730 2021-11-15T19:28:44.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb4065b10 0x7f6bb4157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:28:44.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb37fe700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bb40b00a0 0x7f6bb41396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:28:44.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb2ffd700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 0x7f6bb40adeb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f6bb40af9b0 tx=0x7f6b9c007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b9c00ce20 con 0x7f6bb4065730 2021-11-15T19:28:44.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0072e0 con 0x7f6bb4065730 2021-11-15T19:28:44.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40ae3a0 con 0x7f6bb4065730 2021-11-15T19:28:44.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b9c005800 con 0x7f6bb4065730 2021-11-15T19:28:44.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb41578c0 con 0x7f6bb4065730 2021-11-15T19:28:44.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb40b0fb0 con 0x7f6bb4065730 2021-11-15T19:28:44.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6b9c010070 con 0x7f6bb4065730 2021-11-15T19:28:44.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6babfff700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b980535b0 0x7f6b98055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6b9c06af80 con 0x7f6bb4065730 2021-11-15T19:28:44.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b980535b0 0x7f6b98055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.361+0000 7f6bb27fc700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b980535b0 0x7f6b98055a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6ba4007000 tx=0x7f6bb40652b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.365+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b9c0420e0 con 0x7f6bb4065730 2021-11-15T19:28:44.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bb40573d0 con 0x7f6bb4065730 2021-11-15T19:28:44.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6babfff700 1 -- 172.21.2.137:0/2890765894 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6b9c045700 con 0x7f6bb4065730 2021-11-15T19:28:44.451 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:28:44.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b980535b0 msgr2=0x7f6b98055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b980535b0 0x7f6b98055a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6ba4007000 tx=0x7f6bb40652b0).stop 2021-11-15T19:28:44.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 msgr2=0x7f6bb40adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 0x7f6bb40adeb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f6bb40af9b0 tx=0x7f6b9c007c00).stop 2021-11-15T19:28:44.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 shutdown_connections 2021-11-15T19:28:44.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b980535b0 0x7f6b98055a70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6bb40b00a0 0x7f6bb41396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6bb4065b10 0x7f6bb4157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 --2- 172.21.2.137:0/2890765894 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6bb4065730 0x7f6bb40adeb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 >> 172.21.2.137:0/2890765894 conn(0x7f6bb4060290 msgr2=0x7f6bb40b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 shutdown_connections 2021-11-15T19:28:44.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.449+0000 7f6bb938a700 1 -- 172.21.2.137:0/2890765894 wait complete. 2021-11-15T19:28:44.458 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:28:44.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 Processor -- start 2021-11-15T19:28:44.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- start start 2021-11-15T19:28:44.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd3d4065730 0x7fd3d413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3d4065b10 0x7fd3d413c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d4066270 con 0x7fd3d40b00a0 2021-11-15T19:28:44.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d4067410 con 0x7fd3d4065730 2021-11-15T19:28:44.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d4065fd0 con 0x7fd3d4065b10 2021-11-15T19:28:44.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3d4065b10 0x7fd3d413c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3d4065b10 0x7fd3d413c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33610/0 (socket says 172.21.2.137:33610) 2021-11-15T19:28:44.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 -- 172.21.2.137:0/1730650923 learned_addr learned my addr 172.21.2.137:0/1730650923 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 -- 172.21.2.137:0/1730650923 >> v2:172.21.2.111:3300/0 conn(0x7fd3d4065730 msgr2=0x7fd3d413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 --2- 172.21.2.137:0/1730650923 >> v2:172.21.2.111:3300/0 conn(0x7fd3d4065730 0x7fd3d413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 -- 172.21.2.137:0/1730650923 >> v1:172.21.2.111:6789/0 conn(0x7fd3d40b00a0 legacy=0x7fd3d405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 -- 172.21.2.137:0/1730650923 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4066f70 con 0x7fd3d4065b10 2021-11-15T19:28:44.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d97c3700 1 --2- 172.21.2.137:0/1730650923 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d4065b10 0x7fd3d413c7a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fd3d413f060 tx=0x7fd3d0006e40).ready entity=mon.1 client_cookie=9ec3d8169c32aa0c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d8fc2700 1 -- 172.21.2.137:0/1730650923 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d000bcb0 con 0x7fd3d4065b10 2021-11-15T19:28:44.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d8fc2700 1 -- 172.21.2.137:0/1730650923 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0000e90 con 0x7fd3d4065b10 2021-11-15T19:28:44.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3d8fc2700 1 -- 172.21.2.137:0/1730650923 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d00153f0 con 0x7fd3d4065b10 2021-11-15T19:28:44.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- 172.21.2.137:0/1730650923 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d4065b10 msgr2=0x7fd3d413c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 --2- 172.21.2.137:0/1730650923 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d4065b10 0x7fd3d413c7a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fd3d413f060 tx=0x7fd3d0006e40).stop 2021-11-15T19:28:44.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- 172.21.2.137:0/1730650923 shutdown_connections 2021-11-15T19:28:44.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 --2- 172.21.2.137:0/1730650923 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d4065b10 0x7fd3d413c7a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 --2- 172.21.2.137:0/1730650923 >> v2:172.21.2.111:3300/0 conn(0x7fd3d4065730 0x7fd3d413c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- 172.21.2.137:0/1730650923 >> 172.21.2.137:0/1730650923 conn(0x7fd3d4060290 msgr2=0x7fd3d4060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- 172.21.2.137:0/1730650923 shutdown_connections 2021-11-15T19:28:44.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.509+0000 7fd3dc228700 1 -- 172.21.2.137:0/1730650923 wait complete. 2021-11-15T19:28:44.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 Processor -- start 2021-11-15T19:28:44.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- start start 2021-11-15T19:28:44.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3d4065730 0x7fd3d4141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3d4065b10 0x7fd3d413e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 0x7fd3d4142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4141fe0 con 0x7fd3d4065730 2021-11-15T19:28:44.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4153150 con 0x7fd3d40b00a0 2021-11-15T19:28:44.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41423a0 con 0x7fd3d4065b10 2021-11-15T19:28:44.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 0x7fd3d4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 0x7fd3d4142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33616/0 (socket says 172.21.2.137:33616) 2021-11-15T19:28:44.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 -- 172.21.2.137:0/2534078456 learned_addr learned my addr 172.21.2.137:0/2534078456 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 -- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3d4065b10 msgr2=0x7fd3d413e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3d4065b10 0x7fd3d413e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 -- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3d4065730 msgr2=0x7fd3d4141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3d4065730 0x7fd3d4141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 -- 172.21.2.137:0/2534078456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d000d4d0 con 0x7fd3d40b00a0 2021-11-15T19:28:44.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3da7c5700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 0x7fd3d4142840 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fd3cc003290 tx=0x7fd3cc0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3cc00f510 con 0x7fd3d40b00a0 2021-11-15T19:28:44.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00f670 con 0x7fd3d40b00a0 2021-11-15T19:28:44.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3cc00f7e0 con 0x7fd3d40b00a0 2021-11-15T19:28:44.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d4135cf0 con 0x7fd3d40b00a0 2021-11-15T19:28:44.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d4141920 con 0x7fd3d40b00a0 2021-11-15T19:28:44.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d4142560 con 0x7fd3d40b00a0 2021-11-15T19:28:44.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd3cc00f070 con 0x7fd3d40b00a0 2021-11-15T19:28:44.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3c2ffd700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3b40535d0 0x7fd3b4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd3cc06b5d0 con 0x7fd3d40b00a0 2021-11-15T19:28:44.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.513+0000 7fd3d9fc4700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3b40535d0 0x7fd3b4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.517+0000 7fd3d9fc4700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3b40535d0 0x7fd3b4055a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fd3c4002f70 tx=0x7fd3c4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.517+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3cc042620 con 0x7fd3d40b00a0 2021-11-15T19:28:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.597+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3d4135e80 con 0x7fd3d40b00a0 2021-11-15T19:28:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3c2ffd700 1 -- 172.21.2.137:0/2534078456 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd3cc045c40 con 0x7fd3d40b00a0 2021-11-15T19:28:44.602 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:28:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3b40535d0 msgr2=0x7fd3b4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3b40535d0 0x7fd3b4055a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fd3c4002f70 tx=0x7fd3c4006a80).stop 2021-11-15T19:28:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 msgr2=0x7fd3d4142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 0x7fd3d4142840 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fd3cc003290 tx=0x7fd3cc0090f0).stop 2021-11-15T19:28:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 shutdown_connections 2021-11-15T19:28:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3b40535d0 0x7fd3b4055a90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3d40b00a0 0x7fd3d4142840 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3d4065b10 0x7fd3d413e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 --2- 172.21.2.137:0/2534078456 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3d4065730 0x7fd3d4141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 >> 172.21.2.137:0/2534078456 conn(0x7fd3d4060290 msgr2=0x7fd3d405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 shutdown_connections 2021-11-15T19:28:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.601+0000 7fd3dc228700 1 -- 172.21.2.137:0/2534078456 wait complete. 2021-11-15T19:28:44.609 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:28:44.610 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:28:44.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 Processor -- start 2021-11-15T19:28:44.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 -- start start 2021-11-15T19:28:44.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90005fb80 0x7fa90009a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa9000b1130 0x7fa900143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa90009ab80 0x7fa900144440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa900141bc0 con 0x7fa9000b1130 2021-11-15T19:28:44.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa900097ff0 con 0x7fa90009ab80 2021-11-15T19:28:44.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa90762a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90009a1f0 con 0x7fa90005fb80 2021-11-15T19:28:44.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa90009ab80 0x7fa900144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa90009ab80 0x7fa900144440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33620/0 (socket says 172.21.2.137:33620) 2021-11-15T19:28:44.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 -- 172.21.2.137:0/3804640436 learned_addr learned my addr 172.21.2.137:0/3804640436 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 -- 172.21.2.137:0/3804640436 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90005fb80 msgr2=0x7fa90009a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 --2- 172.21.2.137:0/3804640436 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90005fb80 0x7fa90009a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 -- 172.21.2.137:0/3804640436 >> v2:172.21.2.111:3300/0 conn(0x7fa9000b1130 msgr2=0x7fa900143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:28:44.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 --2- 172.21.2.137:0/3804640436 >> v2:172.21.2.111:3300/0 conn(0x7fa9000b1130 0x7fa900143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 -- 172.21.2.137:0/3804640436 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000b1660 con 0x7fa90009ab80 2021-11-15T19:28:44.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa905bc7700 1 --2- 172.21.2.137:0/3804640436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa90009ab80 0x7fa900144440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fa8f80032f0 tx=0x7fa8f8009290).ready entity=mon.1 client_cookie=6907edc66af902dc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa8effff700 1 -- 172.21.2.137:0/3804640436 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f800ba60 con 0x7fa90009ab80 2021-11-15T19:28:44.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa8effff700 1 -- 172.21.2.137:0/3804640436 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800bbc0 con 0x7fa90009ab80 2021-11-15T19:28:44.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.657+0000 7fa8effff700 1 -- 172.21.2.137:0/3804640436 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f8010560 con 0x7fa90009ab80 2021-11-15T19:28:44.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3804640436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa90009ab80 msgr2=0x7fa900144440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- 172.21.2.137:0/3804640436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa90009ab80 0x7fa900144440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fa8f80032f0 tx=0x7fa8f8009290).stop 2021-11-15T19:28:44.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3804640436 shutdown_connections 2021-11-15T19:28:44.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- 172.21.2.137:0/3804640436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa90009ab80 0x7fa900144440 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- 172.21.2.137:0/3804640436 >> v2:172.21.2.111:3300/0 conn(0x7fa9000b1130 0x7fa900143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- 172.21.2.137:0/3804640436 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90005fb80 0x7fa90009a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3804640436 >> 172.21.2.137:0/3804640436 conn(0x7fa9000b4e60 msgr2=0x7fa9000b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3804640436 shutdown_connections 2021-11-15T19:28:44.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3804640436 wait complete. 2021-11-15T19:28:44.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 Processor -- start 2021-11-15T19:28:44.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- start start 2021-11-15T19:28:44.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa90005fb80 0x7fa9001518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90009ab80 0x7fa90013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 0x7fa90013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000645f0 con 0x7fa90005fb80 2021-11-15T19:28:44.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000add60 con 0x7fa9000b1130 2021-11-15T19:28:44.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000635c0 con 0x7fa90009ab80 2021-11-15T19:28:44.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 0x7fa90013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 0x7fa90013e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33628/0 (socket says 172.21.2.137:33628) 2021-11-15T19:28:44.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 -- 172.21.2.137:0/3130194513 learned_addr learned my addr 172.21.2.137:0/3130194513 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:28:44.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 -- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90009ab80 msgr2=0x7fa90013de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90009ab80 0x7fa90013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 -- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa90005fb80 msgr2=0x7fa9001518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa90005fb80 0x7fa9001518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 -- 172.21.2.137:0/3130194513 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009530 con 0x7fa9000b1130 2021-11-15T19:28:44.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa905bc7700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 0x7fa90013e370 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fa8f80032f0 tx=0x7fa8f8018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f801e070 con 0x7fa9000b1130 2021-11-15T19:28:44.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8018610 con 0x7fa9000b1130 2021-11-15T19:28:44.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f8018970 con 0x7fa9000b1130 2021-11-15T19:28:44.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9000ae720 con 0x7fa9000b1130 2021-11-15T19:28:44.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90013e860 con 0x7fa9000b1130 2021-11-15T19:28:44.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa900063430 con 0x7fa9000b1130 2021-11-15T19:28:44.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.661+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8f8018ad0 con 0x7fa9000b1130 2021-11-15T19:28:44.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.665+0000 7fa8ee7fc700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8e0053610 0x7fa8e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:28:44.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.665+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa8f8070bc0 con 0x7fa9000b1130 2021-11-15T19:28:44.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.665+0000 7fa9053c6700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8e0053610 0x7fa8e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:28:44.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.665+0000 7fa9053c6700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8e0053610 0x7fa8e0055ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa8f0002f70 tx=0x7fa8f0006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:28:44.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.665+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8f8047b90 con 0x7fa9000b1130 2021-11-15T19:28:44.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.769+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9000573d0 con 0x7fa9000b1130 2021-11-15T19:28:44.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa8ee7fc700 1 -- 172.21.2.137:0/3130194513 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fa8f804b1b0 con 0x7fa9000b1130 2021-11-15T19:28:44.774 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:28:44.775 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:28:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8e0053610 msgr2=0x7fa8e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8e0053610 0x7fa8e0055ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa8f0002f70 tx=0x7fa8f0006a80).stop 2021-11-15T19:28:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 msgr2=0x7fa90013e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:28:44.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 0x7fa90013e370 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fa8f80032f0 tx=0x7fa8f8018000).stop 2021-11-15T19:28:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 shutdown_connections 2021-11-15T19:28:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa8e0053610 0x7fa8e0055ad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9000b1130 0x7fa90013e370 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:28:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa90009ab80 0x7fa90013de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 --2- 172.21.2.137:0/3130194513 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa90005fb80 0x7fa9001518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:28:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 >> 172.21.2.137:0/3130194513 conn(0x7fa9000b4e60 msgr2=0x7fa900140440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:28:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 shutdown_connections 2021-11-15T19:28:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:28:44.773+0000 7fa90762a700 1 -- 172.21.2.137:0/3130194513 wait complete. 2021-11-15T19:28:44.778 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:28:44.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:28:41.474267+0000', 'modified': '2021-11-15T19:28:42.480660+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5191}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5191': {'gid': 5191, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/105473297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 105473297}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 105473297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:28:44.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:28:44.984 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:28:45.048 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5191,"want_state":"up:active","state":"up:active","rank_uptime":3.5660293699999999,"mdsmap_epoch":15,"osdmap_epoch":42,"osdmap_epoch_barrier":41,"uptime":7.7709228640000001} 2021-11-15T19:28:45.049 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5191, "mdsmap_epoch": 15, "osdmap_epoch": 42, "osdmap_epoch_barrier": 41, "rank_uptime": 3.56602937, "state": "up:active", "uptime": 7.770922864, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:28:45.049 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:28:45.049 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:28:45.050 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:28:45.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:45.051 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:45.061 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:28:45.073 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:28:45.073 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:28:45.125 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:28:45.125 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:28:45.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:45.127 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:28:45.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:28:45.132 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:45.135 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:28:45.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:28:45.145 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:28:45.150 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:28:45.151 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:28:45.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:45.152 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:28:45.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:28:45.173+0000 7f825ae23080 -1 init, newargv = 0x55a0c0e469b0 newargc=9 2021-11-15T19:28:45.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14231]: starting ceph client 2021-11-15T19:28:45.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14231]: starting fuse 2021-11-15T19:28:46.279 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:28:46.291 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:28:46.291 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:28:46.340 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:28:46.341 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:28:46.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:46.342 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:28:46.347 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:28:46.347 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:28:46.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:46.348 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:28:46.349 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:28:46.349 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:28:46.349 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:28:46.350 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:28:46.350 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.350 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:28:46.351 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:28:46.351 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:28:46.352 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.352 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:28:46.352 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:28:46.353 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:28:46.353 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:28:46.354 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.354 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:28:46.354 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:28:46.355 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:28:46.355 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:28:46.356 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:28:46.356 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.356 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:28:46.357 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:28:46.412 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14231.asok 2021-11-15T19:28:46.415 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14231.asok 2021-11-15T19:28:46.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:46.416 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14231.asok status 2021-11-15T19:28:46.463 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:28:46.464 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:28:46.464 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:28:46.464 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:28:46.465 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:28:46.465 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:28:46.465 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:28:46.465 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14231", 2021-11-15T19:28:46.466 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:28:46.466 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:28:46.466 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:28:46.466 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:28:46.466 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 5362, 2021-11-15T19:28:46.467 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:28:46.467 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:28:46.467 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:28:46.467 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 5362 2021-11-15T19:28:46.468 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:28:46.468 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:28:46.468 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:28:46.468 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:28:46.469 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1025678652 2021-11-15T19:28:46.469 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:28:46.469 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:28:46.469 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:28:46.469 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:28:46.470 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:28:46.470 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1025678652 2021-11-15T19:28:46.470 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:28:46.470 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.5362 172.21.2.131:0/1025678652", 2021-11-15T19:28:46.471 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/1025678652", 2021-11-15T19:28:46.471 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:28:46.471 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 15, 2021-11-15T19:28:46.471 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 42, 2021-11-15T19:28:46.471 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:28:46.472 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:28:46.472 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:28:46.472 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:28:46.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:46.474 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:46.474 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:46.480 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:28:46.480 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:28:46.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:46.481 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:46.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:28:46.530 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:28:46.531 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:28:46.536 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:28:46.537 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:28:46.537 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:28:46.538 DEBUG:teuthology.orchestra.run.gibba031:> import sys 2021-11-15T19:28:46.538 DEBUG:teuthology.orchestra.run.gibba031:> import time 2021-11-15T19:28:46.539 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:28:46.539 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.539 DEBUG:teuthology.orchestra.run.gibba031:> n = 1000 2021-11-15T19:28:46.540 DEBUG:teuthology.orchestra.run.gibba031:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T19:28:46.540 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.540 DEBUG:teuthology.orchestra.run.gibba031:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T19:28:46.541 DEBUG:teuthology.orchestra.run.gibba031:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T19:28:46.541 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:28:46.541 DEBUG:teuthology.orchestra.run.gibba031:> for i in range(0, n): 2021-11-15T19:28:46.542 DEBUG:teuthology.orchestra.run.gibba031:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T19:28:46.542 DEBUG:teuthology.orchestra.run.gibba031:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T19:28:46.542 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content'"'"') 2021-11-15T19:28:46.543 DEBUG:teuthology.orchestra.run.gibba031:> if True: 2021-11-15T19:28:46.543 DEBUG:teuthology.orchestra.run.gibba031:> f.flush() 2021-11-15T19:28:46.543 DEBUG:teuthology.orchestra.run.gibba031:> os.fsync(f.fileno()) 2021-11-15T19:28:46.544 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:28:53.774 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:53.777 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:53.781 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:53.784 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:28:53.787 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:00.832 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:29:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 Processor -- start 2021-11-15T19:29:00.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- start start 2021-11-15T19:29:00.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 0x7fb368142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:00.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb3680b6830 0x7fb3681433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680b63b0 con 0x7fb3680b5fd0 2021-11-15T19:29:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb368147070 con 0x7fb3680b6830 2021-11-15T19:29:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368146dd0 con 0x7fb36813ce00 2021-11-15T19:29:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb3680b6830 0x7fb3681433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb3680b6830 0x7fb3681433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33638/0 (socket says 172.21.2.137:33638) 2021-11-15T19:29:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 -- 172.21.2.137:0/1283705869 learned_addr learned my addr 172.21.2.137:0/1283705869 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 -- 172.21.2.137:0/1283705869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 msgr2=0x7fb368142ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 --2- 172.21.2.137:0/1283705869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 0x7fb368142ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 -- 172.21.2.137:0/1283705869 >> v1:172.21.2.111:6789/0 conn(0x7fb3680b5fd0 legacy=0x7fb36813c6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 -- 172.21.2.137:0/1283705869 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb368146af0 con 0x7fb3680b6830 2021-11-15T19:29:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb367fff700 1 --2- 172.21.2.137:0/1283705869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3681433c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fb36813d200 tx=0x7fb360009290).ready entity=mon.1 client_cookie=cceaf7407874dcd4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb3667fc700 1 -- 172.21.2.137:0/1283705869 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb36000b860 con 0x7fb3680b6830 2021-11-15T19:29:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb3667fc700 1 -- 172.21.2.137:0/1283705869 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000b9c0 con 0x7fb3680b6830 2021-11-15T19:29:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb3667fc700 1 -- 172.21.2.137:0/1283705869 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb36000bb70 con 0x7fb3680b6830 2021-11-15T19:29:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- 172.21.2.137:0/1283705869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 msgr2=0x7fb3681433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 --2- 172.21.2.137:0/1283705869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3681433c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fb36813d200 tx=0x7fb360009290).stop 2021-11-15T19:29:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- 172.21.2.137:0/1283705869 shutdown_connections 2021-11-15T19:29:00.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 --2- 172.21.2.137:0/1283705869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3681433c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 --2- 172.21.2.137:0/1283705869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 0x7fb368142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- 172.21.2.137:0/1283705869 >> 172.21.2.137:0/1283705869 conn(0x7fb3680624b0 msgr2=0x7fb368062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- 172.21.2.137:0/1283705869 shutdown_connections 2021-11-15T19:29:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.897+0000 7fb36dba4700 1 -- 172.21.2.137:0/1283705869 wait complete. 2021-11-15T19:29:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 Processor -- start 2021-11-15T19:29:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- start start 2021-11-15T19:29:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3680b5fd0 0x7fb36813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3680ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 0x7fb368140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680add90 con 0x7fb3680b5fd0 2021-11-15T19:29:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36813df70 con 0x7fb3680b6830 2021-11-15T19:29:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36813e210 con 0x7fb36813ce00 2021-11-15T19:29:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3680ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3680ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33644/0 (socket says 172.21.2.137:33644) 2021-11-15T19:29:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 -- 172.21.2.137:0/2610842306 learned_addr learned my addr 172.21.2.137:0/2610842306 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 -- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 msgr2=0x7fb368140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 0x7fb368140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 -- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3680b5fd0 msgr2=0x7fb36813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3680b5fd0 0x7fb36813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 -- 172.21.2.137:0/2610842306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360009530 con 0x7fb3680b6830 2021-11-15T19:29:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb366ffd700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3680ad8a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb35c002fb0 tx=0x7fb35c006e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35c013460 con 0x7fb3680b6830 2021-11-15T19:29:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0135c0 con 0x7fb3680b6830 2021-11-15T19:29:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368140600 con 0x7fb3680b6830 2021-11-15T19:29:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35c013920 con 0x7fb3680b6830 2021-11-15T19:29:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36813ef40 con 0x7fb3680b6830 2021-11-15T19:29:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb368140790 con 0x7fb3680b6830 2021-11-15T19:29:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb35c00f070 con 0x7fb3680b6830 2021-11-15T19:29:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb364ff9700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb348053660 0x7fb348055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb35c06b3c0 con 0x7fb3680b6830 2021-11-15T19:29:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.901+0000 7fb3677fe700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb348053660 0x7fb348055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.905+0000 7fb3677fe700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb348053660 0x7fb348055b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fb358002f40 tx=0x7fb358006900).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:00.905+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb35c042520 con 0x7fb3680b6830 2021-11-15T19:29:01.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.013+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3680afff0 con 0x7fb3680b6830 2021-11-15T19:29:01.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.013+0000 7fb364ff9700 1 -- 172.21.2.137:0/2610842306 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fb35c045b40 con 0x7fb3680b6830 2021-11-15T19:29:01.021 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:29:01.021 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:29:01.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb348053660 msgr2=0x7fb348055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb348053660 0x7fb348055b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fb358002f40 tx=0x7fb358006900).stop 2021-11-15T19:29:01.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 msgr2=0x7fb3680ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3680ad8a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb35c002fb0 tx=0x7fb35c006e10).stop 2021-11-15T19:29:01.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 shutdown_connections 2021-11-15T19:29:01.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb348053660 0x7fb348055b20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb36813ce00 0x7fb368140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3680b6830 0x7fb3680ad8a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 --2- 172.21.2.137:0/2610842306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3680b5fd0 0x7fb36813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 >> 172.21.2.137:0/2610842306 conn(0x7fb3680624b0 msgr2=0x7fb3681435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 shutdown_connections 2021-11-15T19:29:01.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.017+0000 7fb36dba4700 1 -- 172.21.2.137:0/2610842306 wait complete. 2021-11-15T19:29:01.025 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:29:01.029 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-15T19:29:01.087 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T19:29:01.087 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T19:29:01.088 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:29:01.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 Processor -- start 2021-11-15T19:29:01.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- start start 2021-11-15T19:29:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff600b3140 0x7eff6009cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff6009ab00 0x7eff60143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6009d190 con 0x7eff6009c8c0 2021-11-15T19:29:01.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6005fe40 con 0x7eff6009ab00 2021-11-15T19:29:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60099790 con 0x7eff600b3140 2021-11-15T19:29:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff6009ab00 0x7eff60143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5effd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7eff6009c8c0 0x7eff6005f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52430/0 (socket says 172.21.2.137:52430) 2021-11-15T19:29:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5effd700 1 -- 172.21.2.137:0/307642367 learned_addr learned my addr 172.21.2.137:0/307642367 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:01.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5dffb700 1 -- 172.21.2.137:0/307642367 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121349844 0 0) 0x7eff6009d190 con 0x7eff6009c8c0 2021-11-15T19:29:01.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5dffb700 1 -- 172.21.2.137:0/307642367 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff40003260 con 0x7eff6009c8c0 2021-11-15T19:29:01.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5f7fe700 1 -- 172.21.2.137:0/307642367 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff600b3140 msgr2=0x7eff6009cca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:01.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5f7fe700 1 --2- 172.21.2.137:0/307642367 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff600b3140 0x7eff6009cca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5f7fe700 1 -- 172.21.2.137:0/307642367 >> v1:172.21.2.137:6789/0 conn(0x7eff6009c8c0 legacy=0x7eff6005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5f7fe700 1 -- 172.21.2.137:0/307642367 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600b2940 con 0x7eff6009ab00 2021-11-15T19:29:01.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5f7fe700 1 --2- 172.21.2.137:0/307642367 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff6009ab00 0x7eff60143260 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7eff580032f0 tx=0x7eff580091d0).ready entity=mon.1 client_cookie=4f5fa6b263f4df1d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5dffb700 1 -- 172.21.2.137:0/307642367 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5800b6c0 con 0x7eff6009ab00 2021-11-15T19:29:01.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5dffb700 1 -- 172.21.2.137:0/307642367 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5800b820 con 0x7eff6009ab00 2021-11-15T19:29:01.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff5dffb700 1 -- 172.21.2.137:0/307642367 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5800b9d0 con 0x7eff6009ab00 2021-11-15T19:29:01.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- 172.21.2.137:0/307642367 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff6009ab00 msgr2=0x7eff60143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- 172.21.2.137:0/307642367 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff6009ab00 0x7eff60143260 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7eff580032f0 tx=0x7eff580091d0).stop 2021-11-15T19:29:01.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- 172.21.2.137:0/307642367 shutdown_connections 2021-11-15T19:29:01.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- 172.21.2.137:0/307642367 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff6009ab00 0x7eff60143260 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- 172.21.2.137:0/307642367 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff600b3140 0x7eff6009cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- 172.21.2.137:0/307642367 >> 172.21.2.137:0/307642367 conn(0x7eff600b45b0 msgr2=0x7eff6005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- 172.21.2.137:0/307642367 shutdown_connections 2021-11-15T19:29:01.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- 172.21.2.137:0/307642367 wait complete. 2021-11-15T19:29:01.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 Processor -- start 2021-11-15T19:29:01.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- start start 2021-11-15T19:29:01.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff6009ab00 0x7eff60146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff6009c8c0 0x7eff60153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 0x7eff60153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600add90 con 0x7eff6009ab00 2021-11-15T19:29:01.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600ae640 con 0x7eff600b3140 2021-11-15T19:29:01.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.133+0000 7eff65507700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff600ae100 con 0x7eff6009c8c0 2021-11-15T19:29:01.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 0x7eff60153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 0x7eff60153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33656/0 (socket says 172.21.2.137:33656) 2021-11-15T19:29:01.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 -- 172.21.2.137:0/2179714100 learned_addr learned my addr 172.21.2.137:0/2179714100 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 -- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff6009c8c0 msgr2=0x7eff60153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff6009c8c0 0x7eff60153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 -- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff6009ab00 msgr2=0x7eff60146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff6009ab00 0x7eff60146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 -- 172.21.2.137:0/2179714100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58009470 con 0x7eff600b3140 2021-11-15T19:29:01.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5f7fe700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 0x7eff60153650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7eff600aded0 tx=0x7eff58016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff58011e90 con 0x7eff600b3140 2021-11-15T19:29:01.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58021440 con 0x7eff600b3140 2021-11-15T19:29:01.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff600ae3a0 con 0x7eff600b3140 2021-11-15T19:29:01.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff60153d60 con 0x7eff600b3140 2021-11-15T19:29:01.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff580217a0 con 0x7eff600b3140 2021-11-15T19:29:01.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff60152ea0 con 0x7eff600b3140 2021-11-15T19:29:01.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff5800f070 con 0x7eff600b3140 2021-11-15T19:29:01.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff57fff700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff440536f0 0x7eff44055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7eff5806cf30 con 0x7eff600b3140 2021-11-15T19:29:01.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5effd700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff440536f0 0x7eff44055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.137+0000 7eff5effd700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff440536f0 0x7eff44055bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7eff48001110 tx=0x7eff480076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.141+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff60152ea0 con 0x7eff600b3140 2021-11-15T19:29:01.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.249+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff60152ea0 con 0x7eff600b3140 2021-11-15T19:29:01.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.249+0000 7eff57fff700 1 -- 172.21.2.137:0/2179714100 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7eff58015870 con 0x7eff600b3140 2021-11-15T19:29:01.256 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:29:01.256 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:29:01.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff440536f0 msgr2=0x7eff44055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff440536f0 0x7eff44055bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7eff48001110 tx=0x7eff480076c0).stop 2021-11-15T19:29:01.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 msgr2=0x7eff60153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 0x7eff60153650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7eff600aded0 tx=0x7eff58016000).stop 2021-11-15T19:29:01.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 shutdown_connections 2021-11-15T19:29:01.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff440536f0 0x7eff44055bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff600b3140 0x7eff60153650 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff6009c8c0 0x7eff60153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 --2- 172.21.2.137:0/2179714100 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff6009ab00 0x7eff60146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 >> 172.21.2.137:0/2179714100 conn(0x7eff600b45b0 msgr2=0x7eff600b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 shutdown_connections 2021-11-15T19:29:01.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.253+0000 7eff65507700 1 -- 172.21.2.137:0/2179714100 wait complete. 2021-11-15T19:29:01.260 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:29:01.264 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T19:29:01.320 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T19:29:01.320 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T19:29:01.321 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:29:01.335 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:29:01.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 Processor -- start 2021-11-15T19:29:01.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- start start 2021-11-15T19:29:01.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2f6c0b2d50 0x7f2f6c05f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f2f6c05fed0 0x7f2f6c060380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c097c50 con 0x7f2f6c0ac3c0 2021-11-15T19:29:01.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c0ac120 con 0x7f2f6c05fed0 2021-11-15T19:29:01.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c0979b0 con 0x7f2f6c0b2d50 2021-11-15T19:29:01.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6affd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f2f6c0ac3c0 0x7f2f6c0ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52444/0 (socket says 172.21.2.137:52444) 2021-11-15T19:29:01.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6affd700 1 -- 172.21.2.137:0/2222792698 learned_addr learned my addr 172.21.2.137:0/2222792698 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:01.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6a7fc700 1 --2- 172.21.2.137:0/2222792698 >> v2:172.21.2.137:3300/0 conn(0x7f2f6c0b2d50 0x7f2f6c05f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6a7fc700 1 -- 172.21.2.137:0/2222792698 >> v2:172.21.2.111:3300/0 conn(0x7f2f6c05fed0 msgr2=0x7f2f6c060380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6a7fc700 1 --2- 172.21.2.137:0/2222792698 >> v2:172.21.2.111:3300/0 conn(0x7f2f6c05fed0 0x7f2f6c060380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6a7fc700 1 -- 172.21.2.137:0/2222792698 >> v1:172.21.2.137:6789/0 conn(0x7f2f6c0ac3c0 legacy=0x7f2f6c0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6a7fc700 1 -- 172.21.2.137:0/2222792698 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0aceb0 con 0x7f2f6c0b2d50 2021-11-15T19:29:01.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f6a7fc700 1 --2- 172.21.2.137:0/2222792698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c0b2d50 0x7f2f6c05f9e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2f54002f70 tx=0x7f2f54006df0).ready entity=mon.1 client_cookie=148b7d47d16e658a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f69ffb700 1 -- 172.21.2.137:0/2222792698 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5400d5c0 con 0x7f2f6c0b2d50 2021-11-15T19:29:01.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f69ffb700 1 -- 172.21.2.137:0/2222792698 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54000e90 con 0x7f2f6c0b2d50 2021-11-15T19:29:01.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f69ffb700 1 -- 172.21.2.137:0/2222792698 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5400d910 con 0x7f2f6c0b2d50 2021-11-15T19:29:01.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- 172.21.2.137:0/2222792698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c0b2d50 msgr2=0x7f2f6c05f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 --2- 172.21.2.137:0/2222792698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c0b2d50 0x7f2f6c05f9e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2f54002f70 tx=0x7f2f54006df0).stop 2021-11-15T19:29:01.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- 172.21.2.137:0/2222792698 shutdown_connections 2021-11-15T19:29:01.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 --2- 172.21.2.137:0/2222792698 >> v2:172.21.2.111:3300/0 conn(0x7f2f6c05fed0 0x7f2f6c060380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 --2- 172.21.2.137:0/2222792698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c0b2d50 0x7f2f6c05f9e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- 172.21.2.137:0/2222792698 >> 172.21.2.137:0/2222792698 conn(0x7f2f6c0b7070 msgr2=0x7f2f6c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- 172.21.2.137:0/2222792698 shutdown_connections 2021-11-15T19:29:01.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.381+0000 7f2f71461700 1 -- 172.21.2.137:0/2222792698 wait complete. 2021-11-15T19:29:01.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 Processor -- start 2021-11-15T19:29:01.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- start start 2021-11-15T19:29:01.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 0x7f2f6c09c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f6c0ac3c0 0x7f2f6c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f6c0afcc0 0x7f2f6c13f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c09b710 con 0x7f2f6c0afcc0 2021-11-15T19:29:01.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c09b1d0 con 0x7f2f6c05fed0 2021-11-15T19:29:01.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c09b470 con 0x7f2f6c0ac3c0 2021-11-15T19:29:01.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 0x7f2f6c09c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 0x7f2f6c09c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33668/0 (socket says 172.21.2.137:33668) 2021-11-15T19:29:01.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 -- 172.21.2.137:0/3030050807 learned_addr learned my addr 172.21.2.137:0/3030050807 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 -- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f6c0ac3c0 msgr2=0x7f2f6c0b0fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:29:01.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f6c0ac3c0 0x7f2f6c0b0fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 -- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f6c0afcc0 msgr2=0x7f2f6c13f290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:29:01.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f6c0afcc0 0x7f2f6c13f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 -- 172.21.2.137:0/3030050807 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5400b180 con 0x7f2f6c05fed0 2021-11-15T19:29:01.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6affd700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 0x7f2f6c09c330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f2f6c0b4e60 tx=0x7f2f5c007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c0074d0 con 0x7f2f6c05fed0 2021-11-15T19:29:01.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00ce50 con 0x7f2f6c05fed0 2021-11-15T19:29:01.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c005800 con 0x7f2f6c05fed0 2021-11-15T19:29:01.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c09ae50 con 0x7f2f6c05fed0 2021-11-15T19:29:01.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c09bd90 con 0x7f2f6c05fed0 2021-11-15T19:29:01.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c067c60 con 0x7f2f6c05fed0 2021-11-15T19:29:01.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f5c021070 con 0x7f2f6c05fed0 2021-11-15T19:29:01.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f63fff700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2f500535b0 0x7f2f50055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f2f5c06f580 con 0x7f2f6c05fed0 2021-11-15T19:29:01.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.385+0000 7f2f6a7fc700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2f500535b0 0x7f2f50055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.389+0000 7f2f6a7fc700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2f500535b0 0x7f2f50055a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f2f54002f70 tx=0x7f2f54014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.389+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f5c0466e0 con 0x7f2f6c05fed0 2021-11-15T19:29:01.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f6c05f730 con 0x7f2f6c05fed0 2021-11-15T19:29:01.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f63fff700 1 -- 172.21.2.137:0/3030050807 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f2f5c049d00 con 0x7f2f6c05fed0 2021-11-15T19:29:01.504 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:29:01.504 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:29:01.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2f500535b0 msgr2=0x7f2f50055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2f500535b0 0x7f2f50055a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f2f54002f70 tx=0x7f2f54014000).stop 2021-11-15T19:29:01.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 msgr2=0x7f2f6c09c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 0x7f2f6c09c330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f2f6c0b4e60 tx=0x7f2f5c007ca0).stop 2021-11-15T19:29:01.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 shutdown_connections 2021-11-15T19:29:01.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2f500535b0 0x7f2f50055a70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f6c0afcc0 0x7f2f6c13f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f6c0ac3c0 0x7f2f6c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 --2- 172.21.2.137:0/3030050807 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f6c05fed0 0x7f2f6c09c330 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 >> 172.21.2.137:0/3030050807 conn(0x7f2f6c0b7070 msgr2=0x7f2f6c0b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 shutdown_connections 2021-11-15T19:29:01.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.497+0000 7f2f71461700 1 -- 172.21.2.137:0/3030050807 wait complete. 2021-11-15T19:29:01.508 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:29:01.511 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-11-15T19:29:01.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe202cbf700 1 Processor -- start 2021-11-15T19:29:01.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe202cbf700 1 -- start start 2021-11-15T19:29:01.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe202cbf700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe1fc0b0550 0x7fe1fc14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe202cbf700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc05cb50 con 0x7fe1fc14aaa0 2021-11-15T19:29:01.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe202cbf700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc0ad030 con 0x7fe1fc05c770 2021-11-15T19:29:01.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe202cbf700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc0b1650 con 0x7fe1fc0b0550 2021-11-15T19:29:01.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe1fc05c770 0x7fe1fc0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52458/0 (socket says 172.21.2.137:52458) 2021-11-15T19:29:01.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 -- 172.21.2.137:0/2744297272 learned_addr learned my addr 172.21.2.137:0/2744297272 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:01.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460080213 0 0) 0x7fe1fc0ad030 con 0x7fe1fc05c770 2021-11-15T19:29:01.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1dc003260 con 0x7fe1fc05c770 2021-11-15T19:29:01.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2203925415 0 0) 0x7fe1dc003260 con 0x7fe1fc05c770 2021-11-15T19:29:01.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 >> v2:172.21.2.111:3300/0 conn(0x7fe1fc0b0550 msgr2=0x7fe1fc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 --2- 172.21.2.137:0/2744297272 >> v2:172.21.2.111:3300/0 conn(0x7fe1fc0b0550 0x7fe1fc14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 >> v1:172.21.2.111:6789/0 conn(0x7fe1fc14aaa0 legacy=0x7fe1fc140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0ad2d0 con 0x7fe1fc05c770 2021-11-15T19:29:01.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe1e4001660 con 0x7fe1fc05c770 2021-11-15T19:29:01.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 >> v1:172.21.2.137:6789/0 conn(0x7fe1fc05c770 legacy=0x7fe1fc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1dc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1dc004500 0x7fe1dc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1dc004f90 0x7fe1dc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0b1650 con 0x7fe1dc004500 2021-11-15T19:29:01.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc00be80 con 0x7fe1dc003750 2021-11-15T19:29:01.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc00c040 con 0x7fe1dc004f90 2021-11-15T19:29:01.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1dc003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1dc004500 0x7fe1dc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 -- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1dc004f90 msgr2=0x7fe1dc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1dc004f90 0x7fe1dc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 -- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1dc004500 msgr2=0x7fe1dc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1dc004500 0x7fe1dc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 -- 172.21.2.137:0/2744297272 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc003260 con 0x7fe1dc003750 2021-11-15T19:29:01.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1dc004500 0x7fe1dc004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:29:01.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe20125c700 1 -- 172.21.2.137:0/2744297272 reap_dead start 2021-11-15T19:29:01.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe200a5b700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1dc003b50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fe1fc0aee10 tx=0x7fe1fc146fe0).ready entity=mon.1 client_cookie=d68ca051fab3ba44 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e40071a0 con 0x7fe1dc003750 2021-11-15T19:29:01.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4007300 con 0x7fe1dc003750 2021-11-15T19:29:01.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.557+0000 7fe1fb7fe700 1 -- 172.21.2.137:0/2744297272 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e400c8f0 con 0x7fe1dc003750 2021-11-15T19:29:01.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/2744297272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 msgr2=0x7fe1dc003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1dc003b50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fe1fc0aee10 tx=0x7fe1fc146fe0).stop 2021-11-15T19:29:01.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/2744297272 shutdown_connections 2021-11-15T19:29:01.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 --2- 172.21.2.137:0/2744297272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1dc003b50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/2744297272 >> 172.21.2.137:0/2744297272 conn(0x7fe1fc0631e0 msgr2=0x7fe1fc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/2744297272 shutdown_connections 2021-11-15T19:29:01.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/2744297272 wait complete. 2021-11-15T19:29:01.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 Processor -- start 2021-11-15T19:29:01.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- start start 2021-11-15T19:29:01.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1fc159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1fc1470e0 0x7fe1fc142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1fc142b70 0x7fe1fc143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15a4e0 con 0x7fe1fc142b70 2021-11-15T19:29:01.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15a240 con 0x7fe1dc003750 2021-11-15T19:29:01.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc1444f0 con 0x7fe1fc1470e0 2021-11-15T19:29:01.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1fc159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1fc159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33688/0 (socket says 172.21.2.137:33688) 2021-11-15T19:29:01.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 -- 172.21.2.137:0/3978122233 learned_addr learned my addr 172.21.2.137:0/3978122233 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe20125c700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1fc142b70 0x7fe1fc143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 -- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1fc1470e0 msgr2=0x7fe1fc142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1fc1470e0 0x7fe1fc142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 -- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1fc142b70 msgr2=0x7fe1fc143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1fc142b70 0x7fe1fc143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 -- 172.21.2.137:0/3978122233 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc145410 con 0x7fe1dc003750 2021-11-15T19:29:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe200a5b700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1fc159b80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fe1fc0aee10 tx=0x7fe1e4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe1f9ffb700 1 -- 172.21.2.137:0/3978122233 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e400ce10 con 0x7fe1dc003750 2021-11-15T19:29:01.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe1f9ffb700 1 -- 172.21.2.137:0/3978122233 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4004520 con 0x7fe1dc003750 2021-11-15T19:29:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc147540 con 0x7fe1dc003750 2021-11-15T19:29:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe1f9ffb700 1 -- 172.21.2.137:0/3978122233 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e4004880 con 0x7fe1dc003750 2021-11-15T19:29:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc145030 con 0x7fe1dc003750 2021-11-15T19:29:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe1f9ffb700 1 -- 172.21.2.137:0/3978122233 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe1e4026070 con 0x7fe1dc003750 2021-11-15T19:29:01.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe1f9ffb700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1e00536d0 0x7fe1e0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.561+0000 7fe1f9ffb700 1 -- 172.21.2.137:0/3978122233 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe1e406c030 con 0x7fe1dc003750 2021-11-15T19:29:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1e00536d0 0x7fe1e0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 Processor -- start 2021-11-15T19:29:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- start start 2021-11-15T19:29:01.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ebbc0 0x13235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 0x12ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12e7890 0x12e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x1248d50 con 0x12ebbc0 2021-11-15T19:29:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x125c4b0 con 0x12ed160 2021-11-15T19:29:01.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x123cc20 con 0x12e7890 2021-11-15T19:29:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 0x12ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 0x12ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33700/0 (socket says 172.21.2.137:33700) 2021-11-15T19:29:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 -- 172.21.2.137:0/2392852055 learned_addr learned my addr 172.21.2.137:0/2392852055 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1e00536d0 0x7fe1e0055b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe1ec002f10 tx=0x7fe1ec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 -- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12e7890 msgr2=0x12e7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12e7890 0x12e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe200a5b700 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ebbc0 0x13235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12e7890 0x12e7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 -- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ebbc0 msgr2=0x13235d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ebbc0 0x13235d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 -- 172.21.2.137:0/2392852055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1294cb0 con 0x12ed160 2021-11-15T19:29:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe200a5b700 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ebbc0 0x13235d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:29:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 0x12ed5c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x1323310 tx=0x7fe1ec012000).ready entity=mon.1 client_cookie=1945f3a119e42b1d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe202cbf700 1 -- 172.21.2.137:0/2392852055 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1ec019070 con 0x12ed160 2021-11-15T19:29:01.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe202cbf700 1 -- 172.21.2.137:0/2392852055 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec012820 con 0x12ed160 2021-11-15T19:29:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe202cbf700 1 -- 172.21.2.137:0/2392852055 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1ec012b80 con 0x12ed160 2021-11-15T19:29:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- 172.21.2.137:0/2392852055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 msgr2=0x12ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 0x12ed5c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x1323310 tx=0x7fe1ec012000).stop 2021-11-15T19:29:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- 172.21.2.137:0/2392852055 shutdown_connections 2021-11-15T19:29:01.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12e7890 0x12e7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ed160 0x12ed5c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2392852055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ebbc0 0x13235d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- 172.21.2.137:0/2392852055 >> 172.21.2.137:0/2392852055 conn(0x12e9640 msgr2=0x12ea480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- 172.21.2.137:0/2392852055 shutdown_connections 2021-11-15T19:29:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- 172.21.2.137:0/2392852055 wait complete. 2021-11-15T19:29:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- start start 2021-11-15T19:29:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 Processor -- start 2021-11-15T19:29:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 0x12f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x1331220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x1323a70 con 0x12ed160 2021-11-15T19:29:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x12f3800 con 0x12f3360 2021-11-15T19:29:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x12f3aa0 con 0x12ebbc0 2021-11-15T19:29:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20cf10740 10 client.0 ll_register_callbacks cb 0x12502a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:29:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x1331220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x1331220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33706/0 (socket says 172.21.2.137:33706) 2021-11-15T19:29:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 -- 172.21.2.137:0/1538685783 learned_addr learned my addr 172.21.2.137:0/1538685783 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 -- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 msgr2=0x12f78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 0x12f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 -- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 msgr2=0x12e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 -- 172.21.2.137:0/1538685783 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec014610 con 0x12f3360 2021-11-15T19:29:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe20125c700 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x1331220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fe1e4001110 tx=0x7fe1f4009040).ready entity=mon.1 client_cookie=9fcc2ebb2cf1e428 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.565+0000 7fe1db7fe700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:29:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 1 -- 172.21.2.137:0/1538685783 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f400c040 con 0x12f3360 2021-11-15T19:29:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 1 -- 172.21.2.137:0/1538685783 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe1f400de00 con 0x12f3360 2021-11-15T19:29:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1252570 con 0x12f3360 2021-11-15T19:29:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 1 -- 172.21.2.137:0/1538685783 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1f4007170 con 0x12f3360 2021-11-15T19:29:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 10 client.5398 fetch_fsmap learned FSMap version 15 2021-11-15T19:29:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x124be50 con 0x12f3360 2021-11-15T19:29:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 1 -- 172.21.2.137:0/1538685783 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1252570 con 0x12f3360 2021-11-15T19:29:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 1 -- 172.21.2.137:0/1538685783 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 15) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fe1f4004850 con 0x12f3360 2021-11-15T19:29:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 10 client.5398 fetch_fsmap finished waiting for FSMap version 15 2021-11-15T19:29:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 10 client.5398 resolve_mds: resolved ID 'a' to GID 5191 2021-11-15T19:29:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 20 client.5398 populate_metadata read hostname 'gibba037' 2021-11-15T19:29:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f2600 0x12f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 4 client.5398 mds_command: new command op to 5191 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T19:29:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 --> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x124a8e0 con 0x12f2600 2021-11-15T19:29:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe200a5b700 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f2600 0x12f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 10 client.5398 ms_handle_connect on v2:172.21.2.137:6832/105473297 2021-11-15T19:29:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe200a5b700 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f2600 0x12f29e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b9da60e6f8b9039a server_cookie=2257e82669353382 in_seq=0 out_seq=0 2021-11-15T19:29:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 1 -- 172.21.2.137:0/1538685783 <== mds.0 v2:172.21.2.137:6832/105473297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x124a8e0 con 0x12f2600 2021-11-15T19:29:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 10 client.5398 handle_command_reply: tid=0 2021-11-15T19:29:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 client.5398 shutdown 2021-11-15T19:29:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 msgr2=0x1331220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x1331220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fe1e4001110 tx=0x7fe1f4009040).stop 2021-11-15T19:29:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 shutdown_connections 2021-11-15T19:29:01.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x1331220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f2600 0x12f29e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe1db7fe700 0 client.5398 ms_handle_reset on v2:172.21.2.137:6832/105473297 2021-11-15T19:29:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1538685783 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 0x12f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 >> 172.21.2.137:0/1538685783 conn(0x12e7890 msgr2=0x12ea480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 shutdown_connections 2021-11-15T19:29:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 1 -- 172.21.2.137:0/1538685783 wait complete. 2021-11-15T19:29:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.569+0000 7fe20cf10740 20 client.5398 trim_cache size 0 max 16384 2021-11-15T19:29:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 Processor -- start 2021-11-15T19:29:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- start start 2021-11-15T19:29:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 0x132fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x12e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x126b870 con 0x12ed160 2021-11-15T19:29:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x124a8e0 con 0x12f3360 2021-11-15T19:29:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x13224a0 con 0x12ebbc0 2021-11-15T19:29:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x12e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x12e8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33714/0 (socket says 172.21.2.137:33714) 2021-11-15T19:29:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 -- 172.21.2.137:0/2811960912 learned_addr learned my addr 172.21.2.137:0/2811960912 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 -- 172.21.2.137:0/2811960912 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 msgr2=0x132fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 0x132fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 -- 172.21.2.137:0/2811960912 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 msgr2=0x12e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 -- 172.21.2.137:0/2811960912 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1254750 con 0x12f3360 2021-11-15T19:29:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20125c700 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x12e8f00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x1252680 tx=0x7fe1f401d000).ready entity=mon.1 client_cookie=96ca6420a7c03ac2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe1f1ffb700 1 -- 172.21.2.137:0/2811960912 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f400dc10 con 0x12f3360 2021-11-15T19:29:01.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe1f1ffb700 1 -- 172.21.2.137:0/2811960912 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400dd70 con 0x12f3360 2021-11-15T19:29:01.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe1f1ffb700 1 -- 172.21.2.137:0/2811960912 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f400dee0 con 0x12f3360 2021-11-15T19:29:01.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- 172.21.2.137:0/2811960912 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 msgr2=0x12e8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:01.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x12e8f00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x1252680 tx=0x7fe1f401d000).stop 2021-11-15T19:29:01.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- 172.21.2.137:0/2811960912 shutdown_connections 2021-11-15T19:29:01.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12f3360 0x12e8f00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:01.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12ed160 0x12e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- 172.21.2.137:0/2811960912 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ebbc0 0x132fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- 172.21.2.137:0/2811960912 >> 172.21.2.137:0/2811960912 conn(0x12e7890 msgr2=0x1330ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:01.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- 172.21.2.137:0/2811960912 shutdown_connections 2021-11-15T19:29:01.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- 172.21.2.137:0/2811960912 wait complete. 2021-11-15T19:29:01.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- start start 2021-11-15T19:29:01.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 Processor -- start 2021-11-15T19:29:01.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 0x1385370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ed160 0x12f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12f3360 0x1383b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x12e8f10 con 0x12f3360 2021-11-15T19:29:01.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x13887d0 con 0x12ebbc0 2021-11-15T19:29:01.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x1388a70 con 0x12ed160 2021-11-15T19:29:01.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe20cf10740 10 client.0 ll_register_callbacks cb 0x12f6c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:29:01.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe200a5b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 0x1385370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe200a5b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 0x1385370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33718/0 (socket says 172.21.2.137:33718) 2021-11-15T19:29:01.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.577+0000 7fe200a5b700 1 -- 172.21.2.137:0/1336512691 learned_addr learned my addr 172.21.2.137:0/1336512691 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:01.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe200a5b700 1 -- 172.21.2.137:0/1336512691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ed160 msgr2=0x12f0100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:01.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe200a5b700 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ed160 0x12f0100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe200a5b700 1 -- 172.21.2.137:0/1336512691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12f3360 msgr2=0x1383b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:01.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe200a5b700 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12f3360 0x1383b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:01.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe200a5b700 1 -- 172.21.2.137:0/1336512691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x124be50 con 0x12ebbc0 2021-11-15T19:29:01.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe200a5b700 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 0x1385370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fe1e406b000 tx=0x7fe1e402d040).ready entity=mon.1 client_cookie=b676b476fcabd7c0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:01.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:29:01.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 1 -- 172.21.2.137:0/1336512691 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e4030040 con 0x12ebbc0 2021-11-15T19:29:01.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 1 -- 172.21.2.137:0/1336512691 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe1e4042c40 con 0x12ebbc0 2021-11-15T19:29:01.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1ec012820 con 0x12ebbc0 2021-11-15T19:29:01.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 1 -- 172.21.2.137:0/1336512691 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e4042e00 con 0x12ebbc0 2021-11-15T19:29:01.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 10 client.5404 fetch_fsmap learned FSMap version 15 2021-11-15T19:29:01.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x1251140 con 0x12ebbc0 2021-11-15T19:29:01.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 1 -- 172.21.2.137:0/1336512691 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec012820 con 0x12ebbc0 2021-11-15T19:29:01.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 1 -- 172.21.2.137:0/1336512691 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 15) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fe1e401d030 con 0x12ebbc0 2021-11-15T19:29:01.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 10 client.5404 fetch_fsmap finished waiting for FSMap version 15 2021-11-15T19:29:01.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 10 client.5404 resolve_mds: resolved ID 'a' to GID 5191 2021-11-15T19:29:01.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 20 client.5404 populate_metadata read hostname 'gibba037' 2021-11-15T19:29:01.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f05f0 0x1384010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:01.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 4 client.5404 mds_command: new command op to 5191 tid=0[{"prefix": "cache drop"}] 2021-11-15T19:29:01.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 --> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1140590 con 0x12f05f0 2021-11-15T19:29:01.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f05f0 0x1384010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:01.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1f0ff9700 10 client.5404 ms_handle_connect on v2:172.21.2.137:6832/105473297 2021-11-15T19:29:01.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:01.581+0000 7fe1fbfff700 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f05f0 0x1384010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f78740ba433bf573 server_cookie=1a523339abf9d96b in_seq=0 out_seq=0 2021-11-15T19:29:12.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe1f0ff9700 1 -- 172.21.2.137:0/1336512691 <== mds.0 v2:172.21.2.137:6832/105473297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x1140590 con 0x12f05f0 2021-11-15T19:29:12.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe1f0ff9700 10 client.5404 handle_command_reply: tid=0 2021-11-15T19:29:12.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 client.5404 shutdown 2021-11-15T19:29:12.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 msgr2=0x1385370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:12.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 0x1385370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fe1e406b000 tx=0x7fe1e402d040).stop 2021-11-15T19:29:12.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 shutdown_connections 2021-11-15T19:29:12.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:6832/105473297,v1:172.21.2.137:6833/105473297] conn(0x12f05f0 0x1384010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x12f3360 0x1383b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x12ed160 0x12f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 --2- 172.21.2.137:0/1336512691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x12ebbc0 0x1385370 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 >> 172.21.2.137:0/1336512691 conn(0x12e7890 msgr2=0x12e8800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:12.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe1f0ff9700 0 client.5404 ms_handle_reset on v2:172.21.2.137:6832/105473297 2021-11-15T19:29:12.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 shutdown_connections 2021-11-15T19:29:12.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 1 -- 172.21.2.137:0/1336512691 wait complete. 2021-11-15T19:29:12.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe20cf10740 20 client.5404 trim_cache size 0 max 16384 2021-11-15T19:29:12.673 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:29:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "client_recall": { 2021-11-15T19:29:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": 0, 2021-11-15T19:29:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "(0) Success", 2021-11-15T19:29:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "recalled": 220 2021-11-15T19:29:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:29:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "flush_journal": { 2021-11-15T19:29:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": 0, 2021-11-15T19:29:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "" 2021-11-15T19:29:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:29:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "trim_cache": { 2021-11-15T19:29:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "trimmed": 0 2021-11-15T19:29:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:29:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "cache": { 2021-11-15T19:29:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": { 2021-11-15T19:29:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "items": 19907, 2021-11-15T19:29:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes": 3094368 2021-11-15T19:29:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:29:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:29:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: "duration": 11.080361819 2021-11-15T19:29:12.677 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:29:12.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1e00536d0 msgr2=0x7fe1e0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:12.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1e00536d0 0x7fe1e0055b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe1ec002f10 tx=0x7fe1ec008040).stop 2021-11-15T19:29:12.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 msgr2=0x7fe1fc159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:12.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1fc159b80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fe1fc0aee10 tx=0x7fe1e4015000).stop 2021-11-15T19:29:12.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 shutdown_connections 2021-11-15T19:29:12.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe1e00536d0 0x7fe1e0055b90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1fc142b70 0x7fe1fc143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1fc1470e0 0x7fe1fc142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 --2- 172.21.2.137:0/3978122233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1dc003750 0x7fe1fc159b80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 >> 172.21.2.137:0/3978122233 conn(0x7fe1fc0631e0 msgr2=0x7fe1fc0b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:12.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 shutdown_connections 2021-11-15T19:29:12.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.662+0000 7fe202cbf700 1 -- 172.21.2.137:0/3978122233 wait complete. 2021-11-15T19:29:12.682 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-15T19:29:12.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:12.684 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:29:12.684 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:12.694 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T19:29:12.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:29:12.695 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T19:29:12.696 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:29:12.696 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:29:12.697 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:12.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:12.713 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:29:12.714 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:12.762 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:29:12.762 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:29:12.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:29:12.763 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:12.768 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:29:12.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 Processor -- start 2021-11-15T19:29:12.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- start start 2021-11-15T19:29:12.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700b1340 0x7f5370147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5370143f00 0x7f5370144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f53700a9f50 0x7f53700aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5370148190 con 0x7f5370143f00 2021-11-15T19:29:12.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700b1720 con 0x7f53700a9f50 2021-11-15T19:29:12.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5370147e70 con 0x7f53700b1340 2021-11-15T19:29:12.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f53700a9f50 0x7f53700aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:12.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f53700a9f50 0x7f53700aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33726/0 (socket says 172.21.2.137:33726) 2021-11-15T19:29:12.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 -- 172.21.2.137:0/3872140034 learned_addr learned my addr 172.21.2.137:0/3872140034 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:12.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 -- 172.21.2.137:0/3872140034 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700b1340 msgr2=0x7f5370147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:12.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 --2- 172.21.2.137:0/3872140034 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700b1340 0x7f5370147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 -- 172.21.2.137:0/3872140034 >> v2:172.21.2.111:3300/0 conn(0x7f5370143f00 msgr2=0x7f5370144360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:29:12.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 --2- 172.21.2.137:0/3872140034 >> v2:172.21.2.111:3300/0 conn(0x7f5370143f00 0x7f5370144360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 -- 172.21.2.137:0/3872140034 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700af800 con 0x7f53700a9f50 2021-11-15T19:29:12.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f537486f700 1 --2- 172.21.2.137:0/3872140034 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53700a9f50 0x7f53700aa370 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f53680032f0 tx=0x7f5368009290).ready entity=mon.1 client_cookie=732c0f10d6761b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:12.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f536effd700 1 -- 172.21.2.137:0/3872140034 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536800b870 con 0x7f53700a9f50 2021-11-15T19:29:12.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f536effd700 1 -- 172.21.2.137:0/3872140034 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536800b9d0 con 0x7f53700a9f50 2021-11-15T19:29:12.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f536effd700 1 -- 172.21.2.137:0/3872140034 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536800bb80 con 0x7f53700a9f50 2021-11-15T19:29:12.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- 172.21.2.137:0/3872140034 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53700a9f50 msgr2=0x7f53700aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:12.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- 172.21.2.137:0/3872140034 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53700a9f50 0x7f53700aa370 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f53680032f0 tx=0x7f5368009290).stop 2021-11-15T19:29:12.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- 172.21.2.137:0/3872140034 shutdown_connections 2021-11-15T19:29:12.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- 172.21.2.137:0/3872140034 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53700a9f50 0x7f53700aa370 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- 172.21.2.137:0/3872140034 >> v2:172.21.2.111:3300/0 conn(0x7f5370143f00 0x7f5370144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 --2- 172.21.2.137:0/3872140034 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700b1340 0x7f5370147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.874+0000 7f53762d2700 1 -- 172.21.2.137:0/3872140034 >> 172.21.2.137:0/3872140034 conn(0x7f53700b4e60 msgr2=0x7f53700b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:12.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- 172.21.2.137:0/3872140034 shutdown_connections 2021-11-15T19:29:12.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- 172.21.2.137:0/3872140034 wait complete. 2021-11-15T19:29:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 Processor -- start 2021-11-15T19:29:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- start start 2021-11-15T19:29:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700a9f50 0x7f5370097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53700b1340 0x7f53700b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 0x7f5370148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537009a6b0 con 0x7f53700b1340 2021-11-15T19:29:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537009a950 con 0x7f5370143f00 2021-11-15T19:29:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53701484d0 con 0x7f53700a9f50 2021-11-15T19:29:12.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 0x7f5370148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 0x7f5370148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33736/0 (socket says 172.21.2.137:33736) 2021-11-15T19:29:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 -- 172.21.2.137:0/1949041232 learned_addr learned my addr 172.21.2.137:0/1949041232 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 -- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700a9f50 msgr2=0x7f5370097df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:29:12.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700a9f50 0x7f5370097df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 -- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53700b1340 msgr2=0x7f53700b3b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:29:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53700b1340 0x7f53700b3b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 -- 172.21.2.137:0/1949041232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368009530 con 0x7f5370143f00 2021-11-15T19:29:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f537486f700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 0x7f5370148970 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f53680032f0 tx=0x7f5368016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:12.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536800b870 con 0x7f5370143f00 2021-11-15T19:29:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5368021630 con 0x7f5370143f00 2021-11-15T19:29:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537009ad20 con 0x7f5370143f00 2021-11-15T19:29:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5368021990 con 0x7f5370143f00 2021-11-15T19:29:12.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537014b310 con 0x7f5370143f00 2021-11-15T19:29:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370099dd0 con 0x7f5370143f00 2021-11-15T19:29:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f536800f070 con 0x7f5370143f00 2021-11-15T19:29:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536d7fa700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53500536a0 0x7f5350055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:12.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f536806cde0 con 0x7f5370143f00 2021-11-15T19:29:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.878+0000 7f536ffff700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53500536a0 0x7f5350055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.882+0000 7f536ffff700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53500536a0 0x7f5350055b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f5364002ef0 tx=0x7f5364006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:12.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.882+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5370099dd0 con 0x7f5370143f00 2021-11-15T19:29:12.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5370099dd0 con 0x7f5370143f00 2021-11-15T19:29:12.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f536d7fa700 1 -- 172.21.2.137:0/1949041232 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f5370099dd0 con 0x7f5370143f00 2021-11-15T19:29:12.971 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:29:12.971 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":42,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:28:43.493938+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:28:39.350040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T19:28:40.459226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:29:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53500536a0 msgr2=0x7f5350055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53500536a0 0x7f5350055b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f5364002ef0 tx=0x7f5364006890).stop 2021-11-15T19:29:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 msgr2=0x7f5370148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:12.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 0x7f5370148970 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f53680032f0 tx=0x7f5368016000).stop 2021-11-15T19:29:12.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 shutdown_connections 2021-11-15T19:29:12.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53500536a0 0x7f5350055b60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5370143f00 0x7f5370148970 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:12.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53700b1340 0x7f53700b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 --2- 172.21.2.137:0/1949041232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53700a9f50 0x7f5370097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:12.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 >> 172.21.2.137:0/1949041232 conn(0x7f53700b4e60 msgr2=0x7f53700b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:12.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 shutdown_connections 2021-11-15T19:29:12.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:12.966+0000 7f53762d2700 1 -- 172.21.2.137:0/1949041232 wait complete. 2021-11-15T19:29:12.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:28:39.350040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:28:40.459226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:29:12.978 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:29:13.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 Processor -- start 2021-11-15T19:29:13.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 -- start start 2021-11-15T19:29:13.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcaf405c770 0x7fcaf40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf4140aa0 0x7fcaf4140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf405cb50 con 0x7fcaf40b0550 2021-11-15T19:29:13.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf40b1650 con 0x7fcaf405c770 2021-11-15T19:29:13.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf94c7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40ad030 con 0x7fcaf4140aa0 2021-11-15T19:29:13.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf37fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf4140aa0 0x7fcaf4140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf27fc700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fcaf40b0550 0x7fcaf414a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:45018/0 (socket says 172.21.2.137:45018) 2021-11-15T19:29:13.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf27fc700 1 -- 172.21.2.137:0/1380443069 learned_addr learned my addr 172.21.2.137:0/1380443069 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:13.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.026+0000 7fcaf2ffd700 1 --2- 172.21.2.137:0/1380443069 >> v2:172.21.2.111:3300/0 conn(0x7fcaf405c770 0x7fcaf40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf37fe700 1 -- 172.21.2.137:0/1380443069 >> v2:172.21.2.111:3300/0 conn(0x7fcaf405c770 msgr2=0x7fcaf40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf37fe700 1 --2- 172.21.2.137:0/1380443069 >> v2:172.21.2.111:3300/0 conn(0x7fcaf405c770 0x7fcaf40aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf37fe700 1 -- 172.21.2.137:0/1380443069 >> v1:172.21.2.111:6789/0 conn(0x7fcaf40b0550 legacy=0x7fcaf414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf37fe700 1 -- 172.21.2.137:0/1380443069 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40ad2d0 con 0x7fcaf4140aa0 2021-11-15T19:29:13.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf37fe700 1 --2- 172.21.2.137:0/1380443069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf4140aa0 0x7fcaf4140f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcaec0032f0 tx=0x7fcaec0091d0).ready entity=mon.2 client_cookie=6e2ac8e5bd2d3c16 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf1ffb700 1 -- 172.21.2.137:0/1380443069 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaec00b6c0 con 0x7fcaf4140aa0 2021-11-15T19:29:13.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf1ffb700 1 -- 172.21.2.137:0/1380443069 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec00b820 con 0x7fcaf4140aa0 2021-11-15T19:29:13.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf1ffb700 1 -- 172.21.2.137:0/1380443069 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaec00b990 con 0x7fcaf4140aa0 2021-11-15T19:29:13.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 -- 172.21.2.137:0/1380443069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf4140aa0 msgr2=0x7fcaf4140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/1380443069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf4140aa0 0x7fcaf4140f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcaec0032f0 tx=0x7fcaec0091d0).stop 2021-11-15T19:29:13.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 -- 172.21.2.137:0/1380443069 shutdown_connections 2021-11-15T19:29:13.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/1380443069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf4140aa0 0x7fcaf4140f10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/1380443069 >> v2:172.21.2.111:3300/0 conn(0x7fcaf405c770 0x7fcaf40aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 -- 172.21.2.137:0/1380443069 >> 172.21.2.137:0/1380443069 conn(0x7fcaf40631e0 msgr2=0x7fcaf405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 -- 172.21.2.137:0/1380443069 shutdown_connections 2021-11-15T19:29:13.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 -- 172.21.2.137:0/1380443069 wait complete. 2021-11-15T19:29:13.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 Processor -- start 2021-11-15T19:29:13.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.030+0000 7fcaf94c7700 1 -- start start 2021-11-15T19:29:13.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 0x7fcaf4142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf40b0550 0x7fcaf4140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaf4140aa0 0x7fcaf41569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4146700 con 0x7fcaf4140aa0 2021-11-15T19:29:13.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4156530 con 0x7fcaf405c770 2021-11-15T19:29:13.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4156250 con 0x7fcaf40b0550 2021-11-15T19:29:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 0x7fcaf4142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 0x7fcaf4142320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33746/0 (socket says 172.21.2.137:33746) 2021-11-15T19:29:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 -- 172.21.2.137:0/3039691996 learned_addr learned my addr 172.21.2.137:0/3039691996 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 -- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf40b0550 msgr2=0x7fcaf4140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf40b0550 0x7fcaf4140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 -- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaf4140aa0 msgr2=0x7fcaf41569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaf4140aa0 0x7fcaf41569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 -- 172.21.2.137:0/3039691996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec009470 con 0x7fcaf405c770 2021-11-15T19:29:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf2ffd700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 0x7fcaf4142320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fcae400c000 tx=0x7fcae4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcae4010780 con 0x7fcaf405c770 2021-11-15T19:29:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae40108e0 con 0x7fcaf405c770 2021-11-15T19:29:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf41413a0 con 0x7fcaf405c770 2021-11-15T19:29:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4066f20 con 0x7fcaf405c770 2021-11-15T19:29:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcae4010c40 con 0x7fcaf405c770 2021-11-15T19:29:13.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf4157200 con 0x7fcaf405c770 2021-11-15T19:29:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcae401c460 con 0x7fcaf405c770 2021-11-15T19:29:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaebfff700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcad8053640 0x7fcad8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fcae406bf60 con 0x7fcaf405c770 2021-11-15T19:29:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.034+0000 7fcaf27fc700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcad8053640 0x7fcad8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.038+0000 7fcaf27fc700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcad8053640 0x7fcad8055b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fcaf40620e0 tx=0x7fcadc007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.038+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcaf4157200 con 0x7fcaf405c770 2021-11-15T19:29:13.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.118+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcaf4157200 con 0x7fcaf405c770 2021-11-15T19:29:13.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.118+0000 7fcaebfff700 1 -- 172.21.2.137:0/3039691996 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcaf4157200 con 0x7fcaf405c770 2021-11-15T19:29:13.125 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:29:13.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcad8053640 msgr2=0x7fcad8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcad8053640 0x7fcad8055b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fcaf40620e0 tx=0x7fcadc007800).stop 2021-11-15T19:29:13.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 msgr2=0x7fcaf4142320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 0x7fcaf4142320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fcae400c000 tx=0x7fcae4006df0).stop 2021-11-15T19:29:13.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 shutdown_connections 2021-11-15T19:29:13.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcad8053640 0x7fcad8055b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaf4140aa0 0x7fcaf41569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaf40b0550 0x7fcaf4140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 --2- 172.21.2.137:0/3039691996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaf405c770 0x7fcaf4142320 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 >> 172.21.2.137:0/3039691996 conn(0x7fcaf40631e0 msgr2=0x7fcaf4140210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 shutdown_connections 2021-11-15T19:29:13.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.122+0000 7fcaf94c7700 1 -- 172.21.2.137:0/3039691996 wait complete. 2021-11-15T19:29:13.132 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:29:13.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 Processor -- start 2021-11-15T19:29:13.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- start start 2021-11-15T19:29:13.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc05c770 0x7f96bc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f96bc140aa0 0x7f96bc140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc05cb50 con 0x7f96bc0b0550 2021-11-15T19:29:13.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0b1650 con 0x7f96bc140aa0 2021-11-15T19:29:13.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0ad030 con 0x7f96bc05c770 2021-11-15T19:29:13.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c2adc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f96bc140aa0 0x7f96bc140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c1ada700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f96bc0b0550 0x7f96bc14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52536/0 (socket says 172.21.2.137:52536) 2021-11-15T19:29:13.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c1ada700 1 -- 172.21.2.137:0/4279721595 learned_addr learned my addr 172.21.2.137:0/4279721595 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:13.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c2adc700 1 -- 172.21.2.137:0/4279721595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc05c770 msgr2=0x7f96bc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c22db700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc05c770 0x7f96bc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c2adc700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc05c770 0x7f96bc0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c2adc700 1 -- 172.21.2.137:0/4279721595 >> v1:172.21.2.137:6789/0 conn(0x7f96bc0b0550 legacy=0x7f96bc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c2adc700 1 -- 172.21.2.137:0/4279721595 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0ad2d0 con 0x7f96bc140aa0 2021-11-15T19:29:13.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c12d9700 1 -- 172.21.2.137:0/4279721595 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220152974 0 0) 0x7f96bc05cb50 con 0x7f96bc0b0550 2021-11-15T19:29:13.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c22db700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc05c770 0x7f96bc0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:29:13.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c2adc700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc140aa0 0x7f96bc140f10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f96b40032f0 tx=0x7f96b40091d0).ready entity=mon.1 client_cookie=53315a904d9d7b34 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c12d9700 1 -- 172.21.2.137:0/4279721595 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b4009ea0 con 0x7f96bc140aa0 2021-11-15T19:29:13.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c12d9700 1 -- 172.21.2.137:0/4279721595 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b400b8a0 con 0x7f96bc140aa0 2021-11-15T19:29:13.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c12d9700 1 -- 172.21.2.137:0/4279721595 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b400ba10 con 0x7f96bc140aa0 2021-11-15T19:29:13.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- 172.21.2.137:0/4279721595 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc140aa0 msgr2=0x7f96bc140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc140aa0 0x7f96bc140f10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f96b40032f0 tx=0x7f96b40091d0).stop 2021-11-15T19:29:13.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- 172.21.2.137:0/4279721595 shutdown_connections 2021-11-15T19:29:13.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc140aa0 0x7f96bc140f10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 --2- 172.21.2.137:0/4279721595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc05c770 0x7f96bc0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- 172.21.2.137:0/4279721595 >> 172.21.2.137:0/4279721595 conn(0x7f96bc0631e0 msgr2=0x7f96bc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.182+0000 7f96c453f700 1 -- 172.21.2.137:0/4279721595 shutdown_connections 2021-11-15T19:29:13.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- 172.21.2.137:0/4279721595 wait complete. 2021-11-15T19:29:13.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 Processor -- start 2021-11-15T19:29:13.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- start start 2021-11-15T19:29:13.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 0x7f96bc14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96bc0b0550 0x7f96bc1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc140aa0 0x7f96bc1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc145410 con 0x7f96bc0b0550 2021-11-15T19:29:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc147350 con 0x7f96bc05c770 2021-11-15T19:29:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc143c20 con 0x7f96bc140aa0 2021-11-15T19:29:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 0x7f96bc14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 0x7f96bc14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33758/0 (socket says 172.21.2.137:33758) 2021-11-15T19:29:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 -- 172.21.2.137:0/1348088537 learned_addr learned my addr 172.21.2.137:0/1348088537 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 -- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc140aa0 msgr2=0x7f96bc1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc140aa0 0x7f96bc1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 -- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96bc0b0550 msgr2=0x7f96bc1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96bc0b0550 0x7f96bc1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 -- 172.21.2.137:0/1348088537 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b4009470 con 0x7f96bc05c770 2021-11-15T19:29:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c22db700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 0x7f96bc14ab30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f96b8007000 tx=0x7f96b8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b8010580 con 0x7f96bc05c770 2021-11-15T19:29:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b80106e0 con 0x7f96bc05c770 2021-11-15T19:29:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b8010a40 con 0x7f96bc05c770 2021-11-15T19:29:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc141be0 con 0x7f96bc05c770 2021-11-15T19:29:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc147ce0 con 0x7f96bc05c770 2021-11-15T19:29:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc1471a0 con 0x7f96bc05c770 2021-11-15T19:29:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96b8010ba0 con 0x7f96bc05c770 2021-11-15T19:29:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96af7fe700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f969c053610 0x7f969c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f96b806baf0 con 0x7f96bc05c770 2021-11-15T19:29:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.186+0000 7f96c1ada700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f969c053610 0x7f969c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.190+0000 7f96c1ada700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f969c053610 0x7f969c055ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f96b0000bc0 tx=0x7f96b00011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.190+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96b8042c50 con 0x7f96bc05c770 2021-11-15T19:29:13.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96bc0ae7f0 con 0x7f96bc05c770 2021-11-15T19:29:13.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96af7fe700 1 -- 172.21.2.137:0/1348088537 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96b8046270 con 0x7f96bc05c770 2021-11-15T19:29:13.278 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:29:13.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f969c053610 msgr2=0x7f969c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f969c053610 0x7f969c055ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f96b0000bc0 tx=0x7f96b00011a0).stop 2021-11-15T19:29:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 msgr2=0x7f96bc14ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 0x7f96bc14ab30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f96b8007000 tx=0x7f96b8008040).stop 2021-11-15T19:29:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 shutdown_connections 2021-11-15T19:29:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f969c053610 0x7f969c055ad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96bc140aa0 0x7f96bc1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96bc0b0550 0x7f96bc1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 --2- 172.21.2.137:0/1348088537 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96bc05c770 0x7f96bc14ab30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 >> 172.21.2.137:0/1348088537 conn(0x7f96bc0631e0 msgr2=0x7f96bc13ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 shutdown_connections 2021-11-15T19:29:13.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.274+0000 7f96c453f700 1 -- 172.21.2.137:0/1348088537 wait complete. 2021-11-15T19:29:13.285 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:29:13.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 Processor -- start 2021-11-15T19:29:13.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- start start 2021-11-15T19:29:13.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc0b0fe0 0x7fb8fc0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8fc0acff0 0x7fb8fc0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc0aedf0 con 0x7fb8fc13f5c0 2021-11-15T19:29:13.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ae070 con 0x7fb8fc0acff0 2021-11-15T19:29:13.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ad470 con 0x7fb8fc0b0fe0 2021-11-15T19:29:13.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8fc0acff0 0x7fb8fc0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8fc0acff0 0x7fb8fc0af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33770/0 (socket says 172.21.2.137:33770) 2021-11-15T19:29:13.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 -- 172.21.2.137:0/2271908001 learned_addr learned my addr 172.21.2.137:0/2271908001 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:13.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 -- 172.21.2.137:0/2271908001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc0b0fe0 msgr2=0x7fb8fc0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 --2- 172.21.2.137:0/2271908001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc0b0fe0 0x7fb8fc0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 -- 172.21.2.137:0/2271908001 >> v1:172.21.2.111:6789/0 conn(0x7fb8fc13f5c0 legacy=0x7fb8fc13c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 -- 172.21.2.137:0/2271908001 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc0b13c0 con 0x7fb8fc0acff0 2021-11-15T19:29:13.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8faffd700 1 --2- 172.21.2.137:0/2271908001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc0af4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fb8fc0685f0 tx=0x7fb8f0006f40).ready entity=mon.1 client_cookie=ff33d281c9b7377d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8fa7fc700 1 -- 172.21.2.137:0/2271908001 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f000dc30 con 0x7fb8fc0acff0 2021-11-15T19:29:13.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8fa7fc700 1 -- 172.21.2.137:0/2271908001 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0000e90 con 0x7fb8fc0acff0 2021-11-15T19:29:13.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8fa7fc700 1 -- 172.21.2.137:0/2271908001 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f000be90 con 0x7fb8fc0acff0 2021-11-15T19:29:13.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- 172.21.2.137:0/2271908001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 msgr2=0x7fb8fc0af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- 172.21.2.137:0/2271908001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc0af4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fb8fc0685f0 tx=0x7fb8f0006f40).stop 2021-11-15T19:29:13.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- 172.21.2.137:0/2271908001 shutdown_connections 2021-11-15T19:29:13.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- 172.21.2.137:0/2271908001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc0af4c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- 172.21.2.137:0/2271908001 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc0b0fe0 0x7fb8fc0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- 172.21.2.137:0/2271908001 >> 172.21.2.137:0/2271908001 conn(0x7fb8fc0b5f50 msgr2=0x7fb8fc0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- 172.21.2.137:0/2271908001 shutdown_connections 2021-11-15T19:29:13.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- 172.21.2.137:0/2271908001 wait complete. 2021-11-15T19:29:13.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 Processor -- start 2021-11-15T19:29:13.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- start start 2021-11-15T19:29:13.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8fc0b0fe0 0x7fb8fc065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc13f5c0 0x7fb8fc065650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc063cd0 con 0x7fb8fc0b0fe0 2021-11-15T19:29:13.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc063f70 con 0x7fb8fc0acff0 2021-11-15T19:29:13.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb901c80700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc064210 con 0x7fb8fc13f5c0 2021-11-15T19:29:13.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8fb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8fb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc144400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33774/0 (socket says 172.21.2.137:33774) 2021-11-15T19:29:13.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.334+0000 7fb8fb7fe700 1 -- 172.21.2.137:0/3756103681 learned_addr learned my addr 172.21.2.137:0/3756103681 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:13.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8fb7fe700 1 -- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc13f5c0 msgr2=0x7fb8fc065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8fb7fe700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc13f5c0 0x7fb8fc065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8fb7fe700 1 -- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8fc0b0fe0 msgr2=0x7fb8fc065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8fb7fe700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8fc0b0fe0 0x7fb8fc065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8fb7fe700 1 -- 172.21.2.137:0/3756103681 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f000b460 con 0x7fb8fc0acff0 2021-11-15T19:29:13.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8fb7fe700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc144400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fb8ec002f70 tx=0x7fb8ec006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec013460 con 0x7fb8fc0acff0 2021-11-15T19:29:13.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec0135c0 con 0x7fb8fc0acff0 2021-11-15T19:29:13.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec013920 con 0x7fb8fc0acff0 2021-11-15T19:29:13.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc145cd0 con 0x7fb8fc0acff0 2021-11-15T19:29:13.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc141e20 con 0x7fb8fc0acff0 2021-11-15T19:29:13.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc0ad690 con 0x7fb8fc0acff0 2021-11-15T19:29:13.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8ec00f070 con 0x7fb8fc0acff0 2021-11-15T19:29:13.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8dc053640 0x7fb8dc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb8ec06b340 con 0x7fb8fc0acff0 2021-11-15T19:29:13.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8faffd700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8dc053640 0x7fb8dc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8faffd700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8dc053640 0x7fb8dc055b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb8fc0685f0 tx=0x7fb8f0006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.338+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8ec042390 con 0x7fb8fc0acff0 2021-11-15T19:29:13.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8fc0573d0 con 0x7fb8fc0acff0 2021-11-15T19:29:13.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb8f8ff9700 1 -- 172.21.2.137:0/3756103681 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb8ec0459b0 con 0x7fb8fc0acff0 2021-11-15T19:29:13.431 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:29:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8dc053640 msgr2=0x7fb8dc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8dc053640 0x7fb8dc055b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb8fc0685f0 tx=0x7fb8f0006f40).stop 2021-11-15T19:29:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 msgr2=0x7fb8fc144400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc144400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fb8ec002f70 tx=0x7fb8ec006ec0).stop 2021-11-15T19:29:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 shutdown_connections 2021-11-15T19:29:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8dc053640 0x7fb8dc055b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8fc13f5c0 0x7fb8fc065650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8fc0b0fe0 0x7fb8fc065160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 --2- 172.21.2.137:0/3756103681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8fc0acff0 0x7fb8fc144400 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 >> 172.21.2.137:0/3756103681 conn(0x7fb8fc0b5f50 msgr2=0x7fb8fc0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 shutdown_connections 2021-11-15T19:29:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.426+0000 7fb901c80700 1 -- 172.21.2.137:0/3756103681 wait complete. 2021-11-15T19:29:13.438 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:29:13.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169c62f700 1 Processor -- start 2021-11-15T19:29:13.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169c62f700 1 -- start start 2021-11-15T19:29:13.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169c62f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 0x7f16940afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169c62f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16940aedf0 con 0x7f16940acff0 2021-11-15T19:29:13.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169c62f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16940afbd0 con 0x7f169413f5c0 2021-11-15T19:29:13.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169c62f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16940ae070 con 0x7f16940b0fe0 2021-11-15T19:29:13.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169abcc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f169413f5c0 0x7f169413c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52562/0 (socket says 172.21.2.137:52562) 2021-11-15T19:29:13.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169abcc700 1 -- 172.21.2.137:0/2412854302 learned_addr learned my addr 172.21.2.137:0/2412854302 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:13.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826478838 0 0) 0x7f16940afbd0 con 0x7f169413f5c0 2021-11-15T19:29:13.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f167c003260 con 0x7f169413f5c0 2021-11-15T19:29:13.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f169a3cb700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 0x7f16940afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050973371 0 0) 0x7f167c003260 con 0x7f169413f5c0 2021-11-15T19:29:13.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 msgr2=0x7f16940afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 0x7f16940afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 >> v1:172.21.2.111:6789/0 conn(0x7f16940acff0 legacy=0x7f16940af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940b13c0 con 0x7f169413f5c0 2021-11-15T19:29:13.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f168c0019e0 con 0x7f169413f5c0 2021-11-15T19:29:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 >> v1:172.21.2.137:6789/0 conn(0x7f169413f5c0 legacy=0x7f169413c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 0x7f167c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f167c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f167c004a60 0x7f167c004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16940ae070 con 0x7f167c004a60 2021-11-15T19:29:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c00db20 con 0x7f167c003de0 2021-11-15T19:29:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c00dce0 con 0x7f16940b0fe0 2021-11-15T19:29:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f1699bca700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f167c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f1699bca700 1 -- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 msgr2=0x7f167c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f1699bca700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f16940b0fe0 0x7f167c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f1699bca700 1 -- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f167c004a60 msgr2=0x7f167c004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f1699bca700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f167c004a60 0x7f167c004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.486+0000 7f1699bca700 1 -- 172.21.2.137:0/2412854302 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c003260 con 0x7f167c003de0 2021-11-15T19:29:13.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f1699bca700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f167c004500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f1690001fa0 tx=0x7f1690007a00).ready entity=mon.1 client_cookie=f2e01346dea6b2ca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1690007070 con 0x7f167c003de0 2021-11-15T19:29:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16900071d0 con 0x7f167c003de0 2021-11-15T19:29:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16993c9700 1 -- 172.21.2.137:0/2412854302 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1690006510 con 0x7f167c003de0 2021-11-15T19:29:13.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/2412854302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 msgr2=0x7f167c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 --2- 172.21.2.137:0/2412854302 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f167c004500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f1690001fa0 tx=0x7f1690007a00).stop 2021-11-15T19:29:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169abcc700 1 -- 172.21.2.137:0/2412854302 reap_dead start 2021-11-15T19:29:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/2412854302 shutdown_connections 2021-11-15T19:29:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/2412854302 >> 172.21.2.137:0/2412854302 conn(0x7f16940b5f50 msgr2=0x7f16940b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/2412854302 shutdown_connections 2021-11-15T19:29:13.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/2412854302 wait complete. 2021-11-15T19:29:13.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 Processor -- start 2021-11-15T19:29:13.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- start start 2021-11-15T19:29:13.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f1694136820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f169413f130 0x7f1694141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f169413e870 0x7f1694141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169405ff30 con 0x7f169413f130 2021-11-15T19:29:13.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169405f860 con 0x7f167c003de0 2021-11-15T19:29:13.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1694143750 con 0x7f169413e870 2021-11-15T19:29:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f1694136820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f1694136820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33792/0 (socket says 172.21.2.137:33792) 2021-11-15T19:29:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 -- 172.21.2.137:0/4210621585 learned_addr learned my addr 172.21.2.137:0/4210621585 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 -- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f169413e870 msgr2=0x7f1694141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f169413e870 0x7f1694141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 -- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f169413f130 msgr2=0x7f1694141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f169413f130 0x7f1694141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 -- 172.21.2.137:0/4210621585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169405fa90 con 0x7f167c003de0 2021-11-15T19:29:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169a3cb700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f1694136820 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1694159770 tx=0x7f1684008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1684016070 con 0x7f167c003de0 2021-11-15T19:29:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684000e90 con 0x7f167c003de0 2021-11-15T19:29:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16941439f0 con 0x7f167c003de0 2021-11-15T19:29:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1684011970 con 0x7f167c003de0 2021-11-15T19:29:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1694141da0 con 0x7f167c003de0 2021-11-15T19:29:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16940573d0 con 0x7f167c003de0 2021-11-15T19:29:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.490+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1684011ad0 con 0x7f167c003de0 2021-11-15T19:29:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.494+0000 7f16837fe700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1674053580 0x7f1674055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.494+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f168406b7e0 con 0x7f167c003de0 2021-11-15T19:29:13.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.494+0000 7f1699bca700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1674053580 0x7f1674055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.494+0000 7f1699bca700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1674053580 0x7f1674055a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f1690001fa0 tx=0x7f1690015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.494+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16840428e0 con 0x7f167c003de0 2021-11-15T19:29:13.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f169405fc20 con 0x7f167c003de0 2021-11-15T19:29:13.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f16837fe700 1 -- 172.21.2.137:0/4210621585 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1684045f00 con 0x7f167c003de0 2021-11-15T19:29:13.584 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:29:13.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1674053580 msgr2=0x7f1674055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1674053580 0x7f1674055a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f1690001fa0 tx=0x7f1690015000).stop 2021-11-15T19:29:13.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 msgr2=0x7f1694136820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f1694136820 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1694159770 tx=0x7f1684008040).stop 2021-11-15T19:29:13.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 shutdown_connections 2021-11-15T19:29:13.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1674053580 0x7f1674055a40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f169413e870 0x7f1694141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f169413f130 0x7f1694141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 --2- 172.21.2.137:0/4210621585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f167c003de0 0x7f1694136820 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 >> 172.21.2.137:0/4210621585 conn(0x7f16940b5f50 msgr2=0x7f16940b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 shutdown_connections 2021-11-15T19:29:13.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.578+0000 7f169c62f700 1 -- 172.21.2.137:0/4210621585 wait complete. 2021-11-15T19:29:13.591 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:29:13.591 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:29:13.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 Processor -- start 2021-11-15T19:29:13.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- start start 2021-11-15T19:29:13.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad00b1340 0x7f8ad0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8ad00a9f50 0x7f8ad00aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad0148190 con 0x7f8ad0143f00 2021-11-15T19:29:13.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00b1720 con 0x7f8ad00a9f50 2021-11-15T19:29:13.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0147e70 con 0x7f8ad00b1340 2021-11-15T19:29:13.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8ad0143f00 0x7f8ad0144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52582/0 (socket says 172.21.2.137:52582) 2021-11-15T19:29:13.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 -- 172.21.2.137:0/1541166897 learned_addr learned my addr 172.21.2.137:0/1541166897 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:29:13.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557238473 0 0) 0x7f8ac0001110 con 0x7f8ad0143f00 2021-11-15T19:29:13.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab0003260 con 0x7f8ad0143f00 2021-11-15T19:29:13.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000854612 0 0) 0x7f8ab0003260 con 0x7f8ad0143f00 2021-11-15T19:29:13.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad00b1340 msgr2=0x7f8ad0147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad00b1340 0x7f8ad0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 >> v2:172.21.2.111:3300/0 conn(0x7f8ad00a9f50 msgr2=0x7f8ad00aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 --2- 172.21.2.137:0/1541166897 >> v2:172.21.2.111:3300/0 conn(0x7f8ad00a9f50 0x7f8ad00aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00af800 con 0x7f8ad0143f00 2021-11-15T19:29:13.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8ac00017f0 con 0x7f8ad0143f00 2021-11-15T19:29:13.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 >> v1:172.21.2.137:6789/0 conn(0x7f8ad0143f00 legacy=0x7f8ad0144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ab00037d0 0x7f8ab0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ab0004500 0x7f8ab0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ab0005070 0x7f8ab000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00b1720 con 0x7f8ab00037d0 2021-11-15T19:29:13.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0147e70 con 0x7f8ab0004500 2021-11-15T19:29:13.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab000beb0 con 0x7f8ab0005070 2021-11-15T19:29:13.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ab0004500 0x7f8ab0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 -- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ab0005070 msgr2=0x7f8ab000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ab0005070 0x7f8ab000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 -- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ab00037d0 msgr2=0x7f8ab0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:29:13.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ab00037d0 0x7f8ab0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 -- 172.21.2.137:0/1541166897 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00af800 con 0x7f8ab0004500 2021-11-15T19:29:13.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ab0004500 0x7f8ab0004980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f8ac0001500 tx=0x7f8ac0007740).ready entity=mon.1 client_cookie=67b0b209e430477f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac000cab0 con 0x7f8ab0004500 2021-11-15T19:29:13.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000cc10 con 0x7f8ab0004500 2021-11-15T19:29:13.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8acd59a700 1 -- 172.21.2.137:0/1541166897 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac00070d0 con 0x7f8ab0004500 2021-11-15T19:29:13.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- 172.21.2.137:0/1541166897 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ab0004500 msgr2=0x7f8ab0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 --2- 172.21.2.137:0/1541166897 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ab0004500 0x7f8ab0004980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f8ac0001500 tx=0x7f8ac0007740).stop 2021-11-15T19:29:13.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8aced9d700 1 -- 172.21.2.137:0/1541166897 reap_dead start 2021-11-15T19:29:13.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- 172.21.2.137:0/1541166897 shutdown_connections 2021-11-15T19:29:13.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- 172.21.2.137:0/1541166897 >> 172.21.2.137:0/1541166897 conn(0x7f8ad00b4e60 msgr2=0x7f8ad00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- 172.21.2.137:0/1541166897 shutdown_connections 2021-11-15T19:29:13.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- 172.21.2.137:0/1541166897 wait complete. 2021-11-15T19:29:13.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 Processor -- start 2021-11-15T19:29:13.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- start start 2021-11-15T19:29:13.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad009a4c0 0x7f8ad009a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 0x7f8ad013ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad0156af0 0x7f8ad0156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0099c90 con 0x7f8ad0156af0 2021-11-15T19:29:13.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0099f30 con 0x7f8ad013faf0 2021-11-15T19:29:13.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.638+0000 7f8ad4939700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0148580 con 0x7f8ad009a4c0 2021-11-15T19:29:13.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 0x7f8ad013ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 0x7f8ad013ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33812/0 (socket says 172.21.2.137:33812) 2021-11-15T19:29:13.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 -- 172.21.2.137:0/542870862 learned_addr learned my addr 172.21.2.137:0/542870862 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:29:13.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 -- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad009a4c0 msgr2=0x7f8ad009a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad009a4c0 0x7f8ad009a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 -- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad0156af0 msgr2=0x7f8ad0156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad0156af0 0x7f8ad0156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 -- 172.21.2.137:0/542870862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad01491d0 con 0x7f8ad013faf0 2021-11-15T19:29:13.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8acdd9b700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 0x7f8ad013ff50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f8ac0001500 tx=0x7f8ac0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac00047d0 con 0x7f8ad013faf0 2021-11-15T19:29:13.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac0004930 con 0x7f8ad013faf0 2021-11-15T19:29:13.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac0004c90 con 0x7f8ad013faf0 2021-11-15T19:29:13.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad0148e60 con 0x7f8ad013faf0 2021-11-15T19:29:13.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad014a120 con 0x7f8ad013faf0 2021-11-15T19:29:13.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad01567e0 con 0x7f8ad013faf0 2021-11-15T19:29:13.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ac0027070 con 0x7f8ad013faf0 2021-11-15T19:29:13.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ac77fe700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ab4053600 0x7f8ab4055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:29:13.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8ac006c3e0 con 0x7f8ad013faf0 2021-11-15T19:29:13.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ace59c700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ab4053600 0x7f8ab4055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:29:13.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.642+0000 7f8ace59c700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ab4053600 0x7f8ab4055ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8ab8002f70 tx=0x7f8ab8006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:29:13.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.646+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ac0043540 con 0x7f8ad013faf0 2021-11-15T19:29:13.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.750+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ad0148190 con 0x7f8ad013faf0 2021-11-15T19:29:13.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.750+0000 7f8ac77fe700 1 -- 172.21.2.137:0/542870862 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f8ad0148190 con 0x7f8ad013faf0 2021-11-15T19:29:13.757 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:29:13.758 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:29:13.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ab4053600 msgr2=0x7f8ab4055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ab4053600 0x7f8ab4055ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8ab8002f70 tx=0x7f8ab8006a00).stop 2021-11-15T19:29:13.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 msgr2=0x7f8ad013ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:29:13.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 0x7f8ad013ff50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f8ac0001500 tx=0x7f8ac0015000).stop 2021-11-15T19:29:13.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 shutdown_connections 2021-11-15T19:29:13.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ab4053600 0x7f8ab4055ac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad0156af0 0x7f8ad0156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad013faf0 0x7f8ad013ff50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:29:13.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 --2- 172.21.2.137:0/542870862 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad009a4c0 0x7f8ad009a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:29:13.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 >> 172.21.2.137:0/542870862 conn(0x7f8ad00b4e60 msgr2=0x7f8ad0141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:29:13.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 shutdown_connections 2021-11-15T19:29:13.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:29:13.754+0000 7f8ad4939700 1 -- 172.21.2.137:0/542870862 wait complete. 2021-11-15T19:29:13.762 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:29:13.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:28:41.474267+0000', 'modified': '2021-11-15T19:28:42.480660+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5191}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5191': {'gid': 5191, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/105473297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 105473297}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 105473297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:29:13.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:29:13.968 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:29:14.033 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5191,"want_state":"up:active","state":"up:active","rank_uptime":32.551225434999999,"mdsmap_epoch":15,"osdmap_epoch":42,"osdmap_epoch_barrier":41,"uptime":36.756120862000003} 2021-11-15T19:29:14.034 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5191, "mdsmap_epoch": 15, "osdmap_epoch": 42, "osdmap_epoch_barrier": 41, "rank_uptime": 32.551225435, "state": "up:active", "uptime": 36.756120862, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:29:14.034 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:29:14.034 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:29:14.035 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:29:14.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:14.036 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:14.046 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:29:14.100 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:29:14.100 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:29:14.106 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:29:14.106 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:29:14.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:14.108 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:29:14.111 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:29:14.112 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:14.155 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:29:14.164 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:29:14.164 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:29:14.169 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:29:14.170 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:29:14.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:14.171 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:29:14.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:29:14.193+0000 7f5421a09080 -1 init, newargv = 0x5563657f1b10 newargc=9ceph-fuse[14312 2021-11-15T19:29:14.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:]: starting ceph client 2021-11-15T19:29:14.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14312]: starting fuse 2021-11-15T19:29:15.299 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:29:15.312 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:29:15.312 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:29:15.360 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:29:15.361 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:29:15.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:15.363 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:29:15.368 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:29:15.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:29:15.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:15.369 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:29:15.369 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:29:15.370 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:29:15.370 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:29:15.371 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:29:15.371 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:29:15.371 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:29:15.372 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:29:15.372 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:29:15.373 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:29:15.373 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:29:15.373 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:29:15.374 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:29:15.374 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:29:15.374 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:29:15.375 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:29:15.375 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:29:15.376 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:29:15.376 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:29:15.376 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:29:15.377 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:29:15.377 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:29:15.378 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:29:15.408 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14312.asok 2021-11-15T19:29:15.410 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14312.asok 2021-11-15T19:29:15.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:15.411 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14312.asok status 2021-11-15T19:29:15.459 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:29:15.459 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:29:15.459 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:29:15.459 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:29:15.460 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:29:15.460 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:29:15.460 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:29:15.460 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14312", 2021-11-15T19:29:15.461 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:29:15.461 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:29:15.461 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:29:15.461 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:29:15.462 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 5449, 2021-11-15T19:29:15.462 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:29:15.462 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:29:15.462 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:29:15.463 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 5449 2021-11-15T19:29:15.463 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:29:15.463 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:29:15.463 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:29:15.463 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:29:15.464 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 3991978991 2021-11-15T19:29:15.464 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:29:15.464 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:29:15.464 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:29:15.464 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:29:15.465 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:29:15.465 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 3991978991 2021-11-15T19:29:15.465 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:29:15.465 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.5449 172.21.2.131:0/3991978991", 2021-11-15T19:29:15.466 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/3991978991", 2021-11-15T19:29:15.466 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:29:15.466 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 15, 2021-11-15T19:29:15.466 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 42, 2021-11-15T19:29:15.466 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:29:15.467 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:29:15.467 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:29:15.467 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:29:15.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:15.469 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:29:15.469 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:15.478 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:29:15.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:29:15.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:29:15.480 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:29:23.836 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:23.840 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:23.844 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:23.847 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:23.851 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:53.896 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:53.900 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:53.903 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:53.907 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:29:53.910 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:02.282 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:30:02.283 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:02.291 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:02.305 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:02.318 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:02.331 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:02.343 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:30:02.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:02.344 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:02.344 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:02.378 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:30:02.379 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:30:02.380 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:30:02.380 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:30:02.380 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:02.391 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14312]: fuse finished with error 0 and tester_r 0 2021-11-15T19:30:02.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:02.393 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:02.393 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:02.397 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:30:02.398 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:30:02.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:30:02.519 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:02.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:02.529 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:02.529 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:30:02.538 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:30:02.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:02.540 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:30:02.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:30:02.541 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:30:02.550 INFO:teuthology.orchestra.run.gibba018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:30:02.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:02.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:02.552 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:02.552 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:30:02.562 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:30:02.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:02.563 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:30:02.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:30:02.564 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:30:02.573 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:30:02.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:02.575 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:30:02.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 Processor -- start 2021-11-15T19:30:02.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- start start 2021-11-15T19:30:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff5240b1340 0x7ff524147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff524143f00 0x7ff524144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff524148190 con 0x7ff5240a9f50 2021-11-15T19:30:02.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240b1720 con 0x7ff524143f00 2021-11-15T19:30:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff524147e70 con 0x7ff5240b1340 2021-11-15T19:30:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff529bb9700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff5240a9f50 0x7ff5240aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52604/0 (socket says 172.21.2.137:52604) 2021-11-15T19:30:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff529bb9700 1 -- 172.21.2.137:0/3074998458 learned_addr learned my addr 172.21.2.137:0/3074998458 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:02.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff5293b8700 1 --2- 172.21.2.137:0/3074998458 >> v2:172.21.2.137:3300/0 conn(0x7ff5240b1340 0x7ff524147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:02.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff5293b8700 1 -- 172.21.2.137:0/3074998458 >> v2:172.21.2.111:3300/0 conn(0x7ff524143f00 msgr2=0x7ff524144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:02.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff5293b8700 1 --2- 172.21.2.137:0/3074998458 >> v2:172.21.2.111:3300/0 conn(0x7ff524143f00 0x7ff524144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:02.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff5293b8700 1 -- 172.21.2.137:0/3074998458 >> v1:172.21.2.137:6789/0 conn(0x7ff5240a9f50 legacy=0x7ff5240aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:02.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff517fff700 1 -- 172.21.2.137:0/3074998458 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106206921 0 0) 0x7ff51c001490 con 0x7ff5240a9f50 2021-11-15T19:30:02.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff5293b8700 1 -- 172.21.2.137:0/3074998458 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240af800 con 0x7ff5240b1340 2021-11-15T19:30:02.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff5293b8700 1 --2- 172.21.2.137:0/3074998458 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240b1340 0x7ff524147980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7ff518002f70 tx=0x7ff518006df0).ready entity=mon.1 client_cookie=48127388c6758f7b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:02.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff517fff700 1 -- 172.21.2.137:0/3074998458 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51800d5c0 con 0x7ff5240b1340 2021-11-15T19:30:02.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff517fff700 1 -- 172.21.2.137:0/3074998458 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518000e90 con 0x7ff5240b1340 2021-11-15T19:30:02.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff517fff700 1 -- 172.21.2.137:0/3074998458 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51800d910 con 0x7ff5240b1340 2021-11-15T19:30:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- 172.21.2.137:0/3074998458 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240b1340 msgr2=0x7ff524147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 --2- 172.21.2.137:0/3074998458 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240b1340 0x7ff524147980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7ff518002f70 tx=0x7ff518006df0).stop 2021-11-15T19:30:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- 172.21.2.137:0/3074998458 shutdown_connections 2021-11-15T19:30:02.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 --2- 172.21.2.137:0/3074998458 >> v2:172.21.2.111:3300/0 conn(0x7ff524143f00 0x7ff524144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 --2- 172.21.2.137:0/3074998458 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240b1340 0x7ff524147980 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.683+0000 7ff52b61c700 1 -- 172.21.2.137:0/3074998458 >> 172.21.2.137:0/3074998458 conn(0x7ff5240b4e60 msgr2=0x7ff5240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- 172.21.2.137:0/3074998458 shutdown_connections 2021-11-15T19:30:02.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- 172.21.2.137:0/3074998458 wait complete. 2021-11-15T19:30:02.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 Processor -- start 2021-11-15T19:30:02.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- start start 2021-11-15T19:30:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 0x7ff5240ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff5240b1340 0x7ff524159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff524143f00 0x7ff52415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240ac350 con 0x7ff5240b1340 2021-11-15T19:30:02.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240aca20 con 0x7ff5240a9f50 2021-11-15T19:30:02.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff524141490 con 0x7ff524143f00 2021-11-15T19:30:02.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 0x7ff5240ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:02.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 0x7ff5240ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33826/0 (socket says 172.21.2.137:33826) 2021-11-15T19:30:02.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 -- 172.21.2.137:0/2876563767 learned_addr learned my addr 172.21.2.137:0/2876563767 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:02.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 -- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff524143f00 msgr2=0x7ff52415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:02.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff524143f00 0x7ff52415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:02.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 -- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff5240b1340 msgr2=0x7ff524159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:02.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff5240b1340 0x7ff524159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:02.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 -- 172.21.2.137:0/2876563767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51800b180 con 0x7ff5240a9f50 2021-11-15T19:30:02.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5293b8700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 0x7ff5240ae010 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7ff518002f70 tx=0x7ff518014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:02.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff518016070 con 0x7ff5240a9f50 2021-11-15T19:30:02.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51800de90 con 0x7ff5240a9f50 2021-11-15T19:30:02.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51801e450 con 0x7ff5240a9f50 2021-11-15T19:30:02.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240ac580 con 0x7ff5240a9f50 2021-11-15T19:30:02.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5240ae500 con 0x7ff5240a9f50 2021-11-15T19:30:02.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5240ad970 con 0x7ff5240a9f50 2021-11-15T19:30:02.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff51800f030 con 0x7ff5240a9f50 2021-11-15T19:30:02.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5167fc700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5040536a0 0x7ff504055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:02.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.687+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff51806c810 con 0x7ff5240a9f50 2021-11-15T19:30:02.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.691+0000 7ff528bb7700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5040536a0 0x7ff504055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:02.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.691+0000 7ff528bb7700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5040536a0 0x7ff504055b60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff520002f70 tx=0x7ff520006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:02.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.691+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5240ad970 con 0x7ff5240a9f50 2021-11-15T19:30:02.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.771+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff5240ad970 con 0x7ff5240a9f50 2021-11-15T19:30:02.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff5167fc700 1 -- 172.21.2.137:0/2876563767 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v42) v1 ==== 81+0+33645 (secure 0 0 0) 0x7ff5240ad970 con 0x7ff5240a9f50 2021-11-15T19:30:02.779 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:02.779 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:30:02.779 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 42, 2021-11-15T19:30:02.779 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:30:02.780 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:30:02.780 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:28:43.493938+0000", 2021-11-15T19:30:02.780 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:30:02.780 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:30:02.780 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:30:02.781 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:30:02.781 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:30:02.781 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:30:02.781 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:30:02.782 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:30:02.782 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:30:02.782 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:02.782 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:30:02.782 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:30:02.783 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:30:02.783 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:30:02.783 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:30:02.783 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 8, 2021-11-15T19:30:02.784 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:30:02.784 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:30:02.784 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:30:02.784 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:30:02.785 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:30:02.785 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.785 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:30:02.785 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:30:02.786 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:30:02.786 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:30:02.786 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:30:02.786 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:30:02.786 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:30:02.787 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:30:02.787 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:30:02.787 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:30:02.787 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:30:02.788 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:30:02.788 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:30:02.788 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:30:02.788 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:30:02.788 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:30:02.789 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:30:02.789 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:30:02.789 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:30:02.789 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:30:02.790 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:30:02.790 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:30:02.790 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:30:02.790 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.791 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:30:02.791 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:30:02.791 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:30:02.791 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:30:02.791 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:30:02.792 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:30:02.792 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:30:02.792 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:30:02.792 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:30:02.793 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:30:02.793 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:30:02.793 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:30:02.793 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:30:02.793 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:30:02.794 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:30:02.794 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:30:02.794 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:30:02.794 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:30:02.794 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:30:02.795 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:30:02.795 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:30:02.795 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:30:02.795 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:30:02.796 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:30:02.796 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:30:02.796 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:30:02.796 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:30:02.796 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.797 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:30:02.797 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:30:02.797 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:30:02.797 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:30:02.798 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:30:02.798 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:30:02.798 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:30:02.798 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:30:02.798 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:30:02.799 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:30:02.799 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:30:02.799 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:30:02.799 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:30:02.800 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.800 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:30:02.800 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:30:02.800 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.801 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.801 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.801 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:30:02.801 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:30:02.801 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:30:02.802 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:30:02.802 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:30:02.802 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:30:02.802 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:30:02.803 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:30:02.803 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:30:02.803 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:30:02.803 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:30:02.803 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:30:02.804 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:30:02.804 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:30:02.804 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:30:02.804 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:30:02.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:30:02.805 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:30:02.805 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:30:02.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:30:02.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:30:02.806 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:30:02.806 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:30:02.806 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.806 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:30:02.807 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:30:02.807 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:30:02.807 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:30:02.807 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:30:02.808 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:30:02.808 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:30:02.808 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:30:02.808 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:30:02.808 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:30:02.809 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:30:02.809 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:30:02.809 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:30:02.809 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:30:02.809 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:30:02.810 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:30:02.810 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:30:02.810 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:30:02.810 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:30:02.811 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:30:02.811 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:30:02.811 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:30:02.811 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:30:02.812 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:30:02.812 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:30:02.812 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:30:02.812 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:30:02.812 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.813 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:30:02.813 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:30:02.813 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:30:02.813 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:30:02.814 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:30:02.814 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:30:02.814 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:30:02.814 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:30:02.815 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:30:02.815 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:30:02.815 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:30:02.815 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:30:02.815 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:30:02.816 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:30:02.816 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.816 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.816 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 7, 2021-11-15T19:30:02.817 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:30:02.817 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:28:39.350040+0000", 2021-11-15T19:30:02.817 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:30:02.817 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:30:02.818 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:30:02.818 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:30:02.818 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:30:02.818 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:30:02.818 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:30:02.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:30:02.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:30:02.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:30:02.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:30:02.820 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:30:02.820 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:30:02.820 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:30:02.820 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:30:02.820 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:30:02.821 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:30:02.821 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:30:02.821 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:30:02.821 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:30:02.821 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.822 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "41", 2021-11-15T19:30:02.822 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:30:02.822 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:30:02.822 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:30:02.823 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:30:02.823 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:30:02.823 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:30:02.823 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:30:02.823 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:30:02.824 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:30:02.824 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:30:02.824 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:30:02.824 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:30:02.824 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:30:02.825 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:30:02.825 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:30:02.825 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:30:02.825 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:30:02.826 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:30:02.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:30:02.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:30:02.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:30:02.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:30:02.827 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:30:02.827 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:30:02.827 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:30:02.827 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:30:02.828 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.828 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:30:02.828 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:30:02.828 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:30:02.829 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:30:02.829 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:30:02.829 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:30:02.829 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:30:02.829 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:30:02.830 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:30:02.830 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:30:02.830 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:30:02.830 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:30:02.830 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:30:02.831 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:30:02.831 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:30:02.831 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.831 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:30:02.831 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:30:02.832 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:30:02.832 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.832 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.832 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.832 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.833 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 8, 2021-11-15T19:30:02.833 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:30:02.833 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:28:40.459226+0000", 2021-11-15T19:30:02.833 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:30:02.834 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:30:02.834 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:30:02.834 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:30:02.834 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:30:02.834 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:30:02.835 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:30:02.835 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:30:02.835 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:30:02.835 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:30:02.836 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:30:02.836 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:30:02.836 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:30:02.836 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:30:02.836 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:30:02.837 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:30:02.837 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:30:02.837 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:30:02.837 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:30:02.838 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:30:02.838 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.838 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "42", 2021-11-15T19:30:02.838 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:30:02.839 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:30:02.839 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:30:02.839 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:30:02.839 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:30:02.839 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:30:02.840 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:30:02.840 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:30:02.840 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:30:02.840 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:30:02.840 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:30:02.841 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:30:02.841 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:30:02.841 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:30:02.841 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:30:02.842 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:30:02.842 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:30:02.842 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:30:02.842 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:30:02.843 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:30:02.843 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:30:02.843 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:30:02.843 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:30:02.843 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:30:02.844 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:30:02.844 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:30:02.844 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.844 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:30:02.845 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:30:02.845 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:30:02.845 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:30:02.845 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:30:02.846 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:30:02.846 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:30:02.846 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:30:02.846 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:30:02.846 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:30:02.847 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:30:02.847 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:30:02.847 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:30:02.847 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:30:02.848 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:30:02.848 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.848 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.848 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.848 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:02.849 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:30:02.849 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.849 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:30:02.849 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:30:02.849 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.850 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.850 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.850 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.850 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.851 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.851 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.851 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:02.851 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.851 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.852 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.852 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.852 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.852 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:30:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:30:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:30:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:30:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:30:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:30:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:30:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:30:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:30:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:30:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:30:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:30:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:30:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:30:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 40, 2021-11-15T19:30:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:30:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:30:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:30:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:30:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:30:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:30:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:30:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:30:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:30:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:30:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:30:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:30:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:30:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:30:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.886 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.886 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 26, 2021-11-15T19:30:02.886 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.886 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.886 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.887 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.887 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.887 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.887 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:30:02.888 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.888 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.888 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.888 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.889 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:30:02.889 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.889 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.889 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.889 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.890 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.890 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.890 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.890 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.891 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:30:02.891 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.891 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.891 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.892 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.892 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:30:02.892 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.892 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.893 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.893 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.893 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.893 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.894 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.894 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.894 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:30:02.894 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.894 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.895 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.895 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.895 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:30:02.895 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.896 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.896 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.896 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.896 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.896 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.897 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.897 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.897 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:30:02.897 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.898 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.898 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.898 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.898 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:30:02.898 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:02.899 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.899 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.899 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.899 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:30:02.900 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:30:02.900 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:30:02.900 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:30:02.900 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.900 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.901 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.901 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.901 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.901 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.902 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:30:02.902 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:30:02.902 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.902 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.903 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.903 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.903 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.903 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.903 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.904 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:02.904 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.904 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.904 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.905 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.905 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.905 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.905 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:30:02.905 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.906 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.906 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.906 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.906 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:30:02.907 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.907 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.907 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.907 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.908 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.908 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.908 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.908 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.908 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:30:02.909 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.909 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.909 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.909 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.910 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:30:02.910 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.910 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.910 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.910 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.911 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.911 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.911 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.911 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.912 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:30:02.912 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.912 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.912 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.912 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.913 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:30:02.913 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.913 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.913 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.914 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.914 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.914 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.914 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.915 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.915 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:30:02.915 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.915 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.915 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.916 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.916 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:30:02.916 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:02.916 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.917 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.917 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.917 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:30:02.917 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:30:02.917 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:30:02.918 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:30:02.918 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.918 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.918 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.919 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.919 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.919 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.919 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:30:02.920 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:30:02.920 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.920 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.920 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.920 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.921 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.921 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.921 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.921 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:02.922 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.922 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.922 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.922 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.923 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.923 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.923 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:30:02.923 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.923 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.924 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.924 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.924 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:30:02.924 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.924 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.925 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.925 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.925 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.925 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.926 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.926 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.926 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:30:02.926 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.927 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.927 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.927 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.927 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:30:02.928 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.928 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.928 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.928 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.929 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.929 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.929 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.929 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.929 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:30:02.930 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.930 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.930 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.930 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.931 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:30:02.931 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.931 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.931 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.931 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.932 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.932 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.932 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.932 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.932 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:30:02.933 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.933 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.933 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.933 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.934 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:30:02.934 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:02.934 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.934 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.934 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.935 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:30:02.935 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:30:02.935 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:30:02.935 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:30:02.936 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.936 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.936 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.936 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.936 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.937 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.937 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:30:02.937 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:30:02.937 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.937 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.938 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.938 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.938 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.938 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.938 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.939 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:02.939 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.939 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.939 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.939 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.940 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.940 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.940 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:30:02.940 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.940 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.941 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.941 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.941 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:30:02.941 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.941 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.942 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.942 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.942 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.942 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.943 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.943 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.943 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:30:02.943 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.943 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.944 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.944 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.944 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:30:02.944 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.944 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.945 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.945 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.945 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.945 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.945 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.946 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.946 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:30:02.946 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.946 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.946 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.947 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.947 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:30:02.947 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.947 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.947 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.948 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.948 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.948 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.948 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.948 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.949 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:30:02.949 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.949 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.949 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.949 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.950 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:30:02.950 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:02.950 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.950 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.951 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.951 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:30:02.951 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:30:02.951 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:30:02.951 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:30:02.952 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.952 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.952 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.952 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.953 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.953 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.953 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:30:02.953 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:30:02.953 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.954 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.954 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.954 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.954 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.955 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:02.955 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.956 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.956 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.956 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.956 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.956 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.957 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:30:02.957 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.957 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.957 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.958 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.958 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:30:02.958 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.958 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.958 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.959 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.959 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.959 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.959 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.960 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.960 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:30:02.960 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.960 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.960 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.961 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.961 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:30:02.961 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.961 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.961 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.962 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.962 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.962 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.962 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.963 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.963 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:30:02.963 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.963 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.964 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.964 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.964 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:30:02.964 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.964 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.965 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.965 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.965 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.965 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.966 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.966 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.966 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:30:02.966 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.966 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.967 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.967 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.967 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:30:02.967 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:02.968 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.968 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.968 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.968 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:30:02.968 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:30:02.969 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:30:02.969 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:30:02.969 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.969 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.970 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.970 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.970 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.970 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.970 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:30:02.971 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:30:02.971 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:02.971 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:02.971 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:02.972 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:02.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:02.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:02.972 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:02.972 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 37, 2021-11-15T19:30:02.973 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:02.973 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:02.973 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:02.973 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.974 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.974 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.974 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:30:02.974 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.974 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.975 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.975 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.975 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:30:02.975 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.976 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.976 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.976 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.976 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:02.977 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.977 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.977 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.977 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:30:02.977 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.978 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.978 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.978 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.978 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:30:02.979 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.979 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.979 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.979 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.979 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:02.980 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.980 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.980 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.980 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:30:02.981 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.981 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.981 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.981 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.981 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:30:02.982 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.982 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.982 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.982 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.983 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:02.983 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:02.983 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.983 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:02.983 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:30:02.984 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.984 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.984 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.984 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:02.984 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:30:02.985 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:02.985 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.985 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.985 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.986 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:30:02.986 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:30:02.986 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:30:02.986 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:30:02.987 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:02.987 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:02.987 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:02.987 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:02.987 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:02.988 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:02.988 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:30:02.988 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.988 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:30:02.988 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:02.989 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:02.989 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:02.989 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:02.989 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:02.990 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:30:02.990 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:02.990 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.990 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.991 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:30:02.991 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:02.991 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:02.991 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:02.991 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:02.992 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:02.992 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:30:02.992 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:02.992 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.993 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.993 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:30:02.993 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:02.993 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:02.994 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:02.994 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:02.994 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:02.994 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:30:02.994 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:02.995 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.995 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.995 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:30:02.995 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:02.996 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:02.996 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:02.996 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:02.996 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:02.996 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:30:02.997 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:02.997 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.997 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:02.997 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:30:02.998 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:02.998 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:02.998 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:02.998 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:02.998 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:02.999 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:30:02.999 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:02.999 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:02.999 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:03.000 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:30:03.000 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:03.000 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:03.000 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:03.000 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:03.001 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:03.001 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:30:03.001 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:03.001 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:03.001 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:03.002 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:30:03.002 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:03.002 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:03.002 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:03.003 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:03.003 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:03.003 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:30:03.003 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:03.003 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:03.004 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:03.004 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:30:03.004 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:03.004 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:03.005 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:03.005 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:03.005 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:03.005 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:30:03.005 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:03.006 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:03.006 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:03.006 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:30:03.006 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:30:03.007 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:30:03.007 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:30:03.007 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:30:03.007 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:30:03.007 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:30:03.008 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:30:03.008 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:30:03.008 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:30:03.008 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:30:03.009 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:30:03.009 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:30:03.009 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:03.009 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:03.009 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:30:03.010 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:30:03.010 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:30:03.010 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:30:03.010 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:30:03.011 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:30:03.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5040536a0 msgr2=0x7ff504055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5040536a0 0x7ff504055b60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff520002f70 tx=0x7ff520006a80).stop 2021-11-15T19:30:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 msgr2=0x7ff5240ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 0x7ff5240ae010 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7ff518002f70 tx=0x7ff518014000).stop 2021-11-15T19:30:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 shutdown_connections 2021-11-15T19:30:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5040536a0 0x7ff504055b60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff524143f00 0x7ff52415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff5240b1340 0x7ff524159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 --2- 172.21.2.137:0/2876563767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff5240a9f50 0x7ff5240ae010 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 >> 172.21.2.137:0/2876563767 conn(0x7ff5240b4e60 msgr2=0x7ff5240af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 shutdown_connections 2021-11-15T19:30:03.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:02.775+0000 7ff52b61c700 1 -- 172.21.2.137:0/2876563767 wait complete. 2021-11-15T19:30:03.016 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:03.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 Processor -- start 2021-11-15T19:30:03.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 -- start start 2021-11-15T19:30:03.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd3840b1340 0x7fd384147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd384148190 con 0x7fd384143f00 2021-11-15T19:30:03.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840b1720 con 0x7fd3840a9f50 2021-11-15T19:30:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd384147e70 con 0x7fd3840b1340 2021-11-15T19:30:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd3840a9f50 0x7fd3840aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52614/0 (socket says 172.21.2.137:52614) 2021-11-15T19:30:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 -- 172.21.2.137:0/3672263592 learned_addr learned my addr 172.21.2.137:0/3672263592 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:03.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836030313 0 0) 0x7fd3840b1720 con 0x7fd3840a9f50 2021-11-15T19:30:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd370003260 con 0x7fd3840a9f50 2021-11-15T19:30:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd383fff700 1 --2- 172.21.2.137:0/3672263592 >> v2:172.21.2.111:3300/0 conn(0x7fd3840b1340 0x7fd384147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2579307645 0 0) 0x7fd370003260 con 0x7fd3840a9f50 2021-11-15T19:30:03.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 >> v2:172.21.2.111:3300/0 conn(0x7fd3840b1340 msgr2=0x7fd384147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 --2- 172.21.2.137:0/3672263592 >> v2:172.21.2.111:3300/0 conn(0x7fd3840b1340 0x7fd384147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 >> v1:172.21.2.111:6789/0 conn(0x7fd384143f00 legacy=0x7fd384144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840af800 con 0x7fd3840a9f50 2021-11-15T19:30:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd37c0019e0 con 0x7fd3840a9f50 2021-11-15T19:30:03.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 >> v1:172.21.2.137:6789/0 conn(0x7fd3840a9f50 legacy=0x7fd3840aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370003820 0x7fd370003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd370004500 0x7fd370004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd370004f70 0x7fd37000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384147e70 con 0x7fd370004500 2021-11-15T19:30:03.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37000bef0 con 0x7fd370004f70 2021-11-15T19:30:03.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37000c0b0 con 0x7fd370003820 2021-11-15T19:30:03.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd370004f70 0x7fd37000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 -- 172.21.2.137:0/3672263592 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370003820 msgr2=0x7fd370003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370003820 0x7fd370003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 -- 172.21.2.137:0/3672263592 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd370004500 msgr2=0x7fd370004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd370004500 0x7fd370004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 -- 172.21.2.137:0/3672263592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370003260 con 0x7fd370004f70 2021-11-15T19:30:03.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 -- 172.21.2.137:0/3672263592 reap_dead start 2021-11-15T19:30:03.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd3888f9700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd370004f70 0x7fd37000b750 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd384062250 tx=0x7fd38405f9e0).ready entity=mon.1 client_cookie=9e486eacd194b15 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:03.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c00cbe0 con 0x7fd370004f70 2021-11-15T19:30:03.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00cd40 con 0x7fd370004f70 2021-11-15T19:30:03.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd382ffd700 1 -- 172.21.2.137:0/3672263592 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c005b80 con 0x7fd370004f70 2021-11-15T19:30:03.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 -- 172.21.2.137:0/3672263592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd370004f70 msgr2=0x7fd37000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd370004f70 0x7fd37000b750 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd384062250 tx=0x7fd38405f9e0).stop 2021-11-15T19:30:03.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 -- 172.21.2.137:0/3672263592 shutdown_connections 2021-11-15T19:30:03.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.067+0000 7fd38a35c700 1 --2- 172.21.2.137:0/3672263592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd370004f70 0x7fd37000b750 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- 172.21.2.137:0/3672263592 >> 172.21.2.137:0/3672263592 conn(0x7fd3840b4e60 msgr2=0x7fd3840b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:03.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- 172.21.2.137:0/3672263592 shutdown_connections 2021-11-15T19:30:03.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- 172.21.2.137:0/3672263592 wait complete. 2021-11-15T19:30:03.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 Processor -- start 2021-11-15T19:30:03.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- start start 2021-11-15T19:30:03.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370004f70 0x7fd3841474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3841479b0 0x7fd384140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 0x7fd3841414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841465a0 con 0x7fd3841479b0 2021-11-15T19:30:03.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384145720 con 0x7fd384142990 2021-11-15T19:30:03.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841467d0 con 0x7fd370004f70 2021-11-15T19:30:03.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 0x7fd3841414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 0x7fd3841414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33846/0 (socket says 172.21.2.137:33846) 2021-11-15T19:30:03.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 -- 172.21.2.137:0/2377349018 learned_addr learned my addr 172.21.2.137:0/2377349018 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:03.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 -- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370004f70 msgr2=0x7fd3841474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370004f70 0x7fd3841474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 -- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3841479b0 msgr2=0x7fd384140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3841479b0 0x7fd384140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 -- 172.21.2.137:0/2377349018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384141990 con 0x7fd384142990 2021-11-15T19:30:03.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3888f9700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 0x7fd3841414a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fd384140e50 tx=0x7fd37c013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:03.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c001f00 con 0x7fd384142990 2021-11-15T19:30:03.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00ceb0 con 0x7fd384142990 2021-11-15T19:30:03.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384141b80 con 0x7fd384142990 2021-11-15T19:30:03.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c0074d0 con 0x7fd384142990 2021-11-15T19:30:03.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd384145d20 con 0x7fd384142990 2021-11-15T19:30:03.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd384145d20 con 0x7fd384142990 2021-11-15T19:30:03.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd37c010070 con 0x7fd384142990 2021-11-15T19:30:03.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3817fa700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd364053580 0x7fd364055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.071+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd37c06cad0 con 0x7fd384142990 2021-11-15T19:30:03.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.075+0000 7fd383fff700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd364053580 0x7fd364055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.075+0000 7fd383fff700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd364053580 0x7fd364055a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd37400a000 tx=0x7fd374008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:03.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.075+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd37c043b20 con 0x7fd384142990 2021-11-15T19:30:03.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd384145d20 con 0x7fd384142990 2021-11-15T19:30:03.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd3817fa700 1 -- 172.21.2.137:0/2377349018 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fd37c047140 con 0x7fd384142990 2021-11-15T19:30:03.189 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:03.189 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:28:42.480660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5191":{"gid":5191,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/105473297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":105473297},{"type":"v1","addr":"172.21.2.137:6833","nonce":105473297}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:30:03.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd364053580 msgr2=0x7fd364055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd364053580 0x7fd364055a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd37400a000 tx=0x7fd374008040).stop 2021-11-15T19:30:03.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 msgr2=0x7fd3841414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 0x7fd3841414a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fd384140e50 tx=0x7fd37c013000).stop 2021-11-15T19:30:03.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 shutdown_connections 2021-11-15T19:30:03.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd364053580 0x7fd364055a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd384142990 0x7fd3841414a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3841479b0 0x7fd384140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 --2- 172.21.2.137:0/2377349018 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd370004f70 0x7fd3841474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 >> 172.21.2.137:0/2377349018 conn(0x7fd3840b4e60 msgr2=0x7fd38413d950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:03.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 shutdown_connections 2021-11-15T19:30:03.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.183+0000 7fd38a35c700 1 -- 172.21.2.137:0/2377349018 wait complete. 2021-11-15T19:30:03.193 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 15 2021-11-15T19:30:03.196 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:30:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 Processor -- start 2021-11-15T19:30:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 -- start start 2021-11-15T19:30:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe0c05c770 0x7efe0c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efe0c0b0550 0x7efe0c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c05cb50 con 0x7efe0c14aaa0 2021-11-15T19:30:03.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0b1650 con 0x7efe0c0b0550 2021-11-15T19:30:03.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe113b6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0ad030 con 0x7efe0c05c770 2021-11-15T19:30:03.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efe0c14aaa0 0x7efe0c140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52636/0 (socket says 172.21.2.137:52636) 2021-11-15T19:30:03.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0b7fe700 1 -- 172.21.2.137:0/1144010195 learned_addr learned my addr 172.21.2.137:0/1144010195 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617536243 0 0) 0x7efe0c05cb50 con 0x7efe0c14aaa0 2021-11-15T19:30:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0003260 con 0x7efe0c14aaa0 2021-11-15T19:30:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0a7fc700 1 --2- 172.21.2.137:0/1144010195 >> v2:172.21.2.111:3300/0 conn(0x7efe0c0b0550 0x7efe0c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe0c05c770 0x7efe0c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416620116 0 0) 0x7efdf0003260 con 0x7efe0c14aaa0 2021-11-15T19:30:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe0c05c770 msgr2=0x7efe0c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe0c05c770 0x7efe0c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 >> v2:172.21.2.111:3300/0 conn(0x7efe0c0b0550 msgr2=0x7efe0c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 --2- 172.21.2.137:0/1144010195 >> v2:172.21.2.111:3300/0 conn(0x7efe0c0b0550 0x7efe0c14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0ad2d0 con 0x7efe0c14aaa0 2021-11-15T19:30:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7efe040019e0 con 0x7efe0c14aaa0 2021-11-15T19:30:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 >> v1:172.21.2.137:6789/0 conn(0x7efe0c14aaa0 legacy=0x7efe0c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efdf00037d0 0x7efdf0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efdf0004500 0x7efdf0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf0004f40 0x7efdf000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b1650 con 0x7efdf0004500 2021-11-15T19:30:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0ad030 con 0x7efdf00037d0 2021-11-15T19:30:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000be20 con 0x7efdf0004f40 2021-11-15T19:30:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe0c05c770 0x7efe0c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efdf00037d0 0x7efdf0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0a7fc700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efdf0004500 0x7efdf0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0b7fe700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf0004f40 0x7efdf000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 -- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf0004f40 msgr2=0x7efdf000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf0004f40 0x7efdf000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 -- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efdf0004500 msgr2=0x7efdf0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efdf0004500 0x7efdf0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 -- 172.21.2.137:0/1144010195 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0003260 con 0x7efdf00037d0 2021-11-15T19:30:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0b7fe700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf0004f40 0x7efdf000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe0affd700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efdf00037d0 0x7efdf0003bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7efe00007000 tx=0x7efe00008040).ready entity=mon.1 client_cookie=90d1b4e6ac329e38 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe00012430 con 0x7efdf00037d0 2021-11-15T19:30:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0000c030 con 0x7efdf00037d0 2021-11-15T19:30:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.255+0000 7efe09ffb700 1 -- 172.21.2.137:0/1144010195 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe00012780 con 0x7efdf00037d0 2021-11-15T19:30:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/1144010195 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efdf00037d0 msgr2=0x7efdf0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 --2- 172.21.2.137:0/1144010195 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efdf00037d0 0x7efdf0003bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7efe00007000 tx=0x7efe00008040).stop 2021-11-15T19:30:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 -- 172.21.2.137:0/1144010195 reap_dead start 2021-11-15T19:30:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/1144010195 shutdown_connections 2021-11-15T19:30:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/1144010195 >> 172.21.2.137:0/1144010195 conn(0x7efe0c0631e0 msgr2=0x7efe0c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/1144010195 shutdown_connections 2021-11-15T19:30:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/1144010195 wait complete. 2021-11-15T19:30:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 Processor -- start 2021-11-15T19:30:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- start start 2021-11-15T19:30:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf00037d0 0x7efe0c116b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe0c0665d0 0x7efe0c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 0x7efe0c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0657a0 con 0x7efe0c0665d0 2021-11-15T19:30:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c142c70 con 0x7efe0c0672e0 2021-11-15T19:30:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c1190b0 con 0x7efdf00037d0 2021-11-15T19:30:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 0x7efe0c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 0x7efe0c15a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33866/0 (socket says 172.21.2.137:33866) 2021-11-15T19:30:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 -- 172.21.2.137:0/3694878391 learned_addr learned my addr 172.21.2.137:0/3694878391 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:03.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 -- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf00037d0 msgr2=0x7efe0c116b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf00037d0 0x7efe0c116b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 -- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe0c0665d0 msgr2=0x7efe0c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:03.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe0c0665d0 0x7efe0c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:03.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 -- 172.21.2.137:0/3694878391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c119350 con 0x7efe0c0672e0 2021-11-15T19:30:03.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe0b7fe700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 0x7efe0c15a180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7efe04001b40 tx=0x7efe04009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:03.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe04004b80 con 0x7efe0c0672e0 2021-11-15T19:30:03.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04004ce0 con 0x7efe0c0672e0 2021-11-15T19:30:03.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c066130 con 0x7efe0c0672e0 2021-11-15T19:30:03.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe040072c0 con 0x7efe0c0672e0 2021-11-15T19:30:03.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c067a50 con 0x7efe0c0672e0 2021-11-15T19:30:03.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c0662c0 con 0x7efe0c0672e0 2021-11-15T19:30:03.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe0401b060 con 0x7efe0c0672e0 2021-11-15T19:30:03.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efdfbfff700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efde80536a0 0x7efde8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:03.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.259+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6069+0+0 (secure 0 0 0) 0x7efe0406b3c0 con 0x7efe0c0672e0 2021-11-15T19:30:03.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.263+0000 7efe0affd700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efde80536a0 0x7efde8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:03.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.263+0000 7efe0affd700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efde80536a0 0x7efde8055b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7efe00007000 tx=0x7efe00008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:03.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.263+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe04042520 con 0x7efe0c0672e0 2021-11-15T19:30:03.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:03.371+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efe0c0573d0 con 0x7efe0c0672e0 2021-11-15T19:30:04.272 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:30:04.269+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:30:04.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efdfbfff700 1 -- 172.21.2.137:0/3694878391 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7efe04019030 con 0x7efe0c0672e0 2021-11-15T19:30:04.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efde80536a0 msgr2=0x7efde8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efde80536a0 0x7efde8055b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7efe00007000 tx=0x7efe00008040).stop 2021-11-15T19:30:04.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 msgr2=0x7efe0c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 0x7efe0c15a180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7efe04001b40 tx=0x7efe04009040).stop 2021-11-15T19:30:04.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 shutdown_connections 2021-11-15T19:30:04.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efde80536a0 0x7efde8055b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe0c0672e0 0x7efe0c15a180 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe0c0665d0 0x7efe0c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:04.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 --2- 172.21.2.137:0/3694878391 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efdf00037d0 0x7efe0c116b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:04.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 >> 172.21.2.137:0/3694878391 conn(0x7efe0c0631e0 msgr2=0x7efe0c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:04.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 shutdown_connections 2021-11-15T19:30:04.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.283+0000 7efe113b6700 1 -- 172.21.2.137:0/3694878391 wait complete. 2021-11-15T19:30:04.291 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:30:04.296 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:04.309 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:30:04.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 Processor -- start 2021-11-15T19:30:04.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 -- start start 2021-11-15T19:30:04.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faf280b1340 0x7faf28147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf28143f00 0x7faf28144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf28148190 con 0x7faf280a9f50 2021-11-15T19:30:04.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf280b1720 con 0x7faf280b1340 2021-11-15T19:30:04.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2f844700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28147e70 con 0x7faf28143f00 2021-11-15T19:30:04.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2d5e0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faf280b1340 0x7faf28147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2d5e0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faf280b1340 0x7faf28147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:41116/0 (socket says 172.21.2.137:41116) 2021-11-15T19:30:04.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2d5e0700 1 -- 172.21.2.137:0/3087784798 learned_addr learned my addr 172.21.2.137:0/3087784798 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:04.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2cddf700 1 --2- 172.21.2.137:0/3087784798 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf28143f00 0x7faf28144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.343+0000 7faf2dde1700 1 --1- 172.21.2.137:0/3087784798 >> v1:172.21.2.111:6789/0 conn(0x7faf280a9f50 0x7faf280aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:45162/0 (socket says 172.21.2.137:45162) 2021-11-15T19:30:04.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2cddf700 1 -- 172.21.2.137:0/3087784798 >> v2:172.21.2.111:3300/0 conn(0x7faf280b1340 msgr2=0x7faf28147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:04.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2cddf700 1 --2- 172.21.2.137:0/3087784798 >> v2:172.21.2.111:3300/0 conn(0x7faf280b1340 0x7faf28147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2cddf700 1 -- 172.21.2.137:0/3087784798 >> v1:172.21.2.111:6789/0 conn(0x7faf280a9f50 legacy=0x7faf280aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2cddf700 1 -- 172.21.2.137:0/3087784798 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280af800 con 0x7faf28143f00 2021-11-15T19:30:04.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2cddf700 1 --2- 172.21.2.137:0/3087784798 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf28143f00 0x7faf28144360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faf18002f70 tx=0x7faf18006df0).ready entity=mon.2 client_cookie=569659b6775fb1ab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:04.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf17fff700 1 -- 172.21.2.137:0/3087784798 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1800d570 con 0x7faf28143f00 2021-11-15T19:30:04.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf17fff700 1 -- 172.21.2.137:0/3087784798 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18000e90 con 0x7faf28143f00 2021-11-15T19:30:04.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf17fff700 1 -- 172.21.2.137:0/3087784798 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1800d8c0 con 0x7faf28143f00 2021-11-15T19:30:04.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/3087784798 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf28143f00 msgr2=0x7faf28144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 --2- 172.21.2.137:0/3087784798 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf28143f00 0x7faf28144360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faf18002f70 tx=0x7faf18006df0).stop 2021-11-15T19:30:04.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/3087784798 shutdown_connections 2021-11-15T19:30:04.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 --2- 172.21.2.137:0/3087784798 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf28143f00 0x7faf28144360 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 --2- 172.21.2.137:0/3087784798 >> v2:172.21.2.111:3300/0 conn(0x7faf280b1340 0x7faf28147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/3087784798 >> 172.21.2.137:0/3087784798 conn(0x7faf280b4e60 msgr2=0x7faf280b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:04.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/3087784798 shutdown_connections 2021-11-15T19:30:04.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/3087784798 wait complete. 2021-11-15T19:30:04.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 Processor -- start 2021-11-15T19:30:04.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- start start 2021-11-15T19:30:04.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf280a9f50 0x7faf280b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf280b1340 0x7faf280ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 0x7faf28148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28148a70 con 0x7faf280b1340 2021-11-15T19:30:04.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2814a4f0 con 0x7faf28143f00 2021-11-15T19:30:04.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28148c90 con 0x7faf280a9f50 2021-11-15T19:30:04.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 0x7faf28148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 0x7faf28148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33898/0 (socket says 172.21.2.137:33898) 2021-11-15T19:30:04.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 -- 172.21.2.137:0/1777334260 learned_addr learned my addr 172.21.2.137:0/1777334260 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:04.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2d5e0700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf280a9f50 0x7faf280b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 -- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf280a9f50 msgr2=0x7faf280b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf280a9f50 0x7faf280b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 -- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf280b1340 msgr2=0x7faf280ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf280b1340 0x7faf280ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:04.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 -- 172.21.2.137:0/1777334260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1800b180 con 0x7faf28143f00 2021-11-15T19:30:04.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2dde1700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 0x7faf28148580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7faf280b4590 tx=0x7faf20007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:04.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf20005ae0 con 0x7faf28143f00 2021-11-15T19:30:04.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20005c40 con 0x7faf28143f00 2021-11-15T19:30:04.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf28148f30 con 0x7faf28143f00 2021-11-15T19:30:04.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf200070d0 con 0x7faf28143f00 2021-11-15T19:30:04.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf280aed30 con 0x7faf28143f00 2021-11-15T19:30:04.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.347+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf280573d0 con 0x7faf28143f00 2021-11-15T19:30:04.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.351+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf20010070 con 0x7faf28143f00 2021-11-15T19:30:04.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.351+0000 7faf167fc700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf080536a0 0x7faf08055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.351+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6155+0+0 (secure 0 0 0) 0x7faf2006b060 con 0x7faf28143f00 2021-11-15T19:30:04.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.351+0000 7faf2d5e0700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf080536a0 0x7faf08055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.351+0000 7faf2d5e0700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf080536a0 0x7faf08055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7faf24008000 tx=0x7faf24008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:04.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.351+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf20042170 con 0x7faf28143f00 2021-11-15T19:30:04.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf28148190 con 0x7faf28143f00 2021-11-15T19:30:04.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf167fc700 1 -- 172.21.2.137:0/1777334260 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1774 (secure 0 0 0) 0x7faf28148190 con 0x7faf28143f00 2021-11-15T19:30:04.468 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:04.468 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:28:41.474267+0000","modified":"2021-11-15T19:30:04.271703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T19:30:04.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf080536a0 msgr2=0x7faf08055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf080536a0 0x7faf08055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7faf24008000 tx=0x7faf24008040).stop 2021-11-15T19:30:04.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 msgr2=0x7faf28148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 0x7faf28148580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7faf280b4590 tx=0x7faf20007f60).stop 2021-11-15T19:30:04.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 shutdown_connections 2021-11-15T19:30:04.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf080536a0 0x7faf08055b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf28143f00 0x7faf28148580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf280b1340 0x7faf280ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:04.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 --2- 172.21.2.137:0/1777334260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf280a9f50 0x7faf280b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 >> 172.21.2.137:0/1777334260 conn(0x7faf280b4e60 msgr2=0x7faf28145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:04.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 shutdown_connections 2021-11-15T19:30:04.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.463+0000 7faf2f844700 1 -- 172.21.2.137:0/1777334260 wait complete. 2021-11-15T19:30:04.472 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 16 2021-11-15T19:30:04.475 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:30:04.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 Processor -- start 2021-11-15T19:30:04.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 -- start start 2021-11-15T19:30:04.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c05c770 0x7f476c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f476c140aa0 0x7f476c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c05cb50 con 0x7f476c0b0550 2021-11-15T19:30:04.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476c0b1650 con 0x7f476c140aa0 2021-11-15T19:30:04.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f4771f7b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c0ad030 con 0x7f476c05c770 2021-11-15T19:30:04.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f476c140aa0 0x7f476c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f476c140aa0 0x7f476c140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33902/0 (socket says 172.21.2.137:33902) 2021-11-15T19:30:04.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 -- 172.21.2.137:0/164142353 learned_addr learned my addr 172.21.2.137:0/164142353 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:04.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 -- 172.21.2.137:0/164142353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c05c770 msgr2=0x7f476c0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:04.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 --2- 172.21.2.137:0/164142353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c05c770 0x7f476c0aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:04.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 -- 172.21.2.137:0/164142353 >> v1:172.21.2.111:6789/0 conn(0x7f476c0b0550 legacy=0x7f476c14a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:04.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 -- 172.21.2.137:0/164142353 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c0ad2d0 con 0x7f476c140aa0 2021-11-15T19:30:04.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476bfff700 1 --2- 172.21.2.137:0/164142353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c140f10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f476c0adfd0 tx=0x7f4764009290).ready entity=mon.1 client_cookie=952c85e96767968e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:04.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476a7fc700 1 -- 172.21.2.137:0/164142353 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476400b860 con 0x7f476c140aa0 2021-11-15T19:30:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476a7fc700 1 -- 172.21.2.137:0/164142353 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476400b9c0 con 0x7f476c140aa0 2021-11-15T19:30:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.571+0000 7f476a7fc700 1 -- 172.21.2.137:0/164142353 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476400bb70 con 0x7f476c140aa0 2021-11-15T19:30:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/164142353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 msgr2=0x7f476c140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 --2- 172.21.2.137:0/164142353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c140f10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f476c0adfd0 tx=0x7f4764009290).stop 2021-11-15T19:30:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/164142353 shutdown_connections 2021-11-15T19:30:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 --2- 172.21.2.137:0/164142353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c140f10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 --2- 172.21.2.137:0/164142353 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c05c770 0x7f476c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/164142353 >> 172.21.2.137:0/164142353 conn(0x7f476c0631e0 msgr2=0x7f476c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/164142353 shutdown_connections 2021-11-15T19:30:04.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/164142353 wait complete. 2021-11-15T19:30:04.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 Processor -- start 2021-11-15T19:30:04.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- start start 2021-11-15T19:30:04.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f476c05c770 0x7f476c14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c0b0550 0x7f476c143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c145a20 con 0x7f476c05c770 2021-11-15T19:30:04.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c143040 con 0x7f476c140aa0 2021-11-15T19:30:04.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c147ff0 con 0x7f476c0b0550 2021-11-15T19:30:04.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33912/0 (socket says 172.21.2.137:33912) 2021-11-15T19:30:04.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 -- 172.21.2.137:0/3654043703 learned_addr learned my addr 172.21.2.137:0/3654043703 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:04.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476b7fe700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f476c05c770 0x7f476c14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 -- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c0b0550 msgr2=0x7f476c143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476affd700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c0b0550 0x7f476c143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c0b0550 0x7f476c143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 -- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f476c05c770 msgr2=0x7f476c14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:04.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f476c05c770 0x7f476c14ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:04.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 -- 172.21.2.137:0/3654043703 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764009530 con 0x7f476c140aa0 2021-11-15T19:30:04.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476affd700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c0b0550 0x7f476c143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:04.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f476bfff700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c146560 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f476c143570 tx=0x7f4764016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:04.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4764021630 con 0x7f476c140aa0 2021-11-15T19:30:04.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764021790 con 0x7f476c140aa0 2021-11-15T19:30:04.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c143650 con 0x7f476c140aa0 2021-11-15T19:30:04.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c144280 con 0x7f476c140aa0 2021-11-15T19:30:04.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4764021af0 con 0x7f476c140aa0 2021-11-15T19:30:04.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c0ae7f0 con 0x7f476c140aa0 2021-11-15T19:30:04.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f476400f070 con 0x7f476c140aa0 2021-11-15T19:30:04.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.575+0000 7f4768ff9700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47500536d0 0x7f4750055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:04.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.579+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f476406d720 con 0x7f476c140aa0 2021-11-15T19:30:04.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.579+0000 7f476b7fe700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47500536d0 0x7f4750055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:04.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.579+0000 7f476b7fe700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47500536d0 0x7f4750055b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f475c00a000 tx=0x7f475c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:04.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.579+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4764044720 con 0x7f476c140aa0 2021-11-15T19:30:04.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:04.687+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f476c0573d0 con 0x7f476c140aa0 2021-11-15T19:30:05.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4768ff9700 1 -- 172.21.2.137:0/3654043703 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f47640150a0 con 0x7f476c140aa0 2021-11-15T19:30:05.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47500536d0 msgr2=0x7f4750055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:05.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47500536d0 0x7f4750055b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f475c00a000 tx=0x7f475c008040).stop 2021-11-15T19:30:05.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 msgr2=0x7f476c146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:05.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c146560 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f476c143570 tx=0x7f4764016000).stop 2021-11-15T19:30:05.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 shutdown_connections 2021-11-15T19:30:05.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47500536d0 0x7f4750055b90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f476c140aa0 0x7f476c146560 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f476c0b0550 0x7f476c143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 --2- 172.21.2.137:0/3654043703 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f476c05c770 0x7f476c14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 >> 172.21.2.137:0/3654043703 conn(0x7f476c0631e0 msgr2=0x7f476c140f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:05.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 shutdown_connections 2021-11-15T19:30:05.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.287+0000 7f4771f7b700 1 -- 172.21.2.137:0/3654043703 wait complete. 2021-11-15T19:30:05.299 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:30:05.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 Processor -- start 2021-11-15T19:30:05.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 -- start start 2021-11-15T19:30:05.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0608f0 0x7f1e3c13f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:05.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1e3c0b1660 0x7f1e3c0b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:05.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0b0c80 con 0x7f1e3c0b2c00 2021-11-15T19:30:05.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0ad6c0 con 0x7f1e3c0b1660 2021-11-15T19:30:05.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.347+0000 7f1e41223700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b0f20 con 0x7f1e3c0608f0 2021-11-15T19:30:05.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0608f0 0x7f1e3c13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:05.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1e3c0b1660 0x7f1e3c0b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:05.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3b59e700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f1e3c0b2c00 0x7f1e3c05f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:45192/0 (socket says 172.21.2.137:45192) 2021-11-15T19:30:05.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3b59e700 1 -- 172.21.2.137:0/1894662046 learned_addr learned my addr 172.21.2.137:0/1894662046 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:05.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 -- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0608f0 msgr2=0x7f1e3c13f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:05.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 --2- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0608f0 0x7f1e3c13f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 -- 172.21.2.137:0/1894662046 >> v1:172.21.2.111:6789/0 conn(0x7f1e3c0b2c00 legacy=0x7f1e3c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:05.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 -- 172.21.2.137:0/1894662046 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0b11c0 con 0x7f1e3c0b1660 2021-11-15T19:30:05.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 --2- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c0b2710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1e30002f70 tx=0x7f1e30006df0).ready entity=mon.0 client_cookie=24a2c2b2e0ae47f9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:05.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e39d9b700 1 -- 172.21.2.137:0/1894662046 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e30014070 con 0x7f1e3c0b1660 2021-11-15T19:30:05.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e39d9b700 1 -- 172.21.2.137:0/1894662046 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30000e90 con 0x7f1e3c0b1660 2021-11-15T19:30:05.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e39d9b700 1 -- 172.21.2.137:0/1894662046 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e3000fb60 con 0x7f1e3c0b1660 2021-11-15T19:30:05.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 msgr2=0x7f1e3c0b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:05.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 --2- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c0b2710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1e30002f70 tx=0x7f1e30006df0).stop 2021-11-15T19:30:05.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- 172.21.2.137:0/1894662046 shutdown_connections 2021-11-15T19:30:05.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 --2- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c0b2710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 --2- 172.21.2.137:0/1894662046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0608f0 0x7f1e3c13f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- 172.21.2.137:0/1894662046 >> 172.21.2.137:0/1894662046 conn(0x7f1e3c063980 msgr2=0x7f1e3c063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:05.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- 172.21.2.137:0/1894662046 shutdown_connections 2021-11-15T19:30:05.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- 172.21.2.137:0/1894662046 wait complete. 2021-11-15T19:30:05.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 Processor -- start 2021-11-15T19:30:05.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- start start 2021-11-15T19:30:05.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 0x7f1e3c149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:05.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:05.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0b2c00 0x7f1e3c14d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:05.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c14cd00 con 0x7f1e3c0b1660 2021-11-15T19:30:05.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c14dad0 con 0x7f1e3c0608f0 2021-11-15T19:30:05.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e41223700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c13f380 con 0x7f1e3c0b2c00 2021-11-15T19:30:05.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 0x7f1e3c149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:05.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 0x7f1e3c149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33924/0 (socket says 172.21.2.137:33924) 2021-11-15T19:30:05.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 -- 172.21.2.137:0/397067442 learned_addr learned my addr 172.21.2.137:0/397067442 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:05.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3a59c700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:05.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 -- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0b2c00 msgr2=0x7f1e3c14d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:05.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0b2c00 0x7f1e3c14d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:05.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 -- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 msgr2=0x7f1e3c14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:05.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:05.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 -- 172.21.2.137:0/397067442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3000b180 con 0x7f1e3c0608f0 2021-11-15T19:30:05.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.351+0000 7f1e3ad9d700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 0x7f1e3c149bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f1e2c00c000 tx=0x7f1e2c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:05.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e2c010780 con 0x7f1e3c0608f0 2021-11-15T19:30:05.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0108e0 con 0x7f1e3c0608f0 2021-11-15T19:30:05.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e2c010c40 con 0x7f1e3c0608f0 2021-11-15T19:30:05.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c13f620 con 0x7f1e3c0608f0 2021-11-15T19:30:05.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c14b590 con 0x7f1e3c0608f0 2021-11-15T19:30:05.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c0b1ac0 con 0x7f1e3c0608f0 2021-11-15T19:30:05.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e2c01c460 con 0x7f1e3c0608f0 2021-11-15T19:30:05.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e180536a0 0x7f1e18055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:05.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f1e2c06bed0 con 0x7f1e3c0608f0 2021-11-15T19:30:05.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e3a59c700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e180536a0 0x7f1e18055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:05.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e3a59c700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e180536a0 0x7f1e18055b60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1e30019000 tx=0x7f1e30016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:05.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.355+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e2c042f80 con 0x7f1e3c0608f0 2021-11-15T19:30:05.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:05.439+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e3c0573d0 con 0x7f1e3c0608f0 2021-11-15T19:30:06.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.291+0000 7f1e2bfff700 1 -- 172.21.2.137:0/397067442 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1e2c0465a0 con 0x7f1e3c0608f0 2021-11-15T19:30:06.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e180536a0 msgr2=0x7f1e18055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e180536a0 0x7f1e18055b60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1e30019000 tx=0x7f1e30016000).stop 2021-11-15T19:30:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 msgr2=0x7f1e3c149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 0x7f1e3c149bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f1e2c00c000 tx=0x7f1e2c006df0).stop 2021-11-15T19:30:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 shutdown_connections 2021-11-15T19:30:06.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e180536a0 0x7f1e18055b60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:06.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e3c0b2c00 0x7f1e3c14d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:06.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e3c0b1660 0x7f1e3c14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:06.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 --2- 172.21.2.137:0/397067442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e3c0608f0 0x7f1e3c149bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:06.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 >> 172.21.2.137:0/397067442 conn(0x7f1e3c063980 msgr2=0x7f1e3c144900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:06.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 shutdown_connections 2021-11-15T19:30:06.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.295+0000 7f1e41223700 1 -- 172.21.2.137:0/397067442 wait complete. 2021-11-15T19:30:06.302 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:30:06.305 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:30:06.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 Processor -- start 2021-11-15T19:30:06.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- start start 2021-11-15T19:30:06.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f27080af2f0 0x7f2708143290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:06.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080aecf0 con 0x7f27080acab0 2021-11-15T19:30:06.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270813f180 con 0x7f27080b1180 2021-11-15T19:30:06.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708143780 con 0x7f27080af2f0 2021-11-15T19:30:06.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f27077fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f27080b1180 0x7f2708142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52716/0 (socket says 172.21.2.137:52716) 2021-11-15T19:30:06.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f27077fe700 1 -- 172.21.2.137:0/374309102 learned_addr learned my addr 172.21.2.137:0/374309102 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:06.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270cd35700 1 --2- 172.21.2.137:0/374309102 >> v2:172.21.2.137:3300/0 conn(0x7f27080af2f0 0x7f2708143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:06.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270cd35700 1 -- 172.21.2.137:0/374309102 >> v1:172.21.2.137:6789/0 conn(0x7f27080b1180 legacy=0x7f2708142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:06.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270cd35700 1 -- 172.21.2.137:0/374309102 >> v1:172.21.2.111:6789/0 conn(0x7f27080acab0 legacy=0x7f27080b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:06.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270cd35700 1 -- 172.21.2.137:0/374309102 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080aef20 con 0x7f27080af2f0 2021-11-15T19:30:06.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270cd35700 1 --2- 172.21.2.137:0/374309102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f2708143290 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f27080b2bd0 tx=0x7f27000091d0).ready entity=mon.1 client_cookie=ad217b912deba9b1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:06.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f2706ffd700 1 -- 172.21.2.137:0/374309102 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2700009ea0 con 0x7f27080af2f0 2021-11-15T19:30:06.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f2706ffd700 1 -- 172.21.2.137:0/374309102 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000b860 con 0x7f27080af2f0 2021-11-15T19:30:06.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f2706ffd700 1 -- 172.21.2.137:0/374309102 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f270000b9d0 con 0x7f27080af2f0 2021-11-15T19:30:06.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- 172.21.2.137:0/374309102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 msgr2=0x7f2708143290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:06.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 --2- 172.21.2.137:0/374309102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f2708143290 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f27080b2bd0 tx=0x7f27000091d0).stop 2021-11-15T19:30:06.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- 172.21.2.137:0/374309102 shutdown_connections 2021-11-15T19:30:06.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 --2- 172.21.2.137:0/374309102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f2708143290 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:06.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- 172.21.2.137:0/374309102 >> 172.21.2.137:0/374309102 conn(0x7f27080630f0 msgr2=0x7f27080634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:06.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- 172.21.2.137:0/374309102 shutdown_connections 2021-11-15T19:30:06.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- 172.21.2.137:0/374309102 wait complete. 2021-11-15T19:30:06.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 Processor -- start 2021-11-15T19:30:06.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.355+0000 7f270e798700 1 -- start start 2021-11-15T19:30:06.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27080acab0 0x7f2708065640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:06.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f27080664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:06.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27080b1180 0x7f27081556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:06.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708142250 con 0x7f27080b1180 2021-11-15T19:30:06.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081379b0 con 0x7f27080af2f0 2021-11-15T19:30:06.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708066020 con 0x7f27080acab0 2021-11-15T19:30:06.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f27080664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:06.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f27080664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33938/0 (socket says 172.21.2.137:33938) 2021-11-15T19:30:06.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 -- 172.21.2.137:0/2230739541 learned_addr learned my addr 172.21.2.137:0/2230739541 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:06.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 -- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27080acab0 msgr2=0x7f2708065640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:06.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27080acab0 0x7f2708065640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:06.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 -- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27080b1180 msgr2=0x7f27081556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:06.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27080b1180 0x7f27081556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:06.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 -- 172.21.2.137:0/2230739541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700009470 con 0x7f27080af2f0 2021-11-15T19:30:06.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27077fe700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f27080664c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f27080b2c70 tx=0x7f26f0007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:06.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f000ce30 con 0x7f27080af2f0 2021-11-15T19:30:06.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00072e0 con 0x7f27080af2f0 2021-11-15T19:30:06.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708064520 con 0x7f27080af2f0 2021-11-15T19:30:06.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f0005800 con 0x7f27080af2f0 2021-11-15T19:30:06.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2708137770 con 0x7f27080af2f0 2021-11-15T19:30:06.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27080646b0 con 0x7f27080af2f0 2021-11-15T19:30:06.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f26f001a060 con 0x7f27080af2f0 2021-11-15T19:30:06.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27057fa700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26ec053640 0x7f26ec055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:06.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f26f006a7d0 con 0x7f27080af2f0 2021-11-15T19:30:06.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f2707fff700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26ec053640 0x7f26ec055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:06.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.359+0000 7f2707fff700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26ec053640 0x7f26ec055b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f26f8002f90 tx=0x7f26f80069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:06.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.363+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26f0041a90 con 0x7f27080af2f0 2021-11-15T19:30:06.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:06.447+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2708137bb0 con 0x7f27080af2f0 2021-11-15T19:30:07.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f27057fa700 1 -- 172.21.2.137:0/2230739541 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2708137bb0 con 0x7f27080af2f0 2021-11-15T19:30:07.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26ec053640 msgr2=0x7f26ec055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26ec053640 0x7f26ec055b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f26f8002f90 tx=0x7f26f80069b0).stop 2021-11-15T19:30:07.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 msgr2=0x7f27080664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f27080664c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f27080b2c70 tx=0x7f26f0007ca0).stop 2021-11-15T19:30:07.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 shutdown_connections 2021-11-15T19:30:07.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26ec053640 0x7f26ec055b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27080b1180 0x7f27081556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:07.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27080af2f0 0x7f27080664c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 --2- 172.21.2.137:0/2230739541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27080acab0 0x7f2708065640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:07.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 >> 172.21.2.137:0/2230739541 conn(0x7f27080630f0 msgr2=0x7f270806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:07.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 shutdown_connections 2021-11-15T19:30:07.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.307+0000 7f270e798700 1 -- 172.21.2.137:0/2230739541 wait complete. 2021-11-15T19:30:07.316 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:30:07.319 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:30:07.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 Processor -- start 2021-11-15T19:30:07.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 -- start start 2021-11-15T19:30:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 0x7fbaac14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbaac14aaa0 0x7fbaac140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac05cb50 con 0x7fbaac05c770 2021-11-15T19:30:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac0b1650 con 0x7fbaac14aaa0 2021-11-15T19:30:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbab0ec4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0ad030 con 0x7fbaac0b0550 2021-11-15T19:30:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbaaa59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbaac05c770 0x7fbaac0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52730/0 (socket says 172.21.2.137:52730) 2021-11-15T19:30:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbaaa59c700 1 -- 172.21.2.137:0/1002772390 learned_addr learned my addr 172.21.2.137:0/1002772390 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312080383 0 0) 0x7fbaac05cb50 con 0x7fbaac05c770 2021-11-15T19:30:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba8c003260 con 0x7fbaac05c770 2021-11-15T19:30:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.367+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/1002772390 >> v2:172.21.2.111:3300/0 conn(0x7fbaac14aaa0 0x7fbaac140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 0x7fbaac14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2476771682 0 0) 0x7fba8c003260 con 0x7fbaac05c770 2021-11-15T19:30:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 msgr2=0x7fbaac14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 0x7fbaac14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 >> v2:172.21.2.111:3300/0 conn(0x7fbaac14aaa0 msgr2=0x7fbaac140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 --2- 172.21.2.137:0/1002772390 >> v2:172.21.2.111:3300/0 conn(0x7fbaac14aaa0 0x7fbaac140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac0ad2d0 con 0x7fbaac05c770 2021-11-15T19:30:07.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fba9c001660 con 0x7fbaac05c770 2021-11-15T19:30:07.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/1002772390 >> v2:172.21.2.111:3300/0 conn(0x7fbaac14aaa0 0x7fbaac140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:30:07.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 >> v1:172.21.2.137:6789/0 conn(0x7fbaac05c770 legacy=0x7fbaac0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 0x7fba8c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba8c003e00 0x7fba8c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba8c0049f0 0x7fba8c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0b1650 con 0x7fba8c003e00 2021-11-15T19:30:07.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0ad030 con 0x7fba8c0049f0 2021-11-15T19:30:07.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c00b8e0 con 0x7fbaac0b0550 2021-11-15T19:30:07.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba8c0049f0 0x7fba8c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba8c003e00 0x7fba8c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaa59c700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 0x7fba8c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 -- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 msgr2=0x7fba8c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbaac0b0550 0x7fba8c0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 -- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba8c003e00 msgr2=0x7fba8c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba8c003e00 0x7fba8c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 -- 172.21.2.137:0/1002772390 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c003260 con 0x7fba8c0049f0 2021-11-15T19:30:07.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fba8c003e00 0x7fba8c004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:30:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba8c0049f0 0x7fba8c004e70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fbaa400a000 tx=0x7fbaa4008040).ready entity=mon.1 client_cookie=e4b25c18e0b2e54d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaa400c070 con 0x7fba8c0049f0 2021-11-15T19:30:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa400e620 con 0x7fba8c0049f0 2021-11-15T19:30:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa959a700 1 -- 172.21.2.137:0/1002772390 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaa400e980 con 0x7fba8c0049f0 2021-11-15T19:30:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/1002772390 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba8c0049f0 msgr2=0x7fba8c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/1002772390 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fba8c0049f0 0x7fba8c004e70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fbaa400a000 tx=0x7fbaa4008040).stop 2021-11-15T19:30:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 -- 172.21.2.137:0/1002772390 reap_dead start 2021-11-15T19:30:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/1002772390 shutdown_connections 2021-11-15T19:30:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/1002772390 >> 172.21.2.137:0/1002772390 conn(0x7fbaac0631e0 msgr2=0x7fbaac05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/1002772390 shutdown_connections 2021-11-15T19:30:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/1002772390 wait complete. 2021-11-15T19:30:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 Processor -- start 2021-11-15T19:30:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- start start 2021-11-15T19:30:07.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba8c0049f0 0x7fbaac063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 0x7fbaac1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbaac146120 0x7fbaac1409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac146d20 con 0x7fbaac146120 2021-11-15T19:30:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac144c30 con 0x7fbaac149b70 2021-11-15T19:30:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac144ed0 con 0x7fba8c0049f0 2021-11-15T19:30:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 0x7fbaac1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 0x7fbaac1404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33958/0 (socket says 172.21.2.137:33958) 2021-11-15T19:30:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 -- 172.21.2.137:0/645536996 learned_addr learned my addr 172.21.2.137:0/645536996 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:07.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaad9d700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbaac146120 0x7fbaac1409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaa59c700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba8c0049f0 0x7fbaac063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 -- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba8c0049f0 msgr2=0x7fbaac063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba8c0049f0 0x7fbaac063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 -- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbaac146120 msgr2=0x7fbaac1409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbaac146120 0x7fbaac1409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 -- 172.21.2.137:0/645536996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac1454e0 con 0x7fbaac149b70 2021-11-15T19:30:07.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaaa59c700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba8c0049f0 0x7fbaac063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:07.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa9d9b700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 0x7fbaac1404f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fbaac149530 tx=0x7fba94008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:07.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba94013800 con 0x7fbaac149b70 2021-11-15T19:30:07.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94000e90 con 0x7fbaac149b70 2021-11-15T19:30:07.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac140ed0 con 0x7fbaac149b70 2021-11-15T19:30:07.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba94013b50 con 0x7fbaac149b70 2021-11-15T19:30:07.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.371+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac1597a0 con 0x7fbaac149b70 2021-11-15T19:30:07.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac145090 con 0x7fbaac149b70 2021-11-15T19:30:07.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba94013cb0 con 0x7fbaac149b70 2021-11-15T19:30:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbaa37fe700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba90053520 0x7fba900559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fba9406b580 con 0x7fbaac149b70 2021-11-15T19:30:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbaaa59c700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba90053520 0x7fba900559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbaaa59c700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba90053520 0x7fba900559e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fba9c006000 tx=0x7fba9c001c90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:07.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.375+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba940429c0 con 0x7fbaac149b70 2021-11-15T19:30:07.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.463+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbaac0573d0 con 0x7fbaac149b70 2021-11-15T19:30:07.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.471+0000 7fbaa37fe700 1 -- 172.21.2.137:0/645536996 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fba94045fe0 con 0x7fbaac149b70 2021-11-15T19:30:07.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba90053520 msgr2=0x7fba900559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba90053520 0x7fba900559e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fba9c006000 tx=0x7fba9c001c90).stop 2021-11-15T19:30:07.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 msgr2=0x7fbaac1404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 0x7fbaac1404f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fbaac149530 tx=0x7fba94008040).stop 2021-11-15T19:30:07.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 shutdown_connections 2021-11-15T19:30:07.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fba90053520 0x7fba900559e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbaac146120 0x7fbaac1409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbaac149b70 0x7fbaac1404f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 --2- 172.21.2.137:0/645536996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fba8c0049f0 0x7fbaac063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 >> 172.21.2.137:0/645536996 conn(0x7fbaac0631e0 msgr2=0x7fbaac0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:07.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 shutdown_connections 2021-11-15T19:30:07.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.475+0000 7fbab0ec4700 1 -- 172.21.2.137:0/645536996 wait complete. 2021-11-15T19:30:07.486 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-11-15T19:30:07.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 Processor -- start 2021-11-15T19:30:07.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 -- start start 2021-11-15T19:30:07.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f236009afc0 0x7f23600b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 0x7f236009c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236009a480 con 0x7f236005d070 2021-11-15T19:30:07.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600acb40 con 0x7f236009afc0 2021-11-15T19:30:07.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f2364b75700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236005d450 con 0x7f236009c400 2021-11-15T19:30:07.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f235e59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f236005d070 0x7f236009a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52748/0 (socket says 172.21.2.137:52748) 2021-11-15T19:30:07.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f235e59c700 1 -- 172.21.2.137:0/2838667917 learned_addr learned my addr 172.21.2.137:0/2838667917 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:07.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534319820 0 0) 0x7f236009a480 con 0x7f236005d070 2021-11-15T19:30:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.531+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2340003260 con 0x7f236005d070 2021-11-15T19:30:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591992533 0 0) 0x7f2340003260 con 0x7f236005d070 2021-11-15T19:30:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 msgr2=0x7f236009c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 0x7f236009c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 >> v2:172.21.2.111:3300/0 conn(0x7f236009afc0 msgr2=0x7f23600b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 --2- 172.21.2.137:0/2838667917 >> v2:172.21.2.111:3300/0 conn(0x7f236009afc0 0x7f23600b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600643d0 con 0x7f236005d070 2021-11-15T19:30:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f2350001660 con 0x7f236005d070 2021-11-15T19:30:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 >> v1:172.21.2.137:6789/0 conn(0x7f236005d070 legacy=0x7f236009a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340003750 0x7f2340003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 0x7f2340004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2340004b10 0x7f2340004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600acb40 con 0x7f2340003750 2021-11-15T19:30:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236005d450 con 0x7f2340004b10 2021-11-15T19:30:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234000b990 con 0x7f236009c400 2021-11-15T19:30:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2340004b10 0x7f2340004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235e59c700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340003750 0x7f2340003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235dd9b700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 0x7f2340004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 msgr2=0x7f2340004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 0x7f2340004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340003750 msgr2=0x7f2340003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340003750 0x7f2340003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/2838667917 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2340003260 con 0x7f2340004b10 2021-11-15T19:30:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235dd9b700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f236009c400 0x7f2340004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235e59c700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340003750 0x7f2340003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:30:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2340004b10 0x7f2340004f90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f23580032f0 tx=0x7f2358006f90).ready entity=mon.1 client_cookie=38e07aef4fccd55f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235800b460 con 0x7f2340004b10 2021-11-15T19:30:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800b5c0 con 0x7f2340004b10 2021-11-15T19:30:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235d59a700 1 -- 172.21.2.137:0/2838667917 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235800b920 con 0x7f2340004b10 2021-11-15T19:30:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/2838667917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2340004b10 msgr2=0x7f2340004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 --2- 172.21.2.137:0/2838667917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2340004b10 0x7f2340004f90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f23580032f0 tx=0x7f2358006f90).stop 2021-11-15T19:30:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/2838667917 reap_dead start 2021-11-15T19:30:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/2838667917 shutdown_connections 2021-11-15T19:30:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/2838667917 >> 172.21.2.137:0/2838667917 conn(0x7f23600b4640 msgr2=0x7f236005fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/2838667917 shutdown_connections 2021-11-15T19:30:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/2838667917 wait complete. 2021-11-15T19:30:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 Processor -- start 2021-11-15T19:30:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- start start 2021-11-15T19:30:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340004b10 0x7f23600b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2360067aa0 0x7f23600b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 0x7f2360152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600655a0 con 0x7f2340004b10 2021-11-15T19:30:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600b5ae0 con 0x7f23601524d0 2021-11-15T19:30:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600657d0 con 0x7f2360067aa0 2021-11-15T19:30:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 0x7f2360152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 0x7f2360152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33982/0 (socket says 172.21.2.137:33982) 2021-11-15T19:30:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/3640863125 learned_addr learned my addr 172.21.2.137:0/3640863125 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235e59c700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340004b10 0x7f23600b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235dd9b700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2360067aa0 0x7f23600b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2360067aa0 msgr2=0x7f23600b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2360067aa0 0x7f23600b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340004b10 msgr2=0x7f23600b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340004b10 0x7f23600b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 -- 172.21.2.137:0/3640863125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360151fb0 con 0x7f23601524d0 2021-11-15T19:30:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235dd9b700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2360067aa0 0x7f23600b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f235ed9d700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 0x7f2360152960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f23600b37d0 tx=0x7f2358016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2358011800 con 0x7f23601524d0 2021-11-15T19:30:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358011960 con 0x7f23601524d0 2021-11-15T19:30:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2360152e50 con 0x7f23601524d0 2021-11-15T19:30:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2358011cc0 con 0x7f23601524d0 2021-11-15T19:30:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600af4a0 con 0x7f23601524d0 2021-11-15T19:30:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.535+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2360064670 con 0x7f23601524d0 2021-11-15T19:30:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.539+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f235800f070 con 0x7f23601524d0 2021-11-15T19:30:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.539+0000 7f23577fe700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2344053640 0x7f2344055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.539+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f235806cc10 con 0x7f23601524d0 2021-11-15T19:30:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.539+0000 7f235e59c700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2344053640 0x7f2344055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:07.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.539+0000 7f235e59c700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2344053640 0x7f2344055b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f235000d000 tx=0x7f2350009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:07.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.539+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2358044050 con 0x7f23601524d0 2021-11-15T19:30:07.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:07.655+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f23600b1030 con 0x7f23601524d0 2021-11-15T19:30:08.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f23577fe700 1 -- 172.21.2.137:0/3640863125 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v141) v1 ==== 144+0+0 (secure 0 0 0) 0x7f2358047670 con 0x7f23601524d0 2021-11-15T19:30:08.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2344053640 msgr2=0x7f2344055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:08.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2344053640 0x7f2344055b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f235000d000 tx=0x7f2350009040).stop 2021-11-15T19:30:08.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 msgr2=0x7f2360152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:08.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 0x7f2360152960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f23600b37d0 tx=0x7f2358016000).stop 2021-11-15T19:30:08.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 shutdown_connections 2021-11-15T19:30:08.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2344053640 0x7f2344055b00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:08.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23601524d0 0x7f2360152960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:08.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2360067aa0 0x7f23600b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:08.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 --2- 172.21.2.137:0/3640863125 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2340004b10 0x7f23600b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:08.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 >> 172.21.2.137:0/3640863125 conn(0x7f23600b4640 msgr2=0x7f23600ac030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:08.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 shutdown_connections 2021-11-15T19:30:08.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.315+0000 7f2364b75700 1 -- 172.21.2.137:0/3640863125 wait complete. 2021-11-15T19:30:08.328 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T19:30:08.329 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T19:30:08.329 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-11-15T19:30:08.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5faf148700 1 Processor -- start 2021-11-15T19:30:08.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5faf148700 1 -- start start 2021-11-15T19:30:08.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5faf148700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 0x7f5fa80ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5faf148700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa8097c50 con 0x7f5fa80b2d50 2021-11-15T19:30:08.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5faf148700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa8144ee0 con 0x7f5fa80609f0 2021-11-15T19:30:08.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5faf148700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80ac120 con 0x7f5fa80ac3c0 2021-11-15T19:30:08.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fad6e5700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f5fa80609f0 0x7f5fa81447d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52768/0 (socket says 172.21.2.137:52768) 2021-11-15T19:30:08.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fad6e5700 1 -- 172.21.2.137:0/2302784946 learned_addr learned my addr 172.21.2.137:0/2302784946 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:08.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651995996 0 0) 0x7f5fa8144ee0 con 0x7f5fa80609f0 2021-11-15T19:30:08.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f88003260 con 0x7f5fa80609f0 2021-11-15T19:30:08.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795405513 0 0) 0x7f5f88003260 con 0x7f5fa80609f0 2021-11-15T19:30:08.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 msgr2=0x7f5fa80ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:08.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 0x7f5fa80ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:08.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 >> v1:172.21.2.111:6789/0 conn(0x7f5fa80b2d50 legacy=0x7f5fa81440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:08.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa80979b0 con 0x7f5fa80609f0 2021-11-15T19:30:08.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.375+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f5fa00019e0 con 0x7f5fa80609f0 2021-11-15T19:30:08.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 >> v1:172.21.2.137:6789/0 conn(0x7f5fa80609f0 legacy=0x7f5fa81447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:08.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 0x7f5f88003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5f88003df0 0x7f5f88004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5f88004b10 0x7f5f88004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800b910 con 0x7f5f88004b10 2021-11-15T19:30:08.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800ba80 con 0x7f5f88003df0 2021-11-15T19:30:08.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800bc40 con 0x7f5fa80ac3c0 2021-11-15T19:30:08.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5f88003df0 0x7f5f88004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:08.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5facee4700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 0x7f5f88003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:08.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fad6e5700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5f88004b10 0x7f5f88004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:08.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 msgr2=0x7f5f88003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:08.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 0x7f5f88003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:08.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5f88004b10 msgr2=0x7f5f88004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:08.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5f88004b10 0x7f5f88004f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:08.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/2302784946 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88003260 con 0x7f5f88003df0 2021-11-15T19:30:08.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5facee4700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fa80ac3c0 0x7f5f88003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:08.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5f88003df0 0x7f5f88004500 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f5f98000f70 tx=0x7f5f980079e0).ready entity=mon.1 client_cookie=3df6b618287fef71 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:08.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f98007cf0 con 0x7f5f88003df0 2021-11-15T19:30:08.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f98014410 con 0x7f5f88003df0 2021-11-15T19:30:08.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa77fe700 1 -- 172.21.2.137:0/2302784946 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f98014770 con 0x7f5f88003df0 2021-11-15T19:30:08.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/2302784946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5f88003df0 msgr2=0x7f5f88004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:08.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 --2- 172.21.2.137:0/2302784946 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5f88003df0 0x7f5f88004500 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f5f98000f70 tx=0x7f5f980079e0).stop 2021-11-15T19:30:08.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fad6e5700 1 -- 172.21.2.137:0/2302784946 reap_dead start 2021-11-15T19:30:08.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/2302784946 shutdown_connections 2021-11-15T19:30:08.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/2302784946 >> 172.21.2.137:0/2302784946 conn(0x7f5fa80b7070 msgr2=0x7f5fa80b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:08.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/2302784946 shutdown_connections 2021-11-15T19:30:08.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/2302784946 wait complete. 2021-11-15T19:30:08.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 Processor -- start 2021-11-15T19:30:08.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- start start 2021-11-15T19:30:08.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5f88003df0 0x7f5fa8144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 0x7f5fa8061950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fa81420a0 0x7f5fa8142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8141970 con 0x7f5fa81420a0 2021-11-15T19:30:08.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8146f30 con 0x7f5fa80966c0 2021-11-15T19:30:08.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8062150 con 0x7f5f88003df0 2021-11-15T19:30:08.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 0x7f5fa8061950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:08.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 0x7f5fa8061950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:33996/0 (socket says 172.21.2.137:33996) 2021-11-15T19:30:08.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/3947392468 learned_addr learned my addr 172.21.2.137:0/3947392468 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:08.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5f88003df0 msgr2=0x7f5fa8144160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:08.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5f88003df0 0x7f5fa8144160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:08.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fa81420a0 msgr2=0x7f5fa8142550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:08.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fa81420a0 0x7f5fa8142550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:08.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 -- 172.21.2.137:0/3947392468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8142a40 con 0x7f5fa80966c0 2021-11-15T19:30:08.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa7fff700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 0x7f5fa8061950 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f5f98000f70 tx=0x7f5f98015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:08.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f98007cf0 con 0x7f5fa80966c0 2021-11-15T19:30:08.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f98022470 con 0x7f5fa80966c0 2021-11-15T19:30:08.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8146ab0 con 0x7f5fa80966c0 2021-11-15T19:30:08.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f98013ec0 con 0x7f5fa80966c0 2021-11-15T19:30:08.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa81448e0 con 0x7f5fa80966c0 2021-11-15T19:30:08.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.379+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8062310 con 0x7f5fa80966c0 2021-11-15T19:30:08.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.383+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f9802a030 con 0x7f5fa80966c0 2021-11-15T19:30:08.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.383+0000 7f5fa5ffb700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5f8c053580 0x7f5f8c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:08.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.383+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5f9801c040 con 0x7f5fa80966c0 2021-11-15T19:30:08.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.383+0000 7f5facee4700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5f8c053580 0x7f5f8c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:08.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.383+0000 7f5facee4700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5f8c053580 0x7f5f8c055a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5f90007000 tx=0x7f5f90008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:08.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.383+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f980443a0 con 0x7f5fa80966c0 2021-11-15T19:30:08.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:08.499+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f5fa8146e90 con 0x7f5fa80966c0 2021-11-15T19:30:09.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5fa5ffb700 1 -- 172.21.2.137:0/3947392468 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v142) v1 ==== 155+0+0 (secure 0 0 0) 0x7f5f980479c0 con 0x7f5fa80966c0 2021-11-15T19:30:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5f8c053580 msgr2=0x7f5f8c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5f8c053580 0x7f5f8c055a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5f90007000 tx=0x7f5f90008040).stop 2021-11-15T19:30:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 msgr2=0x7f5fa8061950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 0x7f5fa8061950 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f5f98000f70 tx=0x7f5f98015000).stop 2021-11-15T19:30:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 shutdown_connections 2021-11-15T19:30:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5f8c053580 0x7f5f8c055a40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fa81420a0 0x7f5fa8142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fa80966c0 0x7f5fa8061950 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 --2- 172.21.2.137:0/3947392468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5f88003df0 0x7f5fa8144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 >> 172.21.2.137:0/3947392468 conn(0x7f5fa80b7070 msgr2=0x7f5fa80b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 shutdown_connections 2021-11-15T19:30:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.323+0000 7f5faf148700 1 -- 172.21.2.137:0/3947392468 wait complete. 2021-11-15T19:30:09.334 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:30:09.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 Processor -- start 2021-11-15T19:30:09.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- start start 2021-11-15T19:30:09.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fcd9005c770 0x7fcd900aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcd90140aa0 0x7fcd90140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9005cb50 con 0x7fcd900b0550 2021-11-15T19:30:09.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900b1650 con 0x7fcd9005c770 2021-11-15T19:30:09.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900ad030 con 0x7fcd90140aa0 2021-11-15T19:30:09.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcd90140aa0 0x7fcd90140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcd90140aa0 0x7fcd90140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34006/0 (socket says 172.21.2.137:34006) 2021-11-15T19:30:09.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 -- 172.21.2.137:0/3846974986 learned_addr learned my addr 172.21.2.137:0/3846974986 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:09.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 -- 172.21.2.137:0/3846974986 >> v2:172.21.2.111:3300/0 conn(0x7fcd9005c770 msgr2=0x7fcd900aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:09.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 --2- 172.21.2.137:0/3846974986 >> v2:172.21.2.111:3300/0 conn(0x7fcd9005c770 0x7fcd900aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 -- 172.21.2.137:0/3846974986 >> v1:172.21.2.111:6789/0 conn(0x7fcd900b0550 legacy=0x7fcd9014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:09.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 -- 172.21.2.137:0/3846974986 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900ad2d0 con 0x7fcd90140aa0 2021-11-15T19:30:09.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd94b85700 1 --2- 172.21.2.137:0/3846974986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd90140ef0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fcd900aee10 tx=0x7fcd88009290).ready entity=mon.1 client_cookie=88e99e9f9fb5d096 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:09.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd8effd700 1 -- 172.21.2.137:0/3846974986 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8800b830 con 0x7fcd90140aa0 2021-11-15T19:30:09.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd8effd700 1 -- 172.21.2.137:0/3846974986 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8800b990 con 0x7fcd90140aa0 2021-11-15T19:30:09.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd8effd700 1 -- 172.21.2.137:0/3846974986 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8800bb40 con 0x7fcd90140aa0 2021-11-15T19:30:09.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- 172.21.2.137:0/3846974986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 msgr2=0x7fcd90140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 --2- 172.21.2.137:0/3846974986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd90140ef0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fcd900aee10 tx=0x7fcd88009290).stop 2021-11-15T19:30:09.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- 172.21.2.137:0/3846974986 shutdown_connections 2021-11-15T19:30:09.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 --2- 172.21.2.137:0/3846974986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd90140ef0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 --2- 172.21.2.137:0/3846974986 >> v2:172.21.2.111:3300/0 conn(0x7fcd9005c770 0x7fcd900aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- 172.21.2.137:0/3846974986 >> 172.21.2.137:0/3846974986 conn(0x7fcd900631e0 msgr2=0x7fcd9005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:09.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- 172.21.2.137:0/3846974986 shutdown_connections 2021-11-15T19:30:09.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.383+0000 7fcd965e8700 1 -- 172.21.2.137:0/3846974986 wait complete. 2021-11-15T19:30:09.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 Processor -- start 2021-11-15T19:30:09.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- start start 2021-11-15T19:30:09.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcd9005c770 0x7fcd900b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcd900b0550 0x7fcd90159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd901429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90067130 con 0x7fcd9005c770 2021-11-15T19:30:09.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90066e60 con 0x7fcd90140aa0 2021-11-15T19:30:09.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90142500 con 0x7fcd900b0550 2021-11-15T19:30:09.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd901429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd901429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34012/0 (socket says 172.21.2.137:34012) 2021-11-15T19:30:09.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 -- 172.21.2.137:0/1515048801 learned_addr learned my addr 172.21.2.137:0/1515048801 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:09.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 -- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcd900b0550 msgr2=0x7fcd90159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcd900b0550 0x7fcd90159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 -- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcd9005c770 msgr2=0x7fcd900b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcd9005c770 0x7fcd900b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 -- 172.21.2.137:0/1515048801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88009530 con 0x7fcd90140aa0 2021-11-15T19:30:09.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd94b85700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd901429d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fcd900aee10 tx=0x7fcd88016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:09.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8800bdb0 con 0x7fcd90140aa0 2021-11-15T19:30:09.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8801f420 con 0x7fcd90140aa0 2021-11-15T19:30:09.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8801f780 con 0x7fcd90140aa0 2021-11-15T19:30:09.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90064d00 con 0x7fcd90140aa0 2021-11-15T19:30:09.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900651b0 con 0x7fcd90140aa0 2021-11-15T19:30:09.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd901426c0 con 0x7fcd90140aa0 2021-11-15T19:30:09.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd8800f070 con 0x7fcd90140aa0 2021-11-15T19:30:09.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8d7fa700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcd740536a0 0x7fcd74055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fcd8806c1f0 con 0x7fcd90140aa0 2021-11-15T19:30:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8ffff700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcd740536a0 0x7fcd74055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.387+0000 7fcd8ffff700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcd740536a0 0x7fcd74055b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fcd78002f70 tx=0x7fcd78006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:09.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.391+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd88043630 con 0x7fcd90140aa0 2021-11-15T19:30:09.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.475+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcd90066fa0 con 0x7fcd90140aa0 2021-11-15T19:30:09.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd8d7fa700 1 -- 172.21.2.137:0/1515048801 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd88015070 con 0x7fcd90140aa0 2021-11-15T19:30:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcd740536a0 msgr2=0x7fcd74055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcd740536a0 0x7fcd74055b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fcd78002f70 tx=0x7fcd78006a80).stop 2021-11-15T19:30:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 msgr2=0x7fcd901429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd901429d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fcd900aee10 tx=0x7fcd88016000).stop 2021-11-15T19:30:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 shutdown_connections 2021-11-15T19:30:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcd740536a0 0x7fcd74055b60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcd90140aa0 0x7fcd901429d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcd900b0550 0x7fcd90159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 --2- 172.21.2.137:0/1515048801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcd9005c770 0x7fcd900b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 >> 172.21.2.137:0/1515048801 conn(0x7fcd900631e0 msgr2=0x7fcd900b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 shutdown_connections 2021-11-15T19:30:09.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.487+0000 7fcd965e8700 1 -- 172.21.2.137:0/1515048801 wait complete. 2021-11-15T19:30:09.499 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:30:09.500 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:09.509 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:09.522 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:09.535 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:09.549 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:30:09.559 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:30:09.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:09.559 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:09.560 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:09.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:09.564 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:30:09.564 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:30:09.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:09.565 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:09.566 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:30:09.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:09.571 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:30:09.572 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:30:09.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:09.573 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:09.573 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:30:09.578 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:30:09.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:09.580 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:30:09.580 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:30:09.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.647+0000 7f67c95ed700 1 Processor -- start 2021-11-15T19:30:09.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.647+0000 7f67c95ed700 1 -- start start 2021-11-15T19:30:09.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40b1340 0x7f67c4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67c4143f00 0x7f67c4144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f67c40a9f50 0x7f67c40aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c4148190 con 0x7f67c40a9f50 2021-11-15T19:30:09.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c40b1720 con 0x7f67c4143f00 2021-11-15T19:30:09.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4147e70 con 0x7f67c40b1340 2021-11-15T19:30:09.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67c4143f00 0x7f67c4144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67c4143f00 0x7f67c4144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34018/0 (socket says 172.21.2.137:34018) 2021-11-15T19:30:09.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 -- 172.21.2.137:0/2151742608 learned_addr learned my addr 172.21.2.137:0/2151742608 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:09.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 -- 172.21.2.137:0/2151742608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40b1340 msgr2=0x7f67c4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:09.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 --2- 172.21.2.137:0/2151742608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40b1340 0x7f67c4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 -- 172.21.2.137:0/2151742608 >> v2:172.21.2.111:3300/0 conn(0x7f67c40a9f50 msgr2=0x7f67c40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:09.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 --2- 172.21.2.137:0/2151742608 >> v2:172.21.2.111:3300/0 conn(0x7f67c40a9f50 0x7f67c40aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 -- 172.21.2.137:0/2151742608 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c40af800 con 0x7f67c4143f00 2021-11-15T19:30:09.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 --2- 172.21.2.137:0/2151742608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c4144360 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f67b4002f70 tx=0x7f67b4006eb0).ready entity=mon.1 client_cookie=25bdd6180d6ed4f3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:09.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c1ffb700 1 -- 172.21.2.137:0/2151742608 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b400d570 con 0x7f67c4143f00 2021-11-15T19:30:09.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c1ffb700 1 -- 172.21.2.137:0/2151742608 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b4000e90 con 0x7f67c4143f00 2021-11-15T19:30:09.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c1ffb700 1 -- 172.21.2.137:0/2151742608 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b400d900 con 0x7f67c4143f00 2021-11-15T19:30:09.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2151742608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 msgr2=0x7f67c4144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2151742608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c4144360 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f67b4002f70 tx=0x7f67b4006eb0).stop 2021-11-15T19:30:09.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2151742608 shutdown_connections 2021-11-15T19:30:09.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2151742608 >> v2:172.21.2.111:3300/0 conn(0x7f67c40a9f50 0x7f67c40aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2151742608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c4144360 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2151742608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40b1340 0x7f67c4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:09.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2151742608 >> 172.21.2.137:0/2151742608 conn(0x7f67c40b4e60 msgr2=0x7f67c40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:09.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2151742608 shutdown_connections 2021-11-15T19:30:09.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2151742608 wait complete. 2021-11-15T19:30:09.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 Processor -- start 2021-11-15T19:30:09.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- start start 2021-11-15T19:30:09.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40a9f50 0x7f67c415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67c40b1340 0x7f67c40b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c413d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40ad890 con 0x7f67c40b1340 2021-11-15T19:30:09.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c414af00 con 0x7f67c4143f00 2021-11-15T19:30:09.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c414b1a0 con 0x7f67c40a9f50 2021-11-15T19:30:09.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c413d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c413d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34026/0 (socket says 172.21.2.137:34026) 2021-11-15T19:30:09.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 -- 172.21.2.137:0/2484306816 learned_addr learned my addr 172.21.2.137:0/2484306816 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:09.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c27fc700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67c40b1340 0x7f67c40b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c2ffd700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40a9f50 0x7f67c415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 -- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40a9f50 msgr2=0x7f67c415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40a9f50 0x7f67c415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 -- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67c40b1340 msgr2=0x7f67c40b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67c40b1340 0x7f67c40b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 -- 172.21.2.137:0/2484306816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b400b1e0 con 0x7f67c4143f00 2021-11-15T19:30:09.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c37fe700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c413d970 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f67bc0032f0 tx=0x7f67bc0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:09.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67bc00e470 con 0x7f67c4143f00 2021-11-15T19:30:09.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc00e5d0 con 0x7f67c4143f00 2021-11-15T19:30:09.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c40ae690 con 0x7f67c4143f00 2021-11-15T19:30:09.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67bc00e930 con 0x7f67c4143f00 2021-11-15T19:30:09.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.651+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c413de60 con 0x7f67c4143f00 2021-11-15T19:30:09.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c414b360 con 0x7f67c4143f00 2021-11-15T19:30:09.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67bc018030 con 0x7f67c4143f00 2021-11-15T19:30:09.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67bbfff700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67a80536a0 0x7f67a8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:09.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f67bc06aed0 con 0x7f67c4143f00 2021-11-15T19:30:09.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67c2ffd700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67a80536a0 0x7f67a8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:09.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67c2ffd700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67a80536a0 0x7f67a8055b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f67ac00c000 tx=0x7f67ac008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:09.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.655+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67bc042340 con 0x7f67c4143f00 2021-11-15T19:30:09.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f67c405faf0 con 0x7f67c4143f00 2021-11-15T19:30:09.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67bbfff700 1 -- 172.21.2.137:0/2484306816 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+28825 (secure 0 0 0) 0x7f67bc0270b0 con 0x7f67c4143f00 2021-11-15T19:30:09.745 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:09.745 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:30:09.745 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 45, 2021-11-15T19:30:09.746 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:30:09.746 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:30:09.746 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:30:07.297012+0000", 2021-11-15T19:30:09.746 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:30:09.747 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:30:09.747 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:30:09.747 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:30:09.747 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:30:09.748 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:30:09.748 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:30:09.748 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:30:09.748 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:30:09.748 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:09.749 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:30:09.749 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:30:09.749 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:30:09.749 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:30:09.750 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:30:09.750 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 8, 2021-11-15T19:30:09.750 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:30:09.750 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:30:09.750 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:30:09.751 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:30:09.751 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:30:09.751 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.751 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:30:09.752 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:30:09.752 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:30:09.752 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:30:09.752 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:30:09.753 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:30:09.753 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:30:09.753 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:30:09.753 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:30:09.753 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:30:09.754 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:30:09.754 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:30:09.754 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:30:09.754 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:30:09.755 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:30:09.755 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:30:09.755 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:30:09.755 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:30:09.755 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:30:09.756 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:30:09.756 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:30:09.756 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:30:09.756 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:30:09.757 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.757 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:30:09.757 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:30:09.757 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:30:09.757 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:30:09.758 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:30:09.758 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:30:09.758 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:30:09.758 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:30:09.759 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:30:09.759 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:30:09.759 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:30:09.759 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:30:09.759 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:30:09.760 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:30:09.760 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:30:09.760 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:30:09.760 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:30:09.761 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:30:09.761 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:30:09.761 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:30:09.761 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:30:09.761 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:30:09.762 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:30:09.762 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:30:09.762 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:30:09.762 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:30:09.763 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:30:09.763 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.763 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:30:09.763 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:30:09.763 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:30:09.764 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:30:09.764 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:30:09.764 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:30:09.764 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:30:09.765 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:30:09.765 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:30:09.765 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:30:09.765 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:30:09.765 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:30:09.766 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:30:09.766 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.766 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:30:09.766 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:30:09.767 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.767 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.767 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.767 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:30:09.767 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:30:09.768 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:30:09.768 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:30:09.768 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:30:09.768 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:30:09.769 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:30:09.769 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:30:09.769 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:30:09.769 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:30:09.769 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:30:09.770 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:30:09.770 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:30:09.770 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:30:09.770 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:30:09.771 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:30:09.771 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:30:09.771 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:30:09.771 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:30:09.771 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:30:09.772 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:30:09.772 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:30:09.772 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:30:09.772 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.772 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:30:09.773 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:30:09.773 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:30:09.773 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:30:09.773 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:30:09.774 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:30:09.774 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:30:09.774 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:30:09.774 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:30:09.774 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:30:09.775 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:30:09.775 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:30:09.775 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:30:09.775 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:30:09.776 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:30:09.776 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:30:09.776 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:30:09.776 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:30:09.776 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:30:09.777 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:30:09.777 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:30:09.777 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:30:09.777 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:30:09.778 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:30:09.778 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:30:09.778 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:30:09.778 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:30:09.779 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.779 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:30:09.779 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:30:09.779 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:30:09.779 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:30:09.780 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:30:09.780 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:30:09.780 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:30:09.780 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:30:09.781 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:30:09.781 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:30:09.781 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:30:09.781 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:30:09.781 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:30:09.782 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:30:09.782 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.782 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.782 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:09.783 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:30:09.783 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.783 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:30:09.783 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:30:09.784 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.784 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.784 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.784 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.784 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.785 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.785 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.785 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:09.785 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.785 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.786 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.786 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.786 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.786 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.787 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:30:09.787 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.787 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.787 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.787 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.788 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:30:09.788 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.788 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.788 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.788 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.789 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.789 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.789 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.789 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.790 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:30:09.790 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.790 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.790 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.791 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:30:09.791 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.791 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.791 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.792 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.792 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.792 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.792 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.792 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.793 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:30:09.793 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.793 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.793 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.794 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.794 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:30:09.794 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.794 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.794 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.795 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.795 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.795 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.795 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.796 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.796 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:30:09.796 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.796 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.797 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.797 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:30:09.797 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:30:09.798 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.798 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.798 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.798 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:30:09.799 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:30:09.799 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:30:09.799 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:30:09.799 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.799 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.800 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.800 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.800 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.800 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.801 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:30:09.801 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:30:09.801 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.801 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.802 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.802 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.802 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.802 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.802 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.803 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 40, 2021-11-15T19:30:09.803 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.803 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.803 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.803 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.804 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.804 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.804 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:30:09.804 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.805 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.805 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.805 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.805 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:30:09.806 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.806 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.806 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.806 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.806 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.807 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.807 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.807 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.808 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:30:09.808 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.808 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.808 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.808 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.809 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:30:09.809 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.809 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.809 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.810 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.810 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.810 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.810 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.810 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.811 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:30:09.811 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.811 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.811 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.812 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.812 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:30:09.812 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.812 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.813 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.813 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.813 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.813 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.813 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.814 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.814 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:30:09.814 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.814 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.815 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.815 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.815 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:30:09.815 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:30:09.816 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.816 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.816 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.816 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:30:09.816 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:30:09.817 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:30:09.817 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:30:09.817 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.817 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.818 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.818 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.818 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.818 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.819 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:30:09.819 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:30:09.819 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.819 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.819 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.820 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.820 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.820 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.820 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.821 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 26, 2021-11-15T19:30:09.821 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.821 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.821 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.822 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.822 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.822 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.822 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:30:09.822 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.823 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.823 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.823 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.823 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:30:09.824 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.824 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.824 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.824 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.824 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.825 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.825 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.825 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.825 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:30:09.826 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.826 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.826 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.826 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.827 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:30:09.827 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.827 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.827 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.827 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.828 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.828 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.828 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.828 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.829 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:30:09.829 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.829 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.829 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.830 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.830 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:30:09.830 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.830 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.830 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.831 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.831 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.831 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.831 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.832 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.832 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:30:09.832 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.832 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.832 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.833 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.833 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:30:09.833 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:30:09.833 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.834 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.834 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.834 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:30:09.834 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:30:09.835 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:30:09.835 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:30:09.835 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.835 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.836 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.836 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.836 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.836 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.836 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:30:09.837 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:30:09.837 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.837 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.837 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.838 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.838 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.838 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.838 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.839 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:09.839 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.839 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.839 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.839 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.840 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.840 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.840 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:30:09.840 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.841 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.841 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.841 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.841 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:30:09.842 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.842 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.842 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.842 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.843 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.843 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.843 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.843 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.844 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:30:09.844 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.844 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.844 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.845 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.845 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:30:09.845 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.845 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.845 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.846 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.846 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.846 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.846 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.847 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.847 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:30:09.847 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.847 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.847 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.848 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.848 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:30:09.848 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.848 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.848 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.849 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.849 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.849 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.849 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.849 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.850 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:30:09.850 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.850 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.850 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.851 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.851 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:30:09.851 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:30:09.851 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.851 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.852 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.852 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:30:09.852 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:30:09.852 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:30:09.853 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:30:09.853 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.853 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.853 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.853 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.854 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.854 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.854 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:30:09.854 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:30:09.854 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.855 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.855 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.855 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.855 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.856 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.856 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.856 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:09.856 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.856 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.856 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.857 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.857 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.857 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.857 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:30:09.858 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.858 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.858 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.858 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:30:09.859 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.859 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.859 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.859 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.860 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.860 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.860 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.860 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.860 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:30:09.861 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.861 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.861 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.861 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.861 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:30:09.862 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.862 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.862 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.862 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.862 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.863 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.863 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.863 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.863 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:30:09.863 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.864 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.864 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.864 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.864 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:30:09.865 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.865 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.865 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.865 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.865 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.866 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.866 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.866 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.866 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:30:09.867 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.867 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.867 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.867 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.868 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:30:09.868 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:30:09.868 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.868 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.869 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.869 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:30:09.869 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:30:09.869 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:30:09.869 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:30:09.870 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.870 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.870 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.870 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.871 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.871 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.871 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:30:09.871 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:30:09.871 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.872 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.872 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.872 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.872 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.873 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.873 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.873 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:09.873 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.874 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.874 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.874 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.874 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.874 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.875 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:30:09.875 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.875 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.875 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.875 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.876 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:30:09.876 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.876 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.876 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.876 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.877 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.877 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.877 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.877 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.878 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:30:09.878 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.878 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.878 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.878 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.879 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:30:09.879 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.879 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.879 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.880 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.880 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.880 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.880 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.881 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.881 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:30:09.881 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.881 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.881 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.882 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.882 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:30:09.882 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.882 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.883 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.883 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.883 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.883 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.884 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.884 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.884 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:30:09.884 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.884 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.885 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.885 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.885 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:30:09.885 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:30:09.885 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.886 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.886 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.886 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:30:09.886 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:30:09.887 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:30:09.887 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:30:09.887 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.887 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.887 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.888 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.888 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.888 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.888 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:30:09.889 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:30:09.889 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.889 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.889 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.889 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.890 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.890 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.890 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.890 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 38, 2021-11-15T19:30:09.890 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.891 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.891 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.891 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.891 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.891 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.892 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:30:09.892 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.892 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.892 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.892 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.893 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:30:09.893 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.893 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.893 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.894 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.894 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.894 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.894 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.894 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.895 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:30:09.895 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.895 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.895 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.895 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.896 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:30:09.896 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.896 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.896 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.897 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.897 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.897 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.897 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.897 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.898 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:30:09.898 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.898 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.898 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.899 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.899 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:30:09.899 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.899 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.899 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.900 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.900 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.900 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.900 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.900 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.901 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:30:09.901 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.901 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.901 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.902 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.902 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:30:09.902 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:30:09.902 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.903 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.903 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.903 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:30:09.903 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:30:09.903 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:30:09.904 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:30:09.904 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.904 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.904 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.904 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.905 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.905 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.905 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:30:09.905 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:30:09.905 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:30:09.906 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:30:09.906 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:30:09.906 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:30:09.906 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:30:09.907 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:30:09.907 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:30:09.907 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 37, 2021-11-15T19:30:09.907 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:30:09.907 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:30:09.908 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:30:09.908 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.908 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.908 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.908 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:30:09.909 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.909 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.909 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.909 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.909 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:30:09.910 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.910 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.910 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.910 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.911 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:30:09.911 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.911 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.911 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.911 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:30:09.912 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.912 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.912 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.912 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.912 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:30:09.913 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.913 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.913 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.913 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.913 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:30:09.914 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.914 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.914 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.914 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:30:09.914 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.915 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.915 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.915 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.915 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:30:09.915 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.916 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.916 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.916 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.916 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:30:09.916 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:30:09.917 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.917 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:30:09.917 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:30:09.917 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.917 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.918 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.918 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:30:09.918 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:30:09.918 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:30:09.918 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.919 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.919 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.919 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:30:09.919 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:30:09.919 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:30:09.920 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:30:09.920 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:30:09.920 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:30:09.920 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:30:09.920 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:09.921 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.921 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:09.921 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:30:09.921 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.921 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:30:09.922 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.922 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.922 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.922 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.923 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.923 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:30:09.923 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.923 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.923 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.924 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:30:09.924 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.924 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.924 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.925 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.925 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.925 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:30:09.925 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.925 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.926 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.926 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:30:09.926 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.926 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.926 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.927 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.927 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.927 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:30:09.927 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.927 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.928 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.928 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:30:09.928 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.928 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.928 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.929 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.929 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.929 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:30:09.929 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.930 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.930 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.930 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:30:09.930 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.930 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.931 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.931 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.931 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.931 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:30:09.931 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.932 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.932 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.932 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:30:09.932 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.932 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.933 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.933 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.933 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.933 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:30:09.934 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.934 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.934 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.934 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:30:09.934 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.935 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.935 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.935 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.935 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.935 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:30:09.936 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.936 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.936 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:09.936 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:30:09.936 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:30:09.937 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:30:09.937 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:30:09.937 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:30:09.937 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:30:09.937 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:30:09.938 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:30:09.938 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.938 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:30:09.938 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:30:09.938 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:30:09.939 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:30:09.939 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:30:09.939 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:30:09.939 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/105473297": "2021-11-16T19:30:03.377768+0000", 2021-11-15T19:30:09.939 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/105473297": "2021-11-16T19:30:03.377768+0000" 2021-11-15T19:30:09.940 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.940 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:30:09.940 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:30:09.940 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:30:09.941 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:30:09.941 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:30:09.941 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:30:09.941 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:30:09.941 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:30:09.942 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:09.942 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:09.942 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:30:09.942 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:30:09.943 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:30:09.943 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:30:09.943 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:30:09.943 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:30:09.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67a80536a0 msgr2=0x7f67a8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67a80536a0 0x7f67a8055b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f67ac00c000 tx=0x7f67ac008040).stop 2021-11-15T19:30:09.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 msgr2=0x7f67c413d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:09.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c413d970 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f67bc0032f0 tx=0x7f67bc0091a0).stop 2021-11-15T19:30:09.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 shutdown_connections 2021-11-15T19:30:09.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67a80536a0 0x7f67a8055b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67c4143f00 0x7f67c413d970 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67c40b1340 0x7f67c40b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 --2- 172.21.2.137:0/2484306816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67c40a9f50 0x7f67c415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:09.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 >> 172.21.2.137:0/2484306816 conn(0x7f67c40b4e60 msgr2=0x7f67c4145a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:09.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 shutdown_connections 2021-11-15T19:30:09.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:09.739+0000 7f67c95ed700 1 -- 172.21.2.137:0/2484306816 wait complete. 2021-11-15T19:30:09.948 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:10.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 Processor -- start 2021-11-15T19:30:10.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- start start 2021-11-15T19:30:10.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c0ac3c0 0x7fe88c0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe88c0609f0 0x7fe88c1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c097c50 con 0x7fe88c0b2d50 2021-11-15T19:30:10.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c0ac120 con 0x7fe88c0609f0 2021-11-15T19:30:10.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0979b0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe88c0609f0 0x7fe88c1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe88c0609f0 0x7fe88c1447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34034/0 (socket says 172.21.2.137:34034) 2021-11-15T19:30:10.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 -- 172.21.2.137:0/4276945231 learned_addr learned my addr 172.21.2.137:0/4276945231 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:10.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88ad9d700 1 --2- 172.21.2.137:0/4276945231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c0ac3c0 0x7fe88c0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 -- 172.21.2.137:0/4276945231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c0ac3c0 msgr2=0x7fe88c0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:10.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 --2- 172.21.2.137:0/4276945231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c0ac3c0 0x7fe88c0ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 -- 172.21.2.137:0/4276945231 >> v1:172.21.2.111:6789/0 conn(0x7fe88c0b2d50 legacy=0x7fe88c1440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:10.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 -- 172.21.2.137:0/4276945231 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c067c60 con 0x7fe88c0609f0 2021-11-15T19:30:10.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe88b59e700 1 --2- 172.21.2.137:0/4276945231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0609f0 0x7fe88c1447d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fe88c0b4e60 tx=0x7fe884009290).ready entity=mon.1 client_cookie=2a96d4e17e899cab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe889d9b700 1 -- 172.21.2.137:0/4276945231 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe88400b860 con 0x7fe88c0609f0 2021-11-15T19:30:10.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe889d9b700 1 -- 172.21.2.137:0/4276945231 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400b9c0 con 0x7fe88c0609f0 2021-11-15T19:30:10.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe889d9b700 1 -- 172.21.2.137:0/4276945231 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe88400bb70 con 0x7fe88c0609f0 2021-11-15T19:30:10.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- 172.21.2.137:0/4276945231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0609f0 msgr2=0x7fe88c1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 --2- 172.21.2.137:0/4276945231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0609f0 0x7fe88c1447d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fe88c0b4e60 tx=0x7fe884009290).stop 2021-11-15T19:30:10.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- 172.21.2.137:0/4276945231 shutdown_connections 2021-11-15T19:30:10.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 --2- 172.21.2.137:0/4276945231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0609f0 0x7fe88c1447d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 --2- 172.21.2.137:0/4276945231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c0ac3c0 0x7fe88c0ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- 172.21.2.137:0/4276945231 >> 172.21.2.137:0/4276945231 conn(0x7fe88c0b7070 msgr2=0x7fe88c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:10.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- 172.21.2.137:0/4276945231 shutdown_connections 2021-11-15T19:30:10.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.015+0000 7fe8911dd700 1 -- 172.21.2.137:0/4276945231 wait complete. 2021-11-15T19:30:10.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 Processor -- start 2021-11-15T19:30:10.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- start start 2021-11-15T19:30:10.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe88c0609f0 0x7fe88c099080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 0x7fe88c0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c155b00 0x7fe88c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c09ade0 con 0x7fe88c0609f0 2021-11-15T19:30:10.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c09a380 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c09a620 con 0x7fe88c155b00 2021-11-15T19:30:10.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 0x7fe88c0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 0x7fe88c0af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34040/0 (socket says 172.21.2.137:34040) 2021-11-15T19:30:10.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 -- 172.21.2.137:0/2031918921 learned_addr learned my addr 172.21.2.137:0/2031918921 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:10.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 -- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c155b00 msgr2=0x7fe88c155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c155b00 0x7fe88c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 -- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe88c0609f0 msgr2=0x7fe88c099080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe88c0609f0 0x7fe88c099080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 -- 172.21.2.137:0/2031918921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884009530 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88a59c700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 0x7fe88c0af2b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fe874002f30 tx=0x7fe874006d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe874002320 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874002480 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c09a8c0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8740027e0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c09a000 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c09aaa0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe87400f030 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe883fff700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8700536a0 0x7fe870055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe87406b350 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88ad9d700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8700536a0 0x7fe870055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.019+0000 7fe88ad9d700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8700536a0 0x7fe870055b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe87c00a000 tx=0x7fe87c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.023+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe88c09aaa0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.127+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe88c09aaa0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe883fff700 1 -- 172.21.2.137:0/2031918921 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fe88c09aaa0 con 0x7fe88c0ac3c0 2021-11-15T19:30:10.135 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:10.135 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5476,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/4093778603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4093778603},{"type":"v1","addr":"172.21.2.137:6833","nonce":4093778603}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[]} 2021-11-15T19:30:10.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8700536a0 msgr2=0x7fe870055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8700536a0 0x7fe870055b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe87c00a000 tx=0x7fe87c008040).stop 2021-11-15T19:30:10.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 msgr2=0x7fe88c0af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 0x7fe88c0af2b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fe874002f30 tx=0x7fe874006d70).stop 2021-11-15T19:30:10.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 shutdown_connections 2021-11-15T19:30:10.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8700536a0 0x7fe870055b60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe88c155b00 0x7fe88c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe88c0ac3c0 0x7fe88c0af2b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 --2- 172.21.2.137:0/2031918921 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe88c0609f0 0x7fe88c099080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 >> 172.21.2.137:0/2031918921 conn(0x7fe88c0b7070 msgr2=0x7fe88c0b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:10.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 shutdown_connections 2021-11-15T19:30:10.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.131+0000 7fe8911dd700 1 -- 172.21.2.137:0/2031918921 wait complete. 2021-11-15T19:30:10.139 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 17 2021-11-15T19:30:10.141 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:10.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 Processor -- start 2021-11-15T19:30:10.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 -- start start 2021-11-15T19:30:10.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0ed40b1340 0x7f0ed4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed4148190 con 0x7f0ed4143f00 2021-11-15T19:30:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40b1720 con 0x7f0ed40a9f50 2021-11-15T19:30:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed4147e70 con 0x7f0ed40b1340 2021-11-15T19:30:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed9d7e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0ed40a9f50 0x7f0ed40aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52830/0 (socket says 172.21.2.137:52830) 2021-11-15T19:30:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed9d7e700 1 -- 172.21.2.137:0/520950380 learned_addr learned my addr 172.21.2.137:0/520950380 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed957d700 1 --2- 172.21.2.137:0/520950380 >> v2:172.21.2.137:3300/0 conn(0x7f0ed40b1340 0x7f0ed4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed957d700 1 -- 172.21.2.137:0/520950380 >> v1:172.21.2.137:6789/0 conn(0x7f0ed40a9f50 legacy=0x7f0ed40aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed957d700 1 -- 172.21.2.137:0/520950380 >> v1:172.21.2.111:6789/0 conn(0x7f0ed4143f00 legacy=0x7f0ed4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed957d700 1 -- 172.21.2.137:0/520950380 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40af800 con 0x7f0ed40b1340 2021-11-15T19:30:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ed957d700 1 --2- 172.21.2.137:0/520950380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40b1340 0x7f0ed4147980 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f0ed4062250 tx=0x7f0ec8006df0).ready entity=mon.1 client_cookie=2673899a3cd03f41 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ec7fff700 1 -- 172.21.2.137:0/520950380 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec800d5c0 con 0x7f0ed40b1340 2021-11-15T19:30:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ec7fff700 1 -- 172.21.2.137:0/520950380 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8000e90 con 0x7f0ed40b1340 2021-11-15T19:30:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0ec7fff700 1 -- 172.21.2.137:0/520950380 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec800d910 con 0x7f0ed40b1340 2021-11-15T19:30:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 -- 172.21.2.137:0/520950380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40b1340 msgr2=0x7f0ed4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/520950380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40b1340 0x7f0ed4147980 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f0ed4062250 tx=0x7f0ec8006df0).stop 2021-11-15T19:30:10.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 -- 172.21.2.137:0/520950380 shutdown_connections 2021-11-15T19:30:10.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.187+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/520950380 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40b1340 0x7f0ed4147980 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- 172.21.2.137:0/520950380 >> 172.21.2.137:0/520950380 conn(0x7f0ed40b4e60 msgr2=0x7f0ed40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:10.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- 172.21.2.137:0/520950380 shutdown_connections 2021-11-15T19:30:10.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- 172.21.2.137:0/520950380 wait complete. 2021-11-15T19:30:10.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 Processor -- start 2021-11-15T19:30:10.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- start start 2021-11-15T19:30:10.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 0x7f0ed4142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ed40b1340 0x7f0ed4145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ed4143f00 0x7f0ed409a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4141ac0 con 0x7f0ed4143f00 2021-11-15T19:30:10.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41473e0 con 0x7f0ed40a9f50 2021-11-15T19:30:10.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40ac350 con 0x7f0ed40b1340 2021-11-15T19:30:10.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 0x7f0ed4142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 0x7f0ed4142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34050/0 (socket says 172.21.2.137:34050) 2021-11-15T19:30:10.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 -- 172.21.2.137:0/844917055 learned_addr learned my addr 172.21.2.137:0/844917055 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:10.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 -- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ed40b1340 msgr2=0x7f0ed4145440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:10.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ed40b1340 0x7f0ed4145440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 -- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ed4143f00 msgr2=0x7f0ed409a430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:10.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ed4143f00 0x7f0ed409a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 -- 172.21.2.137:0/844917055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec800b180 con 0x7f0ed40a9f50 2021-11-15T19:30:10.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed957d700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 0x7f0ed4142b70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f0ed4062250 tx=0x7f0ec8012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec8002f70 con 0x7f0ed40a9f50 2021-11-15T19:30:10.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8013d50 con 0x7f0ed40a9f50 2021-11-15T19:30:10.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec801f640 con 0x7f0ed40a9f50 2021-11-15T19:30:10.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4141410 con 0x7f0ed40a9f50 2021-11-15T19:30:10.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed41402e0 con 0x7f0ed40a9f50 2021-11-15T19:30:10.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed4147200 con 0x7f0ed40a9f50 2021-11-15T19:30:10.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ec801c070 con 0x7f0ed40a9f50 2021-11-15T19:30:10.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ec67fc700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0eb40536d0 0x7f0eb4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0ec806c070 con 0x7f0ed40a9f50 2021-11-15T19:30:10.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.191+0000 7f0ed8d7c700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0eb40536d0 0x7f0eb4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.195+0000 7f0ed8d7c700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0eb40536d0 0x7f0eb4055b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f0ed0002ef0 tx=0x7f0ed0006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.195+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ec80434f0 con 0x7f0ed40a9f50 2021-11-15T19:30:10.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ed4148190 con 0x7f0ed40a9f50 2021-11-15T19:30:10.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0ec67fc700 1 -- 172.21.2.137:0/844917055 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f0ed4148190 con 0x7f0ed40a9f50 2021-11-15T19:30:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:10.308 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/784821634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":784821634},{"type":"v1","addr":"172.21.2.111:6835","nonce":784821634}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5476,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/4093778603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4093778603},{"type":"v1","addr":"172.21.2.137:6833","nonce":4093778603}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[]} 2021-11-15T19:30:10.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0eb40536d0 msgr2=0x7f0eb4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0eb40536d0 0x7f0eb4055b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f0ed0002ef0 tx=0x7f0ed0006890).stop 2021-11-15T19:30:10.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 msgr2=0x7f0ed4142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 0x7f0ed4142b70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f0ed4062250 tx=0x7f0ec8012000).stop 2021-11-15T19:30:10.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 shutdown_connections 2021-11-15T19:30:10.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0eb40536d0 0x7f0eb4055b90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ed4143f00 0x7f0ed409a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ed40b1340 0x7f0ed4145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 --2- 172.21.2.137:0/844917055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ed40a9f50 0x7f0ed4142b70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 >> 172.21.2.137:0/844917055 conn(0x7f0ed40b4e60 msgr2=0x7f0ed40af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:10.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 shutdown_connections 2021-11-15T19:30:10.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.303+0000 7f0edb7e1700 1 -- 172.21.2.137:0/844917055 wait complete. 2021-11-15T19:30:10.312 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 17 2021-11-15T19:30:10.315 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:30:10.315 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:30:10.315 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:30:10.316 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:30:10.316 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:30:10.316 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:30:10.317 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:30:10.317 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:30:10.320 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:30:10.321 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:30:10.322 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:30:10.323 DEBUG:teuthology.parallel:result is None 2021-11-15T19:30:10.329 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:30:10.329 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:30:10.331 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:30:10.331 DEBUG:teuthology.parallel:result is None 2021-11-15T19:30:10.332 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:30:10.356 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:30:10.365 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:30:10.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 Processor -- start 2021-11-15T19:30:10.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 -- start start 2021-11-15T19:30:10.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0c8405c770 0x7f0c840aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c840b0550 0x7f0c8414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0c8414aaa0 0x7f0c84140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840b1650 con 0x7f0c8405c770 2021-11-15T19:30:10.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8405cb50 con 0x7f0c8414aaa0 2021-11-15T19:30:10.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c89ec6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840ad030 con 0x7f0c840b0550 2021-11-15T19:30:10.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c83fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0c8414aaa0 0x7f0c84140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c83fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0c8414aaa0 0x7f0c84140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34072/0 (socket says 172.21.2.137:34072) 2021-11-15T19:30:10.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.379+0000 7f0c83fff700 1 -- 172.21.2.137:0/1034282698 learned_addr learned my addr 172.21.2.137:0/1034282698 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:10.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c83fff700 1 -- 172.21.2.137:0/1034282698 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c840b0550 msgr2=0x7f0c8414a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:10.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c83fff700 1 --2- 172.21.2.137:0/1034282698 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c840b0550 0x7f0c8414a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c83fff700 1 -- 172.21.2.137:0/1034282698 >> v2:172.21.2.111:3300/0 conn(0x7f0c8405c770 msgr2=0x7f0c840aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:10.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c83fff700 1 --2- 172.21.2.137:0/1034282698 >> v2:172.21.2.111:3300/0 conn(0x7f0c8405c770 0x7f0c840aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c83fff700 1 -- 172.21.2.137:0/1034282698 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840ad2d0 con 0x7f0c8414aaa0 2021-11-15T19:30:10.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c83fff700 1 --2- 172.21.2.137:0/1034282698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c8414aaa0 0x7f0c84140aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0c7c0032f0 tx=0x7f0c7c009290).ready entity=mon.1 client_cookie=d9f1313f6bef2ae6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c827fc700 1 -- 172.21.2.137:0/1034282698 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c7c00b870 con 0x7f0c8414aaa0 2021-11-15T19:30:10.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c827fc700 1 -- 172.21.2.137:0/1034282698 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00b9d0 con 0x7f0c8414aaa0 2021-11-15T19:30:10.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c827fc700 1 -- 172.21.2.137:0/1034282698 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c7c00bb80 con 0x7f0c8414aaa0 2021-11-15T19:30:10.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/1034282698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c8414aaa0 msgr2=0x7f0c84140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/1034282698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c8414aaa0 0x7f0c84140aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0c7c0032f0 tx=0x7f0c7c009290).stop 2021-11-15T19:30:10.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/1034282698 shutdown_connections 2021-11-15T19:30:10.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/1034282698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c8414aaa0 0x7f0c84140aa0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:10.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/1034282698 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c840b0550 0x7f0c8414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/1034282698 >> v2:172.21.2.111:3300/0 conn(0x7f0c8405c770 0x7f0c840aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/1034282698 >> 172.21.2.137:0/1034282698 conn(0x7f0c840631e0 msgr2=0x7f0c8405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:10.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/1034282698 shutdown_connections 2021-11-15T19:30:10.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/1034282698 wait complete. 2021-11-15T19:30:10.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 Processor -- start 2021-11-15T19:30:10.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- start start 2021-11-15T19:30:10.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c8405c770 0x7f0c84063b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 0x7f0c84147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c8414aaa0 0x7f0c840663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84142680 con 0x7f0c8405c770 2021-11-15T19:30:10.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84066a40 con 0x7f0c840b0550 2021-11-15T19:30:10.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84066ce0 con 0x7f0c8414aaa0 2021-11-15T19:30:10.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 0x7f0c84147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 0x7f0c84147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34078/0 (socket says 172.21.2.137:34078) 2021-11-15T19:30:10.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 -- 172.21.2.137:0/2982838787 learned_addr learned my addr 172.21.2.137:0/2982838787 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:10.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 -- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c8414aaa0 msgr2=0x7f0c840663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c8414aaa0 0x7f0c840663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 -- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c8405c770 msgr2=0x7f0c84063b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:10.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c8405c770 0x7f0c84063b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:10.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 -- 172.21.2.137:0/2982838787 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c009530 con 0x7f0c840b0550 2021-11-15T19:30:10.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c82ffd700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 0x7f0c84147290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0c6c002ef0 tx=0x7f0c6c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c6c009ea0 con 0x7f0c840b0550 2021-11-15T19:30:10.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c002320 con 0x7f0c840b0550 2021-11-15T19:30:10.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c84066f80 con 0x7f0c840b0550 2021-11-15T19:30:10.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8413f2c0 con 0x7f0c840b0550 2021-11-15T19:30:10.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c6c002680 con 0x7f0c840b0550 2021-11-15T19:30:10.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c84066890 con 0x7f0c840b0550 2021-11-15T19:30:10.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.383+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c6c00f030 con 0x7f0c840b0550 2021-11-15T19:30:10.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.387+0000 7f0c80ff9700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c68053720 0x7f0c68055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:10.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.387+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0c6c06b4b0 con 0x7f0c840b0550 2021-11-15T19:30:10.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.387+0000 7f0c837fe700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c68053720 0x7f0c68055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:10.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.387+0000 7f0c837fe700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c68053720 0x7f0c68055be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0c74002ef0 tx=0x7f0c74006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:10.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.387+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c6c0427e0 con 0x7f0c840b0550 2021-11-15T19:30:10.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:10.479+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0c840ae7f0 con 0x7f0c840b0550 2021-11-15T19:30:11.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.363+0000 7f0c80ff9700 1 -- 172.21.2.137:0/2982838787 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0c6c045e00 con 0x7f0c840b0550 2021-11-15T19:30:11.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c68053720 msgr2=0x7f0c68055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c68053720 0x7f0c68055be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0c74002ef0 tx=0x7f0c74006910).stop 2021-11-15T19:30:11.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 msgr2=0x7f0c84147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 0x7f0c84147290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0c6c002ef0 tx=0x7f0c6c006d50).stop 2021-11-15T19:30:11.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 shutdown_connections 2021-11-15T19:30:11.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c68053720 0x7f0c68055be0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c8414aaa0 0x7f0c840663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c840b0550 0x7f0c84147290 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 --2- 172.21.2.137:0/2982838787 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c8405c770 0x7f0c84063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 >> 172.21.2.137:0/2982838787 conn(0x7f0c840631e0 msgr2=0x7f0c840b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 shutdown_connections 2021-11-15T19:30:11.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.367+0000 7f0c89ec6700 1 -- 172.21.2.137:0/2982838787 wait complete. 2021-11-15T19:30:11.375 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:30:11.381 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:30:11.381 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:30:11.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.427+0000 7f31f9c1f700 1 Processor -- start 2021-11-15T19:30:11.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.427+0000 7f31f9c1f700 1 -- start start 2021-11-15T19:30:11.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.427+0000 7f31f9c1f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.427+0000 7f31f9c1f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f31f405f730 0x7f31f405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f4060070 con 0x7f31f40608f0 2021-11-15T19:30:11.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f40ad6c0 con 0x7f31f405f730 2021-11-15T19:30:11.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b1b50 con 0x7f31f413f890 2021-11-15T19:30:11.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f3fff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f31f405f730 0x7f31f405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f37fe700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f31f40608f0 0x7f31f40b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:45360/0 (socket says 172.21.2.137:45360) 2021-11-15T19:30:11.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f37fe700 1 -- 172.21.2.137:0/569457620 learned_addr learned my addr 172.21.2.137:0/569457620 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:11.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f2ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f2ffd700 1 -- 172.21.2.137:0/569457620 >> v2:172.21.2.111:3300/0 conn(0x7f31f405f730 msgr2=0x7f31f405fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f2ffd700 1 --2- 172.21.2.137:0/569457620 >> v2:172.21.2.111:3300/0 conn(0x7f31f405f730 0x7f31f405fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f2ffd700 1 -- 172.21.2.137:0/569457620 >> v1:172.21.2.111:6789/0 conn(0x7f31f40608f0 legacy=0x7f31f40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f2ffd700 1 -- 172.21.2.137:0/569457620 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40b0c80 con 0x7f31f413f890 2021-11-15T19:30:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f2ffd700 1 --2- 172.21.2.137:0/569457620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f40b1660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f31e4002f70 tx=0x7f31e4006df0).ready entity=mon.2 client_cookie=311ed083779c4632 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f27fc700 1 -- 172.21.2.137:0/569457620 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e400d570 con 0x7f31f413f890 2021-11-15T19:30:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f27fc700 1 -- 172.21.2.137:0/569457620 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e4000e90 con 0x7f31f413f890 2021-11-15T19:30:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f27fc700 1 -- 172.21.2.137:0/569457620 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e400d8c0 con 0x7f31f413f890 2021-11-15T19:30:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- 172.21.2.137:0/569457620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 msgr2=0x7f31f40b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/569457620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f40b1660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f31e4002f70 tx=0x7f31e4006df0).stop 2021-11-15T19:30:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- 172.21.2.137:0/569457620 shutdown_connections 2021-11-15T19:30:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/569457620 >> v2:172.21.2.111:3300/0 conn(0x7f31f405f730 0x7f31f405fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/569457620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f40b1660 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- 172.21.2.137:0/569457620 >> 172.21.2.137:0/569457620 conn(0x7f31f4063980 msgr2=0x7f31f4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- 172.21.2.137:0/569457620 shutdown_connections 2021-11-15T19:30:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.431+0000 7f31f9c1f700 1 -- 172.21.2.137:0/569457620 wait complete. 2021-11-15T19:30:11.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 Processor -- start 2021-11-15T19:30:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- start start 2021-11-15T19:30:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 0x7f31f4145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f31f40608f0 0x7f31f4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4156430 con 0x7f31f40608f0 2021-11-15T19:30:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b56d0 con 0x7f31f405f730 2021-11-15T19:30:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f41555b0 con 0x7f31f413f890 2021-11-15T19:30:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 0x7f31f4145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 0x7f31f4145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34092/0 (socket says 172.21.2.137:34092) 2021-11-15T19:30:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 -- 172.21.2.137:0/3609729919 learned_addr learned my addr 172.21.2.137:0/3609729919 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 -- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 msgr2=0x7f31f4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 -- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f31f40608f0 msgr2=0x7f31f4155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f31f40608f0 0x7f31f4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 -- 172.21.2.137:0/3609729919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e400b180 con 0x7f31f405f730 2021-11-15T19:30:11.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f37fe700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 0x7f31f4145270 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f31f40b3ac0 tx=0x7f31dc007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31dc00ce30 con 0x7f31f405f730 2021-11-15T19:30:11.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc0072e0 con 0x7f31f405f730 2021-11-15T19:30:11.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31dc005800 con 0x7f31f405f730 2021-11-15T19:30:11.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f40b5b10 con 0x7f31f405f730 2021-11-15T19:30:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4139cf0 con 0x7f31f405f730 2021-11-15T19:30:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f41553c0 con 0x7f31f405f730 2021-11-15T19:30:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31dc010070 con 0x7f31f405f730 2021-11-15T19:30:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f0ff9700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31d8053610 0x7f31d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f31dc06ac30 con 0x7f31f405f730 2021-11-15T19:30:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.435+0000 7f31f2ffd700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31d8053610 0x7f31d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.439+0000 7f31f2ffd700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31d8053610 0x7f31d8055ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f31e4002f70 tx=0x7f31e4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.439+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31dc0420c0 con 0x7f31f405f730 2021-11-15T19:30:11.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f31f40b0f20 con 0x7f31f405f730 2021-11-15T19:30:11.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f0ff9700 1 -- 172.21.2.137:0/3609729919 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f31dc018030 con 0x7f31f405f730 2021-11-15T19:30:11.556 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:11.556 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:30:11.557 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:30:11.557 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.557 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:30:11.557 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:30:11.558 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.558 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:30:11.558 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.558 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.559 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.559 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.559 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.559 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.560 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:30:11.560 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:30:11.560 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.560 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:30:11.560 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.561 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.561 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.561 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.561 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.562 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.562 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:30:11.562 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:30:11.562 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.562 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.563 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.563 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.563 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.563 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.564 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.564 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:30:11.564 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:30:11.564 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.564 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.565 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.565 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.565 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.565 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.566 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.566 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:30:11.566 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:30:11.566 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.567 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.567 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.567 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.567 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.568 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.568 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.568 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:30:11.568 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:30:11.569 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.569 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.569 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.569 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.570 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.570 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.570 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.570 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:30:11.571 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:30:11.571 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.571 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.571 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.572 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.572 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.572 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.572 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.572 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:30:11.573 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:30:11.573 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.573 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.573 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.574 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.574 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.574 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.574 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.574 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:30:11.575 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:30:11.575 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.575 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.575 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.576 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.576 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.576 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.576 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.576 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:30:11.577 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:30:11.577 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.577 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.578 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.578 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.578 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.578 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.579 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.579 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:30:11.579 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:30:11.579 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.579 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:30:11.580 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:30:11.580 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:30:11.580 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.580 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.581 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.581 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:30:11.581 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:30:11.581 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.582 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:30:11.582 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:30:11.582 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:30:11.582 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.583 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.583 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.583 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:30:11.583 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:30:11.584 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.584 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:30:11.584 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:30:11.584 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:30:11.585 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.585 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.585 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.586 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:30:11.586 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:30:11.586 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.586 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:30:11.587 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:30:11.587 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:30:11.587 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.588 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.588 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.588 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.588 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:30:11.589 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:30:11.589 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.589 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:30:11.590 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:30:11.590 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.590 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.590 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:11.591 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:11.591 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:30:11.591 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:30:11.591 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:30:11.592 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:30:11.592 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:30:11.592 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:30:11.592 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.593 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:11.593 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:30:11.593 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:30:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31d8053610 msgr2=0x7f31d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31d8053610 0x7f31d8055ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f31e4002f70 tx=0x7f31e4014000).stop 2021-11-15T19:30:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 msgr2=0x7f31f4145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 0x7f31f4145270 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f31f40b3ac0 tx=0x7f31dc007c00).stop 2021-11-15T19:30:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 shutdown_connections 2021-11-15T19:30:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31d8053610 0x7f31d8055ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f31f413f890 0x7f31f4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f31f40608f0 0x7f31f4155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 --2- 172.21.2.137:0/3609729919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f31f405f730 0x7f31f4145270 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 >> 172.21.2.137:0/3609729919 conn(0x7f31f4063980 msgr2=0x7f31f41495e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 shutdown_connections 2021-11-15T19:30:11.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.551+0000 7f31f9c1f700 1 -- 172.21.2.137:0/3609729919 wait complete. 2021-11-15T19:30:11.598 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:30:11.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 Processor -- start 2021-11-15T19:30:11.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- start start 2021-11-15T19:30:11.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89ec0b2d50 0x7f89ec05f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec05fed0 0x7f89ec060350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec097c50 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0ac120 con 0x7f89ec0b2d50 2021-11-15T19:30:11.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0979b0 con 0x7f89ec05fed0 2021-11-15T19:30:11.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89ec0b2d50 0x7f89ec05f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89ec0b2d50 0x7f89ec05f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34100/0 (socket says 172.21.2.137:34100) 2021-11-15T19:30:11.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/4250499370 learned_addr learned my addr 172.21.2.137:0/4250499370 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:11.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/4250499370 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec05fed0 msgr2=0x7f89ec060350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:11.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- 172.21.2.137:0/4250499370 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec05fed0 0x7f89ec060350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/4250499370 >> v1:172.21.2.111:6789/0 conn(0x7f89ec0ac3c0 legacy=0x7f89ec0ac7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:11.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/4250499370 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0aceb0 con 0x7f89ec0b2d50 2021-11-15T19:30:11.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- 172.21.2.137:0/4250499370 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0b2d50 0x7f89ec05f9e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f89ec0b4e60 tx=0x7f89d4006eb0).ready entity=mon.1 client_cookie=ad10f275b2faf52d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89e9d9b700 1 -- 172.21.2.137:0/4250499370 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d400d570 con 0x7f89ec0b2d50 2021-11-15T19:30:11.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89e9d9b700 1 -- 172.21.2.137:0/4250499370 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4000e90 con 0x7f89ec0b2d50 2021-11-15T19:30:11.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89e9d9b700 1 -- 172.21.2.137:0/4250499370 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d400d8c0 con 0x7f89ec0b2d50 2021-11-15T19:30:11.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- 172.21.2.137:0/4250499370 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0b2d50 msgr2=0x7f89ec05f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- 172.21.2.137:0/4250499370 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0b2d50 0x7f89ec05f9e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f89ec0b4e60 tx=0x7f89d4006eb0).stop 2021-11-15T19:30:11.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- 172.21.2.137:0/4250499370 shutdown_connections 2021-11-15T19:30:11.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- 172.21.2.137:0/4250499370 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec05fed0 0x7f89ec060350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- 172.21.2.137:0/4250499370 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0b2d50 0x7f89ec05f9e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- 172.21.2.137:0/4250499370 >> 172.21.2.137:0/4250499370 conn(0x7f89ec0b7070 msgr2=0x7f89ec0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- 172.21.2.137:0/4250499370 shutdown_connections 2021-11-15T19:30:11.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- 172.21.2.137:0/4250499370 wait complete. 2021-11-15T19:30:11.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 Processor -- start 2021-11-15T19:30:11.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- start start 2021-11-15T19:30:11.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89ec05fed0 0x7f89ec064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 0x7f89ec0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec066f50 0x7f89ec142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec13d060 con 0x7f89ec05fed0 2021-11-15T19:30:11.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec066840 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec066ae0 con 0x7f89ec066f50 2021-11-15T19:30:11.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 0x7f89ec0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 0x7f89ec0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34106/0 (socket says 172.21.2.137:34106) 2021-11-15T19:30:11.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/1389372975 learned_addr learned my addr 172.21.2.137:0/1389372975 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:11.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec066f50 msgr2=0x7f89ec142500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:11.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec066f50 0x7f89ec142500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89ec05fed0 msgr2=0x7f89ec064920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:11.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89ec05fed0 0x7f89ec064920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 -- 172.21.2.137:0/1389372975 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d400b1e0 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89ea59c700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 0x7f89ec0b51e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f89ec066760 tx=0x7f89d4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d4002f70 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400de20 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec142060 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.651+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d4011e90 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec067610 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec067830 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89d4025030 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89e3fff700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d00536a0 0x7f89d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f89d406cb30 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89ead9d700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d00536a0 0x7f89d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89ead9d700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d00536a0 0x7f89d0055b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f89dc002ef0 tx=0x7f89dc006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.655+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89d4043ef0 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.739+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89ec067c60 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.739+0000 7f89e3fff700 1 -- 172.21.2.137:0/1389372975 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f89d4023070 con 0x7f89ec0ac3c0 2021-11-15T19:30:11.746 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:11.746 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":47,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:30:11.364378+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:30:11.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d00536a0 msgr2=0x7f89d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d00536a0 0x7f89d0055b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f89dc002ef0 tx=0x7f89dc006890).stop 2021-11-15T19:30:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 msgr2=0x7f89ec0b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 0x7f89ec0b51e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f89ec066760 tx=0x7f89d4015000).stop 2021-11-15T19:30:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 shutdown_connections 2021-11-15T19:30:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d00536a0 0x7f89d0055b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89ec066f50 0x7f89ec142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89ec0ac3c0 0x7f89ec0b51e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 --2- 172.21.2.137:0/1389372975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89ec05fed0 0x7f89ec064920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 >> 172.21.2.137:0/1389372975 conn(0x7f89ec0b7070 msgr2=0x7f89ec13e970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 shutdown_connections 2021-11-15T19:30:11.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.743+0000 7f89f10e7700 1 -- 172.21.2.137:0/1389372975 wait complete. 2021-11-15T19:30:11.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:30:11.754 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:30:11.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 Processor -- start 2021-11-15T19:30:11.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- start start 2021-11-15T19:30:11.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9338065730 0x7f933813c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93380b00a0 0x7f933805bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9338066270 con 0x7f9338065b10 2021-11-15T19:30:11.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9338067410 con 0x7f9338065730 2021-11-15T19:30:11.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9338065fd0 con 0x7f93380b00a0 2021-11-15T19:30:11.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f9337fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9338065b10 0x7f933813c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52900/0 (socket says 172.21.2.137:52900) 2021-11-15T19:30:11.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f9337fff700 1 -- 172.21.2.137:0/3159210276 learned_addr learned my addr 172.21.2.137:0/3159210276 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:11.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933cdbf700 1 --2- 172.21.2.137:0/3159210276 >> v2:172.21.2.137:3300/0 conn(0x7f9338065730 0x7f933813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933cdbf700 1 -- 172.21.2.137:0/3159210276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93380b00a0 msgr2=0x7f933805bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:11.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933cdbf700 1 --2- 172.21.2.137:0/3159210276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93380b00a0 0x7f933805bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933cdbf700 1 -- 172.21.2.137:0/3159210276 >> v1:172.21.2.137:6789/0 conn(0x7f9338065b10 legacy=0x7f933813c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933cdbf700 1 -- 172.21.2.137:0/3159210276 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338066f70 con 0x7f9338065730 2021-11-15T19:30:11.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933cdbf700 1 --2- 172.21.2.137:0/3159210276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f933813c2b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f932c001110 tx=0x7f9328007f00).ready entity=mon.1 client_cookie=55f78a188539d35c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f93377fe700 1 -- 172.21.2.137:0/3159210276 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9328010510 con 0x7f9338065730 2021-11-15T19:30:11.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f93377fe700 1 -- 172.21.2.137:0/3159210276 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328000e90 con 0x7f9338065730 2021-11-15T19:30:11.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f93377fe700 1 -- 172.21.2.137:0/3159210276 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9328010670 con 0x7f9338065730 2021-11-15T19:30:11.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- 172.21.2.137:0/3159210276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 msgr2=0x7f933813c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 --2- 172.21.2.137:0/3159210276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f933813c2b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f932c001110 tx=0x7f9328007f00).stop 2021-11-15T19:30:11.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- 172.21.2.137:0/3159210276 shutdown_connections 2021-11-15T19:30:11.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 --2- 172.21.2.137:0/3159210276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93380b00a0 0x7f933805bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 --2- 172.21.2.137:0/3159210276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f933813c2b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- 172.21.2.137:0/3159210276 >> 172.21.2.137:0/3159210276 conn(0x7f9338060290 msgr2=0x7f9338060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- 172.21.2.137:0/3159210276 shutdown_connections 2021-11-15T19:30:11.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- 172.21.2.137:0/3159210276 wait complete. 2021-11-15T19:30:11.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 Processor -- start 2021-11-15T19:30:11.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.803+0000 7f933f023700 1 -- start start 2021-11-15T19:30:11.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f93380acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9338065b10 0x7f9338155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93380b00a0 0x7f9338155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338142fc0 con 0x7f93380b00a0 2021-11-15T19:30:11.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93380b4480 con 0x7f9338065730 2021-11-15T19:30:11.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93380b6030 con 0x7f9338065b10 2021-11-15T19:30:11.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f93380acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f93380acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34122/0 (socket says 172.21.2.137:34122) 2021-11-15T19:30:11.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 -- 172.21.2.137:0/883852691 learned_addr learned my addr 172.21.2.137:0/883852691 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:11.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 -- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9338065b10 msgr2=0x7f9338155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9338065b10 0x7f9338155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 -- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93380b00a0 msgr2=0x7f9338155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93380b00a0 0x7f9338155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 -- 172.21.2.137:0/883852691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932800c200 con 0x7f9338065730 2021-11-15T19:30:11.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933cdbf700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f93380acc50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f932c001110 tx=0x7f9328017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9328002f50 con 0x7f9338065730 2021-11-15T19:30:11.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328010510 con 0x7f9338065730 2021-11-15T19:30:11.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93380b62f0 con 0x7f9338065730 2021-11-15T19:30:11.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9338140480 con 0x7f9338065730 2021-11-15T19:30:11.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9328010870 con 0x7f9338065730 2021-11-15T19:30:11.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93380b45c0 con 0x7f9338065730 2021-11-15T19:30:11.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9328027020 con 0x7f9338065730 2021-11-15T19:30:11.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9335ffb700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f93180536a0 0x7f9318055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f932806bf00 con 0x7f9338065730 2021-11-15T19:30:11.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9337fff700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f93180536a0 0x7f9318055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.807+0000 7f9337fff700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f93180536a0 0x7f9318055b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f932c0011d0 tx=0x7f932c007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.811+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9328043390 con 0x7f9338065730 2021-11-15T19:30:11.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.891+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f93380573d0 con 0x7f9338065730 2021-11-15T19:30:11.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f9335ffb700 1 -- 172.21.2.137:0/883852691 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v47) v1 ==== 110+0+10 (secure 0 0 0) 0x7f93280160b0 con 0x7f9338065730 2021-11-15T19:30:11.899 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:30:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f93180536a0 msgr2=0x7f9318055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f93180536a0 0x7f9318055b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f932c0011d0 tx=0x7f932c007790).stop 2021-11-15T19:30:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 msgr2=0x7f93380acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f93380acc50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f932c001110 tx=0x7f9328017000).stop 2021-11-15T19:30:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 shutdown_connections 2021-11-15T19:30:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f93180536a0 0x7f9318055b60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93380b00a0 0x7f9338155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9338065b10 0x7f9338155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 --2- 172.21.2.137:0/883852691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9338065730 0x7f93380acc50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 >> 172.21.2.137:0/883852691 conn(0x7f9338060290 msgr2=0x7f933813dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 shutdown_connections 2021-11-15T19:30:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.895+0000 7f933f023700 1 -- 172.21.2.137:0/883852691 wait complete. 2021-11-15T19:30:11.906 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:30:11.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 Processor -- start 2021-11-15T19:30:11.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- start start 2021-11-15T19:30:11.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbc2c05c770 0x7fbc2c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c140aa0 0x7fbc2c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c05cb50 con 0x7fbc2c0b0550 2021-11-15T19:30:11.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c0b1650 con 0x7fbc2c05c770 2021-11-15T19:30:11.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0ad030 con 0x7fbc2c140aa0 2021-11-15T19:30:11.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbc2c05c770 0x7fbc2c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbc2c05c770 0x7fbc2c0aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34128/0 (socket says 172.21.2.137:34128) 2021-11-15T19:30:11.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/2743432255 learned_addr learned my addr 172.21.2.137:0/2743432255 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:11.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/2743432255 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c140aa0 msgr2=0x7fbc2c140f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:11.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 --2- 172.21.2.137:0/2743432255 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c140aa0 0x7fbc2c140f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/2743432255 >> v1:172.21.2.111:6789/0 conn(0x7fbc2c0b0550 legacy=0x7fbc2c14a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:11.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/2743432255 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0ad2d0 con 0x7fbc2c05c770 2021-11-15T19:30:11.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2b7fe700 1 --2- 172.21.2.137:0/2743432255 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c0aef30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fbc2c0620e0 tx=0x7fbc1c006eb0).ready entity=mon.1 client_cookie=6260316fa91c05e2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2a7fc700 1 -- 172.21.2.137:0/2743432255 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c00d570 con 0x7fbc2c05c770 2021-11-15T19:30:11.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2a7fc700 1 -- 172.21.2.137:0/2743432255 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c000e90 con 0x7fbc2c05c770 2021-11-15T19:30:11.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc2a7fc700 1 -- 172.21.2.137:0/2743432255 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c00d8c0 con 0x7fbc2c05c770 2021-11-15T19:30:11.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- 172.21.2.137:0/2743432255 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 msgr2=0x7fbc2c0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 --2- 172.21.2.137:0/2743432255 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c0aef30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fbc2c0620e0 tx=0x7fbc1c006eb0).stop 2021-11-15T19:30:11.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- 172.21.2.137:0/2743432255 shutdown_connections 2021-11-15T19:30:11.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 --2- 172.21.2.137:0/2743432255 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c140aa0 0x7fbc2c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 --2- 172.21.2.137:0/2743432255 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c0aef30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:11.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- 172.21.2.137:0/2743432255 >> 172.21.2.137:0/2743432255 conn(0x7fbc2c0631e0 msgr2=0x7fbc2c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:11.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- 172.21.2.137:0/2743432255 shutdown_connections 2021-11-15T19:30:11.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- 172.21.2.137:0/2743432255 wait complete. 2021-11-15T19:30:11.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 Processor -- start 2021-11-15T19:30:11.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.955+0000 7fbc3214e700 1 -- start start 2021-11-15T19:30:11.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c0b0550 0x7fbc2c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc2c140aa0 0x7fbc2c1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c1565b0 con 0x7fbc2c140aa0 2021-11-15T19:30:11.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c156850 con 0x7fbc2c05c770 2021-11-15T19:30:11.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c156af0 con 0x7fbc2c0b0550 2021-11-15T19:30:11.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34136/0 (socket says 172.21.2.137:34136) 2021-11-15T19:30:11.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/1806566322 learned_addr learned my addr 172.21.2.137:0/1806566322 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:11.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c0b0550 msgr2=0x7fbc2c156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c0b0550 0x7fbc2c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc2c140aa0 msgr2=0x7fbc2c1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:11.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc2c140aa0 0x7fbc2c1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:11.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 -- 172.21.2.137:0/1806566322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c00b1e0 con 0x7fbc2c05c770 2021-11-15T19:30:11.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2b7fe700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c145410 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fbc2c0620e0 tx=0x7fbc1c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c002f70 con 0x7fbc2c05c770 2021-11-15T19:30:11.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00d8f0 con 0x7fbc2c05c770 2021-11-15T19:30:11.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c01e460 con 0x7fbc2c05c770 2021-11-15T19:30:11.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c141be0 con 0x7fbc2c05c770 2021-11-15T19:30:11.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c1559a0 con 0x7fbc2c05c770 2021-11-15T19:30:11.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c156cb0 con 0x7fbc2c05c770 2021-11-15T19:30:11.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc1c025030 con 0x7fbc2c05c770 2021-11-15T19:30:11.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc28ff9700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc100536d0 0x7fbc10055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:11.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fbc1c06ca20 con 0x7fbc2c05c770 2021-11-15T19:30:11.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2affd700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc100536d0 0x7fbc10055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:11.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.959+0000 7fbc2affd700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc100536d0 0x7fbc10055b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fbc14002fb0 tx=0x7fbc140069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:11.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:11.963+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc1c043eb0 con 0x7fbc2c05c770 2021-11-15T19:30:12.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc2c0ae7f0 con 0x7fbc2c05c770 2021-11-15T19:30:12.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc28ff9700 1 -- 172.21.2.137:0/1806566322 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc1c0474d0 con 0x7fbc2c05c770 2021-11-15T19:30:12.048 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:12.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc100536d0 msgr2=0x7fbc10055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc100536d0 0x7fbc10055b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fbc14002fb0 tx=0x7fbc140069b0).stop 2021-11-15T19:30:12.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 msgr2=0x7fbc2c145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c145410 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fbc2c0620e0 tx=0x7fbc1c015000).stop 2021-11-15T19:30:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 shutdown_connections 2021-11-15T19:30:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc100536d0 0x7fbc10055b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc2c140aa0 0x7fbc2c1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc2c0b0550 0x7fbc2c156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 --2- 172.21.2.137:0/1806566322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc2c05c770 0x7fbc2c145410 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 >> 172.21.2.137:0/1806566322 conn(0x7fbc2c0631e0 msgr2=0x7fbc2c13df80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 shutdown_connections 2021-11-15T19:30:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.043+0000 7fbc3214e700 1 -- 172.21.2.137:0/1806566322 wait complete. 2021-11-15T19:30:12.055 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:30:12.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad62012700 1 Processor -- start 2021-11-15T19:30:12.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad62012700 1 -- start start 2021-11-15T19:30:12.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad62012700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad5c0b1180 0x7fad5c142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad62012700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0aecf0 con 0x7fad5c0acab0 2021-11-15T19:30:12.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad62012700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c13f180 con 0x7fad5c0af2f0 2021-11-15T19:30:12.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad62012700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c143780 con 0x7fad5c0b1180 2021-11-15T19:30:12.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad5bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fad5c0af2f0 0x7fad5c143070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52928/0 (socket says 172.21.2.137:52928) 2021-11-15T19:30:12.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.099+0000 7fad5bfff700 1 -- 172.21.2.137:0/2675140416 learned_addr learned my addr 172.21.2.137:0/2675140416 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:12.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144774359 0 0) 0x7fad54001490 con 0x7fad5c0af2f0 2021-11-15T19:30:12.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c003260 con 0x7fad5c0af2f0 2021-11-15T19:30:12.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3337206906 0 0) 0x7fad3c003260 con 0x7fad5c0af2f0 2021-11-15T19:30:12.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad5c0b1180 msgr2=0x7fad5c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:12.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad5c0b1180 0x7fad5c142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 >> v1:172.21.2.111:6789/0 conn(0x7fad5c0acab0 legacy=0x7fad5c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:12.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0aef20 con 0x7fad5c0af2f0 2021-11-15T19:30:12.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fad54001b70 con 0x7fad5c0af2f0 2021-11-15T19:30:12.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 >> v1:172.21.2.137:6789/0 conn(0x7fad5c0af2f0 legacy=0x7fad5c143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c0037d0 0x7fad3c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad3c004500 0x7fad3c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad3c005070 0x7fad3c00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00cf60 con 0x7fad3c005070 2021-11-15T19:30:12.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00d0d0 con 0x7fad3c004500 2021-11-15T19:30:12.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00d290 con 0x7fad3c0037d0 2021-11-15T19:30:12.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad3c004500 0x7fad3c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad3c005070 0x7fad3c00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 -- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c0037d0 msgr2=0x7fad3c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:12.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c0037d0 0x7fad3c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 -- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad3c005070 msgr2=0x7fad3c00c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:12.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad3c005070 0x7fad3c00c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:12.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 -- 172.21.2.137:0/2675140416 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c003260 con 0x7fad3c004500 2021-11-15T19:30:12.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad3c005070 0x7fad3c00c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:12.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5affd700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad3c004500 0x7fad3c004980 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fad44002f70 tx=0x7fad44006bf0).ready entity=mon.1 client_cookie=56686e106a83a180 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:12.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad44012450 con 0x7fad3c004500 2021-11-15T19:30:12.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad440125b0 con 0x7fad3c004500 2021-11-15T19:30:12.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5a7fc700 1 -- 172.21.2.137:0/2675140416 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad44012910 con 0x7fad3c004500 2021-11-15T19:30:12.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- 172.21.2.137:0/2675140416 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad3c004500 msgr2=0x7fad3c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 --2- 172.21.2.137:0/2675140416 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad3c004500 0x7fad3c004980 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fad44002f70 tx=0x7fad44006bf0).stop 2021-11-15T19:30:12.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 -- 172.21.2.137:0/2675140416 reap_dead start 2021-11-15T19:30:12.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- 172.21.2.137:0/2675140416 shutdown_connections 2021-11-15T19:30:12.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- 172.21.2.137:0/2675140416 >> 172.21.2.137:0/2675140416 conn(0x7fad5c0630f0 msgr2=0x7fad5c0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:12.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- 172.21.2.137:0/2675140416 shutdown_connections 2021-11-15T19:30:12.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- 172.21.2.137:0/2675140416 wait complete. 2021-11-15T19:30:12.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 Processor -- start 2021-11-15T19:30:12.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- start start 2021-11-15T19:30:12.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c004500 0x7fad5c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad5c110420 0x7fad5c069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 0x7fad5c13dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c159d70 con 0x7fad5c110420 2021-11-15T19:30:12.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c143be0 con 0x7fad5c13d730 2021-11-15T19:30:12.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad62012700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c143940 con 0x7fad3c004500 2021-11-15T19:30:12.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 0x7fad5c13dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 0x7fad5c13dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34158/0 (socket says 172.21.2.137:34158) 2021-11-15T19:30:12.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 -- 172.21.2.137:0/3086845774 learned_addr learned my addr 172.21.2.137:0/3086845774 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:12.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 -- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c004500 msgr2=0x7fad5c156630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:12.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c004500 0x7fad5c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 -- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad5c110420 msgr2=0x7fad5c069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad5c110420 0x7fad5c069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.103+0000 7fad5bfff700 1 -- 172.21.2.137:0/3086845774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c156b20 con 0x7fad5c13d730 2021-11-15T19:30:12.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad5bfff700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 0x7fad5c13dbb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fad54001d50 tx=0x7fad54009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:12.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad54004ab0 con 0x7fad5c13d730 2021-11-15T19:30:12.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54004c10 con 0x7fad5c13d730 2021-11-15T19:30:12.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c06a220 con 0x7fad5c13d730 2021-11-15T19:30:12.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c110020 con 0x7fad5c13d730 2021-11-15T19:30:12.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad54007170 con 0x7fad5c13d730 2021-11-15T19:30:12.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c0573d0 con 0x7fad5c13d730 2021-11-15T19:30:12.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad540072d0 con 0x7fad5c13d730 2021-11-15T19:30:12.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad58ff9700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad40053580 0x7fad40055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fad5406b560 con 0x7fad5c13d730 2021-11-15T19:30:12.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad5b7fe700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad40053580 0x7fad40055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.107+0000 7fad5b7fe700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad40053580 0x7fad40055a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fad4c000f70 tx=0x7fad4c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:12.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.111+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad540429f0 con 0x7fad5c13d730 2021-11-15T19:30:12.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad5c13f180 con 0x7fad5c13d730 2021-11-15T19:30:12.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad58ff9700 1 -- 172.21.2.137:0/3086845774 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+143 (secure 0 0 0) 0x7fad5c13f180 con 0x7fad5c13d730 2021-11-15T19:30:12.199 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:12.199 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:30:12.200 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:12.200 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:30:12.200 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:30:12.200 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:12.200 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:30:12.201 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:30:12.201 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:30:12.201 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:12.201 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:30:12.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad40053580 msgr2=0x7fad40055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad40053580 0x7fad40055a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fad4c000f70 tx=0x7fad4c0069b0).stop 2021-11-15T19:30:12.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 msgr2=0x7fad5c13dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 0x7fad5c13dbb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fad54001d50 tx=0x7fad54009040).stop 2021-11-15T19:30:12.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 shutdown_connections 2021-11-15T19:30:12.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fad40053580 0x7fad40055a40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:12.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fad5c13d730 0x7fad5c13dbb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:12.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fad5c110420 0x7fad5c069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 --2- 172.21.2.137:0/3086845774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fad3c004500 0x7fad5c156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 >> 172.21.2.137:0/3086845774 conn(0x7fad5c0630f0 msgr2=0x7fad5c141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:12.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 shutdown_connections 2021-11-15T19:30:12.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.195+0000 7fad62012700 1 -- 172.21.2.137:0/3086845774 wait complete. 2021-11-15T19:30:12.206 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:30:12.206 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:30:12.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 Processor -- start 2021-11-15T19:30:12.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- start start 2021-11-15T19:30:12.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9f7005c770 0x7f9f700aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9f700b0550 0x7f9f7014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7005cb50 con 0x7f9f7014aaa0 2021-11-15T19:30:12.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700b1650 con 0x7f9f7005c770 2021-11-15T19:30:12.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700ad030 con 0x7f9f700b0550 2021-11-15T19:30:12.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9f700b0550 0x7f9f7014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9f700b0550 0x7f9f7014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34166/0 (socket says 172.21.2.137:34166) 2021-11-15T19:30:12.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 -- 172.21.2.137:0/106808908 learned_addr learned my addr 172.21.2.137:0/106808908 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:12.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 -- 172.21.2.137:0/106808908 >> v2:172.21.2.111:3300/0 conn(0x7f9f7005c770 msgr2=0x7f9f700aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:12.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 --2- 172.21.2.137:0/106808908 >> v2:172.21.2.111:3300/0 conn(0x7f9f7005c770 0x7f9f700aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 -- 172.21.2.137:0/106808908 >> v1:172.21.2.111:6789/0 conn(0x7f9f7014aaa0 legacy=0x7f9f70140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:12.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 -- 172.21.2.137:0/106808908 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700ad2d0 con 0x7f9f700b0550 2021-11-15T19:30:12.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f74dda700 1 --2- 172.21.2.137:0/106808908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f700b0550 0x7f9f7014a5b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f9f700aee10 tx=0x7f9f60006eb0).ready entity=mon.1 client_cookie=57f0893301be228b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:12.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f5ffff700 1 -- 172.21.2.137:0/106808908 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6000d5c0 con 0x7f9f700b0550 2021-11-15T19:30:12.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f5ffff700 1 -- 172.21.2.137:0/106808908 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60000e90 con 0x7f9f700b0550 2021-11-15T19:30:12.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f5ffff700 1 -- 172.21.2.137:0/106808908 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6000d910 con 0x7f9f700b0550 2021-11-15T19:30:12.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- 172.21.2.137:0/106808908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f700b0550 msgr2=0x7f9f7014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 --2- 172.21.2.137:0/106808908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f700b0550 0x7f9f7014a5b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f9f700aee10 tx=0x7f9f60006eb0).stop 2021-11-15T19:30:12.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- 172.21.2.137:0/106808908 shutdown_connections 2021-11-15T19:30:12.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 --2- 172.21.2.137:0/106808908 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f700b0550 0x7f9f7014a5b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:12.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 --2- 172.21.2.137:0/106808908 >> v2:172.21.2.111:3300/0 conn(0x7f9f7005c770 0x7f9f700aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- 172.21.2.137:0/106808908 >> 172.21.2.137:0/106808908 conn(0x7f9f700631e0 msgr2=0x7f9f7005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:12.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- 172.21.2.137:0/106808908 shutdown_connections 2021-11-15T19:30:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.255+0000 7f9f7783f700 1 -- 172.21.2.137:0/106808908 wait complete. 2021-11-15T19:30:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 Processor -- start 2021-11-15T19:30:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- start start 2021-11-15T19:30:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 0x7f9f70144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f700b0550 0x7f9f70145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f7014aaa0 0x7f9f7013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70145760 con 0x7f9f7014aaa0 2021-11-15T19:30:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70142070 con 0x7f9f7005c770 2021-11-15T19:30:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701422a0 con 0x7f9f700b0550 2021-11-15T19:30:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 0x7f9f70144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 0x7f9f70144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34170/0 (socket says 172.21.2.137:34170) 2021-11-15T19:30:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 -- 172.21.2.137:0/3884814519 learned_addr learned my addr 172.21.2.137:0/3884814519 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 -- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f700b0550 msgr2=0x7f9f70145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f700b0550 0x7f9f70145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 -- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f7014aaa0 msgr2=0x7f9f7013ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f7014aaa0 0x7f9f7013ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 -- 172.21.2.137:0/3884814519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6000b1e0 con 0x7f9f7005c770 2021-11-15T19:30:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f755db700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 0x7f9f70144be0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f9f70144740 tx=0x7f9f6c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6c013460 con 0x7f9f7005c770 2021-11-15T19:30:12.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c0135c0 con 0x7f9f7005c770 2021-11-15T19:30:12.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6c013920 con 0x7f9f7005c770 2021-11-15T19:30:12.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f70142fb0 con 0x7f9f7005c770 2021-11-15T19:30:12.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f701416f0 con 0x7f9f7005c770 2021-11-15T19:30:12.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f700ae7f0 con 0x7f9f7005c770 2021-11-15T19:30:12.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f6c00f070 con 0x7f9f7005c770 2021-11-15T19:30:12.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f5e7fc700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f500536a0 0x7f9f50055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:12.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9f6c06acf0 con 0x7f9f7005c770 2021-11-15T19:30:12.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.259+0000 7f9f74dda700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f500536a0 0x7f9f50055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:12.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.263+0000 7f9f74dda700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f500536a0 0x7f9f50055b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9f700aee10 tx=0x7f9f60015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:12.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.263+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f6c042180 con 0x7f9f7005c770 2021-11-15T19:30:12.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:12.347+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9f700573d0 con 0x7f9f7005c770 2021-11-15T19:30:13.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f5e7fc700 1 -- 172.21.2.137:0/3884814519 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9f6c018030 con 0x7f9f7005c770 2021-11-15T19:30:13.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f500536a0 msgr2=0x7f9f50055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:13.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f500536a0 0x7f9f50055b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9f700aee10 tx=0x7f9f60015000).stop 2021-11-15T19:30:13.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 msgr2=0x7f9f70144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:13.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 0x7f9f70144be0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f9f70144740 tx=0x7f9f6c006df0).stop 2021-11-15T19:30:13.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 shutdown_connections 2021-11-15T19:30:13.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f500536a0 0x7f9f50055b60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:13.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f7014aaa0 0x7f9f7013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f700b0550 0x7f9f70145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 --2- 172.21.2.137:0/3884814519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f7005c770 0x7f9f70144be0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 >> 172.21.2.137:0/3884814519 conn(0x7f9f700631e0 msgr2=0x7f9f70149e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:13.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 shutdown_connections 2021-11-15T19:30:13.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.355+0000 7f9f7783f700 1 -- 172.21.2.137:0/3884814519 wait complete. 2021-11-15T19:30:13.364 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:30:13.367 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:30:13.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 Processor -- start 2021-11-15T19:30:13.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- start start 2021-11-15T19:30:13.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f845805c770 0x7f84580aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:13.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8458140aa0 0x7f8458140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:13.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845805cb50 con 0x7f84580b0550 2021-11-15T19:30:13.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580b1650 con 0x7f8458140aa0 2021-11-15T19:30:13.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84580ad030 con 0x7f845805c770 2021-11-15T19:30:13.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8458140aa0 0x7f8458140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:13.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8458140aa0 0x7f8458140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34180/0 (socket says 172.21.2.137:34180) 2021-11-15T19:30:13.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 -- 172.21.2.137:0/3063268960 learned_addr learned my addr 172.21.2.137:0/3063268960 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:13.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 -- 172.21.2.137:0/3063268960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f845805c770 msgr2=0x7f84580aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:13.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 --2- 172.21.2.137:0/3063268960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f845805c770 0x7f84580aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:13.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 -- 172.21.2.137:0/3063268960 >> v1:172.21.2.111:6789/0 conn(0x7f84580b0550 legacy=0x7f845814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:13.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 -- 172.21.2.137:0/3063268960 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580ad2d0 con 0x7f8458140aa0 2021-11-15T19:30:13.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f8456d9d700 1 --2- 172.21.2.137:0/3063268960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458140f10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f84580adfd0 tx=0x7f8450009290).ready entity=mon.1 client_cookie=37750c186d06c4c4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:13.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845559a700 1 -- 172.21.2.137:0/3063268960 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845000b860 con 0x7f8458140aa0 2021-11-15T19:30:13.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845559a700 1 -- 172.21.2.137:0/3063268960 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845000b9c0 con 0x7f8458140aa0 2021-11-15T19:30:13.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845559a700 1 -- 172.21.2.137:0/3063268960 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845000bb70 con 0x7f8458140aa0 2021-11-15T19:30:13.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- 172.21.2.137:0/3063268960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 msgr2=0x7f8458140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:13.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 --2- 172.21.2.137:0/3063268960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458140f10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f84580adfd0 tx=0x7f8450009290).stop 2021-11-15T19:30:13.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- 172.21.2.137:0/3063268960 shutdown_connections 2021-11-15T19:30:13.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 --2- 172.21.2.137:0/3063268960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458140f10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:13.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 --2- 172.21.2.137:0/3063268960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f845805c770 0x7f84580aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:13.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- 172.21.2.137:0/3063268960 >> 172.21.2.137:0/3063268960 conn(0x7f84580631e0 msgr2=0x7f845805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:13.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- 172.21.2.137:0/3063268960 shutdown_connections 2021-11-15T19:30:13.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.415+0000 7f845c805700 1 -- 172.21.2.137:0/3063268960 wait complete. 2021-11-15T19:30:13.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 Processor -- start 2021-11-15T19:30:13.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- start start 2021-11-15T19:30:13.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f845805c770 0x7f8458141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:13.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84580b0550 0x7f845813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:13.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:13.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458141c50 con 0x7f845805c770 2021-11-15T19:30:13.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458143920 con 0x7f8458140aa0 2021-11-15T19:30:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8458145d00 con 0x7f84580b0550 2021-11-15T19:30:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34186/0 (socket says 172.21.2.137:34186) 2021-11-15T19:30:13.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 -- 172.21.2.137:0/2580431594 learned_addr learned my addr 172.21.2.137:0/2580431594 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 -- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84580b0550 msgr2=0x7f845813ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84580b0550 0x7f845813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 -- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f845805c770 msgr2=0x7f8458141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:13.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f845805c770 0x7f8458141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 -- 172.21.2.137:0/2580431594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450009530 con 0x7f8458140aa0 2021-11-15T19:30:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f8456d9d700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458148f30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f84580adfd0 tx=0x7f8450016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845000bb30 con 0x7f8458140aa0 2021-11-15T19:30:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845001f420 con 0x7f8458140aa0 2021-11-15T19:30:13.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845814aad0 con 0x7f8458140aa0 2021-11-15T19:30:13.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845001f780 con 0x7f8458140aa0 2021-11-15T19:30:13.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845813c0e0 con 0x7f8458140aa0 2021-11-15T19:30:13.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8458145ec0 con 0x7f8458140aa0 2021-11-15T19:30:13.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f845000f070 con 0x7f8458140aa0 2021-11-15T19:30:13.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f844f7fe700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f843c0536a0 0x7f843c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:13.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f845006c440 con 0x7f8458140aa0 2021-11-15T19:30:13.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.419+0000 7f845659c700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f843c0536a0 0x7f843c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:13.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.423+0000 7f845659c700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f843c0536a0 0x7f843c055b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f8440002f70 tx=0x7f8440006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:13.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.423+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8450043660 con 0x7f8458140aa0 2021-11-15T19:30:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:13.507+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f8458148000 con 0x7f8458140aa0 2021-11-15T19:30:14.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f844f7fe700 1 -- 172.21.2.137:0/2580431594 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v49) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8450015070 con 0x7f8458140aa0 2021-11-15T19:30:14.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f843c0536a0 msgr2=0x7f843c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f843c0536a0 0x7f843c055b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f8440002f70 tx=0x7f8440006a80).stop 2021-11-15T19:30:14.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 msgr2=0x7f8458148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458148f30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f84580adfd0 tx=0x7f8450016000).stop 2021-11-15T19:30:14.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 shutdown_connections 2021-11-15T19:30:14.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f843c0536a0 0x7f843c055b60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8458140aa0 0x7f8458148f30 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84580b0550 0x7f845813ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 --2- 172.21.2.137:0/2580431594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f845805c770 0x7f8458141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 >> 172.21.2.137:0/2580431594 conn(0x7f84580631e0 msgr2=0x7f84580b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 shutdown_connections 2021-11-15T19:30:14.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.367+0000 7f845c805700 1 -- 172.21.2.137:0/2580431594 wait complete. 2021-11-15T19:30:14.376 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:30:14.379 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:30:14.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 Processor -- start 2021-11-15T19:30:14.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- start start 2021-11-15T19:30:14.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 0x7f4a680af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4a680b10b0 0x7f4a680b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a68147f70 con 0x7f4a680b0610 2021-11-15T19:30:14.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a68060100 con 0x7f4a680b10b0 2021-11-15T19:30:14.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68147cd0 con 0x7f4a6805fd20 2021-11-15T19:30:14.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4a680b0610 0x7f4a680aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:52976/0 (socket says 172.21.2.137:52976) 2021-11-15T19:30:14.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 -- 172.21.2.137:0/2371677100 learned_addr learned my addr 172.21.2.137:0/2371677100 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:14.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6de45700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 0x7f4a680af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6d644700 1 --2- 172.21.2.137:0/2371677100 >> v2:172.21.2.111:3300/0 conn(0x7f4a680b10b0 0x7f4a680b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672355833 0 0) 0x7f4a68147f70 con 0x7f4a680b0610 2021-11-15T19:30:14.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a50003260 con 0x7f4a680b0610 2021-11-15T19:30:14.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372158969 0 0) 0x7f4a50003260 con 0x7f4a680b0610 2021-11-15T19:30:14.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 msgr2=0x7f4a680af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 0x7f4a680af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 >> v2:172.21.2.111:3300/0 conn(0x7f4a680b10b0 msgr2=0x7f4a680b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 --2- 172.21.2.137:0/2371677100 >> v2:172.21.2.111:3300/0 conn(0x7f4a680b10b0 0x7f4a680b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680a9ed0 con 0x7f4a680b0610 2021-11-15T19:30:14.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4a600019e0 con 0x7f4a680b0610 2021-11-15T19:30:14.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 >> v1:172.21.2.137:6789/0 conn(0x7f4a680b0610 legacy=0x7f4a680aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 0x7f4a500037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a50003d50 0x7f4a50004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a500049f0 0x7f4a50004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68060100 con 0x7f4a50003d50 2021-11-15T19:30:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68147cd0 con 0x7f4a500049f0 2021-11-15T19:30:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5000b780 con 0x7f4a6805fd20 2021-11-15T19:30:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a500049f0 0x7f4a50004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 -- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 msgr2=0x7f4a500037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a6805fd20 0x7f4a500037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 -- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a50003d50 msgr2=0x7f4a50004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a50003d50 0x7f4a50004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 -- 172.21.2.137:0/2371677100 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50003260 con 0x7f4a500049f0 2021-11-15T19:30:14.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a500049f0 0x7f4a50004e70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4a600016f0 tx=0x7f4a680b5e40).ready entity=mon.1 client_cookie=c8799bbaaddad189 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6000cc70 con 0x7f4a500049f0 2021-11-15T19:30:14.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6000cdd0 con 0x7f4a500049f0 2021-11-15T19:30:14.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6ce43700 1 -- 172.21.2.137:0/2371677100 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a60005b80 con 0x7f4a500049f0 2021-11-15T19:30:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- 172.21.2.137:0/2371677100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a500049f0 msgr2=0x7f4a50004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2371677100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a500049f0 0x7f4a50004e70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4a600016f0 tx=0x7f4a680b5e40).stop 2021-11-15T19:30:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a6e646700 1 -- 172.21.2.137:0/2371677100 reap_dead start 2021-11-15T19:30:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- 172.21.2.137:0/2371677100 shutdown_connections 2021-11-15T19:30:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.431+0000 7f4a700a9700 1 -- 172.21.2.137:0/2371677100 >> 172.21.2.137:0/2371677100 conn(0x7f4a680b4e60 msgr2=0x7f4a680b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- 172.21.2.137:0/2371677100 shutdown_connections 2021-11-15T19:30:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- 172.21.2.137:0/2371677100 wait complete. 2021-11-15T19:30:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 Processor -- start 2021-11-15T19:30:14.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- start start 2021-11-15T19:30:14.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a500049f0 0x7f4a680ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 0x7f4a68143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a68062de0 0x7f4a68143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68159e70 con 0x7f4a500049f0 2021-11-15T19:30:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6815a110 con 0x7f4a680ac790 2021-11-15T19:30:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6815a3b0 con 0x7f4a68062de0 2021-11-15T19:30:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 0x7f4a68143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 0x7f4a68143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34206/0 (socket says 172.21.2.137:34206) 2021-11-15T19:30:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 -- 172.21.2.137:0/2048704150 learned_addr learned my addr 172.21.2.137:0/2048704150 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6de45700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a500049f0 0x7f4a680ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 -- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a68062de0 msgr2=0x7f4a68143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a68062de0 0x7f4a68143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 -- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a500049f0 msgr2=0x7f4a680ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a500049f0 0x7f4a680ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 -- 172.21.2.137:0/2048704150 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68144020 con 0x7f4a680ac790 2021-11-15T19:30:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6d644700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 0x7f4a68143640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4a5800c000 tx=0x7f4a58006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a58016070 con 0x7f4a680ac790 2021-11-15T19:30:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a58000e90 con 0x7f4a680ac790 2021-11-15T19:30:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a58010970 con 0x7f4a680ac790 2021-11-15T19:30:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a68159af0 con 0x7f4a680ac790 2021-11-15T19:30:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6815a850 con 0x7f4a680ac790 2021-11-15T19:30:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6815a570 con 0x7f4a680ac790 2021-11-15T19:30:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a58010ad0 con 0x7f4a680ac790 2021-11-15T19:30:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a56ffd700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a480534f0 0x7f4a480559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f4a5806b8f0 con 0x7f4a680ac790 2021-11-15T19:30:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.435+0000 7f4a6de45700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a480534f0 0x7f4a480559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.439+0000 7f4a6de45700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a480534f0 0x7f4a480559b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f4a6400b000 tx=0x7f4a64008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.439+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a58042ac0 con 0x7f4a680ac790 2021-11-15T19:30:14.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.551+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4a68159c80 con 0x7f4a680ac790 2021-11-15T19:30:14.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.563+0000 7f4a56ffd700 1 -- 172.21.2.137:0/2048704150 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v19) v1 ==== 188+0+0 (secure 0 0 0) 0x7f4a580460e0 con 0x7f4a680ac790 2021-11-15T19:30:14.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a480534f0 msgr2=0x7f4a480559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a480534f0 0x7f4a480559b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f4a6400b000 tx=0x7f4a64008040).stop 2021-11-15T19:30:14.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 msgr2=0x7f4a68143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 0x7f4a68143640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4a5800c000 tx=0x7f4a58006df0).stop 2021-11-15T19:30:14.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 shutdown_connections 2021-11-15T19:30:14.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4a480534f0 0x7f4a480559b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4a68062de0 0x7f4a68143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4a680ac790 0x7f4a68143640 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 --2- 172.21.2.137:0/2048704150 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4a500049f0 0x7f4a680ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 >> 172.21.2.137:0/2048704150 conn(0x7f4a680b4e60 msgr2=0x7f4a68145f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 shutdown_connections 2021-11-15T19:30:14.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.567+0000 7f4a700a9700 1 -- 172.21.2.137:0/2048704150 wait complete. 2021-11-15T19:30:14.574 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 9 and data pool 10 2021-11-15T19:30:14.577 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:30:14.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 Processor -- start 2021-11-15T19:30:14.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- start start 2021-11-15T19:30:14.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fb40b1340 0x7f1fb4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40a9f50 0x7f1fb40aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb4148190 con 0x7f1fb4143f00 2021-11-15T19:30:14.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40b1720 con 0x7f1fb40b1340 2021-11-15T19:30:14.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4147e70 con 0x7f1fb40a9f50 2021-11-15T19:30:14.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb8f5c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fb40b1340 0x7f1fb4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb3fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1fb4143f00 0x7f1fb4144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53004/0 (socket says 172.21.2.137:53004) 2021-11-15T19:30:14.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb3fff700 1 -- 172.21.2.137:0/619788790 learned_addr learned my addr 172.21.2.137:0/619788790 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:14.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/619788790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40a9f50 msgr2=0x7f1fb40aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb8f5c700 1 --2- 172.21.2.137:0/619788790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40a9f50 0x7f1fb40aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/619788790 >> v1:172.21.2.137:6789/0 conn(0x7f1fb4143f00 legacy=0x7f1fb4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/619788790 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40af800 con 0x7f1fb40b1340 2021-11-15T19:30:14.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb8f5c700 1 --2- 172.21.2.137:0/619788790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40b1340 0x7f1fb4147980 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f1fa4002f70 tx=0x7f1fa4006df0).ready entity=mon.1 client_cookie=d8378a576bdc3211 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb37fe700 1 -- 172.21.2.137:0/619788790 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa400d570 con 0x7f1fb40b1340 2021-11-15T19:30:14.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb37fe700 1 -- 172.21.2.137:0/619788790 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4000e90 con 0x7f1fb40b1340 2021-11-15T19:30:14.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fb37fe700 1 -- 172.21.2.137:0/619788790 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa400d8c0 con 0x7f1fb40b1340 2021-11-15T19:30:14.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/619788790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40b1340 msgr2=0x7f1fb4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/619788790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40b1340 0x7f1fb4147980 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f1fa4002f70 tx=0x7f1fa4006df0).stop 2021-11-15T19:30:14.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/619788790 shutdown_connections 2021-11-15T19:30:14.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/619788790 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40a9f50 0x7f1fb40aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/619788790 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40b1340 0x7f1fb4147980 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/619788790 >> 172.21.2.137:0/619788790 conn(0x7f1fb40b4e60 msgr2=0x7f1fb40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/619788790 shutdown_connections 2021-11-15T19:30:14.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/619788790 wait complete. 2021-11-15T19:30:14.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 Processor -- start 2021-11-15T19:30:14.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- start start 2021-11-15T19:30:14.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 0x7f1fb4140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b1340 0x7f1fb41467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb4143f00 0x7f1fb415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb415ab30 con 0x7f1fb4143f00 2021-11-15T19:30:14.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb409a420 con 0x7f1fb40a9f50 2021-11-15T19:30:14.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.623+0000 7f1fbb1c0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4159c60 con 0x7f1fb40b1340 2021-11-15T19:30:14.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 0x7f1fb4140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 0x7f1fb4140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34226/0 (socket says 172.21.2.137:34226) 2021-11-15T19:30:14.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/1776372394 learned_addr learned my addr 172.21.2.137:0/1776372394 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:14.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b1340 msgr2=0x7f1fb41467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b1340 0x7f1fb41467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb4143f00 msgr2=0x7f1fb415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb4143f00 0x7f1fb415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 -- 172.21.2.137:0/1776372394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa400b180 con 0x7f1fb40a9f50 2021-11-15T19:30:14.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb8f5c700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 0x7f1fb4140d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f1fa4002f70 tx=0x7f1fa4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa4011790 con 0x7f1fb40a9f50 2021-11-15T19:30:14.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40118f0 con 0x7f1fb40a9f50 2021-11-15T19:30:14.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb4159f00 con 0x7f1fb40a9f50 2021-11-15T19:30:14.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40ac2a0 con 0x7f1fb40a9f50 2021-11-15T19:30:14.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa4011c50 con 0x7f1fb40a9f50 2021-11-15T19:30:14.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40573d0 con 0x7f1fb40a9f50 2021-11-15T19:30:14.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fa4025030 con 0x7f1fb40a9f50 2021-11-15T19:30:14.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb1ffb700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f940534f0 0x7f1f940559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1fa406cc20 con 0x7f1fb40a9f50 2021-11-15T19:30:14.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb3fff700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f940534f0 0x7f1f940559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.627+0000 7f1fb3fff700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f940534f0 0x7f1f940559b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f1fb4062250 tx=0x7f1fa8007820).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.631+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fa4043d80 con 0x7f1fb40a9f50 2021-11-15T19:30:14.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb405f730 con 0x7f1fb40a9f50 2021-11-15T19:30:14.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/1776372394 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f1fa4023020 con 0x7f1fb40a9f50 2021-11-15T19:30:14.720 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:14.721 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":51,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:30:14.556844+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:30:12.364466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T19:30:13.528542+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:30:14.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f940534f0 msgr2=0x7f1f940559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f940534f0 0x7f1f940559b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f1fb4062250 tx=0x7f1fa8007820).stop 2021-11-15T19:30:14.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 msgr2=0x7f1fb4140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 0x7f1fb4140d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f1fa4002f70 tx=0x7f1fa4015000).stop 2021-11-15T19:30:14.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 shutdown_connections 2021-11-15T19:30:14.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f940534f0 0x7f1f940559b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb4143f00 0x7f1fb415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b1340 0x7f1fb41467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 --2- 172.21.2.137:0/1776372394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb40a9f50 0x7f1fb4140d00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 >> 172.21.2.137:0/1776372394 conn(0x7f1fb40b4e60 msgr2=0x7f1fb40b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 shutdown_connections 2021-11-15T19:30:14.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.715+0000 7f1fbb1c0700 1 -- 172.21.2.137:0/1776372394 wait complete. 2021-11-15T19:30:14.728 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:30:14.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 Processor -- start 2021-11-15T19:30:14.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- start start 2021-11-15T19:30:14.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf480b1340 0x7faf48147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf48148190 con 0x7faf48143f00 2021-11-15T19:30:14.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480b1720 con 0x7faf480a9f50 2021-11-15T19:30:14.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf48147e70 con 0x7faf480b1340 2021-11-15T19:30:14.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4e541700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7faf480a9f50 0x7faf480aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53020/0 (socket says 172.21.2.137:53020) 2021-11-15T19:30:14.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4e541700 1 -- 172.21.2.137:0/3342204001 learned_addr learned my addr 172.21.2.137:0/3342204001 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:14.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4dd40700 1 --2- 172.21.2.137:0/3342204001 >> v2:172.21.2.137:3300/0 conn(0x7faf480b1340 0x7faf48147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4dd40700 1 -- 172.21.2.137:0/3342204001 >> v1:172.21.2.137:6789/0 conn(0x7faf480a9f50 legacy=0x7faf480aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4dd40700 1 -- 172.21.2.137:0/3342204001 >> v1:172.21.2.111:6789/0 conn(0x7faf48143f00 legacy=0x7faf48144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4dd40700 1 -- 172.21.2.137:0/3342204001 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480af800 con 0x7faf480b1340 2021-11-15T19:30:14.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4dd40700 1 --2- 172.21.2.137:0/3342204001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48147980 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7faf48062250 tx=0x7faf44006df0).ready entity=mon.1 client_cookie=d5378a270dc34f78 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4cd3e700 1 -- 172.21.2.137:0/3342204001 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4400d5c0 con 0x7faf480b1340 2021-11-15T19:30:14.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4cd3e700 1 -- 172.21.2.137:0/3342204001 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44000e90 con 0x7faf480b1340 2021-11-15T19:30:14.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4cd3e700 1 -- 172.21.2.137:0/3342204001 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4400d910 con 0x7faf480b1340 2021-11-15T19:30:14.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3342204001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 msgr2=0x7faf48147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3342204001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48147980 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7faf48062250 tx=0x7faf44006df0).stop 2021-11-15T19:30:14.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3342204001 shutdown_connections 2021-11-15T19:30:14.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3342204001 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48147980 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3342204001 >> 172.21.2.137:0/3342204001 conn(0x7faf480b4e60 msgr2=0x7faf480b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3342204001 shutdown_connections 2021-11-15T19:30:14.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3342204001 wait complete. 2021-11-15T19:30:14.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.779+0000 7faf4ffa4700 1 Processor -- start 2021-11-15T19:30:14.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- start start 2021-11-15T19:30:14.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf480a9f50 0x7faf48146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf48143f00 0x7faf481409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4809a1d0 con 0x7faf48143f00 2021-11-15T19:30:14.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48143070 con 0x7faf480b1340 2021-11-15T19:30:14.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf48099f30 con 0x7faf480a9f50 2021-11-15T19:30:14.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34240/0 (socket says 172.21.2.137:34240) 2021-11-15T19:30:14.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 -- 172.21.2.137:0/3758779701 learned_addr learned my addr 172.21.2.137:0/3758779701 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:14.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 -- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf480a9f50 msgr2=0x7faf48146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf480a9f50 0x7faf48146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 -- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf48143f00 msgr2=0x7faf481409c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:14.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf48143f00 0x7faf481409c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 -- 172.21.2.137:0/3758779701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4400b180 con 0x7faf480b1340 2021-11-15T19:30:14.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4d53f700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48159ce0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7faf48142490 tx=0x7faf3c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c012410 con 0x7faf480b1340 2021-11-15T19:30:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c012570 con 0x7faf480b1340 2021-11-15T19:30:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c0128d0 con 0x7faf480b1340 2021-11-15T19:30:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf48140520 con 0x7faf480b1340 2021-11-15T19:30:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4815a1d0 con 0x7faf480b1340 2021-11-15T19:30:14.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf481406b0 con 0x7faf480b1340 2021-11-15T19:30:14.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf3c00f030 con 0x7faf480b1340 2021-11-15T19:30:14.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf3affd700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf28053610 0x7faf28055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faf3c06b660 con 0x7faf480b1340 2021-11-15T19:30:14.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.783+0000 7faf4dd40700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf28053610 0x7faf28055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.787+0000 7faf4dd40700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf28053610 0x7faf28055ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7faf48062250 tx=0x7faf44012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.787+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf3c0427c0 con 0x7faf480b1340 2021-11-15T19:30:14.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf4805faf0 con 0x7faf480b1340 2021-11-15T19:30:14.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf3affd700 1 -- 172.21.2.137:0/3758779701 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16066 (secure 0 0 0) 0x7faf3c045de0 con 0x7faf480b1340 2021-11-15T19:30:14.875 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:14.876 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":51,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:30:14.556844+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:30:12.364466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T19:30:13.528542+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:30:14.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf28053610 msgr2=0x7faf28055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf28053610 0x7faf28055ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7faf48062250 tx=0x7faf44012000).stop 2021-11-15T19:30:14.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 msgr2=0x7faf48159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48159ce0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7faf48142490 tx=0x7faf3c006d50).stop 2021-11-15T19:30:14.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 shutdown_connections 2021-11-15T19:30:14.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf28053610 0x7faf28055ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf48143f00 0x7faf481409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf480b1340 0x7faf48159ce0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 --2- 172.21.2.137:0/3758779701 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf480a9f50 0x7faf48146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 >> 172.21.2.137:0/3758779701 conn(0x7faf480b4e60 msgr2=0x7faf4814abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 shutdown_connections 2021-11-15T19:30:14.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.871+0000 7faf4ffa4700 1 -- 172.21.2.137:0/3758779701 wait complete. 2021-11-15T19:30:14.883 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:30:14.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 Processor -- start 2021-11-15T19:30:14.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- start start 2021-11-15T19:30:14.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f000405c770 0x7f00040aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f00040b0550 0x7f000414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000405cb50 con 0x7f000414aaa0 2021-11-15T19:30:14.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040b1650 con 0x7f000405c770 2021-11-15T19:30:14.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040ad030 con 0x7f00040b0550 2021-11-15T19:30:14.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00037fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f000414aaa0 0x7f0004140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53030/0 (socket says 172.21.2.137:53030) 2021-11-15T19:30:14.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00037fe700 1 -- 172.21.2.137:0/3281603314 learned_addr learned my addr 172.21.2.137:0/3281603314 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:14.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00027fc700 1 --2- 172.21.2.137:0/3281603314 >> v2:172.21.2.137:3300/0 conn(0x7f00040b0550 0x7f000414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00027fc700 1 -- 172.21.2.137:0/3281603314 >> v2:172.21.2.111:3300/0 conn(0x7f000405c770 msgr2=0x7f00040aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:14.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00027fc700 1 --2- 172.21.2.137:0/3281603314 >> v2:172.21.2.111:3300/0 conn(0x7f000405c770 0x7f00040aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00027fc700 1 -- 172.21.2.137:0/3281603314 >> v1:172.21.2.137:6789/0 conn(0x7f000414aaa0 legacy=0x7f0004140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00027fc700 1 -- 172.21.2.137:0/3281603314 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040ad2d0 con 0x7f00040b0550 2021-11-15T19:30:14.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f00027fc700 1 --2- 172.21.2.137:0/3281603314 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414a5b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7effec002f70 tx=0x7effec006df0).ready entity=mon.1 client_cookie=8e0ac48711b04144 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0001ffb700 1 -- 172.21.2.137:0/3281603314 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec00d5c0 con 0x7f00040b0550 2021-11-15T19:30:14.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0001ffb700 1 -- 172.21.2.137:0/3281603314 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec000e90 con 0x7f00040b0550 2021-11-15T19:30:14.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0001ffb700 1 -- 172.21.2.137:0/3281603314 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec00d910 con 0x7f00040b0550 2021-11-15T19:30:14.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- 172.21.2.137:0/3281603314 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 msgr2=0x7f000414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 --2- 172.21.2.137:0/3281603314 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414a5b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7effec002f70 tx=0x7effec006df0).stop 2021-11-15T19:30:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- 172.21.2.137:0/3281603314 shutdown_connections 2021-11-15T19:30:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 --2- 172.21.2.137:0/3281603314 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414a5b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 --2- 172.21.2.137:0/3281603314 >> v2:172.21.2.111:3300/0 conn(0x7f000405c770 0x7f00040aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- 172.21.2.137:0/3281603314 >> 172.21.2.137:0/3281603314 conn(0x7f00040631e0 msgr2=0x7f000405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- 172.21.2.137:0/3281603314 shutdown_connections 2021-11-15T19:30:14.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- 172.21.2.137:0/3281603314 wait complete. 2021-11-15T19:30:14.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 Processor -- start 2021-11-15T19:30:14.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.931+0000 7f0009a06700 1 -- start start 2021-11-15T19:30:14.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f000405c770 0x7f0004159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f000414aaa0 0x7f0004063d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000413b670 con 0x7f000405c770 2021-11-15T19:30:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000414e140 con 0x7f00040b0550 2021-11-15T19:30:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000413b3d0 con 0x7f000414aaa0 2021-11-15T19:30:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34256/0 (socket says 172.21.2.137:34256) 2021-11-15T19:30:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 -- 172.21.2.137:0/695773812 learned_addr learned my addr 172.21.2.137:0/695773812 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 -- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f000414aaa0 msgr2=0x7f0004063d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f000414aaa0 0x7f0004063d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 -- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f000405c770 msgr2=0x7f0004159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f000405c770 0x7f0004159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 -- 172.21.2.137:0/695773812 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec00b180 con 0x7f00040b0550 2021-11-15T19:30:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f00027fc700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414d860 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7effec002f70 tx=0x7effec014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec01e400 con 0x7f00040b0550 2021-11-15T19:30:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec01e560 con 0x7f00040b0550 2021-11-15T19:30:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0004063870 con 0x7f00040b0550 2021-11-15T19:30:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec01e8c0 con 0x7f00040b0550 2021-11-15T19:30:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0004066cc0 con 0x7f00040b0550 2021-11-15T19:30:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040ae7f0 con 0x7f00040b0550 2021-11-15T19:30:14.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7effec01c070 con 0x7f00040b0550 2021-11-15T19:30:14.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7efffbfff700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7effe80536a0 0x7effe8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:14.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6069+0+0 (secure 0 0 0) 0x7effec06c780 con 0x7f00040b0550 2021-11-15T19:30:14.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.935+0000 7f0002ffd700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7effe80536a0 0x7effe8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:14.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.939+0000 7f0002ffd700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7effe80536a0 0x7effe8055b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efff4002f70 tx=0x7efff4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:14.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:14.939+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7effec0437d0 con 0x7f00040b0550 2021-11-15T19:30:15.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.051+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f00040573d0 con 0x7f00040b0550 2021-11-15T19:30:15.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7efffbfff700 1 -- 172.21.2.137:0/695773812 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7effec0230b0 con 0x7f00040b0550 2021-11-15T19:30:15.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7effe80536a0 msgr2=0x7effe8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7effe80536a0 0x7effe8055b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efff4002f70 tx=0x7efff4006a80).stop 2021-11-15T19:30:15.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 msgr2=0x7f000414d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414d860 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7effec002f70 tx=0x7effec014000).stop 2021-11-15T19:30:15.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 shutdown_connections 2021-11-15T19:30:15.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7effe80536a0 0x7effe8055b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f000414aaa0 0x7f0004063d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f00040b0550 0x7f000414d860 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 --2- 172.21.2.137:0/695773812 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f000405c770 0x7f0004159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 >> 172.21.2.137:0/695773812 conn(0x7f00040631e0 msgr2=0x7f00040b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:15.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 shutdown_connections 2021-11-15T19:30:15.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.575+0000 7f0009a06700 1 -- 172.21.2.137:0/695773812 wait complete. 2021-11-15T19:30:15.587 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:15.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 Processor -- start 2021-11-15T19:30:15.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- start start 2021-11-15T19:30:15.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa440142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4400b63b0 con 0x7fa4400b5fd0 2021-11-15T19:30:15.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa440147070 con 0x7fa4400b6830 2021-11-15T19:30:15.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa440146dd0 con 0x7fa44013ce00 2021-11-15T19:30:15.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43ed9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa4400b6830 0x7fa4401433c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53046/0 (socket says 172.21.2.137:53046) 2021-11-15T19:30:15.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43ed9d700 1 -- 172.21.2.137:0/2687910338 learned_addr learned my addr 172.21.2.137:0/2687910338 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:15.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485745561 0 0) 0x7fa440147070 con 0x7fa4400b6830 2021-11-15T19:30:15.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa424003260 con 0x7fa4400b6830 2021-11-15T19:30:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43dd9b700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa440142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062095088 0 0) 0x7fa424003260 con 0x7fa4400b6830 2021-11-15T19:30:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 msgr2=0x7fa440142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa440142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 >> v1:172.21.2.111:6789/0 conn(0x7fa4400b5fd0 legacy=0x7fa44013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440143ad0 con 0x7fa4400b6830 2021-11-15T19:30:15.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa4380019e0 con 0x7fa4400b6830 2021-11-15T19:30:15.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 >> v1:172.21.2.137:6789/0 conn(0x7fa4400b6830 legacy=0x7fa4401433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa424003750 0x7fa424003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa424004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424004a40 0x7fa424004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa440146dd0 con 0x7fa424004a40 2021-11-15T19:30:15.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42400b860 con 0x7fa424003750 2021-11-15T19:30:15.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42400ba20 con 0x7fa44013ce00 2021-11-15T19:30:15.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa424003750 0x7fa424003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43ed9d700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424004a40 0x7fa424004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43dd9b700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa424004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 -- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 msgr2=0x7fa424004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa424004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 -- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424004a40 msgr2=0x7fa424004ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424004a40 0x7fa424004ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 -- 172.21.2.137:0/2687910338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424003260 con 0x7fa424003750 2021-11-15T19:30:15.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43dd9b700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa44013ce00 0x7fa424004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:15.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43e59c700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa424003750 0x7fa424003b70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fa44013d200 tx=0x7fa430007a00).ready entity=mon.1 client_cookie=1c9bddde87975cd0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa430007d10 con 0x7fa424003750 2021-11-15T19:30:15.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430007070 con 0x7fa424003750 2021-11-15T19:30:15.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43d59a700 1 -- 172.21.2.137:0/2687910338 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4300073d0 con 0x7fa424003750 2021-11-15T19:30:15.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- 172.21.2.137:0/2687910338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa424003750 msgr2=0x7fa424003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 --2- 172.21.2.137:0/2687910338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa424003750 0x7fa424003b70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fa44013d200 tx=0x7fa430007a00).stop 2021-11-15T19:30:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa43ed9d700 1 -- 172.21.2.137:0/2687910338 reap_dead start 2021-11-15T19:30:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- 172.21.2.137:0/2687910338 shutdown_connections 2021-11-15T19:30:15.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- 172.21.2.137:0/2687910338 >> 172.21.2.137:0/2687910338 conn(0x7fa4400624b0 msgr2=0x7fa440062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- 172.21.2.137:0/2687910338 shutdown_connections 2021-11-15T19:30:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.643+0000 7fa444ffb700 1 -- 172.21.2.137:0/2687910338 wait complete. 2021-11-15T19:30:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 Processor -- start 2021-11-15T19:30:15.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- start start 2021-11-15T19:30:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424003750 0x7fa4401415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 0x7fa440152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa440152870 0x7fa440152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44013dc10 con 0x7fa424003750 2021-11-15T19:30:15.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400af500 con 0x7fa440141ad0 2021-11-15T19:30:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44013de40 con 0x7fa440152870 2021-11-15T19:30:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 0x7fa440152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 0x7fa440152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34274/0 (socket says 172.21.2.137:34274) 2021-11-15T19:30:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 -- 172.21.2.137:0/1951175303 learned_addr learned my addr 172.21.2.137:0/1951175303 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:15.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 -- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa440152870 msgr2=0x7fa440152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa440152870 0x7fa440152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 -- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424003750 msgr2=0x7fa4401415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424003750 0x7fa4401415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 -- 172.21.2.137:0/1951175303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44013e0e0 con 0x7fa440141ad0 2021-11-15T19:30:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43dd9b700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 0x7fa440152380 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fa434002f30 tx=0x7fa434008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43400c070 con 0x7fa440141ad0 2021-11-15T19:30:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434000e90 con 0x7fa440141ad0 2021-11-15T19:30:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44013f570 con 0x7fa440141ad0 2021-11-15T19:30:15.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44013fa40 con 0x7fa440141ad0 2021-11-15T19:30:15.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4340135e0 con 0x7fa440141ad0 2021-11-15T19:30:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440146af0 con 0x7fa440141ad0 2021-11-15T19:30:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa434019020 con 0x7fa440141ad0 2021-11-15T19:30:15.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa42f7fe700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa41c0536f0 0x7fa41c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa43406b030 con 0x7fa440141ad0 2021-11-15T19:30:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43e59c700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa41c0536f0 0x7fa41c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.647+0000 7fa43e59c700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa41c0536f0 0x7fa41c055bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fa44013d200 tx=0x7fa430015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.651+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa434042080 con 0x7fa440141ad0 2021-11-15T19:30:15.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa440061100 con 0x7fa440141ad0 2021-11-15T19:30:15.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa42f7fe700 1 -- 172.21.2.137:0/1951175303 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fa434017070 con 0x7fa440141ad0 2021-11-15T19:30:15.764 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:15.765 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:15.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa41c0536f0 msgr2=0x7fa41c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa41c0536f0 0x7fa41c055bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fa44013d200 tx=0x7fa430015000).stop 2021-11-15T19:30:15.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 msgr2=0x7fa440152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 0x7fa440152380 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fa434002f30 tx=0x7fa434008040).stop 2021-11-15T19:30:15.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 shutdown_connections 2021-11-15T19:30:15.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa41c0536f0 0x7fa41c055bb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa440152870 0x7fa440152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa440141ad0 0x7fa440152380 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 --2- 172.21.2.137:0/1951175303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa424003750 0x7fa4401415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 >> 172.21.2.137:0/1951175303 conn(0x7fa4400624b0 msgr2=0x7fa440145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:15.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 shutdown_connections 2021-11-15T19:30:15.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.759+0000 7fa444ffb700 1 -- 172.21.2.137:0/1951175303 wait complete. 2021-11-15T19:30:15.768 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:15.771 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:30:15.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 Processor -- start 2021-11-15T19:30:15.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- start start 2021-11-15T19:30:15.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400608f0 0x7faf4013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faf400b1660 0x7faf400b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf400b2c00 0x7faf4005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400ad6c0 con 0x7faf400b1660 2021-11-15T19:30:15.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400b0c80 con 0x7faf400b2c00 2021-11-15T19:30:15.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf400b0f20 con 0x7faf400608f0 2021-11-15T19:30:15.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf400b2c00 0x7faf4005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf400b2c00 0x7faf4005f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34282/0 (socket says 172.21.2.137:34282) 2021-11-15T19:30:15.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 -- 172.21.2.137:0/1238330402 learned_addr learned my addr 172.21.2.137:0/1238330402 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:15.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 -- 172.21.2.137:0/1238330402 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400608f0 msgr2=0x7faf4013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 --2- 172.21.2.137:0/1238330402 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400608f0 0x7faf4013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 -- 172.21.2.137:0/1238330402 >> v2:172.21.2.111:3300/0 conn(0x7faf400b1660 msgr2=0x7faf400b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 --2- 172.21.2.137:0/1238330402 >> v2:172.21.2.111:3300/0 conn(0x7faf400b1660 0x7faf400b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 -- 172.21.2.137:0/1238330402 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400b11c0 con 0x7faf400b2c00 2021-11-15T19:30:15.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf468af700 1 --2- 172.21.2.137:0/1238330402 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b2c00 0x7faf4005f730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7faf380032f0 tx=0x7faf3800b530).ready entity=mon.1 client_cookie=f3cac5bbbbd0288d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf450ac700 1 -- 172.21.2.137:0/1238330402 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3800be70 con 0x7faf400b2c00 2021-11-15T19:30:15.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf450ac700 1 -- 172.21.2.137:0/1238330402 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38010470 con 0x7faf400b2c00 2021-11-15T19:30:15.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf450ac700 1 -- 172.21.2.137:0/1238330402 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf380107d0 con 0x7faf400b2c00 2021-11-15T19:30:15.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- 172.21.2.137:0/1238330402 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b2c00 msgr2=0x7faf4005f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- 172.21.2.137:0/1238330402 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b2c00 0x7faf4005f730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7faf380032f0 tx=0x7faf3800b530).stop 2021-11-15T19:30:15.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- 172.21.2.137:0/1238330402 shutdown_connections 2021-11-15T19:30:15.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- 172.21.2.137:0/1238330402 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b2c00 0x7faf4005f730 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- 172.21.2.137:0/1238330402 >> v2:172.21.2.111:3300/0 conn(0x7faf400b1660 0x7faf400b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- 172.21.2.137:0/1238330402 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400608f0 0x7faf4013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- 172.21.2.137:0/1238330402 >> 172.21.2.137:0/1238330402 conn(0x7faf40063980 msgr2=0x7faf40063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:15.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- 172.21.2.137:0/1238330402 shutdown_connections 2021-11-15T19:30:15.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- 172.21.2.137:0/1238330402 wait complete. 2021-11-15T19:30:15.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 Processor -- start 2021-11-15T19:30:15.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 -- start start 2021-11-15T19:30:15.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.819+0000 7faf48312700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf400608f0 0x7faf4013b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 0x7faf4013a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400b2c00 0x7faf4013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf40143400 con 0x7faf400608f0 2021-11-15T19:30:15.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf401435f0 con 0x7faf400b1660 2021-11-15T19:30:15.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf40143890 con 0x7faf400b2c00 2021-11-15T19:30:15.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 0x7faf4013a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 0x7faf4013a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34290/0 (socket says 172.21.2.137:34290) 2021-11-15T19:30:15.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 -- 172.21.2.137:0/1259858050 learned_addr learned my addr 172.21.2.137:0/1259858050 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:15.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 -- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400b2c00 msgr2=0x7faf4013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400b2c00 0x7faf4013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 -- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf400608f0 msgr2=0x7faf4013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf400608f0 0x7faf4013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 -- 172.21.2.137:0/1259858050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3800b7d0 con 0x7faf400b1660 2021-11-15T19:30:15.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf458ad700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 0x7faf4013a6c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7faf3c002f70 tx=0x7faf3c006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c013460 con 0x7faf400b1660 2021-11-15T19:30:15.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0135c0 con 0x7faf400b1660 2021-11-15T19:30:15.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4013e7e0 con 0x7faf400b1660 2021-11-15T19:30:15.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c013920 con 0x7faf400b1660 2021-11-15T19:30:15.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf40139be0 con 0x7faf400b1660 2021-11-15T19:30:15.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf400b1ac0 con 0x7faf400b1660 2021-11-15T19:30:15.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf3c01a060 con 0x7faf400b1660 2021-11-15T19:30:15.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf2f7fe700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf200536f0 0x7faf20055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faf3c06b4e0 con 0x7faf400b1660 2021-11-15T19:30:15.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf460ae700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf200536f0 0x7faf20055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.823+0000 7faf460ae700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf200536f0 0x7faf20055bb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7faf30002f70 tx=0x7faf30006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.827+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf3c042530 con 0x7faf400b1660 2021-11-15T19:30:15.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf400573d0 con 0x7faf400b1660 2021-11-15T19:30:15.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf2f7fe700 1 -- 172.21.2.137:0/1259858050 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16053 (secure 0 0 0) 0x7faf3c045b50 con 0x7faf400b1660 2021-11-15T19:30:15.915 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:15.916 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":52,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:30:15.562110+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:30:12.364466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T19:30:13.528542+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:30:15.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf200536f0 msgr2=0x7faf20055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf200536f0 0x7faf20055bb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7faf30002f70 tx=0x7faf30006a80).stop 2021-11-15T19:30:15.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 msgr2=0x7faf4013a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 0x7faf4013a6c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7faf3c002f70 tx=0x7faf3c006e40).stop 2021-11-15T19:30:15.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 shutdown_connections 2021-11-15T19:30:15.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf200536f0 0x7faf20055bb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf400b2c00 0x7faf4013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf400b1660 0x7faf4013a6c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 --2- 172.21.2.137:0/1259858050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf400608f0 0x7faf4013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 >> 172.21.2.137:0/1259858050 conn(0x7faf40063980 msgr2=0x7faf4013f200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:15.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 shutdown_connections 2021-11-15T19:30:15.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.911+0000 7faf48312700 1 -- 172.21.2.137:0/1259858050 wait complete. 2021-11-15T19:30:15.923 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:30:15.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 Processor -- start 2021-11-15T19:30:15.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- start start 2021-11-15T19:30:15.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd758060a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd7580b2a40 0x7fd75814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd75814b210 0x7fd75805f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd758061c10 con 0x7fd75814b210 2021-11-15T19:30:15.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd758061100 con 0x7fd7580b2a40 2021-11-15T19:30:15.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580ac690 con 0x7fd758061830 2021-11-15T19:30:15.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd7580b2a40 0x7fd75814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd7580b2a40 0x7fd75814ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34298/0 (socket says 172.21.2.137:34298) 2021-11-15T19:30:15.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 -- 172.21.2.137:0/2111204652 learned_addr learned my addr 172.21.2.137:0/2111204652 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:15.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 -- 172.21.2.137:0/2111204652 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 msgr2=0x7fd758060a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 --2- 172.21.2.137:0/2111204652 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd758060a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 -- 172.21.2.137:0/2111204652 >> v2:172.21.2.111:3300/0 conn(0x7fd75814b210 msgr2=0x7fd75805f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:15.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 --2- 172.21.2.137:0/2111204652 >> v2:172.21.2.111:3300/0 conn(0x7fd75814b210 0x7fd75805f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 -- 172.21.2.137:0/2111204652 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580ac930 con 0x7fd7580b2a40 2021-11-15T19:30:15.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75cec1700 1 --2- 172.21.2.137:0/2111204652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7580b2a40 0x7fd75814ad20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fd74c002f70 tx=0x7fd74c006eb0).ready entity=mon.1 client_cookie=846f9139df92ba82 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd74bfff700 1 -- 172.21.2.137:0/2111204652 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd74c00d570 con 0x7fd7580b2a40 2021-11-15T19:30:15.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd74bfff700 1 -- 172.21.2.137:0/2111204652 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c000e90 con 0x7fd7580b2a40 2021-11-15T19:30:15.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd74bfff700 1 -- 172.21.2.137:0/2111204652 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd74c00d900 con 0x7fd7580b2a40 2021-11-15T19:30:15.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- 172.21.2.137:0/2111204652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7580b2a40 msgr2=0x7fd75814ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- 172.21.2.137:0/2111204652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7580b2a40 0x7fd75814ad20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fd74c002f70 tx=0x7fd74c006eb0).stop 2021-11-15T19:30:15.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- 172.21.2.137:0/2111204652 shutdown_connections 2021-11-15T19:30:15.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- 172.21.2.137:0/2111204652 >> v2:172.21.2.111:3300/0 conn(0x7fd75814b210 0x7fd75805f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- 172.21.2.137:0/2111204652 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd7580b2a40 0x7fd75814ad20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 --2- 172.21.2.137:0/2111204652 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd758060a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:15.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- 172.21.2.137:0/2111204652 >> 172.21.2.137:0/2111204652 conn(0x7fd7580b7070 msgr2=0x7fd7580b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:15.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- 172.21.2.137:0/2111204652 shutdown_connections 2021-11-15T19:30:15.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- 172.21.2.137:0/2111204652 wait complete. 2021-11-15T19:30:15.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 Processor -- start 2021-11-15T19:30:15.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.975+0000 7fd75f926700 1 -- start start 2021-11-15T19:30:15.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd75809cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7580b2a40 0x7fd75809a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 0x7fd75814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75808fb00 con 0x7fd7580b2a40 2021-11-15T19:30:15.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75808f5c0 con 0x7fd75814b210 2021-11-15T19:30:15.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75808f860 con 0x7fd758061830 2021-11-15T19:30:15.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 0x7fd75814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 0x7fd75814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34304/0 (socket says 172.21.2.137:34304) 2021-11-15T19:30:15.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 -- 172.21.2.137:0/2571226176 learned_addr learned my addr 172.21.2.137:0/2571226176 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:15.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75cec1700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7580b2a40 0x7fd75809a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75d6c2700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd75809cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 -- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 msgr2=0x7fd75809cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd75809cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 -- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7580b2a40 msgr2=0x7fd75809a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:15.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7580b2a40 0x7fd75809a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:15.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 -- 172.21.2.137:0/2571226176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c00b1e0 con 0x7fd75814b210 2021-11-15T19:30:15.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75dec3700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 0x7fd75814d580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fd7500032f0 tx=0x7fd7500091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75000f760 con 0x7fd75814b210 2021-11-15T19:30:15.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75000f8c0 con 0x7fd75814b210 2021-11-15T19:30:15.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd758159c00 con 0x7fd75814b210 2021-11-15T19:30:15.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75000fc20 con 0x7fd75814b210 2021-11-15T19:30:15.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75809aca0 con 0x7fd75814b210 2021-11-15T19:30:15.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7580573d0 con 0x7fd75814b210 2021-11-15T19:30:15.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd75001a460 con 0x7fd75814b210 2021-11-15T19:30:15.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd74a7fc700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7380534f0 0x7fd7380559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:15.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd75006bd30 con 0x7fd75814b210 2021-11-15T19:30:15.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75d6c2700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7380534f0 0x7fd7380559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:15.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.979+0000 7fd75d6c2700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7380534f0 0x7fd7380559b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd75400a000 tx=0x7fd754008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:15.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:15.983+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd750042d90 con 0x7fd75814b210 2021-11-15T19:30:16.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.091+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd75809a970 con 0x7fd75814b210 2021-11-15T19:30:16.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.103+0000 7fd74a7fc700 1 -- 172.21.2.137:0/2571226176 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd7500463b0 con 0x7fd75814b210 2021-11-15T19:30:16.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7380534f0 msgr2=0x7fd7380559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7380534f0 0x7fd7380559b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd75400a000 tx=0x7fd754008040).stop 2021-11-15T19:30:16.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 msgr2=0x7fd75814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 0x7fd75814d580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fd7500032f0 tx=0x7fd7500091d0).stop 2021-11-15T19:30:16.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 shutdown_connections 2021-11-15T19:30:16.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7380534f0 0x7fd7380559b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd75814b210 0x7fd75814d580 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7580b2a40 0x7fd75809a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 --2- 172.21.2.137:0/2571226176 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd758061830 0x7fd75809cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 >> 172.21.2.137:0/2571226176 conn(0x7fd7580b7070 msgr2=0x7fd7580b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 shutdown_connections 2021-11-15T19:30:16.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.107+0000 7fd75f926700 1 -- 172.21.2.137:0/2571226176 wait complete. 2021-11-15T19:30:16.114 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:30:16.117 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:30:16.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 Processor -- start 2021-11-15T19:30:16.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 -- start start 2021-11-15T19:30:16.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82140b3de0 0x7f82140b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8214141e70 0x7f8214142300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140b41c0 con 0x7f8214146410 2021-11-15T19:30:16.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140b5440 con 0x7f8214141e70 2021-11-15T19:30:16.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f821a735700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140622c0 con 0x7f82140b3de0 2021-11-15T19:30:16.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8214141e70 0x7f8214142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8214141e70 0x7f8214142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34308/0 (socket says 172.21.2.137:34308) 2021-11-15T19:30:16.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 -- 172.21.2.137:0/3550771518 learned_addr learned my addr 172.21.2.137:0/3550771518 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:16.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 -- 172.21.2.137:0/3550771518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82140b3de0 msgr2=0x7f82140b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:16.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 --2- 172.21.2.137:0/3550771518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82140b3de0 0x7f82140b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:16.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 -- 172.21.2.137:0/3550771518 >> v1:172.21.2.111:6789/0 conn(0x7f8214146410 legacy=0x7f8214146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:16.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.167+0000 7f8219f34700 1 -- 172.21.2.137:0/3550771518 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214062560 con 0x7f8214141e70 2021-11-15T19:30:16.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219f34700 1 --2- 172.21.2.137:0/3550771518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8214141e70 0x7f8214142300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f82140b15a0 tx=0x7f820c009290).ready entity=mon.1 client_cookie=4ebe84bc40ffe9b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8207fff700 1 -- 172.21.2.137:0/3550771518 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f820c00b860 con 0x7f8214141e70 2021-11-15T19:30:16.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8207fff700 1 -- 172.21.2.137:0/3550771518 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00b9c0 con 0x7f8214141e70 2021-11-15T19:30:16.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8207fff700 1 -- 172.21.2.137:0/3550771518 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f820c00bb70 con 0x7f8214141e70 2021-11-15T19:30:16.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3550771518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8214141e70 msgr2=0x7f8214142300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 --2- 172.21.2.137:0/3550771518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8214141e70 0x7f8214142300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f82140b15a0 tx=0x7f820c009290).stop 2021-11-15T19:30:16.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3550771518 shutdown_connections 2021-11-15T19:30:16.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 --2- 172.21.2.137:0/3550771518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8214141e70 0x7f8214142300 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 --2- 172.21.2.137:0/3550771518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f82140b3de0 0x7f82140b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:16.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3550771518 >> 172.21.2.137:0/3550771518 conn(0x7f82140b9100 msgr2=0x7f82140b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3550771518 shutdown_connections 2021-11-15T19:30:16.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3550771518 wait complete. 2021-11-15T19:30:16.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 Processor -- start 2021-11-15T19:30:16.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- start start 2021-11-15T19:30:16.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 0x7f8214146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8214141e70 0x7f821413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8214146410 0x7f8214148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821413fbb0 con 0x7f8214141e70 2021-11-15T19:30:16.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8214144a90 con 0x7f82140b3de0 2021-11-15T19:30:16.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821413f220 con 0x7f8214146410 2021-11-15T19:30:16.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 0x7f8214146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 0x7f8214146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34314/0 (socket says 172.21.2.137:34314) 2021-11-15T19:30:16.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 -- 172.21.2.137:0/3361364665 learned_addr learned my addr 172.21.2.137:0/3361364665 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:16.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219f34700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8214146410 0x7f8214148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8218f32700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8214141e70 0x7f821413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 -- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8214146410 msgr2=0x7f8214148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8214146410 0x7f8214148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 -- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8214141e70 msgr2=0x7f821413f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8214141e70 0x7f821413f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 -- 172.21.2.137:0/3361364665 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c009530 con 0x7f82140b3de0 2021-11-15T19:30:16.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8218f32700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8214141e70 0x7f821413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:30:16.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f8219733700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 0x7f8214146b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f8208002f70 tx=0x7f8208006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8208013460 con 0x7f82140b3de0 2021-11-15T19:30:16.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080135c0 con 0x7f82140b3de0 2021-11-15T19:30:16.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82141445f0 con 0x7f82140b3de0 2021-11-15T19:30:16.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8208013920 con 0x7f82140b3de0 2021-11-15T19:30:16.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8214145260 con 0x7f82140b3de0 2021-11-15T19:30:16.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821413f420 con 0x7f82140b3de0 2021-11-15T19:30:16.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.171+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f820800f070 con 0x7f82140b3de0 2021-11-15T19:30:16.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.175+0000 7f82067fc700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81f4053610 0x7f81f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.175+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f820806b210 con 0x7f82140b3de0 2021-11-15T19:30:16.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.175+0000 7f8218f32700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81f4053610 0x7f81f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.175+0000 7f8218f32700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81f4053610 0x7f81f4055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f821000a000 tx=0x7f8210008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.175+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f821413f420 con 0x7f82140b3de0 2021-11-15T19:30:16.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.287+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f821413f420 con 0x7f82140b3de0 2021-11-15T19:30:16.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.299+0000 7f82067fc700 1 -- 172.21.2.137:0/3361364665 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f821413f420 con 0x7f82140b3de0 2021-11-15T19:30:16.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81f4053610 msgr2=0x7f81f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81f4053610 0x7f81f4055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f821000a000 tx=0x7f8210008040).stop 2021-11-15T19:30:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 msgr2=0x7f8214146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 0x7f8214146b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f8208002f70 tx=0x7f8208006ec0).stop 2021-11-15T19:30:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 shutdown_connections 2021-11-15T19:30:16.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81f4053610 0x7f81f4055ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8214146410 0x7f8214148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8214141e70 0x7f821413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 --2- 172.21.2.137:0/3361364665 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f82140b3de0 0x7f8214146b90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 >> 172.21.2.137:0/3361364665 conn(0x7f82140b9100 msgr2=0x7f82140b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 shutdown_connections 2021-11-15T19:30:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.303+0000 7f821a735700 1 -- 172.21.2.137:0/3361364665 wait complete. 2021-11-15T19:30:16.310 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:30:16.313 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:30:16.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 Processor -- start 2021-11-15T19:30:16.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 -- start start 2021-11-15T19:30:16.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb4780608f0 0x7fb47813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb47805f730 0x7fb47805fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780b1af0 con 0x7fb4780b1660 2021-11-15T19:30:16.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780ad6c0 con 0x7fb4780608f0 2021-11-15T19:30:16.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ecde700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780b0c80 con 0x7fb47805f730 2021-11-15T19:30:16.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47d27b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb47805f730 0x7fb47805fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb477fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb4780b1660 0x7fb4780b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53106/0 (socket says 172.21.2.137:53106) 2021-11-15T19:30:16.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb477fff700 1 -- 172.21.2.137:0/220513698 learned_addr learned my addr 172.21.2.137:0/220513698 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:16.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ca7a700 1 --2- 172.21.2.137:0/220513698 >> v2:172.21.2.111:3300/0 conn(0x7fb4780608f0 0x7fb47813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47d27b700 1 -- 172.21.2.137:0/220513698 >> v2:172.21.2.111:3300/0 conn(0x7fb4780608f0 msgr2=0x7fb47813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:16.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47d27b700 1 --2- 172.21.2.137:0/220513698 >> v2:172.21.2.111:3300/0 conn(0x7fb4780608f0 0x7fb47813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47d27b700 1 -- 172.21.2.137:0/220513698 >> v1:172.21.2.137:6789/0 conn(0x7fb4780b1660 legacy=0x7fb4780b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47d27b700 1 -- 172.21.2.137:0/220513698 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780b0f20 con 0x7fb47805f730 2021-11-15T19:30:16.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47ca7a700 1 --2- 172.21.2.137:0/220513698 >> v2:172.21.2.111:3300/0 conn(0x7fb4780608f0 0x7fb47813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:16.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb47d27b700 1 --2- 172.21.2.137:0/220513698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47805fb40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fb4700032f0 tx=0x7fb4700091d0).ready entity=mon.1 client_cookie=1fefb61de57c6115 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb4777fe700 1 -- 172.21.2.137:0/220513698 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb470009ea0 con 0x7fb47805f730 2021-11-15T19:30:16.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb4777fe700 1 -- 172.21.2.137:0/220513698 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47000b870 con 0x7fb47805f730 2021-11-15T19:30:16.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.363+0000 7fb4777fe700 1 -- 172.21.2.137:0/220513698 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb47000b9e0 con 0x7fb47805f730 2021-11-15T19:30:16.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/220513698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 msgr2=0x7fb47805fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 --2- 172.21.2.137:0/220513698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47805fb40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fb4700032f0 tx=0x7fb4700091d0).stop 2021-11-15T19:30:16.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/220513698 shutdown_connections 2021-11-15T19:30:16.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 --2- 172.21.2.137:0/220513698 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47805fb40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 --2- 172.21.2.137:0/220513698 >> v2:172.21.2.111:3300/0 conn(0x7fb4780608f0 0x7fb47813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/220513698 >> 172.21.2.137:0/220513698 conn(0x7fb478063980 msgr2=0x7fb478063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/220513698 shutdown_connections 2021-11-15T19:30:16.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/220513698 wait complete. 2021-11-15T19:30:16.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 Processor -- start 2021-11-15T19:30:16.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- start start 2021-11-15T19:30:16.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4780608f0 0x7fb47813eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4780b1660 0x7fb4781282e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb478066c50 con 0x7fb4780b1660 2021-11-15T19:30:16.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47813ac20 con 0x7fb47805f730 2021-11-15T19:30:16.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47813aec0 con 0x7fb4780608f0 2021-11-15T19:30:16.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34330/0 (socket says 172.21.2.137:34330) 2021-11-15T19:30:16.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 -- 172.21.2.137:0/1351769902 learned_addr learned my addr 172.21.2.137:0/1351769902 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:16.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 -- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4780608f0 msgr2=0x7fb47813eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4780608f0 0x7fb47813eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:16.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 -- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4780b1660 msgr2=0x7fb4781282e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4780b1660 0x7fb4781282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:16.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 -- 172.21.2.137:0/1351769902 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470009470 con 0x7fb47805f730 2021-11-15T19:30:16.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ca7a700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47813e690 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fb468007000 tx=0x7fb468008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb468010580 con 0x7fb47805f730 2021-11-15T19:30:16.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4680106e0 con 0x7fb47805f730 2021-11-15T19:30:16.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47813a8a0 con 0x7fb47805f730 2021-11-15T19:30:16.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb478128f50 con 0x7fb47805f730 2021-11-15T19:30:16.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb468010a40 con 0x7fb47805f730 2021-11-15T19:30:16.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb478066dc0 con 0x7fb47805f730 2021-11-15T19:30:16.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb468010ba0 con 0x7fb47805f730 2021-11-15T19:30:16.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb475ffb700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4580536f0 0x7fb458055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.367+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb46806ba90 con 0x7fb47805f730 2021-11-15T19:30:16.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.371+0000 7fb477fff700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4580536f0 0x7fb458055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.371+0000 7fb477fff700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4580536f0 0x7fb458055bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb4780b3ac0 tx=0x7fb46c007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.371+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb478066dc0 con 0x7fb47805f730 2021-11-15T19:30:16.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.483+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb478066dc0 con 0x7fb47805f730 2021-11-15T19:30:16.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb475ffb700 1 -- 172.21.2.137:0/1351769902 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb478066dc0 con 0x7fb47805f730 2021-11-15T19:30:16.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4580536f0 msgr2=0x7fb458055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4580536f0 0x7fb458055bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb4780b3ac0 tx=0x7fb46c007860).stop 2021-11-15T19:30:16.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 msgr2=0x7fb47813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47813e690 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fb468007000 tx=0x7fb468008040).stop 2021-11-15T19:30:16.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 shutdown_connections 2021-11-15T19:30:16.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4580536f0 0x7fb458055bb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4780b1660 0x7fb4781282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:16.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4780608f0 0x7fb47813eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:16.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 --2- 172.21.2.137:0/1351769902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb47805f730 0x7fb47813e690 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 >> 172.21.2.137:0/1351769902 conn(0x7fb478063980 msgr2=0x7fb478143530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 shutdown_connections 2021-11-15T19:30:16.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.495+0000 7fb47ecde700 1 -- 172.21.2.137:0/1351769902 wait complete. 2021-11-15T19:30:16.505 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:30:16.508 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:16.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 Processor -- start 2021-11-15T19:30:16.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- start start 2021-11-15T19:30:16.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6c34147980 0x7f6c340aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c34148190 con 0x7f6c34144610 2021-11-15T19:30:16.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340b1720 con 0x7f6c340b1340 2021-11-15T19:30:16.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340af800 con 0x7f6c34147980 2021-11-15T19:30:16.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6c340b1340 0x7f6c34143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53116/0 (socket says 172.21.2.137:53116) 2021-11-15T19:30:16.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 -- 172.21.2.137:0/448005741 learned_addr learned my addr 172.21.2.137:0/448005741 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:16.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323268231 0 0) 0x7f6c340b1720 con 0x7f6c340b1340 2021-11-15T19:30:16.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c1c003260 con 0x7f6c340b1340 2021-11-15T19:30:16.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a885700 1 --2- 172.21.2.137:0/448005741 >> v2:172.21.2.111:3300/0 conn(0x7f6c34147980 0x7f6c340aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479134104 0 0) 0x7f6c1c003260 con 0x7f6c340b1340 2021-11-15T19:30:16.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 >> v2:172.21.2.111:3300/0 conn(0x7f6c34147980 msgr2=0x7f6c340aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:16.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 --2- 172.21.2.137:0/448005741 >> v2:172.21.2.111:3300/0 conn(0x7f6c34147980 0x7f6c340aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 >> v1:172.21.2.111:6789/0 conn(0x7f6c34144610 legacy=0x7f6c340a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3405faf0 con 0x7f6c340b1340 2021-11-15T19:30:16.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6c28001660 con 0x7f6c340b1340 2021-11-15T19:30:16.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 >> v1:172.21.2.137:6789/0 conn(0x7f6c340b1340 legacy=0x7f6c34143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c1c003750 0x7f6c1c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c004500 0x7f6c1c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c1c004e70 0x7f6c1c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340af800 con 0x7f6c1c004e70 2021-11-15T19:30:16.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c00bdd0 con 0x7f6c1c003750 2021-11-15T19:30:16.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c00bf60 con 0x7f6c1c004500 2021-11-15T19:30:16.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c1c003750 0x7f6c1c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a885700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c1c004e70 0x7f6c1c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 -- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c004500 msgr2=0x7f6c1c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:16.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39883700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c004500 0x7f6c1c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c004500 0x7f6c1c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 -- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c1c004e70 msgr2=0x7f6c1c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:16.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c1c004e70 0x7f6c1c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 -- 172.21.2.137:0/448005741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c003260 con 0x7f6c1c003750 2021-11-15T19:30:16.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a885700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c1c004e70 0x7f6c1c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:16.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39883700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c004500 0x7f6c1c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:16.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a885700 1 -- 172.21.2.137:0/448005741 reap_dead start 2021-11-15T19:30:16.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3a084700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c1c003750 0x7f6c1c003b70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f6c28001370 tx=0x7f6c3405f9e0).ready entity=mon.1 client_cookie=1c6f9794d2d36ee4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c280070d0 con 0x7f6c1c003750 2021-11-15T19:30:16.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28007230 con 0x7f6c1c003750 2021-11-15T19:30:16.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c39082700 1 -- 172.21.2.137:0/448005741 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c2800c8f0 con 0x7f6c1c003750 2021-11-15T19:30:16.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/448005741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c1c003750 msgr2=0x7f6c1c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c1c003750 0x7f6c1c003b70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f6c28001370 tx=0x7f6c3405f9e0).stop 2021-11-15T19:30:16.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/448005741 shutdown_connections 2021-11-15T19:30:16.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/448005741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c1c003750 0x7f6c1c003b70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/448005741 >> 172.21.2.137:0/448005741 conn(0x7f6c340b4e60 msgr2=0x7f6c340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/448005741 shutdown_connections 2021-11-15T19:30:16.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/448005741 wait complete. 2021-11-15T19:30:16.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 Processor -- start 2021-11-15T19:30:16.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 -- start start 2021-11-15T19:30:16.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.555+0000 7f6c3c2e8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c003750 0x7f6c34140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 0x7f6c3413e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c34142470 0x7f6c341428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3414b370 con 0x7f6c34142470 2021-11-15T19:30:16.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3414ab90 con 0x7f6c3414a1f0 2021-11-15T19:30:16.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3414ae30 con 0x7f6c1c003750 2021-11-15T19:30:16.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 0x7f6c3413e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 0x7f6c3413e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34350/0 (socket says 172.21.2.137:34350) 2021-11-15T19:30:16.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3a885700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c34142470 0x7f6c341428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 -- 172.21.2.137:0/1637067508 learned_addr learned my addr 172.21.2.137:0/1637067508 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:16.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3a084700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c003750 0x7f6c34140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 -- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c003750 msgr2=0x7f6c34140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c003750 0x7f6c34140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 -- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c34142470 msgr2=0x7f6c341428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c34142470 0x7f6c341428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 -- 172.21.2.137:0/1637067508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3414b0d0 con 0x7f6c3414a1f0 2021-11-15T19:30:16.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c39883700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 0x7f6c3413e8d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f6c34149c00 tx=0x7f6c30009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c30013470 con 0x7f6c3414a1f0 2021-11-15T19:30:16.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c300135d0 con 0x7f6c3414a1f0 2021-11-15T19:30:16.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34142de0 con 0x7f6c3414a1f0 2021-11-15T19:30:16.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c30013930 con 0x7f6c3414a1f0 2021-11-15T19:30:16.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c34159cf0 con 0x7f6c3414a1f0 2021-11-15T19:30:16.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3405fd90 con 0x7f6c3414a1f0 2021-11-15T19:30:16.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c3001a030 con 0x7f6c3414a1f0 2021-11-15T19:30:16.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c277fe700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c140534f0 0x7f6c140559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:16.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6c3006afa0 con 0x7f6c3414a1f0 2021-11-15T19:30:16.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3a084700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c140534f0 0x7f6c140559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:16.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.559+0000 7f6c3a084700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c140534f0 0x7f6c140559b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f6c28019000 tx=0x7f6c28013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:16.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.563+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c30042100 con 0x7f6c3414a1f0 2021-11-15T19:30:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c34148190 con 0x7f6c3414a1f0 2021-11-15T19:30:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c277fe700 1 -- 172.21.2.137:0/1637067508 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f6c34148190 con 0x7f6c3414a1f0 2021-11-15T19:30:16.677 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:16.677 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:16.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c140534f0 msgr2=0x7f6c140559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c140534f0 0x7f6c140559b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f6c28019000 tx=0x7f6c28013000).stop 2021-11-15T19:30:16.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 msgr2=0x7f6c3413e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:16.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 0x7f6c3413e8d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f6c34149c00 tx=0x7f6c30009040).stop 2021-11-15T19:30:16.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 shutdown_connections 2021-11-15T19:30:16.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c140534f0 0x7f6c140559b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c34142470 0x7f6c341428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c3414a1f0 0x7f6c3413e8d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 --2- 172.21.2.137:0/1637067508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c1c003750 0x7f6c34140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:16.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 >> 172.21.2.137:0/1637067508 conn(0x7f6c340b4e60 msgr2=0x7f6c341471e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:16.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 shutdown_connections 2021-11-15T19:30:16.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:16.671+0000 7f6c3c2e8700 1 -- 172.21.2.137:0/1637067508 wait complete. 2021-11-15T19:30:16.681 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:16.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:30:14.557279+0000', 'modified': '2021-11-15T19:30:15.563899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5545': {'gid': 5545, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1712485554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1712485554}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1712485554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:30:16.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:30:16.886 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:30:16.966 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5545,"want_state":"up:active","state":"up:active","rank_uptime":2.3980781150000001,"mdsmap_epoch":20,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":6.6044409640000001} 2021-11-15T19:30:16.966 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5545, "mdsmap_epoch": 20, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 2.398078115, "state": "up:active", "uptime": 6.604440964, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:30:16.967 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:30:17.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 Processor -- start 2021-11-15T19:30:17.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 -- start start 2021-11-15T19:30:17.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3e400ac3c0 0x7f3e400ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3e400609f0 0x7f3e401447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e40097c50 con 0x7f3e400b2d50 2021-11-15T19:30:17.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400ac120 con 0x7f3e400609f0 2021-11-15T19:30:17.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e45e24700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400979b0 con 0x7f3e400ac3c0 2021-11-15T19:30:17.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3effd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3e400b2d50 0x7f3e401440c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53136/0 (socket says 172.21.2.137:53136) 2021-11-15T19:30:17.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3effd700 1 -- 172.21.2.137:0/1193351252 learned_addr learned my addr 172.21.2.137:0/1193351252 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:17.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3f7fe700 1 --2- 172.21.2.137:0/1193351252 >> v2:172.21.2.137:3300/0 conn(0x7f3e400ac3c0 0x7f3e400ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/1193351252 >> v2:172.21.2.111:3300/0 conn(0x7f3e400609f0 msgr2=0x7f3e401447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3f7fe700 1 --2- 172.21.2.137:0/1193351252 >> v2:172.21.2.111:3300/0 conn(0x7f3e400609f0 0x7f3e401447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/1193351252 >> v1:172.21.2.137:6789/0 conn(0x7f3e400b2d50 legacy=0x7f3e401440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/1193351252 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40067c60 con 0x7f3e400ac3c0 2021-11-15T19:30:17.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3f7fe700 1 --2- 172.21.2.137:0/1193351252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400ac3c0 0x7f3e400ac7a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f3e28002f70 tx=0x7f3e28006df0).ready entity=mon.1 client_cookie=e357bd5d1d470f37 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3e7fc700 1 -- 172.21.2.137:0/1193351252 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e2800d5c0 con 0x7f3e400ac3c0 2021-11-15T19:30:17.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3e7fc700 1 -- 172.21.2.137:0/1193351252 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28000e90 con 0x7f3e400ac3c0 2021-11-15T19:30:17.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.011+0000 7f3e3e7fc700 1 -- 172.21.2.137:0/1193351252 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e2800d910 con 0x7f3e400ac3c0 2021-11-15T19:30:17.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/1193351252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400ac3c0 msgr2=0x7f3e400ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 --2- 172.21.2.137:0/1193351252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400ac3c0 0x7f3e400ac7a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f3e28002f70 tx=0x7f3e28006df0).stop 2021-11-15T19:30:17.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/1193351252 shutdown_connections 2021-11-15T19:30:17.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 --2- 172.21.2.137:0/1193351252 >> v2:172.21.2.111:3300/0 conn(0x7f3e400609f0 0x7f3e401447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 --2- 172.21.2.137:0/1193351252 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400ac3c0 0x7f3e400ac7a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/1193351252 >> 172.21.2.137:0/1193351252 conn(0x7f3e400b7070 msgr2=0x7f3e400b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/1193351252 shutdown_connections 2021-11-15T19:30:17.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/1193351252 wait complete. 2021-11-15T19:30:17.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 Processor -- start 2021-11-15T19:30:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- start start 2021-11-15T19:30:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 0x7f3e40144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e400ac3c0 0x7f3e400ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e40067660 0x7f3e400afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40067240 con 0x7f3e400ac3c0 2021-11-15T19:30:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40066430 con 0x7f3e400609f0 2021-11-15T19:30:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400b1040 con 0x7f3e40067660 2021-11-15T19:30:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 0x7f3e40144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 0x7f3e40144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34360/0 (socket says 172.21.2.137:34360) 2021-11-15T19:30:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/937241551 learned_addr learned my addr 172.21.2.137:0/937241551 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e40067660 msgr2=0x7f3e400afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e40067660 0x7f3e400afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e400ac3c0 msgr2=0x7f3e400ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e400ac3c0 0x7f3e400ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 -- 172.21.2.137:0/937241551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2800b180 con 0x7f3e400609f0 2021-11-15T19:30:17.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3f7fe700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 0x7f3e40144410 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f3e28002f70 tx=0x7f3e28014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e2801e400 con 0x7f3e400609f0 2021-11-15T19:30:17.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2801e560 con 0x7f3e400609f0 2021-11-15T19:30:17.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40066130 con 0x7f3e400609f0 2021-11-15T19:30:17.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e2801e8c0 con 0x7f3e400609f0 2021-11-15T19:30:17.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e40065a50 con 0x7f3e400609f0 2021-11-15T19:30:17.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e400b1240 con 0x7f3e400609f0 2021-11-15T19:30:17.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e28025030 con 0x7f3e400609f0 2021-11-15T19:30:17.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3cff9700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e240536a0 0x7f3e24055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.015+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3e2806c930 con 0x7f3e400609f0 2021-11-15T19:30:17.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.019+0000 7f3e3effd700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e240536a0 0x7f3e24055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.019+0000 7f3e3effd700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e240536a0 0x7f3e24055b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3e400b4e60 tx=0x7f3e30007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.019+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e400b1240 con 0x7f3e400609f0 2021-11-15T19:30:17.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e400b1210 con 0x7f3e400609f0 2021-11-15T19:30:17.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e3cff9700 1 -- 172.21.2.137:0/937241551 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16040 (secure 0 0 0) 0x7f3e28023020 con 0x7f3e400609f0 2021-11-15T19:30:17.108 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:17.108 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":53,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:30:16.576804+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:30:12.364466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T19:30:13.528542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:30:17.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e240536a0 msgr2=0x7f3e24055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e240536a0 0x7f3e24055b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3e400b4e60 tx=0x7f3e30007860).stop 2021-11-15T19:30:17.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 msgr2=0x7f3e40144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 0x7f3e40144410 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f3e28002f70 tx=0x7f3e28014000).stop 2021-11-15T19:30:17.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 shutdown_connections 2021-11-15T19:30:17.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e240536a0 0x7f3e24055b60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e40067660 0x7f3e400afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e400ac3c0 0x7f3e400ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 --2- 172.21.2.137:0/937241551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e400609f0 0x7f3e40144410 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 >> 172.21.2.137:0/937241551 conn(0x7f3e400b7070 msgr2=0x7f3e400b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 shutdown_connections 2021-11-15T19:30:17.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.103+0000 7f3e45e24700 1 -- 172.21.2.137:0/937241551 wait complete. 2021-11-15T19:30:17.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:30:12.364466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:30:13.528542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:30:17.116 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:30:17.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe653e700 1 Processor -- start 2021-11-15T19:30:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe653e700 1 -- start start 2021-11-15T19:30:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe653e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 0x7fafe014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe653e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe005cb50 con 0x7fafe005c770 2021-11-15T19:30:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe653e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00ad030 con 0x7fafe014aaa0 2021-11-15T19:30:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe653e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00b1650 con 0x7fafe00b0550 2021-11-15T19:30:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe4adb700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fafe014aaa0 0x7fafe0140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53154/0 (socket says 172.21.2.137:53154) 2021-11-15T19:30:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafe4adb700 1 -- 172.21.2.137:0/4247846561 learned_addr learned my addr 172.21.2.137:0/4247846561 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669909511 0 0) 0x7fafe00ad030 con 0x7fafe014aaa0 2021-11-15T19:30:17.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc0003260 con 0x7fafe014aaa0 2021-11-15T19:30:17.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243780838 0 0) 0x7fafc0003260 con 0x7fafe014aaa0 2021-11-15T19:30:17.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 msgr2=0x7fafe014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 0x7fafe014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 >> v1:172.21.2.111:6789/0 conn(0x7fafe005c770 legacy=0x7fafe00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00ad2d0 con 0x7fafe014aaa0 2021-11-15T19:30:17.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.163+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fafd80019e0 con 0x7fafe014aaa0 2021-11-15T19:30:17.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 >> v1:172.21.2.137:6789/0 conn(0x7fafe014aaa0 legacy=0x7fafe0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafc0003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 0x7fafc0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafc0004b10 0x7fafc0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00b1650 con 0x7fafc0004b10 2021-11-15T19:30:17.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc000b8e0 con 0x7fafc0003750 2021-11-15T19:30:17.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc000baa0 con 0x7fafe00b0550 2021-11-15T19:30:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafc0003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe4adb700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafc0004b10 0x7fafc0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdf7fe700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 0x7fafc0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 msgr2=0x7fafc0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe00b0550 0x7fafc0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafc0004b10 msgr2=0x7fafc0004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafc0004b10 0x7fafc0004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/4247846561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0003260 con 0x7fafc0003750 2021-11-15T19:30:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafc0003b50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fafd0001fa0 tx=0x7fafd0007a00).ready entity=mon.1 client_cookie=5e79a23c8d2f8424 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd0007070 con 0x7fafc0003750 2021-11-15T19:30:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd00071d0 con 0x7fafc0003750 2021-11-15T19:30:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdeffd700 1 -- 172.21.2.137:0/4247846561 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd0006510 con 0x7fafc0003750 2021-11-15T19:30:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/4247846561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 msgr2=0x7fafc0003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 --2- 172.21.2.137:0/4247846561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafc0003b50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fafd0001fa0 tx=0x7fafd0007a00).stop 2021-11-15T19:30:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe4adb700 1 -- 172.21.2.137:0/4247846561 reap_dead start 2021-11-15T19:30:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/4247846561 shutdown_connections 2021-11-15T19:30:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/4247846561 >> 172.21.2.137:0/4247846561 conn(0x7fafe00631e0 msgr2=0x7fafe005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/4247846561 shutdown_connections 2021-11-15T19:30:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/4247846561 wait complete. 2021-11-15T19:30:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 Processor -- start 2021-11-15T19:30:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- start start 2021-11-15T19:30:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafe0144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafe0145190 0x7fafe00b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe0147840 0x7fafe0140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe015a670 con 0x7fafe0145190 2021-11-15T19:30:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0116b80 con 0x7fafc0003750 2021-11-15T19:30:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01461b0 con 0x7fafe0147840 2021-11-15T19:30:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafe0144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafe0144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34382/0 (socket says 172.21.2.137:34382) 2021-11-15T19:30:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/2250155536 learned_addr learned my addr 172.21.2.137:0/2250155536 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdf7fe700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafe0145190 0x7fafe00b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe0147840 msgr2=0x7fafe0140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe0147840 0x7fafe0140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafe0145190 msgr2=0x7fafe00b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafe0145190 0x7fafe00b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 -- 172.21.2.137:0/2250155536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0146450 con 0x7fafc0003750 2021-11-15T19:30:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdffff700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafe0144080 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fafd0001fa0 tx=0x7fafd0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd0021650 con 0x7fafc0003750 2021-11-15T19:30:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0000e90 con 0x7fafc0003750 2021-11-15T19:30:17.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd00219a0 con 0x7fafc0003750 2021-11-15T19:30:17.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe00b5060 con 0x7fafc0003750 2021-11-15T19:30:17.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.167+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe0116800 con 0x7fafc0003750 2021-11-15T19:30:17.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0146000 con 0x7fafc0003750 2021-11-15T19:30:17.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fafd001d070 con 0x7fafc0003750 2021-11-15T19:30:17.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafdd7fa700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fafc40536a0 0x7fafc4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fafd006c750 con 0x7fafc0003750 2021-11-15T19:30:17.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafdf7fe700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fafc40536a0 0x7fafc4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafdf7fe700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fafc40536a0 0x7fafc4055b60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fafc800c000 tx=0x7fafc8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.171+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fafd00437a0 con 0x7fafc0003750 2021-11-15T19:30:17.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fafe0116ae0 con 0x7fafc0003750 2021-11-15T19:30:17.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafdd7fa700 1 -- 172.21.2.137:0/2250155536 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v53) v1 ==== 110+0+10 (secure 0 0 0) 0x7fafd0026030 con 0x7fafc0003750 2021-11-15T19:30:17.260 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:30:17.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fafc40536a0 msgr2=0x7fafc4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fafc40536a0 0x7fafc4055b60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fafc800c000 tx=0x7fafc8008040).stop 2021-11-15T19:30:17.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 msgr2=0x7fafe0144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafe0144080 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fafd0001fa0 tx=0x7fafd0015000).stop 2021-11-15T19:30:17.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 shutdown_connections 2021-11-15T19:30:17.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fafc40536a0 0x7fafc4055b60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fafe0147840 0x7fafe0140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fafe0145190 0x7fafe00b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 --2- 172.21.2.137:0/2250155536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fafc0003750 0x7fafe0144080 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 >> 172.21.2.137:0/2250155536 conn(0x7fafe00631e0 msgr2=0x7fafe0140de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 shutdown_connections 2021-11-15T19:30:17.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.255+0000 7fafe653e700 1 -- 172.21.2.137:0/2250155536 wait complete. 2021-11-15T19:30:17.267 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:30:17.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 Processor -- start 2021-11-15T19:30:17.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- start start 2021-11-15T19:30:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa8ac0b0fe0 0x7fa8ac0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac0acff0 0x7fa8ac0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac0aedf0 con 0x7fa8ac13f5c0 2021-11-15T19:30:17.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0ad4a0 con 0x7fa8ac0b0fe0 2021-11-15T19:30:17.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0ae070 con 0x7fa8ac0acff0 2021-11-15T19:30:17.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa8ac0b0fe0 0x7fa8ac0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa8ac0b0fe0 0x7fa8ac0afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34388/0 (socket says 172.21.2.137:34388) 2021-11-15T19:30:17.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 -- 172.21.2.137:0/2377913917 learned_addr learned my addr 172.21.2.137:0/2377913917 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 -- 172.21.2.137:0/2377913917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac0acff0 msgr2=0x7fa8ac0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 --2- 172.21.2.137:0/2377913917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac0acff0 0x7fa8ac0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 -- 172.21.2.137:0/2377913917 >> v1:172.21.2.111:6789/0 conn(0x7fa8ac13f5c0 legacy=0x7fa8ac13c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 -- 172.21.2.137:0/2377913917 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0b13c0 con 0x7fa8ac0b0fe0 2021-11-15T19:30:17.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8abfff700 1 --2- 172.21.2.137:0/2377913917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0b0fe0 0x7fa8ac0afde0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fa8ac0af3a0 tx=0x7fa8a0006eb0).ready entity=mon.1 client_cookie=fb58fadd301bb07c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8aaffd700 1 -- 172.21.2.137:0/2377913917 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a000d570 con 0x7fa8ac0b0fe0 2021-11-15T19:30:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8aaffd700 1 -- 172.21.2.137:0/2377913917 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0000e90 con 0x7fa8ac0b0fe0 2021-11-15T19:30:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8aaffd700 1 -- 172.21.2.137:0/2377913917 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a000d8c0 con 0x7fa8ac0b0fe0 2021-11-15T19:30:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- 172.21.2.137:0/2377913917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0b0fe0 msgr2=0x7fa8ac0afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 --2- 172.21.2.137:0/2377913917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0b0fe0 0x7fa8ac0afde0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fa8ac0af3a0 tx=0x7fa8a0006eb0).stop 2021-11-15T19:30:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- 172.21.2.137:0/2377913917 shutdown_connections 2021-11-15T19:30:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 --2- 172.21.2.137:0/2377913917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac0acff0 0x7fa8ac0af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 --2- 172.21.2.137:0/2377913917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0b0fe0 0x7fa8ac0afde0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- 172.21.2.137:0/2377913917 >> 172.21.2.137:0/2377913917 conn(0x7fa8ac0b5f50 msgr2=0x7fa8ac0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- 172.21.2.137:0/2377913917 shutdown_connections 2021-11-15T19:30:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.315+0000 7fa8b241b700 1 -- 172.21.2.137:0/2377913917 wait complete. 2021-11-15T19:30:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 Processor -- start 2021-11-15T19:30:17.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- start start 2021-11-15T19:30:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 0x7fa8ac063b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8ac0b0fe0 0x7fa8ac066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac13f5c0 0x7fa8ac0671e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac140b50 con 0x7fa8ac0b0fe0 2021-11-15T19:30:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac140df0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac141090 con 0x7fa8ac13f5c0 2021-11-15T19:30:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 0x7fa8ac063b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 0x7fa8ac063b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34394/0 (socket says 172.21.2.137:34394) 2021-11-15T19:30:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 -- 172.21.2.137:0/4022680471 learned_addr learned my addr 172.21.2.137:0/4022680471 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 -- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac13f5c0 msgr2=0x7fa8ac0671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac13f5c0 0x7fa8ac0671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 -- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8ac0b0fe0 msgr2=0x7fa8ac066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8ac0b0fe0 0x7fa8ac066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 -- 172.21.2.137:0/4022680471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a000b1e0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8abfff700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 0x7fa8ac063b70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fa8ac0af3a0 tx=0x7fa8a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a000d8f0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0011ce0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac141a90 con 0x7fa8ac0acff0 2021-11-15T19:30:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac1507c0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a001e650 con 0x7fa8ac0acff0 2021-11-15T19:30:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac141250 con 0x7fa8ac0acff0 2021-11-15T19:30:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8a0025030 con 0x7fa8ac0acff0 2021-11-15T19:30:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8a97fa700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa88c053600 0x7fa88c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa8a006cba0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.319+0000 7fa8ab7fe700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa88c053600 0x7fa88c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.323+0000 7fa8ab7fe700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa88c053600 0x7fa88c055ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa89c002f70 tx=0x7fa89c006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.323+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8a0043d00 con 0x7fa8ac0acff0 2021-11-15T19:30:17.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.403+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8ac1507c0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8a97fa700 1 -- 172.21.2.137:0/4022680471 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8ac1507c0 con 0x7fa8ac0acff0 2021-11-15T19:30:17.411 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:17.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa88c053600 msgr2=0x7fa88c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa88c053600 0x7fa88c055ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa89c002f70 tx=0x7fa89c006a80).stop 2021-11-15T19:30:17.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 msgr2=0x7fa8ac063b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 0x7fa8ac063b70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fa8ac0af3a0 tx=0x7fa8a0015000).stop 2021-11-15T19:30:17.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 shutdown_connections 2021-11-15T19:30:17.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa88c053600 0x7fa88c055ac0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa8ac13f5c0 0x7fa8ac0671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa8ac0b0fe0 0x7fa8ac066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 --2- 172.21.2.137:0/4022680471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa8ac0acff0 0x7fa8ac063b70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 >> 172.21.2.137:0/4022680471 conn(0x7fa8ac0b5f50 msgr2=0x7fa8ac137c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 shutdown_connections 2021-11-15T19:30:17.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.407+0000 7fa8b241b700 1 -- 172.21.2.137:0/4022680471 wait complete. 2021-11-15T19:30:17.418 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:30:17.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 Processor -- start 2021-11-15T19:30:17.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- start start 2021-11-15T19:30:17.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb3480b5330 0x7fb3480b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb3480b3e70 0x7fb3480b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348146c20 con 0x7fb3480b2400 2021-11-15T19:30:17.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb348142af0 con 0x7fb3480b3e70 2021-11-15T19:30:17.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3480b27e0 con 0x7fb3480b5330 2021-11-15T19:30:17.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb3480b5330 0x7fb3480b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb3480b5330 0x7fb3480b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34404/0 (socket says 172.21.2.137:34404) 2021-11-15T19:30:17.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 -- 172.21.2.137:0/3003603552 learned_addr learned my addr 172.21.2.137:0/3003603552 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 -- 172.21.2.137:0/3003603552 >> v2:172.21.2.111:3300/0 conn(0x7fb3480b3e70 msgr2=0x7fb3480b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 --2- 172.21.2.137:0/3003603552 >> v2:172.21.2.111:3300/0 conn(0x7fb3480b3e70 0x7fb3480b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 -- 172.21.2.137:0/3003603552 >> v1:172.21.2.111:6789/0 conn(0x7fb3480b2400 legacy=0x7fb3480b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 -- 172.21.2.137:0/3003603552 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480b4d80 con 0x7fb3480b5330 2021-11-15T19:30:17.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb347fff700 1 --2- 172.21.2.137:0/3003603552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb3480b2a90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fb3480b6ee0 tx=0x7fb338006eb0).ready entity=mon.1 client_cookie=7f56021e51f4032d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb3477fe700 1 -- 172.21.2.137:0/3003603552 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33800d5c0 con 0x7fb3480b5330 2021-11-15T19:30:17.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb3477fe700 1 -- 172.21.2.137:0/3003603552 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338000e90 con 0x7fb3480b5330 2021-11-15T19:30:17.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb3477fe700 1 -- 172.21.2.137:0/3003603552 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33800d910 con 0x7fb3480b5330 2021-11-15T19:30:17.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- 172.21.2.137:0/3003603552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 msgr2=0x7fb3480b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- 172.21.2.137:0/3003603552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb3480b2a90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fb3480b6ee0 tx=0x7fb338006eb0).stop 2021-11-15T19:30:17.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- 172.21.2.137:0/3003603552 shutdown_connections 2021-11-15T19:30:17.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- 172.21.2.137:0/3003603552 >> v2:172.21.2.111:3300/0 conn(0x7fb3480b3e70 0x7fb3480b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- 172.21.2.137:0/3003603552 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb3480b2a90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- 172.21.2.137:0/3003603552 >> 172.21.2.137:0/3003603552 conn(0x7fb3480623a0 msgr2=0x7fb348062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- 172.21.2.137:0/3003603552 shutdown_connections 2021-11-15T19:30:17.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- 172.21.2.137:0/3003603552 wait complete. 2021-11-15T19:30:17.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 Processor -- start 2021-11-15T19:30:17.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- start start 2021-11-15T19:30:17.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3480b2400 0x7fb3481137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3480b3e70 0x7fb34813ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb34813f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3481125c0 con 0x7fb3480b3e70 2021-11-15T19:30:17.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480afab0 con 0x7fb3480b5330 2021-11-15T19:30:17.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34f233700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3481160a0 con 0x7fb3480b2400 2021-11-15T19:30:17.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb34813f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb34813f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34412/0 (socket says 172.21.2.137:34412) 2021-11-15T19:30:17.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 -- 172.21.2.137:0/176345021 learned_addr learned my addr 172.21.2.137:0/176345021 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 -- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3480b2400 msgr2=0x7fb3481137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3480b2400 0x7fb3481137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 -- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3480b3e70 msgr2=0x7fb34813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3480b3e70 0x7fb34813ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.467+0000 7fb34d7d0700 1 -- 172.21.2.137:0/176345021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33800b1e0 con 0x7fb3480b5330 2021-11-15T19:30:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb34d7d0700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb34813f1a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fb348115fc0 tx=0x7fb330006da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb330012410 con 0x7fb3480b5330 2021-11-15T19:30:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330012570 con 0x7fb3480b5330 2021-11-15T19:30:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3300128d0 con 0x7fb3480b5330 2021-11-15T19:30:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb348116340 con 0x7fb3480b5330 2021-11-15T19:30:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3480af730 con 0x7fb3480b5330 2021-11-15T19:30:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3480573d0 con 0x7fb3480b5330 2021-11-15T19:30:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb33000f030 con 0x7fb3480b5330 2021-11-15T19:30:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb32c0536a0 0x7fb32c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb33006b810 con 0x7fb3480b5330 2021-11-15T19:30:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb34cfcf700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb32c0536a0 0x7fb32c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb34cfcf700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb32c0536a0 0x7fb32c055b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb340003270 tx=0x7fb340006c90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.471+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb330042800 con 0x7fb3480b5330 2021-11-15T19:30:17.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.555+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3480633b0 con 0x7fb3480b5330 2021-11-15T19:30:17.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.555+0000 7fb345ffb700 1 -- 172.21.2.137:0/176345021 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb330045e20 con 0x7fb3480b5330 2021-11-15T19:30:17.561 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:17.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb32c0536a0 msgr2=0x7fb32c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb32c0536a0 0x7fb32c055b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb340003270 tx=0x7fb340006c90).stop 2021-11-15T19:30:17.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 msgr2=0x7fb34813f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb34813f1a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fb348115fc0 tx=0x7fb330006da0).stop 2021-11-15T19:30:17.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 shutdown_connections 2021-11-15T19:30:17.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb32c0536a0 0x7fb32c055b60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb3480b5330 0x7fb34813f1a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb3480b3e70 0x7fb34813ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 --2- 172.21.2.137:0/176345021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3480b2400 0x7fb3481137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 >> 172.21.2.137:0/176345021 conn(0x7fb3480623a0 msgr2=0x7fb3480b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 shutdown_connections 2021-11-15T19:30:17.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.559+0000 7fb34f233700 1 -- 172.21.2.137:0/176345021 wait complete. 2021-11-15T19:30:17.568 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:30:17.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 Processor -- start 2021-11-15T19:30:17.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 -- start start 2021-11-15T19:30:17.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 0x7fbfd013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbfd0065b10 0x7fbfd013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd0066270 con 0x7fbfd00b00a0 2021-11-15T19:30:17.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd0067410 con 0x7fbfd0065b10 2021-11-15T19:30:17.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd7147700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd006a580 con 0x7fbfd0065730 2021-11-15T19:30:17.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd56e4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbfd00b00a0 0x7fbfd0069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53202/0 (socket says 172.21.2.137:53202) 2021-11-15T19:30:17.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd56e4700 1 -- 172.21.2.137:0/624682170 learned_addr learned my addr 172.21.2.137:0/624682170 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:17.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507640502 0 0) 0x7fbfd0066270 con 0x7fbfd00b00a0 2021-11-15T19:30:17.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfbc003260 con 0x7fbfd00b00a0 2021-11-15T19:30:17.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcffff700 1 --2- 172.21.2.137:0/624682170 >> v2:172.21.2.111:3300/0 conn(0x7fbfd0065b10 0x7fbfd013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd4ee3700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 0x7fbfd013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299636905 0 0) 0x7fbfbc003260 con 0x7fbfd00b00a0 2021-11-15T19:30:17.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 msgr2=0x7fbfd013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 0x7fbfd013c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 >> v2:172.21.2.111:3300/0 conn(0x7fbfd0065b10 msgr2=0x7fbfd013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 --2- 172.21.2.137:0/624682170 >> v2:172.21.2.111:3300/0 conn(0x7fbfd0065b10 0x7fbfd013c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd0065fd0 con 0x7fbfd00b00a0 2021-11-15T19:30:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fbfc8001a00 con 0x7fbfd00b00a0 2021-11-15T19:30:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 >> v1:172.21.2.137:6789/0 conn(0x7fbfd00b00a0 legacy=0x7fbfd0069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfbc003780 0x7fbfbc003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 0x7fbfbc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfbc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0067410 con 0x7fbfbc003780 2021-11-15T19:30:17.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd006a580 con 0x7fbfbc0049f0 2021-11-15T19:30:17.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc00d9e0 con 0x7fbfd0065730 2021-11-15T19:30:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd56e4700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfbc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfd4ee3700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfbc003780 0x7fbfbc003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.615+0000 7fbfcffff700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 0x7fbfbc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 -- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 msgr2=0x7fbfbc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd0065730 0x7fbfbc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 -- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfbc003780 msgr2=0x7fbfbc003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfbc003780 0x7fbfbc003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 -- 172.21.2.137:0/624682170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc003260 con 0x7fbfbc0049f0 2021-11-15T19:30:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfbc003780 0x7fbfbc003ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:30:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfbc004e70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fbfd0067550 tx=0x7fbfd0066e60).ready entity=mon.1 client_cookie=875e3b8559b499d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc800cc60 con 0x7fbfbc0049f0 2021-11-15T19:30:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc800cdc0 con 0x7fbfbc0049f0 2021-11-15T19:30:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcf7fe700 1 -- 172.21.2.137:0/624682170 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc8004b50 con 0x7fbfbc0049f0 2021-11-15T19:30:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/624682170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 msgr2=0x7fbfbc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 --2- 172.21.2.137:0/624682170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfbc004e70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fbfd0067550 tx=0x7fbfd0066e60).stop 2021-11-15T19:30:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 -- 172.21.2.137:0/624682170 reap_dead start 2021-11-15T19:30:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/624682170 shutdown_connections 2021-11-15T19:30:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/624682170 >> 172.21.2.137:0/624682170 conn(0x7fbfd0060290 msgr2=0x7fbfd0060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/624682170 shutdown_connections 2021-11-15T19:30:17.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/624682170 wait complete. 2021-11-15T19:30:17.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 Processor -- start 2021-11-15T19:30:17.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- start start 2021-11-15T19:30:17.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfd00b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd014dc80 0x7fbfd0151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfd014e100 0x7fbfd00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b5a30 con 0x7fbfd014e100 2021-11-15T19:30:17.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0151290 con 0x7fbfbc0049f0 2021-11-15T19:30:17.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b5c60 con 0x7fbfd014dc80 2021-11-15T19:30:17.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfd00b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfd00b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34428/0 (socket says 172.21.2.137:34428) 2021-11-15T19:30:17.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 -- 172.21.2.137:0/3289718659 learned_addr learned my addr 172.21.2.137:0/3289718659 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcffff700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd014dc80 0x7fbfd0151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd56e4700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfd014e100 0x7fbfd00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 -- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd014dc80 msgr2=0x7fbfd0151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd014dc80 0x7fbfd0151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 -- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfd014e100 msgr2=0x7fbfd00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfd014e100 0x7fbfd00b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 -- 172.21.2.137:0/3289718659 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd01514f0 con 0x7fbfbc0049f0 2021-11-15T19:30:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd4ee3700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfd00b2600 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fbfc400c000 tx=0x7fbfc4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc40135f0 con 0x7fbfbc0049f0 2021-11-15T19:30:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4000e90 con 0x7fbfbc0049f0 2021-11-15T19:30:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd00b4ae0 con 0x7fbfbc0049f0 2021-11-15T19:30:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4013940 con 0x7fbfbc0049f0 2021-11-15T19:30:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd00b6380 con 0x7fbfbc0049f0 2021-11-15T19:30:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd0151680 con 0x7fbfbc0049f0 2021-11-15T19:30:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.619+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbfc4013aa0 con 0x7fbfbc0049f0 2021-11-15T19:30:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.623+0000 7fbfcdffb700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbfb0053610 0x7fbfb0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.623+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbfc406ba60 con 0x7fbfbc0049f0 2021-11-15T19:30:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.623+0000 7fbfcffff700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbfb0053610 0x7fbfb0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.623+0000 7fbfcffff700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbfb0053610 0x7fbfb0055ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbfc000c000 tx=0x7fbfc0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.623+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbfc4042b60 con 0x7fbfbc0049f0 2021-11-15T19:30:17.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfd0066f70 con 0x7fbfbc0049f0 2021-11-15T19:30:17.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfcdffb700 1 -- 172.21.2.137:0/3289718659 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbfc4017020 con 0x7fbfbc0049f0 2021-11-15T19:30:17.715 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbfb0053610 msgr2=0x7fbfb0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbfb0053610 0x7fbfb0055ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbfc000c000 tx=0x7fbfc0008040).stop 2021-11-15T19:30:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 msgr2=0x7fbfd00b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfd00b2600 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fbfc400c000 tx=0x7fbfc4008040).stop 2021-11-15T19:30:17.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 shutdown_connections 2021-11-15T19:30:17.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbfb0053610 0x7fbfb0055ad0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbfd014e100 0x7fbfd00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbfd014dc80 0x7fbfd0151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 --2- 172.21.2.137:0/3289718659 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbfbc0049f0 0x7fbfd00b2600 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 >> 172.21.2.137:0/3289718659 conn(0x7fbfd0060290 msgr2=0x7fbfd013a830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 shutdown_connections 2021-11-15T19:30:17.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.711+0000 7fbfd7147700 1 -- 172.21.2.137:0/3289718659 wait complete. 2021-11-15T19:30:17.722 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:30:17.722 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:17.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 Processor -- start 2021-11-15T19:30:17.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 -- start start 2021-11-15T19:30:17.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0b1340 0x7f67bc147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67bc0a9f50 0x7f67bc0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc148190 con 0x7f67bc143f00 2021-11-15T19:30:17.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67bc0b1720 con 0x7f67bc0a9f50 2021-11-15T19:30:17.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67c1563700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc147e70 con 0x7f67bc0b1340 2021-11-15T19:30:17.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67bc0a9f50 0x7f67bc0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67bc0a9f50 0x7f67bc0aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34440/0 (socket says 172.21.2.137:34440) 2021-11-15T19:30:17.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 -- 172.21.2.137:0/1803477381 learned_addr learned my addr 172.21.2.137:0/1803477381 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 -- 172.21.2.137:0/1803477381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0b1340 msgr2=0x7f67bc147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 --2- 172.21.2.137:0/1803477381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0b1340 0x7f67bc147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 -- 172.21.2.137:0/1803477381 >> v1:172.21.2.111:6789/0 conn(0x7f67bc143f00 legacy=0x7f67bc144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:17.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 -- 172.21.2.137:0/1803477381 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0af800 con 0x7f67bc0a9f50 2021-11-15T19:30:17.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67bb7fe700 1 --2- 172.21.2.137:0/1803477381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0a9f50 0x7f67bc0aa370 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f67bc05cfa0 tx=0x7f67ac006eb0).ready entity=mon.1 client_cookie=e7deb8f77f0bde05 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67b9ffb700 1 -- 172.21.2.137:0/1803477381 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac00d570 con 0x7f67bc0a9f50 2021-11-15T19:30:17.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67b9ffb700 1 -- 172.21.2.137:0/1803477381 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac000e90 con 0x7f67bc0a9f50 2021-11-15T19:30:17.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.767+0000 7f67b9ffb700 1 -- 172.21.2.137:0/1803477381 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac00d8c0 con 0x7f67bc0a9f50 2021-11-15T19:30:17.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/1803477381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0a9f50 msgr2=0x7f67bc0aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 --2- 172.21.2.137:0/1803477381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0a9f50 0x7f67bc0aa370 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f67bc05cfa0 tx=0x7f67ac006eb0).stop 2021-11-15T19:30:17.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/1803477381 shutdown_connections 2021-11-15T19:30:17.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 --2- 172.21.2.137:0/1803477381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0a9f50 0x7f67bc0aa370 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 --2- 172.21.2.137:0/1803477381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0b1340 0x7f67bc147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/1803477381 >> 172.21.2.137:0/1803477381 conn(0x7f67bc0b4e60 msgr2=0x7f67bc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/1803477381 shutdown_connections 2021-11-15T19:30:17.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/1803477381 wait complete. 2021-11-15T19:30:17.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 Processor -- start 2021-11-15T19:30:17.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- start start 2021-11-15T19:30:17.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0a9f50 0x7f67bc0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 0x7f67bc0ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67bc143f00 0x7f67bc098290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0ae050 con 0x7f67bc143f00 2021-11-15T19:30:17.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0ae2f0 con 0x7f67bc0b1340 2021-11-15T19:30:17.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc097df0 con 0x7f67bc0a9f50 2021-11-15T19:30:17.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 0x7f67bc0ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 0x7f67bc0ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34446/0 (socket says 172.21.2.137:34446) 2021-11-15T19:30:17.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 -- 172.21.2.137:0/66033094 learned_addr learned my addr 172.21.2.137:0/66033094 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:17.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 -- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0a9f50 msgr2=0x7f67bc0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0a9f50 0x7f67bc0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 -- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67bc143f00 msgr2=0x7f67bc098290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67bc143f00 0x7f67bc098290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 -- 172.21.2.137:0/66033094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac00b1e0 con 0x7f67bc0b1340 2021-11-15T19:30:17.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67ba7fc700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 0x7f67bc0ac2a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f67b40012f0 tx=0x7f67b4001440).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b400e4a0 con 0x7f67bc0b1340 2021-11-15T19:30:17.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b400e600 con 0x7f67bc0b1340 2021-11-15T19:30:17.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc0ac790 con 0x7f67bc0b1340 2021-11-15T19:30:17.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b400e9a0 con 0x7f67bc0b1340 2021-11-15T19:30:17.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc09abc0 con 0x7f67bc0b1340 2021-11-15T19:30:17.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc0aee70 con 0x7f67bc0b1340 2021-11-15T19:30:17.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67b4019030 con 0x7f67bc0b1340 2021-11-15T19:30:17.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67abfff700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67980536a0 0x7f6798055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:17.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.771+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f67b406b3d0 con 0x7f67bc0b1340 2021-11-15T19:30:17.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.775+0000 7f67baffd700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67980536a0 0x7f6798055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:17.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.775+0000 7f67baffd700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67980536a0 0x7f6798055b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f67b0002f70 tx=0x7f67b00069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:17.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.775+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67bc0aee70 con 0x7f67bc0b1340 2021-11-15T19:30:17.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67bc0aee70 con 0x7f67bc0b1340 2021-11-15T19:30:17.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67abfff700 1 -- 172.21.2.137:0/66033094 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f67bc0aee70 con 0x7f67bc0b1340 2021-11-15T19:30:17.887 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:17.887 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:17.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67980536a0 msgr2=0x7f6798055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67980536a0 0x7f6798055b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f67b0002f70 tx=0x7f67b00069e0).stop 2021-11-15T19:30:17.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 msgr2=0x7f67bc0ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:17.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 0x7f67bc0ac2a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f67b40012f0 tx=0x7f67b4001440).stop 2021-11-15T19:30:17.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 shutdown_connections 2021-11-15T19:30:17.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f67980536a0 0x7f6798055b60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67bc143f00 0x7f67bc098290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67bc0b1340 0x7f67bc0ac2a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 --2- 172.21.2.137:0/66033094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f67bc0a9f50 0x7f67bc0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 >> 172.21.2.137:0/66033094 conn(0x7f67bc0b4e60 msgr2=0x7f67bc13e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 shutdown_connections 2021-11-15T19:30:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:17.883+0000 7f67c1563700 1 -- 172.21.2.137:0/66033094 wait complete. 2021-11-15T19:30:17.891 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:18.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:30:14.557279+0000', 'modified': '2021-11-15T19:30:15.563899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5545': {'gid': 5545, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1712485554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1712485554}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1712485554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:30:18.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:30:18.097 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:30:18.160 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5545,"want_state":"up:active","state":"up:active","rank_uptime":3.592461278,"mdsmap_epoch":20,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":7.7988240910000002} 2021-11-15T19:30:18.161 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5545, "mdsmap_epoch": 20, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 3.592461278, "state": "up:active", "uptime": 7.798824091, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:30:18.161 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:30:18.162 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:30:18.162 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:30:18.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:18.163 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:18.174 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:30:18.186 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:30:18.186 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:30:18.236 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:30:18.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:30:18.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:18.238 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:30:18.243 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:30:18.244 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:18.288 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:30:18.300 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:30:18.300 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:30:18.305 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:30:18.306 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:30:18.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:18.307 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:30:18.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:30:18.329+0000 7ff7de950080 -1 init, newargv = 0x55fa7357cb50 newargc=9 2021-11-15T19:30:18.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14402]: starting ceph client 2021-11-15T19:30:18.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14402]: starting fuse 2021-11-15T19:30:19.435 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:30:19.447 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:30:19.448 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:30:19.496 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:30:19.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:30:19.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:19.498 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:30:19.503 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:30:19.503 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:30:19.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:19.504 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:30:19.504 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:30:19.505 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:30:19.505 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:30:19.505 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:30:19.506 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.506 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:30:19.507 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:30:19.507 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:30:19.507 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.508 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:30:19.508 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:30:19.509 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:30:19.509 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:30:19.510 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.510 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:30:19.510 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:30:19.511 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:30:19.511 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:30:19.512 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:30:19.512 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.512 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:30:19.513 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:30:19.539 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14402.asok 2021-11-15T19:30:19.542 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14402.asok 2021-11-15T19:30:19.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:19.543 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14402.asok status 2021-11-15T19:30:19.649 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:30:19.649 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:30:19.650 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:30:19.650 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:30:19.650 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:30:19.650 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:30:19.650 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:30:19.651 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14402", 2021-11-15T19:30:19.651 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:30:19.651 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:19.651 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:30:19.652 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:30:19.652 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 5716, 2021-11-15T19:30:19.652 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:30:19.652 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:30:19.653 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:30:19.653 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 5716 2021-11-15T19:30:19.653 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:19.653 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:30:19.653 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:30:19.654 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:30:19.654 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 423214436 2021-11-15T19:30:19.654 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:30:19.654 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:19.654 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:30:19.655 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:30:19.655 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:30:19.655 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 423214436 2021-11-15T19:30:19.655 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:19.656 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.5716 172.21.2.131:0/423214436", 2021-11-15T19:30:19.656 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/423214436", 2021-11-15T19:30:19.656 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:30:19.656 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 20, 2021-11-15T19:30:19.656 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 53, 2021-11-15T19:30:19.657 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:30:19.657 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:30:19.657 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:30:19.657 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:30:19.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:19.659 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:19.659 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:19.665 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:30:19.665 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:30:19.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:19.666 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:19.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:19.715 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:19.715 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:19.721 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:30:19.721 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:30:19.722 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:30:19.722 DEBUG:teuthology.orchestra.run.gibba031:> import sys 2021-11-15T19:30:19.723 DEBUG:teuthology.orchestra.run.gibba031:> import time 2021-11-15T19:30:19.723 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:30:19.723 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.724 DEBUG:teuthology.orchestra.run.gibba031:> n = 1000 2021-11-15T19:30:19.724 DEBUG:teuthology.orchestra.run.gibba031:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T19:30:19.724 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.725 DEBUG:teuthology.orchestra.run.gibba031:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T19:30:19.725 DEBUG:teuthology.orchestra.run.gibba031:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T19:30:19.726 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:19.726 DEBUG:teuthology.orchestra.run.gibba031:> for i in range(0, n): 2021-11-15T19:30:19.726 DEBUG:teuthology.orchestra.run.gibba031:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T19:30:19.727 DEBUG:teuthology.orchestra.run.gibba031:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T19:30:19.727 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content'"'"') 2021-11-15T19:30:19.727 DEBUG:teuthology.orchestra.run.gibba031:> if True: 2021-11-15T19:30:19.728 DEBUG:teuthology.orchestra.run.gibba031:> f.flush() 2021-11-15T19:30:19.728 DEBUG:teuthology.orchestra.run.gibba031:> os.fsync(f.fileno()) 2021-11-15T19:30:19.728 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:30:23.974 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:23.977 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:23.981 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:23.984 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:23.987 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:34.206 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:34.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 Processor -- start 2021-11-15T19:30:34.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- start start 2021-11-15T19:30:34.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff0180b1340 0x7ff018147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff018143f00 0x7ff018144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 0x7ff0180aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff018148190 con 0x7ff0180b1340 2021-11-15T19:30:34.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180b1720 con 0x7ff018143f00 2021-11-15T19:30:34.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff018147e70 con 0x7ff0180a9f50 2021-11-15T19:30:34.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff018143f00 0x7ff018144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff018143f00 0x7ff018144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34452/0 (socket says 172.21.2.137:34452) 2021-11-15T19:30:34.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 -- 172.21.2.137:0/2149198348 learned_addr learned my addr 172.21.2.137:0/2149198348 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 -- 172.21.2.137:0/2149198348 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 msgr2=0x7ff0180aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 --2- 172.21.2.137:0/2149198348 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 0x7ff0180aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 -- 172.21.2.137:0/2149198348 >> v2:172.21.2.111:3300/0 conn(0x7ff0180b1340 msgr2=0x7ff018147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 --2- 172.21.2.137:0/2149198348 >> v2:172.21.2.111:3300/0 conn(0x7ff0180b1340 0x7ff018147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 -- 172.21.2.137:0/2149198348 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180af800 con 0x7ff018143f00 2021-11-15T19:30:34.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01c9be700 1 --2- 172.21.2.137:0/2149198348 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff018144390 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7ff008002f70 tx=0x7ff008006eb0).ready entity=mon.1 client_cookie=515e043b2158c41d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff007fff700 1 -- 172.21.2.137:0/2149198348 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00800d570 con 0x7ff018143f00 2021-11-15T19:30:34.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff007fff700 1 -- 172.21.2.137:0/2149198348 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008000e90 con 0x7ff018143f00 2021-11-15T19:30:34.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff007fff700 1 -- 172.21.2.137:0/2149198348 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00800d900 con 0x7ff018143f00 2021-11-15T19:30:34.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- 172.21.2.137:0/2149198348 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 msgr2=0x7ff018144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- 172.21.2.137:0/2149198348 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff018144390 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7ff008002f70 tx=0x7ff008006eb0).stop 2021-11-15T19:30:34.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- 172.21.2.137:0/2149198348 shutdown_connections 2021-11-15T19:30:34.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- 172.21.2.137:0/2149198348 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 0x7ff0180aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- 172.21.2.137:0/2149198348 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff018144390 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 --2- 172.21.2.137:0/2149198348 >> v2:172.21.2.111:3300/0 conn(0x7ff0180b1340 0x7ff018147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- 172.21.2.137:0/2149198348 >> 172.21.2.137:0/2149198348 conn(0x7ff0180b4e60 msgr2=0x7ff0180b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- 172.21.2.137:0/2149198348 shutdown_connections 2021-11-15T19:30:34.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- 172.21.2.137:0/2149198348 wait complete. 2021-11-15T19:30:34.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 Processor -- start 2021-11-15T19:30:34.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.259+0000 7ff01f423700 1 -- start start 2021-11-15T19:30:34.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 0x7ff01814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0180b1340 0x7ff018159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff0180b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01813fe80 con 0x7ff0180b1340 2021-11-15T19:30:34.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181400b0 con 0x7ff018143f00 2021-11-15T19:30:34.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff018159760 con 0x7ff0180a9f50 2021-11-15T19:30:34.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff0180b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff0180b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34458/0 (socket says 172.21.2.137:34458) 2021-11-15T19:30:34.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 -- 172.21.2.137:0/3834089870 learned_addr learned my addr 172.21.2.137:0/3834089870 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 -- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 msgr2=0x7ff01814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 0x7ff01814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 -- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0180b1340 msgr2=0x7ff018159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0180b1340 0x7ff018159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 -- 172.21.2.137:0/3834089870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00800b1e0 con 0x7ff018143f00 2021-11-15T19:30:34.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d9c0700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff0180b3fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7ff0100032f0 tx=0x7ff0100091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01000d4a0 con 0x7ff018143f00 2021-11-15T19:30:34.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000d600 con 0x7ff018143f00 2021-11-15T19:30:34.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff018159a00 con 0x7ff018143f00 2021-11-15T19:30:34.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01000d960 con 0x7ff018143f00 2021-11-15T19:30:34.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0180aef50 con 0x7ff018143f00 2021-11-15T19:30:34.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff018159b90 con 0x7ff018143f00 2021-11-15T19:30:34.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff010018030 con 0x7ff018143f00 2021-11-15T19:30:34.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff0067fc700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feff80536f0 0x7feff8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff01006b390 con 0x7ff018143f00 2021-11-15T19:30:34.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.263+0000 7ff01d1bf700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feff80536f0 0x7feff8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.267+0000 7ff01d1bf700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feff80536f0 0x7feff8055bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff014002f70 tx=0x7ff014006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.267+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff010042490 con 0x7ff018143f00 2021-11-15T19:30:34.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff01805faf0 con 0x7ff018143f00 2021-11-15T19:30:34.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff0067fc700 1 -- 172.21.2.137:0/3834089870 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7ff010045ab0 con 0x7ff018143f00 2021-11-15T19:30:34.381 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:34.381 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:34.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feff80536f0 msgr2=0x7feff8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feff80536f0 0x7feff8055bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff014002f70 tx=0x7ff014006960).stop 2021-11-15T19:30:34.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 msgr2=0x7ff0180b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff0180b3fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7ff0100032f0 tx=0x7ff0100091a0).stop 2021-11-15T19:30:34.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 shutdown_connections 2021-11-15T19:30:34.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feff80536f0 0x7feff8055bb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff018143f00 0x7ff0180b3fa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0180b1340 0x7ff018159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 --2- 172.21.2.137:0/3834089870 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0180a9f50 0x7ff01814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 >> 172.21.2.137:0/3834089870 conn(0x7ff0180b4e60 msgr2=0x7ff018145a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 shutdown_connections 2021-11-15T19:30:34.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.375+0000 7ff01f423700 1 -- 172.21.2.137:0/3834089870 wait complete. 2021-11-15T19:30:34.385 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:34.388 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-15T19:30:34.444 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T19:30:34.445 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T19:30:34.445 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:34.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 Processor -- start 2021-11-15T19:30:34.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 -- start start 2021-11-15T19:30:34.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 0x7f70f405c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f40abd90 0x7f70f405f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f414a7a0 con 0x7f70f405fc20 2021-11-15T19:30:34.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40ab2b0 con 0x7f70f405bd20 2021-11-15T19:30:34.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70fa22e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f414aa40 con 0x7f70f40abd90 2021-11-15T19:30:34.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f37fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 0x7f70f405c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f2ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f40abd90 0x7f70f405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f37fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 0x7f70f405c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:41692/0 (socket says 172.21.2.137:41692) 2021-11-15T19:30:34.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f3fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f70f405fc20 0x7f70f41465e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:45738/0 (socket says 172.21.2.137:45738) 2021-11-15T19:30:34.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f37fe700 1 -- 172.21.2.137:0/748048122 learned_addr learned my addr 172.21.2.137:0/748048122 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f2ffd700 1 -- 172.21.2.137:0/748048122 >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 msgr2=0x7f70f405c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f2ffd700 1 --2- 172.21.2.137:0/748048122 >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 0x7f70f405c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f2ffd700 1 -- 172.21.2.137:0/748048122 >> v1:172.21.2.111:6789/0 conn(0x7f70f405fc20 legacy=0x7f70f41465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f2ffd700 1 -- 172.21.2.137:0/748048122 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f414ace0 con 0x7f70f40abd90 2021-11-15T19:30:34.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f37fe700 1 --2- 172.21.2.137:0/748048122 >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 0x7f70f405c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:30:34.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f2ffd700 1 --2- 172.21.2.137:0/748048122 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f40abd90 0x7f70f405f730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f70e4002f70 tx=0x7f70e4006df0).ready entity=mon.2 client_cookie=b9620a7541b3f1d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f27fc700 1 -- 172.21.2.137:0/748048122 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e400d570 con 0x7f70f40abd90 2021-11-15T19:30:34.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f27fc700 1 -- 172.21.2.137:0/748048122 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4000e90 con 0x7f70f40abd90 2021-11-15T19:30:34.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.491+0000 7f70f27fc700 1 -- 172.21.2.137:0/748048122 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e400d8c0 con 0x7f70f40abd90 2021-11-15T19:30:34.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/748048122 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f40abd90 msgr2=0x7f70f405f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 --2- 172.21.2.137:0/748048122 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f40abd90 0x7f70f405f730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f70e4002f70 tx=0x7f70e4006df0).stop 2021-11-15T19:30:34.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/748048122 shutdown_connections 2021-11-15T19:30:34.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 --2- 172.21.2.137:0/748048122 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f40abd90 0x7f70f405f730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 --2- 172.21.2.137:0/748048122 >> v2:172.21.2.111:3300/0 conn(0x7f70f405bd20 0x7f70f405c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/748048122 >> 172.21.2.137:0/748048122 conn(0x7f70f40b2a20 msgr2=0x7f70f40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/748048122 shutdown_connections 2021-11-15T19:30:34.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/748048122 wait complete. 2021-11-15T19:30:34.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 Processor -- start 2021-11-15T19:30:34.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- start start 2021-11-15T19:30:34.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f405bd20 0x7f70f4149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70f405fc20 0x7f70f4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 0x7f70f409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4159760 con 0x7f70f405fc20 2021-11-15T19:30:34.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4159a00 con 0x7f70f40abd90 2021-11-15T19:30:34.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40ae230 con 0x7f70f405bd20 2021-11-15T19:30:34.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 0x7f70f409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 0x7f70f409b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34474/0 (socket says 172.21.2.137:34474) 2021-11-15T19:30:34.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 -- 172.21.2.137:0/1042805612 learned_addr learned my addr 172.21.2.137:0/1042805612 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 -- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f405bd20 msgr2=0x7f70f4149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f405bd20 0x7f70f4149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 -- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70f405fc20 msgr2=0x7f70f4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70f405fc20 0x7f70f4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 -- 172.21.2.137:0/1042805612 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e800b1e0 con 0x7f70f40abd90 2021-11-15T19:30:34.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f3fff700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 0x7f70f409b540 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f70f40b5ed0 tx=0x7f70ec007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70ec005ae0 con 0x7f70f40abd90 2021-11-15T19:30:34.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec005c40 con 0x7f70f40abd90 2021-11-15T19:30:34.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70ec0070d0 con 0x7f70f40abd90 2021-11-15T19:30:34.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e400b180 con 0x7f70f40abd90 2021-11-15T19:30:34.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f415a530 con 0x7f70f40abd90 2021-11-15T19:30:34.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f4159bc0 con 0x7f70f40abd90 2021-11-15T19:30:34.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f70ec010070 con 0x7f70f40abd90 2021-11-15T19:30:34.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f0ff9700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70d4053640 0x7f70d4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.495+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f70ec06b360 con 0x7f70f40abd90 2021-11-15T19:30:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.499+0000 7f70f37fe700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70d4053640 0x7f70d4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.499+0000 7f70f37fe700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70d4053640 0x7f70d4055b00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f70e800c000 tx=0x7f70e8006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.499+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70ec0424c0 con 0x7f70f40abd90 2021-11-15T19:30:34.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70f4060d20 con 0x7f70f40abd90 2021-11-15T19:30:34.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70f0ff9700 1 -- 172.21.2.137:0/1042805612 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f70ec045ae0 con 0x7f70f40abd90 2021-11-15T19:30:34.612 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:34.613 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:34.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70d4053640 msgr2=0x7f70d4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70d4053640 0x7f70d4055b00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f70e800c000 tx=0x7f70e8006eb0).stop 2021-11-15T19:30:34.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 msgr2=0x7f70f409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 0x7f70f409b540 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f70f40b5ed0 tx=0x7f70ec007f40).stop 2021-11-15T19:30:34.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 shutdown_connections 2021-11-15T19:30:34.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f70d4053640 0x7f70d4055b00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70f40abd90 0x7f70f409b540 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70f405fc20 0x7f70f4159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 --2- 172.21.2.137:0/1042805612 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70f405bd20 0x7f70f4149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 >> 172.21.2.137:0/1042805612 conn(0x7f70f40b2a20 msgr2=0x7f70f40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 shutdown_connections 2021-11-15T19:30:34.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.607+0000 7f70fa22e700 1 -- 172.21.2.137:0/1042805612 wait complete. 2021-11-15T19:30:34.617 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:34.620 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T19:30:34.676 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T19:30:34.676 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T19:30:34.677 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:30:34.691 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:34.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 Processor -- start 2021-11-15T19:30:34.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 -- start start 2021-11-15T19:30:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9040144610 0x7f9040147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90400a9f50 0x7f90400aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9040148190 con 0x7f90400b1340 2021-11-15T19:30:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90400b1720 con 0x7f9040144610 2021-11-15T19:30:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9046ba8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9040147e70 con 0x7f90400a9f50 2021-11-15T19:30:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9044944700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f90400b1340 0x7f9040143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53260/0 (socket says 172.21.2.137:53260) 2021-11-15T19:30:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f9044944700 1 -- 172.21.2.137:0/3194993614 learned_addr learned my addr 172.21.2.137:0/3194993614 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.735+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393596683 0 0) 0x7f9030001110 con 0x7f90400b1340 2021-11-15T19:30:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003260 con 0x7f90400b1340 2021-11-15T19:30:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469687995 0 0) 0x7f9020003260 con 0x7f90400b1340 2021-11-15T19:30:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90400a9f50 msgr2=0x7f90400aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90400a9f50 0x7f90400aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 >> v2:172.21.2.111:3300/0 conn(0x7f9040144610 msgr2=0x7f9040147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 --2- 172.21.2.137:0/3194993614 >> v2:172.21.2.111:3300/0 conn(0x7f9040144610 0x7f9040147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400af800 con 0x7f90400b1340 2021-11-15T19:30:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9030001810 con 0x7f90400b1340 2021-11-15T19:30:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 >> v1:172.21.2.137:6789/0 conn(0x7f90400b1340 legacy=0x7f9040143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f9020003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90400a9f50 0x7f9020004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9020004bf0 0x7f902000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90400b1720 con 0x7f9020004bf0 2021-11-15T19:30:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040147e70 con 0x7f90200037d0 2021-11-15T19:30:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9020005330 con 0x7f90400a9f50 2021-11-15T19:30:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f9020003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90400a9f50 msgr2=0x7f9020004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90400a9f50 0x7f9020004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9020004bf0 msgr2=0x7f902000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9020004bf0 0x7f902000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/3194993614 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020003260 con 0x7f90200037d0 2021-11-15T19:30:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f9020003bf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f9030001520 tx=0x7f90400abfb0).ready entity=mon.1 client_cookie=81de801be5e16b34 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9030007170 con 0x7f90200037d0 2021-11-15T19:30:34.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300072d0 con 0x7f90200037d0 2021-11-15T19:30:34.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903f7fe700 1 -- 172.21.2.137:0/3194993614 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000ca20 con 0x7f90200037d0 2021-11-15T19:30:34.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/3194993614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 msgr2=0x7f9020003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 --2- 172.21.2.137:0/3194993614 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f9020003bf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f9030001520 tx=0x7f90400abfb0).stop 2021-11-15T19:30:34.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9045145700 1 -- 172.21.2.137:0/3194993614 reap_dead start 2021-11-15T19:30:34.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/3194993614 shutdown_connections 2021-11-15T19:30:34.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/3194993614 >> 172.21.2.137:0/3194993614 conn(0x7f90400b4e60 msgr2=0x7f90400b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/3194993614 shutdown_connections 2021-11-15T19:30:34.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/3194993614 wait complete. 2021-11-15T19:30:34.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 Processor -- start 2021-11-15T19:30:34.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- start start 2021-11-15T19:30:34.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f904009a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9040144b30 0x7f9040142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90401434b0 0x7f9040159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040144f70 con 0x7f9040144b30 2021-11-15T19:30:34.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040146d10 con 0x7f90200037d0 2021-11-15T19:30:34.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9040143930 con 0x7f90401434b0 2021-11-15T19:30:34.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f904009a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f904009a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34490/0 (socket says 172.21.2.137:34490) 2021-11-15T19:30:34.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/59825619 learned_addr learned my addr 172.21.2.137:0/59825619 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9045145700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90401434b0 0x7f9040159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903ffff700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9040144b30 0x7f9040142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90401434b0 msgr2=0x7f9040159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90401434b0 0x7f9040159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9040144b30 msgr2=0x7f9040142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9040144b30 0x7f9040142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 -- 172.21.2.137:0/59825619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040146f40 con 0x7f90200037d0 2021-11-15T19:30:34.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9045145700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90401434b0 0x7f9040159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:34.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9044944700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f904009a910 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f9030001520 tx=0x7f9030013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9030007440 con 0x7f90200037d0 2021-11-15T19:30:34.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030004730 con 0x7f90200037d0 2021-11-15T19:30:34.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9030004a90 con 0x7f90200037d0 2021-11-15T19:30:34.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90401471e0 con 0x7f90200037d0 2021-11-15T19:30:34.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.739+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904015a650 con 0x7f90200037d0 2021-11-15T19:30:34.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9040098910 con 0x7f90200037d0 2021-11-15T19:30:34.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9030027070 con 0x7f90200037d0 2021-11-15T19:30:34.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f903dffb700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90240535b0 0x7f9024055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f903006bcf0 con 0x7f90200037d0 2021-11-15T19:30:34.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f903ffff700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90240535b0 0x7f9024055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f903ffff700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90240535b0 0x7f9024055a70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f902800a000 tx=0x7f9028008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.743+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9030042e50 con 0x7f90200037d0 2021-11-15T19:30:34.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.851+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9040148190 con 0x7f90200037d0 2021-11-15T19:30:34.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.851+0000 7f903dffb700 1 -- 172.21.2.137:0/59825619 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f9040148190 con 0x7f90200037d0 2021-11-15T19:30:34.858 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:34.858 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:34.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90240535b0 msgr2=0x7f9024055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90240535b0 0x7f9024055a70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f902800a000 tx=0x7f9028008040).stop 2021-11-15T19:30:34.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 msgr2=0x7f904009a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f904009a910 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f9030001520 tx=0x7f9030013000).stop 2021-11-15T19:30:34.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 shutdown_connections 2021-11-15T19:30:34.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90240535b0 0x7f9024055a70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90401434b0 0x7f9040159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9040144b30 0x7f9040142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 --2- 172.21.2.137:0/59825619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90200037d0 0x7f904009a910 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 >> 172.21.2.137:0/59825619 conn(0x7f90400b4e60 msgr2=0x7f9040149740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 shutdown_connections 2021-11-15T19:30:34.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.855+0000 7f9046ba8700 1 -- 172.21.2.137:0/59825619 wait complete. 2021-11-15T19:30:34.862 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:34.865 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 5 2021-11-15T19:30:34.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 Processor -- start 2021-11-15T19:30:34.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 -- start start 2021-11-15T19:30:34.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdec00b72e0 0x7fdec00b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00ad320 0x7fdec01290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00b76c0 con 0x7fdec00acd60 2021-11-15T19:30:34.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec00b3100 con 0x7fdec00b72e0 2021-11-15T19:30:34.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec7e71700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec012a170 con 0x7fdec00ad320 2021-11-15T19:30:34.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec640e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00ad320 0x7fdec01290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec5c0d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdec00b72e0 0x7fdec00b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec540c700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fdec00acd60 0x7fdec00b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:45774/0 (socket says 172.21.2.137:45774) 2021-11-15T19:30:34.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.959+0000 7fdec540c700 1 -- 172.21.2.137:0/2604837823 learned_addr learned my addr 172.21.2.137:0/2604837823 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:34.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec5c0d700 1 -- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00ad320 msgr2=0x7fdec01290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00ad320 0x7fdec01290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec5c0d700 1 -- 172.21.2.137:0/2604837823 >> v1:172.21.2.111:6789/0 conn(0x7fdec00acd60 legacy=0x7fdec00b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec5c0d700 1 -- 172.21.2.137:0/2604837823 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00ad8a0 con 0x7fdec00b72e0 2021-11-15T19:30:34.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 0x7fdec00b19b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdeb4002f70 tx=0x7fdeb4006df0).ready entity=mon.0 client_cookie=326a3ca16fbce232 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec4c0b700 1 -- 172.21.2.137:0/2604837823 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb400d570 con 0x7fdec00b72e0 2021-11-15T19:30:34.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec4c0b700 1 -- 172.21.2.137:0/2604837823 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4000e90 con 0x7fdec00b72e0 2021-11-15T19:30:34.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec4c0b700 1 -- 172.21.2.137:0/2604837823 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb400d8c0 con 0x7fdec00b72e0 2021-11-15T19:30:34.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 msgr2=0x7fdec00b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 --2- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 0x7fdec00b19b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdeb4002f70 tx=0x7fdeb4006df0).stop 2021-11-15T19:30:34.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- 172.21.2.137:0/2604837823 shutdown_connections 2021-11-15T19:30:34.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 --2- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00ad320 0x7fdec01290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 --2- 172.21.2.137:0/2604837823 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 0x7fdec00b19b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- 172.21.2.137:0/2604837823 >> 172.21.2.137:0/2604837823 conn(0x7fdec0064960 msgr2=0x7fdec0064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- 172.21.2.137:0/2604837823 shutdown_connections 2021-11-15T19:30:34.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- 172.21.2.137:0/2604837823 wait complete. 2021-11-15T19:30:34.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 Processor -- start 2021-11-15T19:30:34.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- start start 2021-11-15T19:30:34.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00acd60 0x7fdec01447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 0x7fdec0141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 0x7fdec0062860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0144cb0 con 0x7fdec00b72e0 2021-11-15T19:30:34.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00af0e0 con 0x7fdec00ad320 2021-11-15T19:30:34.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec7e71700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00631b0 con 0x7fdec00acd60 2021-11-15T19:30:34.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec540c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 0x7fdec0141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec540c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 0x7fdec0141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34506/0 (socket says 172.21.2.137:34506) 2021-11-15T19:30:34.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.963+0000 7fdec540c700 1 -- 172.21.2.137:0/5397248 learned_addr learned my addr 172.21.2.137:0/5397248 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00acd60 msgr2=0x7fdec01447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00acd60 0x7fdec01447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 msgr2=0x7fdec0062860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 0x7fdec0062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/5397248 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb400b180 con 0x7fdec00ad320 2021-11-15T19:30:34.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 0x7fdec0141dd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fdec00ac910 tx=0x7fdebc007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdeb2ffd700 1 -- 172.21.2.137:0/5397248 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc00ce30 con 0x7fdec00ad320 2021-11-15T19:30:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdeb2ffd700 1 -- 172.21.2.137:0/5397248 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0072e0 con 0x7fdec00ad320 2021-11-15T19:30:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec0063450 con 0x7fdec00ad320 2021-11-15T19:30:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdeb2ffd700 1 -- 172.21.2.137:0/5397248 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc005800 con 0x7fdec00ad320 2021-11-15T19:30:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec01422c0 con 0x7fdec00ad320 2021-11-15T19:30:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdeb2ffd700 1 -- 172.21.2.137:0/5397248 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdebc010070 con 0x7fdec00ad320 2021-11-15T19:30:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdeb2ffd700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdea0053720 0x7fdea0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdeb2ffd700 1 -- 172.21.2.137:0/5397248 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdebc06b010 con 0x7fdec00ad320 2021-11-15T19:30:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdea0053720 0x7fdea0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 Processor -- start 2021-11-15T19:30:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- start start 2021-11-15T19:30:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 0xc27f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 0xc28400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xc21d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xb637f0 con 0xc288f0 2021-11-15T19:30:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xb43c70 con 0xbf1ff0 2021-11-15T19:30:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xbf4cc0 con 0xc2cca0 2021-11-15T19:30:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 0xc28400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 0xc28400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34514/0 (socket says 172.21.2.137:34514) 2021-11-15T19:30:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/2571031711 learned_addr learned my addr 172.21.2.137:0/2571031711 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/2571031711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 msgr2=0xc27f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 0xc27f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/2571031711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 msgr2=0xc21d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xc21d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 -- 172.21.2.137:0/2571031711 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb9a960 con 0xbf1ff0 2021-11-15T19:30:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdea0053720 0x7fdea0055be0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fdeb4002f70 tx=0x7fdeb4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec540c700 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 0xc28400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fdebc0458f0 tx=0x7fdebc009000).ready entity=mon.1 client_cookie=9e258f2aef20d131 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec7e71700 1 -- 172.21.2.137:0/2571031711 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc043f70 con 0xbf1ff0 2021-11-15T19:30:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec7e71700 1 -- 172.21.2.137:0/2571031711 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0441d0 con 0xbf1ff0 2021-11-15T19:30:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fdec7e71700 1 -- 172.21.2.137:0/2571031711 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc041e10 con 0xbf1ff0 2021-11-15T19:30:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- 172.21.2.137:0/2571031711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 msgr2=0xc28400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 0xc28400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fdebc0458f0 tx=0x7fdebc009000).stop 2021-11-15T19:30:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- 172.21.2.137:0/2571031711 shutdown_connections 2021-11-15T19:30:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xc21d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xbf1ff0 0xc28400 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 --2- 172.21.2.137:0/2571031711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 0xc27f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.967+0000 7fded20b5740 1 -- 172.21.2.137:0/2571031711 >> 172.21.2.137:0/2571031711 conn(0xbeef10 msgr2=0xc2c230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/2571031711 shutdown_connections 2021-11-15T19:30:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/2571031711 wait complete. 2021-11-15T19:30:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- start start 2021-11-15T19:30:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 Processor -- start 2021-11-15T19:30:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xbf8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 0xc37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 0xc37c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xc24450 con 0xc288f0 2021-11-15T19:30:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf5be0 con 0xc24690 2021-11-15T19:30:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xbf5e80 con 0xc2cca0 2021-11-15T19:30:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 10 client.0 ll_register_callbacks cb 0xb572f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:30:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 0xc37c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 0xc37c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34522/0 (socket says 172.21.2.137:34522) 2021-11-15T19:30:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 -- 172.21.2.137:0/3383029334 learned_addr learned my addr 172.21.2.137:0/3383029334 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 -- 172.21.2.137:0/3383029334 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 msgr2=0xc37720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 0xc37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 -- 172.21.2.137:0/3383029334 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 msgr2=0xbf8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xbf8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 -- 172.21.2.137:0/3383029334 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec01422c0 con 0xc24690 2021-11-15T19:30:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec640e700 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 0xc37c10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fdeb800c000 tx=0x7fdeb80091d0).ready entity=mon.1 client_cookie=233f0f6b7520eaa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:30:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 1 -- 172.21.2.137:0/3383029334 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb8012600 con 0xc24690 2021-11-15T19:30:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 1 -- 172.21.2.137:0/3383029334 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdeb8012760 con 0xc24690 2021-11-15T19:30:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb598b0 con 0xc24690 2021-11-15T19:30:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 1 -- 172.21.2.137:0/3383029334 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdeb8012920 con 0xc24690 2021-11-15T19:30:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 10 client.5740 fetch_fsmap learned FSMap version 20 2021-11-15T19:30:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0xb52ea0 con 0xc24690 2021-11-15T19:30:34.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 1 -- 172.21.2.137:0/3383029334 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb598b0 con 0xc24690 2021-11-15T19:30:34.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 1 -- 172.21.2.137:0/3383029334 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 20) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fdeb801a3a0 con 0xc24690 2021-11-15T19:30:34.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 10 client.5740 fetch_fsmap finished waiting for FSMap version 20 2021-11-15T19:30:34.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 10 client.5740 resolve_mds: resolved ID 'a' to GID 5545 2021-11-15T19:30:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 20 client.5740 populate_metadata read hostname 'gibba037' 2021-11-15T19:30:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc3aea0 0xc3b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 4 client.5740 mds_command: new command op to 5545 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T19:30:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 --> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb51930 con 0xc3aea0 2021-11-15T19:30:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc3aea0 0xc3b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 10 client.5740 ms_handle_connect on v2:172.21.2.137:6832/1712485554 2021-11-15T19:30:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc3aea0 0xc3b280 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8b0c192ae262a19a server_cookie=1d35217021789ba2 in_seq=0 out_seq=0 2021-11-15T19:30:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 1 -- 172.21.2.137:0/3383029334 <== mds.0 v2:172.21.2.137:6832/1712485554 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xb51930 con 0xc3aea0 2021-11-15T19:30:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 10 client.5740 handle_command_reply: tid=0 2021-11-15T19:30:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 client.5740 shutdown 2021-11-15T19:30:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 msgr2=0xc37c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 0xc37c10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fdeb800c000 tx=0x7fdeb80091d0).stop 2021-11-15T19:30:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 shutdown_connections 2021-11-15T19:30:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc3aea0 0xc3b280 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc24690 0xc37c10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fde9cff9700 0 client.5740 ms_handle_reset on v2:172.21.2.137:6832/1712485554 2021-11-15T19:30:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc2cca0 0xc37720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 --2- 172.21.2.137:0/3383029334 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xbf8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 >> 172.21.2.137:0/3383029334 conn(0xbf1ff0 msgr2=0xbf4410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 shutdown_connections 2021-11-15T19:30:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 1 -- 172.21.2.137:0/3383029334 wait complete. 2021-11-15T19:30:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.971+0000 7fded20b5740 20 client.5740 trim_cache size 0 max 16384 2021-11-15T19:30:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 Processor -- start 2021-11-15T19:30:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- start start 2021-11-15T19:30:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 0xbf4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xc345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 0xc37480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xb35dc0 con 0xc288f0 2021-11-15T19:30:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf0950 con 0xc2cca0 2021-11-15T19:30:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xb8f4a0 con 0xc24690 2021-11-15T19:30:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 0xc37480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 0xc37480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34526/0 (socket says 172.21.2.137:34526) 2021-11-15T19:30:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 -- 172.21.2.137:0/3008856603 learned_addr learned my addr 172.21.2.137:0/3008856603 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 -- 172.21.2.137:0/3008856603 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 msgr2=0xbf4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 0xbf4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 -- 172.21.2.137:0/3008856603 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 msgr2=0xc345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xc345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 -- 172.21.2.137:0/3008856603 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb5ba90 con 0xc2cca0 2021-11-15T19:30:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fdec640e700 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 0xc37480 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fdeb800c000 tx=0x7fdeb801e000).ready entity=mon.1 client_cookie=cb739b0a77c491b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fde9effd700 1 -- 172.21.2.137:0/3008856603 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb800eca0 con 0xc2cca0 2021-11-15T19:30:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fde9effd700 1 -- 172.21.2.137:0/3008856603 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb801a880 con 0xc2cca0 2021-11-15T19:30:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fde9effd700 1 -- 172.21.2.137:0/3008856603 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb801ab80 con 0xc2cca0 2021-11-15T19:30:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- 172.21.2.137:0/3008856603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 msgr2=0xc37480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:35.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 0xc37480 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fdeb800c000 tx=0x7fdeb801e000).stop 2021-11-15T19:30:35.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- 172.21.2.137:0/3008856603 shutdown_connections 2021-11-15T19:30:35.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc2cca0 0xc37480 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:35.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc288f0 0xc345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 --2- 172.21.2.137:0/3008856603 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 0xbf4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- 172.21.2.137:0/3008856603 >> 172.21.2.137:0/3008856603 conn(0xbf1ff0 msgr2=0xc2c190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:35.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- 172.21.2.137:0/3008856603 shutdown_connections 2021-11-15T19:30:35.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.979+0000 7fded20b5740 1 -- 172.21.2.137:0/3008856603 wait complete. 2021-11-15T19:30:35.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- start start 2021-11-15T19:30:35.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 Processor -- start 2021-11-15T19:30:35.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 0xc335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 0xbecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc2cca0 0xbed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xc37b80 con 0xc2cca0 2021-11-15T19:30:35.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xc33aa0 con 0xc288f0 2021-11-15T19:30:35.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xc378e0 con 0xc24690 2021-11-15T19:30:35.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 10 client.0 ll_register_callbacks cb 0xbf7480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:30:35.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 0xbecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:35.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 0xbecf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34534/0 (socket says 172.21.2.137:34534) 2021-11-15T19:30:35.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 -- 172.21.2.137:0/3991706164 learned_addr learned my addr 172.21.2.137:0/3991706164 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:35.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 -- 172.21.2.137:0/3991706164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 msgr2=0xc335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:35.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 0xc335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 -- 172.21.2.137:0/3991706164 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc2cca0 msgr2=0xbed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:35.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc2cca0 0xbed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:35.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 -- 172.21.2.137:0/3991706164 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb52ea0 con 0xc288f0 2021-11-15T19:30:35.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec540c700 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 0xbecf00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fdebc0458f0 tx=0x7fdebc047000).ready entity=mon.1 client_cookie=da416a5b1058bfab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:35.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:30:35.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 1 -- 172.21.2.137:0/3991706164 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc0450f0 con 0xc288f0 2021-11-15T19:30:35.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 1 -- 172.21.2.137:0/3991706164 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdebc05bc20 con 0xc288f0 2021-11-15T19:30:35.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdebc0441d0 con 0xc288f0 2021-11-15T19:30:35.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 1 -- 172.21.2.137:0/3991706164 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdebc05bde0 con 0xc288f0 2021-11-15T19:30:35.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 10 client.5746 fetch_fsmap learned FSMap version 20 2021-11-15T19:30:35.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0xb58480 con 0xc288f0 2021-11-15T19:30:35.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 1 -- 172.21.2.137:0/3991706164 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0441d0 con 0xc288f0 2021-11-15T19:30:35.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 1 -- 172.21.2.137:0/3991706164 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 20) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fdebc044490 con 0xc288f0 2021-11-15T19:30:35.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 10 client.5746 fetch_fsmap finished waiting for FSMap version 20 2021-11-15T19:30:35.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 10 client.5746 resolve_mds: resolved ID 'a' to GID 5545 2021-11-15T19:30:35.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 20 client.5746 populate_metadata read hostname 'gibba037' 2021-11-15T19:30:35.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc8a470 0xc8a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:35.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 4 client.5746 mds_command: new command op to 5545 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-11-15T19:30:35.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 --> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0xa475e0 con 0xc8a470 2021-11-15T19:30:35.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc8a470 0xc8a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:35.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fde9dffb700 10 client.5746 ms_handle_connect on v2:172.21.2.137:6832/1712485554 2021-11-15T19:30:35.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:34.983+0000 7fdec5c0d700 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc8a470 0xc8a850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d77ab05791b72d4f server_cookie=525a0741dfbe3a26 in_seq=0 out_seq=0 2021-11-15T19:30:40.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fde9dffb700 1 -- 172.21.2.137:0/3991706164 <== mds.0 v2:172.21.2.137:6832/1712485554 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0xa475e0 con 0xc8a470 2021-11-15T19:30:40.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fde9dffb700 10 client.5746 handle_command_reply: tid=0 2021-11-15T19:30:40.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 client.5746 shutdown 2021-11-15T19:30:40.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 msgr2=0xbecf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 0xbecf00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fdebc0458f0 tx=0x7fdebc047000).stop 2021-11-15T19:30:40.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 shutdown_connections 2021-11-15T19:30:40.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:6832/1712485554,v1:172.21.2.137:6833/1712485554] conn(0xc8a470 0xc8a850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xc2cca0 0xbed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xc288f0 0xbecf00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 --2- 172.21.2.137:0/3991706164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xc24690 0xc335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fde9dffb700 0 client.5746 ms_handle_reset on v2:172.21.2.137:6832/1712485554 2021-11-15T19:30:40.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 >> 172.21.2.137:0/3991706164 conn(0xbf1ff0 msgr2=0xc371d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 shutdown_connections 2021-11-15T19:30:40.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 1 -- 172.21.2.137:0/3991706164 wait complete. 2021-11-15T19:30:40.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fded20b5740 20 client.5746 trim_cache size 0 max 16384 2021-11-15T19:30:40.073 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:30:40.073 INFO:teuthology.orchestra.run.gibba037.stdout: "client_recall": { 2021-11-15T19:30:40.073 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": -110, 2021-11-15T19:30:40.074 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "(110) Connection timed out", 2021-11-15T19:30:40.074 INFO:teuthology.orchestra.run.gibba037.stdout: "recalled": 120 2021-11-15T19:30:40.074 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:40.074 INFO:teuthology.orchestra.run.gibba037.stdout: "flush_journal": { 2021-11-15T19:30:40.074 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": 0, 2021-11-15T19:30:40.075 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "" 2021-11-15T19:30:40.075 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:40.075 INFO:teuthology.orchestra.run.gibba037.stdout: "trim_cache": { 2021-11-15T19:30:40.075 INFO:teuthology.orchestra.run.gibba037.stdout: "trimmed": 0 2021-11-15T19:30:40.076 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:40.076 INFO:teuthology.orchestra.run.gibba037.stdout: "cache": { 2021-11-15T19:30:40.076 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": { 2021-11-15T19:30:40.076 INFO:teuthology.orchestra.run.gibba037.stdout: "items": 19922, 2021-11-15T19:30:40.076 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes": 3095328 2021-11-15T19:30:40.077 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:30:40.077 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:30:40.077 INFO:teuthology.orchestra.run.gibba037.stdout: "duration": 5.0793253350000001 2021-11-15T19:30:40.077 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:30:40.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdea0053720 msgr2=0x7fdea0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdea0053720 0x7fdea0055be0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fdeb4002f70 tx=0x7fdeb4014000).stop 2021-11-15T19:30:40.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 msgr2=0x7fdec0141dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 0x7fdec0141dd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fdec00ac910 tx=0x7fdebc007c40).stop 2021-11-15T19:30:40.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 shutdown_connections 2021-11-15T19:30:40.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdea0053720 0x7fdea0055be0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdec00b72e0 0x7fdec0062860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdec00ad320 0x7fdec0141dd0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 --2- 172.21.2.137:0/5397248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdec00acd60 0x7fdec01447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 >> 172.21.2.137:0/5397248 conn(0x7fdec0064960 msgr2=0x7fdec00b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 shutdown_connections 2021-11-15T19:30:40.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.063+0000 7fdec7e71700 1 -- 172.21.2.137:0/5397248 wait complete. 2021-11-15T19:30:40.082 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-15T19:30:40.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:40.083 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:40.084 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:40.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:30:40.089 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T19:30:40.089 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T19:30:40.090 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:30:40.090 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:30:40.090 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:40.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:40.147 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:40.148 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:40.152 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:30:40.152 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:30:40.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:30:40.153 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:40.157 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:30:40.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 Processor -- start 2021-11-15T19:30:40.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- start start 2021-11-15T19:30:40.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd6b40acab0 0x7fd6b40b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd6b40af2f0 0x7fd6b40b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b40aecf0 con 0x7fd6b40b1180 2021-11-15T19:30:40.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b413f180 con 0x7fd6b40af2f0 2021-11-15T19:30:40.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b40aef20 con 0x7fd6b40acab0 2021-11-15T19:30:40.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd6b40acab0 0x7fd6b40b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd6b40acab0 0x7fd6b40b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34546/0 (socket says 172.21.2.137:34546) 2021-11-15T19:30:40.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 -- 172.21.2.137:0/1471959561 learned_addr learned my addr 172.21.2.137:0/1471959561 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 -- 172.21.2.137:0/1471959561 >> v2:172.21.2.111:3300/0 conn(0x7fd6b40af2f0 msgr2=0x7fd6b40b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 --2- 172.21.2.137:0/1471959561 >> v2:172.21.2.111:3300/0 conn(0x7fd6b40af2f0 0x7fd6b40b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 -- 172.21.2.137:0/1471959561 >> v1:172.21.2.111:6789/0 conn(0x7fd6b40b1180 legacy=0x7fd6b4142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 -- 172.21.2.137:0/1471959561 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40ace90 con 0x7fd6b40acab0 2021-11-15T19:30:40.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b37fe700 1 --2- 172.21.2.137:0/1471959561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b40b2060 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fd6b40b2bd0 tx=0x7fd6a4006e40).ready entity=mon.1 client_cookie=150111481e272e02 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b27fc700 1 -- 172.21.2.137:0/1471959561 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a400bcb0 con 0x7fd6b40acab0 2021-11-15T19:30:40.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b27fc700 1 -- 172.21.2.137:0/1471959561 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4000e90 con 0x7fd6b40acab0 2021-11-15T19:30:40.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6b27fc700 1 -- 172.21.2.137:0/1471959561 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a40153f0 con 0x7fd6b40acab0 2021-11-15T19:30:40.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/1471959561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 msgr2=0x7fd6b40b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/1471959561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b40b2060 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fd6b40b2bd0 tx=0x7fd6a4006e40).stop 2021-11-15T19:30:40.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/1471959561 shutdown_connections 2021-11-15T19:30:40.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/1471959561 >> v2:172.21.2.111:3300/0 conn(0x7fd6b40af2f0 0x7fd6b40b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/1471959561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b40b2060 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/1471959561 >> 172.21.2.137:0/1471959561 conn(0x7fd6b40630f0 msgr2=0x7fd6b40634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/1471959561 shutdown_connections 2021-11-15T19:30:40.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.255+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/1471959561 wait complete. 2021-11-15T19:30:40.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 Processor -- start 2021-11-15T19:30:40.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- start start 2021-11-15T19:30:40.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b4113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd6b40af2f0 0x7fd6b4110390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd6b40b1180 0x7fd6b4110c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b410f930 con 0x7fd6b40af2f0 2021-11-15T19:30:40.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4112920 con 0x7fd6b40acab0 2021-11-15T19:30:40.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4112bc0 con 0x7fd6b40b1180 2021-11-15T19:30:40.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b4113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b4113300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34552/0 (socket says 172.21.2.137:34552) 2021-11-15T19:30:40.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 -- 172.21.2.137:0/3943325498 learned_addr learned my addr 172.21.2.137:0/3943325498 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 -- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd6b40b1180 msgr2=0x7fd6b4110c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd6b40b1180 0x7fd6b4110c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 -- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd6b40af2f0 msgr2=0x7fd6b4110390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd6b40af2f0 0x7fd6b4110390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 -- 172.21.2.137:0/3943325498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a400d4d0 con 0x7fd6b40acab0 2021-11-15T19:30:40.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b37fe700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b4113300 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fd6a4006fc0 tx=0x7fd6a4018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a40159c0 con 0x7fd6b40acab0 2021-11-15T19:30:40.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4015b20 con 0x7fd6b40acab0 2021-11-15T19:30:40.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a4015e80 con 0x7fd6b40acab0 2021-11-15T19:30:40.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4112e60 con 0x7fd6b40acab0 2021-11-15T19:30:40.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b41112f0 con 0x7fd6b40acab0 2021-11-15T19:30:40.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b40b1820 con 0x7fd6b40acab0 2021-11-15T19:30:40.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6a4028460 con 0x7fd6b40acab0 2021-11-15T19:30:40.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b0ff9700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd698053580 0x7fd698055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd6a406f350 con 0x7fd6b40acab0 2021-11-15T19:30:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.259+0000 7fd6b2ffd700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd698053580 0x7fd698055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.263+0000 7fd6b2ffd700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd698053580 0x7fd698055a40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd69c002ef0 tx=0x7fd69c006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.263+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6a40463b0 con 0x7fd6b40acab0 2021-11-15T19:30:40.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.343+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6b40b1820 con 0x7fd6b40acab0 2021-11-15T19:30:40.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.343+0000 7fd6b0ff9700 1 -- 172.21.2.137:0/3943325498 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16040 (secure 0 0 0) 0x7fd6a40499d0 con 0x7fd6b40acab0 2021-11-15T19:30:40.349 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:40.350 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":53,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:30:16.576804+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:30:12.364466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T19:30:13.528542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:30:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd698053580 msgr2=0x7fd698055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd698053580 0x7fd698055a40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd69c002ef0 tx=0x7fd69c006910).stop 2021-11-15T19:30:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 msgr2=0x7fd6b4113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b4113300 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fd6a4006fc0 tx=0x7fd6a4018000).stop 2021-11-15T19:30:40.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 shutdown_connections 2021-11-15T19:30:40.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd698053580 0x7fd698055a40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd6b40b1180 0x7fd6b4110c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd6b40af2f0 0x7fd6b4110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 --2- 172.21.2.137:0/3943325498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd6b40acab0 0x7fd6b4113300 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 >> 172.21.2.137:0/3943325498 conn(0x7fd6b40630f0 msgr2=0x7fd6b413ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 shutdown_connections 2021-11-15T19:30:40.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.347+0000 7fd6ba1c8700 1 -- 172.21.2.137:0/3943325498 wait complete. 2021-11-15T19:30:40.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:30:12.364466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:30:13.528542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:30:40.358 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:30:40.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 Processor -- start 2021-11-15T19:30:40.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- start start 2021-11-15T19:30:40.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f21040acd60 0x7f21040b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040b4680 0x7f21041290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21040b76c0 con 0x7f21040b72e0 2021-11-15T19:30:40.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21040b3100 con 0x7f21040acd60 2021-11-15T19:30:40.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21040b20c0 con 0x7f21040b4680 2021-11-15T19:30:40.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f21040acd60 0x7f21040b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f21040acd60 0x7f21040b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34564/0 (socket says 172.21.2.137:34564) 2021-11-15T19:30:40.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2922210343 learned_addr learned my addr 172.21.2.137:0/2922210343 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2922210343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040b4680 msgr2=0x7f21041290c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:40.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- 172.21.2.137:0/2922210343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040b4680 0x7f21041290c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2922210343 >> v1:172.21.2.111:6789/0 conn(0x7f21040b72e0 legacy=0x7f21040b19b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:30:40.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2922210343 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210412a170 con 0x7f21040acd60 2021-11-15T19:30:40.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- 172.21.2.137:0/2922210343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040acd60 0x7f21040b4190 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f21040ac910 tx=0x7f20f4006eb0).ready entity=mon.1 client_cookie=73daebed84047a3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2101ffb700 1 -- 172.21.2.137:0/2922210343 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f400d570 con 0x7f21040acd60 2021-11-15T19:30:40.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2101ffb700 1 -- 172.21.2.137:0/2922210343 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4000e90 con 0x7f21040acd60 2021-11-15T19:30:40.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2101ffb700 1 -- 172.21.2.137:0/2922210343 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f400d900 con 0x7f21040acd60 2021-11-15T19:30:40.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2922210343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040acd60 msgr2=0x7f21040b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- 172.21.2.137:0/2922210343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040acd60 0x7f21040b4190 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f21040ac910 tx=0x7f20f4006eb0).stop 2021-11-15T19:30:40.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2922210343 shutdown_connections 2021-11-15T19:30:40.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- 172.21.2.137:0/2922210343 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040b4680 0x7f21041290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- 172.21.2.137:0/2922210343 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040acd60 0x7f21040b4190 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2922210343 >> 172.21.2.137:0/2922210343 conn(0x7f2104064960 msgr2=0x7f2104064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2922210343 shutdown_connections 2021-11-15T19:30:40.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2922210343 wait complete. 2021-11-15T19:30:40.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 Processor -- start 2021-11-15T19:30:40.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- start start 2021-11-15T19:30:40.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040acd60 0x7f21041535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 0x7f2104141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21040b72e0 0x7f21040af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104153aa0 con 0x7f21040b72e0 2021-11-15T19:30:40.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104153ce0 con 0x7f21040b4680 2021-11-15T19:30:40.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2104153f80 con 0x7f21040acd60 2021-11-15T19:30:40.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 0x7f2104141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 0x7f2104141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34568/0 (socket says 172.21.2.137:34568) 2021-11-15T19:30:40.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2647767701 learned_addr learned my addr 172.21.2.137:0/2647767701 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040acd60 msgr2=0x7f21041535b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:40.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040acd60 0x7f21041535b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21040b72e0 msgr2=0x7f21040af870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:30:40.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21040b72e0 0x7f21040af870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 -- 172.21.2.137:0/2647767701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f400b1e0 con 0x7f21040b4680 2021-11-15T19:30:40.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f21027fc700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 0x7f2104141dd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f21040ac910 tx=0x7f20f4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f4002f50 con 0x7f21040b4680 2021-11-15T19:30:40.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400de40 con 0x7f21040b4680 2021-11-15T19:30:40.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2104143c00 con 0x7f21040b4680 2021-11-15T19:30:40.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f401d450 con 0x7f21040b4680 2021-11-15T19:30:40.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.407+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104144cc0 con 0x7f21040b4680 2021-11-15T19:30:40.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21040b3a50 con 0x7f21040b4680 2021-11-15T19:30:40.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f20f400f070 con 0x7f21040b4680 2021-11-15T19:30:40.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f20fbfff700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20e8053610 0x7f20e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f20f406d640 con 0x7f21040b4680 2021-11-15T19:30:40.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f2102ffd700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20e8053610 0x7f20e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f2102ffd700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20e8053610 0x7f20e8055ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f20ec000ed0 tx=0x7f20ec0068b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.411+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20f4044690 con 0x7f21040b4680 2021-11-15T19:30:40.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.495+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f21040573d0 con 0x7f21040b4680 2021-11-15T19:30:40.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.495+0000 7f20fbfff700 1 -- 172.21.2.137:0/2647767701 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v53) v1 ==== 110+0+10 (secure 0 0 0) 0x7f20f4047cb0 con 0x7f21040b4680 2021-11-15T19:30:40.502 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:30:40.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.495+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20e8053610 msgr2=0x7f20e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.495+0000 7f2109354700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20e8053610 0x7f20e8055ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f20ec000ed0 tx=0x7f20ec0068b0).stop 2021-11-15T19:30:40.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.495+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 msgr2=0x7f2104141dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.495+0000 7f2109354700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 0x7f2104141dd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f21040ac910 tx=0x7f20f4015000).stop 2021-11-15T19:30:40.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 shutdown_connections 2021-11-15T19:30:40.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f20e8053610 0x7f20e8055ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f21040b72e0 0x7f21040af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f21040b4680 0x7f2104141dd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 --2- 172.21.2.137:0/2647767701 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f21040acd60 0x7f21041535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 >> 172.21.2.137:0/2647767701 conn(0x7f2104064960 msgr2=0x7f2104064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 shutdown_connections 2021-11-15T19:30:40.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.499+0000 7f2109354700 1 -- 172.21.2.137:0/2647767701 wait complete. 2021-11-15T19:30:40.508 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:30:40.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 Processor -- start 2021-11-15T19:30:40.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 -- start start 2021-11-15T19:30:40.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8b3c0b0fe0 0x7f8b3c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 0x7f8b3c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c0aedf0 con 0x7f8b3c0acff0 2021-11-15T19:30:40.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c0ad4a0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b41dfc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0ae070 con 0x7f8b3c13f5c0 2021-11-15T19:30:40.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8b3c0b0fe0 0x7f8b3c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8b3c0b0fe0 0x7f8b3c0afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34574/0 (socket says 172.21.2.137:34574) 2021-11-15T19:30:40.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 -- 172.21.2.137:0/61289032 learned_addr learned my addr 172.21.2.137:0/61289032 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 -- 172.21.2.137:0/61289032 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 msgr2=0x7f8b3c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 --2- 172.21.2.137:0/61289032 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 0x7f8b3c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 -- 172.21.2.137:0/61289032 >> v1:172.21.2.111:6789/0 conn(0x7f8b3c0acff0 legacy=0x7f8b3c0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 -- 172.21.2.137:0/61289032 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0afbd0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3b7fe700 1 --2- 172.21.2.137:0/61289032 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c0afde0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f8b3c0b04d0 tx=0x7f8b2c006eb0).ready entity=mon.1 client_cookie=e66240d15f956ddd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3a7fc700 1 -- 172.21.2.137:0/61289032 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2c00d570 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3a7fc700 1 -- 172.21.2.137:0/61289032 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c000e90 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.555+0000 7f8b3a7fc700 1 -- 172.21.2.137:0/61289032 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2c00d8c0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/61289032 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 msgr2=0x7f8b3c0afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/61289032 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c0afde0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f8b3c0b04d0 tx=0x7f8b2c006eb0).stop 2021-11-15T19:30:40.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/61289032 shutdown_connections 2021-11-15T19:30:40.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/61289032 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 0x7f8b3c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/61289032 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c0afde0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/61289032 >> 172.21.2.137:0/61289032 conn(0x7f8b3c0b5f50 msgr2=0x7f8b3c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/61289032 shutdown_connections 2021-11-15T19:30:40.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/61289032 wait complete. 2021-11-15T19:30:40.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 Processor -- start 2021-11-15T19:30:40.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- start start 2021-11-15T19:30:40.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b3c0acff0 0x7f8b3c0665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 0x7f8b3c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c067180 con 0x7f8b3c0acff0 2021-11-15T19:30:40.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c13ab60 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c066c40 con 0x7f8b3c13f5c0 2021-11-15T19:30:40.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c142f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34580/0 (socket says 172.21.2.137:34580) 2021-11-15T19:30:40.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 -- 172.21.2.137:0/2085064472 learned_addr learned my addr 172.21.2.137:0/2085064472 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 -- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 msgr2=0x7f8b3c13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 0x7f8b3c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 -- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b3c0acff0 msgr2=0x7f8b3c0665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b3c0acff0 0x7f8b3c0665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 -- 172.21.2.137:0/2085064472 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c00b1e0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b3affd700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c142f50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f8b30002f90 tx=0x7f8b30006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b30013460 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b300135c0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c066ee0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c0676c0 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b30013920 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b14003410 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b3001a060 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b38ff9700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b1c053690 0x7f8b1c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.559+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8b3006b310 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.563+0000 7f8b3b7fe700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b1c053690 0x7f8b1c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.563+0000 7f8b3b7fe700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b1c053690 0x7f8b1c055b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f8b3c0b04d0 tx=0x7f8b2c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.563+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b30042360 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8b14003c40 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b38ff9700 1 -- 172.21.2.137:0/2085064472 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b30045980 con 0x7f8b3c0b0fe0 2021-11-15T19:30:40.651 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:40.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b1c053690 msgr2=0x7f8b1c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b1c053690 0x7f8b1c055b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f8b3c0b04d0 tx=0x7f8b2c015000).stop 2021-11-15T19:30:40.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 msgr2=0x7f8b3c142f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c142f50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f8b30002f90 tx=0x7f8b30006df0).stop 2021-11-15T19:30:40.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 shutdown_connections 2021-11-15T19:30:40.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b1c053690 0x7f8b1c055b50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b3c13f5c0 0x7f8b3c13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b3c0b0fe0 0x7f8b3c142f50 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 --2- 172.21.2.137:0/2085064472 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b3c0acff0 0x7f8b3c0665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 >> 172.21.2.137:0/2085064472 conn(0x7f8b3c0b5f50 msgr2=0x7f8b3c13ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 shutdown_connections 2021-11-15T19:30:40.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.647+0000 7f8b41dfc700 1 -- 172.21.2.137:0/2085064472 wait complete. 2021-11-15T19:30:40.658 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:30:40.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 Processor -- start 2021-11-15T19:30:40.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- start start 2021-11-15T19:30:40.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f740c0b72e0 0x7f740c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f740c0acd60 0x7f740c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c0b76c0 con 0x7f740c0b4680 2021-11-15T19:30:40.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0b3100 con 0x7f740c0b72e0 2021-11-15T19:30:40.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c12a170 con 0x7f740c0acd60 2021-11-15T19:30:40.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f740c0acd60 0x7f740c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f740c0acd60 0x7f740c0b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34592/0 (socket says 172.21.2.137:34592) 2021-11-15T19:30:40.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 -- 172.21.2.137:0/93966569 learned_addr learned my addr 172.21.2.137:0/93966569 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 -- 172.21.2.137:0/93966569 >> v2:172.21.2.111:3300/0 conn(0x7f740c0b72e0 msgr2=0x7f740c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 --2- 172.21.2.137:0/93966569 >> v2:172.21.2.111:3300/0 conn(0x7f740c0b72e0 0x7f740c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 -- 172.21.2.137:0/93966569 >> v1:172.21.2.111:6789/0 conn(0x7f740c0b4680 legacy=0x7f740c143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 -- 172.21.2.137:0/93966569 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0ad8a0 con 0x7f740c0acd60 2021-11-15T19:30:40.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 --2- 172.21.2.137:0/93966569 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0acd60 0x7f740c0b4190 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f740c065c40 tx=0x7f73fc006eb0).ready entity=mon.1 client_cookie=6e13e78d013fceea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f740959a700 1 -- 172.21.2.137:0/93966569 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00d5c0 con 0x7f740c0acd60 2021-11-15T19:30:40.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f740959a700 1 -- 172.21.2.137:0/93966569 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc000e90 con 0x7f740c0acd60 2021-11-15T19:30:40.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f740959a700 1 -- 172.21.2.137:0/93966569 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00d910 con 0x7f740c0acd60 2021-11-15T19:30:40.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- 172.21.2.137:0/93966569 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0acd60 msgr2=0x7f740c0b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- 172.21.2.137:0/93966569 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0acd60 0x7f740c0b4190 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f740c065c40 tx=0x7f73fc006eb0).stop 2021-11-15T19:30:40.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- 172.21.2.137:0/93966569 shutdown_connections 2021-11-15T19:30:40.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- 172.21.2.137:0/93966569 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0acd60 0x7f740c0b4190 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- 172.21.2.137:0/93966569 >> v2:172.21.2.111:3300/0 conn(0x7f740c0b72e0 0x7f740c0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- 172.21.2.137:0/93966569 >> 172.21.2.137:0/93966569 conn(0x7f740c064960 msgr2=0x7f740c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- 172.21.2.137:0/93966569 shutdown_connections 2021-11-15T19:30:40.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- 172.21.2.137:0/93966569 wait complete. 2021-11-15T19:30:40.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 Processor -- start 2021-11-15T19:30:40.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- start start 2021-11-15T19:30:40.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f740c0acd60 0x7f740c1442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 0x7f740c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f740c0b72e0 0x7f740c1455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c123ff0 con 0x7f740c0acd60 2021-11-15T19:30:40.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0ae580 con 0x7f740c0b4680 2021-11-15T19:30:40.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7410db4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0ae820 con 0x7f740c0b72e0 2021-11-15T19:30:40.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 0x7f740c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 0x7f740c0614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34594/0 (socket says 172.21.2.137:34594) 2021-11-15T19:30:40.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.707+0000 7f7409d9b700 1 -- 172.21.2.137:0/1813246986 learned_addr learned my addr 172.21.2.137:0/1813246986 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7409d9b700 1 -- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f740c0b72e0 msgr2=0x7f740c1455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7409d9b700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f740c0b72e0 0x7f740c1455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7409d9b700 1 -- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f740c0acd60 msgr2=0x7f740c1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7409d9b700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f740c0acd60 0x7f740c1442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7409d9b700 1 -- 172.21.2.137:0/1813246986 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc00b1e0 con 0x7f740c0b4680 2021-11-15T19:30:40.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7409d9b700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 0x7f740c0614f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f740c065c40 tx=0x7f73fc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc006be0 con 0x7f740c0b4680 2021-11-15T19:30:40.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc002f70 con 0x7f740c0b4680 2021-11-15T19:30:40.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00de70 con 0x7f740c0b4680 2021-11-15T19:30:40.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c145170 con 0x7f740c0b4680 2021-11-15T19:30:40.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c0ae2f0 con 0x7f740c0b4680 2021-11-15T19:30:40.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c0b3cf0 con 0x7f740c0b4680 2021-11-15T19:30:40.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f73fc01a040 con 0x7f740c0b4680 2021-11-15T19:30:40.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f74037fe700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73f0053580 0x7f73f0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f73fc06c880 con 0x7f740c0b4680 2021-11-15T19:30:40.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f740a59c700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73f0053580 0x7f73f0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.711+0000 7f740a59c700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73f0053580 0x7f73f0055a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f73f4002f70 tx=0x7f73f40069f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.715+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73fc043a50 con 0x7f740c0b4680 2021-11-15T19:30:40.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.795+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f740c0573d0 con 0x7f740c0b4680 2021-11-15T19:30:40.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.795+0000 7f74037fe700 1 -- 172.21.2.137:0/1813246986 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+10 (secure 0 0 0) 0x7f73fc0230a0 con 0x7f740c0b4680 2021-11-15T19:30:40.802 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:40.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73f0053580 msgr2=0x7f73f0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73f0053580 0x7f73f0055a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f73f4002f70 tx=0x7f73f40069f0).stop 2021-11-15T19:30:40.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 msgr2=0x7f740c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 0x7f740c0614f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f740c065c40 tx=0x7f73fc015000).stop 2021-11-15T19:30:40.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 shutdown_connections 2021-11-15T19:30:40.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f73f0053580 0x7f73f0055a40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f740c0b72e0 0x7f740c1455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f740c0b4680 0x7f740c0614f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 --2- 172.21.2.137:0/1813246986 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f740c0acd60 0x7f740c1442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 >> 172.21.2.137:0/1813246986 conn(0x7f740c064960 msgr2=0x7f740c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 shutdown_connections 2021-11-15T19:30:40.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.799+0000 7f7410db4700 1 -- 172.21.2.137:0/1813246986 wait complete. 2021-11-15T19:30:40.809 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:30:40.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.855+0000 7fdc548a9700 1 Processor -- start 2021-11-15T19:30:40.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.855+0000 7fdc548a9700 1 -- start start 2021-11-15T19:30:40.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdc5005c770 0x7fdc500aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdc500b0550 0x7fdc5014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc500b1650 con 0x7fdc5005c770 2021-11-15T19:30:40.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5005cb50 con 0x7fdc500b0550 2021-11-15T19:30:40.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500ad030 con 0x7fdc5014aaa0 2021-11-15T19:30:40.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdc500b0550 0x7fdc5014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdc500b0550 0x7fdc5014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34602/0 (socket says 172.21.2.137:34602) 2021-11-15T19:30:40.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 -- 172.21.2.137:0/667540645 learned_addr learned my addr 172.21.2.137:0/667540645 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 -- 172.21.2.137:0/667540645 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 msgr2=0x7fdc50140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4ed9d700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 --2- 172.21.2.137:0/667540645 >> v2:172.21.2.111:3300/0 conn(0x7fdc5005c770 0x7fdc500aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 -- 172.21.2.137:0/667540645 >> v2:172.21.2.111:3300/0 conn(0x7fdc5005c770 msgr2=0x7fdc500aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:40.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 --2- 172.21.2.137:0/667540645 >> v2:172.21.2.111:3300/0 conn(0x7fdc5005c770 0x7fdc500aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 -- 172.21.2.137:0/667540645 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500ad2d0 con 0x7fdc500b0550 2021-11-15T19:30:40.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4ed9d700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:40.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 --2- 172.21.2.137:0/667540645 >> v2:172.21.2.111:3300/0 conn(0x7fdc5005c770 0x7fdc500aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:30:40.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4dd9b700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc500b0550 0x7fdc5014a5b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fdc38002f70 tx=0x7fdc38006eb0).ready entity=mon.1 client_cookie=9874b29ec92566e3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4d59a700 1 -- 172.21.2.137:0/667540645 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3800d570 con 0x7fdc500b0550 2021-11-15T19:30:40.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4d59a700 1 -- 172.21.2.137:0/667540645 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc38000e90 con 0x7fdc500b0550 2021-11-15T19:30:40.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4d59a700 1 -- 172.21.2.137:0/667540645 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3800d900 con 0x7fdc500b0550 2021-11-15T19:30:40.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- 172.21.2.137:0/667540645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc500b0550 msgr2=0x7fdc5014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc500b0550 0x7fdc5014a5b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fdc38002f70 tx=0x7fdc38006eb0).stop 2021-11-15T19:30:40.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- 172.21.2.137:0/667540645 shutdown_connections 2021-11-15T19:30:40.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- 172.21.2.137:0/667540645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc500b0550 0x7fdc5014a5b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- 172.21.2.137:0/667540645 >> v2:172.21.2.111:3300/0 conn(0x7fdc5005c770 0x7fdc500aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- 172.21.2.137:0/667540645 >> 172.21.2.137:0/667540645 conn(0x7fdc500631e0 msgr2=0x7fdc5005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- 172.21.2.137:0/667540645 shutdown_connections 2021-11-15T19:30:40.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- 172.21.2.137:0/667540645 wait complete. 2021-11-15T19:30:40.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 Processor -- start 2021-11-15T19:30:40.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- start start 2021-11-15T19:30:40.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 0x7fdc50118f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc500b0550 0x7fdc50066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5011a9a0 con 0x7fdc500b0550 2021-11-15T19:30:40.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc501180d0 con 0x7fdc5005c770 2021-11-15T19:30:40.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc548a9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50117b90 con 0x7fdc5014aaa0 2021-11-15T19:30:40.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 0x7fdc50118f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 0x7fdc50118f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34608/0 (socket says 172.21.2.137:34608) 2021-11-15T19:30:40.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 -- 172.21.2.137:0/4030159662 learned_addr learned my addr 172.21.2.137:0/4030159662 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:40.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 -- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 msgr2=0x7fdc50144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 -- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc500b0550 msgr2=0x7fdc50066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc500b0550 0x7fdc50066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.859+0000 7fdc4e59c700 1 -- 172.21.2.137:0/4030159662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3800b1e0 con 0x7fdc5005c770 2021-11-15T19:30:40.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc4e59c700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 0x7fdc50118f90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fdc40007000 tx=0x7fdc40008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc40010580 con 0x7fdc5005c770 2021-11-15T19:30:40.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400106e0 con 0x7fdc5005c770 2021-11-15T19:30:40.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc40010a40 con 0x7fdc5005c770 2021-11-15T19:30:40.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc50117e30 con 0x7fdc5005c770 2021-11-15T19:30:40.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc50159ac0 con 0x7fdc5005c770 2021-11-15T19:30:40.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5011b4c0 con 0x7fdc5005c770 2021-11-15T19:30:40.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc40010ba0 con 0x7fdc5005c770 2021-11-15T19:30:40.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc477fe700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc34053640 0x7fdc34055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:40.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdc4006bb40 con 0x7fdc5005c770 2021-11-15T19:30:40.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc4dd9b700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc34053640 0x7fdc34055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:40.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.863+0000 7fdc4dd9b700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc34053640 0x7fdc34055b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fdc38002f70 tx=0x7fdc38015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:40.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.867+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc40042c40 con 0x7fdc5005c770 2021-11-15T19:30:40.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc500573d0 con 0x7fdc5005c770 2021-11-15T19:30:40.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc477fe700 1 -- 172.21.2.137:0/4030159662 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdc40046260 con 0x7fdc5005c770 2021-11-15T19:30:40.952 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:30:40.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc34053640 msgr2=0x7fdc34055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc34053640 0x7fdc34055b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fdc38002f70 tx=0x7fdc38015000).stop 2021-11-15T19:30:40.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 msgr2=0x7fdc50118f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:40.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 0x7fdc50118f90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fdc40007000 tx=0x7fdc40008040).stop 2021-11-15T19:30:40.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 shutdown_connections 2021-11-15T19:30:40.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc34053640 0x7fdc34055b00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc5014aaa0 0x7fdc50144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc500b0550 0x7fdc50066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:40.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 --2- 172.21.2.137:0/4030159662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc5005c770 0x7fdc50118f90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:40.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 >> 172.21.2.137:0/4030159662 conn(0x7fdc500631e0 msgr2=0x7fdc500b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:40.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 shutdown_connections 2021-11-15T19:30:40.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:40.947+0000 7fdc548a9700 1 -- 172.21.2.137:0/4030159662 wait complete. 2021-11-15T19:30:40.959 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:30:40.960 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:30:41.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.003+0000 7fb92a66b700 1 Processor -- start 2021-11-15T19:30:41.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.003+0000 7fb92a66b700 1 -- start start 2021-11-15T19:30:41.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb92413cbc0 0x7fb924142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:41.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb924143b70 con 0x7fb924146170 2021-11-15T19:30:41.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb924147070 con 0x7fb9240af3c0 2021-11-15T19:30:41.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9240b1b50 con 0x7fb92413cbc0 2021-11-15T19:30:41.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb92413cbc0 0x7fb924142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:41.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb928c08700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb9240af3c0 0x7fb9240af850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53402/0 (socket says 172.21.2.137:53402) 2021-11-15T19:30:41.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb928c08700 1 -- 172.21.2.137:0/1042668797 learned_addr learned my addr 172.21.2.137:0/1042668797 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:30:41.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/1042668797 >> v1:172.21.2.137:6789/0 conn(0x7fb9240af3c0 legacy=0x7fb9240af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:41.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/1042668797 >> v1:172.21.2.111:6789/0 conn(0x7fb924146170 legacy=0x7fb9240b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:30:41.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/1042668797 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240b2d20 con 0x7fb92413cbc0 2021-11-15T19:30:41.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- 172.21.2.137:0/1042668797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb92413cbc0 0x7fb924142ba0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fb9240b0720 tx=0x7fb90c006df0).ready entity=mon.1 client_cookie=3af8c751d9e9537e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:41.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb922ffd700 1 -- 172.21.2.137:0/1042668797 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90c00d5c0 con 0x7fb92413cbc0 2021-11-15T19:30:41.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb922ffd700 1 -- 172.21.2.137:0/1042668797 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c000e90 con 0x7fb92413cbc0 2021-11-15T19:30:41.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb922ffd700 1 -- 172.21.2.137:0/1042668797 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90c00d910 con 0x7fb92413cbc0 2021-11-15T19:30:41.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/1042668797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb92413cbc0 msgr2=0x7fb924142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:41.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 --2- 172.21.2.137:0/1042668797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb92413cbc0 0x7fb924142ba0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fb9240b0720 tx=0x7fb90c006df0).stop 2021-11-15T19:30:41.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/1042668797 shutdown_connections 2021-11-15T19:30:41.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 --2- 172.21.2.137:0/1042668797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb92413cbc0 0x7fb924142ba0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:41.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/1042668797 >> 172.21.2.137:0/1042668797 conn(0x7fb924063980 msgr2=0x7fb924063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:41.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/1042668797 shutdown_connections 2021-11-15T19:30:41.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/1042668797 wait complete. 2021-11-15T19:30:41.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 Processor -- start 2021-11-15T19:30:41.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- start start 2021-11-15T19:30:41.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 0x7fb924112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:41.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb92413cbc0 0x7fb92415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:41.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb924146170 0x7fb92415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:41.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924111c20 con 0x7fb924146170 2021-11-15T19:30:41.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92415a150 con 0x7fb9240af3c0 2021-11-15T19:30:41.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92410f150 con 0x7fb92413cbc0 2021-11-15T19:30:41.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 0x7fb924112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:41.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 0x7fb924112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34622/0 (socket says 172.21.2.137:34622) 2021-11-15T19:30:41.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/3793016104 learned_addr learned my addr 172.21.2.137:0/3793016104 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:30:41.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb92413cbc0 msgr2=0x7fb92415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:41.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb92413cbc0 0x7fb92415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:41.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb924146170 msgr2=0x7fb92415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:41.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb924146170 0x7fb92415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:41.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 -- 172.21.2.137:0/3793016104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c00b180 con 0x7fb9240af3c0 2021-11-15T19:30:41.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb923fff700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 0x7fb924112df0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fb9240b0720 tx=0x7fb90c012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:41.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90c016070 con 0x7fb9240af3c0 2021-11-15T19:30:41.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c002f50 con 0x7fb9240af3c0 2021-11-15T19:30:41.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92410f3d0 con 0x7fb9240af3c0 2021-11-15T19:30:41.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90c01e450 con 0x7fb9240af3c0 2021-11-15T19:30:41.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.007+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb924066d70 con 0x7fb9240af3c0 2021-11-15T19:30:41.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb924111a70 con 0x7fb9240af3c0 2021-11-15T19:30:41.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb90c025030 con 0x7fb9240af3c0 2021-11-15T19:30:41.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb9217fa700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb908053640 0x7fb908055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:30:41.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb90c06ca20 con 0x7fb9240af3c0 2021-11-15T19:30:41.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb9237fe700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb908053640 0x7fb908055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:30:41.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb9237fe700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb908053640 0x7fb908055b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb914002f30 tx=0x7fb914006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:30:41.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.011+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb90c043a70 con 0x7fb9240af3c0 2021-11-15T19:30:41.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb924143430 con 0x7fb9240af3c0 2021-11-15T19:30:41.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb9217fa700 1 -- 172.21.2.137:0/3793016104 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fb90c023870 con 0x7fb9240af3c0 2021-11-15T19:30:41.129 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:30:41.129 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:30:41.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb908053640 msgr2=0x7fb908055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:41.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb908053640 0x7fb908055b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb914002f30 tx=0x7fb914006930).stop 2021-11-15T19:30:41.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 msgr2=0x7fb924112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:30:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 0x7fb924112df0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fb9240b0720 tx=0x7fb90c012000).stop 2021-11-15T19:30:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 shutdown_connections 2021-11-15T19:30:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb908053640 0x7fb908055b00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb924146170 0x7fb92415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb92413cbc0 0x7fb92415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:30:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 --2- 172.21.2.137:0/3793016104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb9240af3c0 0x7fb924112df0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:30:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 >> 172.21.2.137:0/3793016104 conn(0x7fb924063980 msgr2=0x7fb9240af850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:30:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 shutdown_connections 2021-11-15T19:30:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:30:41.123+0000 7fb92a66b700 1 -- 172.21.2.137:0/3793016104 wait complete. 2021-11-15T19:30:41.133 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:30:41.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:30:14.557279+0000', 'modified': '2021-11-15T19:30:15.563899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5545': {'gid': 5545, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1712485554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1712485554}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1712485554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:30:41.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:30:41.338 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:30:41.402 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5545,"want_state":"up:active","state":"up:active","rank_uptime":26.834352407000001,"mdsmap_epoch":20,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":31.040714738999998} 2021-11-15T19:30:41.403 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5545, "mdsmap_epoch": 20, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 26.834352407, "state": "up:active", "uptime": 31.040714739, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:30:41.403 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:30:41.404 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:30:41.404 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:30:41.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:41.405 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:41.416 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:30:41.428 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:30:41.428 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:30:41.476 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:30:41.476 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:30:41.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:41.478 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:30:41.483 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:30:41.483 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:41.485 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:30:41.495 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:30:41.496 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:30:41.500 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:30:41.501 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:30:41.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:41.503 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:30:41.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:30:41.526+0000 7ff2d5a80080 -1 init, newargv = 0x564e09887b90 newargc=9 2021-11-15T19:30:41.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14484]: starting ceph client 2021-11-15T19:30:41.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14484]: starting fuse 2021-11-15T19:30:42.607 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:30:42.620 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:30:42.620 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:30:42.668 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:30:42.669 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:30:42.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:42.671 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:30:42.676 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:30:42.676 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:30:42.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:42.677 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:30:42.678 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:30:42.678 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:30:42.678 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:30:42.679 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:30:42.679 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:42.680 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:30:42.680 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:30:42.680 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:30:42.681 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:42.681 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:30:42.682 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:30:42.682 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:30:42.682 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:30:42.683 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:42.683 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:30:42.684 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:30:42.684 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:30:42.685 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:30:42.685 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:30:42.685 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:30:42.686 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:30:42.686 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:30:42.752 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14484.asok 2021-11-15T19:30:42.754 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14484.asok 2021-11-15T19:30:42.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:42.755 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14484.asok status 2021-11-15T19:30:42.802 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:30:42.803 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:30:42.803 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:30:42.803 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:30:42.803 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:30:42.804 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:30:42.804 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:30:42.804 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14484", 2021-11-15T19:30:42.804 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:30:42.804 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:42.805 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:30:42.805 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:30:42.805 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4710, 2021-11-15T19:30:42.805 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:30:42.805 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:30:42.806 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:30:42.806 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4710 2021-11-15T19:30:42.806 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:42.806 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:30:42.807 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:30:42.807 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:30:42.807 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2415646549 2021-11-15T19:30:42.807 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:30:42.807 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:42.808 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:30:42.808 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:30:42.808 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:30:42.808 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2415646549 2021-11-15T19:30:42.808 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:30:42.809 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4710 172.21.2.131:0/2415646549", 2021-11-15T19:30:42.809 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2415646549", 2021-11-15T19:30:42.809 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:30:42.809 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 20, 2021-11-15T19:30:42.809 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 53, 2021-11-15T19:30:42.810 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:30:42.810 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:30:42.810 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:30:42.810 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:30:42.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:42.812 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:30:42.813 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:42.818 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:30:42.818 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:30:42.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:30:42.819 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:30:54.035 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:54.038 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:54.042 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:54.045 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:30:54.049 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:24.119 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:24.123 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:24.126 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:24.130 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:24.133 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:35.376 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:31:35.377 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:35.388 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:35.401 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:35.414 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:35.428 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:35.441 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:31:35.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:35.442 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:35.443 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:35.448 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:31:35.449 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:31:35.449 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:31:35.450 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:31:35.450 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:35.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14484]: fuse finished with error 0 and tester_r 0 2021-11-15T19:31:35.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:35.501 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:35.501 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:35.505 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:31:35.506 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:31:35.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:31:35.617 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:35.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:35.662 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:35.662 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:31:35.672 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:31:35.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:35.673 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:31:35.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:31:35.674 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:31:35.683 INFO:teuthology.orchestra.run.gibba018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:31:35.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:35.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:35.685 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:35.685 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:31:35.695 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:31:35.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:35.696 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:31:35.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:31:35.697 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:31:35.706 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:31:35.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:35.708 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:31:35.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.772+0000 7fe4a3548700 1 Processor -- start 2021-11-15T19:31:35.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- start start 2021-11-15T19:31:35.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 0x7fe49c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe49c0a9f50 0x7fe49c0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c148190 con 0x7fe49c0b1340 2021-11-15T19:31:35.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0b1720 con 0x7fe49c0a9f50 2021-11-15T19:31:35.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c147e70 con 0x7fe49c144610 2021-11-15T19:31:35.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a12e4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe49c0b1340 0x7fe49c143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53412/0 (socket says 172.21.2.137:53412) 2021-11-15T19:31:35.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a12e4700 1 -- 172.21.2.137:0/2655347888 learned_addr learned my addr 172.21.2.137:0/2655347888 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:35.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444009915 0 0) 0x7fe490001110 con 0x7fe49c0b1340 2021-11-15T19:31:35.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe484003260 con 0x7fe49c0b1340 2021-11-15T19:31:35.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a1ae5700 1 --2- 172.21.2.137:0/2655347888 >> v2:172.21.2.111:3300/0 conn(0x7fe49c0a9f50 0x7fe49c0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 0x7fe49c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800926643 0 0) 0x7fe484003260 con 0x7fe49c0b1340 2021-11-15T19:31:35.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 msgr2=0x7fe49c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:35.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 0x7fe49c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:35.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 >> v2:172.21.2.111:3300/0 conn(0x7fe49c0a9f50 msgr2=0x7fe49c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:35.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 --2- 172.21.2.137:0/2655347888 >> v2:172.21.2.111:3300/0 conn(0x7fe49c0a9f50 0x7fe49c0aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:35.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0af800 con 0x7fe49c0b1340 2021-11-15T19:31:35.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe4900017f0 con 0x7fe49c0b1340 2021-11-15T19:31:35.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 >> v1:172.21.2.137:6789/0 conn(0x7fe49c0b1340 legacy=0x7fe49c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:35.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 0x7fe4840037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe484003e00 0x7fe484004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4840049f0 0x7fe484004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0b1720 con 0x7fe4840049f0 2021-11-15T19:31:35.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c147e70 con 0x7fe484003e00 2021-11-15T19:31:35.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48400b8e0 con 0x7fe49c144610 2021-11-15T19:31:35.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe484003e00 0x7fe484004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a1ae5700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4840049f0 0x7fe484004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 -- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 msgr2=0x7fe4840037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:35.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c144610 0x7fe4840037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:35.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 -- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4840049f0 msgr2=0x7fe484004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:35.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4840049f0 0x7fe484004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:35.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 -- 172.21.2.137:0/2655347888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484003260 con 0x7fe484003e00 2021-11-15T19:31:35.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a1ae5700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4840049f0 0x7fe484004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:35.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a0ae3700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe484003e00 0x7fe484004500 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe49800a000 tx=0x7fe498008040).ready entity=mon.1 client_cookie=7ec2dac4da47d637 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:35.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe498013670 con 0x7fe484003e00 2021-11-15T19:31:35.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4980137d0 con 0x7fe484003e00 2021-11-15T19:31:35.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe48ffff700 1 -- 172.21.2.137:0/2655347888 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe498013b30 con 0x7fe484003e00 2021-11-15T19:31:35.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- 172.21.2.137:0/2655347888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe484003e00 msgr2=0x7fe484004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:35.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 --2- 172.21.2.137:0/2655347888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe484003e00 0x7fe484004500 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe49800a000 tx=0x7fe498008040).stop 2021-11-15T19:31:35.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a1ae5700 1 -- 172.21.2.137:0/2655347888 reap_dead start 2021-11-15T19:31:35.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- 172.21.2.137:0/2655347888 shutdown_connections 2021-11-15T19:31:35.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- 172.21.2.137:0/2655347888 >> 172.21.2.137:0/2655347888 conn(0x7fe49c0b4e60 msgr2=0x7fe49c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:35.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- 172.21.2.137:0/2655347888 shutdown_connections 2021-11-15T19:31:35.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.776+0000 7fe4a3548700 1 -- 172.21.2.137:0/2655347888 wait complete. 2021-11-15T19:31:35.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 Processor -- start 2021-11-15T19:31:35.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- start start 2021-11-15T19:31:35.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe484003e00 0x7fe49c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c140130 0x7fe49c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 0x7fe49c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0630b0 con 0x7fe484003e00 2021-11-15T19:31:35.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c157570 con 0x7fe49c062710 2021-11-15T19:31:35.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0632a0 con 0x7fe49c140130 2021-11-15T19:31:35.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 0x7fe49c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 0x7fe49c062bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34646/0 (socket says 172.21.2.137:34646) 2021-11-15T19:31:35.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 -- 172.21.2.137:0/4168116223 learned_addr learned my addr 172.21.2.137:0/4168116223 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:35.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a12e4700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe484003e00 0x7fe49c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a0ae3700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c140130 0x7fe49c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 -- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c140130 msgr2=0x7fe49c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:35.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c140130 0x7fe49c156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:35.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 -- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe484003e00 msgr2=0x7fe49c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:35.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe484003e00 0x7fe49c156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:35.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 -- 172.21.2.137:0/4168116223 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c09a7f0 con 0x7fe49c062710 2021-11-15T19:31:35.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a12e4700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe484003e00 0x7fe49c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:35.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a1ae5700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 0x7fe49c062bc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fe494001210 tx=0x7fe494008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:35.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe494018070 con 0x7fe49c062710 2021-11-15T19:31:35.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400c030 con 0x7fe49c062710 2021-11-15T19:31:35.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c13fc20 con 0x7fe49c062710 2021-11-15T19:31:35.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49400fee0 con 0x7fe49c062710 2021-11-15T19:31:35.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c140920 con 0x7fe49c062710 2021-11-15T19:31:35.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c05faf0 con 0x7fe49c062710 2021-11-15T19:31:35.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4940139f0 con 0x7fe49c062710 2021-11-15T19:31:35.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe48e7fc700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe47c0536a0 0x7fe47c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:35.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe49406b620 con 0x7fe49c062710 2021-11-15T19:31:35.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.780+0000 7fe4a12e4700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe47c0536a0 0x7fe47c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:35.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.784+0000 7fe4a12e4700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe47c0536a0 0x7fe47c055b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe490008000 tx=0x7fe490009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:35.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.784+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe494042780 con 0x7fe49c062710 2021-11-15T19:31:35.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.864+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe49c0573d0 con 0x7fe49c062710 2021-11-15T19:31:35.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.864+0000 7fe48e7fc700 1 -- 172.21.2.137:0/4168116223 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33647 (secure 0 0 0) 0x7fe494045da0 con 0x7fe49c062710 2021-11-15T19:31:35.872 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:35.873 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:31:35.873 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 53, 2021-11-15T19:31:35.873 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:31:35.874 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:31:35.874 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:30:16.576804+0000", 2021-11-15T19:31:35.875 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:31:35.875 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:31:35.876 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:31:35.876 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:31:35.876 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:31:35.877 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:31:35.877 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:31:35.878 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:31:35.878 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:31:35.879 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:35.879 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:31:35.879 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:31:35.880 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:31:35.880 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:31:35.881 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:31:35.881 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 10, 2021-11-15T19:31:35.881 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:31:35.882 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:31:35.882 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:31:35.883 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:31:35.883 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:31:35.884 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.884 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:31:35.884 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:31:35.885 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:31:35.885 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:31:35.886 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:31:35.886 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:31:35.887 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:31:35.887 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:31:35.888 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:31:35.888 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:31:35.888 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:31:35.889 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:31:35.889 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:31:35.890 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:31:35.890 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:31:35.891 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:31:35.891 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:31:35.892 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:31:35.892 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:31:35.892 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:31:35.893 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:31:35.893 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:31:35.894 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:31:35.894 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.894 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:31:35.894 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:31:35.895 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:31:35.895 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:31:35.895 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:31:35.895 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:31:35.895 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:31:35.896 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:31:35.896 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:31:35.896 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:31:35.896 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:31:35.897 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:31:35.897 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:31:35.897 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:31:35.897 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:31:35.897 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:31:35.898 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:31:35.898 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:31:35.898 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:31:35.898 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:31:35.899 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:31:35.899 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:31:35.899 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:31:35.899 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:31:35.899 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:31:35.900 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:31:35.900 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:31:35.900 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.900 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:31:35.901 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:31:35.901 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:31:35.901 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:31:35.901 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:31:35.901 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:31:35.902 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:31:35.902 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:31:35.902 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:31:35.902 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:31:35.903 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:31:35.903 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:31:35.903 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:31:35.903 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.903 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:31:35.904 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:31:35.904 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.904 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.904 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.904 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:31:35.905 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:31:35.905 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:31:35.905 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:31:35.905 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:31:35.906 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:31:35.906 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:31:35.906 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:31:35.906 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:31:35.907 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:31:35.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:31:35.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:31:35.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:31:35.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:31:35.908 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:31:35.908 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:31:35.908 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:31:35.908 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:31:35.909 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:31:35.909 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:31:35.909 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:31:35.909 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:31:35.909 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:31:35.910 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.910 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:31:35.910 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:31:35.910 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:31:35.911 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:31:35.911 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:31:35.911 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:31:35.911 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:31:35.911 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:31:35.912 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:31:35.912 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:31:35.912 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:31:35.912 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:31:35.912 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:31:35.913 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:31:35.913 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:31:35.913 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:31:35.913 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:31:35.914 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:31:35.914 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:31:35.914 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:31:35.914 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:31:35.914 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:31:35.915 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:31:35.915 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:31:35.915 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:31:35.915 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:31:35.916 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:31:35.916 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.916 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:31:35.916 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:31:35.917 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:31:35.917 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:31:35.917 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:31:35.917 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:31:35.917 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:31:35.918 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:31:35.918 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:31:35.918 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:31:35.918 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:31:35.919 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:31:35.919 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:31:35.919 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:31:35.919 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.919 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.920 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.920 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 9, 2021-11-15T19:31:35.920 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:31:35.920 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:30:12.364466+0000", 2021-11-15T19:31:35.921 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:31:35.921 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:31:35.921 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:31:35.921 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:31:35.922 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:31:35.922 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:31:35.922 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:31:35.922 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:31:35.922 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:31:35.923 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:31:35.923 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:31:35.923 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:31:35.923 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:31:35.924 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:31:35.924 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:31:35.924 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:31:35.924 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:31:35.925 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:31:35.925 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:31:35.925 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:31:35.925 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.925 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "52", 2021-11-15T19:31:35.926 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:31:35.926 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:31:35.926 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:31:35.926 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:31:35.926 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:31:35.927 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:31:35.927 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:31:35.927 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:31:35.927 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:31:35.928 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:31:35.928 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:31:35.928 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:31:35.928 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:31:35.928 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:31:35.929 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:31:35.929 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:31:35.929 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:31:35.929 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:31:35.930 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:31:35.930 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:31:35.930 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:31:35.930 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:31:35.930 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:31:35.931 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:31:35.931 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:31:35.931 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:31:35.931 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.932 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:31:35.932 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:31:35.932 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:31:35.933 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:31:35.933 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:31:35.933 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:31:35.933 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:31:35.934 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:31:35.934 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:31:35.934 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:31:35.934 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:31:35.934 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:31:35.935 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:31:35.935 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:31:35.935 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:31:35.935 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.936 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:31:35.936 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:31:35.936 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:31:35.936 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.936 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.937 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.937 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.937 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 10, 2021-11-15T19:31:35.937 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:31:35.938 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:30:13.528542+0000", 2021-11-15T19:31:35.938 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:31:35.938 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:31:35.938 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:31:35.939 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:31:35.939 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:31:35.939 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:31:35.939 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:31:35.939 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:31:35.940 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:31:35.940 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:31:35.940 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:31:35.940 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:31:35.941 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:31:35.941 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:31:35.941 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:31:35.941 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:31:35.942 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:31:35.942 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:31:35.942 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:31:35.942 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:31:35.942 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.943 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "53", 2021-11-15T19:31:35.943 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:31:35.943 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:31:35.943 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:31:35.944 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:31:35.944 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:31:35.944 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:31:35.944 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:31:35.945 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:31:35.945 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:31:35.945 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:31:35.945 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:31:35.945 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:31:35.946 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:31:35.946 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:31:35.946 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:31:35.946 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:31:35.947 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:31:35.947 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:31:35.947 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:31:35.947 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:31:35.947 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:31:35.948 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:31:35.948 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:31:35.948 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:31:35.948 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:31:35.949 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:31:35.949 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.949 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:31:35.949 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:31:35.949 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:31:35.950 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:31:35.950 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:31:35.950 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:31:35.950 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:31:35.951 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:31:35.951 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:31:35.951 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:31:35.951 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:31:35.951 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:31:35.952 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:31:35.952 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:31:35.952 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:31:35.952 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.952 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.953 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.953 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:35.953 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:31:35.953 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.954 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:31:35.954 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:31:35.954 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:35.954 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:35.954 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:35.955 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:35.955 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:35.955 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:35.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:35.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:35.956 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:35.956 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:35.956 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:35.956 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.956 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.957 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.957 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:31:35.957 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.957 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.958 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.958 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.958 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:31:35.958 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.958 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.959 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.959 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.959 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:35.959 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.960 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.960 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.960 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:31:35.960 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.960 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.961 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.961 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.961 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:31:35.961 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.961 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.962 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.962 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.962 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:35.962 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.963 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.963 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.963 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:31:35.963 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.963 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.964 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.964 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.964 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:31:35.964 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.965 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.965 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.965 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.965 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:35.965 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.966 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.966 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.966 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:31:35.966 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.967 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.967 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.967 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.967 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:31:35.968 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:35.968 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.968 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.968 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.968 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:31:35.969 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:31:35.969 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:31:35.969 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:31:35.969 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:35.969 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:35.970 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:35.970 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.970 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.970 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.971 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:31:35.971 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:31:35.971 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:35.971 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:35.971 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:35.972 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:35.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:35.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:35.972 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:35.973 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:35.973 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:35.973 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:35.973 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:35.973 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.974 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.974 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.974 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:31:35.974 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.975 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.975 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.975 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.975 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:31:35.975 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.976 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.976 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.976 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.976 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:35.977 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.977 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.977 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.977 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:31:35.977 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.978 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.978 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.978 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.978 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:31:35.979 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.979 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.979 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.979 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.980 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:35.980 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.980 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.980 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.980 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:31:35.981 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.981 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.981 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.981 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.982 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:31:35.982 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.982 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.982 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.982 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.983 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:35.983 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.983 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.983 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.984 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:31:35.984 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.984 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.984 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.985 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.985 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:31:35.985 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:35.985 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.985 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.986 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.986 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:31:35.986 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:31:35.986 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:31:35.987 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:31:35.987 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:35.987 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:35.987 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:35.987 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.988 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.988 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.988 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:31:35.988 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:31:35.989 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:35.989 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:35.989 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:35.989 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:35.989 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:35.990 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:35.990 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:35.990 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:35.990 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:35.991 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:35.991 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:35.991 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.991 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.991 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.992 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:31:35.992 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:35.992 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.992 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.992 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.993 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:31:35.993 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:35.993 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.993 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.994 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.994 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:35.994 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.994 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.995 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.995 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:31:35.995 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:35.995 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.996 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.996 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.996 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:31:35.996 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:35.996 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:35.997 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:35.997 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.997 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:35.997 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:35.997 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.998 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:35.998 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:31:35.998 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:35.998 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:35.999 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:35.999 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:35.999 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:31:35.999 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:36.000 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.000 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.000 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.000 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:36.000 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.001 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.001 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.001 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:31:36.001 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:36.002 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.002 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.002 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.002 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:31:36.002 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:36.003 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.003 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.003 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.003 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:31:36.004 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:31:36.004 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:31:36.004 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:31:36.004 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:36.004 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:36.005 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:36.005 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.005 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.005 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.005 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:31:36.006 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:31:36.006 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:36.006 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:36.006 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:36.007 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:36.007 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:36.007 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:36.007 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:36.007 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 48, 2021-11-15T19:31:36.008 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:36.008 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:36.008 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:36.008 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.009 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.009 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.009 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:31:36.009 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.009 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.010 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.010 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.010 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:31:36.010 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.010 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.011 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.011 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.011 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:36.011 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.012 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.012 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.012 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:31:36.012 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.012 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.013 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.013 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.013 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:31:36.013 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.013 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.014 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.014 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.014 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:36.014 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.015 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.015 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.015 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:31:36.015 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.016 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.016 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.016 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.016 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:31:36.016 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.017 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.017 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.017 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.017 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:36.017 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.018 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.018 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.018 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:31:36.018 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.019 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.019 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.019 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.019 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:31:36.019 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:36.020 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.020 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.020 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.020 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:31:36.021 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:31:36.021 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:31:36.021 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:31:36.021 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:36.021 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:36.022 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:36.022 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.022 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.022 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.022 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:31:36.023 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:31:36.023 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:36.023 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:36.023 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:36.024 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:36.024 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:36.024 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:36.024 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:36.025 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:36.025 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:36.025 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:36.025 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:36.025 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.026 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.026 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.026 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:31:36.026 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.027 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.027 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.027 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.027 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:31:36.027 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.028 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.028 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.028 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.028 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:36.029 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.029 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.029 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.029 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:31:36.029 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.030 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.030 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.030 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.030 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:31:36.031 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.031 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.031 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.031 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.032 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:36.032 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.032 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.032 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.033 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:31:36.033 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.033 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.033 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.033 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.034 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:31:36.034 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.034 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.034 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.035 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.035 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:36.035 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.035 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.035 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.036 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:31:36.036 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.036 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.036 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.037 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.037 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:31:36.037 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:36.037 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.037 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.038 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.038 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:31:36.038 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:31:36.038 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:31:36.039 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:31:36.039 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:36.039 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:36.039 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:36.040 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.040 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.040 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.040 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:31:36.040 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:31:36.041 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:36.041 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:36.041 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:36.041 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:36.042 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:36.042 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:36.042 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:36.042 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:36.042 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:36.043 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:36.043 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:36.043 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.043 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.044 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.044 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:31:36.044 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.044 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.044 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.045 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.045 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:31:36.045 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.045 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.046 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.046 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.046 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:36.046 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.047 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.047 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.047 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:31:36.047 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.048 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.048 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.048 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.048 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:31:36.048 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.049 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.049 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.049 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.049 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:36.050 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.050 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.050 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.050 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:31:36.051 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.051 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.051 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.051 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.051 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:31:36.052 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.052 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.052 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.052 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.053 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:36.053 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.053 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.053 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.054 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:31:36.054 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.054 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.054 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.054 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.055 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:31:36.055 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:36.055 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.055 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.056 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.056 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:31:36.056 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:31:36.056 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:31:36.056 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:31:36.057 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:36.057 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:36.057 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:36.057 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.058 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.058 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.058 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:31:36.058 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:31:36.059 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:36.059 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:36.059 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:36.059 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:36.059 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:36.060 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:36.060 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:36.060 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 51, 2021-11-15T19:31:36.060 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:36.061 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:36.061 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:36.061 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.061 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.061 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.062 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:31:36.062 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.062 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.062 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.063 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.063 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:31:36.063 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.063 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.063 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.064 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.064 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:36.064 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.064 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.065 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.065 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:31:36.065 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.065 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.066 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.066 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.066 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:31:36.066 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.066 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.067 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.067 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.067 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:36.067 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.068 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.068 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.068 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:31:36.068 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.069 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.069 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.069 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.069 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:31:36.069 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.070 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.070 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.070 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.070 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:36.071 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.071 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.071 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.071 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:31:36.071 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.072 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.072 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.072 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.072 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:31:36.072 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:36.073 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.073 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.073 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.073 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:31:36.074 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:31:36.074 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:31:36.074 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:31:36.074 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:36.075 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:36.075 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:36.075 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.075 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.075 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.076 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:31:36.076 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:31:36.076 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:36.076 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:36.077 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:36.077 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:36.077 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:36.077 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:36.077 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:36.078 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 48, 2021-11-15T19:31:36.078 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:36.078 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:36.078 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:36.079 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.079 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.079 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.079 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:31:36.080 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.080 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.080 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.080 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.080 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:31:36.081 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.081 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.081 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.081 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.082 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:36.082 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.082 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.082 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.082 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:31:36.083 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.083 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.083 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.083 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.084 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:31:36.084 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.084 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.084 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.084 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.085 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:36.085 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.085 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.085 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.086 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:31:36.086 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.086 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.086 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.086 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.087 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:31:36.087 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.087 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.087 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.088 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.088 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:36.088 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:36.088 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.088 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:36.089 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:31:36.089 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.089 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.089 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.090 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:36.090 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:31:36.090 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:36.090 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.090 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.091 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.091 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:31:36.091 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:31:36.091 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:31:36.092 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:31:36.092 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:36.092 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:36.092 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:36.092 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:36.093 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.093 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:36.093 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:31:36.093 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.094 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:31:36.094 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.094 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.094 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.094 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.095 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.095 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:31:36.095 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.095 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.096 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.096 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:31:36.096 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.096 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.096 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.097 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.097 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.097 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:31:36.097 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.098 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.098 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.098 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:31:36.098 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.098 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.099 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.099 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.099 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.099 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:31:36.100 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.100 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.100 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.100 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:31:36.100 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.101 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.101 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.101 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.101 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.102 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:31:36.102 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.102 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.102 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.102 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:31:36.103 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.103 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.103 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.103 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.104 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.104 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:31:36.104 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.104 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.104 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.105 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:31:36.105 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.105 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.105 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.105 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.106 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.106 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:31:36.106 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.106 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.107 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.107 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:31:36.107 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.107 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.108 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.108 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.108 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.108 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:31:36.108 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.109 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.109 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:36.109 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:31:36.109 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:36.110 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:36.110 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:36.110 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:36.110 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:36.110 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:31:36.111 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:36.111 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.111 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:36.111 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:31:36.112 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:31:36.112 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:31:36.112 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:31:36.112 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:31:36.112 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:31:36.113 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:31:36.113 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:31:36.113 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:31:36.113 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:31:36.113 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:31:36.114 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:31:36.114 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:31:36.114 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:36.114 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:36.115 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:31:36.115 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:31:36.115 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:31:36.115 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:31:36.116 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:31:36.116 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:31:36.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe47c0536a0 msgr2=0x7fe47c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe47c0536a0 0x7fe47c055b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe490008000 tx=0x7fe490009040).stop 2021-11-15T19:31:36.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 msgr2=0x7fe49c062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 0x7fe49c062bc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fe494001210 tx=0x7fe494008040).stop 2021-11-15T19:31:36.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 shutdown_connections 2021-11-15T19:31:36.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe47c0536a0 0x7fe47c055b60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe49c062710 0x7fe49c062bc0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe49c140130 0x7fe49c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 --2- 172.21.2.137:0/4168116223 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe484003e00 0x7fe49c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 >> 172.21.2.137:0/4168116223 conn(0x7fe49c0b4e60 msgr2=0x7fe49c0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:36.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 shutdown_connections 2021-11-15T19:31:36.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:35.868+0000 7fe4a3548700 1 -- 172.21.2.137:0/4168116223 wait complete. 2021-11-15T19:31:36.121 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:36.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 Processor -- start 2021-11-15T19:31:36.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 -- start start 2021-11-15T19:31:36.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe31405c770 0x7fe3140b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 0x7fe3140b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe314061680 con 0x7fe3140b2770 2021-11-15T19:31:36.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140b2bd0 con 0x7fe31405c770 2021-11-15T19:31:36.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe31a3db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31405cb50 con 0x7fe3140b2e10 2021-11-15T19:31:36.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe319bda700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe3140b2770 0x7fe3141475b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53434/0 (socket says 172.21.2.137:53434) 2021-11-15T19:31:36.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe319bda700 1 -- 172.21.2.137:0/1453753548 learned_addr learned my addr 172.21.2.137:0/1453753548 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:36.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571130590 0 0) 0x7fe314061680 con 0x7fe3140b2770 2021-11-15T19:31:36.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2fc003260 con 0x7fe3140b2770 2021-11-15T19:31:36.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.176+0000 7fe318bd8700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 0x7fe3140b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 --2- 172.21.2.137:0/1453753548 >> v2:172.21.2.111:3300/0 conn(0x7fe31405c770 0x7fe3140b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2714735049 0 0) 0x7fe2fc003260 con 0x7fe3140b2770 2021-11-15T19:31:36.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 msgr2=0x7fe3140b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 0x7fe3140b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 >> v2:172.21.2.111:3300/0 conn(0x7fe31405c770 msgr2=0x7fe3140b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 --2- 172.21.2.137:0/1453753548 >> v2:172.21.2.111:3300/0 conn(0x7fe31405c770 0x7fe3140b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31405d040 con 0x7fe3140b2770 2021-11-15T19:31:36.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe30c0019e0 con 0x7fe3140b2770 2021-11-15T19:31:36.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 >> v1:172.21.2.137:6789/0 conn(0x7fe3140b2770 legacy=0x7fe3141475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2fc0037d0 0x7fe2fc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 0x7fe2fc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0049f0 0x7fe2fc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140b2bd0 con 0x7fe2fc0049f0 2021-11-15T19:31:36.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31405cb50 con 0x7fe2fc0037d0 2021-11-15T19:31:36.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc00b880 con 0x7fe3140b2e10 2021-11-15T19:31:36.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2fc0037d0 0x7fe2fc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 -- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 msgr2=0x7fe2fc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140b2e10 0x7fe2fc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:36.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 -- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0049f0 msgr2=0x7fe2fc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0049f0 0x7fe2fc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:36.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 -- 172.21.2.137:0/1453753548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc003260 con 0x7fe2fc0037d0 2021-11-15T19:31:36.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2fc0037d0 0x7fe2fc003bf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fe30400a000 tx=0x7fe304008040).ready entity=mon.1 client_cookie=1e1b1c999379730d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:36.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304013670 con 0x7fe2fc0037d0 2021-11-15T19:31:36.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3040137d0 con 0x7fe2fc0037d0 2021-11-15T19:31:36.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe303fff700 1 -- 172.21.2.137:0/1453753548 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304013b30 con 0x7fe2fc0037d0 2021-11-15T19:31:36.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- 172.21.2.137:0/1453753548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2fc0037d0 msgr2=0x7fe2fc003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 --2- 172.21.2.137:0/1453753548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2fc0037d0 0x7fe2fc003bf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fe30400a000 tx=0x7fe304008040).stop 2021-11-15T19:31:36.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 -- 172.21.2.137:0/1453753548 reap_dead start 2021-11-15T19:31:36.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- 172.21.2.137:0/1453753548 shutdown_connections 2021-11-15T19:31:36.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- 172.21.2.137:0/1453753548 >> 172.21.2.137:0/1453753548 conn(0x7fe3140b4430 msgr2=0x7fe31405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:36.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- 172.21.2.137:0/1453753548 shutdown_connections 2021-11-15T19:31:36.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- 172.21.2.137:0/1453753548 wait complete. 2021-11-15T19:31:36.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 Processor -- start 2021-11-15T19:31:36.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- start start 2021-11-15T19:31:36.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0037d0 0x7fe31409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140ae9d0 0x7fe31409b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 0x7fe314155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314157600 con 0x7fe2fc0037d0 2021-11-15T19:31:36.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314157360 con 0x7fe314155910 2021-11-15T19:31:36.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe31a3db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140ae720 con 0x7fe3140ae9d0 2021-11-15T19:31:36.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 0x7fe314155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 0x7fe314155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34664/0 (socket says 172.21.2.137:34664) 2021-11-15T19:31:36.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 -- 172.21.2.137:0/3210661518 learned_addr learned my addr 172.21.2.137:0/3210661518 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:36.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3193d9700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0037d0 0x7fe31409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe318bd8700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140ae9d0 0x7fe31409b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 -- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140ae9d0 msgr2=0x7fe31409b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140ae9d0 0x7fe31409b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 -- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0037d0 msgr2=0x7fe31409aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0037d0 0x7fe31409aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 -- 172.21.2.137:0/3210661518 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314157090 con 0x7fe314155910 2021-11-15T19:31:36.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe318bd8700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140ae9d0 0x7fe31409b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:36.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe319bda700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 0x7fe314155dc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe30c001bc0 tx=0x7fe314067d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:36.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.180+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c004ab0 con 0x7fe314155910 2021-11-15T19:31:36.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c004c10 con 0x7fe314155910 2021-11-15T19:31:36.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c007170 con 0x7fe314155910 2021-11-15T19:31:36.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3141562b0 con 0x7fe314155910 2021-11-15T19:31:36.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe314159e30 con 0x7fe314155910 2021-11-15T19:31:36.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31414b3f0 con 0x7fe314155910 2021-11-15T19:31:36.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe30c0072d0 con 0x7fe314155910 2021-11-15T19:31:36.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3027fc700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2f4053580 0x7fe2f4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe30c06b4b0 con 0x7fe314155910 2021-11-15T19:31:36.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3193d9700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2f4053580 0x7fe2f4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3193d9700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2f4053580 0x7fe2f4055a40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe30401a000 tx=0x7fe304008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:36.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.184+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe30c042610 con 0x7fe314155910 2021-11-15T19:31:36.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3140573d0 con 0x7fe314155910 2021-11-15T19:31:36.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe3027fc700 1 -- 172.21.2.137:0/3210661518 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fe30c045c30 con 0x7fe314155910 2021-11-15T19:31:36.298 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:36.298 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:30:15.563899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1712485554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1712485554},{"type":"v1","addr":"172.21.2.137:6833","nonce":1712485554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:31:36.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2f4053580 msgr2=0x7fe2f4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2f4053580 0x7fe2f4055a40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe30401a000 tx=0x7fe304008040).stop 2021-11-15T19:31:36.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 msgr2=0x7fe314155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 0x7fe314155dc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe30c001bc0 tx=0x7fe314067d50).stop 2021-11-15T19:31:36.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 shutdown_connections 2021-11-15T19:31:36.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2f4053580 0x7fe2f4055a40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe314155910 0x7fe314155dc0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3140ae9d0 0x7fe31409b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 --2- 172.21.2.137:0/3210661518 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2fc0037d0 0x7fe31409aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 >> 172.21.2.137:0/3210661518 conn(0x7fe3140b4430 msgr2=0x7fe3141487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:36.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 shutdown_connections 2021-11-15T19:31:36.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.292+0000 7fe31a3db700 1 -- 172.21.2.137:0/3210661518 wait complete. 2021-11-15T19:31:36.302 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 20 2021-11-15T19:31:36.305 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:31:36.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 Processor -- start 2021-11-15T19:31:36.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- start start 2021-11-15T19:31:36.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc92c065730 0x7fc92c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c066270 con 0x7fc92c065b10 2021-11-15T19:31:36.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c065fd0 con 0x7fc92c0b00a0 2021-11-15T19:31:36.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c067410 con 0x7fc92c065730 2021-11-15T19:31:36.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc930941700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc92c0b00a0 0x7fc92c05bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53452/0 (socket says 172.21.2.137:53452) 2021-11-15T19:31:36.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc930941700 1 -- 172.21.2.137:0/3190641737 learned_addr learned my addr 172.21.2.137:0/3190641737 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:36.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445620326 0 0) 0x7fc92c065fd0 con 0x7fc92c0b00a0 2021-11-15T19:31:36.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc90c003260 con 0x7fc92c0b00a0 2021-11-15T19:31:36.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92bfff700 1 --2- 172.21.2.137:0/3190641737 >> v2:172.21.2.111:3300/0 conn(0x7fc92c065730 0x7fc92c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003125174 0 0) 0x7fc90c003260 con 0x7fc92c0b00a0 2021-11-15T19:31:36.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 >> v2:172.21.2.111:3300/0 conn(0x7fc92c065730 msgr2=0x7fc92c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 --2- 172.21.2.137:0/3190641737 >> v2:172.21.2.111:3300/0 conn(0x7fc92c065730 0x7fc92c13c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 >> v1:172.21.2.111:6789/0 conn(0x7fc92c065b10 legacy=0x7fc92c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c066f70 con 0x7fc92c0b00a0 2021-11-15T19:31:36.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fc9240019e0 con 0x7fc92c0b00a0 2021-11-15T19:31:36.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 >> v1:172.21.2.137:6789/0 conn(0x7fc92c0b00a0 legacy=0x7fc92c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc90c003750 0x7fc90c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc90c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc90c004e70 0x7fc90c00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c067410 con 0x7fc90c004e70 2021-11-15T19:31:36.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c00ce30 con 0x7fc90c004500 2021-11-15T19:31:36.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c00cff0 con 0x7fc90c003750 2021-11-15T19:31:36.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc90c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92bfff700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc90c003750 0x7fc90c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc930941700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc90c004e70 0x7fc90c00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 -- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc90c003750 msgr2=0x7fc90c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc90c003750 0x7fc90c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 -- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc90c004e70 msgr2=0x7fc90c00c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:36.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc90c004e70 0x7fc90c00c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 -- 172.21.2.137:0/3190641737 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c003260 con 0x7fc90c004500 2021-11-15T19:31:36.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc930941700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc90c004e70 0x7fc90c00c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:36.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc930941700 1 -- 172.21.2.137:0/3190641737 reap_dead start 2021-11-15T19:31:36.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92b7fe700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc90c004980 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fc92c0612c0 tx=0x7fc914007a00).ready entity=mon.1 client_cookie=9da63e7524069bb8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:36.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914007d10 con 0x7fc90c004500 2021-11-15T19:31:36.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914007030 con 0x7fc90c004500 2021-11-15T19:31:36.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc92affd700 1 -- 172.21.2.137:0/3190641737 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914007390 con 0x7fc90c004500 2021-11-15T19:31:36.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- 172.21.2.137:0/3190641737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 msgr2=0x7fc90c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc90c004980 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fc92c0612c0 tx=0x7fc914007a00).stop 2021-11-15T19:31:36.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- 172.21.2.137:0/3190641737 shutdown_connections 2021-11-15T19:31:36.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 --2- 172.21.2.137:0/3190641737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc90c004980 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:36.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- 172.21.2.137:0/3190641737 >> 172.21.2.137:0/3190641737 conn(0x7fc92c060290 msgr2=0x7fc92c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:36.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- 172.21.2.137:0/3190641737 shutdown_connections 2021-11-15T19:31:36.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.352+0000 7fc9323a4700 1 -- 172.21.2.137:0/3190641737 wait complete. 2021-11-15T19:31:36.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 Processor -- start 2021-11-15T19:31:36.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- start start 2021-11-15T19:31:36.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc92c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc92c0ace30 0x7fc92c142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc92c150420 0x7fc92c1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c14fd50 con 0x7fc92c150420 2021-11-15T19:31:36.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c1534e0 con 0x7fc90c004500 2021-11-15T19:31:36.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c14ff80 con 0x7fc92c0ace30 2021-11-15T19:31:36.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc92c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc92c0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34680/0 (socket says 172.21.2.137:34680) 2021-11-15T19:31:36.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 -- 172.21.2.137:0/870951119 learned_addr learned my addr 172.21.2.137:0/870951119 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:36.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 -- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc92c0ace30 msgr2=0x7fc92c142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc92c0ace30 0x7fc92c142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:36.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 -- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc92c150420 msgr2=0x7fc92c1508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:36.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc92c150420 0x7fc92c1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:36.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 -- 172.21.2.137:0/870951119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0ae270 con 0x7fc90c004500 2021-11-15T19:31:36.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92bfff700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc92c0add80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fc91c00b000 tx=0x7fc91c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:36.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c012610 con 0x7fc90c004500 2021-11-15T19:31:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c012770 con 0x7fc90c004500 2021-11-15T19:31:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c13b350 con 0x7fc90c004500 2021-11-15T19:31:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c012b10 con 0x7fc90c004500 2021-11-15T19:31:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c0aca30 con 0x7fc90c004500 2021-11-15T19:31:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c0b0fb0 con 0x7fc90c004500 2021-11-15T19:31:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc91c012c70 con 0x7fc90c004500 2021-11-15T19:31:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9297fa700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9100536a0 0x7fc910055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc91c06c2c0 con 0x7fc90c004500 2021-11-15T19:31:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92b7fe700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9100536a0 0x7fc910055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.356+0000 7fc92b7fe700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9100536a0 0x7fc910055b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fc92c0612c0 tx=0x7fc914013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.360+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc91c043420 con 0x7fc90c004500 2021-11-15T19:31:36.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:36.468+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc92c0573d0 con 0x7fc90c004500 2021-11-15T19:31:37.338 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:31:37.332+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:31:37.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9297fa700 1 -- 172.21.2.137:0/870951119 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc91c046a40 con 0x7fc90c004500 2021-11-15T19:31:37.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9100536a0 msgr2=0x7fc910055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9100536a0 0x7fc910055b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fc92c0612c0 tx=0x7fc914013000).stop 2021-11-15T19:31:37.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 msgr2=0x7fc92c0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc92c0add80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fc91c00b000 tx=0x7fc91c008040).stop 2021-11-15T19:31:37.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 shutdown_connections 2021-11-15T19:31:37.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9100536a0 0x7fc910055b60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc92c150420 0x7fc92c1508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc92c0ace30 0x7fc92c142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 --2- 172.21.2.137:0/870951119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc90c004500 0x7fc92c0add80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 >> 172.21.2.137:0/870951119 conn(0x7fc92c060290 msgr2=0x7fc92c0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:37.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 shutdown_connections 2021-11-15T19:31:37.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.348+0000 7fc9323a4700 1 -- 172.21.2.137:0/870951119 wait complete. 2021-11-15T19:31:37.357 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:31:37.360 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:37.371 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:31:37.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 Processor -- start 2021-11-15T19:31:37.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 -- start start 2021-11-15T19:31:37.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 0x7f3aa4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3aa40a9f50 0x7f3aa40aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa4148190 con 0x7f3aa4143f00 2021-11-15T19:31:37.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa40b1720 con 0x7f3aa40a9f50 2021-11-15T19:31:37.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aabe8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4147e70 con 0x7f3aa40b1340 2021-11-15T19:31:37.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa9428700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3aa4143f00 0x7f3aa4144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53486/0 (socket says 172.21.2.137:53486) 2021-11-15T19:31:37.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa9428700 1 -- 172.21.2.137:0/467062365 learned_addr learned my addr 172.21.2.137:0/467062365 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:37.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/467062365 >> v2:172.21.2.111:3300/0 conn(0x7f3aa40a9f50 0x7f3aa40aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591913247 0 0) 0x7f3a94001110 con 0x7f3aa4143f00 2021-11-15T19:31:37.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a8c003260 con 0x7f3aa4143f00 2021-11-15T19:31:37.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa9c29700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 0x7f3aa4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388488777 0 0) 0x7f3a8c003260 con 0x7f3aa4143f00 2021-11-15T19:31:37.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 msgr2=0x7f3aa4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:37.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 0x7f3aa4147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 >> v2:172.21.2.111:3300/0 conn(0x7f3aa40a9f50 msgr2=0x7f3aa40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:37.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 --2- 172.21.2.137:0/467062365 >> v2:172.21.2.111:3300/0 conn(0x7f3aa40a9f50 0x7f3aa40aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa40af800 con 0x7f3aa4143f00 2021-11-15T19:31:37.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3a940017f0 con 0x7f3aa4143f00 2021-11-15T19:31:37.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 >> v1:172.21.2.137:6789/0 conn(0x7f3aa4143f00 legacy=0x7f3aa4144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 0x7f3a8c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c003d50 0x7f3a8c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a8c0049f0 0x7f3a8c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40b1720 con 0x7f3a8c003d50 2021-11-15T19:31:37.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4147e70 con 0x7f3a8c0049f0 2021-11-15T19:31:37.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c00b780 con 0x7f3aa40b1340 2021-11-15T19:31:37.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a8c0049f0 0x7f3a8c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa9428700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c003d50 0x7f3a8c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 -- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 msgr2=0x7f3a8c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:37.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa40b1340 0x7f3a8c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 -- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c003d50 msgr2=0x7f3a8c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:37.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c003d50 0x7f3a8c004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 -- 172.21.2.137:0/467062365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c003260 con 0x7f3a8c0049f0 2021-11-15T19:31:37.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a8c0049f0 0x7f3a8c004e70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f3a9c00c000 tx=0x7f3a9c0091d0).ready entity=mon.1 client_cookie=e479986d44299300 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:37.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9c00e7e0 con 0x7f3a8c0049f0 2021-11-15T19:31:37.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00e940 con 0x7f3a8c0049f0 2021-11-15T19:31:37.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.408+0000 7f3aa8c27700 1 -- 172.21.2.137:0/467062365 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9c00eca0 con 0x7f3a8c0049f0 2021-11-15T19:31:37.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/467062365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a8c0049f0 msgr2=0x7f3a8c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/467062365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a8c0049f0 0x7f3a8c004e70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f3a9c00c000 tx=0x7f3a9c0091d0).stop 2021-11-15T19:31:37.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 -- 172.21.2.137:0/467062365 reap_dead start 2021-11-15T19:31:37.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/467062365 shutdown_connections 2021-11-15T19:31:37.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/467062365 >> 172.21.2.137:0/467062365 conn(0x7f3aa40b4e60 msgr2=0x7f3aa40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:37.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/467062365 shutdown_connections 2021-11-15T19:31:37.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/467062365 wait complete. 2021-11-15T19:31:37.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 Processor -- start 2021-11-15T19:31:37.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- start start 2021-11-15T19:31:37.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c0049f0 0x7f3aa415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa41453c0 0x7f3aa40aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 0x7f3aa4099f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4064330 con 0x7f3a8c0049f0 2021-11-15T19:31:37.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4159cb0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4159f50 con 0x7f3aa41453c0 2021-11-15T19:31:37.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 0x7f3aa4099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 0x7f3aa4099f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34714/0 (socket says 172.21.2.137:34714) 2021-11-15T19:31:37.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 -- 172.21.2.137:0/27858455 learned_addr learned my addr 172.21.2.137:0/27858455 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:37.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 -- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa41453c0 msgr2=0x7f3aa40aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa41453c0 0x7f3aa40aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 -- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c0049f0 msgr2=0x7f3aa415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c0049f0 0x7f3aa415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 -- 172.21.2.137:0/27858455 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa415a1f0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aaa42a700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 0x7f3aa4099f00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f3aa4097550 tx=0x7f3a9c01a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:37.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9c009600 con 0x7f3aa4063eb0 2021-11-15T19:31:37.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00eed0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa409a3f0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9c01b830 con 0x7f3aa4063eb0 2021-11-15T19:31:37.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa409a8a0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa405faf0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a9c01b990 con 0x7f3aa4063eb0 2021-11-15T19:31:37.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3a92ffd700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a84053660 0x7f3a84055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f3a9c06d940 con 0x7f3aa4063eb0 2021-11-15T19:31:37.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.412+0000 7f3aa9c29700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a84053660 0x7f3a84055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.416+0000 7f3aa9c29700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a84053660 0x7f3a84055b20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f3aa000c000 tx=0x7f3aa0006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:37.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.416+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a9c044940 con 0x7f3aa4063eb0 2021-11-15T19:31:37.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.524+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aa40573d0 con 0x7f3aa4063eb0 2021-11-15T19:31:37.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.524+0000 7f3a92ffd700 1 -- 172.21.2.137:0/27858455 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1778 (secure 0 0 0) 0x7f3a9c016020 con 0x7f3aa4063eb0 2021-11-15T19:31:37.530 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:37.531 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:30:14.557279+0000","modified":"2021-11-15T19:31:37.336945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T19:31:37.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a84053660 msgr2=0x7f3a84055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a84053660 0x7f3a84055b20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f3aa000c000 tx=0x7f3aa0006df0).stop 2021-11-15T19:31:37.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 msgr2=0x7f3aa4099f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 0x7f3aa4099f00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f3aa4097550 tx=0x7f3a9c01a000).stop 2021-11-15T19:31:37.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 shutdown_connections 2021-11-15T19:31:37.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a84053660 0x7f3a84055b20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3aa4063eb0 0x7f3aa4099f00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3aa41453c0 0x7f3aa40aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 --2- 172.21.2.137:0/27858455 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a8c0049f0 0x7f3aa415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 >> 172.21.2.137:0/27858455 conn(0x7f3aa40b4e60 msgr2=0x7f3aa414abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:37.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 shutdown_connections 2021-11-15T19:31:37.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.528+0000 7f3aabe8d700 1 -- 172.21.2.137:0/27858455 wait complete. 2021-11-15T19:31:37.535 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 21 2021-11-15T19:31:37.537 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:31:37.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 Processor -- start 2021-11-15T19:31:37.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 -- start start 2021-11-15T19:31:37.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f27d00b0550 0x7f27d014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f27d014aaa0 0x7f27d0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d005cb50 con 0x7f27d005c770 2021-11-15T19:31:37.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00b1650 con 0x7f27d00b0550 2021-11-15T19:31:37.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27d501f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00ad030 con 0x7f27d014aaa0 2021-11-15T19:31:37.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f27d014aaa0 0x7f27d0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f27d014aaa0 0x7f27d0140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34722/0 (socket says 172.21.2.137:34722) 2021-11-15T19:31:37.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 -- 172.21.2.137:0/2112907185 learned_addr learned my addr 172.21.2.137:0/2112907185 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:37.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27ce59c700 1 --2- 172.21.2.137:0/2112907185 >> v2:172.21.2.111:3300/0 conn(0x7f27d00b0550 0x7f27d014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 -- 172.21.2.137:0/2112907185 >> v2:172.21.2.111:3300/0 conn(0x7f27d00b0550 msgr2=0x7f27d014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:37.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 --2- 172.21.2.137:0/2112907185 >> v2:172.21.2.111:3300/0 conn(0x7f27d00b0550 0x7f27d014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 -- 172.21.2.137:0/2112907185 >> v1:172.21.2.111:6789/0 conn(0x7f27d005c770 legacy=0x7f27d00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:37.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 -- 172.21.2.137:0/2112907185 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00ad2d0 con 0x7f27d014aaa0 2021-11-15T19:31:37.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cf59e700 1 --2- 172.21.2.137:0/2112907185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d014aaa0 0x7f27d0140aa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f27d00aee10 tx=0x7f27c8009290).ready entity=mon.1 client_cookie=69fb0f199b4e1ed3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:37.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cdd9b700 1 -- 172.21.2.137:0/2112907185 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c800b830 con 0x7f27d014aaa0 2021-11-15T19:31:37.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cdd9b700 1 -- 172.21.2.137:0/2112907185 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800b990 con 0x7f27d014aaa0 2021-11-15T19:31:37.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.584+0000 7f27cdd9b700 1 -- 172.21.2.137:0/2112907185 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c800bb40 con 0x7f27d014aaa0 2021-11-15T19:31:37.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/2112907185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d014aaa0 msgr2=0x7f27d0140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 --2- 172.21.2.137:0/2112907185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d014aaa0 0x7f27d0140aa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f27d00aee10 tx=0x7f27c8009290).stop 2021-11-15T19:31:37.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/2112907185 shutdown_connections 2021-11-15T19:31:37.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 --2- 172.21.2.137:0/2112907185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d014aaa0 0x7f27d0140aa0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 --2- 172.21.2.137:0/2112907185 >> v2:172.21.2.111:3300/0 conn(0x7f27d00b0550 0x7f27d014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:37.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/2112907185 >> 172.21.2.137:0/2112907185 conn(0x7f27d00631e0 msgr2=0x7f27d005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:37.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/2112907185 shutdown_connections 2021-11-15T19:31:37.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/2112907185 wait complete. 2021-11-15T19:31:37.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 Processor -- start 2021-11-15T19:31:37.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- start start 2021-11-15T19:31:37.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27d005c770 0x7f27d01563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 0x7f27d0063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27d014aaa0 0x7f27d0146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01418b0 con 0x7f27d005c770 2021-11-15T19:31:37.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0066e10 con 0x7f27d00b0550 2021-11-15T19:31:37.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0066740 con 0x7f27d014aaa0 2021-11-15T19:31:37.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 0x7f27d0063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 0x7f27d0063aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34730/0 (socket says 172.21.2.137:34730) 2021-11-15T19:31:37.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 -- 172.21.2.137:0/1672707300 learned_addr learned my addr 172.21.2.137:0/1672707300 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:37.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 -- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27d014aaa0 msgr2=0x7f27d0146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27d014aaa0 0x7f27d0146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 -- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27d005c770 msgr2=0x7f27d01563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:37.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27d005c770 0x7f27d01563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:37.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 -- 172.21.2.137:0/1672707300 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009530 con 0x7f27d00b0550 2021-11-15T19:31:37.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27ce59c700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 0x7f27d0063aa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f27c0007000 tx=0x7f27c0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:37.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c000f5b0 con 0x7f27d00b0550 2021-11-15T19:31:37.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000c030 con 0x7f27d00b0550 2021-11-15T19:31:37.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d0066380 con 0x7f27d00b0550 2021-11-15T19:31:37.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0142660 con 0x7f27d00b0550 2021-11-15T19:31:37.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c000f900 con 0x7f27d00b0550 2021-11-15T19:31:37.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0064b10 con 0x7f27d00b0550 2021-11-15T19:31:37.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27c0019030 con 0x7f27d00b0550 2021-11-15T19:31:37.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27c7fff700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f27b40536f0 0x7f27b4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:37.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.588+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f27c006b2e0 con 0x7f27d00b0550 2021-11-15T19:31:37.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.592+0000 7f27ced9d700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f27b40536f0 0x7f27b4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:37.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.592+0000 7f27ced9d700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f27b40536f0 0x7f27b4055bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f27b8002ef0 tx=0x7f27b8006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:37.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.592+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27d0064b10 con 0x7f27d00b0550 2021-11-15T19:31:37.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:37.700+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f27d0064b10 con 0x7f27d00b0550 2021-11-15T19:31:38.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27c7fff700 1 -- 172.21.2.137:0/1672707300 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f27d0064b10 con 0x7f27d00b0550 2021-11-15T19:31:38.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f27b40536f0 msgr2=0x7f27b4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:38.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f27b40536f0 0x7f27b4055bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f27b8002ef0 tx=0x7f27b8006910).stop 2021-11-15T19:31:38.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 msgr2=0x7f27d0063aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:38.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 0x7f27d0063aa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f27c0007000 tx=0x7f27c0008040).stop 2021-11-15T19:31:38.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 shutdown_connections 2021-11-15T19:31:38.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f27b40536f0 0x7f27b4055bb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:38.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f27d014aaa0 0x7f27d0146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f27d00b0550 0x7f27d0063aa0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:38.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 --2- 172.21.2.137:0/1672707300 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f27d005c770 0x7f27d01563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 >> 172.21.2.137:0/1672707300 conn(0x7f27d00631e0 msgr2=0x7f27d00b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:38.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 shutdown_connections 2021-11-15T19:31:38.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.356+0000 7f27d501f700 1 -- 172.21.2.137:0/1672707300 wait complete. 2021-11-15T19:31:38.367 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:31:38.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 Processor -- start 2021-11-15T19:31:38.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 -- start start 2021-11-15T19:31:38.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0acab0 0x7f4cfc0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4cfc0b1180 0x7f4cfc0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4cfc0af2f0 0x7f4cfc142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0aecf0 con 0x7f4cfc0af2f0 2021-11-15T19:31:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc13f180 con 0x7f4cfc0b1180 2021-11-15T19:31:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d03f55700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0aef20 con 0x7f4cfc0acab0 2021-11-15T19:31:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4cfc0b1180 0x7f4cfc0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:38.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4cfc0b1180 0x7f4cfc0b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34738/0 (socket says 172.21.2.137:34738) 2021-11-15T19:31:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 -- 172.21.2.137:0/1800987386 learned_addr learned my addr 172.21.2.137:0/1800987386 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 -- 172.21.2.137:0/1800987386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0acab0 msgr2=0x7f4cfc0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 --2- 172.21.2.137:0/1800987386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0acab0 0x7f4cfc0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 -- 172.21.2.137:0/1800987386 >> v2:172.21.2.111:3300/0 conn(0x7f4cfc0af2f0 msgr2=0x7f4cfc142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 --2- 172.21.2.137:0/1800987386 >> v2:172.21.2.111:3300/0 conn(0x7f4cfc0af2f0 0x7f4cfc142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 -- 172.21.2.137:0/1800987386 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0ace90 con 0x7f4cfc0b1180 2021-11-15T19:31:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d014f0700 1 --2- 172.21.2.137:0/1800987386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0b1180 0x7f4cfc0b2550 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4cf8002f70 tx=0x7f4cf8006f40).ready entity=mon.1 client_cookie=97721f042cdeabb1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d00cef700 1 -- 172.21.2.137:0/1800987386 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf800c900 con 0x7f4cfc0b1180 2021-11-15T19:31:38.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d00cef700 1 -- 172.21.2.137:0/1800987386 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8000e90 con 0x7f4cfc0b1180 2021-11-15T19:31:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.416+0000 7f4d00cef700 1 -- 172.21.2.137:0/1800987386 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf800cc90 con 0x7f4cfc0b1180 2021-11-15T19:31:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/1800987386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0b1180 msgr2=0x7f4cfc0b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- 172.21.2.137:0/1800987386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0b1180 0x7f4cfc0b2550 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4cf8002f70 tx=0x7f4cf8006f40).stop 2021-11-15T19:31:38.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/1800987386 shutdown_connections 2021-11-15T19:31:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- 172.21.2.137:0/1800987386 >> v2:172.21.2.111:3300/0 conn(0x7f4cfc0af2f0 0x7f4cfc142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- 172.21.2.137:0/1800987386 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0b1180 0x7f4cfc0b2550 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- 172.21.2.137:0/1800987386 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0acab0 0x7f4cfc0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/1800987386 >> 172.21.2.137:0/1800987386 conn(0x7f4cfc0630f0 msgr2=0x7f4cfc0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:38.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/1800987386 shutdown_connections 2021-11-15T19:31:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/1800987386 wait complete. 2021-11-15T19:31:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 Processor -- start 2021-11-15T19:31:38.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- start start 2021-11-15T19:31:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 0x7f4cfc112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0af2f0 0x7f4cfc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4cfc0b1180 0x7f4cfc156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc156d10 con 0x7f4cfc0b1180 2021-11-15T19:31:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc10ec70 con 0x7f4cfc0acab0 2021-11-15T19:31:38.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc156f00 con 0x7f4cfc0af2f0 2021-11-15T19:31:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 0x7f4cfc112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 0x7f4cfc112150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34740/0 (socket says 172.21.2.137:34740) 2021-11-15T19:31:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 -- 172.21.2.137:0/121935477 learned_addr learned my addr 172.21.2.137:0/121935477 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 -- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0af2f0 msgr2=0x7f4cfc156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:38.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0af2f0 0x7f4cfc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 -- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4cfc0b1180 msgr2=0x7f4cfc156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:38.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4cfc0b1180 0x7f4cfc156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:38.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 -- 172.21.2.137:0/121935477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf800a360 con 0x7f4cfc0acab0 2021-11-15T19:31:38.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d01cf1700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 0x7f4cfc112150 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f4cfc111700 tx=0x7f4cf0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:38.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf0013460 con 0x7f4cfc0acab0 2021-11-15T19:31:38.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf00135c0 con 0x7f4cfc0acab0 2021-11-15T19:31:38.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf0013920 con 0x7f4cfc0acab0 2021-11-15T19:31:38.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc1571a0 con 0x7f4cfc0acab0 2021-11-15T19:31:38.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc13fae0 con 0x7f4cfc0acab0 2021-11-15T19:31:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc10ea90 con 0x7f4cfc0acab0 2021-11-15T19:31:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4cf000f070 con 0x7f4cfc0acab0 2021-11-15T19:31:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4ceeffd700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4cdc053610 0x7f4cdc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.420+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f4cf006b360 con 0x7f4cfc0acab0 2021-11-15T19:31:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.424+0000 7f4d014f0700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4cdc053610 0x7f4cdc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:38.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.424+0000 7f4d014f0700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4cdc053610 0x7f4cdc055ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f4cf8002f70 tx=0x7f4cf8006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:38.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.424+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4cf0042470 con 0x7f4cfc0acab0 2021-11-15T19:31:38.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:38.508+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4cfc0b1820 con 0x7f4cfc0acab0 2021-11-15T19:31:39.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4ceeffd700 1 -- 172.21.2.137:0/121935477 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4cf0045a90 con 0x7f4cfc0acab0 2021-11-15T19:31:39.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4cdc053610 msgr2=0x7f4cdc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:39.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4cdc053610 0x7f4cdc055ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f4cf8002f70 tx=0x7f4cf8006f40).stop 2021-11-15T19:31:39.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 msgr2=0x7f4cfc112150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:39.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 0x7f4cfc112150 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f4cfc111700 tx=0x7f4cf0006ec0).stop 2021-11-15T19:31:39.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 shutdown_connections 2021-11-15T19:31:39.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4cdc053610 0x7f4cdc055ad0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:39.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4cfc0b1180 0x7f4cfc156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:39.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4cfc0af2f0 0x7f4cfc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:39.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 --2- 172.21.2.137:0/121935477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4cfc0acab0 0x7f4cfc112150 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:39.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 >> 172.21.2.137:0/121935477 conn(0x7f4cfc0630f0 msgr2=0x7f4cfc13e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:39.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 shutdown_connections 2021-11-15T19:31:39.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.360+0000 7f4d03f55700 1 -- 172.21.2.137:0/121935477 wait complete. 2021-11-15T19:31:39.369 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:31:39.372 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:31:39.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 Processor -- start 2021-11-15T19:31:39.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- start start 2021-11-15T19:31:39.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f963405fd20 0x7f96340af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:39.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9634147f70 con 0x7f96340b0830 2021-11-15T19:31:39.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9634060100 con 0x7f96340b10b0 2021-11-15T19:31:39.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9634147cd0 con 0x7f963405fd20 2021-11-15T19:31:39.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963936b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f96340b10b0 0x7f96340b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53534/0 (socket says 172.21.2.137:53534) 2021-11-15T19:31:39.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963936b700 1 -- 172.21.2.137:0/2190109661 learned_addr learned my addr 172.21.2.137:0/2190109661 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:39.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9639b6c700 1 --2- 172.21.2.137:0/2190109661 >> v2:172.21.2.137:3300/0 conn(0x7f963405fd20 0x7f96340af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:39.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9639b6c700 1 -- 172.21.2.137:0/2190109661 >> v1:172.21.2.137:6789/0 conn(0x7f96340b10b0 legacy=0x7f96340b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:39.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9639b6c700 1 -- 172.21.2.137:0/2190109661 >> v1:172.21.2.111:6789/0 conn(0x7f96340b0830 legacy=0x7f96340aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:39.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9639b6c700 1 -- 172.21.2.137:0/2190109661 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340a9ed0 con 0x7f963405fd20 2021-11-15T19:31:39.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9639b6c700 1 --2- 172.21.2.137:0/2190109661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f963405fd20 0x7f96340af800 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f96340b4db0 tx=0x7f9630006df0).ready entity=mon.1 client_cookie=7e6af0b1441631ba server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:39.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9638b6a700 1 -- 172.21.2.137:0/2190109661 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f963000d5c0 con 0x7f963405fd20 2021-11-15T19:31:39.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9638b6a700 1 -- 172.21.2.137:0/2190109661 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9630000e90 con 0x7f963405fd20 2021-11-15T19:31:39.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f9638b6a700 1 -- 172.21.2.137:0/2190109661 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f963000d910 con 0x7f963405fd20 2021-11-15T19:31:39.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- 172.21.2.137:0/2190109661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f963405fd20 msgr2=0x7f96340af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:39.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 --2- 172.21.2.137:0/2190109661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f963405fd20 0x7f96340af800 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f96340b4db0 tx=0x7f9630006df0).stop 2021-11-15T19:31:39.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- 172.21.2.137:0/2190109661 shutdown_connections 2021-11-15T19:31:39.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 --2- 172.21.2.137:0/2190109661 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f963405fd20 0x7f96340af800 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:39.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- 172.21.2.137:0/2190109661 >> 172.21.2.137:0/2190109661 conn(0x7f96340b4e60 msgr2=0x7f96340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:39.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- 172.21.2.137:0/2190109661 shutdown_connections 2021-11-15T19:31:39.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.424+0000 7f963bdd0700 1 -- 172.21.2.137:0/2190109661 wait complete. 2021-11-15T19:31:39.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 Processor -- start 2021-11-15T19:31:39.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- start start 2021-11-15T19:31:39.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f963405fd20 0x7f9634156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:39.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96340b0830 0x7f9634142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:39.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 0x7f9634157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:39.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96341409e0 con 0x7f963405fd20 2021-11-15T19:31:39.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340631d0 con 0x7f96340b10b0 2021-11-15T19:31:39.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9634062c90 con 0x7f96340b0830 2021-11-15T19:31:39.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 0x7f9634157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:39.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 0x7f9634157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34756/0 (socket says 172.21.2.137:34756) 2021-11-15T19:31:39.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 -- 172.21.2.137:0/1140634556 learned_addr learned my addr 172.21.2.137:0/1140634556 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:39.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 -- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96340b0830 msgr2=0x7f9634142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:39.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96340b0830 0x7f9634142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:39.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 -- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f963405fd20 msgr2=0x7f9634156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:39.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f963405fd20 0x7f9634156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:39.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 -- 172.21.2.137:0/1140634556 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963000b180 con 0x7f96340b10b0 2021-11-15T19:31:39.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963a36d700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 0x7f9634157020 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f962c003310 tx=0x7f962c009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:39.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f962c001500 con 0x7f96340b10b0 2021-11-15T19:31:39.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c001660 con 0x7f96340b10b0 2021-11-15T19:31:39.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9634062f90 con 0x7f96340b10b0 2021-11-15T19:31:39.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9634143a30 con 0x7f96340b10b0 2021-11-15T19:31:39.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f962c0019c0 con 0x7f96340b10b0 2021-11-15T19:31:39.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9634063df0 con 0x7f96340b10b0 2021-11-15T19:31:39.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f962c018030 con 0x7f96340b10b0 2021-11-15T19:31:39.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f9622ffd700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96140535d0 0x7f9614055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:39.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.428+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f962c06b100 con 0x7f96340b10b0 2021-11-15T19:31:39.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.432+0000 7f9639b6c700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96140535d0 0x7f9614055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:39.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.432+0000 7f9639b6c700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96140535d0 0x7f9614055a90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f96340b4db0 tx=0x7f9630012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:39.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.432+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f962c042360 con 0x7f96340b10b0 2021-11-15T19:31:39.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:39.516+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96341479f0 con 0x7f96340b10b0 2021-11-15T19:31:40.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.368+0000 7f9622ffd700 1 -- 172.21.2.137:0/1140634556 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 173+0+0 (secure 0 0 0) 0x7f962c016020 con 0x7f96340b10b0 2021-11-15T19:31:40.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96140535d0 msgr2=0x7f9614055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96140535d0 0x7f9614055a90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f96340b4db0 tx=0x7f9630012000).stop 2021-11-15T19:31:40.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 msgr2=0x7f9634157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 0x7f9634157020 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f962c003310 tx=0x7f962c009120).stop 2021-11-15T19:31:40.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 shutdown_connections 2021-11-15T19:31:40.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96140535d0 0x7f9614055a90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96340b10b0 0x7f9634157020 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96340b0830 0x7f9634142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 --2- 172.21.2.137:0/1140634556 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f963405fd20 0x7f9634156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 >> 172.21.2.137:0/1140634556 conn(0x7f96340b4e60 msgr2=0x7f9634099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 shutdown_connections 2021-11-15T19:31:40.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.372+0000 7f963bdd0700 1 -- 172.21.2.137:0/1140634556 wait complete. 2021-11-15T19:31:40.379 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:31:40.383 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:31:40.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 Processor -- start 2021-11-15T19:31:40.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- start start 2021-11-15T19:31:40.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fce640b0550 0x7fce6414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6405cb50 con 0x7fce6405c770 2021-11-15T19:31:40.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce640ad030 con 0x7fce6414aaa0 2021-11-15T19:31:40.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640b1650 con 0x7fce640b0550 2021-11-15T19:31:40.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fce6414aaa0 0x7fce64140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53546/0 (socket says 172.21.2.137:53546) 2021-11-15T19:31:40.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 -- 172.21.2.137:0/1359598630 learned_addr learned my addr 172.21.2.137:0/1359598630 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:40.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123896189 0 0) 0x7fce640ad030 con 0x7fce6414aaa0 2021-11-15T19:31:40.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce44003260 con 0x7fce6414aaa0 2021-11-15T19:31:40.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce62ffd700 1 --2- 172.21.2.137:0/1359598630 >> v2:172.21.2.111:3300/0 conn(0x7fce640b0550 0x7fce6414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332152019 0 0) 0x7fce44003260 con 0x7fce6414aaa0 2021-11-15T19:31:40.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 >> v2:172.21.2.111:3300/0 conn(0x7fce640b0550 msgr2=0x7fce6414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 --2- 172.21.2.137:0/1359598630 >> v2:172.21.2.111:3300/0 conn(0x7fce640b0550 0x7fce6414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 >> v1:172.21.2.111:6789/0 conn(0x7fce6405c770 legacy=0x7fce640aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640ad2d0 con 0x7fce6414aaa0 2021-11-15T19:31:40.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fce5c0019e0 con 0x7fce6414aaa0 2021-11-15T19:31:40.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 >> v1:172.21.2.137:6789/0 conn(0x7fce6414aaa0 legacy=0x7fce64140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44003820 0x7fce44003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce44004500 0x7fce44004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce44004f70 0x7fce4400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640b1650 con 0x7fce44003820 2021-11-15T19:31:40.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4400be50 con 0x7fce44004f70 2021-11-15T19:31:40.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4400c010 con 0x7fce44004500 2021-11-15T19:31:40.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce44004f70 0x7fce4400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 -- 172.21.2.137:0/1359598630 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce44004500 msgr2=0x7fce44004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce44004500 0x7fce44004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 -- 172.21.2.137:0/1359598630 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44003820 msgr2=0x7fce44003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44003820 0x7fce44003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 -- 172.21.2.137:0/1359598630 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44003260 con 0x7fce44004f70 2021-11-15T19:31:40.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 -- 172.21.2.137:0/1359598630 reap_dead start 2021-11-15T19:31:40.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce63fff700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce44004f70 0x7fce4400b750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fce640aee10 tx=0x7fce64146fe0).ready entity=mon.1 client_cookie=4fb1c938835d6c2d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:40.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5c00cc60 con 0x7fce44004f70 2021-11-15T19:31:40.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00cdc0 con 0x7fce44004f70 2021-11-15T19:31:40.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce627fc700 1 -- 172.21.2.137:0/1359598630 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5c005b80 con 0x7fce44004f70 2021-11-15T19:31:40.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- 172.21.2.137:0/1359598630 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce44004f70 msgr2=0x7fce4400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce44004f70 0x7fce4400b750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fce640aee10 tx=0x7fce64146fe0).stop 2021-11-15T19:31:40.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- 172.21.2.137:0/1359598630 shutdown_connections 2021-11-15T19:31:40.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1359598630 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce44004f70 0x7fce4400b750 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- 172.21.2.137:0/1359598630 >> 172.21.2.137:0/1359598630 conn(0x7fce640631e0 msgr2=0x7fce6405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:40.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- 172.21.2.137:0/1359598630 shutdown_connections 2021-11-15T19:31:40.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 -- 172.21.2.137:0/1359598630 wait complete. 2021-11-15T19:31:40.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.436+0000 7fce6a11b700 1 Processor -- start 2021-11-15T19:31:40.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- start start 2021-11-15T19:31:40.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44004f70 0x7fce64067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 0x7fce640654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce64116ad0 0x7fce6413f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640649c0 con 0x7fce44004f70 2021-11-15T19:31:40.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64063aa0 con 0x7fce64156f50 2021-11-15T19:31:40.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce64064bf0 con 0x7fce64116ad0 2021-11-15T19:31:40.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 0x7fce640654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 0x7fce640654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34778/0 (socket says 172.21.2.137:34778) 2021-11-15T19:31:40.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 -- 172.21.2.137:0/1166074898 learned_addr learned my addr 172.21.2.137:0/1166074898 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:40.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 -- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce64116ad0 msgr2=0x7fce6413f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce64116ad0 0x7fce6413f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 -- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44004f70 msgr2=0x7fce64067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44004f70 0x7fce64067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 -- 172.21.2.137:0/1166074898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64063800 con 0x7fce64156f50 2021-11-15T19:31:40.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce62ffd700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 0x7fce640654a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fce5400a000 tx=0x7fce54008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:40.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54011500 con 0x7fce64156f50 2021-11-15T19:31:40.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54000e90 con 0x7fce64156f50 2021-11-15T19:31:40.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54011850 con 0x7fce64156f50 2021-11-15T19:31:40.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6414a640 con 0x7fce64156f50 2021-11-15T19:31:40.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce640674f0 con 0x7fce64156f50 2021-11-15T19:31:40.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640ae7f0 con 0x7fce64156f50 2021-11-15T19:31:40.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce54019020 con 0x7fce64156f50 2021-11-15T19:31:40.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce60ff9700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce480536a0 0x7fce48055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fce5406af40 con 0x7fce64156f50 2021-11-15T19:31:40.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.440+0000 7fce637fe700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce480536a0 0x7fce48055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.444+0000 7fce637fe700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce480536a0 0x7fce48055b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fce4c001fa0 tx=0x7fce4c0077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:40.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.444+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce54042270 con 0x7fce64156f50 2021-11-15T19:31:40.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.528+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fce640573d0 con 0x7fce64156f50 2021-11-15T19:31:40.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce60ff9700 1 -- 172.21.2.137:0/1166074898 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce54045890 con 0x7fce64156f50 2021-11-15T19:31:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce480536a0 msgr2=0x7fce48055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce480536a0 0x7fce48055b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fce4c001fa0 tx=0x7fce4c0077f0).stop 2021-11-15T19:31:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 msgr2=0x7fce640654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 0x7fce640654a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fce5400a000 tx=0x7fce54008040).stop 2021-11-15T19:31:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 shutdown_connections 2021-11-15T19:31:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce480536a0 0x7fce48055b60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce64116ad0 0x7fce6413f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce64156f50 0x7fce640654a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 --2- 172.21.2.137:0/1166074898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce44004f70 0x7fce64067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 >> 172.21.2.137:0/1166074898 conn(0x7fce640631e0 msgr2=0x7fce640b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 shutdown_connections 2021-11-15T19:31:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.544+0000 7fce6a11b700 1 -- 172.21.2.137:0/1166074898 wait complete. 2021-11-15T19:31:40.555 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-11-15T19:31:40.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c27369700 1 Processor -- start 2021-11-15T19:31:40.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c27369700 1 -- start start 2021-11-15T19:31:40.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c27369700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6c200b26d0 0x7f6c20141560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c27369700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200b18f0 con 0x7f6c2005c770 2021-11-15T19:31:40.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c27369700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2005cb50 con 0x7f6c200ac900 2021-11-15T19:31:40.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c27369700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200acd90 con 0x7f6c200b26d0 2021-11-15T19:31:40.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c25b66700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6c200ac900 0x7f6c20140e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53566/0 (socket says 172.21.2.137:53566) 2021-11-15T19:31:40.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c25b66700 1 -- 172.21.2.137:0/2276714536 learned_addr learned my addr 172.21.2.137:0/2276714536 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:40.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.600+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304061465 0 0) 0x7f6c2005cb50 con 0x7f6c200ac900 2021-11-15T19:31:40.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c08003260 con 0x7f6c200ac900 2021-11-15T19:31:40.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2146147250 0 0) 0x7f6c08003260 con 0x7f6c200ac900 2021-11-15T19:31:40.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 >> v2:172.21.2.111:3300/0 conn(0x7f6c200b26d0 msgr2=0x7f6c20141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 --2- 172.21.2.137:0/2276714536 >> v2:172.21.2.111:3300/0 conn(0x7f6c200b26d0 0x7f6c20141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 >> v1:172.21.2.111:6789/0 conn(0x7f6c2005c770 legacy=0x7f6c200b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200b2b40 con 0x7f6c200ac900 2021-11-15T19:31:40.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6c10001660 con 0x7f6c200ac900 2021-11-15T19:31:40.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 >> v1:172.21.2.137:6789/0 conn(0x7f6c200ac900 legacy=0x7f6c20140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c08003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c08004500 0x7f6c08004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c08005050 0x7f6c0800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200acd90 con 0x7f6c08005050 2021-11-15T19:31:40.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08010350 con 0x7f6c08003820 2021-11-15T19:31:40.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08010510 con 0x7f6c08004500 2021-11-15T19:31:40.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c08003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/2276714536 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c08004500 msgr2=0x7f6c08004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c08004500 0x7f6c08004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/2276714536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c08005050 msgr2=0x7f6c0800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:40.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c08005050 0x7f6c0800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:40.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/2276714536 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08003260 con 0x7f6c08003820 2021-11-15T19:31:40.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26b68700 1 -- 172.21.2.137:0/2276714536 reap_dead start 2021-11-15T19:31:40.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c08003c20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f6c1c000f70 tx=0x7f6c1c0079e0).ready entity=mon.1 client_cookie=b51499bfe2a4786f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:40.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1c007cf0 con 0x7f6c08003820 2021-11-15T19:31:40.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c014410 con 0x7f6c08003820 2021-11-15T19:31:40.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25365700 1 -- 172.21.2.137:0/2276714536 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1c014770 con 0x7f6c08003820 2021-11-15T19:31:40.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- 172.21.2.137:0/2276714536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 msgr2=0x7f6c08003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c08003c20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f6c1c000f70 tx=0x7f6c1c0079e0).stop 2021-11-15T19:31:40.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- 172.21.2.137:0/2276714536 shutdown_connections 2021-11-15T19:31:40.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 --2- 172.21.2.137:0/2276714536 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c08003c20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- 172.21.2.137:0/2276714536 >> 172.21.2.137:0/2276714536 conn(0x7f6c200b4430 msgr2=0x7f6c2005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:40.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- 172.21.2.137:0/2276714536 shutdown_connections 2021-11-15T19:31:40.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- 172.21.2.137:0/2276714536 wait complete. 2021-11-15T19:31:40.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 Processor -- start 2021-11-15T19:31:40.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- start start 2021-11-15T19:31:40.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c20156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c20099050 0x7f6c2009c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c2015a0e0 0x7f6c2015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2015aa50 con 0x7f6c20099050 2021-11-15T19:31:40.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20157770 con 0x7f6c08003820 2021-11-15T19:31:40.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c27369700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20099940 con 0x7f6c2015a0e0 2021-11-15T19:31:40.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c20156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c20156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34796/0 (socket says 172.21.2.137:34796) 2021-11-15T19:31:40.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/4170243734 learned_addr learned my addr 172.21.2.137:0/4170243734 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:40.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c25b66700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c20099050 0x7f6c2009c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26b68700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c2015a0e0 0x7f6c2015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c2015a0e0 msgr2=0x7f6c2015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c2015a0e0 0x7f6c2015a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c20099050 msgr2=0x7f6c2009c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:40.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c20099050 0x7f6c2009c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:40.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 -- 172.21.2.137:0/4170243734 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20159c40 con 0x7f6c08003820 2021-11-15T19:31:40.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.604+0000 7f6c26367700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c20156570 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6c200b0180 tx=0x7f6c1c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:40.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1c0138c0 con 0x7f6c08003820 2021-11-15T19:31:40.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c013a20 con 0x7f6c08003820 2021-11-15T19:31:40.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c20156a60 con 0x7f6c08003820 2021-11-15T19:31:40.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1c013d80 con 0x7f6c08003820 2021-11-15T19:31:40.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c200995c0 con 0x7f6c08003820 2021-11-15T19:31:40.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c20099b40 con 0x7f6c08003820 2021-11-15T19:31:40.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c1c022470 con 0x7f6c08003820 2021-11-15T19:31:40.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c000536a0 0x7f6c00055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:40.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6c1c01c040 con 0x7f6c08003820 2021-11-15T19:31:40.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c25b66700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c000536a0 0x7f6c00055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:40.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c25b66700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c000536a0 0x7f6c00055b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f6c1000b000 tx=0x7f6c10001920).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:40.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.608+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c1c043c70 con 0x7f6c08003820 2021-11-15T19:31:40.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:40.724+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f6c20159dd0 con 0x7f6c08003820 2021-11-15T19:31:41.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.380+0000 7f6c0f7fe700 1 -- 172.21.2.137:0/4170243734 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v197) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6c1c027070 con 0x7f6c08003820 2021-11-15T19:31:41.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c000536a0 msgr2=0x7f6c00055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:41.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c000536a0 0x7f6c00055b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f6c1000b000 tx=0x7f6c10001920).stop 2021-11-15T19:31:41.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 msgr2=0x7f6c20156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:41.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c20156570 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6c200b0180 tx=0x7f6c1c015000).stop 2021-11-15T19:31:41.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 shutdown_connections 2021-11-15T19:31:41.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6c000536a0 0x7f6c00055b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:41.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6c2015a0e0 0x7f6c2015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:41.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6c20099050 0x7f6c2009c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:41.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 --2- 172.21.2.137:0/4170243734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6c08003820 0x7f6c20156570 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:41.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 >> 172.21.2.137:0/4170243734 conn(0x7f6c200b4430 msgr2=0x7f6c20142140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:41.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 shutdown_connections 2021-11-15T19:31:41.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.384+0000 7f6c27369700 1 -- 172.21.2.137:0/4170243734 wait complete. 2021-11-15T19:31:41.394 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T19:31:41.394 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T19:31:41.395 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-11-15T19:31:41.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.444+0000 7f300a6e4700 1 Processor -- start 2021-11-15T19:31:41.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.444+0000 7f300a6e4700 1 -- start start 2021-11-15T19:31:41.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f300413ce00 0x7f3004142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:41.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30040b6830 0x7f30041433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:41.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040b63b0 con 0x7f30040b5fd0 2021-11-15T19:31:41.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3004147070 con 0x7f30040b6830 2021-11-15T19:31:41.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004146dd0 con 0x7f300413ce00 2021-11-15T19:31:41.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f30040b5fd0 0x7f300413c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53584/0 (socket says 172.21.2.137:53584) 2021-11-15T19:31:41.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 -- 172.21.2.137:0/1458729415 learned_addr learned my addr 172.21.2.137:0/1458729415 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:41.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3008c81700 1 --2- 172.21.2.137:0/1458729415 >> v2:172.21.2.137:3300/0 conn(0x7f30040b6830 0x7f30041433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:41.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3002ffd700 1 -- 172.21.2.137:0/1458729415 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583752206 0 0) 0x7f30040b63b0 con 0x7f30040b5fd0 2021-11-15T19:31:41.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3002ffd700 1 -- 172.21.2.137:0/1458729415 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe4003260 con 0x7f30040b5fd0 2021-11-15T19:31:41.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3008c81700 1 -- 172.21.2.137:0/1458729415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f300413ce00 msgr2=0x7f3004142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:41.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3008c81700 1 --2- 172.21.2.137:0/1458729415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f300413ce00 0x7f3004142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:41.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3008c81700 1 -- 172.21.2.137:0/1458729415 >> v1:172.21.2.137:6789/0 conn(0x7f30040b5fd0 legacy=0x7f300413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:41.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3008c81700 1 -- 172.21.2.137:0/1458729415 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004146af0 con 0x7f30040b6830 2021-11-15T19:31:41.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3008c81700 1 --2- 172.21.2.137:0/1458729415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b6830 0x7f30041433c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f2ffc0032f0 tx=0x7f2ffc0091d0).ready entity=mon.1 client_cookie=8ed35176ebc7cf72 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:41.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3002ffd700 1 -- 172.21.2.137:0/1458729415 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ffc00b6c0 con 0x7f30040b6830 2021-11-15T19:31:41.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3002ffd700 1 -- 172.21.2.137:0/1458729415 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00b820 con 0x7f30040b6830 2021-11-15T19:31:41.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3002ffd700 1 -- 172.21.2.137:0/1458729415 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ffc00b990 con 0x7f30040b6830 2021-11-15T19:31:41.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- 172.21.2.137:0/1458729415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b6830 msgr2=0x7f30041433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:41.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- 172.21.2.137:0/1458729415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b6830 0x7f30041433c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f2ffc0032f0 tx=0x7f2ffc0091d0).stop 2021-11-15T19:31:41.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- 172.21.2.137:0/1458729415 shutdown_connections 2021-11-15T19:31:41.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- 172.21.2.137:0/1458729415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b6830 0x7f30041433c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:41.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- 172.21.2.137:0/1458729415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f300413ce00 0x7f3004142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:41.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- 172.21.2.137:0/1458729415 >> 172.21.2.137:0/1458729415 conn(0x7f30040624b0 msgr2=0x7f3004062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:41.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- 172.21.2.137:0/1458729415 shutdown_connections 2021-11-15T19:31:41.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- 172.21.2.137:0/1458729415 wait complete. 2021-11-15T19:31:41.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 Processor -- start 2021-11-15T19:31:41.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- start start 2021-11-15T19:31:41.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 0x7f3004067180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:41.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30040b6830 0x7f300413a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:41.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f300413ce00 0x7f300413a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:41.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040af910 con 0x7f300413ce00 2021-11-15T19:31:41.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040648f0 con 0x7f30040b5fd0 2021-11-15T19:31:41.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f300a6e4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300413aa60 con 0x7f30040b6830 2021-11-15T19:31:41.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 0x7f3004067180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:41.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 0x7f3004067180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34808/0 (socket says 172.21.2.137:34808) 2021-11-15T19:31:41.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 -- 172.21.2.137:0/2325328383 learned_addr learned my addr 172.21.2.137:0/2325328383 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:41.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 -- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30040b6830 msgr2=0x7f300413a080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:41.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30040b6830 0x7f300413a080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:41.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 -- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f300413ce00 msgr2=0x7f300413a570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:41.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f300413ce00 0x7f300413a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:41.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 -- 172.21.2.137:0/2325328383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009470 con 0x7f30040b5fd0 2021-11-15T19:31:41.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.448+0000 7f3003fff700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 0x7f3004067180 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f2fec001160 tx=0x7f2fec007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:41.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fec0070d0 con 0x7f30040b5fd0 2021-11-15T19:31:41.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec007230 con 0x7f30040b5fd0 2021-11-15T19:31:41.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3004063810 con 0x7f30040b5fd0 2021-11-15T19:31:41.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3004064570 con 0x7f30040b5fd0 2021-11-15T19:31:41.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fec005610 con 0x7f30040b5fd0 2021-11-15T19:31:41.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30040afff0 con 0x7f30040b5fd0 2021-11-15T19:31:41.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2fec01a060 con 0x7f30040b5fd0 2021-11-15T19:31:41.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fe80536f0 0x7f2fe8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:41.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2fec06aea0 con 0x7f30040b5fd0 2021-11-15T19:31:41.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30037fe700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fe80536f0 0x7f2fe8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:41.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30037fe700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fe80536f0 0x7f2fe8055bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f2ff4002f70 tx=0x7f2ff4006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:41.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.452+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2fec0421d0 con 0x7f30040b5fd0 2021-11-15T19:31:41.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:41.564+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f30040573d0 con 0x7f30040b5fd0 2021-11-15T19:31:42.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.384+0000 7f30017fa700 1 -- 172.21.2.137:0/2325328383 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v198) v1 ==== 150+0+0 (secure 0 0 0) 0x7f2fec018030 con 0x7f30040b5fd0 2021-11-15T19:31:42.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fe80536f0 msgr2=0x7f2fe8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fe80536f0 0x7f2fe8055bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f2ff4002f70 tx=0x7f2ff4006a00).stop 2021-11-15T19:31:42.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 msgr2=0x7f3004067180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 0x7f3004067180 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f2fec001160 tx=0x7f2fec007a20).stop 2021-11-15T19:31:42.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 shutdown_connections 2021-11-15T19:31:42.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fe80536f0 0x7f2fe8055bb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f300413ce00 0x7f300413a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f30040b6830 0x7f300413a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 --2- 172.21.2.137:0/2325328383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30040b5fd0 0x7f3004067180 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 >> 172.21.2.137:0/2325328383 conn(0x7f30040624b0 msgr2=0x7f30040b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:42.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 shutdown_connections 2021-11-15T19:31:42.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.388+0000 7f300a6e4700 1 -- 172.21.2.137:0/2325328383 wait complete. 2021-11-15T19:31:42.399 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:31:42.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 Processor -- start 2021-11-15T19:31:42.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- start start 2021-11-15T19:31:42.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f09080b72e0 0x7f09080b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f09080acd60 0x7f09080b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 0x7f0908143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080b3100 con 0x7f09080b72e0 2021-11-15T19:31:42.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080b76c0 con 0x7f09080acd60 2021-11-15T19:31:42.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090812a170 con 0x7f09080b4680 2021-11-15T19:31:42.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f09080acd60 0x7f09080b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f09080acd60 0x7f09080b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34820/0 (socket says 172.21.2.137:34820) 2021-11-15T19:31:42.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 -- 172.21.2.137:0/1832632628 learned_addr learned my addr 172.21.2.137:0/1832632628 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:42.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 -- 172.21.2.137:0/1832632628 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 msgr2=0x7f0908143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:42.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 --2- 172.21.2.137:0/1832632628 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 0x7f0908143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 -- 172.21.2.137:0/1832632628 >> v2:172.21.2.111:3300/0 conn(0x7f09080b72e0 msgr2=0x7f09080b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:42.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 --2- 172.21.2.137:0/1832632628 >> v2:172.21.2.111:3300/0 conn(0x7f09080b72e0 0x7f09080b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 -- 172.21.2.137:0/1832632628 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080ad8a0 con 0x7f09080acd60 2021-11-15T19:31:42.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f0905d9b700 1 --2- 172.21.2.137:0/1832632628 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f09080b4190 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f08f8002f70 tx=0x7f08f8006eb0).ready entity=mon.1 client_cookie=ecc95952faed1003 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:42.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090559a700 1 -- 172.21.2.137:0/1832632628 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f800d570 con 0x7f09080acd60 2021-11-15T19:31:42.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090559a700 1 -- 172.21.2.137:0/1832632628 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8000e90 con 0x7f09080acd60 2021-11-15T19:31:42.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090559a700 1 -- 172.21.2.137:0/1832632628 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f800d900 con 0x7f09080acd60 2021-11-15T19:31:42.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- 172.21.2.137:0/1832632628 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 msgr2=0x7f09080b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- 172.21.2.137:0/1832632628 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f09080b4190 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f08f8002f70 tx=0x7f08f8006eb0).stop 2021-11-15T19:31:42.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- 172.21.2.137:0/1832632628 shutdown_connections 2021-11-15T19:31:42.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- 172.21.2.137:0/1832632628 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 0x7f0908143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- 172.21.2.137:0/1832632628 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f09080b4190 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 --2- 172.21.2.137:0/1832632628 >> v2:172.21.2.111:3300/0 conn(0x7f09080b72e0 0x7f09080b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- 172.21.2.137:0/1832632628 >> 172.21.2.137:0/1832632628 conn(0x7f0908064960 msgr2=0x7f0908064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:42.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- 172.21.2.137:0/1832632628 shutdown_connections 2021-11-15T19:31:42.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.448+0000 7f090ca2c700 1 -- 172.21.2.137:0/1832632628 wait complete. 2021-11-15T19:31:42.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 Processor -- start 2021-11-15T19:31:42.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- start start 2021-11-15T19:31:42.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f0908062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 0x7f090813dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09080b72e0 0x7f090813e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908144050 con 0x7f09080b72e0 2021-11-15T19:31:42.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080ae490 con 0x7f09080acd60 2021-11-15T19:31:42.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090813e730 con 0x7f09080b4680 2021-11-15T19:31:42.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f0908062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f0908062de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34824/0 (socket says 172.21.2.137:34824) 2021-11-15T19:31:42.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 -- 172.21.2.137:0/168050275 learned_addr learned my addr 172.21.2.137:0/168050275 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:42.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 -- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 msgr2=0x7f090813dd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:42.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 0x7f090813dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 -- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09080b72e0 msgr2=0x7f090813e240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:42.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09080b72e0 0x7f090813e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 -- 172.21.2.137:0/168050275 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f800b1e0 con 0x7f09080acd60 2021-11-15T19:31:42.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090659c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f0908062de0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f08f0002f70 tx=0x7f08f0006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:42.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f000e470 con 0x7f09080acd60 2021-11-15T19:31:42.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000e5d0 con 0x7f09080acd60 2021-11-15T19:31:42.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0908144280 con 0x7f09080acd60 2021-11-15T19:31:42.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908143100 con 0x7f09080acd60 2021-11-15T19:31:42.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f000e930 con 0x7f09080acd60 2021-11-15T19:31:42.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0908143df0 con 0x7f09080acd60 2021-11-15T19:31:42.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08f0018030 con 0x7f09080acd60 2021-11-15T19:31:42.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f08ff7fe700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f08ec053600 0x7f08ec055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f08f006ad70 con 0x7f09080acd60 2021-11-15T19:31:42.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f0905d9b700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f08ec053600 0x7f08ec055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.452+0000 7f0905d9b700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f08ec053600 0x7f08ec055ac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f08f8002f70 tx=0x7f08f8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:42.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.456+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08f006f070 con 0x7f09080acd60 2021-11-15T19:31:42.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.540+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f09080b3a50 con 0x7f09080acd60 2021-11-15T19:31:42.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.548+0000 7f08ff7fe700 1 -- 172.21.2.137:0/168050275 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f08f00420a0 con 0x7f09080acd60 2021-11-15T19:31:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f08ec053600 msgr2=0x7f08ec055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f08ec053600 0x7f08ec055ac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f08f8002f70 tx=0x7f08f8015000).stop 2021-11-15T19:31:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 msgr2=0x7f0908062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f0908062de0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f08f0002f70 tx=0x7f08f0006db0).stop 2021-11-15T19:31:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 shutdown_connections 2021-11-15T19:31:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f08ec053600 0x7f08ec055ac0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09080b72e0 0x7f090813e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09080b4680 0x7f090813dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 --2- 172.21.2.137:0/168050275 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09080acd60 0x7f0908062de0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 >> 172.21.2.137:0/168050275 conn(0x7f0908064960 msgr2=0x7f09080b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 shutdown_connections 2021-11-15T19:31:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.552+0000 7f090ca2c700 1 -- 172.21.2.137:0/168050275 wait complete. 2021-11-15T19:31:42.562 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:31:42.563 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:42.575 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:42.589 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:42.602 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:42.616 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:31:42.629 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:31:42.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:42.630 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:42.630 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:42.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:42.634 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:31:42.634 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:31:42.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:42.635 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:42.636 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:31:42.645 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:31:42.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:42.646 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:31:42.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:42.647 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:42.648 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:31:42.654 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:31:42.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:31:42.655 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:31:42.656 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:31:42.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 Processor -- start 2021-11-15T19:31:42.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- start start 2021-11-15T19:31:42.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92d80608f0 0x7f92d813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f92d805f730 0x7f92d805fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d8060070 con 0x7f92d80b1660 2021-11-15T19:31:42.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80ad6c0 con 0x7f92d805f730 2021-11-15T19:31:42.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b0c80 con 0x7f92d80608f0 2021-11-15T19:31:42.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d67fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f92d80b1660 0x7f92d80b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53616/0 (socket says 172.21.2.137:53616) 2021-11-15T19:31:42.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d67fc700 1 -- 172.21.2.137:0/4266335744 learned_addr learned my addr 172.21.2.137:0/4266335744 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:42.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362596360 0 0) 0x7f92d8060070 con 0x7f92d80b1660 2021-11-15T19:31:42.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc003260 con 0x7f92d80b1660 2021-11-15T19:31:42.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d77fe700 1 --2- 172.21.2.137:0/4266335744 >> v2:172.21.2.111:3300/0 conn(0x7f92d805f730 0x7f92d805fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92d80608f0 0x7f92d813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820393761 0 0) 0x7f92bc003260 con 0x7f92d80b1660 2021-11-15T19:31:42.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92d80608f0 msgr2=0x7f92d813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92d80608f0 0x7f92d813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 >> v2:172.21.2.111:3300/0 conn(0x7f92d805f730 msgr2=0x7f92d805fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 --2- 172.21.2.137:0/4266335744 >> v2:172.21.2.111:3300/0 conn(0x7f92d805f730 0x7f92d805fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80b0f20 con 0x7f92d80b1660 2021-11-15T19:31:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f92c8001660 con 0x7f92d80b1660 2021-11-15T19:31:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 >> v1:172.21.2.137:6789/0 conn(0x7f92d80b1660 legacy=0x7f92d80b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92bc0037d0 0x7f92bc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92bc004500 0x7f92bc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc005070 0x7f92bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80ad6c0 con 0x7f92bc004500 2021-11-15T19:31:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b0c80 con 0x7f92bc0037d0 2021-11-15T19:31:42.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00beb0 con 0x7f92bc005070 2021-11-15T19:31:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92d80608f0 0x7f92d813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92bc0037d0 0x7f92bc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d67fc700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92bc004500 0x7f92bc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 -- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc005070 msgr2=0x7f92bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:42.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d77fe700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc005070 0x7f92bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc005070 0x7f92bc00b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 -- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92bc004500 msgr2=0x7f92bc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92bc004500 0x7f92bc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 -- 172.21.2.137:0/4266335744 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80b0f20 con 0x7f92bc0037d0 2021-11-15T19:31:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92bc0037d0 0x7f92bc003bf0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f92cc007000 tx=0x7f92cc008040).ready entity=mon.1 client_cookie=aa487b6bd01e6b6e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92cc012430 con 0x7f92bc0037d0 2021-11-15T19:31:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc00c030 con 0x7f92bc0037d0 2021-11-15T19:31:42.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d5ffb700 1 -- 172.21.2.137:0/4266335744 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92cc012780 con 0x7f92bc0037d0 2021-11-15T19:31:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- 172.21.2.137:0/4266335744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92bc0037d0 msgr2=0x7f92bc003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 --2- 172.21.2.137:0/4266335744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92bc0037d0 0x7f92bc003bf0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f92cc007000 tx=0x7f92cc008040).stop 2021-11-15T19:31:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92d77fe700 1 -- 172.21.2.137:0/4266335744 reap_dead start 2021-11-15T19:31:42.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- 172.21.2.137:0/4266335744 shutdown_connections 2021-11-15T19:31:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- 172.21.2.137:0/4266335744 >> 172.21.2.137:0/4266335744 conn(0x7f92d8063980 msgr2=0x7f92d8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- 172.21.2.137:0/4266335744 shutdown_connections 2021-11-15T19:31:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.724+0000 7f92dd334700 1 -- 172.21.2.137:0/4266335744 wait complete. 2021-11-15T19:31:42.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 Processor -- start 2021-11-15T19:31:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- start start 2021-11-15T19:31:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc0037d0 0x7f92d8127f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92d8125610 0x7f92d8126be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 0x7f92d8142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8124970 con 0x7f92d8125610 2021-11-15T19:31:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81234c0 con 0x7f92d81270d0 2021-11-15T19:31:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8122710 con 0x7f92bc0037d0 2021-11-15T19:31:42.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 0x7f92d8142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 0x7f92d8142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34848/0 (socket says 172.21.2.137:34848) 2021-11-15T19:31:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 -- 172.21.2.137:0/890959857 learned_addr learned my addr 172.21.2.137:0/890959857 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc0037d0 0x7f92d8127f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d67fc700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92d8125610 0x7f92d8126be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 -- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc0037d0 msgr2=0x7f92d8127f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc0037d0 0x7f92d8127f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 -- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92d8125610 msgr2=0x7f92d8126be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:42.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92d8125610 0x7f92d8126be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 -- 172.21.2.137:0/890959857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d81287a0 con 0x7f92d81270d0 2021-11-15T19:31:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d77fe700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 0x7f92d8142e70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f92d0000b60 tx=0x7f92d0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d0010550 con 0x7f92d81270d0 2021-11-15T19:31:42.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d000c040 con 0x7f92d81270d0 2021-11-15T19:31:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d8123710 con 0x7f92d81270d0 2021-11-15T19:31:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d8128c40 con 0x7f92d81270d0 2021-11-15T19:31:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d00106b0 con 0x7f92d81270d0 2021-11-15T19:31:42.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d8128930 con 0x7f92d81270d0 2021-11-15T19:31:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92d0010810 con 0x7f92d81270d0 2021-11-15T19:31:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92c7fff700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92b40536a0 0x7f92b4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f92d006e410 con 0x7f92d81270d0 2021-11-15T19:31:42.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.728+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92b40536a0 0x7f92b4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:42.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.732+0000 7f92d6ffd700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92b40536a0 0x7f92b4055b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f92cc014000 tx=0x7f92cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:42.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.732+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92d0042ae0 con 0x7f92d81270d0 2021-11-15T19:31:42.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f92d80b11c0 con 0x7f92d81270d0 2021-11-15T19:31:42.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92c7fff700 1 -- 172.21.2.137:0/890959857 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+28828 (secure 0 0 0) 0x7f92d0046100 con 0x7f92d81270d0 2021-11-15T19:31:42.821 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:42.821 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:31:42.822 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 56, 2021-11-15T19:31:42.822 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:31:42.822 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:31:42.822 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:31:40.361761+0000", 2021-11-15T19:31:42.823 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:31:42.823 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:31:42.823 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:31:42.823 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:31:42.824 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:31:42.824 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:31:42.824 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:31:42.824 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:31:42.825 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:31:42.825 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:42.825 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:31:42.825 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:31:42.826 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:31:42.826 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:31:42.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:31:42.826 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 10, 2021-11-15T19:31:42.827 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:31:42.827 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:31:42.827 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:31:42.827 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:31:42.828 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:31:42.828 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.828 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:31:42.828 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:31:42.829 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:31:42.829 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:31:42.829 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:31:42.829 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:31:42.830 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:31:42.830 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:31:42.830 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:31:42.830 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:31:42.831 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:31:42.831 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:31:42.831 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:31:42.831 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:31:42.831 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:31:42.832 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:31:42.832 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:31:42.832 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:31:42.832 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:31:42.833 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:31:42.833 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:31:42.833 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:31:42.833 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:31:42.834 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.834 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:31:42.834 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:31:42.834 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:31:42.835 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:31:42.835 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:31:42.835 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:31:42.835 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:31:42.836 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:31:42.836 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:31:42.836 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:31:42.836 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:31:42.837 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:31:42.837 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:31:42.837 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:31:42.837 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:31:42.838 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:31:42.838 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:31:42.838 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:31:42.838 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:31:42.839 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:31:42.839 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:31:42.839 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:31:42.839 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:31:42.840 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:31:42.840 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:31:42.840 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:31:42.840 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:31:42.841 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.841 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:31:42.841 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:31:42.841 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:31:42.842 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:31:42.842 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:31:42.842 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:31:42.842 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:31:42.843 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:31:42.843 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:31:42.843 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:31:42.843 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:31:42.844 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:31:42.844 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:31:42.844 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.844 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:31:42.845 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:31:42.845 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.845 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.845 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.846 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:31:42.846 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:31:42.846 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:31:42.846 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:31:42.847 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:31:42.847 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:31:42.847 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:31:42.847 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:31:42.848 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:31:42.848 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:31:42.848 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:31:42.848 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:31:42.849 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:31:42.849 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:31:42.849 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:31:42.849 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:31:42.850 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:31:42.850 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:31:42.850 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:31:42.850 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:31:42.851 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:31:42.851 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:31:42.851 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:31:42.851 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.852 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:31:42.852 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:31:42.852 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:31:42.852 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:31:42.853 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:31:42.853 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:31:42.853 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:31:42.853 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:31:42.853 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:31:42.854 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:31:42.854 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:31:42.854 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:31:42.854 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:31:42.855 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:31:42.855 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:31:42.855 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:31:42.856 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:31:42.856 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:31:42.856 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:31:42.856 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:31:42.856 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:31:42.857 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:31:42.857 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:31:42.857 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:31:42.857 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:31:42.858 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:31:42.858 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:31:42.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.858 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:31:42.859 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:31:42.859 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:31:42.859 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:31:42.859 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:31:42.859 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:31:42.860 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:31:42.860 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:31:42.860 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:31:42.860 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:31:42.861 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:31:42.861 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:31:42.861 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:31:42.861 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:31:42.862 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.862 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.862 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:42.862 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:31:42.863 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.863 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:31:42.863 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:31:42.863 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.863 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.864 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.864 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.864 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.865 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.865 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.865 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:42.865 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.865 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.866 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.866 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.866 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.866 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.867 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:31:42.867 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.867 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.867 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.868 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.868 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:31:42.868 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.868 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.869 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.869 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.869 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.869 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.870 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.870 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:31:42.870 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.870 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.871 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.871 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.871 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:31:42.871 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.872 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.872 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.872 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.872 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.873 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.873 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.873 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.873 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:31:42.874 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.874 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.874 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.875 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.875 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:31:42.875 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.875 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.875 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.876 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.876 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.876 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.876 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.877 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.877 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:31:42.877 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.877 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.877 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.878 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.878 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:31:42.878 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:31:42.878 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.879 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.879 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.879 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:31:42.879 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:31:42.880 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:31:42.880 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:31:42.880 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.880 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.881 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.881 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.881 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.881 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.882 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:31:42.882 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:31:42.882 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.882 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.883 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.883 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.883 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.883 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.884 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.884 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:42.884 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.884 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.884 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.885 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.885 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.885 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.886 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:31:42.886 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.886 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.886 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.887 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.887 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:31:42.887 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.887 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.888 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.888 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.888 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.888 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.889 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.889 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.889 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:31:42.889 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.890 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.890 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.890 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.890 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:31:42.891 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.891 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.891 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.891 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.891 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.892 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.892 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.892 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.892 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:31:42.893 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.893 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.893 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.893 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.894 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:31:42.894 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.894 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.894 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.895 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.895 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.895 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.895 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.896 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.896 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:31:42.896 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.896 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.896 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.897 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.897 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:31:42.897 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:31:42.897 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.898 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.898 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.898 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:31:42.898 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:31:42.899 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:31:42.899 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:31:42.899 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.899 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.900 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.900 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.900 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.900 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.901 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:31:42.901 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:31:42.901 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.901 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.902 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.902 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.902 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.902 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.903 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.903 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:42.903 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.903 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.903 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.904 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.904 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.904 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.904 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:31:42.904 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.905 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.905 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.905 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.906 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:31:42.906 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.906 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.906 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.906 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.907 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.907 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.907 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.908 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.908 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:31:42.908 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.908 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.909 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.909 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.909 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:31:42.909 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.909 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.910 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.910 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.910 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.910 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.910 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.911 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.911 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:31:42.911 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.911 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.912 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.912 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.912 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:31:42.912 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.912 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.913 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.913 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.913 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.913 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.914 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.914 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.914 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:31:42.914 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.914 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.915 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.915 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.915 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:31:42.915 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:31:42.916 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.916 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.916 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.917 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:31:42.917 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:31:42.917 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:31:42.917 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:31:42.917 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.918 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.918 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.918 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.918 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.919 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.919 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:31:42.919 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:31:42.919 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.920 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.920 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.920 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.920 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.921 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.921 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.921 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 48, 2021-11-15T19:31:42.921 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.922 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.922 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.922 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.922 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.923 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.923 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:31:42.923 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.923 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.923 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.924 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.924 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:31:42.924 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.924 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.925 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.925 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.925 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.925 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.926 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.926 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.926 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:31:42.926 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.927 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.927 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.927 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.927 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:31:42.928 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.928 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.928 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.928 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.929 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.929 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.929 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.929 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.929 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:31:42.930 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.930 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.930 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.930 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.930 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:31:42.931 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.931 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.931 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.931 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.932 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.932 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.932 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.932 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.932 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:31:42.933 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.933 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.933 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.933 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.934 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:31:42.934 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:31:42.934 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.934 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.935 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.935 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:31:42.935 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:31:42.935 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:31:42.935 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:31:42.936 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.936 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.936 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.936 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.937 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.937 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.937 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:31:42.937 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:31:42.937 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.938 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.938 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.938 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.938 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.938 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.939 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.939 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:42.939 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.939 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.940 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.940 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.940 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.940 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.941 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:31:42.941 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.941 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.941 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.941 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.942 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:31:42.942 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.942 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.942 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.943 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.943 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.943 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.943 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.943 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.944 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:31:42.944 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.944 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.944 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.945 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.945 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:31:42.945 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.945 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.946 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.946 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.946 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.946 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.947 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.947 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.947 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:31:42.947 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.948 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.948 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.948 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.948 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:31:42.948 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.949 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.949 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.949 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.949 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.949 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.950 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.950 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.950 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:31:42.950 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.951 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.951 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.951 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.951 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:31:42.952 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:31:42.952 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.952 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.952 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.952 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:31:42.953 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:31:42.953 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:31:42.953 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:31:42.953 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.954 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.954 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.954 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.954 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.955 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.955 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:31:42.955 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:31:42.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.956 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.956 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.956 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.956 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.957 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.957 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.957 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 49, 2021-11-15T19:31:42.957 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.958 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.958 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.958 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.958 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.959 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.959 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:31:42.959 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.959 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.959 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.960 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.960 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:31:42.960 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.960 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.961 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.961 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.961 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.961 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.962 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.962 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.962 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:31:42.962 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.963 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.963 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.963 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.963 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:31:42.964 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.964 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.964 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.964 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.964 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.965 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.965 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.965 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.965 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:31:42.965 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.966 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.966 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.966 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.966 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:31:42.967 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.967 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.967 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.967 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.968 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.968 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.968 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.968 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.968 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:31:42.969 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.969 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.969 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.969 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.970 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:31:42.970 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:31:42.970 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.970 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.971 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.971 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:31:42.971 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:31:42.971 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:31:42.972 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:31:42.972 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.972 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.972 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.972 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.973 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.973 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.973 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:31:42.973 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:31:42.974 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.974 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.974 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.974 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.974 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.975 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.975 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.975 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 51, 2021-11-15T19:31:42.975 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.976 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.976 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.976 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.976 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.976 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.977 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:31:42.977 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.977 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.977 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.977 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.978 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:31:42.978 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.978 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.978 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.979 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.979 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.979 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.979 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.980 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.980 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:31:42.980 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.980 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.980 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.981 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.981 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:31:42.981 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.981 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.982 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.982 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.982 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:42.982 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.983 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.983 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.983 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:31:42.983 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.984 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.984 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.984 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.984 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:31:42.985 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.985 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.985 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.985 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.985 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:42.986 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.986 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.986 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.986 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:31:42.987 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.987 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.987 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.987 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.988 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:31:42.988 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:31:42.988 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.988 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.989 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.989 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:31:42.989 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:31:42.989 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:31:42.990 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:31:42.990 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:42.990 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:42.990 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:42.991 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.991 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.991 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.992 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:31:42.992 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:31:42.992 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:31:42.992 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:31:42.992 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:31:42.993 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:31:42.993 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:31:42.993 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:31:42.993 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:31:42.994 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 48, 2021-11-15T19:31:42.994 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:31:42.994 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:31:42.994 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:31:42.995 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.995 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.995 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.995 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:31:42.996 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:42.996 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.996 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.996 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:42.997 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:31:42.997 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:42.997 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:42.997 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:42.998 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:42.998 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:31:42.998 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:42.998 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:42.999 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:42.999 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:31:42.999 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:42.999 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.000 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.000 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:43.000 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:31:43.000 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:43.000 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:43.001 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:43.001 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.001 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:31:43.002 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:43.002 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.002 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:43.002 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:31:43.003 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:43.003 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.003 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.003 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:43.004 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:31:43.004 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:43.004 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:43.004 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:43.005 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.005 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:31:43.005 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:31:43.005 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.006 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:31:43.006 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:31:43.006 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:43.006 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.007 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.007 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:31:43.007 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:31:43.007 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:31:43.008 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:43.008 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:43.008 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.008 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:31:43.009 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:31:43.009 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:31:43.009 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:31:43.009 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:31:43.009 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:31:43.010 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:31:43.010 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:43.010 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:43.010 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:43.011 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:31:43.011 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.011 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:31:43.011 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.012 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.012 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.012 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.012 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.013 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:31:43.013 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.013 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.013 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.014 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:31:43.014 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.014 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.014 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.015 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.015 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.015 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:31:43.015 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.016 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.016 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.016 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:31:43.016 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.016 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.017 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.017 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.017 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.017 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:31:43.018 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.018 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.018 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.018 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:31:43.018 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.019 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.019 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.019 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.019 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.020 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:31:43.020 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.020 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.020 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.020 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:31:43.021 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.021 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.021 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.021 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.021 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.022 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:31:43.022 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.022 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.022 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.023 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:31:43.023 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.023 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.023 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.024 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.024 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.024 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:31:43.024 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.025 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.025 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.025 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:31:43.025 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.025 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.026 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.026 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.026 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.026 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:31:43.027 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.027 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.027 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:43.027 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:31:43.028 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:31:43.028 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:31:43.028 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:31:43.028 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:31:43.028 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:31:43.029 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:31:43.029 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:31:43.029 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:43.029 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:31:43.030 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:31:43.030 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:31:43.030 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:31:43.030 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:31:43.031 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:31:43.031 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/1712485554": "2021-11-16T19:31:36.472505+0000", 2021-11-15T19:31:43.031 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/1712485554": "2021-11-16T19:31:36.472505+0000" 2021-11-15T19:31:43.031 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.031 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:31:43.032 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:31:43.032 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:31:43.032 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:31:43.032 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:31:43.033 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:31:43.033 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:31:43.033 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:31:43.033 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:43.034 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:43.034 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:31:43.034 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:31:43.034 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:31:43.035 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:31:43.035 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:31:43.035 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:31:43.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92b40536a0 msgr2=0x7f92b4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92b40536a0 0x7f92b4055b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f92cc014000 tx=0x7f92cc008040).stop 2021-11-15T19:31:43.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 msgr2=0x7f92d8142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 0x7f92d8142e70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f92d0000b60 tx=0x7f92d0008040).stop 2021-11-15T19:31:43.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 shutdown_connections 2021-11-15T19:31:43.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92b40536a0 0x7f92b4055b60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92d81270d0 0x7f92d8142e70 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92d8125610 0x7f92d8126be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 --2- 172.21.2.137:0/890959857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92bc0037d0 0x7f92d8127f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 >> 172.21.2.137:0/890959857 conn(0x7f92d8063980 msgr2=0x7f92d8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:43.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 shutdown_connections 2021-11-15T19:31:43.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:42.816+0000 7f92dd334700 1 -- 172.21.2.137:0/890959857 wait complete. 2021-11-15T19:31:43.040 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 Processor -- start 2021-11-15T19:31:43.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- start start 2021-11-15T19:31:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2f1c0b25b0 0x7f2f1c0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c0b0d00 0x7f2f1c0b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0b2990 con 0x7f2f1c143170 2021-11-15T19:31:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c13f2f0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c13f590 con 0x7f2f1c0b0d00 2021-11-15T19:31:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2f1c0b25b0 0x7f2f1c0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2f1c0b25b0 0x7f2f1c0ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34852/0 (socket says 172.21.2.137:34852) 2021-11-15T19:31:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 -- 172.21.2.137:0/1989952126 learned_addr learned my addr 172.21.2.137:0/1989952126 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:43.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 -- 172.21.2.137:0/1989952126 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c0b0d00 msgr2=0x7f2f1c0b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:43.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 --2- 172.21.2.137:0/1989952126 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c0b0d00 0x7f2f1c0b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:43.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 -- 172.21.2.137:0/1989952126 >> v1:172.21.2.111:6789/0 conn(0x7f2f1c143170 legacy=0x7f2f1c13fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:43.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 -- 172.21.2.137:0/1989952126 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c13f830 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1a59c700 1 --2- 172.21.2.137:0/1989952126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c0ad140 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f2f1c0b00d0 tx=0x7f2f0c006f40).ready entity=mon.1 client_cookie=63e64190341d5257 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1959a700 1 -- 172.21.2.137:0/1989952126 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0c00dc30 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1959a700 1 -- 172.21.2.137:0/1989952126 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c000e90 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f1959a700 1 -- 172.21.2.137:0/1989952126 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0c00be90 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- 172.21.2.137:0/1989952126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 msgr2=0x7f2f1c0ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/1989952126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c0ad140 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f2f1c0b00d0 tx=0x7f2f0c006f40).stop 2021-11-15T19:31:43.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- 172.21.2.137:0/1989952126 shutdown_connections 2021-11-15T19:31:43.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/1989952126 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c0b0d00 0x7f2f1c0b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:43.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/1989952126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c0ad140 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- 172.21.2.137:0/1989952126 >> 172.21.2.137:0/1989952126 conn(0x7f2f1c063200 msgr2=0x7f2f1c063610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:43.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- 172.21.2.137:0/1989952126 shutdown_connections 2021-11-15T19:31:43.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.096+0000 7f2f20bd3700 1 -- 172.21.2.137:0/1989952126 wait complete. 2021-11-15T19:31:43.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 Processor -- start 2021-11-15T19:31:43.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- start start 2021-11-15T19:31:43.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f1c0b0d00 0x7f2f1c13cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c110cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c143170 0x7f2f1c1111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c067980 con 0x7f2f1c0b0d00 2021-11-15T19:31:43.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c066b50 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0668b0 con 0x7f2f1c143170 2021-11-15T19:31:43.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c110cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c110cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34858/0 (socket says 172.21.2.137:34858) 2021-11-15T19:31:43.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 -- 172.21.2.137:0/2163080430 learned_addr learned my addr 172.21.2.137:0/2163080430 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:43.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 -- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c143170 msgr2=0x7f2f1c1111a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:43.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c143170 0x7f2f1c1111a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:43.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 -- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f1c0b0d00 msgr2=0x7f2f1c13cb00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:43.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f1c0b0d00 0x7f2f1c13cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:43.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 -- 172.21.2.137:0/2163080430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c00b460 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f19d9b700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c110cb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f2f10002ef0 tx=0x7f2f10006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f10012410 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10012570 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f100128d0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c0676e0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c13d2b0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c13efb0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f1000f030 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f0b7fe700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2ef8053660 0x7f2ef8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2f1006b450 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.100+0000 7f2f1a59c700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2ef8053660 0x7f2ef8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.104+0000 7f2f1a59c700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2ef8053660 0x7f2ef8055b20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f2f1c0b00d0 tx=0x7f2f1c13f9c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.104+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f10042780 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.208+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f1c0573d0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f0b7fe700 1 -- 172.21.2.137:0/2163080430 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f2f10045da0 con 0x7f2f1c0b25b0 2021-11-15T19:31:43.215 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:43.216 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19},{"gid":5815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/4106739013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4106739013},{"type":"v1","addr":"172.21.2.137:6833","nonce":4106739013}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2021-11-15T19:31:43.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2ef8053660 msgr2=0x7f2ef8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2ef8053660 0x7f2ef8055b20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f2f1c0b00d0 tx=0x7f2f1c13f9c0).stop 2021-11-15T19:31:43.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 msgr2=0x7f2f1c110cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c110cb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f2f10002ef0 tx=0x7f2f10006d50).stop 2021-11-15T19:31:43.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 shutdown_connections 2021-11-15T19:31:43.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2ef8053660 0x7f2ef8055b20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2f1c143170 0x7f2f1c1111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:43.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2f1c0b25b0 0x7f2f1c110cb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 --2- 172.21.2.137:0/2163080430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2f1c0b0d00 0x7f2f1c13cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:43.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 >> 172.21.2.137:0/2163080430 conn(0x7f2f1c063200 msgr2=0x7f2f1c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:43.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 shutdown_connections 2021-11-15T19:31:43.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.212+0000 7f2f20bd3700 1 -- 172.21.2.137:0/2163080430 wait complete. 2021-11-15T19:31:43.220 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 23 2021-11-15T19:31:43.222 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:43.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 Processor -- start 2021-11-15T19:31:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 -- start start 2021-11-15T19:31:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efed40b1340 0x7efed4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed40aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed4148190 con 0x7efed4143f00 2021-11-15T19:31:43.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40b1720 con 0x7efed40b1340 2021-11-15T19:31:43.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.268+0000 7efed9d96700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed4147e70 con 0x7efed40a9f50 2021-11-15T19:31:43.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efed40b1340 0x7efed4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed3fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed40aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efed40b1340 0x7efed4147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:42094/0 (socket says 172.21.2.137:42094) 2021-11-15T19:31:43.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 -- 172.21.2.137:0/1296309655 learned_addr learned my addr 172.21.2.137:0/1296309655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:43.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 -- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 msgr2=0x7efed40aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:43.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 --2- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed40aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 -- 172.21.2.137:0/1296309655 >> v1:172.21.2.111:6789/0 conn(0x7efed4143f00 legacy=0x7efed4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 -- 172.21.2.137:0/1296309655 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40af800 con 0x7efed40b1340 2021-11-15T19:31:43.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed37fe700 1 --2- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed40b1340 0x7efed4147980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efebc002f70 tx=0x7efebc006eb0).ready entity=mon.0 client_cookie=be8901d62f8e1c23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed27fc700 1 -- 172.21.2.137:0/1296309655 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efebc00d570 con 0x7efed40b1340 2021-11-15T19:31:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed27fc700 1 -- 172.21.2.137:0/1296309655 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc000e90 con 0x7efed40b1340 2021-11-15T19:31:43.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed27fc700 1 -- 172.21.2.137:0/1296309655 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efebc00d900 con 0x7efed40b1340 2021-11-15T19:31:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 -- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed40b1340 msgr2=0x7efed4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 --2- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed40b1340 0x7efed4147980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efebc002f70 tx=0x7efebc006eb0).stop 2021-11-15T19:31:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 -- 172.21.2.137:0/1296309655 shutdown_connections 2021-11-15T19:31:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 --2- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed40aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 --2- 172.21.2.137:0/1296309655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed40b1340 0x7efed4147980 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 -- 172.21.2.137:0/1296309655 >> 172.21.2.137:0/1296309655 conn(0x7efed40b4e60 msgr2=0x7efed40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 -- 172.21.2.137:0/1296309655 shutdown_connections 2021-11-15T19:31:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 -- 172.21.2.137:0/1296309655 wait complete. 2021-11-15T19:31:43.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 Processor -- start 2021-11-15T19:31:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.272+0000 7efed9d96700 1 -- start start 2021-11-15T19:31:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed4099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 0x7efed414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed4143f00 0x7efed40aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40adf00 con 0x7efed4143f00 2021-11-15T19:31:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40ad0b0 con 0x7efed40b1340 2021-11-15T19:31:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40ad350 con 0x7efed40a9f50 2021-11-15T19:31:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 0x7efed414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 0x7efed414aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34876/0 (socket says 172.21.2.137:34876) 2021-11-15T19:31:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 -- 172.21.2.137:0/4288901588 learned_addr learned my addr 172.21.2.137:0/4288901588 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed3fff700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed4143f00 0x7efed40aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed37fe700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed4099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 -- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 msgr2=0x7efed4099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed4099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 -- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed4143f00 msgr2=0x7efed40aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed4143f00 0x7efed40aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 -- 172.21.2.137:0/4288901588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc00b1e0 con 0x7efed40b1340 2021-11-15T19:31:43.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed2ffd700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 0x7efed414aae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7efed4062250 tx=0x7efec4007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec400ce00 con 0x7efed40b1340 2021-11-15T19:31:43.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4007240 con 0x7efed40b1340 2021-11-15T19:31:43.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec4006700 con 0x7efed40b1340 2021-11-15T19:31:43.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed40aeb40 con 0x7efed40b1340 2021-11-15T19:31:43.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed40ac2a0 con 0x7efed40b1340 2021-11-15T19:31:43.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed40ad550 con 0x7efed40b1340 2021-11-15T19:31:43.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efec4006860 con 0x7efed40b1340 2021-11-15T19:31:43.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed0ff9700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efeb8053610 0x7efeb8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efec406b020 con 0x7efed40b1340 2021-11-15T19:31:43.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.276+0000 7efed37fe700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efeb8053610 0x7efeb8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.280+0000 7efed37fe700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efeb8053610 0x7efeb8055ad0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7efebc01a000 tx=0x7efebc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.280+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efec4042350 con 0x7efed40b1340 2021-11-15T19:31:43.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.388+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efed4148190 con 0x7efed40b1340 2021-11-15T19:31:43.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.388+0000 7efed0ff9700 1 -- 172.21.2.137:0/4288901588 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1209 (secure 0 0 0) 0x7efed4148190 con 0x7efed40b1340 2021-11-15T19:31:43.395 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:43.395 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1474978539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1474978539},{"type":"v1","addr":"172.21.2.111:6835","nonce":1474978539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19},{"gid":5815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/4106739013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4106739013},{"type":"v1","addr":"172.21.2.137:6833","nonce":4106739013}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2021-11-15T19:31:43.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efeb8053610 msgr2=0x7efeb8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efeb8053610 0x7efeb8055ad0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7efebc01a000 tx=0x7efebc015000).stop 2021-11-15T19:31:43.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 msgr2=0x7efed414aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 0x7efed414aae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7efed4062250 tx=0x7efec4007be0).stop 2021-11-15T19:31:43.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 shutdown_connections 2021-11-15T19:31:43.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efeb8053610 0x7efeb8055ad0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efed4143f00 0x7efed40aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efed40b1340 0x7efed414aae0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 --2- 172.21.2.137:0/4288901588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efed40a9f50 0x7efed4099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 >> 172.21.2.137:0/4288901588 conn(0x7efed40b4e60 msgr2=0x7efed40af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:43.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 shutdown_connections 2021-11-15T19:31:43.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.392+0000 7efed9d96700 1 -- 172.21.2.137:0/4288901588 wait complete. 2021-11-15T19:31:43.399 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 23 2021-11-15T19:31:43.402 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:31:43.402 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:31:43.403 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:31:43.403 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:31:43.403 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:31:43.404 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:31:43.404 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:31:43.404 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:31:43.408 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:31:43.408 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:31:43.410 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:31:43.410 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:31:43.452 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:31:43.453 DEBUG:teuthology.parallel:result is None 2021-11-15T19:31:43.456 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:31:43.457 DEBUG:teuthology.parallel:result is None 2021-11-15T19:31:43.457 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:31:43.490 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:31:43.494 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:31:43.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe6646d1700 1 Processor -- start 2021-11-15T19:31:43.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe6646d1700 1 -- start start 2021-11-15T19:31:43.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe6646d1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0b1f00 0x7fe65c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe6646d1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c146030 con 0x7fe65c06a280 2021-11-15T19:31:43.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe6646d1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c1462d0 con 0x7fe65c065810 2021-11-15T19:31:43.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe6646d1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c146570 con 0x7fe65c0b1f00 2021-11-15T19:31:43.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe662c6e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe65c065810 0x7fe65c142a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53676/0 (socket says 172.21.2.137:53676) 2021-11-15T19:31:43.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe662c6e700 1 -- 172.21.2.137:0/500832262 learned_addr learned my addr 172.21.2.137:0/500832262 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:43.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe66246d700 1 --2- 172.21.2.137:0/500832262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0b1f00 0x7fe65c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe66246d700 1 -- 172.21.2.137:0/500832262 >> v1:172.21.2.137:6789/0 conn(0x7fe65c065810 legacy=0x7fe65c142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe66246d700 1 -- 172.21.2.137:0/500832262 >> v1:172.21.2.111:6789/0 conn(0x7fe65c06a280 legacy=0x7fe65c065100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe66246d700 1 -- 172.21.2.137:0/500832262 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0b29e0 con 0x7fe65c0b1f00 2021-11-15T19:31:43.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.508+0000 7fe66246d700 1 --2- 172.21.2.137:0/500832262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0b1f00 0x7fe65c0b22e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe658002f70 tx=0x7fe658006df0).ready entity=mon.2 client_cookie=71aee4cd5ba508c2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe66146b700 1 -- 172.21.2.137:0/500832262 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65800d5c0 con 0x7fe65c0b1f00 2021-11-15T19:31:43.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe66146b700 1 -- 172.21.2.137:0/500832262 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe658000e90 con 0x7fe65c0b1f00 2021-11-15T19:31:43.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe66146b700 1 -- 172.21.2.137:0/500832262 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65800d910 con 0x7fe65c0b1f00 2021-11-15T19:31:43.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/500832262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0b1f00 msgr2=0x7fe65c0b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 --2- 172.21.2.137:0/500832262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0b1f00 0x7fe65c0b22e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe658002f70 tx=0x7fe658006df0).stop 2021-11-15T19:31:43.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/500832262 shutdown_connections 2021-11-15T19:31:43.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 --2- 172.21.2.137:0/500832262 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0b1f00 0x7fe65c0b22e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/500832262 >> 172.21.2.137:0/500832262 conn(0x7fe65c060290 msgr2=0x7fe65c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:43.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/500832262 shutdown_connections 2021-11-15T19:31:43.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/500832262 wait complete. 2021-11-15T19:31:43.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 Processor -- start 2021-11-15T19:31:43.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- start start 2021-11-15T19:31:43.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe65c06a280 0x7fe65c0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe65c0b1f00 0x7fe65c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0ac910 0x7fe65c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0afc50 con 0x7fe65c06a280 2021-11-15T19:31:43.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c1558a0 con 0x7fe65c0b1f00 2021-11-15T19:31:43.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c1520d0 con 0x7fe65c0ac910 2021-11-15T19:31:43.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe66246d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe65c06a280 0x7fe65c0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe65c0b1f00 0x7fe65c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe66246d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe65c06a280 0x7fe65c0b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:42126/0 (socket says 172.21.2.137:42126) 2021-11-15T19:31:43.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe66246d700 1 -- 172.21.2.137:0/2444102849 learned_addr learned my addr 172.21.2.137:0/2444102849 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:43.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe662c6e700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0ac910 0x7fe65c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 -- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0ac910 msgr2=0x7fe65c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0ac910 0x7fe65c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 -- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe65c06a280 msgr2=0x7fe65c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:43.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe65c06a280 0x7fe65c0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:43.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 -- 172.21.2.137:0/2444102849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65800b180 con 0x7fe65c0b1f00 2021-11-15T19:31:43.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe661c6c700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe65c0b1f00 0x7fe65c0ace20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fe65c060dc0 tx=0x7fe64c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c012400 con 0x7fe65c0b1f00 2021-11-15T19:31:43.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c012560 con 0x7fe65c0b1f00 2021-11-15T19:31:43.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c152370 con 0x7fe65c0b1f00 2021-11-15T19:31:43.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64c0128c0 con 0x7fe65c0b1f00 2021-11-15T19:31:43.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.512+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c0b4ea0 con 0x7fe65c0b1f00 2021-11-15T19:31:43.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c152500 con 0x7fe65c0b1f00 2021-11-15T19:31:43.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe64c019030 con 0x7fe65c0b1f00 2021-11-15T19:31:43.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe64b7fe700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe63c0536a0 0x7fe63c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:43.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe64c06a9e0 con 0x7fe65c0b1f00 2021-11-15T19:31:43.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe66246d700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe63c0536a0 0x7fe63c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:43.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe66246d700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe63c0536a0 0x7fe63c055b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe65801c000 tx=0x7fe658015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:43.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.516+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe64c041d10 con 0x7fe65c0b1f00 2021-11-15T19:31:43.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:43.608+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe65c0573d0 con 0x7fe65c0b1f00 2021-11-15T19:31:44.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.524+0000 7fe64b7fe700 1 -- 172.21.2.137:0/2444102849 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe64c045330 con 0x7fe65c0b1f00 2021-11-15T19:31:44.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe63c0536a0 msgr2=0x7fe63c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe63c0536a0 0x7fe63c055b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe65801c000 tx=0x7fe658015000).stop 2021-11-15T19:31:44.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe65c0b1f00 msgr2=0x7fe65c0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe65c0b1f00 0x7fe65c0ace20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fe65c060dc0 tx=0x7fe64c007b90).stop 2021-11-15T19:31:44.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 shutdown_connections 2021-11-15T19:31:44.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe63c0536a0 0x7fe63c055b60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe65c0ac910 0x7fe65c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe65c0b1f00 0x7fe65c0ace20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 --2- 172.21.2.137:0/2444102849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe65c06a280 0x7fe65c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 >> 172.21.2.137:0/2444102849 conn(0x7fe65c060290 msgr2=0x7fe65c065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:44.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 shutdown_connections 2021-11-15T19:31:44.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.528+0000 7fe6646d1700 1 -- 172.21.2.137:0/2444102849 wait complete. 2021-11-15T19:31:44.535 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:31:44.538 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:31:44.539 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:31:44.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.584+0000 7f28d2eba700 1 Processor -- start 2021-11-15T19:31:44.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.584+0000 7f28d2eba700 1 -- start start 2021-11-15T19:31:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0b1340 0x7f28cc147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f28cc0a9f50 0x7f28cc0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc148190 con 0x7f28cc143f00 2021-11-15T19:31:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0b1720 con 0x7f28cc0a9f50 2021-11-15T19:31:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc147e70 con 0x7f28cc0b1340 2021-11-15T19:31:44.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f28cc143f00 0x7f28cc144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53690/0 (socket says 172.21.2.137:53690) 2021-11-15T19:31:44.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 -- 172.21.2.137:0/4047710541 learned_addr learned my addr 172.21.2.137:0/4047710541 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:44.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d1457700 1 --2- 172.21.2.137:0/4047710541 >> v2:172.21.2.137:3300/0 conn(0x7f28cc0a9f50 0x7f28cc0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d1457700 1 -- 172.21.2.137:0/4047710541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0b1340 msgr2=0x7f28cc147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d1457700 1 --2- 172.21.2.137:0/4047710541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0b1340 0x7f28cc147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d1457700 1 -- 172.21.2.137:0/4047710541 >> v1:172.21.2.137:6789/0 conn(0x7f28cc143f00 legacy=0x7f28cc144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d1457700 1 -- 172.21.2.137:0/4047710541 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0af800 con 0x7f28cc0a9f50 2021-11-15T19:31:44.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d1457700 1 --2- 172.21.2.137:0/4047710541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0a9f50 0x7f28cc0aa370 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f28c40032f0 tx=0x7f28c40091d0).ready entity=mon.1 client_cookie=4b65b9e6598a0411 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cb7fe700 1 -- 172.21.2.137:0/4047710541 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c4009ea0 con 0x7f28cc0a9f50 2021-11-15T19:31:44.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cb7fe700 1 -- 172.21.2.137:0/4047710541 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400b8a0 con 0x7f28cc0a9f50 2021-11-15T19:31:44.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cb7fe700 1 -- 172.21.2.137:0/4047710541 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c400ba10 con 0x7f28cc0a9f50 2021-11-15T19:31:44.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/4047710541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0a9f50 msgr2=0x7f28cc0aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- 172.21.2.137:0/4047710541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0a9f50 0x7f28cc0aa370 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f28c40032f0 tx=0x7f28c40091d0).stop 2021-11-15T19:31:44.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/4047710541 shutdown_connections 2021-11-15T19:31:44.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- 172.21.2.137:0/4047710541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0a9f50 0x7f28cc0aa370 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- 172.21.2.137:0/4047710541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0b1340 0x7f28cc147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/4047710541 >> 172.21.2.137:0/4047710541 conn(0x7f28cc0b4e60 msgr2=0x7f28cc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:44.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/4047710541 shutdown_connections 2021-11-15T19:31:44.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/4047710541 wait complete. 2021-11-15T19:31:44.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 Processor -- start 2021-11-15T19:31:44.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- start start 2021-11-15T19:31:44.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0a9f50 0x7f28cc09a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 0x7f28cc148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28cc143f00 0x7f28cc148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc14aed0 con 0x7f28cc143f00 2021-11-15T19:31:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0adb60 con 0x7f28cc0b1340 2021-11-15T19:31:44.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0adee0 con 0x7f28cc0a9f50 2021-11-15T19:31:44.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 0x7f28cc148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 0x7f28cc148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34914/0 (socket says 172.21.2.137:34914) 2021-11-15T19:31:44.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 -- 172.21.2.137:0/419403553 learned_addr learned my addr 172.21.2.137:0/419403553 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:44.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 -- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0a9f50 msgr2=0x7f28cc09a750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0a9f50 0x7f28cc09a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 -- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28cc143f00 msgr2=0x7f28cc148a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:31:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28cc143f00 0x7f28cc148a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 -- 172.21.2.137:0/419403553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4009470 con 0x7f28cc0b1340 2021-11-15T19:31:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28cbfff700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 0x7f28cc148510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f28cc05cfa0 tx=0x7f28bc007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28bc00ce30 con 0x7f28cc0b1340 2021-11-15T19:31:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0072e0 con 0x7f28cc0b1340 2021-11-15T19:31:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc14b100 con 0x7f28cc0b1340 2021-11-15T19:31:44.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc0af0d0 con 0x7f28cc0b1340 2021-11-15T19:31:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28bc005800 con 0x7f28cc0b1340 2021-11-15T19:31:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.588+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a4003410 con 0x7f28cc0b1340 2021-11-15T19:31:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.592+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28bc010070 con 0x7f28cc0b1340 2021-11-15T19:31:44.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.592+0000 7f28c9ffb700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b00536f0 0x7f28b0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.592+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f28bc06ac10 con 0x7f28cc0b1340 2021-11-15T19:31:44.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.592+0000 7f28d0c56700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b00536f0 0x7f28b0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.592+0000 7f28d0c56700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b00536f0 0x7f28b0055bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f28b4002f70 tx=0x7f28b4006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.592+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28bc041f90 con 0x7f28cc0b1340 2021-11-15T19:31:44.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.704+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f28a40036c0 con 0x7f28cc0b1340 2021-11-15T19:31:44.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.704+0000 7f28c9ffb700 1 -- 172.21.2.137:0/419403553 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f28bc0455b0 con 0x7f28cc0b1340 2021-11-15T19:31:44.710 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:44.711 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:31:44.711 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:31:44.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.711 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:31:44.712 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:31:44.712 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.712 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:31:44.712 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.713 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.713 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.713 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.713 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.714 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.714 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:31:44.714 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:31:44.714 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.715 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:31:44.715 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.715 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.715 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.716 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.716 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.716 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.716 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:31:44.717 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:31:44.717 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.717 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.717 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.718 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.718 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.718 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.718 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.719 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:31:44.719 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:31:44.719 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.719 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.720 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.720 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.720 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.721 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.721 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:31:44.721 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:31:44.721 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.722 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.722 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.722 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.722 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.723 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.723 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:31:44.723 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:31:44.724 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.724 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.724 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.724 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.725 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.725 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.725 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.725 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:31:44.725 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:31:44.726 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.726 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.726 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.726 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.727 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.727 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.727 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:31:44.728 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:31:44.728 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.728 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.728 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.729 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.729 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.729 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.729 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:31:44.730 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:31:44.730 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.730 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.730 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.731 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.731 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.731 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.731 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.732 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:31:44.732 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:31:44.732 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.732 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.732 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.733 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.733 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.733 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.733 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.734 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:31:44.734 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:31:44.734 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.734 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:31:44.735 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:31:44.735 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:31:44.735 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.735 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.736 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.736 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:31:44.736 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:31:44.736 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.736 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:31:44.737 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:31:44.737 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:31:44.737 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.737 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.738 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.738 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:31:44.738 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:31:44.738 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.739 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:31:44.739 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:31:44.739 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:31:44.739 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.740 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.740 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.740 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:31:44.740 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:31:44.741 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.741 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:31:44.741 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:31:44.741 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:31:44.741 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.742 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.742 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.742 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.742 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:31:44.743 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:31:44.743 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.743 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:31:44.743 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:31:44.744 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.744 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.744 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:44.744 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:44.745 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:31:44.745 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:31:44.745 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:31:44.745 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:31:44.746 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:31:44.746 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:31:44.746 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.746 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:44.747 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:31:44.747 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:31:44.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b00536f0 msgr2=0x7f28b0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b00536f0 0x7f28b0055bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f28b4002f70 tx=0x7f28b4006960).stop 2021-11-15T19:31:44.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 msgr2=0x7f28cc148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 0x7f28cc148510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f28cc05cfa0 tx=0x7f28bc007c40).stop 2021-11-15T19:31:44.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 shutdown_connections 2021-11-15T19:31:44.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b00536f0 0x7f28b0055bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28cc143f00 0x7f28cc148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28cc0b1340 0x7f28cc148510 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 --2- 172.21.2.137:0/419403553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28cc0a9f50 0x7f28cc09a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 >> 172.21.2.137:0/419403553 conn(0x7f28cc0b4e60 msgr2=0x7f28cc0afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:44.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 shutdown_connections 2021-11-15T19:31:44.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.708+0000 7f28d2eba700 1 -- 172.21.2.137:0/419403553 wait complete. 2021-11-15T19:31:44.752 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:31:44.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.796+0000 7fb05e883700 1 Processor -- start 2021-11-15T19:31:44.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.796+0000 7fb05e883700 1 -- start start 2021-11-15T19:31:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb0580b1340 0x7fb058147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb0580a9f50 0x7fb0580aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb058148190 con 0x7fb058143f00 2021-11-15T19:31:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0580b1720 con 0x7fb0580a9f50 2021-11-15T19:31:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb058147e70 con 0x7fb0580b1340 2021-11-15T19:31:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb0580b1340 0x7fb058147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb0580b1340 0x7fb058147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34922/0 (socket says 172.21.2.137:34922) 2021-11-15T19:31:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 -- 172.21.2.137:0/1991972145 learned_addr learned my addr 172.21.2.137:0/1991972145 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 -- 172.21.2.137:0/1991972145 >> v2:172.21.2.111:3300/0 conn(0x7fb0580a9f50 msgr2=0x7fb0580aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 --2- 172.21.2.137:0/1991972145 >> v2:172.21.2.111:3300/0 conn(0x7fb0580a9f50 0x7fb0580aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 -- 172.21.2.137:0/1991972145 >> v1:172.21.2.111:6789/0 conn(0x7fb058143f00 legacy=0x7fb058144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 -- 172.21.2.137:0/1991972145 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580af800 con 0x7fb0580b1340 2021-11-15T19:31:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb057fff700 1 --2- 172.21.2.137:0/1991972145 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb058147980 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fb058062250 tx=0x7fb050009290).ready entity=mon.1 client_cookie=7528cd75bef044f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb056ffd700 1 -- 172.21.2.137:0/1991972145 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb05000b830 con 0x7fb0580b1340 2021-11-15T19:31:44.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb056ffd700 1 -- 172.21.2.137:0/1991972145 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05000b990 con 0x7fb0580b1340 2021-11-15T19:31:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb056ffd700 1 -- 172.21.2.137:0/1991972145 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb05000bb40 con 0x7fb0580b1340 2021-11-15T19:31:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1991972145 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 msgr2=0x7fb058147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- 172.21.2.137:0/1991972145 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb058147980 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fb058062250 tx=0x7fb050009290).stop 2021-11-15T19:31:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1991972145 shutdown_connections 2021-11-15T19:31:44.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- 172.21.2.137:0/1991972145 >> v2:172.21.2.111:3300/0 conn(0x7fb0580a9f50 0x7fb0580aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- 172.21.2.137:0/1991972145 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb058147980 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1991972145 >> 172.21.2.137:0/1991972145 conn(0x7fb0580b4e60 msgr2=0x7fb0580b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1991972145 shutdown_connections 2021-11-15T19:31:44.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1991972145 wait complete. 2021-11-15T19:31:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 Processor -- start 2021-11-15T19:31:44.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- start start 2021-11-15T19:31:44.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0580a9f50 0x7fb058159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb0581464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb058143f00 0x7fb058140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05814a140 con 0x7fb058143f00 2021-11-15T19:31:44.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05814a6a0 con 0x7fb0580b1340 2021-11-15T19:31:44.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0581495f0 con 0x7fb0580a9f50 2021-11-15T19:31:44.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb0581464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb0581464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34926/0 (socket says 172.21.2.137:34926) 2021-11-15T19:31:44.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 -- 172.21.2.137:0/1820597849 learned_addr learned my addr 172.21.2.137:0/1820597849 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:44.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 -- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0580a9f50 msgr2=0x7fb058159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0580a9f50 0x7fb058159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 -- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb058143f00 msgr2=0x7fb058140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb058143f00 0x7fb058140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 -- 172.21.2.137:0/1820597849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009530 con 0x7fb0580b1340 2021-11-15T19:31:44.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0577fe700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb0581464d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb040000f70 tx=0x7fb040007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb04000ce80 con 0x7fb0580b1340 2021-11-15T19:31:44.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040013450 con 0x7fb0580b1340 2021-11-15T19:31:44.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb058142df0 con 0x7fb0580b1340 2021-11-15T19:31:44.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0400137b0 con 0x7fb0580b1340 2021-11-15T19:31:44.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.800+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0580ac440 con 0x7fb0580b1340 2021-11-15T19:31:44.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05805faf0 con 0x7fb0580b1340 2021-11-15T19:31:44.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb04001a060 con 0x7fb0580b1340 2021-11-15T19:31:44.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb0557fa700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb03c053640 0x7fb03c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb04006ae90 con 0x7fb0580b1340 2021-11-15T19:31:44.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb057fff700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb03c053640 0x7fb03c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb057fff700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb03c053640 0x7fb03c055b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fb058062250 tx=0x7fb050016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.804+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb040042320 con 0x7fb0580b1340 2021-11-15T19:31:44.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0580573d0 con 0x7fb0580b1340 2021-11-15T19:31:44.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb0557fa700 1 -- 172.21.2.137:0/1820597849 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13182 (secure 0 0 0) 0x7fb040018020 con 0x7fb0580b1340 2021-11-15T19:31:44.893 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:44.893 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":58,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:31:44.516035+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:31:44.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb03c053640 msgr2=0x7fb03c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb03c053640 0x7fb03c055b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fb058062250 tx=0x7fb050016000).stop 2021-11-15T19:31:44.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 msgr2=0x7fb0581464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb0581464d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb040000f70 tx=0x7fb040007c30).stop 2021-11-15T19:31:44.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 shutdown_connections 2021-11-15T19:31:44.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb03c053640 0x7fb03c055b00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb058143f00 0x7fb058140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0580b1340 0x7fb0581464d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 --2- 172.21.2.137:0/1820597849 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0580a9f50 0x7fb058159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 >> 172.21.2.137:0/1820597849 conn(0x7fb0580b4e60 msgr2=0x7fb05813efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:44.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 shutdown_connections 2021-11-15T19:31:44.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.888+0000 7fb05e883700 1 -- 172.21.2.137:0/1820597849 wait complete. 2021-11-15T19:31:44.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:31:44.901 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:31:44.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 Processor -- start 2021-11-15T19:31:44.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 -- start start 2021-11-15T19:31:44.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e980b0550 0x7f8e9814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8e9814aaa0 0x7f8e98140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9805cb50 con 0x7f8e9805c770 2021-11-15T19:31:44.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980b1650 con 0x7f8e9814aaa0 2021-11-15T19:31:44.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e9e08a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980ad030 con 0x7f8e980b0550 2021-11-15T19:31:44.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e977fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8e9805c770 0x7f8e980aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53716/0 (socket says 172.21.2.137:53716) 2021-11-15T19:31:44.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.948+0000 7f8e977fe700 1 -- 172.21.2.137:0/1973857780 learned_addr learned my addr 172.21.2.137:0/1973857780 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:44.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101572320 0 0) 0x7f8e9805cb50 con 0x7f8e9805c770 2021-11-15T19:31:44.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e78003260 con 0x7f8e9805c770 2021-11-15T19:31:44.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 --2- 172.21.2.137:0/1973857780 >> v2:172.21.2.111:3300/0 conn(0x7f8e9814aaa0 0x7f8e98140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2229634219 0 0) 0x7f8e78003260 con 0x7f8e9805c770 2021-11-15T19:31:44.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e980b0550 msgr2=0x7f8e9814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e980b0550 0x7f8e9814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 >> v2:172.21.2.111:3300/0 conn(0x7f8e9814aaa0 msgr2=0x7f8e98140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 --2- 172.21.2.137:0/1973857780 >> v2:172.21.2.111:3300/0 conn(0x7f8e9814aaa0 0x7f8e98140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:44.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980ad2d0 con 0x7f8e9805c770 2021-11-15T19:31:44.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8e88001660 con 0x7f8e9805c770 2021-11-15T19:31:44.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 --2- 172.21.2.137:0/1973857780 >> v2:172.21.2.111:3300/0 conn(0x7f8e9814aaa0 0x7f8e98140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:44.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 >> v1:172.21.2.137:6789/0 conn(0x7f8e9805c770 legacy=0x7f8e980aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e980b0550 0x7f8e780037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e78003ee0 0x7f8e78004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e7800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b1650 con 0x7f8e78003ee0 2021-11-15T19:31:44.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980ad030 con 0x7f8e78004bf0 2021-11-15T19:31:44.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780053a0 con 0x7f8e980b0550 2021-11-15T19:31:44.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e7800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 -- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e980b0550 msgr2=0x7f8e780037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e980b0550 0x7f8e780037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 -- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e78003ee0 msgr2=0x7f8e78004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:44.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e78003ee0 0x7f8e78004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 -- 172.21.2.137:0/1973857780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78003260 con 0x7f8e78004bf0 2021-11-15T19:31:44.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e7800b750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f8e90007000 tx=0x7f8e90008040).ready entity=mon.1 client_cookie=1fc7c0e2e7724cde server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9000c710 con 0x7f8e78004bf0 2021-11-15T19:31:44.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000c870 con 0x7f8e78004bf0 2021-11-15T19:31:44.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e967fc700 1 -- 172.21.2.137:0/1973857780 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9000c9e0 con 0x7f8e78004bf0 2021-11-15T19:31:44.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- 172.21.2.137:0/1973857780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 msgr2=0x7f8e7800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/1973857780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e7800b750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f8e90007000 tx=0x7f8e90008040).stop 2021-11-15T19:31:44.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e97fff700 1 -- 172.21.2.137:0/1973857780 reap_dead start 2021-11-15T19:31:44.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- 172.21.2.137:0/1973857780 shutdown_connections 2021-11-15T19:31:44.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- 172.21.2.137:0/1973857780 >> 172.21.2.137:0/1973857780 conn(0x7f8e980631e0 msgr2=0x7f8e9805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:44.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- 172.21.2.137:0/1973857780 shutdown_connections 2021-11-15T19:31:44.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- 172.21.2.137:0/1973857780 wait complete. 2021-11-15T19:31:44.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 Processor -- start 2021-11-15T19:31:44.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- start start 2021-11-15T19:31:44.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e980b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e980672b0 0x7f8e9815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e981567d0 0x7f8e98156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980646f0 con 0x7f8e980672b0 2021-11-15T19:31:44.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9815aab0 con 0x7f8e78004bf0 2021-11-15T19:31:44.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98066170 con 0x7f8e981567d0 2021-11-15T19:31:44.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e980b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e980b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34948/0 (socket says 172.21.2.137:34948) 2021-11-15T19:31:44.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 -- 172.21.2.137:0/3070005710 learned_addr learned my addr 172.21.2.137:0/3070005710 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:44.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 -- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e981567d0 msgr2=0x7f8e98156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e981567d0 0x7f8e98156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 -- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e980672b0 msgr2=0x7f8e9815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:44.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e980672b0 0x7f8e9815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:44.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 -- 172.21.2.137:0/3070005710 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98066410 con 0x7f8e78004bf0 2021-11-15T19:31:44.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e977fe700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e980b57e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f8e980669c0 tx=0x7f8e88001b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e88007170 con 0x7f8e78004bf0 2021-11-15T19:31:44.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880072d0 con 0x7f8e78004bf0 2021-11-15T19:31:44.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e980666b0 con 0x7f8e78004bf0 2021-11-15T19:31:44.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.952+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e88004920 con 0x7f8e78004bf0 2021-11-15T19:31:44.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e98157360 con 0x7f8e78004bf0 2021-11-15T19:31:44.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e980adc40 con 0x7f8e78004bf0 2021-11-15T19:31:44.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8e8801b070 con 0x7f8e78004bf0 2021-11-15T19:31:44.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e94ff9700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8e7c0536d0 0x7f8e7c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:44.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8e8806b0b0 con 0x7f8e78004bf0 2021-11-15T19:31:44.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e96ffd700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8e7c0536d0 0x7f8e7c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:44.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e96ffd700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8e7c0536d0 0x7f8e7c055b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f8e80002f70 tx=0x7f8e80006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:44.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:44.956+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e880423d0 con 0x7f8e78004bf0 2021-11-15T19:31:45.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8e980ae7f0 con 0x7f8e78004bf0 2021-11-15T19:31:45.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e94ff9700 1 -- 172.21.2.137:0/3070005710 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8e88001c70 con 0x7f8e78004bf0 2021-11-15T19:31:45.046 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:31:45.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8e7c0536d0 msgr2=0x7f8e7c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8e7c0536d0 0x7f8e7c055b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f8e80002f70 tx=0x7f8e80006a00).stop 2021-11-15T19:31:45.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 msgr2=0x7f8e980b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e980b57e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f8e980669c0 tx=0x7f8e88001b30).stop 2021-11-15T19:31:45.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 shutdown_connections 2021-11-15T19:31:45.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8e7c0536d0 0x7f8e7c055b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8e981567d0 0x7f8e98156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8e980672b0 0x7f8e9815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 --2- 172.21.2.137:0/3070005710 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8e78004bf0 0x7f8e980b57e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 >> 172.21.2.137:0/3070005710 conn(0x7f8e980631e0 msgr2=0x7f8e98146c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:45.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 shutdown_connections 2021-11-15T19:31:45.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.040+0000 7f8e9e08a700 1 -- 172.21.2.137:0/3070005710 wait complete. 2021-11-15T19:31:45.055 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:31:45.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 Processor -- start 2021-11-15T19:31:45.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- start start 2021-11-15T19:31:45.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff35005c770 0x7ff3500aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 0x7ff35014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff35014aaa0 0x7ff350140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500b1650 con 0x7ff35005c770 2021-11-15T19:31:45.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35005cb50 con 0x7ff35014aaa0 2021-11-15T19:31:45.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500ad030 con 0x7ff3500b0550 2021-11-15T19:31:45.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff35014aaa0 0x7ff350140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff35014aaa0 0x7ff350140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34954/0 (socket says 172.21.2.137:34954) 2021-11-15T19:31:45.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 -- 172.21.2.137:0/199032869 learned_addr learned my addr 172.21.2.137:0/199032869 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:45.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 -- 172.21.2.137:0/199032869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 msgr2=0x7ff35014a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:31:45.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 --2- 172.21.2.137:0/199032869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 0x7ff35014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 -- 172.21.2.137:0/199032869 >> v2:172.21.2.111:3300/0 conn(0x7ff35005c770 msgr2=0x7ff3500aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:31:45.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 --2- 172.21.2.137:0/199032869 >> v2:172.21.2.111:3300/0 conn(0x7ff35005c770 0x7ff3500aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 -- 172.21.2.137:0/199032869 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500ad2d0 con 0x7ff35014aaa0 2021-11-15T19:31:45.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34ffff700 1 --2- 172.21.2.137:0/199032869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff350140aa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7ff3480032f0 tx=0x7ff348009290).ready entity=mon.1 client_cookie=6d395f686e69c5fd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34e7fc700 1 -- 172.21.2.137:0/199032869 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34800b870 con 0x7ff35014aaa0 2021-11-15T19:31:45.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34e7fc700 1 -- 172.21.2.137:0/199032869 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34800b9d0 con 0x7ff35014aaa0 2021-11-15T19:31:45.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff34e7fc700 1 -- 172.21.2.137:0/199032869 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34800bb80 con 0x7ff35014aaa0 2021-11-15T19:31:45.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- 172.21.2.137:0/199032869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 msgr2=0x7ff350140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- 172.21.2.137:0/199032869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff350140aa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7ff3480032f0 tx=0x7ff348009290).stop 2021-11-15T19:31:45.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- 172.21.2.137:0/199032869 shutdown_connections 2021-11-15T19:31:45.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- 172.21.2.137:0/199032869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff350140aa0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- 172.21.2.137:0/199032869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 0x7ff35014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 --2- 172.21.2.137:0/199032869 >> v2:172.21.2.111:3300/0 conn(0x7ff35005c770 0x7ff3500aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- 172.21.2.137:0/199032869 >> 172.21.2.137:0/199032869 conn(0x7ff3500631e0 msgr2=0x7ff35005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:45.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- 172.21.2.137:0/199032869 shutdown_connections 2021-11-15T19:31:45.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.104+0000 7ff355ed9700 1 -- 172.21.2.137:0/199032869 wait complete. 2021-11-15T19:31:45.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 Processor -- start 2021-11-15T19:31:45.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- start start 2021-11-15T19:31:45.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff35005c770 0x7ff350063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 0x7ff3500643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff35013ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350145bc0 con 0x7ff35005c770 2021-11-15T19:31:45.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350157460 con 0x7ff35014aaa0 2021-11-15T19:31:45.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff350157700 con 0x7ff3500b0550 2021-11-15T19:31:45.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff35013ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff35013ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34964/0 (socket says 172.21.2.137:34964) 2021-11-15T19:31:45.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 -- 172.21.2.137:0/2808262093 learned_addr learned my addr 172.21.2.137:0/2808262093 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:45.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 -- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 msgr2=0x7ff3500643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 0x7ff3500643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 -- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff35005c770 msgr2=0x7ff350063ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff35005c770 0x7ff350063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 -- 172.21.2.137:0/2808262093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009530 con 0x7ff35014aaa0 2021-11-15T19:31:45.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34ffff700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff35013ff50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7ff3480032f0 tx=0x7ff348016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34800b870 con 0x7ff35014aaa0 2021-11-15T19:31:45.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348021620 con 0x7ff35014aaa0 2021-11-15T19:31:45.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3501570e0 con 0x7ff35014aaa0 2021-11-15T19:31:45.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff348021980 con 0x7ff35014aaa0 2021-11-15T19:31:45.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff350140440 con 0x7ff35014aaa0 2021-11-15T19:31:45.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff350145d30 con 0x7ff35014aaa0 2021-11-15T19:31:45.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff348028070 con 0x7ff35014aaa0 2021-11-15T19:31:45.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34cff9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff334053610 0x7ff334055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff34806c5c0 con 0x7ff35014aaa0 2021-11-15T19:31:45.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.108+0000 7ff34f7fe700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff334053610 0x7ff334055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.112+0000 7ff34f7fe700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff334053610 0x7ff334055ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7ff340002ef0 tx=0x7ff340006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.112+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff348043a50 con 0x7ff35014aaa0 2021-11-15T19:31:45.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.196+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3500ae7f0 con 0x7ff35014aaa0 2021-11-15T19:31:45.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.196+0000 7ff34cff9700 1 -- 172.21.2.137:0/2808262093 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff348015020 con 0x7ff35014aaa0 2021-11-15T19:31:45.203 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:31:45.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff334053610 msgr2=0x7ff334055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff334053610 0x7ff334055ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7ff340002ef0 tx=0x7ff340006910).stop 2021-11-15T19:31:45.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 msgr2=0x7ff35013ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff35013ff50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7ff3480032f0 tx=0x7ff348016000).stop 2021-11-15T19:31:45.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 shutdown_connections 2021-11-15T19:31:45.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff334053610 0x7ff334055ad0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff35014aaa0 0x7ff35013ff50 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3500b0550 0x7ff3500643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 --2- 172.21.2.137:0/2808262093 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff35005c770 0x7ff350063ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 >> 172.21.2.137:0/2808262093 conn(0x7ff3500631e0 msgr2=0x7ff35014db50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:45.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 shutdown_connections 2021-11-15T19:31:45.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.200+0000 7ff355ed9700 1 -- 172.21.2.137:0/2808262093 wait complete. 2021-11-15T19:31:45.212 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:31:45.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 Processor -- start 2021-11-15T19:31:45.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 -- start start 2021-11-15T19:31:45.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7b180b1340 0x7f7b18147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b18143f00 0x7f7b18144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b18148190 con 0x7f7b180a9f50 2021-11-15T19:31:45.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180b1720 con 0x7f7b180b1340 2021-11-15T19:31:45.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b1dec1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18147e70 con 0x7f7b18143f00 2021-11-15T19:31:45.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b177fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7b180b1340 0x7f7b18147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b177fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7b180b1340 0x7f7b18147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:42196/0 (socket says 172.21.2.137:42196) 2021-11-15T19:31:45.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b16ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b18143f00 0x7f7b18144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b17fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f7b180a9f50 0x7f7b180aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:46242/0 (socket says 172.21.2.137:46242) 2021-11-15T19:31:45.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.260+0000 7f7b177fe700 1 -- 172.21.2.137:0/1174959305 learned_addr learned my addr 172.21.2.137:0/1174959305 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:45.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b18143f00 msgr2=0x7f7b18144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:45.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b18143f00 0x7f7b18144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1174959305 >> v1:172.21.2.111:6789/0 conn(0x7f7b180a9f50 legacy=0x7f7b180aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1174959305 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180af800 con 0x7f7b180b1340 2021-11-15T19:31:45.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b180b1340 0x7f7b18147980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7b08002f70 tx=0x7f7b08006eb0).ready entity=mon.0 client_cookie=79eee93880691926 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b167fc700 1 -- 172.21.2.137:0/1174959305 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0800d570 con 0x7f7b180b1340 2021-11-15T19:31:45.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b167fc700 1 -- 172.21.2.137:0/1174959305 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b08000e90 con 0x7f7b180b1340 2021-11-15T19:31:45.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b167fc700 1 -- 172.21.2.137:0/1174959305 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0800d900 con 0x7f7b180b1340 2021-11-15T19:31:45.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b180b1340 msgr2=0x7f7b18147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b180b1340 0x7f7b18147980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7b08002f70 tx=0x7f7b08006eb0).stop 2021-11-15T19:31:45.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1174959305 shutdown_connections 2021-11-15T19:31:45.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b18143f00 0x7f7b18144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1174959305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b180b1340 0x7f7b18147980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1174959305 >> 172.21.2.137:0/1174959305 conn(0x7f7b180b4e60 msgr2=0x7f7b180b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:45.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1174959305 shutdown_connections 2021-11-15T19:31:45.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1174959305 wait complete. 2021-11-15T19:31:45.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 Processor -- start 2021-11-15T19:31:45.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- start start 2021-11-15T19:31:45.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 0x7f7b18149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b180b1340 0x7f7b180983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b18143f00 0x7f7b18098890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180acd30 con 0x7f7b18143f00 2021-11-15T19:31:45.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1814a8d0 con 0x7f7b180a9f50 2021-11-15T19:31:45.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1809aa60 con 0x7f7b180b1340 2021-11-15T19:31:45.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 0x7f7b18149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 0x7f7b18149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34974/0 (socket says 172.21.2.137:34974) 2021-11-15T19:31:45.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1903738861 learned_addr learned my addr 172.21.2.137:0/1903738861 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:45.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b17fff700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b18143f00 0x7f7b18098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b180b1340 msgr2=0x7f7b180983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b180b1340 0x7f7b180983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b18143f00 msgr2=0x7f7b18098890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b18143f00 0x7f7b18098890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 -- 172.21.2.137:0/1903738861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0800b1e0 con 0x7f7b180a9f50 2021-11-15T19:31:45.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b177fe700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 0x7f7b18149fd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f7b08002f70 tx=0x7f7b08015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b08011950 con 0x7f7b180a9f50 2021-11-15T19:31:45.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b08011ab0 con 0x7f7b180a9f50 2021-11-15T19:31:45.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b08011e10 con 0x7f7b180a9f50 2021-11-15T19:31:45.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18098d80 con 0x7f7b180a9f50 2021-11-15T19:31:45.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.264+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1809a240 con 0x7f7b180a9f50 2021-11-15T19:31:45.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1805faf0 con 0x7f7b180a9f50 2021-11-15T19:31:45.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b0801a040 con 0x7f7b180a9f50 2021-11-15T19:31:45.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b14ff9700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7afc0534f0 0x7f7afc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7b0806c590 con 0x7f7b180a9f50 2021-11-15T19:31:45.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b16ffd700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7afc0534f0 0x7f7afc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b16ffd700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7afc0534f0 0x7f7afc0559b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f7b0000c000 tx=0x7f7b00006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.268+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b08043910 con 0x7f7b180a9f50 2021-11-15T19:31:45.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.352+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7b180af4e0 con 0x7f7b180a9f50 2021-11-15T19:31:45.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.352+0000 7f7b14ff9700 1 -- 172.21.2.137:0/1903738861 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7b08023020 con 0x7f7b180a9f50 2021-11-15T19:31:45.359 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:45.359 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:31:45.359 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:45.360 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:31:45.360 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:31:45.360 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:31:45.360 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:31:45.361 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:31:45.361 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:31:45.361 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:31:45.362 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:31:45.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7afc0534f0 msgr2=0x7f7afc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7afc0534f0 0x7f7afc0559b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f7b0000c000 tx=0x7f7b00006df0).stop 2021-11-15T19:31:45.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 msgr2=0x7f7b18149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 0x7f7b18149fd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f7b08002f70 tx=0x7f7b08015000).stop 2021-11-15T19:31:45.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 shutdown_connections 2021-11-15T19:31:45.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7afc0534f0 0x7f7afc0559b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7b18143f00 0x7f7b18098890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7b180b1340 0x7f7b180983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:45.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 --2- 172.21.2.137:0/1903738861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7b180a9f50 0x7f7b18149fd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 >> 172.21.2.137:0/1903738861 conn(0x7f7b180b4e60 msgr2=0x7f7b1813ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:45.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 shutdown_connections 2021-11-15T19:31:45.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.356+0000 7f7b1dec1700 1 -- 172.21.2.137:0/1903738861 wait complete. 2021-11-15T19:31:45.366 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:31:45.367 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:31:45.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 Processor -- start 2021-11-15T19:31:45.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- start start 2021-11-15T19:31:45.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc440b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efc440b4680 0x7efc441290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440b76c0 con 0x7efc440b72e0 2021-11-15T19:31:45.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440b3100 con 0x7efc440b4680 2021-11-15T19:31:45.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440b20c0 con 0x7efc440acd60 2021-11-15T19:31:45.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4aa7b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efc440b4680 0x7efc441290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc49a79700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc440b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4a27a700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7efc440b72e0 0x7efc440b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:46256/0 (socket says 172.21.2.137:46256) 2021-11-15T19:31:45.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4a27a700 1 -- 172.21.2.137:0/2022957577 learned_addr learned my addr 172.21.2.137:0/2022957577 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:45.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4aa7b700 1 -- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 msgr2=0x7efc440b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:45.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4aa7b700 1 --2- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc440b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4aa7b700 1 -- 172.21.2.137:0/2022957577 >> v1:172.21.2.111:6789/0 conn(0x7efc440b72e0 legacy=0x7efc440b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4aa7b700 1 -- 172.21.2.137:0/2022957577 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4412a170 con 0x7efc440b4680 2021-11-15T19:31:45.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4aa7b700 1 --2- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc441290c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7efc40001110 tx=0x7efc3c0091d0).ready entity=mon.0 client_cookie=cff1e33e6338115b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc49278700 1 -- 172.21.2.137:0/2022957577 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3c00b580 con 0x7efc440b4680 2021-11-15T19:31:45.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc49278700 1 -- 172.21.2.137:0/2022957577 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00b6e0 con 0x7efc440b4680 2021-11-15T19:31:45.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc49278700 1 -- 172.21.2.137:0/2022957577 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3c00b850 con 0x7efc440b4680 2021-11-15T19:31:45.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 msgr2=0x7efc441290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc441290c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7efc40001110 tx=0x7efc3c0091d0).stop 2021-11-15T19:31:45.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/2022957577 shutdown_connections 2021-11-15T19:31:45.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc441290c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/2022957577 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc440b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/2022957577 >> 172.21.2.137:0/2022957577 conn(0x7efc44064960 msgr2=0x7efc44064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:45.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/2022957577 shutdown_connections 2021-11-15T19:31:45.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/2022957577 wait complete. 2021-11-15T19:31:45.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 Processor -- start 2021-11-15T19:31:45.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- start start 2021-11-15T19:31:45.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc44125060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc440b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 0x7efc440b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc441445a0 con 0x7efc440b4680 2021-11-15T19:31:45.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440aec80 con 0x7efc440b72e0 2021-11-15T19:31:45.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440b14b0 con 0x7efc440acd60 2021-11-15T19:31:45.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 0x7efc440b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 0x7efc440b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:34988/0 (socket says 172.21.2.137:34988) 2021-11-15T19:31:45.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 -- 172.21.2.137:0/429315304 learned_addr learned my addr 172.21.2.137:0/429315304 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:45.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc49a79700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc440b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4a27a700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc44125060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 -- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 msgr2=0x7efc44125060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc44125060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 -- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 msgr2=0x7efc440b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:45.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc440b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:45.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 -- 172.21.2.137:0/429315304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009470 con 0x7efc440b72e0 2021-11-15T19:31:45.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4aa7b700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 0x7efc440b0fc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7efc44143700 tx=0x7efc3c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3c00b580 con 0x7efc440b72e0 2021-11-15T19:31:45.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c011d80 con 0x7efc440b72e0 2021-11-15T19:31:45.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc440ae820 con 0x7efc440b72e0 2021-11-15T19:31:45.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3c0205f0 con 0x7efc440b72e0 2021-11-15T19:31:45.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc441257d0 con 0x7efc440b72e0 2021-11-15T19:31:45.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc440b3a50 con 0x7efc440b72e0 2021-11-15T19:31:45.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc3c027030 con 0x7efc440b72e0 2021-11-15T19:31:45.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc337fe700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc24053580 0x7efc24055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:45.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7efc3c06c470 con 0x7efc440b72e0 2021-11-15T19:31:45.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4a27a700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc24053580 0x7efc24055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:45.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.420+0000 7efc4a27a700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc24053580 0x7efc24055a40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7efc4000d000 tx=0x7efc40009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:45.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.424+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc3c0471c0 con 0x7efc440b72e0 2021-11-15T19:31:45.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:45.504+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7efc440573d0 con 0x7efc440b72e0 2021-11-15T19:31:46.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc337fe700 1 -- 172.21.2.137:0/429315304 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v59) v1 ==== 133+0+0 (secure 0 0 0) 0x7efc3c0250a0 con 0x7efc440b72e0 2021-11-15T19:31:46.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc24053580 msgr2=0x7efc24055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:46.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc24053580 0x7efc24055a40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7efc4000d000 tx=0x7efc40009040).stop 2021-11-15T19:31:46.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 msgr2=0x7efc440b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:46.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 0x7efc440b0fc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7efc44143700 tx=0x7efc3c016000).stop 2021-11-15T19:31:46.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 shutdown_connections 2021-11-15T19:31:46.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc24053580 0x7efc24055a40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc440b72e0 0x7efc440b0fc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc440b4680 0x7efc440b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 --2- 172.21.2.137:0/429315304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc440acd60 0x7efc44125060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 >> 172.21.2.137:0/429315304 conn(0x7efc44064960 msgr2=0x7efc44062fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:46.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 shutdown_connections 2021-11-15T19:31:46.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.416+0000 7efc4c4de700 1 -- 172.21.2.137:0/429315304 wait complete. 2021-11-15T19:31:46.424 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:31:46.427 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:31:46.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7be0dd7700 1 Processor -- start 2021-11-15T19:31:46.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7be0dd7700 1 -- start start 2021-11-15T19:31:46.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7be0dd7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7bdc065730 0x7f7bdc13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:46.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7be0dd7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc066270 con 0x7f7bdc065b10 2021-11-15T19:31:46.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7be0dd7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc065fd0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7be0dd7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc067410 con 0x7f7bdc065730 2021-11-15T19:31:46.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bdad9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7bdc0b00a0 0x7f7bdc05bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53778/0 (socket says 172.21.2.137:53778) 2021-11-15T19:31:46.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bdad9d700 1 -- 172.21.2.137:0/2939954246 learned_addr learned my addr 172.21.2.137:0/2939954246 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:46.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bda59c700 1 --2- 172.21.2.137:0/2939954246 >> v2:172.21.2.137:3300/0 conn(0x7f7bdc065730 0x7f7bdc13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:46.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bda59c700 1 -- 172.21.2.137:0/2939954246 >> v1:172.21.2.137:6789/0 conn(0x7f7bdc0b00a0 legacy=0x7f7bdc05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:46.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bda59c700 1 -- 172.21.2.137:0/2939954246 >> v1:172.21.2.111:6789/0 conn(0x7f7bdc065b10 legacy=0x7f7bdc13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:46.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bda59c700 1 -- 172.21.2.137:0/2939954246 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc066f70 con 0x7f7bdc065730 2021-11-15T19:31:46.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bda59c700 1 --2- 172.21.2.137:0/2939954246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc065730 0x7f7bdc13c2b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f7bdc0612c0 tx=0x7f7bc4006df0).ready entity=mon.1 client_cookie=453d743b763f5952 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:46.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bd959a700 1 -- 172.21.2.137:0/2939954246 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc400e8c0 con 0x7f7bdc065730 2021-11-15T19:31:46.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bd959a700 1 -- 172.21.2.137:0/2939954246 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4000e90 con 0x7f7bdc065730 2021-11-15T19:31:46.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.476+0000 7f7bd959a700 1 -- 172.21.2.137:0/2939954246 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc400ec10 con 0x7f7bdc065730 2021-11-15T19:31:46.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/2939954246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc065730 msgr2=0x7f7bdc13c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:46.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/2939954246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc065730 0x7f7bdc13c2b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f7bdc0612c0 tx=0x7f7bc4006df0).stop 2021-11-15T19:31:46.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/2939954246 shutdown_connections 2021-11-15T19:31:46.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/2939954246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc065730 0x7f7bdc13c2b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/2939954246 >> 172.21.2.137:0/2939954246 conn(0x7f7bdc060290 msgr2=0x7f7bdc060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:46.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/2939954246 shutdown_connections 2021-11-15T19:31:46.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/2939954246 wait complete. 2021-11-15T19:31:46.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 Processor -- start 2021-11-15T19:31:46.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- start start 2021-11-15T19:31:46.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7bdc065730 0x7f7bdc0acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:46.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7bdc065b10 0x7f7bdc0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:46.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 0x7f7bdc140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:46.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0afd30 con 0x7f7bdc065b10 2021-11-15T19:31:46.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0ad680 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0ad920 con 0x7f7bdc065730 2021-11-15T19:31:46.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 0x7f7bdc140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:46.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 0x7f7bdc140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35002/0 (socket says 172.21.2.137:35002) 2021-11-15T19:31:46.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 -- 172.21.2.137:0/1522590529 learned_addr learned my addr 172.21.2.137:0/1522590529 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:46.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bda59c700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7bdc065730 0x7f7bdc0acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:46.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd9d9b700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7bdc065b10 0x7f7bdc0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:46.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 -- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7bdc065730 msgr2=0x7f7bdc0acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:46.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7bdc065730 0x7f7bdc0acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 -- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7bdc065b10 msgr2=0x7f7bdc0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:46.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7bdc065b10 0x7f7bdc0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:46.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 -- 172.21.2.137:0/1522590529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc400b180 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bda59c700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7bdc065730 0x7f7bdc0acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:46.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd9d9b700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7bdc065b10 0x7f7bdc0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:46.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bdad9d700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 0x7f7bdc140480 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f7bdc060dc0 tx=0x7f7bd40013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:46.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd4005ba0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4005d00 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc0af9b0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc1481d0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd40072c0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc0adae0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7bd401a060 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd37fe700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7bc0053690 0x7f7bc0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:46.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.480+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f7bd406b2f0 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.484+0000 7f7bda59c700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7bc0053690 0x7f7bc0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:46.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.484+0000 7f7bda59c700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7bc0053690 0x7f7bc0055b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7bc4016000 tx=0x7f7bc4013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:46.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.484+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7bd4042510 con 0x7f7bdc0b00a0 2021-11-15T19:31:46.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:46.568+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7bdc0afba0 con 0x7f7bdc0b00a0 2021-11-15T19:31:47.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7bd37fe700 1 -- 172.21.2.137:0/1522590529 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v60) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7bd4018020 con 0x7f7bdc0b00a0 2021-11-15T19:31:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7bc0053690 msgr2=0x7f7bc0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7bc0053690 0x7f7bc0055b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7bc4016000 tx=0x7f7bc4013000).stop 2021-11-15T19:31:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 msgr2=0x7f7bdc140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 0x7f7bdc140480 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f7bdc060dc0 tx=0x7f7bd40013a0).stop 2021-11-15T19:31:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 shutdown_connections 2021-11-15T19:31:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7bc0053690 0x7f7bc0055b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7bdc0b00a0 0x7f7bdc140480 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7bdc065b10 0x7f7bdc0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 --2- 172.21.2.137:0/1522590529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7bdc065730 0x7f7bdc0acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 >> 172.21.2.137:0/1522590529 conn(0x7f7bdc060290 msgr2=0x7f7bdc13cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 shutdown_connections 2021-11-15T19:31:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.428+0000 7f7be0dd7700 1 -- 172.21.2.137:0/1522590529 wait complete. 2021-11-15T19:31:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:31:47.440 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:31:47.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 Processor -- start 2021-11-15T19:31:47.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- start start 2021-11-15T19:31:47.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff210097260 0x7ff210097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100aca80 con 0x7ff2100b2c30 2021-11-15T19:31:47.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100accb0 con 0x7ff2100969e0 2021-11-15T19:31:47.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100ad150 con 0x7ff210097260 2021-11-15T19:31:47.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff2156de700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff2100969e0 0x7ff21005f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53790/0 (socket says 172.21.2.137:53790) 2021-11-15T19:31:47.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff2156de700 1 -- 172.21.2.137:0/1610966739 learned_addr learned my addr 172.21.2.137:0/1610966739 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:47.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465360968 0 0) 0x7ff2100accb0 con 0x7ff2100969e0 2021-11-15T19:31:47.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff214edd700 1 --2- 172.21.2.137:0/1610966739 >> v2:172.21.2.111:3300/0 conn(0x7ff210097260 0x7ff210097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f4003260 con 0x7ff2100969e0 2021-11-15T19:31:47.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056315335 0 0) 0x7ff1f4003260 con 0x7ff2100969e0 2021-11-15T19:31:47.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 >> v2:172.21.2.111:3300/0 conn(0x7ff210097260 msgr2=0x7ff210097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 --2- 172.21.2.137:0/1610966739 >> v2:172.21.2.111:3300/0 conn(0x7ff210097260 0x7ff210097640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 >> v1:172.21.2.111:6789/0 conn(0x7ff2100b2c30 legacy=0x7ff2100990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210097c50 con 0x7ff2100969e0 2021-11-15T19:31:47.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff208001660 con 0x7ff2100969e0 2021-11-15T19:31:47.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 >> v1:172.21.2.137:6789/0 conn(0x7ff2100969e0 legacy=0x7ff21005f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4003820 0x7ff1f4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f4004500 0x7ff1f4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f4004f70 0x7ff1f400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f400bec0 con 0x7ff1f4003820 2021-11-15T19:31:47.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f400c030 con 0x7ff1f4004500 2021-11-15T19:31:47.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f400c1f0 con 0x7ff1f4004f70 2021-11-15T19:31:47.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f4004500 0x7ff1f4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff2156de700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f4004f70 0x7ff1f400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff214edd700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4003820 0x7ff1f4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 -- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f4004f70 msgr2=0x7ff1f400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f4004f70 0x7ff1f400b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 -- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4003820 msgr2=0x7ff1f4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4003820 0x7ff1f4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 -- 172.21.2.137:0/1610966739 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4003260 con 0x7ff1f4004500 2021-11-15T19:31:47.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff2156de700 1 -- 172.21.2.137:0/1610966739 reap_dead start 2021-11-15T19:31:47.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff214edd700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4003820 0x7ff1f4003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:47.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20ffff700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f4004500 0x7ff1f4004980 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff200002320 tx=0x7ff200007d80).ready entity=mon.1 client_cookie=4adb466ed86e7c78 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff200002510 con 0x7ff1f4004500 2021-11-15T19:31:47.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200006890 con 0x7ff1f4004500 2021-11-15T19:31:47.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff20f7fe700 1 -- 172.21.2.137:0/1610966739 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff200006bf0 con 0x7ff1f4004500 2021-11-15T19:31:47.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- 172.21.2.137:0/1610966739 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f4004500 msgr2=0x7ff1f4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f4004500 0x7ff1f4004980 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff200002320 tx=0x7ff200007d80).stop 2021-11-15T19:31:47.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- 172.21.2.137:0/1610966739 shutdown_connections 2021-11-15T19:31:47.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 --2- 172.21.2.137:0/1610966739 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f4004500 0x7ff1f4004980 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- 172.21.2.137:0/1610966739 >> 172.21.2.137:0/1610966739 conn(0x7ff2100b7070 msgr2=0x7ff2100b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- 172.21.2.137:0/1610966739 shutdown_connections 2021-11-15T19:31:47.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.492+0000 7ff217141700 1 -- 172.21.2.137:0/1610966739 wait complete. 2021-11-15T19:31:47.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 Processor -- start 2021-11-15T19:31:47.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- start start 2021-11-15T19:31:47.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4004500 0x7ff210095e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2100b09d0 0x7ff21008f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 0x7ff2100af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210065b80 con 0x7ff1f4004500 2021-11-15T19:31:47.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210065e20 con 0x7ff2100b0e50 2021-11-15T19:31:47.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210064ca0 con 0x7ff2100b09d0 2021-11-15T19:31:47.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 0x7ff2100af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 0x7ff2100af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35022/0 (socket says 172.21.2.137:35022) 2021-11-15T19:31:47.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 -- 172.21.2.137:0/3341309448 learned_addr learned my addr 172.21.2.137:0/3341309448 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:47.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff214edd700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4004500 0x7ff210095e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 -- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2100b09d0 msgr2=0x7ff21008f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2100b09d0 0x7ff21008f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 -- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4004500 msgr2=0x7ff210095e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4004500 0x7ff210095e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 -- 172.21.2.137:0/3341309448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210065180 con 0x7ff2100b0e50 2021-11-15T19:31:47.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff214edd700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4004500 0x7ff210095e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:31:47.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff2156de700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 0x7ff2100af950 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7ff208001840 tx=0x7ff208009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20800de50 con 0x7ff2100b0e50 2021-11-15T19:31:47.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080070d0 con 0x7ff2100b0e50 2021-11-15T19:31:47.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff208004730 con 0x7ff2100b0e50 2021-11-15T19:31:47.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2100600f0 con 0x7ff2100b0e50 2021-11-15T19:31:47.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff210141890 con 0x7ff2100b0e50 2021-11-15T19:31:47.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff210066e80 con 0x7ff2100b0e50 2021-11-15T19:31:47.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff20801d070 con 0x7ff2100b0e50 2021-11-15T19:31:47.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff20dffb700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1e8053580 0x7ff1e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5953+0+0 (secure 0 0 0) 0x7ff20806acf0 con 0x7ff2100b0e50 2021-11-15T19:31:47.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.496+0000 7ff214edd700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1e8053580 0x7ff1e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.500+0000 7ff214edd700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1e8053580 0x7ff1e8055a40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff1f8009000 tx=0x7ff1f8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.500+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff208041e60 con 0x7ff2100b0e50 2021-11-15T19:31:47.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.608+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff2100573d0 con 0x7ff2100b0e50 2021-11-15T19:31:47.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff20dffb700 1 -- 172.21.2.137:0/3341309448 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v25) v1 ==== 189+0+0 (secure 0 0 0) 0x7ff20801b070 con 0x7ff2100b0e50 2021-11-15T19:31:47.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1e8053580 msgr2=0x7ff1e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1e8053580 0x7ff1e8055a40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff1f8009000 tx=0x7ff1f8008040).stop 2021-11-15T19:31:47.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 msgr2=0x7ff2100af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 0x7ff2100af950 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7ff208001840 tx=0x7ff208009040).stop 2021-11-15T19:31:47.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 shutdown_connections 2021-11-15T19:31:47.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1e8053580 0x7ff1e8055a40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2100b0e50 0x7ff2100af950 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2100b09d0 0x7ff21008f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 --2- 172.21.2.137:0/3341309448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f4004500 0x7ff210095e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 >> 172.21.2.137:0/3341309448 conn(0x7ff2100b7070 msgr2=0x7ff21005f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 shutdown_connections 2021-11-15T19:31:47.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.624+0000 7ff217141700 1 -- 172.21.2.137:0/3341309448 wait complete. 2021-11-15T19:31:47.633 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 11 and data pool 12 2021-11-15T19:31:47.636 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:31:47.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 Processor -- start 2021-11-15T19:31:47.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- start start 2021-11-15T19:31:47.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff9f80b1340 0x7ff9f8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff9f8143f00 0x7ff9f8144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f8148190 con 0x7ff9f80a9f50 2021-11-15T19:31:47.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80b1720 con 0x7ff9f8143f00 2021-11-15T19:31:47.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f8147e70 con 0x7ff9f80b1340 2021-11-15T19:31:47.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff9f80b1340 0x7ff9f8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff9f80b1340 0x7ff9f8147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35038/0 (socket says 172.21.2.137:35038) 2021-11-15T19:31:47.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 -- 172.21.2.137:0/1303175094 learned_addr learned my addr 172.21.2.137:0/1303175094 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:47.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 -- 172.21.2.137:0/1303175094 >> v2:172.21.2.111:3300/0 conn(0x7ff9f8143f00 msgr2=0x7ff9f8144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 --2- 172.21.2.137:0/1303175094 >> v2:172.21.2.111:3300/0 conn(0x7ff9f8143f00 0x7ff9f8144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 -- 172.21.2.137:0/1303175094 >> v1:172.21.2.111:6789/0 conn(0x7ff9f80a9f50 legacy=0x7ff9f80aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 -- 172.21.2.137:0/1303175094 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80af800 con 0x7ff9f80b1340 2021-11-15T19:31:47.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f7fff700 1 --2- 172.21.2.137:0/1303175094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f80b1340 0x7ff9f8147980 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7ff9f8062250 tx=0x7ff9e8006eb0).ready entity=mon.1 client_cookie=db948604f986be2b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f77fe700 1 -- 172.21.2.137:0/1303175094 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9e800d5c0 con 0x7ff9f80b1340 2021-11-15T19:31:47.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f77fe700 1 -- 172.21.2.137:0/1303175094 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8000e90 con 0x7ff9f80b1340 2021-11-15T19:31:47.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f77fe700 1 -- 172.21.2.137:0/1303175094 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9e800d910 con 0x7ff9f80b1340 2021-11-15T19:31:47.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- 172.21.2.137:0/1303175094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f80b1340 msgr2=0x7ff9f8147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- 172.21.2.137:0/1303175094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f80b1340 0x7ff9f8147980 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7ff9f8062250 tx=0x7ff9e8006eb0).stop 2021-11-15T19:31:47.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- 172.21.2.137:0/1303175094 shutdown_connections 2021-11-15T19:31:47.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- 172.21.2.137:0/1303175094 >> v2:172.21.2.111:3300/0 conn(0x7ff9f8143f00 0x7ff9f8144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- 172.21.2.137:0/1303175094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f80b1340 0x7ff9f8147980 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- 172.21.2.137:0/1303175094 >> 172.21.2.137:0/1303175094 conn(0x7ff9f80b4e60 msgr2=0x7ff9f80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- 172.21.2.137:0/1303175094 shutdown_connections 2021-11-15T19:31:47.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- 172.21.2.137:0/1303175094 wait complete. 2021-11-15T19:31:47.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 Processor -- start 2021-11-15T19:31:47.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- start start 2021-11-15T19:31:47.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9f80a9f50 0x7ff9f813f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9f80b1340 0x7ff9f813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 0x7ff9f8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f809a570 con 0x7ff9f80a9f50 2021-11-15T19:31:47.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f809a310 con 0x7ff9f8143f00 2021-11-15T19:31:47.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80aee20 con 0x7ff9f80b1340 2021-11-15T19:31:47.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 0x7ff9f8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 0x7ff9f8159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35044/0 (socket says 172.21.2.137:35044) 2021-11-15T19:31:47.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 -- 172.21.2.137:0/2673146374 learned_addr learned my addr 172.21.2.137:0/2673146374 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:47.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 -- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9f80b1340 msgr2=0x7ff9f813ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9f80b1340 0x7ff9f813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 -- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9f80a9f50 msgr2=0x7ff9f813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9f80a9f50 0x7ff9f813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 -- 172.21.2.137:0/2673146374 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e800b1e0 con 0x7ff9f8143f00 2021-11-15T19:31:47.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fccbd700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 0x7ff9f8159c60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7ff9f0003270 tx=0x7ff9f00090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f000d4a0 con 0x7ff9f8143f00 2021-11-15T19:31:47.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000d600 con 0x7ff9f8143f00 2021-11-15T19:31:47.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8140470 con 0x7ff9f8143f00 2021-11-15T19:31:47.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.684+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f000d960 con 0x7ff9f8143f00 2021-11-15T19:31:47.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8099ec0 con 0x7ff9f8143f00 2021-11-15T19:31:47.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f805faf0 con 0x7ff9f8143f00 2021-11-15T19:31:47.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff9f0018030 con 0x7ff9f8143f00 2021-11-15T19:31:47.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9f5ffb700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9dc0534f0 0x7ff9dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff9f006b1a0 con 0x7ff9f8143f00 2021-11-15T19:31:47.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9f7fff700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9dc0534f0 0x7ff9dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9f7fff700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9dc0534f0 0x7ff9dc0559b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7ff9f8062250 tx=0x7ff9e8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.688+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9f00423b0 con 0x7ff9f8143f00 2021-11-15T19:31:47.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9f80573d0 con 0x7ff9f8143f00 2021-11-15T19:31:47.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9f5ffb700 1 -- 172.21.2.137:0/2673146374 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16054 (secure 0 0 0) 0x7ff9f0023ed0 con 0x7ff9f8143f00 2021-11-15T19:31:47.779 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:47.780 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":62,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:31:47.614999+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:31:45.526704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T19:31:46.590945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:31:47.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9dc0534f0 msgr2=0x7ff9dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9dc0534f0 0x7ff9dc0559b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7ff9f8062250 tx=0x7ff9e8015000).stop 2021-11-15T19:31:47.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 msgr2=0x7ff9f8159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 0x7ff9f8159c60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7ff9f0003270 tx=0x7ff9f00090f0).stop 2021-11-15T19:31:47.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 shutdown_connections 2021-11-15T19:31:47.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff9dc0534f0 0x7ff9dc0559b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9f8143f00 0x7ff9f8159c60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9f80b1340 0x7ff9f813ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 --2- 172.21.2.137:0/2673146374 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff9f80a9f50 0x7ff9f813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 >> 172.21.2.137:0/2673146374 conn(0x7ff9f80b4e60 msgr2=0x7ff9f80b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 shutdown_connections 2021-11-15T19:31:47.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.776+0000 7ff9fe720700 1 -- 172.21.2.137:0/2673146374 wait complete. 2021-11-15T19:31:47.787 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:31:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.832+0000 7fa4b41f9700 1 Processor -- start 2021-11-15T19:31:47.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- start start 2021-11-15T19:31:47.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa4ac144610 0x7fa4ac147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa4ac0a9f50 0x7fa4ac0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac148190 con 0x7fa4ac0b1340 2021-11-15T19:31:47.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac0b1720 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac147e70 con 0x7fa4ac144610 2021-11-15T19:31:47.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa4ac144610 0x7fa4ac147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa4ac144610 0x7fa4ac147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35054/0 (socket says 172.21.2.137:35054) 2021-11-15T19:31:47.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 -- 172.21.2.137:0/3894699379 learned_addr learned my addr 172.21.2.137:0/3894699379 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:47.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 -- 172.21.2.137:0/3894699379 >> v2:172.21.2.111:3300/0 conn(0x7fa4ac0a9f50 msgr2=0x7fa4ac0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 --2- 172.21.2.137:0/3894699379 >> v2:172.21.2.111:3300/0 conn(0x7fa4ac0a9f50 0x7fa4ac0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 -- 172.21.2.137:0/3894699379 >> v1:172.21.2.111:6789/0 conn(0x7fa4ac0b1340 legacy=0x7fa4ac143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:47.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 -- 172.21.2.137:0/3894699379 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0af800 con 0x7fa4ac144610 2021-11-15T19:31:47.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1794700 1 --2- 172.21.2.137:0/3894699379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac144610 0x7fa4ac147980 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fa4ac062250 tx=0x7fa4a8006eb0).ready entity=mon.1 client_cookie=51e4503e01104685 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b0f93700 1 -- 172.21.2.137:0/3894699379 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a800d5c0 con 0x7fa4ac144610 2021-11-15T19:31:47.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b0f93700 1 -- 172.21.2.137:0/3894699379 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8000e90 con 0x7fa4ac144610 2021-11-15T19:31:47.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b0f93700 1 -- 172.21.2.137:0/3894699379 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a800d910 con 0x7fa4ac144610 2021-11-15T19:31:47.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/3894699379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac144610 msgr2=0x7fa4ac147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/3894699379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac144610 0x7fa4ac147980 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fa4ac062250 tx=0x7fa4a8006eb0).stop 2021-11-15T19:31:47.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/3894699379 shutdown_connections 2021-11-15T19:31:47.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/3894699379 >> v2:172.21.2.111:3300/0 conn(0x7fa4ac0a9f50 0x7fa4ac0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/3894699379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac144610 0x7fa4ac147980 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/3894699379 >> 172.21.2.137:0/3894699379 conn(0x7fa4ac0b4e60 msgr2=0x7fa4ac0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/3894699379 shutdown_connections 2021-11-15T19:31:47.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/3894699379 wait complete. 2021-11-15T19:31:47.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 Processor -- start 2021-11-15T19:31:47.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- start start 2021-11-15T19:31:47.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 0x7fa4ac09a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4ac0b1340 0x7fa4ac159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4ac144610 0x7fa4ac14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac09ac90 con 0x7fa4ac0b1340 2021-11-15T19:31:47.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0ae070 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac14a7b0 con 0x7fa4ac144610 2021-11-15T19:31:47.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 0x7fa4ac09a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 0x7fa4ac09a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35060/0 (socket says 172.21.2.137:35060) 2021-11-15T19:31:47.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 -- 172.21.2.137:0/69590655 learned_addr learned my addr 172.21.2.137:0/69590655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:47.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 -- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4ac144610 msgr2=0x7fa4ac14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4ac144610 0x7fa4ac14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 -- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4ac0b1340 msgr2=0x7fa4ac159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4ac0b1340 0x7fa4ac159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 -- 172.21.2.137:0/69590655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a800b1e0 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b1f95700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 0x7fa4ac09a240 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fa4a0002ef0 tx=0x7fa4a0006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a0009ea0 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a0002320 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac15a150 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac14b2e0 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.836+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a0002680 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac14a600 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4a000f030 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa49effd700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa48c0536f0 0x7fa48c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa4a006b780 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa4b1794700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa48c0536f0 0x7fa48c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa4b1794700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa48c0536f0 0x7fa48c055bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa4ac062250 tx=0x7fa4a8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.840+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4a00427d0 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4ac14a970 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa49effd700 1 -- 172.21.2.137:0/69590655 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fa4a0045df0 con 0x7fa4ac0a9f50 2021-11-15T19:31:47.930 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:47.930 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":62,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:31:47.614999+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:31:45.526704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T19:31:46.590945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:31:47.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa48c0536f0 msgr2=0x7fa48c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa48c0536f0 0x7fa48c055bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa4ac062250 tx=0x7fa4a8015000).stop 2021-11-15T19:31:47.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 msgr2=0x7fa4ac09a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 0x7fa4ac09a240 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fa4a0002ef0 tx=0x7fa4a0006d50).stop 2021-11-15T19:31:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 shutdown_connections 2021-11-15T19:31:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa48c0536f0 0x7fa48c055bb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4ac144610 0x7fa4ac14ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4ac0b1340 0x7fa4ac159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 --2- 172.21.2.137:0/69590655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4ac0a9f50 0x7fa4ac09a240 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.924+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 >> 172.21.2.137:0/69590655 conn(0x7fa4ac0b4e60 msgr2=0x7fa4ac0b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.928+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 shutdown_connections 2021-11-15T19:31:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.928+0000 7fa4b41f9700 1 -- 172.21.2.137:0/69590655 wait complete. 2021-11-15T19:31:47.937 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:31:47.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 Processor -- start 2021-11-15T19:31:47.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- start start 2021-11-15T19:31:47.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efe7c05c770 0x7efe7c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efe7c140aa0 0x7efe7c140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c05cb50 con 0x7efe7c0b0550 2021-11-15T19:31:47.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c0b1650 con 0x7efe7c05c770 2021-11-15T19:31:47.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c0ad030 con 0x7efe7c140aa0 2021-11-15T19:31:47.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efe7c140aa0 0x7efe7c140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe79d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efe7c0b0550 0x7efe7c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53848/0 (socket says 172.21.2.137:53848) 2021-11-15T19:31:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe79d9b700 1 -- 172.21.2.137:0/4109061455 learned_addr learned my addr 172.21.2.137:0/4109061455 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7ad9d700 1 -- 172.21.2.137:0/4109061455 >> v2:172.21.2.111:3300/0 conn(0x7efe7c05c770 msgr2=0x7efe7c0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:31:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7ad9d700 1 --2- 172.21.2.137:0/4109061455 >> v2:172.21.2.111:3300/0 conn(0x7efe7c05c770 0x7efe7c0aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7ad9d700 1 -- 172.21.2.137:0/4109061455 >> v1:172.21.2.137:6789/0 conn(0x7efe7c0b0550 legacy=0x7efe7c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7ad9d700 1 -- 172.21.2.137:0/4109061455 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0ad2d0 con 0x7efe7c140aa0 2021-11-15T19:31:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7ad9d700 1 --2- 172.21.2.137:0/4109061455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c140aa0 0x7efe7c140ef0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7efe740032f0 tx=0x7efe740091d0).ready entity=mon.1 client_cookie=a221fb36416506f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7959a700 1 -- 172.21.2.137:0/4109061455 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe74009ea0 con 0x7efe7c140aa0 2021-11-15T19:31:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7959a700 1 -- 172.21.2.137:0/4109061455 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7400b870 con 0x7efe7c140aa0 2021-11-15T19:31:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe7959a700 1 -- 172.21.2.137:0/4109061455 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7400ba20 con 0x7efe7c140aa0 2021-11-15T19:31:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- 172.21.2.137:0/4109061455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c140aa0 msgr2=0x7efe7c140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 --2- 172.21.2.137:0/4109061455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c140aa0 0x7efe7c140ef0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7efe740032f0 tx=0x7efe740091d0).stop 2021-11-15T19:31:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- 172.21.2.137:0/4109061455 shutdown_connections 2021-11-15T19:31:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 --2- 172.21.2.137:0/4109061455 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c140aa0 0x7efe7c140ef0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 --2- 172.21.2.137:0/4109061455 >> v2:172.21.2.111:3300/0 conn(0x7efe7c05c770 0x7efe7c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- 172.21.2.137:0/4109061455 >> 172.21.2.137:0/4109061455 conn(0x7efe7c0631e0 msgr2=0x7efe7c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- 172.21.2.137:0/4109061455 shutdown_connections 2021-11-15T19:31:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.984+0000 7efe8096c700 1 -- 172.21.2.137:0/4109061455 wait complete. 2021-11-15T19:31:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 Processor -- start 2021-11-15T19:31:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- start start 2021-11-15T19:31:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 0x7efe7c13eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe7c0b0550 0x7efe7c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe7c140aa0 0x7efe7c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c145880 con 0x7efe7c140aa0 2021-11-15T19:31:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c145580 con 0x7efe7c05c770 2021-11-15T19:31:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c141dd0 con 0x7efe7c0b0550 2021-11-15T19:31:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 0x7efe7c13eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 0x7efe7c13eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35070/0 (socket says 172.21.2.137:35070) 2021-11-15T19:31:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 -- 172.21.2.137:0/3392217682 learned_addr learned my addr 172.21.2.137:0/3392217682 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 -- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe7c0b0550 msgr2=0x7efe7c156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe7c0b0550 0x7efe7c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 -- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe7c140aa0 msgr2=0x7efe7c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe7c140aa0 0x7efe7c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 -- 172.21.2.137:0/3392217682 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74009470 con 0x7efe7c05c770 2021-11-15T19:31:48.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe7a59c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 0x7efe7c13eb20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7efe70002fb0 tx=0x7efe70006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe70009e00 con 0x7efe7c05c770 2021-11-15T19:31:48.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70013460 con 0x7efe7c05c770 2021-11-15T19:31:48.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c157470 con 0x7efe7c05c770 2021-11-15T19:31:48.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe700137c0 con 0x7efe7c05c770 2021-11-15T19:31:48.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c141910 con 0x7efe7c05c770 2021-11-15T19:31:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c1456f0 con 0x7efe7c05c770 2021-11-15T19:31:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe7000f070 con 0x7efe7c05c770 2021-11-15T19:31:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe6b7fe700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe580536a0 0x7efe58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.988+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7efe7006b300 con 0x7efe7c05c770 2021-11-15T19:31:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.992+0000 7efe79d9b700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe580536a0 0x7efe58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.992+0000 7efe79d9b700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe580536a0 0x7efe58055b60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7efe7c0aee10 tx=0x7efe6c007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:47.992+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe70042460 con 0x7efe7c05c770 2021-11-15T19:31:48.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.104+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe7c0ae7f0 con 0x7efe7c05c770 2021-11-15T19:31:48.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe6b7fe700 1 -- 172.21.2.137:0/3392217682 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe70045a80 con 0x7efe7c05c770 2021-11-15T19:31:48.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe580536a0 msgr2=0x7efe58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe580536a0 0x7efe58055b60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7efe7c0aee10 tx=0x7efe6c007800).stop 2021-11-15T19:31:48.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 msgr2=0x7efe7c13eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 0x7efe7c13eb20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7efe70002fb0 tx=0x7efe70006df0).stop 2021-11-15T19:31:48.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 shutdown_connections 2021-11-15T19:31:48.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efe580536a0 0x7efe58055b60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efe7c140aa0 0x7efe7c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efe7c0b0550 0x7efe7c156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 --2- 172.21.2.137:0/3392217682 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efe7c05c770 0x7efe7c13eb20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 >> 172.21.2.137:0/3392217682 conn(0x7efe7c0631e0 msgr2=0x7efe7c13df80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:48.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 shutdown_connections 2021-11-15T19:31:48.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.628+0000 7efe8096c700 1 -- 172.21.2.137:0/3392217682 wait complete. 2021-11-15T19:31:48.641 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:48.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d66374700 1 Processor -- start 2021-11-15T19:31:48.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d66374700 1 -- start start 2021-11-15T19:31:48.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d66374700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9d60147980 0x7f9d600aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d66374700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d60148190 con 0x7f9d60144610 2021-11-15T19:31:48.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d66374700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600b1720 con 0x7f9d600b1340 2021-11-15T19:31:48.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d66374700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600af800 con 0x7f9d60147980 2021-11-15T19:31:48.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9d600b1340 0x7f9d60143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53862/0 (socket says 172.21.2.137:53862) 2021-11-15T19:31:48.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5ffff700 1 -- 172.21.2.137:0/116757087 learned_addr learned my addr 172.21.2.137:0/116757087 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:48.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68324977 0 0) 0x7f9d600b1720 con 0x7f9d600b1340 2021-11-15T19:31:48.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d40003260 con 0x7f9d600b1340 2021-11-15T19:31:48.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 --2- 172.21.2.137:0/116757087 >> v2:172.21.2.111:3300/0 conn(0x7f9d60147980 0x7f9d600aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250775537 0 0) 0x7f9d40003260 con 0x7f9d600b1340 2021-11-15T19:31:48.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 >> v2:172.21.2.111:3300/0 conn(0x7f9d60147980 msgr2=0x7f9d600aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:48.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 --2- 172.21.2.137:0/116757087 >> v2:172.21.2.111:3300/0 conn(0x7f9d60147980 0x7f9d600aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 >> v1:172.21.2.111:6789/0 conn(0x7f9d60144610 legacy=0x7f9d600a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:48.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6005faf0 con 0x7f9d600b1340 2021-11-15T19:31:48.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9d50001660 con 0x7f9d600b1340 2021-11-15T19:31:48.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 >> v1:172.21.2.137:6789/0 conn(0x7f9d600b1340 legacy=0x7f9d60143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d400037d0 0x7f9d40003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004500 0x7f9d40004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d40004f90 0x7f9d4000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600af800 con 0x7f9d400037d0 2021-11-15T19:31:48.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4000bed0 con 0x7f9d40004f90 2021-11-15T19:31:48.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4000c090 con 0x7f9d40004500 2021-11-15T19:31:48.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d40004f90 0x7f9d4000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 -- 172.21.2.137:0/116757087 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004500 msgr2=0x7f9d40004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:48.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004500 0x7f9d40004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 -- 172.21.2.137:0/116757087 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d400037d0 msgr2=0x7f9d40003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:48.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d400037d0 0x7f9d40003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 -- 172.21.2.137:0/116757087 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6005faf0 con 0x7f9d40004f90 2021-11-15T19:31:48.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 -- 172.21.2.137:0/116757087 reap_dead start 2021-11-15T19:31:48.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d64911700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d40004f90 0x7f9d4000b750 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f9d5800a000 tx=0x7f9d58008040).ready entity=mon.1 client_cookie=7a296b4c81e2ef2a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.688+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5800c070 con 0x7f9d40004f90 2021-11-15T19:31:48.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800e810 con 0x7f9d40004f90 2021-11-15T19:31:48.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5effd700 1 -- 172.21.2.137:0/116757087 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5800eb70 con 0x7f9d40004f90 2021-11-15T19:31:48.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/116757087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d40004f90 msgr2=0x7f9d4000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d40004f90 0x7f9d4000b750 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f9d5800a000 tx=0x7f9d58008040).stop 2021-11-15T19:31:48.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/116757087 shutdown_connections 2021-11-15T19:31:48.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 --2- 172.21.2.137:0/116757087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d40004f90 0x7f9d4000b750 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/116757087 >> 172.21.2.137:0/116757087 conn(0x7f9d600b4e60 msgr2=0x7f9d600b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:48.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/116757087 shutdown_connections 2021-11-15T19:31:48.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/116757087 wait complete. 2021-11-15T19:31:48.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 Processor -- start 2021-11-15T19:31:48.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- start start 2021-11-15T19:31:48.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004f90 0x7f9d60149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 0x7f9d60148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d60143780 0x7f9d601373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600ad570 con 0x7f9d60143780 2021-11-15T19:31:48.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6013d8e0 con 0x7f9d60149c30 2021-11-15T19:31:48.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6013db30 con 0x7f9d40004f90 2021-11-15T19:31:48.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 0x7f9d60148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 0x7f9d60148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35094/0 (socket says 172.21.2.137:35094) 2021-11-15T19:31:48.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 -- 172.21.2.137:0/1161231657 learned_addr learned my addr 172.21.2.137:0/1161231657 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:48.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d64911700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d60143780 0x7f9d601373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5ffff700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004f90 0x7f9d60149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 -- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004f90 msgr2=0x7f9d60149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004f90 0x7f9d60149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 -- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d60143780 msgr2=0x7f9d601373e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d60143780 0x7f9d601373e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 -- 172.21.2.137:0/1161231657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6013ddd0 con 0x7f9d60149c30 2021-11-15T19:31:48.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5f7fe700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 0x7f9d60148660 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f9d48001fa0 tx=0x7f9d48007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4800ce80 con 0x7f9d60149c30 2021-11-15T19:31:48.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48000e90 con 0x7f9d60149c30 2021-11-15T19:31:48.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d48007430 con 0x7f9d60149c30 2021-11-15T19:31:48.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6014a270 con 0x7f9d60149c30 2021-11-15T19:31:48.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d60137a70 con 0x7f9d60149c30 2021-11-15T19:31:48.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6005fd90 con 0x7f9d60149c30 2021-11-15T19:31:48.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.692+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d4801a060 con 0x7f9d60149c30 2021-11-15T19:31:48.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.696+0000 7f9d5d7fa700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d44053660 0x7f9d44055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.696+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9d4806b290 con 0x7f9d60149c30 2021-11-15T19:31:48.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.696+0000 7f9d5ffff700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d44053660 0x7f9d44055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.696+0000 7f9d5ffff700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d44053660 0x7f9d44055b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d5000b000 tx=0x7f9d50001720).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.696+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d480422e0 con 0x7f9d60149c30 2021-11-15T19:31:48.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d6005f730 con 0x7f9d60149c30 2021-11-15T19:31:48.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d5d7fa700 1 -- 172.21.2.137:0/1161231657 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f9d48018020 con 0x7f9d60149c30 2021-11-15T19:31:48.809 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:48.809 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:31:48.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d44053660 msgr2=0x7f9d44055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d44053660 0x7f9d44055b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d5000b000 tx=0x7f9d50001720).stop 2021-11-15T19:31:48.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 msgr2=0x7f9d60148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 0x7f9d60148660 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f9d48001fa0 tx=0x7f9d48007c30).stop 2021-11-15T19:31:48.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 shutdown_connections 2021-11-15T19:31:48.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d44053660 0x7f9d44055b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d60143780 0x7f9d601373e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d60149c30 0x7f9d60148660 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 --2- 172.21.2.137:0/1161231657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d40004f90 0x7f9d60149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 >> 172.21.2.137:0/1161231657 conn(0x7f9d600b4e60 msgr2=0x7f9d6014c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:48.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 shutdown_connections 2021-11-15T19:31:48.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.804+0000 7f9d66374700 1 -- 172.21.2.137:0/1161231657 wait complete. 2021-11-15T19:31:48.813 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:31:48.816 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:31:48.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 Processor -- start 2021-11-15T19:31:48.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- start start 2021-11-15T19:31:48.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e480b1340 0x7f9e48147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9e48143f00 0x7f9e48144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e48148190 con 0x7f9e480a9f50 2021-11-15T19:31:48.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e480b1720 con 0x7f9e48143f00 2021-11-15T19:31:48.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48147e70 con 0x7f9e480b1340 2021-11-15T19:31:48.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9e48143f00 0x7f9e48144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9e48143f00 0x7f9e48144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35100/0 (socket says 172.21.2.137:35100) 2021-11-15T19:31:48.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 -- 172.21.2.137:0/1402881489 learned_addr learned my addr 172.21.2.137:0/1402881489 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:48.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 -- 172.21.2.137:0/1402881489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e480b1340 msgr2=0x7f9e48147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:48.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 --2- 172.21.2.137:0/1402881489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e480b1340 0x7f9e48147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 -- 172.21.2.137:0/1402881489 >> v1:172.21.2.111:6789/0 conn(0x7f9e480a9f50 legacy=0x7f9e480aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:48.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 -- 172.21.2.137:0/1402881489 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e480af800 con 0x7f9e48143f00 2021-11-15T19:31:48.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e467fc700 1 --2- 172.21.2.137:0/1402881489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e48143f00 0x7f9e48144360 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f9e4805cfa0 tx=0x7f9e30006eb0).ready entity=mon.1 client_cookie=5eb776c8c2d298db server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e45ffb700 1 -- 172.21.2.137:0/1402881489 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e3000d570 con 0x7f9e48143f00 2021-11-15T19:31:48.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e45ffb700 1 -- 172.21.2.137:0/1402881489 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e30000e90 con 0x7f9e48143f00 2021-11-15T19:31:48.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e45ffb700 1 -- 172.21.2.137:0/1402881489 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e3000d8c0 con 0x7f9e48143f00 2021-11-15T19:31:48.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- 172.21.2.137:0/1402881489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e48143f00 msgr2=0x7f9e48144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- 172.21.2.137:0/1402881489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e48143f00 0x7f9e48144360 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f9e4805cfa0 tx=0x7f9e30006eb0).stop 2021-11-15T19:31:48.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- 172.21.2.137:0/1402881489 shutdown_connections 2021-11-15T19:31:48.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- 172.21.2.137:0/1402881489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e48143f00 0x7f9e48144360 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- 172.21.2.137:0/1402881489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e480b1340 0x7f9e48147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- 172.21.2.137:0/1402881489 >> 172.21.2.137:0/1402881489 conn(0x7f9e480b4e60 msgr2=0x7f9e480b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:48.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- 172.21.2.137:0/1402881489 shutdown_connections 2021-11-15T19:31:48.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- 172.21.2.137:0/1402881489 wait complete. 2021-11-15T19:31:48.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 Processor -- start 2021-11-15T19:31:48.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- start start 2021-11-15T19:31:48.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e480a9f50 0x7f9e480aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 0x7f9e4814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e48143f00 0x7f9e4809a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4814a940 con 0x7f9e480a9f50 2021-11-15T19:31:48.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4814abe0 con 0x7f9e480b1340 2021-11-15T19:31:48.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.864+0000 7f9e4d799700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48142f10 con 0x7f9e48143f00 2021-11-15T19:31:48.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 0x7f9e4814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 0x7f9e4814b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35104/0 (socket says 172.21.2.137:35104) 2021-11-15T19:31:48.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 -- 172.21.2.137:0/2546130538 learned_addr learned my addr 172.21.2.137:0/2546130538 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:48.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 -- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e48143f00 msgr2=0x7f9e4809a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e48143f00 0x7f9e4809a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 -- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e480a9f50 msgr2=0x7f9e480aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e480a9f50 0x7f9e480aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 -- 172.21.2.137:0/2546130538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3000b1e0 con 0x7f9e480b1340 2021-11-15T19:31:48.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e467fc700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 0x7f9e4814b080 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f9e4805cfa0 tx=0x7f9e30015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e30002f70 con 0x7f9e480b1340 2021-11-15T19:31:48.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000d8f0 con 0x7f9e480b1340 2021-11-15T19:31:48.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e480adfb0 con 0x7f9e480b1340 2021-11-15T19:31:48.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e3001e460 con 0x7f9e480b1340 2021-11-15T19:31:48.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e481485d0 con 0x7f9e480b1340 2021-11-15T19:31:48.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4814ada0 con 0x7f9e480b1340 2021-11-15T19:31:48.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e3001a040 con 0x7f9e480b1340 2021-11-15T19:31:48.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e3ffff700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e2c0536d0 0x7f9e2c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:48.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9e3006c850 con 0x7f9e480b1340 2021-11-15T19:31:48.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e46ffd700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e2c0536d0 0x7f9e2c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:48.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.868+0000 7f9e46ffd700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e2c0536d0 0x7f9e2c055b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9e38002f70 tx=0x7f9e380069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:48.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.872+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e30043a20 con 0x7f9e480b1340 2021-11-15T19:31:48.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e48148190 con 0x7f9e480b1340 2021-11-15T19:31:48.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e3ffff700 1 -- 172.21.2.137:0/2546130538 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9e48148190 con 0x7f9e480b1340 2021-11-15T19:31:48.961 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:48.961 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":63,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:31:48.621301+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:31:45.526704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T19:31:46.590945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:31:48.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e2c0536d0 msgr2=0x7f9e2c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e2c0536d0 0x7f9e2c055b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9e38002f70 tx=0x7f9e380069e0).stop 2021-11-15T19:31:48.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 msgr2=0x7f9e4814b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:48.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 0x7f9e4814b080 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f9e4805cfa0 tx=0x7f9e30015000).stop 2021-11-15T19:31:48.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 shutdown_connections 2021-11-15T19:31:48.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e2c0536d0 0x7f9e2c055b90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e48143f00 0x7f9e4809a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e480b1340 0x7f9e4814b080 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:48.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 --2- 172.21.2.137:0/2546130538 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e480a9f50 0x7f9e480aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:48.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 >> 172.21.2.137:0/2546130538 conn(0x7f9e480b4e60 msgr2=0x7f9e4813e670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:48.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 shutdown_connections 2021-11-15T19:31:48.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:48.956+0000 7f9e4d799700 1 -- 172.21.2.137:0/2546130538 wait complete. 2021-11-15T19:31:48.969 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:31:49.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 Processor -- start 2021-11-15T19:31:49.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- start start 2021-11-15T19:31:49.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f19ec05fd20 0x7f19ec0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec147f70 con 0x7f19ec0b0830 2021-11-15T19:31:49.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec060100 con 0x7f19ec0b10b0 2021-11-15T19:31:49.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec147cd0 con 0x7f19ec05fd20 2021-11-15T19:31:49.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f19da700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f19ec0b10b0 0x7f19ec0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53896/0 (socket says 172.21.2.137:53896) 2021-11-15T19:31:49.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f19da700 1 -- 172.21.2.137:0/249744465 learned_addr learned my addr 172.21.2.137:0/249744465 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:49.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f21db700 1 --2- 172.21.2.137:0/249744465 >> v2:172.21.2.137:3300/0 conn(0x7f19ec05fd20 0x7f19ec0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f11d9700 1 -- 172.21.2.137:0/249744465 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019855557 0 0) 0x7f19ec060100 con 0x7f19ec0b10b0 2021-11-15T19:31:49.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f11d9700 1 -- 172.21.2.137:0/249744465 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d4003260 con 0x7f19ec0b10b0 2021-11-15T19:31:49.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f21db700 1 -- 172.21.2.137:0/249744465 >> v1:172.21.2.137:6789/0 conn(0x7f19ec0b10b0 legacy=0x7f19ec0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f21db700 1 -- 172.21.2.137:0/249744465 >> v1:172.21.2.111:6789/0 conn(0x7f19ec0b0830 legacy=0x7f19ec0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f21db700 1 -- 172.21.2.137:0/249744465 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0a9ed0 con 0x7f19ec05fd20 2021-11-15T19:31:49.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f21db700 1 --2- 172.21.2.137:0/249744465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec05fd20 0x7f19ec0af800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f19ec0b4db0 tx=0x7f19e0006df0).ready entity=mon.1 client_cookie=8b2d693577f92445 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f11d9700 1 -- 172.21.2.137:0/249744465 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e000d5c0 con 0x7f19ec05fd20 2021-11-15T19:31:49.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f11d9700 1 -- 172.21.2.137:0/249744465 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0000e90 con 0x7f19ec05fd20 2021-11-15T19:31:49.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f11d9700 1 -- 172.21.2.137:0/249744465 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e000d910 con 0x7f19ec05fd20 2021-11-15T19:31:49.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- 172.21.2.137:0/249744465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec05fd20 msgr2=0x7f19ec0af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 --2- 172.21.2.137:0/249744465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec05fd20 0x7f19ec0af800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f19ec0b4db0 tx=0x7f19e0006df0).stop 2021-11-15T19:31:49.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- 172.21.2.137:0/249744465 shutdown_connections 2021-11-15T19:31:49.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 --2- 172.21.2.137:0/249744465 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec05fd20 0x7f19ec0af800 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- 172.21.2.137:0/249744465 >> 172.21.2.137:0/249744465 conn(0x7f19ec0b4e60 msgr2=0x7f19ec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- 172.21.2.137:0/249744465 shutdown_connections 2021-11-15T19:31:49.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.020+0000 7f19f443f700 1 -- 172.21.2.137:0/249744465 wait complete. 2021-11-15T19:31:49.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 Processor -- start 2021-11-15T19:31:49.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- start start 2021-11-15T19:31:49.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f19ec05fd20 0x7f19ec142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f19ec0b0830 0x7f19ec1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 0x7f19ec141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1568b0 con 0x7f19ec05fd20 2021-11-15T19:31:49.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec156aa0 con 0x7f19ec0b10b0 2021-11-15T19:31:49.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec156d40 con 0x7f19ec0b0830 2021-11-15T19:31:49.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 0x7f19ec141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 0x7f19ec141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35118/0 (socket says 172.21.2.137:35118) 2021-11-15T19:31:49.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 -- 172.21.2.137:0/2549376372 learned_addr learned my addr 172.21.2.137:0/2549376372 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:49.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 -- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f19ec0b0830 msgr2=0x7f19ec1571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f19ec0b0830 0x7f19ec1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 -- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f19ec05fd20 msgr2=0x7f19ec142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f19ec05fd20 0x7f19ec142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 -- 172.21.2.137:0/2549376372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e000b180 con 0x7f19ec0b10b0 2021-11-15T19:31:49.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f29dc700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 0x7f19ec141980 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f19e4003310 tx=0x7f19e4009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e4001500 con 0x7f19ec0b10b0 2021-11-15T19:31:49.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4001660 con 0x7f19ec0b10b0 2021-11-15T19:31:49.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e40019c0 con 0x7f19ec0b10b0 2021-11-15T19:31:49.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec142d40 con 0x7f19ec0b10b0 2021-11-15T19:31:49.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec067830 con 0x7f19ec0b10b0 2021-11-15T19:31:49.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec156f00 con 0x7f19ec0b10b0 2021-11-15T19:31:49.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19e4018030 con 0x7f19ec0b10b0 2021-11-15T19:31:49.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19df7fe700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f19cc0536d0 0x7f19cc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f19e406b260 con 0x7f19ec0b10b0 2021-11-15T19:31:49.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.024+0000 7f19f21db700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f19cc0536d0 0x7f19cc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.028+0000 7f19f21db700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f19cc0536d0 0x7f19cc055b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f19ec0b4db0 tx=0x7f19e0014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.028+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19e4042470 con 0x7f19ec0b10b0 2021-11-15T19:31:49.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.140+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f19ec0573d0 con 0x7f19ec0b10b0 2021-11-15T19:31:49.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19df7fe700 1 -- 172.21.2.137:0/2549376372 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f19e4016070 con 0x7f19ec0b10b0 2021-11-15T19:31:49.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f19cc0536d0 msgr2=0x7f19cc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f19cc0536d0 0x7f19cc055b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f19ec0b4db0 tx=0x7f19e0014000).stop 2021-11-15T19:31:49.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 msgr2=0x7f19ec141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 0x7f19ec141980 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f19e4003310 tx=0x7f19e4009120).stop 2021-11-15T19:31:49.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 shutdown_connections 2021-11-15T19:31:49.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f19cc0536d0 0x7f19cc055b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f19ec0b10b0 0x7f19ec141980 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f19ec0b0830 0x7f19ec1571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 --2- 172.21.2.137:0/2549376372 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f19ec05fd20 0x7f19ec142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 >> 172.21.2.137:0/2549376372 conn(0x7f19ec0b4e60 msgr2=0x7f19ec146100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 shutdown_connections 2021-11-15T19:31:49.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.152+0000 7f19f443f700 1 -- 172.21.2.137:0/2549376372 wait complete. 2021-11-15T19:31:49.161 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:31:49.164 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:31:49.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f865a379700 1 Processor -- start 2021-11-15T19:31:49.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f865a379700 1 -- start start 2021-11-15T19:31:49.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f865a379700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 0x7f86540af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f865a379700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8654147f70 con 0x7f86540b0830 2021-11-15T19:31:49.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f865a379700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8654060100 con 0x7f86540b10b0 2021-11-15T19:31:49.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f865a379700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8654147cd0 con 0x7f865405fd20 2021-11-15T19:31:49.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f86537fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f86540b10b0 0x7f86540b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53912/0 (socket says 172.21.2.137:53912) 2021-11-15T19:31:49.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f86537fe700 1 -- 172.21.2.137:0/3469256094 learned_addr learned my addr 172.21.2.137:0/3469256094 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:49.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f8653fff700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 0x7f86540af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716304471 0 0) 0x7f8654060100 con 0x7f86540b10b0 2021-11-15T19:31:49.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.212+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8634003260 con 0x7f86540b10b0 2021-11-15T19:31:49.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895738799 0 0) 0x7f8634003260 con 0x7f86540b10b0 2021-11-15T19:31:49.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 msgr2=0x7f86540af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 0x7f86540af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 >> v1:172.21.2.111:6789/0 conn(0x7f86540b0830 legacy=0x7f86540aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540a9ed0 con 0x7f86540b10b0 2021-11-15T19:31:49.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8644001660 con 0x7f86540b10b0 2021-11-15T19:31:49.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 >> v1:172.21.2.137:6789/0 conn(0x7f86540b10b0 legacy=0x7f86540b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8634003750 0x7f8634003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8634004500 0x7f8634004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 0x7f8634004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654147cd0 con 0x7f8634004500 2021-11-15T19:31:49.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863400b800 con 0x7f8634003750 2021-11-15T19:31:49.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863400b9c0 con 0x7f865405fd20 2021-11-15T19:31:49.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8634003750 0x7f8634003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f86537fe700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8634004500 0x7f8634004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 0x7f8634004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 -- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 msgr2=0x7f8634004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f865405fd20 0x7f8634004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 -- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8634004500 msgr2=0x7f8634004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8634004500 0x7f8634004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 -- 172.21.2.137:0/3469256094 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634003260 con 0x7f8634003750 2021-11-15T19:31:49.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8634003750 0x7f8634003b50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f863c00a000 tx=0x7f863c008040).ready entity=mon.1 client_cookie=1d4bd30344e62937 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c013670 con 0x7f8634003750 2021-11-15T19:31:49.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c0137d0 con 0x7f8634003750 2021-11-15T19:31:49.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8652ffd700 1 -- 172.21.2.137:0/3469256094 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c013b30 con 0x7f8634003750 2021-11-15T19:31:49.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/3469256094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8634003750 msgr2=0x7f8634003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 --2- 172.21.2.137:0/3469256094 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8634003750 0x7f8634003b50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f863c00a000 tx=0x7f863c008040).stop 2021-11-15T19:31:49.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 -- 172.21.2.137:0/3469256094 reap_dead start 2021-11-15T19:31:49.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/3469256094 shutdown_connections 2021-11-15T19:31:49.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/3469256094 >> 172.21.2.137:0/3469256094 conn(0x7f86540b4e60 msgr2=0x7f86540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/3469256094 shutdown_connections 2021-11-15T19:31:49.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/3469256094 wait complete. 2021-11-15T19:31:49.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 Processor -- start 2021-11-15T19:31:49.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- start start 2021-11-15T19:31:49.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8634003750 0x7f8654156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86540982d0 0x7f8654159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 0x7f865415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654156e30 con 0x7f86540982d0 2021-11-15T19:31:49.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865409a9f0 con 0x7f8654098730 2021-11-15T19:31:49.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8654157050 con 0x7f8634003750 2021-11-15T19:31:49.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 0x7f865415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 0x7f865415a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35140/0 (socket says 172.21.2.137:35140) 2021-11-15T19:31:49.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 -- 172.21.2.137:0/1887873148 learned_addr learned my addr 172.21.2.137:0/1887873148 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:49.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f86537fe700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86540982d0 0x7f8654159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8653fff700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8634003750 0x7f8654156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 -- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8634003750 msgr2=0x7f8654156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8634003750 0x7f8654156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 -- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86540982d0 msgr2=0x7f8654159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86540982d0 0x7f8654159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 -- 172.21.2.137:0/1887873148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86541572f0 con 0x7f8654098730 2021-11-15T19:31:49.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f8658916700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 0x7f865415a230 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f86540acc70 tx=0x7f864c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864c00ee80 con 0x7f8654098730 2021-11-15T19:31:49.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c002470 con 0x7f8654098730 2021-11-15T19:31:49.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8654157590 con 0x7f8654098730 2021-11-15T19:31:49.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864c0027d0 con 0x7f8654098730 2021-11-15T19:31:49.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.216+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865415a940 con 0x7f8654098730 2021-11-15T19:31:49.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8654157720 con 0x7f8654098730 2021-11-15T19:31:49.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f864c002930 con 0x7f8654098730 2021-11-15T19:31:49.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f86517fa700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86380536a0 0x7f8638055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f864c06b4e0 con 0x7f8654098730 2021-11-15T19:31:49.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f8653fff700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86380536a0 0x7f8638055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f8653fff700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86380536a0 0x7f8638055b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f863c019000 tx=0x7f863c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.220+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f864c042640 con 0x7f8654098730 2021-11-15T19:31:49.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.332+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f86540573d0 con 0x7f8654098730 2021-11-15T19:31:49.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.344+0000 7f86517fa700 1 -- 172.21.2.137:0/1887873148 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f864c045c60 con 0x7f8654098730 2021-11-15T19:31:49.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86380536a0 msgr2=0x7f8638055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86380536a0 0x7f8638055b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f863c019000 tx=0x7f863c008040).stop 2021-11-15T19:31:49.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 msgr2=0x7f865415a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 0x7f865415a230 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f86540acc70 tx=0x7f864c009040).stop 2021-11-15T19:31:49.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 shutdown_connections 2021-11-15T19:31:49.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86380536a0 0x7f8638055b60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8654098730 0x7f865415a230 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86540982d0 0x7f8654159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 --2- 172.21.2.137:0/1887873148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8634003750 0x7f8654156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 >> 172.21.2.137:0/1887873148 conn(0x7f86540b4e60 msgr2=0x7f8654146850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 shutdown_connections 2021-11-15T19:31:49.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.348+0000 7f865a379700 1 -- 172.21.2.137:0/1887873148 wait complete. 2021-11-15T19:31:49.354 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:31:49.357 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:31:49.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 Processor -- start 2021-11-15T19:31:49.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- start start 2021-11-15T19:31:49.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdbbc05fd20 0x7fdbbc0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc147f70 con 0x7fdbbc0b0830 2021-11-15T19:31:49.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc060100 con 0x7fdbbc0b10b0 2021-11-15T19:31:49.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc147cd0 con 0x7fdbbc05fd20 2021-11-15T19:31:49.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbb7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdbbc0b10b0 0x7fdbbc0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53930/0 (socket says 172.21.2.137:53930) 2021-11-15T19:31:49.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbb7fe700 1 -- 172.21.2.137:0/1111729860 learned_addr learned my addr 172.21.2.137:0/1111729860 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:49.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbbfff700 1 --2- 172.21.2.137:0/1111729860 >> v2:172.21.2.137:3300/0 conn(0x7fdbbc05fd20 0x7fdbbc0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1111729860 >> v1:172.21.2.137:6789/0 conn(0x7fdbbc0b10b0 legacy=0x7fdbbc0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1111729860 >> v1:172.21.2.111:6789/0 conn(0x7fdbbc0b0830 legacy=0x7fdbbc0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1111729860 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0a9ed0 con 0x7fdbbc05fd20 2021-11-15T19:31:49.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbbfff700 1 --2- 172.21.2.137:0/1111729860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc0af800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fdbbc0b4db0 tx=0x7fdbac006df0).ready entity=mon.1 client_cookie=2248da9530ea1489 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbaffd700 1 -- 172.21.2.137:0/1111729860 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac00d5c0 con 0x7fdbbc05fd20 2021-11-15T19:31:49.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbaffd700 1 -- 172.21.2.137:0/1111729860 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac000e90 con 0x7fdbbc05fd20 2021-11-15T19:31:49.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbbaffd700 1 -- 172.21.2.137:0/1111729860 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac00d910 con 0x7fdbbc05fd20 2021-11-15T19:31:49.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1111729860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 msgr2=0x7fdbbc0af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1111729860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc0af800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fdbbc0b4db0 tx=0x7fdbac006df0).stop 2021-11-15T19:31:49.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1111729860 shutdown_connections 2021-11-15T19:31:49.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1111729860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc0af800 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1111729860 >> 172.21.2.137:0/1111729860 conn(0x7fdbbc0b4e60 msgr2=0x7fdbbc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1111729860 shutdown_connections 2021-11-15T19:31:49.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1111729860 wait complete. 2021-11-15T19:31:49.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.408+0000 7fdbc29ae700 1 Processor -- start 2021-11-15T19:31:49.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- start start 2021-11-15T19:31:49.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbbc0b0830 0x7fdbbc142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbbc0b10b0 0x7fdbbc157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc1409e0 con 0x7fdbbc0b10b0 2021-11-15T19:31:49.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0631d0 con 0x7fdbbc05fd20 2021-11-15T19:31:49.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc062c90 con 0x7fdbbc0b0830 2021-11-15T19:31:49.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35154/0 (socket says 172.21.2.137:35154) 2021-11-15T19:31:49.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1081891874 learned_addr learned my addr 172.21.2.137:0/1081891874 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:49.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbbc0b0830 msgr2=0x7fdbbc142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbbc0b0830 0x7fdbbc142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbbc0b10b0 msgr2=0x7fdbbc157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbbc0b10b0 0x7fdbbc157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 -- 172.21.2.137:0/1081891874 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac00b180 con 0x7fdbbc05fd20 2021-11-15T19:31:49.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbbfff700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc156800 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fdbbc0b4db0 tx=0x7fdbac012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac016070 con 0x7fdbbc05fd20 2021-11-15T19:31:49.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac002f50 con 0x7fdbbc05fd20 2021-11-15T19:31:49.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc062f90 con 0x7fdbbc05fd20 2021-11-15T19:31:49.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac01e450 con 0x7fdbbc05fd20 2021-11-15T19:31:49.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc143a30 con 0x7fdbbc05fd20 2021-11-15T19:31:49.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc063df0 con 0x7fdbbc05fd20 2021-11-15T19:31:49.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdbac025030 con 0x7fdbbc05fd20 2021-11-15T19:31:49.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbb97fa700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdba00535d0 0x7fdba0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdbac06c900 con 0x7fdbbc05fd20 2021-11-15T19:31:49.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.412+0000 7fdbbb7fe700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdba00535d0 0x7fdba0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.416+0000 7fdbbb7fe700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdba00535d0 0x7fdba0055a90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fdbbc0b2a00 tx=0x7fdba4007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.416+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdbac043a60 con 0x7fdbbc05fd20 2021-11-15T19:31:49.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.528+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdbbc1479f0 con 0x7fdbbc05fd20 2021-11-15T19:31:49.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.540+0000 7fdbb97fa700 1 -- 172.21.2.137:0/1081891874 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdbac047080 con 0x7fdbbc05fd20 2021-11-15T19:31:49.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdba00535d0 msgr2=0x7fdba0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdba00535d0 0x7fdba0055a90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fdbbc0b2a00 tx=0x7fdba4007860).stop 2021-11-15T19:31:49.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 msgr2=0x7fdbbc156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc156800 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fdbbc0b4db0 tx=0x7fdbac012000).stop 2021-11-15T19:31:49.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 shutdown_connections 2021-11-15T19:31:49.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdba00535d0 0x7fdba0055a90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdbbc0b10b0 0x7fdbbc157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdbbc0b0830 0x7fdbbc142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 --2- 172.21.2.137:0/1081891874 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdbbc05fd20 0x7fdbbc156800 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 >> 172.21.2.137:0/1081891874 conn(0x7fdbbc0b4e60 msgr2=0x7fdbbc099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 shutdown_connections 2021-11-15T19:31:49.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.544+0000 7fdbc29ae700 1 -- 172.21.2.137:0/1081891874 wait complete. 2021-11-15T19:31:49.550 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:31:49.553 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:49.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 Processor -- start 2021-11-15T19:31:49.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 -- start start 2021-11-15T19:31:49.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 0x7fdb940b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdb9405f730 0x7fdb9405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb94060070 con 0x7fdb940608f0 2021-11-15T19:31:49.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb940ad6c0 con 0x7fdb9405f730 2021-11-15T19:31:49.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9bc04700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940b1b50 con 0x7fdb9413f890 2021-11-15T19:31:49.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdb940608f0 0x7fdb940b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53942/0 (socket says 172.21.2.137:53942) 2021-11-15T19:31:49.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 -- 172.21.2.137:0/3797942317 learned_addr learned my addr 172.21.2.137:0/3797942317 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:49.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719240162 0 0) 0x7fdb94060070 con 0x7fdb940608f0 2021-11-15T19:31:49.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb7c003260 con 0x7fdb940608f0 2021-11-15T19:31:49.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9a1a1700 1 --2- 172.21.2.137:0/3797942317 >> v2:172.21.2.111:3300/0 conn(0x7fdb9405f730 0x7fdb9405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9919f700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 0x7fdb940b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913433506 0 0) 0x7fdb7c003260 con 0x7fdb940608f0 2021-11-15T19:31:49.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 msgr2=0x7fdb940b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 0x7fdb940b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 >> v2:172.21.2.111:3300/0 conn(0x7fdb9405f730 msgr2=0x7fdb9405fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 --2- 172.21.2.137:0/3797942317 >> v2:172.21.2.111:3300/0 conn(0x7fdb9405f730 0x7fdb9405fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940b0c80 con 0x7fdb940608f0 2021-11-15T19:31:49.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fdb88001660 con 0x7fdb940608f0 2021-11-15T19:31:49.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 >> v1:172.21.2.137:6789/0 conn(0x7fdb940608f0 legacy=0x7fdb940b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb7c0037d0 0x7fdb7c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb7c004500 0x7fdb7c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 0x7fdb7c004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940ad6c0 con 0x7fdb7c004500 2021-11-15T19:31:49.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940b1b50 con 0x7fdb7c0037d0 2021-11-15T19:31:49.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c00b8d0 con 0x7fdb9413f890 2021-11-15T19:31:49.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb7c0037d0 0x7fdb7c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9a1a1700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 0x7fdb7c004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9919f700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb7c004500 0x7fdb7c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 -- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 msgr2=0x7fdb7c004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb9413f890 0x7fdb7c004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 -- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb7c004500 msgr2=0x7fdb7c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:49.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb7c004500 0x7fdb7c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 -- 172.21.2.137:0/3797942317 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c003260 con 0x7fdb7c0037d0 2021-11-15T19:31:49.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb999a0700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb7c0037d0 0x7fdb7c003bf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fdb88001370 tx=0x7fdb88001d80).ready entity=mon.1 client_cookie=b6a3469bd85705a0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb880070d0 con 0x7fdb7c0037d0 2021-11-15T19:31:49.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb88007230 con 0x7fdb7c0037d0 2021-11-15T19:31:49.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.600+0000 7fdb9899e700 1 -- 172.21.2.137:0/3797942317 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8800c8f0 con 0x7fdb7c0037d0 2021-11-15T19:31:49.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3797942317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb7c0037d0 msgr2=0x7fdb7c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3797942317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb7c0037d0 0x7fdb7c003bf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fdb88001370 tx=0x7fdb88001d80).stop 2021-11-15T19:31:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 -- 172.21.2.137:0/3797942317 reap_dead start 2021-11-15T19:31:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3797942317 shutdown_connections 2021-11-15T19:31:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3797942317 >> 172.21.2.137:0/3797942317 conn(0x7fdb94063980 msgr2=0x7fdb94063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3797942317 shutdown_connections 2021-11-15T19:31:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3797942317 wait complete. 2021-11-15T19:31:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 Processor -- start 2021-11-15T19:31:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- start start 2021-11-15T19:31:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb7c0037d0 0x7fdb941398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb94143880 0x7fdb94145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 0x7fdb94140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb94142080 con 0x7fdb94143880 2021-11-15T19:31:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb94142320 con 0x7fdb9413a1a0 2021-11-15T19:31:49.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb94143650 con 0x7fdb7c0037d0 2021-11-15T19:31:49.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 0x7fdb94140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 0x7fdb94140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35172/0 (socket says 172.21.2.137:35172) 2021-11-15T19:31:49.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 -- 172.21.2.137:0/3395824684 learned_addr learned my addr 172.21.2.137:0/3395824684 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:49.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 -- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb7c0037d0 msgr2=0x7fdb941398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb7c0037d0 0x7fdb941398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 -- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb94143880 msgr2=0x7fdb94145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb94143880 0x7fdb94145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 -- 172.21.2.137:0/3395824684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9413a620 con 0x7fdb9413a1a0 2021-11-15T19:31:49.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9a1a1700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 0x7fdb94140d60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fdb8c00d000 tx=0x7fdb8c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8c0126d0 con 0x7fdb9413a1a0 2021-11-15T19:31:49.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c00c070 con 0x7fdb9413a1a0 2021-11-15T19:31:49.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8c012a20 con 0x7fdb9413a1a0 2021-11-15T19:31:49.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb94141250 con 0x7fdb9413a1a0 2021-11-15T19:31:49.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb94151070 con 0x7fdb9413a1a0 2021-11-15T19:31:49.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb94139fa0 con 0x7fdb9413a1a0 2021-11-15T19:31:49.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb8c012040 con 0x7fdb9413a1a0 2021-11-15T19:31:49.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb86ffd700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdb74053690 0x7fdb74055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:49.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.604+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdb8c06b8c0 con 0x7fdb9413a1a0 2021-11-15T19:31:49.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.608+0000 7fdb999a0700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdb74053690 0x7fdb74055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:49.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.608+0000 7fdb999a0700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdb74053690 0x7fdb74055b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fdb88001370 tx=0x7fdb88015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:49.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.608+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb8c042a20 con 0x7fdb9413a1a0 2021-11-15T19:31:49.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.716+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb940b0f20 con 0x7fdb9413a1a0 2021-11-15T19:31:49.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb86ffd700 1 -- 172.21.2.137:0/3395824684 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fdb8c046040 con 0x7fdb9413a1a0 2021-11-15T19:31:49.723 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:49.723 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:31:49.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdb74053690 msgr2=0x7fdb74055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdb74053690 0x7fdb74055b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fdb88001370 tx=0x7fdb88015000).stop 2021-11-15T19:31:49.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 msgr2=0x7fdb94140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:49.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 0x7fdb94140d60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fdb8c00d000 tx=0x7fdb8c008040).stop 2021-11-15T19:31:49.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 shutdown_connections 2021-11-15T19:31:49.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdb74053690 0x7fdb74055b50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdb9413a1a0 0x7fdb94140d60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:49.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdb94143880 0x7fdb94145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 --2- 172.21.2.137:0/3395824684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdb7c0037d0 0x7fdb941398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:49.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 >> 172.21.2.137:0/3395824684 conn(0x7fdb94063980 msgr2=0x7fdb940b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:49.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 shutdown_connections 2021-11-15T19:31:49.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:49.720+0000 7fdb9bc04700 1 -- 172.21.2.137:0/3395824684 wait complete. 2021-11-15T19:31:49.727 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:31:49.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:31:47.615370+0000', 'modified': '2021-11-15T19:31:48.620136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5893}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5893': {'gid': 5893, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/837201683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 837201683}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 837201683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:31:49.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:31:49.933 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:31:50.002 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5893,"want_state":"up:active","state":"up:active","rank_uptime":2.376050148,"mdsmap_epoch":26,"osdmap_epoch":63,"osdmap_epoch_barrier":62,"uptime":6.5069111770000001} 2021-11-15T19:31:50.003 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5893, "mdsmap_epoch": 26, "osdmap_epoch": 63, "osdmap_epoch_barrier": 62, "rank_uptime": 2.376050148, "state": "up:active", "uptime": 6.506911177, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:31:50.003 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:31:50.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f92a3700 1 Processor -- start 2021-11-15T19:31:50.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f92a3700 1 -- start start 2021-11-15T19:31:50.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f92a3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f09f409cca0 0x7f09f4143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f92a3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f405fe40 con 0x7f09f40b3140 2021-11-15T19:31:50.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f92a3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f409d150 con 0x7f09f409c8c0 2021-11-15T19:31:50.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f92a3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4099790 con 0x7f09f409cca0 2021-11-15T19:31:50.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f2ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f09f409c8c0 0x7f09f405f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53966/0 (socket says 172.21.2.137:53966) 2021-11-15T19:31:50.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f2ffd700 1 -- 172.21.2.137:0/3658360672 learned_addr learned my addr 172.21.2.137:0/3658360672 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:50.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f37fe700 1 --2- 172.21.2.137:0/3658360672 >> v2:172.21.2.111:3300/0 conn(0x7f09f409cca0 0x7f09f4143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f1ffb700 1 -- 172.21.2.137:0/3658360672 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153006777 0 0) 0x7f09f409d150 con 0x7f09f409c8c0 2021-11-15T19:31:50.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.048+0000 7f09f1ffb700 1 -- 172.21.2.137:0/3658360672 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d4003260 con 0x7f09f409c8c0 2021-11-15T19:31:50.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f37fe700 1 -- 172.21.2.137:0/3658360672 >> v1:172.21.2.137:6789/0 conn(0x7f09f409c8c0 legacy=0x7f09f405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f37fe700 1 -- 172.21.2.137:0/3658360672 >> v1:172.21.2.111:6789/0 conn(0x7f09f40b3140 legacy=0x7f09f409ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f37fe700 1 -- 172.21.2.137:0/3658360672 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40b2940 con 0x7f09f409cca0 2021-11-15T19:31:50.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f37fe700 1 --2- 172.21.2.137:0/3658360672 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f409cca0 0x7f09f4143260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f09ec0032f0 tx=0x7f09ec0091d0).ready entity=mon.0 client_cookie=473ab73da2bebff0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f1ffb700 1 -- 172.21.2.137:0/3658360672 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ec00b6c0 con 0x7f09f409cca0 2021-11-15T19:31:50.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f1ffb700 1 -- 172.21.2.137:0/3658360672 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00b820 con 0x7f09f409cca0 2021-11-15T19:31:50.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f1ffb700 1 -- 172.21.2.137:0/3658360672 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ec00b990 con 0x7f09f409cca0 2021-11-15T19:31:50.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/3658360672 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f409cca0 msgr2=0x7f09f4143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 --2- 172.21.2.137:0/3658360672 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f409cca0 0x7f09f4143260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f09ec0032f0 tx=0x7f09ec0091d0).stop 2021-11-15T19:31:50.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/3658360672 shutdown_connections 2021-11-15T19:31:50.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 --2- 172.21.2.137:0/3658360672 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f409cca0 0x7f09f4143260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/3658360672 >> 172.21.2.137:0/3658360672 conn(0x7f09f40b45b0 msgr2=0x7f09f405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/3658360672 shutdown_connections 2021-11-15T19:31:50.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/3658360672 wait complete. 2021-11-15T19:31:50.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 Processor -- start 2021-11-15T19:31:50.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- start start 2021-11-15T19:31:50.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09f409c8c0 0x7f09f4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 0x7f09f4061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f40b3140 0x7f09f40b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40618c0 con 0x7f09f40b3140 2021-11-15T19:31:50.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4062710 con 0x7f09f409cca0 2021-11-15T19:31:50.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f41570e0 con 0x7f09f409c8c0 2021-11-15T19:31:50.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 0x7f09f4061d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f2ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09f409c8c0 0x7f09f4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f37fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f40b3140 0x7f09f40b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 0x7f09f4061d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35188/0 (socket says 172.21.2.137:35188) 2021-11-15T19:31:50.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 -- 172.21.2.137:0/331767187 learned_addr learned my addr 172.21.2.137:0/331767187 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f2ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09f409c8c0 0x7f09f4156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:36756/0 (socket says 172.21.2.137:36756) 2021-11-15T19:31:50.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 -- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09f409c8c0 msgr2=0x7f09f4156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09f409c8c0 0x7f09f4156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 -- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f40b3140 msgr2=0x7f09f40b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f40b3140 0x7f09f40b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 -- 172.21.2.137:0/331767187 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec009470 con 0x7f09f409cca0 2021-11-15T19:31:50.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f27fc700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 0x7f09f4061d90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09f405d5e0 tx=0x7f09e4007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e4012400 con 0x7f09f409cca0 2021-11-15T19:31:50.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4012560 con 0x7f09f409cca0 2021-11-15T19:31:50.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4062280 con 0x7f09f409cca0 2021-11-15T19:31:50.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e40128c0 con 0x7f09f409cca0 2021-11-15T19:31:50.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f4066740 con 0x7f09f409cca0 2021-11-15T19:31:50.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4061700 con 0x7f09f409cca0 2021-11-15T19:31:50.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f09e4019030 con 0x7f09f409cca0 2021-11-15T19:31:50.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09ebfff700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09d80536a0 0x7f09d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.052+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f09e406aca0 con 0x7f09f409cca0 2021-11-15T19:31:50.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.056+0000 7f09f2ffd700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09d80536a0 0x7f09d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.056+0000 7f09f2ffd700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09d80536a0 0x7f09d8055b60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f09dc00d000 tx=0x7f09dc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.056+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09e406f070 con 0x7f09f409cca0 2021-11-15T19:31:50.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09f409b210 con 0x7f09f409cca0 2021-11-15T19:31:50.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09ebfff700 1 -- 172.21.2.137:0/331767187 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f09e4041e00 con 0x7f09f409cca0 2021-11-15T19:31:50.145 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:50.145 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":63,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:31:48.621301+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:31:45.526704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T19:31:46.590945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:31:50.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09d80536a0 msgr2=0x7f09d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09d80536a0 0x7f09d8055b60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f09dc00d000 tx=0x7f09dc009040).stop 2021-11-15T19:31:50.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 msgr2=0x7f09f4061d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 0x7f09f4061d90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09f405d5e0 tx=0x7f09e4007c50).stop 2021-11-15T19:31:50.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 shutdown_connections 2021-11-15T19:31:50.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09d80536a0 0x7f09d8055b60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09f40b3140 0x7f09f40b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09f409cca0 0x7f09f4061d90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 --2- 172.21.2.137:0/331767187 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f09f409c8c0 0x7f09f4156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 >> 172.21.2.137:0/331767187 conn(0x7f09f40b45b0 msgr2=0x7f09f405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 shutdown_connections 2021-11-15T19:31:50.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.140+0000 7f09f92a3700 1 -- 172.21.2.137:0/331767187 wait complete. 2021-11-15T19:31:50.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:31:45.526704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:31:46.590945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:31:50.153 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:31:50.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c638d1700 1 Processor -- start 2021-11-15T19:31:50.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c638d1700 1 -- start start 2021-11-15T19:31:50.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c638d1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0c5c0b00a0 0x7f0c5c13c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c638d1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c066270 con 0x7f0c5c065b10 2021-11-15T19:31:50.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c638d1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c065fd0 con 0x7f0c5c065730 2021-11-15T19:31:50.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c638d1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c067410 con 0x7f0c5c0b00a0 2021-11-15T19:31:50.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c6166d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0c5c065730 0x7f0c5c13c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:53976/0 (socket says 172.21.2.137:53976) 2021-11-15T19:31:50.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c6166d700 1 -- 172.21.2.137:0/434849560 learned_addr learned my addr 172.21.2.137:0/434849560 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:50.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340696987 0 0) 0x7f0c5c065fd0 con 0x7f0c5c065730 2021-11-15T19:31:50.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.200+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c44004370 con 0x7f0c5c065730 2021-11-15T19:31:50.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4243173870 0 0) 0x7f0c44004370 con 0x7f0c5c065730 2021-11-15T19:31:50.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 >> v2:172.21.2.111:3300/0 conn(0x7f0c5c0b00a0 msgr2=0x7f0c5c13c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 --2- 172.21.2.137:0/434849560 >> v2:172.21.2.111:3300/0 conn(0x7f0c5c0b00a0 0x7f0c5c13c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 >> v1:172.21.2.111:6789/0 conn(0x7f0c5c065b10 legacy=0x7f0c5c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c066f70 con 0x7f0c5c065730 2021-11-15T19:31:50.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f0c50001660 con 0x7f0c5c065730 2021-11-15T19:31:50.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 >> v1:172.21.2.137:6789/0 conn(0x7f0c5c065730 legacy=0x7f0c5c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c44004930 0x7f0c44004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c44005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c44006160 0x7f0c4400c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c067410 con 0x7f0c44006160 2021-11-15T19:31:50.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4400d050 con 0x7f0c44005610 2021-11-15T19:31:50.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4400d210 con 0x7f0c44004930 2021-11-15T19:31:50.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c44005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 -- 172.21.2.137:0/434849560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c44004930 msgr2=0x7f0c44004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c44004930 0x7f0c44004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 -- 172.21.2.137:0/434849560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c44006160 msgr2=0x7f0c4400c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c44006160 0x7f0c4400c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 -- 172.21.2.137:0/434849560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44004370 con 0x7f0c44005610 2021-11-15T19:31:50.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c61e6e700 1 -- 172.21.2.137:0/434849560 reap_dead start 2021-11-15T19:31:50.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c60e6c700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c44005a90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f0c58000f70 tx=0x7f0c580079e0).ready entity=mon.1 client_cookie=5f5be7d098325dd4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c58007cf0 con 0x7f0c44005610 2021-11-15T19:31:50.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58014410 con 0x7f0c44005610 2021-11-15T19:31:50.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4ffff700 1 -- 172.21.2.137:0/434849560 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c58014770 con 0x7f0c44005610 2021-11-15T19:31:50.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/434849560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 msgr2=0x7f0c44005a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c44005a90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f0c58000f70 tx=0x7f0c580079e0).stop 2021-11-15T19:31:50.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/434849560 shutdown_connections 2021-11-15T19:31:50.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 --2- 172.21.2.137:0/434849560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c44005a90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/434849560 >> 172.21.2.137:0/434849560 conn(0x7f0c5c060290 msgr2=0x7f0c5c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/434849560 shutdown_connections 2021-11-15T19:31:50.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/434849560 wait complete. 2021-11-15T19:31:50.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 Processor -- start 2021-11-15T19:31:50.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- start start 2021-11-15T19:31:50.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c5c144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c5c140c40 0x7f0c5c141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c5c0ad630 0x7f0c5c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0adfa0 con 0x7f0c5c140c40 2021-11-15T19:31:50.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0afd10 con 0x7f0c44005610 2021-11-15T19:31:50.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c142030 con 0x7f0c5c0ad630 2021-11-15T19:31:50.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c5c144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c5c144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35208/0 (socket says 172.21.2.137:35208) 2021-11-15T19:31:50.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 -- 172.21.2.137:0/2864990611 learned_addr learned my addr 172.21.2.137:0/2864990611 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 -- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c5c0ad630 msgr2=0x7f0c5c0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c5c0ad630 0x7f0c5c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 -- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c5c140c40 msgr2=0x7f0c5c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c5c140c40 0x7f0c5c141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 -- 172.21.2.137:0/2864990611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0afa70 con 0x7f0c44005610 2021-11-15T19:31:50.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c6166d700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c5c144240 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f0c5c1421c0 tx=0x7f0c5c067100).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c50007170 con 0x7f0c44005610 2021-11-15T19:31:50.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c500072d0 con 0x7f0c44005610 2021-11-15T19:31:50.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c1416a0 con 0x7f0c44005610 2021-11-15T19:31:50.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c139f90 con 0x7f0c44005610 2021-11-15T19:31:50.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.204+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c50004920 con 0x7f0c44005610 2021-11-15T19:31:50.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c38003410 con 0x7f0c44005610 2021-11-15T19:31:50.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c5001b070 con 0x7f0c44005610 2021-11-15T19:31:50.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c4e7fc700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c3c053720 0x7f0c3c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0c5006b250 con 0x7f0c44005610 2021-11-15T19:31:50.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c60e6c700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c3c053720 0x7f0c3c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c60e6c700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c3c053720 0x7f0c3c055be0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0c58000f70 tx=0x7f0c58015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.208+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c500422a0 con 0x7f0c44005610 2021-11-15T19:31:50.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c38003c40 con 0x7f0c44005610 2021-11-15T19:31:50.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c4e7fc700 1 -- 172.21.2.137:0/2864990611 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v63) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c500458c0 con 0x7f0c44005610 2021-11-15T19:31:50.297 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:31:50.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c3c053720 msgr2=0x7f0c3c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c3c053720 0x7f0c3c055be0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0c58000f70 tx=0x7f0c58015000).stop 2021-11-15T19:31:50.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 msgr2=0x7f0c5c144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c5c144240 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f0c5c1421c0 tx=0x7f0c5c067100).stop 2021-11-15T19:31:50.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 shutdown_connections 2021-11-15T19:31:50.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c3c053720 0x7f0c3c055be0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c5c0ad630 0x7f0c5c0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c5c140c40 0x7f0c5c141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 --2- 172.21.2.137:0/2864990611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c44005610 0x7f0c5c144240 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 >> 172.21.2.137:0/2864990611 conn(0x7f0c5c060290 msgr2=0x7f0c5c05c340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 shutdown_connections 2021-11-15T19:31:50.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.292+0000 7f0c638d1700 1 -- 172.21.2.137:0/2864990611 wait complete. 2021-11-15T19:31:50.304 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:31:50.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 Processor -- start 2021-11-15T19:31:50.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 -- start start 2021-11-15T19:31:50.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 0x7fe39c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe39c0b0550 0x7fe39c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c05cb50 con 0x7fe39c14aaa0 2021-11-15T19:31:50.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0b1650 con 0x7fe39c0b0550 2021-11-15T19:31:50.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a31d1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0ad030 con 0x7fe39c05c770 2021-11-15T19:31:50.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe39c14aaa0 0x7fe39c140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54000/0 (socket says 172.21.2.137:54000) 2021-11-15T19:31:50.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 -- 172.21.2.137:0/2249632648 learned_addr learned my addr 172.21.2.137:0/2249632648 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:50.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a0f6d700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 0x7fe39c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770389855 0 0) 0x7fe39c05cb50 con 0x7fe39c14aaa0 2021-11-15T19:31:50.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe37c003260 con 0x7fe39c14aaa0 2021-11-15T19:31:50.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39bfff700 1 --2- 172.21.2.137:0/2249632648 >> v2:172.21.2.111:3300/0 conn(0x7fe39c0b0550 0x7fe39c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 804614176 0 0) 0x7fe37c003260 con 0x7fe39c14aaa0 2021-11-15T19:31:50.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 msgr2=0x7fe39c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 0x7fe39c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 >> v2:172.21.2.111:3300/0 conn(0x7fe39c0b0550 msgr2=0x7fe39c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 --2- 172.21.2.137:0/2249632648 >> v2:172.21.2.111:3300/0 conn(0x7fe39c0b0550 0x7fe39c14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0ad2d0 con 0x7fe39c14aaa0 2021-11-15T19:31:50.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe3940019e0 con 0x7fe39c14aaa0 2021-11-15T19:31:50.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a0f6d700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 0x7fe39c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:31:50.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 >> v1:172.21.2.137:6789/0 conn(0x7fe39c14aaa0 legacy=0x7fe39c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe37c003750 0x7fe37c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 0x7fe37c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe37c0049f0 0x7fe37c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b1650 con 0x7fe37c003750 2021-11-15T19:31:50.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0ad030 con 0x7fe37c0049f0 2021-11-15T19:31:50.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c00b780 con 0x7fe39c05c770 2021-11-15T19:31:50.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe37c0049f0 0x7fe37c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a0f6d700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe37c003750 0x7fe37c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 -- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 msgr2=0x7fe37c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe39c05c770 0x7fe37c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 -- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe37c003750 msgr2=0x7fe37c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe37c003750 0x7fe37c003b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 -- 172.21.2.137:0/2249632648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c003260 con 0x7fe37c0049f0 2021-11-15T19:31:50.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe3a176e700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe37c0049f0 0x7fe37c004e70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fe3940016f0 tx=0x7fe3940021d0).ready entity=mon.1 client_cookie=448d9b1a474e706e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39400cc80 con 0x7fe37c0049f0 2021-11-15T19:31:50.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400cde0 con 0x7fe37c0049f0 2021-11-15T19:31:50.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.352+0000 7fe39b7fe700 1 -- 172.21.2.137:0/2249632648 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe394005b80 con 0x7fe37c0049f0 2021-11-15T19:31:50.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/2249632648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe37c0049f0 msgr2=0x7fe37c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/2249632648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe37c0049f0 0x7fe37c004e70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fe3940016f0 tx=0x7fe3940021d0).stop 2021-11-15T19:31:50.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a176e700 1 -- 172.21.2.137:0/2249632648 reap_dead start 2021-11-15T19:31:50.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/2249632648 shutdown_connections 2021-11-15T19:31:50.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/2249632648 >> 172.21.2.137:0/2249632648 conn(0x7fe39c0631e0 msgr2=0x7fe39c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/2249632648 shutdown_connections 2021-11-15T19:31:50.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/2249632648 wait complete. 2021-11-15T19:31:50.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 Processor -- start 2021-11-15T19:31:50.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- start start 2021-11-15T19:31:50.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe37c0049f0 0x7fe39c1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 0x7fe39c0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe39c0b4150 0x7fe39c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0659a0 con 0x7fe39c0b4150 2021-11-15T19:31:50.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c064800 con 0x7fe39c159710 2021-11-15T19:31:50.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c063760 con 0x7fe37c0049f0 2021-11-15T19:31:50.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 0x7fe39c0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 0x7fe39c0b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35228/0 (socket says 172.21.2.137:35228) 2021-11-15T19:31:50.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 -- 172.21.2.137:0/1075561232 learned_addr learned my addr 172.21.2.137:0/1075561232 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 -- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe37c0049f0 msgr2=0x7fe39c1496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe37c0049f0 0x7fe39c1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 -- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe39c0b4150 msgr2=0x7fe39c0b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe39c0b4150 0x7fe39c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 -- 172.21.2.137:0/1075561232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c149e50 con 0x7fe39c159710 2021-11-15T19:31:50.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe39bfff700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 0x7fe39c0b2fb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fe39c14a2b0 tx=0x7fe384008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe384011500 con 0x7fe39c159710 2021-11-15T19:31:50.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe384000e90 con 0x7fe39c159710 2021-11-15T19:31:50.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c0b3990 con 0x7fe39c159710 2021-11-15T19:31:50.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c066f10 con 0x7fe39c159710 2021-11-15T19:31:50.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe384011850 con 0x7fe39c159710 2021-11-15T19:31:50.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374003410 con 0x7fe39c159710 2021-11-15T19:31:50.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe384019020 con 0x7fe39c159710 2021-11-15T19:31:50.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe399ffb700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe380053660 0x7fe380055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.356+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe38406b050 con 0x7fe39c159710 2021-11-15T19:31:50.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.360+0000 7fe3a0f6d700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe380053660 0x7fe380055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.360+0000 7fe3a0f6d700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe380053660 0x7fe380055b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe38c008000 tx=0x7fe38c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.360+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3840421b0 con 0x7fe39c159710 2021-11-15T19:31:50.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe374003c40 con 0x7fe39c159710 2021-11-15T19:31:50.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe399ffb700 1 -- 172.21.2.137:0/1075561232 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe384017070 con 0x7fe39c159710 2021-11-15T19:31:50.448 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:31:50.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe380053660 msgr2=0x7fe380055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe380053660 0x7fe380055b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe38c008000 tx=0x7fe38c008040).stop 2021-11-15T19:31:50.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 msgr2=0x7fe39c0b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 0x7fe39c0b2fb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fe39c14a2b0 tx=0x7fe384008040).stop 2021-11-15T19:31:50.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 shutdown_connections 2021-11-15T19:31:50.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe380053660 0x7fe380055b20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe39c0b4150 0x7fe39c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe39c159710 0x7fe39c0b2fb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 --2- 172.21.2.137:0/1075561232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe37c0049f0 0x7fe39c1496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 >> 172.21.2.137:0/1075561232 conn(0x7fe39c0631e0 msgr2=0x7fe39c144390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 shutdown_connections 2021-11-15T19:31:50.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.444+0000 7fe3a31d1700 1 -- 172.21.2.137:0/1075561232 wait complete. 2021-11-15T19:31:50.454 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:31:50.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 Processor -- start 2021-11-15T19:31:50.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- start start 2021-11-15T19:31:50.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc5e805c770 0x7fc5e80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e8140aa0 0x7fc5e8140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e805cb50 con 0x7fc5e80b0550 2021-11-15T19:31:50.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e80b1650 con 0x7fc5e805c770 2021-11-15T19:31:50.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80ad030 con 0x7fc5e8140aa0 2021-11-15T19:31:50.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5edf24700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc5e805c770 0x7fc5e80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ee725700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e8140aa0 0x7fc5e8140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5edf24700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc5e805c770 0x7fc5e80aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:42462/0 (socket says 172.21.2.137:42462) 2021-11-15T19:31:50.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5edf24700 1 -- 172.21.2.137:0/3737527741 learned_addr learned my addr 172.21.2.137:0/3737527741 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ee725700 1 -- 172.21.2.137:0/3737527741 >> v2:172.21.2.111:3300/0 conn(0x7fc5e805c770 msgr2=0x7fc5e80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ee725700 1 --2- 172.21.2.137:0/3737527741 >> v2:172.21.2.111:3300/0 conn(0x7fc5e805c770 0x7fc5e80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ee725700 1 -- 172.21.2.137:0/3737527741 >> v1:172.21.2.111:6789/0 conn(0x7fc5e80b0550 legacy=0x7fc5e814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ee725700 1 -- 172.21.2.137:0/3737527741 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80ad2d0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ee725700 1 --2- 172.21.2.137:0/3737527741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e8140aa0 0x7fc5e8140f10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc5e00032f0 tx=0x7fc5e00091d0).ready entity=mon.2 client_cookie=fe3a1595b5d9d645 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ecf22700 1 -- 172.21.2.137:0/3737527741 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e000b6c0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ecf22700 1 -- 172.21.2.137:0/3737527741 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000b820 con 0x7fc5e8140aa0 2021-11-15T19:31:50.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5ecf22700 1 -- 172.21.2.137:0/3737527741 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e000b990 con 0x7fc5e8140aa0 2021-11-15T19:31:50.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- 172.21.2.137:0/3737527741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e8140aa0 msgr2=0x7fc5e8140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 --2- 172.21.2.137:0/3737527741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e8140aa0 0x7fc5e8140f10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc5e00032f0 tx=0x7fc5e00091d0).stop 2021-11-15T19:31:50.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- 172.21.2.137:0/3737527741 shutdown_connections 2021-11-15T19:31:50.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 --2- 172.21.2.137:0/3737527741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e8140aa0 0x7fc5e8140f10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 --2- 172.21.2.137:0/3737527741 >> v2:172.21.2.111:3300/0 conn(0x7fc5e805c770 0x7fc5e80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.504+0000 7fc5f0188700 1 -- 172.21.2.137:0/3737527741 >> 172.21.2.137:0/3737527741 conn(0x7fc5e80631e0 msgr2=0x7fc5e805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- 172.21.2.137:0/3737527741 shutdown_connections 2021-11-15T19:31:50.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- 172.21.2.137:0/3737527741 wait complete. 2021-11-15T19:31:50.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 Processor -- start 2021-11-15T19:31:50.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- start start 2021-11-15T19:31:50.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5e805c770 0x7fc5e813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e80b0550 0x7fc5e80655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 0x7fc5e813da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8066a00 con 0x7fc5e805c770 2021-11-15T19:31:50.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8066ca0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e813eca0 con 0x7fc5e80b0550 2021-11-15T19:31:50.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 0x7fc5e813da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 0x7fc5e813da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35240/0 (socket says 172.21.2.137:35240) 2021-11-15T19:31:50.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 -- 172.21.2.137:0/132666425 learned_addr learned my addr 172.21.2.137:0/132666425 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 -- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e80b0550 msgr2=0x7fc5e80655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e80b0550 0x7fc5e80655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 -- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5e805c770 msgr2=0x7fc5e813e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5e805c770 0x7fc5e813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 -- 172.21.2.137:0/132666425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0009470 con 0x7fc5e8140aa0 2021-11-15T19:31:50.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5ee725700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 0x7fc5e813da70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fc5e00032f0 tx=0x7fc5e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e00203f0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0020550 con 0x7fc5e8140aa0 2021-11-15T19:31:50.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e00208b0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e8156210 con 0x7fc5e8140aa0 2021-11-15T19:31:50.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e8065ac0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e8066820 con 0x7fc5e8140aa0 2021-11-15T19:31:50.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc5e001e070 con 0x7fc5e8140aa0 2021-11-15T19:31:50.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5d6ffd700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5c80536a0 0x7fc5c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc5e006ca30 con 0x7fc5e8140aa0 2021-11-15T19:31:50.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.508+0000 7fc5edf24700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5c80536a0 0x7fc5c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.512+0000 7fc5edf24700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5c80536a0 0x7fc5c8055b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fc5e400c000 tx=0x7fc5e4006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.512+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc5e0043a80 con 0x7fc5e8140aa0 2021-11-15T19:31:50.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5e80573d0 con 0x7fc5e8140aa0 2021-11-15T19:31:50.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5d6ffd700 1 -- 172.21.2.137:0/132666425 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc5e0015020 con 0x7fc5e8140aa0 2021-11-15T19:31:50.600 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:31:50.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5c80536a0 msgr2=0x7fc5c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5c80536a0 0x7fc5c8055b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fc5e400c000 tx=0x7fc5e4006eb0).stop 2021-11-15T19:31:50.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 msgr2=0x7fc5e813da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 0x7fc5e813da70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fc5e00032f0 tx=0x7fc5e0016000).stop 2021-11-15T19:31:50.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 shutdown_connections 2021-11-15T19:31:50.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5c80536a0 0x7fc5c8055b60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5e8140aa0 0x7fc5e813da70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5e80b0550 0x7fc5e80655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 --2- 172.21.2.137:0/132666425 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5e805c770 0x7fc5e813e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 >> 172.21.2.137:0/132666425 conn(0x7fc5e80631e0 msgr2=0x7fc5e814c030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 shutdown_connections 2021-11-15T19:31:50.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.596+0000 7fc5f0188700 1 -- 172.21.2.137:0/132666425 wait complete. 2021-11-15T19:31:50.607 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:31:50.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 Processor -- start 2021-11-15T19:31:50.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- start start 2021-11-15T19:31:50.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f23740b72e0 0x7f23740b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f23740acd60 0x7f23740b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740b76c0 con 0x7f23740b4680 2021-11-15T19:31:50.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23740b3100 con 0x7f23740b72e0 2021-11-15T19:31:50.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237412a170 con 0x7f23740acd60 2021-11-15T19:31:50.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23791cf700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f23740b4680 0x7f2374143ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54030/0 (socket says 172.21.2.137:54030) 2021-11-15T19:31:50.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23791cf700 1 -- 172.21.2.137:0/427723459 learned_addr learned my addr 172.21.2.137:0/427723459 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:50.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f2373fff700 1 --2- 172.21.2.137:0/427723459 >> v2:172.21.2.137:3300/0 conn(0x7f23740acd60 0x7f23740b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23789ce700 1 --2- 172.21.2.137:0/427723459 >> v2:172.21.2.111:3300/0 conn(0x7f23740b72e0 0x7f23740b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f2373fff700 1 -- 172.21.2.137:0/427723459 >> v2:172.21.2.111:3300/0 conn(0x7f23740b72e0 msgr2=0x7f23740b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f2373fff700 1 --2- 172.21.2.137:0/427723459 >> v2:172.21.2.111:3300/0 conn(0x7f23740b72e0 0x7f23740b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f2373fff700 1 -- 172.21.2.137:0/427723459 >> v1:172.21.2.137:6789/0 conn(0x7f23740b4680 legacy=0x7f2374143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23737fe700 1 -- 172.21.2.137:0/427723459 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093913549 0 0) 0x7f23740b76c0 con 0x7f23740b4680 2021-11-15T19:31:50.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f2373fff700 1 -- 172.21.2.137:0/427723459 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23740ad8a0 con 0x7f23740acd60 2021-11-15T19:31:50.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23789ce700 1 --2- 172.21.2.137:0/427723459 >> v2:172.21.2.111:3300/0 conn(0x7f23740b72e0 0x7f23740b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:31:50.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f2373fff700 1 --2- 172.21.2.137:0/427723459 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740acd60 0x7f23740b4190 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f235c002f70 tx=0x7f235c006df0).ready entity=mon.1 client_cookie=e0af500e28a806a7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23737fe700 1 -- 172.21.2.137:0/427723459 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235c00d5c0 con 0x7f23740acd60 2021-11-15T19:31:50.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23737fe700 1 -- 172.21.2.137:0/427723459 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c000e90 con 0x7f23740acd60 2021-11-15T19:31:50.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f23737fe700 1 -- 172.21.2.137:0/427723459 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235c00d910 con 0x7f23740acd60 2021-11-15T19:31:50.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- 172.21.2.137:0/427723459 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740acd60 msgr2=0x7f23740b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 --2- 172.21.2.137:0/427723459 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740acd60 0x7f23740b4190 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f235c002f70 tx=0x7f235c006df0).stop 2021-11-15T19:31:50.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- 172.21.2.137:0/427723459 shutdown_connections 2021-11-15T19:31:50.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 --2- 172.21.2.137:0/427723459 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740acd60 0x7f23740b4190 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 --2- 172.21.2.137:0/427723459 >> v2:172.21.2.111:3300/0 conn(0x7f23740b72e0 0x7f23740b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- 172.21.2.137:0/427723459 >> 172.21.2.137:0/427723459 conn(0x7f2374064960 msgr2=0x7f2374064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- 172.21.2.137:0/427723459 shutdown_connections 2021-11-15T19:31:50.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.656+0000 7f237ac32700 1 -- 172.21.2.137:0/427723459 wait complete. 2021-11-15T19:31:50.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 Processor -- start 2021-11-15T19:31:50.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- start start 2021-11-15T19:31:50.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23740acd60 0x7f2374124910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23740b4680 0x7f2374127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 0x7f2374127d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2374128260 con 0x7f23740acd60 2021-11-15T19:31:50.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2374153850 con 0x7f23740b72e0 2021-11-15T19:31:50.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2374124e00 con 0x7f23740b4680 2021-11-15T19:31:50.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 0x7f2374127d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 0x7f2374127d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35256/0 (socket says 172.21.2.137:35256) 2021-11-15T19:31:50.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 -- 172.21.2.137:0/628061157 learned_addr learned my addr 172.21.2.137:0/628061157 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23789ce700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23740acd60 0x7f2374124910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 -- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23740b4680 msgr2=0x7f2374127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23740b4680 0x7f2374127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 -- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23740acd60 msgr2=0x7f2374124910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23740acd60 0x7f2374124910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 -- 172.21.2.137:0/628061157 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c00b180 con 0x7f23740b72e0 2021-11-15T19:31:50.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23791cf700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 0x7f2374127d70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f236c001250 tx=0x7f236c007d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c005ba0 con 0x7f23740b72e0 2021-11-15T19:31:50.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c005d00 con 0x7f23740b72e0 2021-11-15T19:31:50.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c004a90 con 0x7f23740b72e0 2021-11-15T19:31:50.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2374125020 con 0x7f23740b72e0 2021-11-15T19:31:50.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23740ae6a0 con 0x7f23740b72e0 2021-11-15T19:31:50.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23741251b0 con 0x7f23740b72e0 2021-11-15T19:31:50.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f236c004bf0 con 0x7f23740b72e0 2021-11-15T19:31:50.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f2371ffb700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2358053660 0x7f2358055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f236c06b5e0 con 0x7f23740b72e0 2021-11-15T19:31:50.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23789ce700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2358053660 0x7f2358055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.660+0000 7f23789ce700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2358053660 0x7f2358055b20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f236400c000 tx=0x7f2364008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.664+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f236c0426c0 con 0x7f23740b72e0 2021-11-15T19:31:50.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.744+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23740b3cf0 con 0x7f23740b72e0 2021-11-15T19:31:50.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f2371ffb700 1 -- 172.21.2.137:0/628061157 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+10 (secure 0 0 0) 0x7f236c045ce0 con 0x7f23740b72e0 2021-11-15T19:31:50.751 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:31:50.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2358053660 msgr2=0x7f2358055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2358053660 0x7f2358055b20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f236400c000 tx=0x7f2364008040).stop 2021-11-15T19:31:50.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 msgr2=0x7f2374127d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 0x7f2374127d70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f236c001250 tx=0x7f236c007d60).stop 2021-11-15T19:31:50.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 shutdown_connections 2021-11-15T19:31:50.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2358053660 0x7f2358055b20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23740b72e0 0x7f2374127d70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23740b4680 0x7f2374127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 --2- 172.21.2.137:0/628061157 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23740acd60 0x7f2374124910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 >> 172.21.2.137:0/628061157 conn(0x7f2374064960 msgr2=0x7f2374140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 shutdown_connections 2021-11-15T19:31:50.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.748+0000 7f237ac32700 1 -- 172.21.2.137:0/628061157 wait complete. 2021-11-15T19:31:50.758 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:31:50.759 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:31:50.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.804+0000 7f90dd5f0700 1 Processor -- start 2021-11-15T19:31:50.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.804+0000 7f90dd5f0700 1 -- start start 2021-11-15T19:31:50.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.804+0000 7f90dd5f0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d80b1180 0x7f90d8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.804+0000 7f90dd5f0700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d80aecf0 con 0x7f90d80af2f0 2021-11-15T19:31:50.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d813f180 con 0x7f90d80acab0 2021-11-15T19:31:50.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8143780 con 0x7f90d80b1180 2021-11-15T19:31:50.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f90d80acab0 0x7f90d80b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54044/0 (socket says 172.21.2.137:54044) 2021-11-15T19:31:50.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 -- 172.21.2.137:0/1915793886 learned_addr learned my addr 172.21.2.137:0/1915793886 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:31:50.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679750039 0 0) 0x7f90c0001110 con 0x7f90d80acab0 2021-11-15T19:31:50.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b8004370 con 0x7f90d80acab0 2021-11-15T19:31:50.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3519723359 0 0) 0x7f90b8004370 con 0x7f90d80acab0 2021-11-15T19:31:50.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d80b1180 msgr2=0x7f90d8142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d80b1180 0x7f90d8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 >> v1:172.21.2.111:6789/0 conn(0x7f90d80af2f0 legacy=0x7f90d8143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80aef20 con 0x7f90d80acab0 2021-11-15T19:31:50.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f90c00017f0 con 0x7f90d80acab0 2021-11-15T19:31:50.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 >> v1:172.21.2.137:6789/0 conn(0x7f90d80acab0 legacy=0x7f90d80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90b80048e0 0x7f90b8004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90b8005610 0x7f90b8005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d80b1180 0x7f90b8003180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b8006360 con 0x7f90b8005610 2021-11-15T19:31:50.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80064d0 con 0x7f90b80048e0 2021-11-15T19:31:50.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80036f0 con 0x7f90d80b1180 2021-11-15T19:31:50.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90b80048e0 0x7f90b8004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 -- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d80b1180 msgr2=0x7f90b8003180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90d80b1180 0x7f90b8003180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 -- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90b8005610 msgr2=0x7f90b8005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:31:50.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90b8005610 0x7f90b8005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 -- 172.21.2.137:0/1915793886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b8004370 con 0x7f90b80048e0 2021-11-15T19:31:50.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d6ffd700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90b80048e0 0x7f90b8004d00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f90d80b2bd0 tx=0x7f90d80ae150).ready entity=mon.1 client_cookie=425b75f67bce876b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c00070d0 con 0x7f90b80048e0 2021-11-15T19:31:50.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0007230 con 0x7f90b80048e0 2021-11-15T19:31:50.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d5ffb700 1 -- 172.21.2.137:0/1915793886 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c000ca20 con 0x7f90b80048e0 2021-11-15T19:31:50.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- 172.21.2.137:0/1915793886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90b80048e0 msgr2=0x7f90b8004d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/1915793886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90b80048e0 0x7f90b8004d00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f90d80b2bd0 tx=0x7f90d80ae150).stop 2021-11-15T19:31:50.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d77fe700 1 -- 172.21.2.137:0/1915793886 reap_dead start 2021-11-15T19:31:50.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- 172.21.2.137:0/1915793886 shutdown_connections 2021-11-15T19:31:50.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- 172.21.2.137:0/1915793886 >> 172.21.2.137:0/1915793886 conn(0x7f90d80630f0 msgr2=0x7f90d80634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- 172.21.2.137:0/1915793886 shutdown_connections 2021-11-15T19:31:50.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- 172.21.2.137:0/1915793886 wait complete. 2021-11-15T19:31:50.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 Processor -- start 2021-11-15T19:31:50.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- start start 2021-11-15T19:31:50.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90b80048e0 0x7f90d814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 0x7f90d810eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90d814ab20 0x7f90d814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d814ea30 con 0x7f90d814ab20 2021-11-15T19:31:50.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80672a0 con 0x7f90d8112430 2021-11-15T19:31:50.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90dd5f0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d814e050 con 0x7f90b80048e0 2021-11-15T19:31:50.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 0x7f90d810eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 0x7f90d810eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35276/0 (socket says 172.21.2.137:35276) 2021-11-15T19:31:50.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 -- 172.21.2.137:0/2102588609 learned_addr learned my addr 172.21.2.137:0/2102588609 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:31:50.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 -- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90b80048e0 msgr2=0x7f90d814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90b80048e0 0x7f90d814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 -- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90d814ab20 msgr2=0x7f90d814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90d814ab20 0x7f90d814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 -- 172.21.2.137:0/2102588609 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d814e2f0 con 0x7f90d8112430 2021-11-15T19:31:50.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.808+0000 7f90d67fc700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 0x7f90d810eb40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f90d814eb70 tx=0x7f90c8006e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c8013460 con 0x7f90d8112430 2021-11-15T19:31:50.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c80135c0 con 0x7f90d8112430 2021-11-15T19:31:50.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d814e590 con 0x7f90d8112430 2021-11-15T19:31:50.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c8013920 con 0x7f90d8112430 2021-11-15T19:31:50.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d810f030 con 0x7f90d8112430 2021-11-15T19:31:50.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d814e720 con 0x7f90d8112430 2021-11-15T19:31:50.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f90c800f070 con 0x7f90d8112430 2021-11-15T19:31:50.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90bc053640 0x7f90bc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:31:50.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f90c806b2b0 con 0x7f90d8112430 2021-11-15T19:31:50.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90d6ffd700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90bc053640 0x7f90bc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:31:50.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90d6ffd700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90bc053640 0x7f90bc055b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f90d80b2bd0 tx=0x7f90c0013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:31:50.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.812+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90c8042370 con 0x7f90d8112430 2021-11-15T19:31:50.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90d80573d0 con 0x7f90d8112430 2021-11-15T19:31:50.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90cffff700 1 -- 172.21.2.137:0/2102588609 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f90c8045990 con 0x7f90d8112430 2021-11-15T19:31:50.928 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:31:50.929 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:31:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90bc053640 msgr2=0x7f90bc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90bc053640 0x7f90bc055b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f90d80b2bd0 tx=0x7f90c0013000).stop 2021-11-15T19:31:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 msgr2=0x7f90d810eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:31:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 0x7f90d810eb40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f90d814eb70 tx=0x7f90c8006e50).stop 2021-11-15T19:31:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 shutdown_connections 2021-11-15T19:31:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f90bc053640 0x7f90bc055b00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f90d814ab20 0x7f90d814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f90d8112430 0x7f90d810eb40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:31:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 --2- 172.21.2.137:0/2102588609 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f90b80048e0 0x7f90d814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:31:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 >> 172.21.2.137:0/2102588609 conn(0x7f90d80630f0 msgr2=0x7f90d813cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:31:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 shutdown_connections 2021-11-15T19:31:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:31:50.924+0000 7f90dd5f0700 1 -- 172.21.2.137:0/2102588609 wait complete. 2021-11-15T19:31:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:31:51.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:31:47.615370+0000', 'modified': '2021-11-15T19:31:48.620136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5893}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5893': {'gid': 5893, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/837201683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 837201683}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 837201683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:31:51.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:31:51.138 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:31:51.202 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5893,"want_state":"up:active","state":"up:active","rank_uptime":3.576294511,"mdsmap_epoch":26,"osdmap_epoch":63,"osdmap_epoch_barrier":62,"uptime":7.7071567329999997} 2021-11-15T19:31:51.203 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5893, "mdsmap_epoch": 26, "osdmap_epoch": 63, "osdmap_epoch_barrier": 62, "rank_uptime": 3.576294511, "state": "up:active", "uptime": 7.707156733, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:31:51.204 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:31:51.204 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:31:51.204 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:31:51.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:51.205 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:51.216 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:31:51.227 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:31:51.227 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:31:51.233 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:31:51.233 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:31:51.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:51.235 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:31:51.238 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:31:51.239 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:51.283 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:31:51.291 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:31:51.292 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:31:51.296 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:31:51.297 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:31:51.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:51.298 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:31:51.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:31:51.314+0000 7f9571d43080 -1 init, newargv = 0x563403497de0 newargc=9 2021-11-15T19:31:51.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14581]: starting ceph client 2021-11-15T19:31:51.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14581]: starting fuse 2021-11-15T19:31:52.426 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:31:52.438 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:31:52.439 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:31:52.488 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:31:52.489 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:31:52.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:52.490 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:31:52.495 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:31:52.495 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:31:52.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:52.496 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:31:52.497 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:31:52.497 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:31:52.498 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:31:52.498 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:31:52.499 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.499 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:31:52.499 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:31:52.500 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:31:52.500 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.501 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:31:52.501 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:31:52.501 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:31:52.502 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:31:52.502 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.503 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:31:52.503 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:31:52.504 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:31:52.504 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:31:52.504 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:31:52.505 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.505 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:31:52.505 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:31:52.572 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14581.asok 2021-11-15T19:31:52.575 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14581.asok 2021-11-15T19:31:52.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:52.576 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14581.asok status 2021-11-15T19:31:52.624 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:31:52.624 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:31:52.624 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:31:52.625 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:31:52.625 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:31:52.625 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:31:52.625 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:31:52.625 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14581", 2021-11-15T19:31:52.626 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:31:52.626 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:31:52.626 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:31:52.626 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:31:52.627 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4824, 2021-11-15T19:31:52.627 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:31:52.627 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:31:52.627 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:31:52.627 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4824 2021-11-15T19:31:52.628 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:31:52.628 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:31:52.628 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:31:52.628 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:31:52.629 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1283032626 2021-11-15T19:31:52.629 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:31:52.629 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:31:52.629 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:31:52.629 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:31:52.630 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:31:52.630 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1283032626 2021-11-15T19:31:52.630 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:31:52.630 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4824 172.21.2.131:0/1283032626", 2021-11-15T19:31:52.630 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/1283032626", 2021-11-15T19:31:52.631 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:31:52.631 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 26, 2021-11-15T19:31:52.631 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 63, 2021-11-15T19:31:52.631 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:31:52.632 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:31:52.632 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:31:52.632 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:31:52.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:52.633 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:52.634 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:52.640 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:31:52.640 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:31:52.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:52.641 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:52.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:31:52.691 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:31:52.692 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:31:52.698 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:31:52.699 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:31:52.699 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:31:52.700 DEBUG:teuthology.orchestra.run.gibba031:> import sys 2021-11-15T19:31:52.700 DEBUG:teuthology.orchestra.run.gibba031:> import time 2021-11-15T19:31:52.700 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:31:52.701 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.701 DEBUG:teuthology.orchestra.run.gibba031:> n = 1000 2021-11-15T19:31:52.701 DEBUG:teuthology.orchestra.run.gibba031:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T19:31:52.702 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.702 DEBUG:teuthology.orchestra.run.gibba031:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T19:31:52.703 DEBUG:teuthology.orchestra.run.gibba031:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T19:31:52.703 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:31:52.703 DEBUG:teuthology.orchestra.run.gibba031:> for i in range(0, n): 2021-11-15T19:31:52.704 DEBUG:teuthology.orchestra.run.gibba031:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T19:31:52.704 DEBUG:teuthology.orchestra.run.gibba031:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T19:31:52.705 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content'"'"') 2021-11-15T19:31:52.705 DEBUG:teuthology.orchestra.run.gibba031:> if True: 2021-11-15T19:31:52.706 DEBUG:teuthology.orchestra.run.gibba031:> f.flush() 2021-11-15T19:31:52.706 DEBUG:teuthology.orchestra.run.gibba031:> os.fsync(f.fileno()) 2021-11-15T19:31:52.706 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:31:54.181 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:54.185 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:54.188 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:54.192 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:31:54.195 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:07.201 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:07.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.257+0000 7fdfc56f8700 1 Processor -- start 2021-11-15T19:32:07.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.257+0000 7fdfc56f8700 1 -- start start 2021-11-15T19:32:07.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdfc00aa4e0 0x7fdfc00aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 0x7fdfc013cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00b1390 con 0x7fdfc00b0c50 2021-11-15T19:32:07.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc013f840 con 0x7fdfc00aa4e0 2021-11-15T19:32:07.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00b1030 con 0x7fdfc013c780 2021-11-15T19:32:07.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdfc00b0c50 0x7fdfc01401a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54064/0 (socket says 172.21.2.137:54064) 2021-11-15T19:32:07.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 -- 172.21.2.137:0/4104145457 learned_addr learned my addr 172.21.2.137:0/4104145457 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:07.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728433326 0 0) 0x7fdfc00b1390 con 0x7fdfc00b0c50 2021-11-15T19:32:07.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa0003260 con 0x7fdfc00b0c50 2021-11-15T19:32:07.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbf7fe700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 0x7fdfc013cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbe7fc700 1 --2- 172.21.2.137:0/4104145457 >> v2:172.21.2.111:3300/0 conn(0x7fdfc00aa4e0 0x7fdfc00aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 123525368 0 0) 0x7fdfa0003260 con 0x7fdfc00b0c50 2021-11-15T19:32:07.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 msgr2=0x7fdfc013cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 0x7fdfc013cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 >> v2:172.21.2.111:3300/0 conn(0x7fdfc00aa4e0 msgr2=0x7fdfc00aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 --2- 172.21.2.137:0/4104145457 >> v2:172.21.2.111:3300/0 conn(0x7fdfc00aa4e0 0x7fdfc00aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc013fa60 con 0x7fdfc00b0c50 2021-11-15T19:32:07.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fdfa8001660 con 0x7fdfc00b0c50 2021-11-15T19:32:07.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 >> v1:172.21.2.137:6789/0 conn(0x7fdfc00b0c50 legacy=0x7fdfc01401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfa00037d0 0x7fdfa0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 0x7fdfa0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfa00049f0 0x7fdfa0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc013f840 con 0x7fdfa00049f0 2021-11-15T19:32:07.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00b1030 con 0x7fdfa00037d0 2021-11-15T19:32:07.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa000dac0 con 0x7fdfc013c780 2021-11-15T19:32:07.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfa00037d0 0x7fdfa0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbe7fc700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 0x7fdfa0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbf7fe700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfa00049f0 0x7fdfa0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 -- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 msgr2=0x7fdfa0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc013c780 0x7fdfa0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 -- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfa00049f0 msgr2=0x7fdfa0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfa00049f0 0x7fdfa0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 -- 172.21.2.137:0/4104145457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0003260 con 0x7fdfa00037d0 2021-11-15T19:32:07.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfa00037d0 0x7fdfa0003bf0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fdfa8001370 tx=0x7fdfa8001d80).ready entity=mon.1 client_cookie=3292e634ca44617f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa80072c0 con 0x7fdfa00037d0 2021-11-15T19:32:07.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8007420 con 0x7fdfa00037d0 2021-11-15T19:32:07.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbdffb700 1 -- 172.21.2.137:0/4104145457 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa800cae0 con 0x7fdfa00037d0 2021-11-15T19:32:07.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- 172.21.2.137:0/4104145457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfa00037d0 msgr2=0x7fdfa0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/4104145457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfa00037d0 0x7fdfa0003bf0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fdfa8001370 tx=0x7fdfa8001d80).stop 2021-11-15T19:32:07.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfbf7fe700 1 -- 172.21.2.137:0/4104145457 reap_dead start 2021-11-15T19:32:07.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- 172.21.2.137:0/4104145457 shutdown_connections 2021-11-15T19:32:07.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- 172.21.2.137:0/4104145457 >> 172.21.2.137:0/4104145457 conn(0x7fdfc00b4e60 msgr2=0x7fdfc00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- 172.21.2.137:0/4104145457 shutdown_connections 2021-11-15T19:32:07.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.261+0000 7fdfc56f8700 1 -- 172.21.2.137:0/4104145457 wait complete. 2021-11-15T19:32:07.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 Processor -- start 2021-11-15T19:32:07.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- start start 2021-11-15T19:32:07.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 0x7fdfc0139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfc013f120 0x7fdfc01396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc014dd20 0x7fdfc014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc013e4f0 con 0x7fdfc013f120 2021-11-15T19:32:07.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01423f0 con 0x7fdfc0142010 2021-11-15T19:32:07.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00ade00 con 0x7fdfc014dd20 2021-11-15T19:32:07.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 0x7fdfc0139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 0x7fdfc0139200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35296/0 (socket says 172.21.2.137:35296) 2021-11-15T19:32:07.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 -- 172.21.2.137:0/702064619 learned_addr learned my addr 172.21.2.137:0/702064619 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 -- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc014dd20 msgr2=0x7fdfc014e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc014dd20 0x7fdfc014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 -- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfc013f120 msgr2=0x7fdfc01396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfc013f120 0x7fdfc01396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 -- 172.21.2.137:0/702064619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc013e750 con 0x7fdfc0142010 2021-11-15T19:32:07.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfbeffd700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 0x7fdfc0139200 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fdfa8001370 tx=0x7fdfa8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa80049e0 con 0x7fdfc0142010 2021-11-15T19:32:07.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8004b40 con 0x7fdfc0142010 2021-11-15T19:32:07.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa8004ea0 con 0x7fdfc0142010 2021-11-15T19:32:07.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc013e9f0 con 0x7fdfc0142010 2021-11-15T19:32:07.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc00acbb0 con 0x7fdfc0142010 2021-11-15T19:32:07.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc013fd00 con 0x7fdfc0142010 2021-11-15T19:32:07.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfa8011560 con 0x7fdfc0142010 2021-11-15T19:32:07.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfb7fff700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdfa40534f0 0x7fdfa40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.265+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdfa80706c0 con 0x7fdfc0142010 2021-11-15T19:32:07.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.269+0000 7fdfbe7fc700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdfa40534f0 0x7fdfa40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.269+0000 7fdfbe7fc700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdfa40534f0 0x7fdfa40559b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fdfb000c000 tx=0x7fdfb0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.269+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfa80477c0 con 0x7fdfc0142010 2021-11-15T19:32:07.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.377+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc00573d0 con 0x7fdfc0142010 2021-11-15T19:32:07.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfb7fff700 1 -- 172.21.2.137:0/702064619 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fdfa804ade0 con 0x7fdfc0142010 2021-11-15T19:32:07.383 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:07.383 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:32:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdfa40534f0 msgr2=0x7fdfa40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdfa40534f0 0x7fdfa40559b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fdfb000c000 tx=0x7fdfb0008040).stop 2021-11-15T19:32:07.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 msgr2=0x7fdfc0139200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 0x7fdfc0139200 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fdfa8001370 tx=0x7fdfa8017000).stop 2021-11-15T19:32:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 shutdown_connections 2021-11-15T19:32:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdfa40534f0 0x7fdfa40559b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfc014dd20 0x7fdfc014e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfc013f120 0x7fdfc01396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 --2- 172.21.2.137:0/702064619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfc0142010 0x7fdfc0139200 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 >> 172.21.2.137:0/702064619 conn(0x7fdfc00b4e60 msgr2=0x7fdfc0143360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 shutdown_connections 2021-11-15T19:32:07.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.381+0000 7fdfc56f8700 1 -- 172.21.2.137:0/702064619 wait complete. 2021-11-15T19:32:07.387 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:32:07.390 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-15T19:32:07.448 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T19:32:07.448 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T19:32:07.449 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:07.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 Processor -- start 2021-11-15T19:32:07.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- start start 2021-11-15T19:32:07.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f62680b1340 0x7f6268147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62680a9f50 0x7f62680aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268148190 con 0x7f6268143f00 2021-11-15T19:32:07.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680b1720 con 0x7f62680b1340 2021-11-15T19:32:07.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268147e70 con 0x7f62680a9f50 2021-11-15T19:32:07.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6268143f00 0x7f6268144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54086/0 (socket says 172.21.2.137:54086) 2021-11-15T19:32:07.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 -- 172.21.2.137:0/2406661063 learned_addr learned my addr 172.21.2.137:0/2406661063 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:07.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444860137 0 0) 0x7f625c001110 con 0x7f6268143f00 2021-11-15T19:32:07.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f624c003260 con 0x7f6268143f00 2021-11-15T19:32:07.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1073686812 0 0) 0x7f624c003260 con 0x7f6268143f00 2021-11-15T19:32:07.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62680a9f50 msgr2=0x7f62680aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62680a9f50 0x7f62680aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 >> v2:172.21.2.111:3300/0 conn(0x7f62680b1340 msgr2=0x7f6268147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6266ffd700 1 --2- 172.21.2.137:0/2406661063 >> v2:172.21.2.111:3300/0 conn(0x7f62680b1340 0x7f6268147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 --2- 172.21.2.137:0/2406661063 >> v2:172.21.2.111:3300/0 conn(0x7f62680b1340 0x7f6268147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680af800 con 0x7f6268143f00 2021-11-15T19:32:07.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f625c001810 con 0x7f6268143f00 2021-11-15T19:32:07.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 >> v1:172.21.2.137:6789/0 conn(0x7f6268143f00 legacy=0x7f6268144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62680a9f50 0x7f624c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f624c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f624c004bf0 0x7f624c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680b1720 con 0x7f624c004bf0 2021-11-15T19:32:07.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268147e70 con 0x7f624c003ee0 2021-11-15T19:32:07.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0053a0 con 0x7f62680a9f50 2021-11-15T19:32:07.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f624c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6266ffd700 1 --2- 172.21.2.137:0/2406661063 >> v2:172.21.2.111:3300/0 conn(0x7f62680b1340 0x7f6268147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:07.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 -- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62680a9f50 msgr2=0x7f624c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62680a9f50 0x7f624c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 -- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f624c004bf0 msgr2=0x7f624c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f624c004bf0 0x7f624c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 -- 172.21.2.137:0/2406661063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c003260 con 0x7f624c003ee0 2021-11-15T19:32:07.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62667fc700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f624c004500 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f625c001520 tx=0x7f62680abfb0).ready entity=mon.1 client_cookie=f619a0f3c0c9311b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f625c007170 con 0x7f624c003ee0 2021-11-15T19:32:07.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0072d0 con 0x7f624c003ee0 2021-11-15T19:32:07.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f6265ffb700 1 -- 172.21.2.137:0/2406661063 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f625c00ca20 con 0x7f624c003ee0 2021-11-15T19:32:07.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- 172.21.2.137:0/2406661063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 msgr2=0x7f624c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 --2- 172.21.2.137:0/2406661063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f624c004500 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f625c001520 tx=0x7f62680abfb0).stop 2021-11-15T19:32:07.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f62677fe700 1 -- 172.21.2.137:0/2406661063 reap_dead start 2021-11-15T19:32:07.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- 172.21.2.137:0/2406661063 shutdown_connections 2021-11-15T19:32:07.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- 172.21.2.137:0/2406661063 >> 172.21.2.137:0/2406661063 conn(0x7f62680b4e60 msgr2=0x7f62680b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- 172.21.2.137:0/2406661063 shutdown_connections 2021-11-15T19:32:07.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.497+0000 7f626d833700 1 -- 172.21.2.137:0/2406661063 wait complete. 2021-11-15T19:32:07.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 Processor -- start 2021-11-15T19:32:07.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- start start 2021-11-15T19:32:07.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f62680b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6268140000 0x7f6268159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6268098680 0x7f6268098b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680ad550 con 0x7f6268140000 2021-11-15T19:32:07.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268098220 con 0x7f624c003ee0 2021-11-15T19:32:07.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268099020 con 0x7f6268098680 2021-11-15T19:32:07.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f62680b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f62680b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35314/0 (socket says 172.21.2.137:35314) 2021-11-15T19:32:07.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 -- 172.21.2.137:0/1276189780 learned_addr learned my addr 172.21.2.137:0/1276189780 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 -- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6268098680 msgr2=0x7f6268098b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6268098680 0x7f6268098b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 -- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6268140000 msgr2=0x7f6268159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6268140000 0x7f6268159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 -- 172.21.2.137:0/1276189780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680ae220 con 0x7f624c003ee0 2021-11-15T19:32:07.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6266ffd700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f62680b01e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f62680ae760 tx=0x7f6258008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6258015070 con 0x7f624c003ee0 2021-11-15T19:32:07.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6258000e90 con 0x7f624c003ee0 2021-11-15T19:32:07.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62680ae4c0 con 0x7f624c003ee0 2021-11-15T19:32:07.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62680ae820 con 0x7f624c003ee0 2021-11-15T19:32:07.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6258010770 con 0x7f624c003ee0 2021-11-15T19:32:07.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626805faf0 con 0x7f624c003ee0 2021-11-15T19:32:07.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f62580108d0 con 0x7f624c003ee0 2021-11-15T19:32:07.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6257fff700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62440535b0 0x7f6244055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f625806b7c0 con 0x7f624c003ee0 2021-11-15T19:32:07.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.501+0000 7f62667fc700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62440535b0 0x7f6244055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.505+0000 7f62667fc700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62440535b0 0x7f6244055a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f625c001520 tx=0x7f625c013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.505+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6258042810 con 0x7f624c003ee0 2021-11-15T19:32:07.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.613+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62680573d0 con 0x7f624c003ee0 2021-11-15T19:32:07.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.613+0000 7f6257fff700 1 -- 172.21.2.137:0/1276189780 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f6258045e30 con 0x7f624c003ee0 2021-11-15T19:32:07.618 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:07.619 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:32:07.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62440535b0 msgr2=0x7f6244055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62440535b0 0x7f6244055a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f625c001520 tx=0x7f625c013000).stop 2021-11-15T19:32:07.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 msgr2=0x7f62680b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f62680b01e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f62680ae760 tx=0x7f6258008040).stop 2021-11-15T19:32:07.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 shutdown_connections 2021-11-15T19:32:07.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62440535b0 0x7f6244055a70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6268098680 0x7f6268098b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6268140000 0x7f6268159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 --2- 172.21.2.137:0/1276189780 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f624c003ee0 0x7f62680b01e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 >> 172.21.2.137:0/1276189780 conn(0x7f62680b4e60 msgr2=0x7f6268149740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 shutdown_connections 2021-11-15T19:32:07.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.617+0000 7f626d833700 1 -- 172.21.2.137:0/1276189780 wait complete. 2021-11-15T19:32:07.623 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:32:07.625 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T19:32:07.684 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T19:32:07.684 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T19:32:07.685 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:07.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 Processor -- start 2021-11-15T19:32:07.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- start start 2021-11-15T19:32:07.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1e840b1340 0x7f1e84147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1e84143f00 0x7f1e84144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e84148190 con 0x7f1e840a9f50 2021-11-15T19:32:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840b1720 con 0x7f1e84143f00 2021-11-15T19:32:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e84147e70 con 0x7f1e840b1340 2021-11-15T19:32:07.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1e840b1340 0x7f1e84147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1e840b1340 0x7f1e84147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35322/0 (socket says 172.21.2.137:35322) 2021-11-15T19:32:07.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 -- 172.21.2.137:0/4196206905 learned_addr learned my addr 172.21.2.137:0/4196206905 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 -- 172.21.2.137:0/4196206905 >> v2:172.21.2.111:3300/0 conn(0x7f1e84143f00 msgr2=0x7f1e84144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 --2- 172.21.2.137:0/4196206905 >> v2:172.21.2.111:3300/0 conn(0x7f1e84143f00 0x7f1e84144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 -- 172.21.2.137:0/4196206905 >> v1:172.21.2.111:6789/0 conn(0x7f1e840a9f50 legacy=0x7f1e840aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 -- 172.21.2.137:0/4196206905 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840af800 con 0x7f1e840b1340 2021-11-15T19:32:07.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8881e700 1 --2- 172.21.2.137:0/4196206905 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e84147980 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f1e84062250 tx=0x7f1e74006eb0).ready entity=mon.1 client_cookie=3a4bbf239cb56b81 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e837fe700 1 -- 172.21.2.137:0/4196206905 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7400d5c0 con 0x7f1e840b1340 2021-11-15T19:32:07.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e837fe700 1 -- 172.21.2.137:0/4196206905 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74000e90 con 0x7f1e840b1340 2021-11-15T19:32:07.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e837fe700 1 -- 172.21.2.137:0/4196206905 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7400d910 con 0x7f1e840b1340 2021-11-15T19:32:07.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- 172.21.2.137:0/4196206905 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 msgr2=0x7f1e84147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/4196206905 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e84147980 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f1e84062250 tx=0x7f1e74006eb0).stop 2021-11-15T19:32:07.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- 172.21.2.137:0/4196206905 shutdown_connections 2021-11-15T19:32:07.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/4196206905 >> v2:172.21.2.111:3300/0 conn(0x7f1e84143f00 0x7f1e84144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/4196206905 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e84147980 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- 172.21.2.137:0/4196206905 >> 172.21.2.137:0/4196206905 conn(0x7f1e840b4e60 msgr2=0x7f1e840b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- 172.21.2.137:0/4196206905 shutdown_connections 2021-11-15T19:32:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- 172.21.2.137:0/4196206905 wait complete. 2021-11-15T19:32:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 Processor -- start 2021-11-15T19:32:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- start start 2021-11-15T19:32:07.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e840a9f50 0x7f1e8413f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e8413ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e84143f00 0x7f1e84159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8409a570 con 0x7f1e84143f00 2021-11-15T19:32:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8409a310 con 0x7f1e840b1340 2021-11-15T19:32:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.733+0000 7f1e8aa82700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840aee20 con 0x7f1e840a9f50 2021-11-15T19:32:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e8413ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e8413ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35328/0 (socket says 172.21.2.137:35328) 2021-11-15T19:32:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 -- 172.21.2.137:0/3016582324 learned_addr learned my addr 172.21.2.137:0/3016582324 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 -- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e840a9f50 msgr2=0x7f1e8413f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e840a9f50 0x7f1e8413f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 -- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e84143f00 msgr2=0x7f1e84159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e84143f00 0x7f1e84159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 -- 172.21.2.137:0/3016582324 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7400b1e0 con 0x7f1e840b1340 2021-11-15T19:32:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e83fff700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e8413ff80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f1e6c002f70 tx=0x7f1e6c006ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6c00e470 con 0x7f1e840b1340 2021-11-15T19:32:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00e5d0 con 0x7f1e840b1340 2021-11-15T19:32:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6c00e930 con 0x7f1e840b1340 2021-11-15T19:32:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e84140470 con 0x7f1e840b1340 2021-11-15T19:32:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e84099ec0 con 0x7f1e840b1340 2021-11-15T19:32:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8405faf0 con 0x7f1e840b1340 2021-11-15T19:32:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e6c018030 con 0x7f1e840b1340 2021-11-15T19:32:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e81ffb700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e68053540 0x7f1e68055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1e6c06af90 con 0x7f1e840b1340 2021-11-15T19:32:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e8881e700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e68053540 0x7f1e68055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.737+0000 7f1e8881e700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e68053540 0x7f1e68055a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f1e84062250 tx=0x7f1e74015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.741+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e6c042090 con 0x7f1e840b1340 2021-11-15T19:32:07.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.849+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e840573d0 con 0x7f1e840b1340 2021-11-15T19:32:07.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e81ffb700 1 -- 172.21.2.137:0/3016582324 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f1e6c0456b0 con 0x7f1e840b1340 2021-11-15T19:32:07.855 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:07.855 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:32:07.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e68053540 msgr2=0x7f1e68055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e68053540 0x7f1e68055a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f1e84062250 tx=0x7f1e74015000).stop 2021-11-15T19:32:07.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 msgr2=0x7f1e8413ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e8413ff80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f1e6c002f70 tx=0x7f1e6c006ed0).stop 2021-11-15T19:32:07.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 shutdown_connections 2021-11-15T19:32:07.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1e68053540 0x7f1e68055a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1e84143f00 0x7f1e84159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1e840b1340 0x7f1e8413ff80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 --2- 172.21.2.137:0/3016582324 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1e840a9f50 0x7f1e8413f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 >> 172.21.2.137:0/3016582324 conn(0x7f1e840b4e60 msgr2=0x7f1e840b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 shutdown_connections 2021-11-15T19:32:07.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.853+0000 7f1e8aa82700 1 -- 172.21.2.137:0/3016582324 wait complete. 2021-11-15T19:32:07.859 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:32:07.862 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-11-15T19:32:07.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 Processor -- start 2021-11-15T19:32:07.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 -- start start 2021-11-15T19:32:07.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefcc05c770 0x7fefcc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fefcc140aa0 0x7fefcc140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc05cb50 con 0x7fefcc0b0550 2021-11-15T19:32:07.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefcc0b1650 con 0x7fefcc140aa0 2021-11-15T19:32:07.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd3d54700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0ad030 con 0x7fefcc05c770 2021-11-15T19:32:07.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd12ef700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fefcc0b0550 0x7fefcc14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54120/0 (socket says 172.21.2.137:54120) 2021-11-15T19:32:07.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.909+0000 7fefd12ef700 1 -- 172.21.2.137:0/831888803 learned_addr learned my addr 172.21.2.137:0/831888803 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:07.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584176347 0 0) 0x7fefcc05cb50 con 0x7fefcc0b0550 2021-11-15T19:32:07.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb4003260 con 0x7fefcc0b0550 2021-11-15T19:32:07.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2345830832 0 0) 0x7fefb4003260 con 0x7fefcc0b0550 2021-11-15T19:32:07.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefcc05c770 msgr2=0x7fefcc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefcc05c770 0x7fefcc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 >> v2:172.21.2.111:3300/0 conn(0x7fefcc140aa0 msgr2=0x7fefcc140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 --2- 172.21.2.137:0/831888803 >> v2:172.21.2.111:3300/0 conn(0x7fefcc140aa0 0x7fefcc140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0ad2d0 con 0x7fefcc0b0550 2021-11-15T19:32:07.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fefbc001660 con 0x7fefcc0b0550 2021-11-15T19:32:07.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 >> v1:172.21.2.137:6789/0 conn(0x7fefcc0b0550 legacy=0x7fefcc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefb40037d0 0x7fefb4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefcc05c770 0x7fefb4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefb4004bf0 0x7fefb400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0b1650 con 0x7fefb4004bf0 2021-11-15T19:32:07.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0ad030 con 0x7fefb40037d0 2021-11-15T19:32:07.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4005300 con 0x7fefcc05c770 2021-11-15T19:32:07.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefb40037d0 0x7fefb4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 -- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefcc05c770 msgr2=0x7fefb4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefcc05c770 0x7fefb4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 -- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefb4004bf0 msgr2=0x7fefb400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefb4004bf0 0x7fefb400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 -- 172.21.2.137:0/831888803 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4003260 con 0x7fefb40037d0 2021-11-15T19:32:07.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd1af0700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefb40037d0 0x7fefb4003bf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fefc8002f70 tx=0x7fefc8006ca0).ready entity=mon.1 client_cookie=30af7545dbbb6d79 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8012410 con 0x7fefb40037d0 2021-11-15T19:32:07.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8012570 con 0x7fefb40037d0 2021-11-15T19:32:07.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd0aee700 1 -- 172.21.2.137:0/831888803 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc80128d0 con 0x7fefb40037d0 2021-11-15T19:32:07.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- 172.21.2.137:0/831888803 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefb40037d0 msgr2=0x7fefb4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 --2- 172.21.2.137:0/831888803 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefb40037d0 0x7fefb4003bf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fefc8002f70 tx=0x7fefc8006ca0).stop 2021-11-15T19:32:07.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd22f1700 1 -- 172.21.2.137:0/831888803 reap_dead start 2021-11-15T19:32:07.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- 172.21.2.137:0/831888803 shutdown_connections 2021-11-15T19:32:07.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- 172.21.2.137:0/831888803 >> 172.21.2.137:0/831888803 conn(0x7fefcc0631e0 msgr2=0x7fefcc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- 172.21.2.137:0/831888803 shutdown_connections 2021-11-15T19:32:07.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- 172.21.2.137:0/831888803 wait complete. 2021-11-15T19:32:07.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 Processor -- start 2021-11-15T19:32:07.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- start start 2021-11-15T19:32:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefb40037d0 0x7fefcc14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefcc142a00 0x7fefcc156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 0x7fefcc157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1435d0 con 0x7fefcc142a00 2021-11-15T19:32:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc149a90 con 0x7fefcc156cf0 2021-11-15T19:32:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd3d54700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1424f0 con 0x7fefb40037d0 2021-11-15T19:32:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd22f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 0x7fefcc157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd22f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 0x7fefcc157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35352/0 (socket says 172.21.2.137:35352) 2021-11-15T19:32:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.913+0000 7fefd22f1700 1 -- 172.21.2.137:0/1620146626 learned_addr learned my addr 172.21.2.137:0/1620146626 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 -- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefb40037d0 msgr2=0x7fefcc14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefb40037d0 0x7fefcc14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 -- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefcc142a00 msgr2=0x7fefcc156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefcc142a00 0x7fefcc156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 -- 172.21.2.137:0/1620146626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc1420f0 con 0x7fefcc156cf0 2021-11-15T19:32:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 0x7fefcc157180 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fefbc001840 tx=0x7fefc400a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefbaffd700 1 -- 172.21.2.137:0/1620146626 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc400ce40 con 0x7fefcc156cf0 2021-11-15T19:32:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefbaffd700 1 -- 172.21.2.137:0/1620146626 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4005c30 con 0x7fefcc156cf0 2021-11-15T19:32:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefbaffd700 1 -- 172.21.2.137:0/1620146626 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc4007070 con 0x7fefcc156cf0 2021-11-15T19:32:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc159980 con 0x7fefcc156cf0 2021-11-15T19:32:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc159e30 con 0x7fefcc156cf0 2021-11-15T19:32:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefbaffd700 1 -- 172.21.2.137:0/1620146626 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fefc401d070 con 0x7fefcc156cf0 2021-11-15T19:32:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefbaffd700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fefac0536d0 0x7fefac055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefbaffd700 1 -- 172.21.2.137:0/1620146626 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fefc406abb0 con 0x7fefcc156cf0 2021-11-15T19:32:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 Processor -- start 2021-11-15T19:32:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 -- start start 2021-11-15T19:32:07.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fefac0536d0 0x7fefac055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe21f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xdebff0 0xe22400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe1bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xd5d7f0 con 0xdebff0 2021-11-15T19:32:07.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3dc70 con 0xe26ca0 2021-11-15T19:32:07.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xdeecc0 con 0xe228f0 2021-11-15T19:32:07.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe21f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe21f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35358/0 (socket says 172.21.2.137:35358) 2021-11-15T19:32:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 -- 172.21.2.137:0/1434079070 learned_addr learned my addr 172.21.2.137:0/1434079070 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 -- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 msgr2=0xe1bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd22f1700 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe1bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe1bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd12ef700 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xdebff0 0xe22400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 -- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xdebff0 msgr2=0xe22400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xdebff0 0xe22400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 -- 172.21.2.137:0/1434079070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd94960 con 0xe26ca0 2021-11-15T19:32:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd12ef700 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xdebff0 0xe22400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd1af0700 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe21f10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0xde7c40 tx=0x7fefc8015000).ready entity=mon.1 client_cookie=4145128db6770ef3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd3d54700 1 -- 172.21.2.137:0/1434079070 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc800b390 con 0xe26ca0 2021-11-15T19:32:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd3d54700 1 -- 172.21.2.137:0/1434079070 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc801fa70 con 0xe26ca0 2021-11-15T19:32:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.917+0000 7fefd3d54700 1 -- 172.21.2.137:0/1434079070 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc801fdd0 con 0xe26ca0 2021-11-15T19:32:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/1434079070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 msgr2=0xe21f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd1af0700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fefac0536d0 0x7fefac055b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fefc8024000 tx=0x7fefc8025040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe21f10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0xde7c40 tx=0x7fefc8015000).stop 2021-11-15T19:32:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/1434079070 shutdown_connections 2021-11-15T19:32:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe1bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xdebff0 0xe22400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/1434079070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe21f10 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/1434079070 >> 172.21.2.137:0/1434079070 conn(0xde8f10 msgr2=0xe26230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/1434079070 shutdown_connections 2021-11-15T19:32:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/1434079070 wait complete. 2021-11-15T19:32:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- start start 2021-11-15T19:32:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 Processor -- start 2021-11-15T19:32:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe17440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 0xdec400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 0xdec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xe18b60 con 0xe26ca0 2021-11-15T19:32:07.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xe1d8d0 con 0xdee490 2021-11-15T19:32:07.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xe18d90 con 0xe228f0 2021-11-15T19:32:07.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 10 client.0 ll_register_callbacks cb 0xd512f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:32:07.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 0xdec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 0xdec8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35366/0 (socket says 172.21.2.137:35366) 2021-11-15T19:32:07.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 -- 172.21.2.137:0/969087116 learned_addr learned my addr 172.21.2.137:0/969087116 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 -- 172.21.2.137:0/969087116 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 msgr2=0xe17440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe17440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 -- 172.21.2.137:0/969087116 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 msgr2=0xdec400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 0xdec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 -- 172.21.2.137:0/969087116 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc8016040 con 0xdee490 2021-11-15T19:32:07.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd22f1700 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 0xdec8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0xe1fac0 tx=0x7fefc4018040).ready entity=mon.1 client_cookie=2c81c660c6076a58 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:32:07.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 1 -- 172.21.2.137:0/969087116 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc4026070 con 0xdee490 2021-11-15T19:32:07.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 1 -- 172.21.2.137:0/969087116 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fefc40158a0 con 0xdee490 2021-11-15T19:32:07.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd538b0 con 0xdee490 2021-11-15T19:32:07.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 1 -- 172.21.2.137:0/969087116 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc4015a60 con 0xdee490 2021-11-15T19:32:07.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 10 client.6085 fetch_fsmap learned FSMap version 26 2021-11-15T19:32:07.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0xd4cea0 con 0xdee490 2021-11-15T19:32:07.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 1 -- 172.21.2.137:0/969087116 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd538b0 con 0xdee490 2021-11-15T19:32:07.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 1 -- 172.21.2.137:0/969087116 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 26) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fefc4015bc0 con 0xdee490 2021-11-15T19:32:07.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 10 client.6085 fetch_fsmap finished waiting for FSMap version 26 2021-11-15T19:32:07.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 10 client.6085 resolve_mds: resolved ID 'a' to GID 5893 2021-11-15T19:32:07.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 20 client.6085 populate_metadata read hostname 'gibba037' 2021-11-15T19:32:07.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe179f0 0xdecde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 4 client.6085 mds_command: new command op to 5893 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T19:32:07.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 --> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd4b930 con 0xe179f0 2021-11-15T19:32:07.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd1af0700 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe179f0 0xdecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 10 client.6085 ms_handle_connect on v2:172.21.2.137:6832/837201683 2021-11-15T19:32:07.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefd1af0700 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe179f0 0xdecde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=81eb1c6f5d8555e4 server_cookie=ffb375b4bf1f7dbe in_seq=0 out_seq=0 2021-11-15T19:32:07.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 1 -- 172.21.2.137:0/969087116 <== mds.0 v2:172.21.2.137:6832/837201683 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xd4b930 con 0xe179f0 2021-11-15T19:32:07.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 10 client.6085 handle_command_reply: tid=0 2021-11-15T19:32:07.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 client.6085 shutdown 2021-11-15T19:32:07.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 msgr2=0xdec8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 0xdec8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0xe1fac0 tx=0x7fefc4018040).stop 2021-11-15T19:32:07.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 shutdown_connections 2021-11-15T19:32:07.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe179f0 0xdecde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xdee490 0xdec8f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 0xdec400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 --2- 172.21.2.137:0/969087116 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xe228f0 0xe17440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefa8ff9700 0 client.6085 ms_handle_reset on v2:172.21.2.137:6832/837201683 2021-11-15T19:32:07.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 >> 172.21.2.137:0/969087116 conn(0xdebff0 msgr2=0xe26140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 shutdown_connections 2021-11-15T19:32:07.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 1 -- 172.21.2.137:0/969087116 wait complete. 2021-11-15T19:32:07.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.921+0000 7fefddf98740 20 client.6085 trim_cache size 0 max 16384 2021-11-15T19:32:07.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 Processor -- start 2021-11-15T19:32:07.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 -- start start 2021-11-15T19:32:07.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 0xe17f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 0xe18440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 0xe21bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xdedbd0 con 0xe26ca0 2021-11-15T19:32:07.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xd538b0 con 0xe228f0 2021-11-15T19:32:07.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xdb02e0 con 0xdee490 2021-11-15T19:32:07.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 0xe18440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 0xe18440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35372/0 (socket says 172.21.2.137:35372) 2021-11-15T19:32:07.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 -- 172.21.2.137:0/1642030893 learned_addr learned my addr 172.21.2.137:0/1642030893 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 -- 172.21.2.137:0/1642030893 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 msgr2=0xe17f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 0xe17f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 -- 172.21.2.137:0/1642030893 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 msgr2=0xe21bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 0xe21bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 -- 172.21.2.137:0/1642030893 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd55a90 con 0xe228f0 2021-11-15T19:32:07.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefd12ef700 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 0xe18440 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0xd3e600 tx=0x7fefbc009040).ready entity=mon.1 client_cookie=78cf73fd1454040 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefaaffd700 1 -- 172.21.2.137:0/1642030893 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefbc007170 con 0xe228f0 2021-11-15T19:32:07.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefaaffd700 1 -- 172.21.2.137:0/1642030893 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc0072d0 con 0xe228f0 2021-11-15T19:32:07.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.929+0000 7fefaaffd700 1 -- 172.21.2.137:0/1642030893 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefbc004920 con 0xe228f0 2021-11-15T19:32:07.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/1642030893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 msgr2=0xe18440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:07.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 0xe18440 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0xd3e600 tx=0x7fefbc009040).stop 2021-11-15T19:32:07.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/1642030893 shutdown_connections 2021-11-15T19:32:07.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe26ca0 0xe21bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe228f0 0xe18440 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:07.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- 172.21.2.137:0/1642030893 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 0xe17f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/1642030893 >> 172.21.2.137:0/1642030893 conn(0xdebff0 msgr2=0xe17210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:07.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/1642030893 shutdown_connections 2021-11-15T19:32:07.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/1642030893 wait complete. 2021-11-15T19:32:07.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- start start 2021-11-15T19:32:07.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 Processor -- start 2021-11-15T19:32:07.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 0xe322f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe228f0 0xe31800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe84500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0xe227a0 con 0xe228f0 2021-11-15T19:32:07.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0xe20580 con 0xe26ca0 2021-11-15T19:32:07.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0xe23060 con 0xdee490 2021-11-15T19:32:07.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 10 client.0 ll_register_callbacks cb 0xe20080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T19:32:07.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe84500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe84500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35378/0 (socket says 172.21.2.137:35378) 2021-11-15T19:32:07.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 -- 172.21.2.137:0/389631959 learned_addr learned my addr 172.21.2.137:0/389631959 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:07.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 -- 172.21.2.137:0/389631959 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 msgr2=0xe322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 0xe322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 -- 172.21.2.137:0/389631959 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe228f0 msgr2=0xe31800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:07.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe228f0 0xe31800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:07.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 -- 172.21.2.137:0/389631959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc0ad2d0 con 0xe26ca0 2021-11-15T19:32:07.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd22f1700 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe84500 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0xe1fac0 tx=0x7fefc4023070).ready entity=mon.1 client_cookie=6259c8b65faad3bc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:07.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 10 client.0 ms_handle_connect on v2:172.21.2.137:3300/0 2021-11-15T19:32:07.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 1 -- 172.21.2.137:0/389631959 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc406a570 con 0xe26ca0 2021-11-15T19:32:07.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 1 -- 172.21.2.137:0/389631959 <== mon.1 v2:172.21.2.137:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fefc406a6d0 con 0xe26ca0 2021-11-15T19:32:07.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefc801fa70 con 0xe26ca0 2021-11-15T19:32:07.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 1 -- 172.21.2.137:0/389631959 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc406a890 con 0xe26ca0 2021-11-15T19:32:07.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 10 client.6091 fetch_fsmap learned FSMap version 26 2021-11-15T19:32:07.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0xd52480 con 0xe26ca0 2021-11-15T19:32:07.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 1 -- 172.21.2.137:0/389631959 <== mon.1 v2:172.21.2.137:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc801fa70 con 0xe26ca0 2021-11-15T19:32:07.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 1 -- 172.21.2.137:0/389631959 <== mon.1 v2:172.21.2.137:3300/0 5 ==== fsmap(e 26) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fefc4044470 con 0xe26ca0 2021-11-15T19:32:07.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 10 client.6091 fetch_fsmap finished waiting for FSMap version 26 2021-11-15T19:32:07.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 10 client.6091 resolve_mds: resolved ID 'a' to GID 5893 2021-11-15T19:32:07.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 20 client.6091 populate_metadata read hostname 'gibba037' 2021-11-15T19:32:07.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe88340 0xe20af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:07.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 4 client.6091 mds_command: new command op to 5893 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-11-15T19:32:07.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 --> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0xc415e0 con 0xe88340 2021-11-15T19:32:07.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd1af0700 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe88340 0xe20af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:07.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefa9ffb700 10 client.6091 ms_handle_connect on v2:172.21.2.137:6832/837201683 2021-11-15T19:32:07.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:07.933+0000 7fefd1af0700 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe88340 0xe20af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7f6c4df441347120 server_cookie=6bbf1d3d7136a30b in_seq=0 out_seq=0 2021-11-15T19:32:18.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefa9ffb700 1 -- 172.21.2.137:0/389631959 <== mds.0 v2:172.21.2.137:6832/837201683 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0xc415e0 con 0xe88340 2021-11-15T19:32:18.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefa9ffb700 10 client.6091 handle_command_reply: tid=0 2021-11-15T19:32:18.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 client.6091 shutdown 2021-11-15T19:32:18.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 msgr2=0xe84500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe84500 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0xe1fac0 tx=0x7fefc4023070).stop 2021-11-15T19:32:18.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 shutdown_connections 2021-11-15T19:32:18.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:6832/837201683,v1:172.21.2.137:6833/837201683] conn(0xe88340 0xe20af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0xe26ca0 0xe84500 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0xe228f0 0xe31800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 --2- 172.21.2.137:0/389631959 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0xdee490 0xe322f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 >> 172.21.2.137:0/389631959 conn(0xdebff0 msgr2=0xe17de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:18.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefa9ffb700 0 client.6091 ms_handle_reset on v2:172.21.2.137:6832/837201683 2021-11-15T19:32:18.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 shutdown_connections 2021-11-15T19:32:18.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 1 -- 172.21.2.137:0/389631959 wait complete. 2021-11-15T19:32:18.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.065+0000 7fefddf98740 20 client.6091 trim_cache size 0 max 16384 2021-11-15T19:32:18.074 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:32:18.074 INFO:teuthology.orchestra.run.gibba037.stdout: "client_recall": { 2021-11-15T19:32:18.075 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": -110, 2021-11-15T19:32:18.075 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "(110) Connection timed out", 2021-11-15T19:32:18.075 INFO:teuthology.orchestra.run.gibba037.stdout: "recalled": 240 2021-11-15T19:32:18.075 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.075 INFO:teuthology.orchestra.run.gibba037.stdout: "flush_journal": { 2021-11-15T19:32:18.076 INFO:teuthology.orchestra.run.gibba037.stdout: "return_code": 0, 2021-11-15T19:32:18.076 INFO:teuthology.orchestra.run.gibba037.stdout: "message": "" 2021-11-15T19:32:18.076 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.076 INFO:teuthology.orchestra.run.gibba037.stdout: "trim_cache": { 2021-11-15T19:32:18.076 INFO:teuthology.orchestra.run.gibba037.stdout: "trimmed": 220 2021-11-15T19:32:18.077 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.077 INFO:teuthology.orchestra.run.gibba037.stdout: "cache": { 2021-11-15T19:32:18.077 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": { 2021-11-15T19:32:18.077 INFO:teuthology.orchestra.run.gibba037.stdout: "items": 15434, 2021-11-15T19:32:18.078 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes": 2428352 2021-11-15T19:32:18.078 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.078 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.078 INFO:teuthology.orchestra.run.gibba037.stdout: "duration": 10.131890813 2021-11-15T19:32:18.079 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:32:18.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fefac0536d0 msgr2=0x7fefac055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fefac0536d0 0x7fefac055b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fefc8024000 tx=0x7fefc8025040).stop 2021-11-15T19:32:18.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 msgr2=0x7fefcc157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 0x7fefcc157180 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fefbc001840 tx=0x7fefc400a060).stop 2021-11-15T19:32:18.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 shutdown_connections 2021-11-15T19:32:18.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fefac0536d0 0x7fefac055b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefcc156cf0 0x7fefcc157180 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefcc142a00 0x7fefcc156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 --2- 172.21.2.137:0/1620146626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefb40037d0 0x7fefcc14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 >> 172.21.2.137:0/1620146626 conn(0x7fefcc0631e0 msgr2=0x7fefcc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:18.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 shutdown_connections 2021-11-15T19:32:18.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.069+0000 7fefd3d54700 1 -- 172.21.2.137:0/1620146626 wait complete. 2021-11-15T19:32:18.083 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:32:18.083 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:18.091 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:18.104 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:18.117 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:18.130 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:18.140 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:32:18.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:18.141 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:18.142 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:18.147 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:32:18.148 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:32:18.148 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:32:18.149 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:32:18.149 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:18.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14581]: fuse finished with error 0 and tester_r 0 2021-11-15T19:32:18.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:18.157 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:18.158 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:18.201 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:32:18.202 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:32:18.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:32:18.313 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:18.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:18.317 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:18.318 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:18.327 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:32:18.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:18.329 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:32:18.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:32:18.330 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:18.381 INFO:teuthology.orchestra.run.gibba018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:32:18.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:18.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:18.383 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:18.384 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:32:18.393 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:32:18.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:18.395 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:32:18.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:32:18.396 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:32:18.405 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:32:18.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:18.406 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:32:18.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.513+0000 7fef81d00700 1 Processor -- start 2021-11-15T19:32:18.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.513+0000 7fef81d00700 1 -- start start 2021-11-15T19:32:18.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fef7c144610 0x7fef7c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fef7c0a9f50 0x7fef7c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c148190 con 0x7fef7c0b1340 2021-11-15T19:32:18.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c0b1720 con 0x7fef7c144610 2021-11-15T19:32:18.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c147e70 con 0x7fef7c0a9f50 2021-11-15T19:32:18.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fef7c0a9f50 0x7fef7c0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fef7c0a9f50 0x7fef7c0aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35388/0 (socket says 172.21.2.137:35388) 2021-11-15T19:32:18.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 -- 172.21.2.137:0/3891833273 learned_addr learned my addr 172.21.2.137:0/3891833273 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:18.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 -- 172.21.2.137:0/3891833273 >> v2:172.21.2.111:3300/0 conn(0x7fef7c144610 msgr2=0x7fef7c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:18.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 --2- 172.21.2.137:0/3891833273 >> v2:172.21.2.111:3300/0 conn(0x7fef7c144610 0x7fef7c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 -- 172.21.2.137:0/3891833273 >> v1:172.21.2.111:6789/0 conn(0x7fef7c0b1340 legacy=0x7fef7c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:18.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 -- 172.21.2.137:0/3891833273 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0af800 con 0x7fef7c0a9f50 2021-11-15T19:32:18.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7bfff700 1 --2- 172.21.2.137:0/3891833273 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c0aa3a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fef7c062250 tx=0x7fef74009290).ready entity=mon.1 client_cookie=d3c9db39038af335 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:18.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7a7fc700 1 -- 172.21.2.137:0/3891833273 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7400b830 con 0x7fef7c0a9f50 2021-11-15T19:32:18.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7a7fc700 1 -- 172.21.2.137:0/3891833273 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400b990 con 0x7fef7c0a9f50 2021-11-15T19:32:18.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7a7fc700 1 -- 172.21.2.137:0/3891833273 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7400bb40 con 0x7fef7c0a9f50 2021-11-15T19:32:18.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- 172.21.2.137:0/3891833273 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 msgr2=0x7fef7c0aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- 172.21.2.137:0/3891833273 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c0aa3a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fef7c062250 tx=0x7fef74009290).stop 2021-11-15T19:32:18.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- 172.21.2.137:0/3891833273 shutdown_connections 2021-11-15T19:32:18.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- 172.21.2.137:0/3891833273 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c0aa3a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- 172.21.2.137:0/3891833273 >> v2:172.21.2.111:3300/0 conn(0x7fef7c144610 0x7fef7c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- 172.21.2.137:0/3891833273 >> 172.21.2.137:0/3891833273 conn(0x7fef7c0b4e60 msgr2=0x7fef7c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:18.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- 172.21.2.137:0/3891833273 shutdown_connections 2021-11-15T19:32:18.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- 172.21.2.137:0/3891833273 wait complete. 2021-11-15T19:32:18.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 Processor -- start 2021-11-15T19:32:18.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- start start 2021-11-15T19:32:18.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef7c0b1340 0x7fef7c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef7c144610 0x7fef7c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c148d90 con 0x7fef7c144610 2021-11-15T19:32:18.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1488c0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef81d00700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1486a0 con 0x7fef7c0b1340 2021-11-15T19:32:18.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c14a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35392/0 (socket says 172.21.2.137:35392) 2021-11-15T19:32:18.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 -- 172.21.2.137:0/389900640 learned_addr learned my addr 172.21.2.137:0/389900640 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:18.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 -- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef7c0b1340 msgr2=0x7fef7c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef7c0b1340 0x7fef7c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 -- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef7c144610 msgr2=0x7fef7c156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef7c144610 0x7fef7c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 -- 172.21.2.137:0/389900640 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009530 con 0x7fef7c0a9f50 2021-11-15T19:32:18.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.517+0000 7fef7b7fe700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c14a600 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fef6c002ef0 tx=0x7fef6c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:18.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c012410 con 0x7fef7c0a9f50 2021-11-15T19:32:18.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c012570 con 0x7fef7c0a9f50 2021-11-15T19:32:18.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c148af0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c0128d0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1412d0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c05faf0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef6c00f030 con 0x7fef7c0a9f50 2021-11-15T19:32:18.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef600536f0 0x7fef60055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fef6c06b670 con 0x7fef7c0a9f50 2021-11-15T19:32:18.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef7affd700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef600536f0 0x7fef60055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef7affd700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef600536f0 0x7fef60055bb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fef64002f70 tx=0x7fef64006a90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:18.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.521+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef6c0427d0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.605+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fef7c05f730 con 0x7fef7c0a9f50 2021-11-15T19:32:18.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.605+0000 7fef78ff9700 1 -- 172.21.2.137:0/389900640 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v63) v1 ==== 81+0+33648 (secure 0 0 0) 0x7fef6c045df0 con 0x7fef7c0a9f50 2021-11-15T19:32:18.611 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:18.611 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:32:18.612 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 63, 2021-11-15T19:32:18.612 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:32:18.612 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:32:18.612 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:31:48.621301+0000", 2021-11-15T19:32:18.613 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:32:18.613 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:32:18.613 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:32:18.613 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:32:18.614 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:32:18.614 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:32:18.614 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:32:18.614 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:32:18.614 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:32:18.615 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:18.615 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:32:18.615 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:32:18.615 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:32:18.616 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:32:18.616 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:32:18.616 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 12, 2021-11-15T19:32:18.616 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:32:18.616 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:32:18.617 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:32:18.617 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:32:18.617 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:32:18.617 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.618 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:32:18.618 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:32:18.618 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:32:18.618 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:32:18.618 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:32:18.619 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:32:18.619 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:32:18.619 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:32:18.619 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:32:18.620 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:32:18.620 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:32:18.620 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:32:18.620 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:32:18.620 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:32:18.621 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:32:18.621 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:32:18.621 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:32:18.621 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:32:18.622 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:32:18.622 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:32:18.622 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:32:18.622 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:32:18.622 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:32:18.623 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.623 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:32:18.623 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:32:18.623 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:32:18.624 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:32:18.624 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:32:18.624 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:32:18.624 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:32:18.624 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:32:18.625 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:32:18.625 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:32:18.625 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:32:18.625 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:32:18.626 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:32:18.626 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:32:18.626 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:32:18.626 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:32:18.626 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:32:18.627 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:32:18.627 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:32:18.627 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:32:18.627 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:32:18.628 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:32:18.628 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:32:18.628 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:32:18.628 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:32:18.628 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:32:18.629 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:32:18.629 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.629 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:32:18.629 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:32:18.630 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:32:18.630 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:32:18.630 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:32:18.630 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:32:18.630 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:32:18.631 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:32:18.631 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:32:18.631 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:32:18.631 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:32:18.631 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:32:18.632 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:32:18.632 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.632 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:32:18.632 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:32:18.633 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.633 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.633 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.633 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:32:18.633 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:32:18.634 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:32:18.634 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:32:18.634 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:32:18.634 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:32:18.634 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:32:18.635 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:32:18.635 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:32:18.635 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:32:18.635 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:32:18.636 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:32:18.636 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:32:18.636 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:32:18.636 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:32:18.636 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:32:18.637 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:32:18.637 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:32:18.637 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:32:18.637 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:32:18.637 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:32:18.638 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:32:18.638 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:32:18.638 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.638 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:32:18.639 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:32:18.639 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:32:18.639 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:32:18.639 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:32:18.639 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:32:18.640 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:32:18.640 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:32:18.640 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:32:18.640 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:32:18.641 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:32:18.641 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:32:18.641 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:32:18.641 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:32:18.641 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:32:18.642 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:32:18.642 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:32:18.642 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:32:18.642 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:32:18.643 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:32:18.643 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:32:18.643 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:32:18.643 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:32:18.643 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:32:18.644 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:32:18.644 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:32:18.644 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:32:18.644 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.645 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:32:18.645 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:32:18.645 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:32:18.645 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:32:18.645 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:32:18.646 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:32:18.646 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:32:18.646 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:32:18.646 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:32:18.647 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:32:18.647 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:32:18.647 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:32:18.647 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:32:18.648 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:32:18.648 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.648 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.648 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.648 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 11, 2021-11-15T19:32:18.649 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:32:18.649 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:31:45.526704+0000", 2021-11-15T19:32:18.649 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:32:18.649 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:32:18.649 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:32:18.650 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:32:18.650 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:32:18.650 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:32:18.650 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:32:18.651 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:32:18.651 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:32:18.651 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:32:18.651 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:32:18.651 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:32:18.652 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:32:18.652 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:32:18.652 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:32:18.652 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:32:18.653 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:32:18.653 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:32:18.653 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:32:18.653 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:32:18.653 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.654 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "62", 2021-11-15T19:32:18.654 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:32:18.654 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:32:18.654 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:32:18.655 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:32:18.655 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:32:18.655 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:32:18.655 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:32:18.655 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:32:18.656 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:32:18.656 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:32:18.656 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:32:18.656 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:32:18.657 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:32:18.657 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:32:18.657 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:32:18.657 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:32:18.657 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:32:18.658 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:32:18.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:32:18.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:32:18.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:32:18.659 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:32:18.659 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:32:18.659 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:32:18.659 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:32:18.659 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:32:18.660 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.660 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:32:18.660 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:32:18.660 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:32:18.660 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:32:18.661 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:32:18.661 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:32:18.661 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:32:18.661 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:32:18.662 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:32:18.662 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:32:18.662 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:32:18.662 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:32:18.662 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:32:18.663 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:32:18.663 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:32:18.663 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.663 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:32:18.663 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:32:18.664 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:32:18.664 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.664 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.664 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.665 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.665 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 12, 2021-11-15T19:32:18.665 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:32:18.665 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:31:46.590945+0000", 2021-11-15T19:32:18.665 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:32:18.666 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:32:18.666 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:32:18.666 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:32:18.666 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:32:18.667 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:32:18.667 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:32:18.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:32:18.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:32:18.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:32:18.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:32:18.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:32:18.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:32:18.668 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:32:18.668 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:32:18.669 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:32:18.669 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:32:18.669 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:32:18.669 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:32:18.670 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:32:18.670 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "63", 2021-11-15T19:32:18.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:32:18.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:32:18.671 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:32:18.671 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:32:18.671 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:32:18.671 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:32:18.672 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:32:18.672 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:32:18.672 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:32:18.672 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:32:18.672 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:32:18.673 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:32:18.673 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:32:18.673 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:32:18.673 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:32:18.673 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:32:18.674 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:32:18.674 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:32:18.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:32:18.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:32:18.675 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:32:18.675 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:32:18.675 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:32:18.675 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:32:18.675 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:32:18.676 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:32:18.676 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.676 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:32:18.676 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:32:18.677 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:32:18.677 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:32:18.677 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:32:18.677 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:32:18.677 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:32:18.678 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:32:18.678 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:32:18.678 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:32:18.678 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:32:18.679 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:32:18.679 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:32:18.679 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:32:18.679 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:32:18.679 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.680 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.680 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.680 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:18.680 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:32:18.681 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.681 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:32:18.681 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:32:18.681 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.681 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.682 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.682 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.682 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.682 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.683 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.683 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:18.683 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.683 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.683 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.684 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.684 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.684 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.684 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:32:18.685 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.685 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.685 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:32:18.686 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.686 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.686 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.687 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.687 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.687 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.687 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.687 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:32:18.688 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.688 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.688 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.689 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:32:18.689 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.689 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.689 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.689 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.690 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.690 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.690 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.690 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.691 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:32:18.691 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.691 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.691 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.691 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.692 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:32:18.692 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.692 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.692 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.692 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.693 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.693 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.693 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:32:18.694 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.694 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.694 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.694 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.695 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:32:18.695 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:18.695 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.695 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.695 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.696 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:32:18.696 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:32:18.696 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:32:18.696 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:32:18.696 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.697 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.697 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.697 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.697 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.697 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.698 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:32:18.698 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:32:18.698 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.698 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.698 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.699 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.699 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.699 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.699 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.700 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:18.700 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.700 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.700 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.700 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.701 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:32:18.701 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.701 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.702 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:32:18.702 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.703 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.703 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.703 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.703 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.703 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.704 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.704 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:32:18.704 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.705 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.705 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.705 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:32:18.705 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.706 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.706 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.706 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.706 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.707 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.707 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.707 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:32:18.707 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.708 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.708 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.708 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.708 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:32:18.708 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.709 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.709 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.709 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.709 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.709 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.710 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.710 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.710 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:32:18.710 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.711 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.711 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:32:18.711 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:18.712 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.712 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.712 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:32:18.712 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:32:18.713 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:32:18.713 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:32:18.713 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.713 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.714 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.714 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.714 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.714 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.714 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:32:18.715 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:32:18.715 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.715 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.715 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.716 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.716 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.716 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.716 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.716 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 59, 2021-11-15T19:32:18.717 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.717 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.717 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.717 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.718 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.718 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.718 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:32:18.718 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.718 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.719 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.719 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.719 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:32:18.720 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.720 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.720 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.721 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.721 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.721 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.721 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.721 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:32:18.722 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.722 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.722 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.722 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.723 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:32:18.723 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.723 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.723 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.724 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.724 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.724 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.724 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.724 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:32:18.724 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.725 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.725 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.725 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.725 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:32:18.725 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.726 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.726 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.726 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.726 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.726 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.727 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.727 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.727 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:32:18.727 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.728 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.728 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:32:18.728 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:18.728 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.729 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.729 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:32:18.729 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:32:18.729 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:32:18.730 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:32:18.730 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.730 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.730 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.730 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.731 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.731 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.731 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:32:18.731 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:32:18.731 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.732 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.732 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.732 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.732 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.732 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.733 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.733 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 48, 2021-11-15T19:32:18.733 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.733 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.734 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.734 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.734 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.734 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.734 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:32:18.735 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.735 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.735 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.735 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.735 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:32:18.735 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.736 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.736 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.736 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.736 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.736 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.737 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.737 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.737 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:32:18.737 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.737 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.738 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.738 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.738 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:32:18.738 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.738 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.739 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.739 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.739 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.739 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.739 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.740 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.740 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:32:18.740 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.740 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.740 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.741 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.741 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:32:18.741 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.741 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.741 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.741 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.742 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.742 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.742 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.742 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.743 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:32:18.743 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.743 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.743 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.743 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.743 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:32:18.744 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:18.744 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.744 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.744 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.744 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:32:18.745 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:32:18.745 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:32:18.745 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:32:18.745 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.745 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.746 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.746 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.746 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.746 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.746 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:32:18.747 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:32:18.747 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.747 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.747 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.748 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.748 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.748 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.748 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.748 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:18.749 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.749 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.749 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.749 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.749 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.750 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.750 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:32:18.750 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.750 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.750 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.751 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.751 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:32:18.751 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.751 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.751 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.752 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.752 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.752 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.752 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.753 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.753 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:32:18.753 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.753 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.753 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.754 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.754 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:32:18.754 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.754 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.754 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.755 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.755 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.755 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.755 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.755 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.756 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:32:18.756 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.756 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.756 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.757 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:32:18.757 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.757 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.757 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.758 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.758 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.758 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.758 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.758 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.759 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:32:18.759 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.759 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.759 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.759 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.760 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:32:18.760 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:18.760 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.760 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.760 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.761 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:32:18.761 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:32:18.761 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:32:18.761 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:32:18.761 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.762 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.762 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.762 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.762 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.763 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.763 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:32:18.763 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:32:18.763 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.763 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.764 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.764 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.764 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.764 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.764 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.765 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 59, 2021-11-15T19:32:18.765 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.765 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.765 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.765 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.765 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.766 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.766 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:32:18.766 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.766 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.767 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.767 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.767 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:32:18.767 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.767 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.768 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.768 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.768 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.768 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.768 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.769 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.769 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:32:18.769 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.769 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.769 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.770 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.770 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:32:18.770 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.770 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.770 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.771 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.771 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.771 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.771 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.771 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.772 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:32:18.772 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.772 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.772 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.772 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.773 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:32:18.773 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.773 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.773 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.773 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.774 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.774 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.774 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.774 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.774 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:32:18.775 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.775 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.775 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.775 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.775 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:32:18.776 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:18.776 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.776 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.776 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.776 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:32:18.777 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:32:18.777 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:32:18.777 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:32:18.777 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.777 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.778 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.778 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.778 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.778 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.778 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:32:18.779 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:32:18.779 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.779 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.779 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.779 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.780 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.780 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.780 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.780 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:18.781 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.781 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.781 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.781 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.782 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.782 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:32:18.782 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.782 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.782 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.783 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.783 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:32:18.783 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.783 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.784 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.784 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.784 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.784 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.784 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.785 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.785 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:32:18.785 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.785 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.785 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.786 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.786 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:32:18.786 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.786 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.786 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.787 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.787 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.787 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.787 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.787 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.788 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:32:18.788 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.788 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.788 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.788 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.789 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:32:18.789 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.789 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.789 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.789 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.789 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.790 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.790 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.790 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.790 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:32:18.790 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.791 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.791 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.791 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:32:18.791 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:18.792 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.792 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.792 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.792 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:32:18.792 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:32:18.793 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:32:18.793 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:32:18.793 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.793 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.793 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.794 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.794 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.794 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.794 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:32:18.794 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:32:18.795 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:18.795 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:18.795 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:18.795 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:18.795 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:18.796 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:18.796 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:18.796 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 59, 2021-11-15T19:32:18.796 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:18.796 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:18.797 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:18.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.797 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.797 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:32:18.797 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.798 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.798 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.798 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.798 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:32:18.798 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.799 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.799 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.799 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.799 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:18.799 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.800 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.800 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:32:18.800 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.800 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.801 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.801 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.801 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:32:18.801 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.801 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.802 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.802 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.802 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:18.802 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.802 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.803 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.803 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:32:18.803 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.803 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.803 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.804 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.804 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:32:18.804 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.804 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.804 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.805 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.805 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:18.805 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:18.805 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.805 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:18.806 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:32:18.806 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.806 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.806 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.806 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:18.807 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:32:18.807 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:18.807 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.807 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.807 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.808 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:32:18.808 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:32:18.808 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:32:18.808 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:32:18.808 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:18.809 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:18.809 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:18.809 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:18.809 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.809 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:18.810 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:32:18.810 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.810 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:32:18.810 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.810 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.811 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.811 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.811 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.811 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:32:18.811 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.811 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.812 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.812 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:32:18.812 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.812 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.812 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.813 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.813 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.813 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:32:18.813 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.813 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.814 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.814 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:32:18.814 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.814 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.814 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.815 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.815 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.815 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:32:18.815 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.815 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.816 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:32:18.816 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.816 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.816 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.817 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.817 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.817 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:32:18.817 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.817 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.818 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.818 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:32:18.818 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.818 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.818 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.819 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.819 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.819 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:32:18.819 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.819 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.820 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.820 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:32:18.820 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.820 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.820 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.821 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.821 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.821 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:32:18.821 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.821 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.822 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.822 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:32:18.822 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.822 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.822 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.823 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.823 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.823 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:32:18.823 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.824 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.824 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:18.824 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:32:18.824 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:18.824 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:18.825 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:18.825 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:18.825 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:18.825 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:32:18.825 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:18.826 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.826 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:18.826 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:32:18.826 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:32:18.826 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:32:18.827 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:32:18.827 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:32:18.827 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:32:18.827 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:32:18.827 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:32:18.828 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:32:18.828 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:32:18.828 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:32:18.828 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:32:18.828 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:32:18.828 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:18.829 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:18.829 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:32:18.829 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:32:18.829 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:32:18.829 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:32:18.830 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:32:18.830 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:32:18.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef600536f0 msgr2=0x7fef60055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef600536f0 0x7fef60055bb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fef64002f70 tx=0x7fef64006a90).stop 2021-11-15T19:32:18.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 msgr2=0x7fef7c14a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c14a600 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fef6c002ef0 tx=0x7fef6c006d50).stop 2021-11-15T19:32:18.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 shutdown_connections 2021-11-15T19:32:18.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef600536f0 0x7fef60055bb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef7c144610 0x7fef7c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef7c0b1340 0x7fef7c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 --2- 172.21.2.137:0/389900640 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef7c0a9f50 0x7fef7c14a600 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 >> 172.21.2.137:0/389900640 conn(0x7fef7c0b4e60 msgr2=0x7fef7c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:18.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 shutdown_connections 2021-11-15T19:32:18.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.609+0000 7fef81d00700 1 -- 172.21.2.137:0/389900640 wait complete. 2021-11-15T19:32:18.834 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:18.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 Processor -- start 2021-11-15T19:32:18.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 -- start start 2021-11-15T19:32:18.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f68cc0b1180 0x7f68cc142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f68cc0af2f0 0x7f68cc143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0aecf0 con 0x7f68cc0acab0 2021-11-15T19:32:18.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc13f180 con 0x7f68cc0b1180 2021-11-15T19:32:18.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68d1ba2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0aef20 con 0x7f68cc0af2f0 2021-11-15T19:32:18.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68cbfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f68cc0af2f0 0x7f68cc143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68cbfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f68cc0af2f0 0x7f68cc143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35400/0 (socket says 172.21.2.137:35400) 2021-11-15T19:32:18.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.885+0000 7f68cbfff700 1 -- 172.21.2.137:0/2322193942 learned_addr learned my addr 172.21.2.137:0/2322193942 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/2322193942 >> v2:172.21.2.111:3300/0 conn(0x7f68cc0b1180 msgr2=0x7f68cc142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- 172.21.2.137:0/2322193942 >> v2:172.21.2.111:3300/0 conn(0x7f68cc0b1180 0x7f68cc142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/2322193942 >> v1:172.21.2.111:6789/0 conn(0x7f68cc0acab0 legacy=0x7f68cc0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/2322193942 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc0b2770 con 0x7f68cc0af2f0 2021-11-15T19:32:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- 172.21.2.137:0/2322193942 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0af2f0 0x7f68cc143070 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f68cc0b2bd0 tx=0x7f68c4009290).ready entity=mon.1 client_cookie=543747652184af2d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68ca7fc700 1 -- 172.21.2.137:0/2322193942 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c400b830 con 0x7f68cc0af2f0 2021-11-15T19:32:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68ca7fc700 1 -- 172.21.2.137:0/2322193942 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c400b990 con 0x7f68cc0af2f0 2021-11-15T19:32:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68ca7fc700 1 -- 172.21.2.137:0/2322193942 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c400bb40 con 0x7f68cc0af2f0 2021-11-15T19:32:18.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/2322193942 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0af2f0 msgr2=0x7f68cc143070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/2322193942 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0af2f0 0x7f68cc143070 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f68cc0b2bd0 tx=0x7f68c4009290).stop 2021-11-15T19:32:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/2322193942 shutdown_connections 2021-11-15T19:32:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/2322193942 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0af2f0 0x7f68cc143070 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/2322193942 >> v2:172.21.2.111:3300/0 conn(0x7f68cc0b1180 0x7f68cc142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/2322193942 >> 172.21.2.137:0/2322193942 conn(0x7f68cc0630f0 msgr2=0x7f68cc0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/2322193942 shutdown_connections 2021-11-15T19:32:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/2322193942 wait complete. 2021-11-15T19:32:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 Processor -- start 2021-11-15T19:32:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- start start 2021-11-15T19:32:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f68cc0acab0 0x7f68cc14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f68cc0af2f0 0x7f68cc137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 0x7f68cc137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc156810 con 0x7f68cc0af2f0 2021-11-15T19:32:18.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1574e0 con 0x7f68cc0b1180 2021-11-15T19:32:18.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc157780 con 0x7f68cc0acab0 2021-11-15T19:32:18.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 0x7f68cc137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 0x7f68cc137c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35408/0 (socket says 172.21.2.137:35408) 2021-11-15T19:32:18.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/3076497454 learned_addr learned my addr 172.21.2.137:0/3076497454 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:18.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68caffd700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f68cc0af2f0 0x7f68cc137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cb7fe700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f68cc0acab0 0x7f68cc14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f68cc0acab0 msgr2=0x7f68cc14c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f68cc0acab0 0x7f68cc14c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f68cc0af2f0 msgr2=0x7f68cc137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:18.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f68cc0af2f0 0x7f68cc137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:18.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 -- 172.21.2.137:0/3076497454 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c4009530 con 0x7f68cc0b1180 2021-11-15T19:32:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cb7fe700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f68cc0acab0 0x7f68cc14c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68cbfff700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 0x7f68cc137c00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f68cc0b2bd0 tx=0x7f68c4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c400b830 con 0x7f68cc0b1180 2021-11-15T19:32:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4020620 con 0x7f68cc0b1180 2021-11-15T19:32:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc1380f0 con 0x7f68cc0b1180 2021-11-15T19:32:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c4020980 con 0x7f68cc0b1180 2021-11-15T19:32:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.889+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc0640e0 con 0x7f68cc0b1180 2021-11-15T19:32:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc157330 con 0x7f68cc0b1180 2021-11-15T19:32:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68c400f070 con 0x7f68cc0b1180 2021-11-15T19:32:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68c8ff9700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f68b00535b0 0x7f68b0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f68c406cc60 con 0x7f68cc0b1180 2021-11-15T19:32:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68cb7fe700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f68b00535b0 0x7f68b0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68cb7fe700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f68b00535b0 0x7f68b0055a70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f68b4007000 tx=0x7f68b4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:18.893+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68c4043cb0 con 0x7f68cc0b1180 2021-11-15T19:32:19.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68cc0ace90 con 0x7f68cc0b1180 2021-11-15T19:32:19.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68c8ff9700 1 -- 172.21.2.137:0/3076497454 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f68c4015070 con 0x7f68cc0b1180 2021-11-15T19:32:19.008 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:19.008 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:31:48.620136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5893":{"gid":5893,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/837201683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":837201683},{"type":"v1","addr":"172.21.2.137:6833","nonce":837201683}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:32:19.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f68b00535b0 msgr2=0x7f68b0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:19.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f68b00535b0 0x7f68b0055a70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f68b4007000 tx=0x7f68b4008040).stop 2021-11-15T19:32:19.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 msgr2=0x7f68cc137c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:19.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 0x7f68cc137c00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f68cc0b2bd0 tx=0x7f68c4016000).stop 2021-11-15T19:32:19.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 shutdown_connections 2021-11-15T19:32:19.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f68b00535b0 0x7f68b0055a70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:19.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f68cc0b1180 0x7f68cc137c00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:19.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f68cc0af2f0 0x7f68cc137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:19.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 --2- 172.21.2.137:0/3076497454 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f68cc0acab0 0x7f68cc14c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:19.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 >> 172.21.2.137:0/3076497454 conn(0x7f68cc0630f0 msgr2=0x7f68cc0b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:19.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 shutdown_connections 2021-11-15T19:32:19.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.005+0000 7f68d1ba2700 1 -- 172.21.2.137:0/3076497454 wait complete. 2021-11-15T19:32:19.012 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 26 2021-11-15T19:32:19.015 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:32:19.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.061+0000 7fac81b7b700 1 Processor -- start 2021-11-15T19:32:19.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.061+0000 7fac81b7b700 1 -- start start 2021-11-15T19:32:19.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac7c0b1030 0x7fac7c140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:19.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c05cb50 con 0x7fac7c0ad020 2021-11-15T19:32:19.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c13f910 con 0x7fac7c05c770 2021-11-15T19:32:19.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c13fbb0 con 0x7fac7c0b1030 2021-11-15T19:32:19.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac7c0b1030 0x7fac7c140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:19.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fac7c05c770 0x7fac7c0ac910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54194/0 (socket says 172.21.2.137:54194) 2021-11-15T19:32:19.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7b7fe700 1 -- 172.21.2.137:0/3825984277 learned_addr learned my addr 172.21.2.137:0/3825984277 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:19.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7affd700 1 --2- 172.21.2.137:0/3825984277 >> v2:172.21.2.137:3300/0 conn(0x7fac7c0b1030 0x7fac7c140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35414/0 (socket says 172.21.2.137:35414) 2021-11-15T19:32:19.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7affd700 1 -- 172.21.2.137:0/3825984277 >> v1:172.21.2.137:6789/0 conn(0x7fac7c05c770 legacy=0x7fac7c0ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:19.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7affd700 1 -- 172.21.2.137:0/3825984277 >> v1:172.21.2.111:6789/0 conn(0x7fac7c0ad020 legacy=0x7fac7c13c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:19.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7affd700 1 -- 172.21.2.137:0/3825984277 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c13fe50 con 0x7fac7c0b1030 2021-11-15T19:32:19.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7affd700 1 --2- 172.21.2.137:0/3825984277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c140590 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fac7c0aee10 tx=0x7fac6c006df0).ready entity=mon.1 client_cookie=ed04688fc4cb6d3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:19.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7a7fc700 1 -- 172.21.2.137:0/3825984277 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6c014070 con 0x7fac7c0b1030 2021-11-15T19:32:19.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7a7fc700 1 -- 172.21.2.137:0/3825984277 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c000e90 con 0x7fac7c0b1030 2021-11-15T19:32:19.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7a7fc700 1 -- 172.21.2.137:0/3825984277 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6c00fbb0 con 0x7fac7c0b1030 2021-11-15T19:32:19.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- 172.21.2.137:0/3825984277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 msgr2=0x7fac7c140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:19.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 --2- 172.21.2.137:0/3825984277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c140590 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fac7c0aee10 tx=0x7fac6c006df0).stop 2021-11-15T19:32:19.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- 172.21.2.137:0/3825984277 shutdown_connections 2021-11-15T19:32:19.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 --2- 172.21.2.137:0/3825984277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c140590 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:19.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- 172.21.2.137:0/3825984277 >> 172.21.2.137:0/3825984277 conn(0x7fac7c0631e0 msgr2=0x7fac7c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:19.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- 172.21.2.137:0/3825984277 shutdown_connections 2021-11-15T19:32:19.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- 172.21.2.137:0/3825984277 wait complete. 2021-11-15T19:32:19.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 Processor -- start 2021-11-15T19:32:19.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- start start 2021-11-15T19:32:19.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac7c05c770 0x7fac7c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:19.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac7c0ad020 0x7fac7c065e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:19.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:19.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c066950 con 0x7fac7c05c770 2021-11-15T19:32:19.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c129c90 con 0x7fac7c0b1030 2021-11-15T19:32:19.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac81b7b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c129f30 con 0x7fac7c0ad020 2021-11-15T19:32:19.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:19.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c066fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35422/0 (socket says 172.21.2.137:35422) 2021-11-15T19:32:19.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 -- 172.21.2.137:0/529309104 learned_addr learned my addr 172.21.2.137:0/529309104 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:19.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 -- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac7c0ad020 msgr2=0x7fac7c065e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:19.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac7c0ad020 0x7fac7c065e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:19.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 -- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac7c05c770 msgr2=0x7fac7c14e710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:19.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac7c05c770 0x7fac7c14e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:19.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.065+0000 7fac7bfff700 1 -- 172.21.2.137:0/529309104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c00b180 con 0x7fac7c0b1030 2021-11-15T19:32:19.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac7bfff700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c066fc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fac74003310 tx=0x7fac740091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:19.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac74001500 con 0x7fac7c0b1030 2021-11-15T19:32:19.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74001660 con 0x7fac7c0b1030 2021-11-15T19:32:19.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac740019c0 con 0x7fac7c0b1030 2021-11-15T19:32:19.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c13eec0 con 0x7fac7c0b1030 2021-11-15T19:32:19.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c066300 con 0x7fac7c0b1030 2021-11-15T19:32:19.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c13eb00 con 0x7fac7c0b1030 2021-11-15T19:32:19.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac74018030 con 0x7fac7c0b1030 2021-11-15T19:32:19.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac78ff9700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac60053610 0x7fac60055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:19.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fac7406b310 con 0x7fac7c0b1030 2021-11-15T19:32:19.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac7b7fe700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac60053610 0x7fac60055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:19.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.069+0000 7fac7b7fe700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac60053610 0x7fac60055ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fac7c140470 tx=0x7fac64007770).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:19.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.073+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac7c13eb00 con 0x7fac7c0b1030 2021-11-15T19:32:19.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:19.181+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fac7c13eb00 con 0x7fac7c0b1030 2021-11-15T19:32:20.135 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:32:20.132+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:32:20.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.145+0000 7fac78ff9700 1 -- 172.21.2.137:0/529309104 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fac7c13eb00 con 0x7fac7c0b1030 2021-11-15T19:32:20.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac60053610 msgr2=0x7fac60055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac60053610 0x7fac60055ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fac7c140470 tx=0x7fac64007770).stop 2021-11-15T19:32:20.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 msgr2=0x7fac7c066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c066fc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fac74003310 tx=0x7fac740091a0).stop 2021-11-15T19:32:20.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 shutdown_connections 2021-11-15T19:32:20.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac60053610 0x7fac60055ad0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:20.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac7c0b1030 0x7fac7c066fc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:20.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac7c0ad020 0x7fac7c065e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 --2- 172.21.2.137:0/529309104 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac7c05c770 0x7fac7c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 >> 172.21.2.137:0/529309104 conn(0x7fac7c0631e0 msgr2=0x7fac7c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:20.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 shutdown_connections 2021-11-15T19:32:20.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.149+0000 7fac81b7b700 1 -- 172.21.2.137:0/529309104 wait complete. 2021-11-15T19:32:20.154 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:32:20.158 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:20.169 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:32:20.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 Processor -- start 2021-11-15T19:32:20.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- start start 2021-11-15T19:32:20.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3e5c0acab0 0x7f3e5c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0aecf0 con 0x7f3e5c0b1180 2021-11-15T19:32:20.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c13f180 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c06a580 con 0x7f3e5c0acab0 2021-11-15T19:32:20.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62190700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3e5c0acab0 0x7f3e5c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:20.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62991700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3e5c0af2f0 0x7f3e5c142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54218/0 (socket says 172.21.2.137:54218) 2021-11-15T19:32:20.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62991700 1 -- 172.21.2.137:0/60150385 learned_addr learned my addr 172.21.2.137:0/60150385 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:20.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62190700 1 -- 172.21.2.137:0/60150385 >> v1:172.21.2.137:6789/0 conn(0x7f3e5c0af2f0 legacy=0x7f3e5c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62190700 1 -- 172.21.2.137:0/60150385 >> v1:172.21.2.111:6789/0 conn(0x7f3e5c0b1180 legacy=0x7f3e5c069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:20.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62190700 1 -- 172.21.2.137:0/60150385 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0aef20 con 0x7f3e5c0acab0 2021-11-15T19:32:20.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e62190700 1 --2- 172.21.2.137:0/60150385 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0acab0 0x7f3e5c0b2060 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f3e5c0b2bd0 tx=0x7f3e58006df0).ready entity=mon.1 client_cookie=9cb0bf9b3d2661b8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:20.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e6118e700 1 -- 172.21.2.137:0/60150385 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e5800d5c0 con 0x7f3e5c0acab0 2021-11-15T19:32:20.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e6118e700 1 -- 172.21.2.137:0/60150385 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58000e90 con 0x7f3e5c0acab0 2021-11-15T19:32:20.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e6118e700 1 -- 172.21.2.137:0/60150385 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e5800d910 con 0x7f3e5c0acab0 2021-11-15T19:32:20.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- 172.21.2.137:0/60150385 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0acab0 msgr2=0x7f3e5c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 --2- 172.21.2.137:0/60150385 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0acab0 0x7f3e5c0b2060 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f3e5c0b2bd0 tx=0x7f3e58006df0).stop 2021-11-15T19:32:20.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- 172.21.2.137:0/60150385 shutdown_connections 2021-11-15T19:32:20.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 --2- 172.21.2.137:0/60150385 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0acab0 0x7f3e5c0b2060 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:20.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- 172.21.2.137:0/60150385 >> 172.21.2.137:0/60150385 conn(0x7f3e5c0630f0 msgr2=0x7f3e5c0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:20.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- 172.21.2.137:0/60150385 shutdown_connections 2021-11-15T19:32:20.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.205+0000 7f3e643f4700 1 -- 172.21.2.137:0/60150385 wait complete. 2021-11-15T19:32:20.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 Processor -- start 2021-11-15T19:32:20.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- start start 2021-11-15T19:32:20.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e5c0acab0 0x7f3e5c141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 0x7f3e5c143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e5c0b1180 0x7f3e5c131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c065c80 con 0x7f3e5c0acab0 2021-11-15T19:32:20.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c065ee0 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c066180 con 0x7f3e5c0b1180 2021-11-15T19:32:20.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 0x7f3e5c143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:20.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 0x7f3e5c143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35446/0 (socket says 172.21.2.137:35446) 2021-11-15T19:32:20.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 -- 172.21.2.137:0/2609645990 learned_addr learned my addr 172.21.2.137:0/2609645990 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:20.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 -- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e5c0b1180 msgr2=0x7f3e5c131190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e5c0b1180 0x7f3e5c131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 -- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e5c0acab0 msgr2=0x7f3e5c141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e5c0acab0 0x7f3e5c141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 -- 172.21.2.137:0/2609645990 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5800b180 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e6198f700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 0x7f3e5c143a00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f3e4c002ef0 tx=0x7f3e4c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:20.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c012410 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c012570 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c065170 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c0128d0 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c142aa0 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c0573d0 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e4c00f030 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e4b7fe700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e3c053690 0x7f3e3c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.209+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f3e4c06b780 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.213+0000 7f3e62190700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e3c053690 0x7f3e3c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:20.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.213+0000 7f3e62190700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e3c053690 0x7f3e3c055b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f3e5c0b2bd0 tx=0x7f3e58012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:20.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.213+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e4c042780 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5c067d20 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e4b7fe700 1 -- 172.21.2.137:0/2609645990 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f3e4c045da0 con 0x7f3e5c0af2f0 2021-11-15T19:32:20.326 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:20.326 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:31:47.615370+0000","modified":"2021-11-15T19:32:20.133880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T19:32:20.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e3c053690 msgr2=0x7f3e3c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e3c053690 0x7f3e3c055b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f3e5c0b2bd0 tx=0x7f3e58012000).stop 2021-11-15T19:32:20.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 msgr2=0x7f3e5c143a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 0x7f3e5c143a00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f3e4c002ef0 tx=0x7f3e4c006d50).stop 2021-11-15T19:32:20.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 shutdown_connections 2021-11-15T19:32:20.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e3c053690 0x7f3e3c055b50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:20.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e5c0b1180 0x7f3e5c131190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e5c0af2f0 0x7f3e5c143a00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:20.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 --2- 172.21.2.137:0/2609645990 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e5c0acab0 0x7f3e5c141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 >> 172.21.2.137:0/2609645990 conn(0x7f3e5c0630f0 msgr2=0x7f3e5c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:20.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 shutdown_connections 2021-11-15T19:32:20.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.321+0000 7f3e643f4700 1 -- 172.21.2.137:0/2609645990 wait complete. 2021-11-15T19:32:20.330 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 27 2021-11-15T19:32:20.333 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:32:20.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 Processor -- start 2021-11-15T19:32:20.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- start start 2021-11-15T19:32:20.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 0x7f14e80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14e80b0550 0x7f14e814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e805cb50 con 0x7f14e814aaa0 2021-11-15T19:32:20.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80b1650 con 0x7f14e80b0550 2021-11-15T19:32:20.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80ad030 con 0x7f14e805c770 2021-11-15T19:32:20.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14e80b0550 0x7f14e814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:20.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14e80b0550 0x7f14e814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35452/0 (socket says 172.21.2.137:35452) 2021-11-15T19:32:20.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 -- 172.21.2.137:0/615349200 learned_addr learned my addr 172.21.2.137:0/615349200 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:20.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 -- 172.21.2.137:0/615349200 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 msgr2=0x7f14e80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:20.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 --2- 172.21.2.137:0/615349200 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 0x7f14e80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 -- 172.21.2.137:0/615349200 >> v1:172.21.2.111:6789/0 conn(0x7f14e814aaa0 legacy=0x7f14e8140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:20.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 -- 172.21.2.137:0/615349200 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80ad2d0 con 0x7f14e80b0550 2021-11-15T19:32:20.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ed41c700 1 --2- 172.21.2.137:0/615349200 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e814a5b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f14e80adfd0 tx=0x7f14dc006eb0).ready entity=mon.1 client_cookie=b5c36d380b6401d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:20.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ecc1b700 1 -- 172.21.2.137:0/615349200 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14dc00d570 con 0x7f14e80b0550 2021-11-15T19:32:20.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ecc1b700 1 -- 172.21.2.137:0/615349200 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc000e90 con 0x7f14e80b0550 2021-11-15T19:32:20.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14ecc1b700 1 -- 172.21.2.137:0/615349200 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14dc00d8c0 con 0x7f14e80b0550 2021-11-15T19:32:20.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- 172.21.2.137:0/615349200 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 msgr2=0x7f14e814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 --2- 172.21.2.137:0/615349200 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e814a5b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f14e80adfd0 tx=0x7f14dc006eb0).stop 2021-11-15T19:32:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- 172.21.2.137:0/615349200 shutdown_connections 2021-11-15T19:32:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 --2- 172.21.2.137:0/615349200 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e814a5b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 --2- 172.21.2.137:0/615349200 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 0x7f14e80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- 172.21.2.137:0/615349200 >> 172.21.2.137:0/615349200 conn(0x7f14e80631e0 msgr2=0x7f14e805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- 172.21.2.137:0/615349200 shutdown_connections 2021-11-15T19:32:20.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.381+0000 7f14efe81700 1 -- 172.21.2.137:0/615349200 wait complete. 2021-11-15T19:32:20.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 Processor -- start 2021-11-15T19:32:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- start start 2021-11-15T19:32:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 0x7f14e815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e8063a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14e814aaa0 0x7f14e8143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8144fb0 con 0x7f14e814aaa0 2021-11-15T19:32:20.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80644e0 con 0x7f14e80b0550 2021-11-15T19:32:20.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8064780 con 0x7f14e805c770 2021-11-15T19:32:20.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e8063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:20.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e8063a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35456/0 (socket says 172.21.2.137:35456) 2021-11-15T19:32:20.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 -- 172.21.2.137:0/1425826530 learned_addr learned my addr 172.21.2.137:0/1425826530 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:20.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 -- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 msgr2=0x7f14e815a710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:20.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 0x7f14e815a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 -- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14e814aaa0 msgr2=0x7f14e8143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14e814aaa0 0x7f14e8143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 -- 172.21.2.137:0/1425826530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc00b1e0 con 0x7f14e80b0550 2021-11-15T19:32:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14ed41c700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e8063a90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f14e80adfd0 tx=0x7f14dc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14dc002f70 con 0x7f14e80b0550 2021-11-15T19:32:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc006b80 con 0x7f14e80b0550 2021-11-15T19:32:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14dc00de20 con 0x7f14e80b0550 2021-11-15T19:32:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e8145380 con 0x7f14e80b0550 2021-11-15T19:32:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e8067320 con 0x7f14e80b0550 2021-11-15T19:32:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8067600 con 0x7f14e80b0550 2021-11-15T19:32:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14dc025030 con 0x7f14e80b0550 2021-11-15T19:32:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14daffd700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14c8053660 0x7f14c8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f14dc06ce80 con 0x7f14e80b0550 2021-11-15T19:32:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.385+0000 7f14edc1d700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14c8053660 0x7f14c8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.389+0000 7f14edc1d700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14c8053660 0x7f14c8055b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f14e4002f70 tx=0x7f14e4006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.389+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14dc043e80 con 0x7f14e80b0550 2021-11-15T19:32:20.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:20.497+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14e80ae7f0 con 0x7f14e80b0550 2021-11-15T19:32:21.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.189+0000 7f14daffd700 1 -- 172.21.2.137:0/1425826530 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f14dc0474a0 con 0x7f14e80b0550 2021-11-15T19:32:21.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14c8053660 msgr2=0x7f14c8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:21.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14c8053660 0x7f14c8055b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f14e4002f70 tx=0x7f14e4006a00).stop 2021-11-15T19:32:21.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 msgr2=0x7f14e8063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:21.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e8063a90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f14e80adfd0 tx=0x7f14dc015000).stop 2021-11-15T19:32:21.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 shutdown_connections 2021-11-15T19:32:21.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14c8053660 0x7f14c8055b20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:21.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14e814aaa0 0x7f14e8143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:21.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14e80b0550 0x7f14e8063a90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:21.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 --2- 172.21.2.137:0/1425826530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14e805c770 0x7f14e815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:21.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 >> 172.21.2.137:0/1425826530 conn(0x7f14e80631e0 msgr2=0x7f14e805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:21.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 shutdown_connections 2021-11-15T19:32:21.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.193+0000 7f14efe81700 1 -- 172.21.2.137:0/1425826530 wait complete. 2021-11-15T19:32:21.205 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:32:21.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.253+0000 7fc9aa4e8700 1 Processor -- start 2021-11-15T19:32:21.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.253+0000 7fc9aa4e8700 1 -- start start 2021-11-15T19:32:21.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a40aee10 0x7fc9a40b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:21.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc9a4144ae0 0x7fc9a4140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:21.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40af1f0 con 0x7fc9a4143f70 2021-11-15T19:32:21.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a4067ba0 con 0x7fc9a4144ae0 2021-11-15T19:32:21.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40b0760 con 0x7fc9a40aee10 2021-11-15T19:32:21.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc9a4144ae0 0x7fc9a4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:21.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc9a4144ae0 0x7fc9a4140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35466/0 (socket says 172.21.2.137:35466) 2021-11-15T19:32:21.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/1556973688 learned_addr learned my addr 172.21.2.137:0/1556973688 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:21.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/1556973688 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a40aee10 msgr2=0x7fc9a40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:21.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- 172.21.2.137:0/1556973688 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a40aee10 0x7fc9a40b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:21.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/1556973688 >> v1:172.21.2.111:6789/0 conn(0x7fc9a4143f70 legacy=0x7fc9a41443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:21.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/1556973688 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4067890 con 0x7fc9a4144ae0 2021-11-15T19:32:21.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- 172.21.2.137:0/1556973688 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4140940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fc9a40688e0 tx=0x7fc99c009290).ready entity=mon.1 client_cookie=1bc03ce3e4baa406 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:21.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a2ffd700 1 -- 172.21.2.137:0/1556973688 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99c00b860 con 0x7fc9a4144ae0 2021-11-15T19:32:21.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a2ffd700 1 -- 172.21.2.137:0/1556973688 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00b9c0 con 0x7fc9a4144ae0 2021-11-15T19:32:21.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a2ffd700 1 -- 172.21.2.137:0/1556973688 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99c00bb70 con 0x7fc9a4144ae0 2021-11-15T19:32:21.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/1556973688 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 msgr2=0x7fc9a4140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:21.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/1556973688 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4140940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fc9a40688e0 tx=0x7fc99c009290).stop 2021-11-15T19:32:21.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/1556973688 shutdown_connections 2021-11-15T19:32:21.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/1556973688 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4140940 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:21.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/1556973688 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a40aee10 0x7fc9a40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:21.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/1556973688 >> 172.21.2.137:0/1556973688 conn(0x7fc9a405bd20 msgr2=0x7fc9a405c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:21.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/1556973688 shutdown_connections 2021-11-15T19:32:21.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/1556973688 wait complete. 2021-11-15T19:32:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 Processor -- start 2021-11-15T19:32:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- start start 2021-11-15T19:32:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9a40aee10 0x7fc9a40ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:21.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a4143f70 0x7fc9a4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:21.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:21.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a413b310 con 0x7fc9a40aee10 2021-11-15T19:32:21.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40a3130 con 0x7fc9a4144ae0 2021-11-15T19:32:21.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a41557c0 con 0x7fc9a4143f70 2021-11-15T19:32:21.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:21.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35474/0 (socket says 172.21.2.137:35474) 2021-11-15T19:32:21.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/3616988565 learned_addr learned my addr 172.21.2.137:0/3616988565 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:21.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a4143f70 msgr2=0x7fc9a4155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:21.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a4143f70 0x7fc9a4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9a40aee10 msgr2=0x7fc9a40ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9a40aee10 0x7fc9a40ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 -- 172.21.2.137:0/3616988565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009530 con 0x7fc9a4144ae0 2021-11-15T19:32:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a8a85700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4152190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fc9a413b450 tx=0x7fc99c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99c00b860 con 0x7fc9a4144ae0 2021-11-15T19:32:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c0032f0 con 0x7fc9a4144ae0 2021-11-15T19:32:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a4155a60 con 0x7fc9a4144ae0 2021-11-15T19:32:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.257+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99c01f610 con 0x7fc9a4144ae0 2021-11-15T19:32:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a413e2d0 con 0x7fc9a4144ae0 2021-11-15T19:32:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a40a2fa0 con 0x7fc9a4144ae0 2021-11-15T19:32:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc99c00f070 con 0x7fc9a4144ae0 2021-11-15T19:32:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9a17fa700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc988053520 0x7fc9880559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fc99c06c680 con 0x7fc9a4144ae0 2021-11-15T19:32:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9a3fff700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc988053520 0x7fc9880559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9a3fff700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc988053520 0x7fc9880559e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc98c002f70 tx=0x7fc98c006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.261+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc99c043680 con 0x7fc9a4144ae0 2021-11-15T19:32:21.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:21.345+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc9a4155bf0 con 0x7fc9a4144ae0 2021-11-15T19:32:22.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.201+0000 7fc9a17fa700 1 -- 172.21.2.137:0/3616988565 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc99c046ca0 con 0x7fc9a4144ae0 2021-11-15T19:32:22.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc988053520 msgr2=0x7fc9880559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:22.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc988053520 0x7fc9880559e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc98c002f70 tx=0x7fc98c006a80).stop 2021-11-15T19:32:22.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 msgr2=0x7fc9a4152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:22.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4152190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fc9a413b450 tx=0x7fc99c016000).stop 2021-11-15T19:32:22.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 shutdown_connections 2021-11-15T19:32:22.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc988053520 0x7fc9880559e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:22.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9a4144ae0 0x7fc9a4152190 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:22.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9a4143f70 0x7fc9a4155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:22.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 --2- 172.21.2.137:0/3616988565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9a40aee10 0x7fc9a40ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:22.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 >> 172.21.2.137:0/3616988565 conn(0x7fc9a405bd20 msgr2=0x7fc9a40b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:22.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 shutdown_connections 2021-11-15T19:32:22.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.205+0000 7fc9aa4e8700 1 -- 172.21.2.137:0/3616988565 wait complete. 2021-11-15T19:32:22.211 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:32:22.216 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:32:22.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 Processor -- start 2021-11-15T19:32:22.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 -- start start 2021-11-15T19:32:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1a7805fd20 0x7f1a780af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a780b10b0 0x7f1a780b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a78147f70 con 0x7f1a780b0610 2021-11-15T19:32:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a78060100 con 0x7f1a7805fd20 2021-11-15T19:32:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7ec24700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78147cd0 con 0x7f1a780b10b0 2021-11-15T19:32:22.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7c9c0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1a7805fd20 0x7f1a780af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:22.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a77fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a780b10b0 0x7f1a780b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:22.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7c9c0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1a7805fd20 0x7f1a780af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:42706/0 (socket says 172.21.2.137:42706) 2021-11-15T19:32:22.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.265+0000 7f1a7c9c0700 1 -- 172.21.2.137:0/1092378430 learned_addr learned my addr 172.21.2.137:0/1092378430 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:22.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7c9c0700 1 -- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a780b10b0 msgr2=0x7f1a780b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:22.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7c9c0700 1 --2- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a780b10b0 0x7f1a780b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:22.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7c9c0700 1 -- 172.21.2.137:0/1092378430 >> v1:172.21.2.111:6789/0 conn(0x7f1a780b0610 legacy=0x7f1a780aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:22.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7c9c0700 1 -- 172.21.2.137:0/1092378430 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780a9ed0 con 0x7f1a7805fd20 2021-11-15T19:32:22.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7c9c0700 1 --2- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a7805fd20 0x7f1a780af800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1a60002f70 tx=0x7f1a60006eb0).ready entity=mon.0 client_cookie=a37bd9da224a3be6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:22.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a777fe700 1 -- 172.21.2.137:0/1092378430 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a6000d570 con 0x7f1a7805fd20 2021-11-15T19:32:22.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a777fe700 1 -- 172.21.2.137:0/1092378430 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60000e90 con 0x7f1a7805fd20 2021-11-15T19:32:22.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a777fe700 1 -- 172.21.2.137:0/1092378430 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a6000d900 con 0x7f1a7805fd20 2021-11-15T19:32:22.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a7805fd20 msgr2=0x7f1a780af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:22.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a7805fd20 0x7f1a780af800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1a60002f70 tx=0x7f1a60006eb0).stop 2021-11-15T19:32:22.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/1092378430 shutdown_connections 2021-11-15T19:32:22.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a780b10b0 0x7f1a780b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:22.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/1092378430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a7805fd20 0x7f1a780af800 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:22.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/1092378430 >> 172.21.2.137:0/1092378430 conn(0x7f1a780b4e60 msgr2=0x7f1a780b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:22.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/1092378430 shutdown_connections 2021-11-15T19:32:22.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/1092378430 wait complete. 2021-11-15T19:32:22.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 Processor -- start 2021-11-15T19:32:22.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- start start 2021-11-15T19:32:22.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a7805fd20 0x7f1a780ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:22.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 0x7f1a780ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:22.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a780b10b0 0x7f1a78099080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:22.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780ae940 con 0x7f1a780b10b0 2021-11-15T19:32:22.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780aeb70 con 0x7f1a780b0610 2021-11-15T19:32:22.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78098be0 con 0x7f1a7805fd20 2021-11-15T19:32:22.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 0x7f1a780ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:22.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 0x7f1a780ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35486/0 (socket says 172.21.2.137:35486) 2021-11-15T19:32:22.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 -- 172.21.2.137:0/4253263250 learned_addr learned my addr 172.21.2.137:0/4253263250 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:22.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 -- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a7805fd20 msgr2=0x7f1a780ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:22.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a7805fd20 0x7f1a780ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:22.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 -- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a780b10b0 msgr2=0x7f1a78099080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:22.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a780b10b0 0x7f1a78099080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:22.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 -- 172.21.2.137:0/4253263250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6000b1e0 con 0x7f1a780b0610 2021-11-15T19:32:22.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a77fff700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 0x7f1a780ad7a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1a6800c000 tx=0x7f1a68006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:22.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a68010780 con 0x7f1a780b0610 2021-11-15T19:32:22.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a680108e0 con 0x7f1a780b0610 2021-11-15T19:32:22.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a780acad0 con 0x7f1a780b0610 2021-11-15T19:32:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a68010c40 con 0x7f1a780b0610 2021-11-15T19:32:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.269+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780ad290 con 0x7f1a780b0610 2021-11-15T19:32:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a78098de0 con 0x7f1a780b0610 2021-11-15T19:32:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a6801c460 con 0x7f1a780b0610 2021-11-15T19:32:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a75ffb700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a5c0534f0 0x7f1a5c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f1a6806bdc0 con 0x7f1a780b0610 2021-11-15T19:32:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a7c9c0700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a5c0534f0 0x7f1a5c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a7c9c0700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a5c0534f0 0x7f1a5c0559b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1a60002f70 tx=0x7f1a60015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.273+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a78098de0 con 0x7f1a780b0610 2021-11-15T19:32:22.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:22.357+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a78098de0 con 0x7f1a780b0610 2021-11-15T19:32:23.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.213+0000 7f1a75ffb700 1 -- 172.21.2.137:0/4253263250 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1a78098de0 con 0x7f1a780b0610 2021-11-15T19:32:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a5c0534f0 msgr2=0x7f1a5c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a5c0534f0 0x7f1a5c0559b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1a60002f70 tx=0x7f1a60015000).stop 2021-11-15T19:32:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 msgr2=0x7f1a780ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 0x7f1a780ad7a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1a6800c000 tx=0x7f1a68006df0).stop 2021-11-15T19:32:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 shutdown_connections 2021-11-15T19:32:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a5c0534f0 0x7f1a5c0559b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a780b10b0 0x7f1a78099080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a780b0610 0x7f1a780ad7a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 --2- 172.21.2.137:0/4253263250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1a7805fd20 0x7f1a780ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 >> 172.21.2.137:0/4253263250 conn(0x7f1a780b4e60 msgr2=0x7f1a78146170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 shutdown_connections 2021-11-15T19:32:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.217+0000 7f1a7ec24700 1 -- 172.21.2.137:0/4253263250 wait complete. 2021-11-15T19:32:23.222 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:32:23.225 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:32:23.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f40c8700 1 Processor -- start 2021-11-15T19:32:23.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f40c8700 1 -- start start 2021-11-15T19:32:23.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f40c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 0x7fd1ec14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f40c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec05cb50 con 0x7fd1ec05c770 2021-11-15T19:32:23.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f40c8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0ad030 con 0x7fd1ec14aaa0 2021-11-15T19:32:23.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f40c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0b1650 con 0x7fd1ec0b0550 2021-11-15T19:32:23.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f2665700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd1ec14aaa0 0x7fd1ec140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54276/0 (socket says 172.21.2.137:54276) 2021-11-15T19:32:23.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.273+0000 7fd1f2665700 1 -- 172.21.2.137:0/3900866152 learned_addr learned my addr 172.21.2.137:0/3900866152 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450189008 0 0) 0x7fd1ec0ad030 con 0x7fd1ec14aaa0 2021-11-15T19:32:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d4003260 con 0x7fd1ec14aaa0 2021-11-15T19:32:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2922106049 0 0) 0x7fd1d4003260 con 0x7fd1ec14aaa0 2021-11-15T19:32:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 msgr2=0x7fd1ec14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 0x7fd1ec14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 >> v1:172.21.2.111:6789/0 conn(0x7fd1ec05c770 legacy=0x7fd1ec0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0ad2d0 con 0x7fd1ec14aaa0 2021-11-15T19:32:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd1e40019e0 con 0x7fd1ec14aaa0 2021-11-15T19:32:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 >> v1:172.21.2.137:6789/0 conn(0x7fd1ec14aaa0 legacy=0x7fd1ec140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 0x7fd1d40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1d4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1d4004b40 0x7fd1d4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0b1650 con 0x7fd1d4004b40 2021-11-15T19:32:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d400ba00 con 0x7fd1d4003ec0 2021-11-15T19:32:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d400bbc0 con 0x7fd1ec0b0550 2021-11-15T19:32:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1d4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 0x7fd1d40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f2665700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1d4004b40 0x7fd1d4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 -- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 msgr2=0x7fd1d40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec0b0550 0x7fd1d40037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 -- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1d4004b40 msgr2=0x7fd1d4004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1d4004b40 0x7fd1d4004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 -- 172.21.2.137:0/3900866152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4003260 con 0x7fd1d4003ec0 2021-11-15T19:32:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1d4004500 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd1e8002f70 tx=0x7fd1e8006ca0).ready entity=mon.1 client_cookie=a418a59d8be22d8a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e8013410 con 0x7fd1d4003ec0 2021-11-15T19:32:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8013570 con 0x7fd1d4003ec0 2021-11-15T19:32:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f0e62700 1 -- 172.21.2.137:0/3900866152 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e80138d0 con 0x7fd1d4003ec0 2021-11-15T19:32:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- 172.21.2.137:0/3900866152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 msgr2=0x7fd1d4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/3900866152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1d4004500 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd1e8002f70 tx=0x7fd1e8006ca0).stop 2021-11-15T19:32:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f2665700 1 -- 172.21.2.137:0/3900866152 reap_dead start 2021-11-15T19:32:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- 172.21.2.137:0/3900866152 shutdown_connections 2021-11-15T19:32:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- 172.21.2.137:0/3900866152 >> 172.21.2.137:0/3900866152 conn(0x7fd1ec0631e0 msgr2=0x7fd1ec05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- 172.21.2.137:0/3900866152 shutdown_connections 2021-11-15T19:32:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- 172.21.2.137:0/3900866152 wait complete. 2021-11-15T19:32:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 Processor -- start 2021-11-15T19:32:23.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- start start 2021-11-15T19:32:23.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1ec145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec065400 0x7fd1ec063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1ec159560 0x7fd1ec142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0665c0 con 0x7fd1ec159560 2021-11-15T19:32:23.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec064490 con 0x7fd1d4003ec0 2021-11-15T19:32:23.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f40c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0646e0 con 0x7fd1ec065400 2021-11-15T19:32:23.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1ec145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1ec145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35504/0 (socket says 172.21.2.137:35504) 2021-11-15T19:32:23.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 -- 172.21.2.137:0/1238704821 learned_addr learned my addr 172.21.2.137:0/1238704821 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f2665700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1ec159560 0x7fd1ec142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1663700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec065400 0x7fd1ec063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 -- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec065400 msgr2=0x7fd1ec063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec065400 0x7fd1ec063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 -- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1ec159560 msgr2=0x7fd1ec142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1ec159560 0x7fd1ec142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.277+0000 7fd1f1e64700 1 -- 172.21.2.137:0/1238704821 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec064980 con 0x7fd1d4003ec0 2021-11-15T19:32:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1f1e64700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1ec145670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fd1e000d000 tx=0x7fd1e0007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e0011590 con 0x7fd1d4003ec0 2021-11-15T19:32:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0000e90 con 0x7fd1d4003ec0 2021-11-15T19:32:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec116800 con 0x7fd1d4003ec0 2021-11-15T19:32:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e00118e0 con 0x7fd1d4003ec0 2021-11-15T19:32:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec143170 con 0x7fd1d4003ec0 2021-11-15T19:32:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec116990 con 0x7fd1d4003ec0 2021-11-15T19:32:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1e001a030 con 0x7fd1d4003ec0 2021-11-15T19:32:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1cc053580 0x7fd1cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd1e006afd0 con 0x7fd1d4003ec0 2021-11-15T19:32:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1f1663700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1cc053580 0x7fd1cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1f1663700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1cc053580 0x7fd1cc055a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd1e8019000 tx=0x7fd1e8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.281+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1e0042410 con 0x7fd1d4003ec0 2021-11-15T19:32:23.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.365+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd1ec0573d0 con 0x7fd1d4003ec0 2021-11-15T19:32:23.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1deffd700 1 -- 172.21.2.137:0/1238704821 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1e0045a30 con 0x7fd1d4003ec0 2021-11-15T19:32:23.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1cc053580 msgr2=0x7fd1cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1cc053580 0x7fd1cc055a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd1e8019000 tx=0x7fd1e8014000).stop 2021-11-15T19:32:23.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 msgr2=0x7fd1ec145670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1ec145670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fd1e000d000 tx=0x7fd1e0007a00).stop 2021-11-15T19:32:23.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 shutdown_connections 2021-11-15T19:32:23.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1cc053580 0x7fd1cc055a40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1ec159560 0x7fd1ec142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1ec065400 0x7fd1ec063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 --2- 172.21.2.137:0/1238704821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1d4003ec0 0x7fd1ec145670 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 >> 172.21.2.137:0/1238704821 conn(0x7fd1ec0631e0 msgr2=0x7fd1ec14af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:23.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 shutdown_connections 2021-11-15T19:32:23.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.381+0000 7fd1f40c8700 1 -- 172.21.2.137:0/1238704821 wait complete. 2021-11-15T19:32:23.391 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-11-15T19:32:23.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.437+0000 7fd2a7a7b700 1 Processor -- start 2021-11-15T19:32:23.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.437+0000 7fd2a7a7b700 1 -- start start 2021-11-15T19:32:23.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2a00b1340 0x7fd2a0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0148190 con 0x7fd2a0143f00 2021-11-15T19:32:23.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a00b1720 con 0x7fd2a00a9f50 2021-11-15T19:32:23.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a0147e70 con 0x7fd2a00b1340 2021-11-15T19:32:23.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2a00b1340 0x7fd2a0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a6018700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd2a00a9f50 0x7fd2a00aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54296/0 (socket says 172.21.2.137:54296) 2021-11-15T19:32:23.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a6018700 1 -- 172.21.2.137:0/3612499133 learned_addr learned my addr 172.21.2.137:0/3612499133 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:23.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/3612499133 >> v1:172.21.2.137:6789/0 conn(0x7fd2a00a9f50 legacy=0x7fd2a00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/3612499133 >> v1:172.21.2.111:6789/0 conn(0x7fd2a0143f00 legacy=0x7fd2a0144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:23.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/3612499133 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00af800 con 0x7fd2a00b1340 2021-11-15T19:32:23.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- 172.21.2.137:0/3612499133 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00b1340 0x7fd2a0147980 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fd2a0062250 tx=0x7fd29c006df0).ready entity=mon.1 client_cookie=4547803c1d4b1301 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:23.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a4815700 1 -- 172.21.2.137:0/3612499133 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c00d5c0 con 0x7fd2a00b1340 2021-11-15T19:32:23.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a4815700 1 -- 172.21.2.137:0/3612499133 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c000e90 con 0x7fd2a00b1340 2021-11-15T19:32:23.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a4815700 1 -- 172.21.2.137:0/3612499133 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c00d910 con 0x7fd2a00b1340 2021-11-15T19:32:23.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/3612499133 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00b1340 msgr2=0x7fd2a0147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/3612499133 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00b1340 0x7fd2a0147980 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fd2a0062250 tx=0x7fd29c006df0).stop 2021-11-15T19:32:23.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/3612499133 shutdown_connections 2021-11-15T19:32:23.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/3612499133 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00b1340 0x7fd2a0147980 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:23.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/3612499133 >> 172.21.2.137:0/3612499133 conn(0x7fd2a00b4e60 msgr2=0x7fd2a00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:23.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/3612499133 shutdown_connections 2021-11-15T19:32:23.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/3612499133 wait complete. 2021-11-15T19:32:23.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 Processor -- start 2021-11-15T19:32:23.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- start start 2021-11-15T19:32:23.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 0x7fd2a0142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2a00b1340 0x7fd2a0145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2a0143f00 0x7fd2a009a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0141ac0 con 0x7fd2a00b1340 2021-11-15T19:32:23.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01473e0 con 0x7fd2a00a9f50 2021-11-15T19:32:23.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00ac350 con 0x7fd2a0143f00 2021-11-15T19:32:23.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 0x7fd2a0142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 0x7fd2a0142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35518/0 (socket says 172.21.2.137:35518) 2021-11-15T19:32:23.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/2212994657 learned_addr learned my addr 172.21.2.137:0/2212994657 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:23.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2a0143f00 msgr2=0x7fd2a009a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2a0143f00 0x7fd2a009a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:23.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2a00b1340 msgr2=0x7fd2a0145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:23.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2a00b1340 0x7fd2a0145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:23.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 -- 172.21.2.137:0/2212994657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c00b180 con 0x7fd2a00a9f50 2021-11-15T19:32:23.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a5817700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 0x7fd2a0142b70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fd2a0062250 tx=0x7fd29c012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:23.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c016070 con 0x7fd2a00a9f50 2021-11-15T19:32:23.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c002f70 con 0x7fd2a00a9f50 2021-11-15T19:32:23.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a0141410 con 0x7fd2a00a9f50 2021-11-15T19:32:23.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c013f00 con 0x7fd2a00a9f50 2021-11-15T19:32:23.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.441+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a01402e0 con 0x7fd2a00a9f50 2021-11-15T19:32:23.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a0147200 con 0x7fd2a00a9f50 2021-11-15T19:32:23.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd29c025030 con 0x7fd2a00a9f50 2021-11-15T19:32:23.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd292ffd700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2880536d0 0x7fd288055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:23.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd29c06c5b0 con 0x7fd2a00a9f50 2021-11-15T19:32:23.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd2a5016700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2880536d0 0x7fd288055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:23.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd2a5016700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2880536d0 0x7fd288055b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fd294002ef0 tx=0x7fd294006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:23.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.445+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd29c043a30 con 0x7fd2a00a9f50 2021-11-15T19:32:23.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:23.557+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fd2a0148190 con 0x7fd2a00a9f50 2021-11-15T19:32:24.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd292ffd700 1 -- 172.21.2.137:0/2212994657 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v227) v1 ==== 147+0+0 (secure 0 0 0) 0x7fd2a0148190 con 0x7fd2a00a9f50 2021-11-15T19:32:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2880536d0 msgr2=0x7fd288055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2880536d0 0x7fd288055b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fd294002ef0 tx=0x7fd294006910).stop 2021-11-15T19:32:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 msgr2=0x7fd2a0142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 0x7fd2a0142b70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fd2a0062250 tx=0x7fd29c012000).stop 2021-11-15T19:32:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 shutdown_connections 2021-11-15T19:32:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2880536d0 0x7fd288055b90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2a0143f00 0x7fd2a009a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:24.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2a00b1340 0x7fd2a0145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:24.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 --2- 172.21.2.137:0/2212994657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2a00a9f50 0x7fd2a0142b70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:24.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 >> 172.21.2.137:0/2212994657 conn(0x7fd2a00b4e60 msgr2=0x7fd2a00af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:24.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 shutdown_connections 2021-11-15T19:32:24.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.225+0000 7fd2a7a7b700 1 -- 172.21.2.137:0/2212994657 wait complete. 2021-11-15T19:32:24.235 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:24.237 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T19:32:24.237 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:32:24.238 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-11-15T19:32:24.240 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:24.243 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:24.247 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:24.250 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:24.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 Processor -- start 2021-11-15T19:32:24.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 -- start start 2021-11-15T19:32:24.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0b005fa70 0x7fc0b0147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc0b01469f0 0x7fc0b00aff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b005fe50 con 0x7fc0b01465b0 2021-11-15T19:32:24.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b0147fd0 con 0x7fc0b01469f0 2021-11-15T19:32:24.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b8219700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b00a9e80 con 0x7fc0b005fa70 2021-11-15T19:32:24.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b57b4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc0b01465b0 0x7fc0b00af820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54312/0 (socket says 172.21.2.137:54312) 2021-11-15T19:32:24.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.285+0000 7fc0b57b4700 1 -- 172.21.2.137:0/1107546551 learned_addr learned my addr 172.21.2.137:0/1107546551 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:24.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283987380 0 0) 0x7fc0b005fe50 con 0x7fc0b01465b0 2021-11-15T19:32:24.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc098003260 con 0x7fc0b01465b0 2021-11-15T19:32:24.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b5fb5700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0b005fa70 0x7fc0b0147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080207005 0 0) 0x7fc098003260 con 0x7fc0b01465b0 2021-11-15T19:32:24.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0b005fa70 msgr2=0x7fc0b0147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:24.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0b005fa70 0x7fc0b0147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:24.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 >> v2:172.21.2.111:3300/0 conn(0x7fc0b01469f0 msgr2=0x7fc0b00aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:24.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 --2- 172.21.2.137:0/1107546551 >> v2:172.21.2.111:3300/0 conn(0x7fc0b01469f0 0x7fc0b00aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:24.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00aa120 con 0x7fc0b01465b0 2021-11-15T19:32:24.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fc0ac001660 con 0x7fc0b01465b0 2021-11-15T19:32:24.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 >> v1:172.21.2.137:6789/0 conn(0x7fc0b01465b0 legacy=0x7fc0b00af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:24.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0980037d0 0x7fc098003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc098004500 0x7fc098004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc098004f90 0x7fc09800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0147fd0 con 0x7fc098004f90 2021-11-15T19:32:24.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b00a9e80 con 0x7fc098004500 2021-11-15T19:32:24.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09800bed0 con 0x7fc0980037d0 2021-11-15T19:32:24.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b5fb5700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0b005fa70 0x7fc0b0147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:24.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc098004500 0x7fc098004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc098004f90 0x7fc09800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 -- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0980037d0 msgr2=0x7fc098003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:24.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0980037d0 0x7fc098003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:24.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 -- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc098004f90 msgr2=0x7fc09800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:24.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc098004f90 0x7fc09800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:24.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 -- 172.21.2.137:0/1107546551 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00aa120 con 0x7fc098004500 2021-11-15T19:32:24.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc098004500 0x7fc098004980 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fc0ac001040 tx=0x7fc0ac00c3c0).ready entity=mon.1 client_cookie=d6e80cb5dd983b8a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:24.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ac0070d0 con 0x7fc098004500 2021-11-15T19:32:24.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac007230 con 0x7fc098004500 2021-11-15T19:32:24.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b4fb3700 1 -- 172.21.2.137:0/1107546551 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ac00c9b0 con 0x7fc098004500 2021-11-15T19:32:24.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- 172.21.2.137:0/1107546551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc098004500 msgr2=0x7fc098004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:24.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 --2- 172.21.2.137:0/1107546551 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc098004500 0x7fc098004980 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fc0ac001040 tx=0x7fc0ac00c3c0).stop 2021-11-15T19:32:24.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 -- 172.21.2.137:0/1107546551 reap_dead start 2021-11-15T19:32:24.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- 172.21.2.137:0/1107546551 shutdown_connections 2021-11-15T19:32:24.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- 172.21.2.137:0/1107546551 >> 172.21.2.137:0/1107546551 conn(0x7fc0b005bd20 msgr2=0x7fc0b005c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:24.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- 172.21.2.137:0/1107546551 shutdown_connections 2021-11-15T19:32:24.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- 172.21.2.137:0/1107546551 wait complete. 2021-11-15T19:32:24.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 Processor -- start 2021-11-15T19:32:24.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- start start 2021-11-15T19:32:24.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc098004500 0x7fc0b00af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0b00aede0 0x7fc0b0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 0x7fc0b01433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0142980 con 0x7fc0b00aede0 2021-11-15T19:32:24.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0144300 con 0x7fc0b01444b0 2021-11-15T19:32:24.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b8219700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0156520 con 0x7fc098004500 2021-11-15T19:32:24.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 0x7fc0b01433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 0x7fc0b01433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35542/0 (socket says 172.21.2.137:35542) 2021-11-15T19:32:24.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 -- 172.21.2.137:0/3680582753 learned_addr learned my addr 172.21.2.137:0/3680582753 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:24.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b57b4700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0b00aede0 0x7fc0b0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b5fb5700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc098004500 0x7fc0b00af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 -- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc098004500 msgr2=0x7fc0b00af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:24.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc098004500 0x7fc0b00af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:24.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 -- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0b00aede0 msgr2=0x7fc0b0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:24.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0b00aede0 0x7fc0b0156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:24.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.289+0000 7fc0b67b6700 1 -- 172.21.2.137:0/3680582753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b01567c0 con 0x7fc0b01444b0 2021-11-15T19:32:24.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0b67b6700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 0x7fc0b01433e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fc0a8000b60 tx=0x7fc0a8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:24.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a80106e0 con 0x7fc0b01444b0 2021-11-15T19:32:24.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8010840 con 0x7fc0b01444b0 2021-11-15T19:32:24.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0a8010ba0 con 0x7fc0b01444b0 2021-11-15T19:32:24.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b00afde0 con 0x7fc0b01444b0 2021-11-15T19:32:24.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b0157150 con 0x7fc0b01444b0 2021-11-15T19:32:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b0144c70 con 0x7fc0b01444b0 2021-11-15T19:32:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc0a801a030 con 0x7fc0b01444b0 2021-11-15T19:32:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0900536d0 0x7fc090055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc0a806b3e0 con 0x7fc0b01444b0 2021-11-15T19:32:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0b5fb5700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0900536d0 0x7fc090055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:24.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0b5fb5700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0900536d0 0x7fc090055b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fc0a400b000 tx=0x7fc0a4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:24.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.293+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0a8042820 con 0x7fc0b01444b0 2021-11-15T19:32:24.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:24.409+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fc0b0156370 con 0x7fc0b01444b0 2021-11-15T19:32:25.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0a2ffd700 1 -- 172.21.2.137:0/3680582753 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v228) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc0a8045e40 con 0x7fc0b01444b0 2021-11-15T19:32:25.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0900536d0 msgr2=0x7fc090055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0900536d0 0x7fc090055b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fc0a400b000 tx=0x7fc0a4008040).stop 2021-11-15T19:32:25.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 msgr2=0x7fc0b01433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 0x7fc0b01433e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fc0a8000b60 tx=0x7fc0a8008040).stop 2021-11-15T19:32:25.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 shutdown_connections 2021-11-15T19:32:25.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0900536d0 0x7fc090055b90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0b01444b0 0x7fc0b01433e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0b00aede0 0x7fc0b0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 --2- 172.21.2.137:0/3680582753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc098004500 0x7fc0b00af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 >> 172.21.2.137:0/3680582753 conn(0x7fc0b005bd20 msgr2=0x7fc0b01458e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:25.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 shutdown_connections 2021-11-15T19:32:25.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.229+0000 7fc0b8219700 1 -- 172.21.2.137:0/3680582753 wait complete. 2021-11-15T19:32:25.240 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:32:25.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 Processor -- start 2021-11-15T19:32:25.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- start start 2021-11-15T19:32:25.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f55b00b0fe0 0x7f55b00afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f55b013f5c0 0x7f55b013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b00aedf0 con 0x7f55b00acff0 2021-11-15T19:32:25.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00ad4a0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00ae070 con 0x7f55b013f5c0 2021-11-15T19:32:25.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f55b013f5c0 0x7f55b013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f55b013f5c0 0x7f55b013fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35550/0 (socket says 172.21.2.137:35550) 2021-11-15T19:32:25.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 -- 172.21.2.137:0/2073014229 learned_addr learned my addr 172.21.2.137:0/2073014229 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:25.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 -- 172.21.2.137:0/2073014229 >> v2:172.21.2.111:3300/0 conn(0x7f55b00b0fe0 msgr2=0x7f55b00afde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:25.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 --2- 172.21.2.137:0/2073014229 >> v2:172.21.2.111:3300/0 conn(0x7f55b00b0fe0 0x7f55b00afde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 -- 172.21.2.137:0/2073014229 >> v1:172.21.2.111:6789/0 conn(0x7f55b00acff0 legacy=0x7f55b00af4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:25.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 -- 172.21.2.137:0/2073014229 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00afbd0 con 0x7f55b013f5c0 2021-11-15T19:32:25.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b5ea0700 1 --2- 172.21.2.137:0/2073014229 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b013f5c0 0x7f55b013fa30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f55b00aec90 tx=0x7f55a800b530).ready entity=mon.1 client_cookie=aece6d1f29852875 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55a3fff700 1 -- 172.21.2.137:0/2073014229 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a800be70 con 0x7f55b013f5c0 2021-11-15T19:32:25.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55a3fff700 1 -- 172.21.2.137:0/2073014229 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8010470 con 0x7f55b013f5c0 2021-11-15T19:32:25.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55a3fff700 1 -- 172.21.2.137:0/2073014229 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a80107d0 con 0x7f55b013f5c0 2021-11-15T19:32:25.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- 172.21.2.137:0/2073014229 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b013f5c0 msgr2=0x7f55b013fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 --2- 172.21.2.137:0/2073014229 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b013f5c0 0x7f55b013fa30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f55b00aec90 tx=0x7f55a800b530).stop 2021-11-15T19:32:25.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- 172.21.2.137:0/2073014229 shutdown_connections 2021-11-15T19:32:25.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 --2- 172.21.2.137:0/2073014229 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b013f5c0 0x7f55b013fa30 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 --2- 172.21.2.137:0/2073014229 >> v2:172.21.2.111:3300/0 conn(0x7f55b00b0fe0 0x7f55b00afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- 172.21.2.137:0/2073014229 >> 172.21.2.137:0/2073014229 conn(0x7f55b00b5f50 msgr2=0x7f55b00b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:25.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- 172.21.2.137:0/2073014229 shutdown_connections 2021-11-15T19:32:25.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.289+0000 7f55b7903700 1 -- 172.21.2.137:0/2073014229 wait complete. 2021-11-15T19:32:25.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 Processor -- start 2021-11-15T19:32:25.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- start start 2021-11-15T19:32:25.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55b00acff0 0x7f55b0152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 0x7f55b0152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55b013f5c0 0x7f55b0113550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00669b0 con 0x7f55b00acff0 2021-11-15T19:32:25.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0065fd0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0066270 con 0x7f55b013f5c0 2021-11-15T19:32:25.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 0x7f55b0152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 0x7f55b0152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35558/0 (socket says 172.21.2.137:35558) 2021-11-15T19:32:25.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 -- 172.21.2.137:0/325595950 learned_addr learned my addr 172.21.2.137:0/325595950 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:25.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 -- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55b013f5c0 msgr2=0x7f55b0113550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55b013f5c0 0x7f55b0113550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 -- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55b00acff0 msgr2=0x7f55b0152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55b00acff0 0x7f55b0152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 -- 172.21.2.137:0/325595950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a800b7d0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b4e9e700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 0x7f55b0152840 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f55a4002fb0 tx=0x7f55a4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a4013460 con 0x7f55b00b0fe0 2021-11-15T19:32:25.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a40135c0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a4013920 con 0x7f55b00b0fe0 2021-11-15T19:32:25.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b0066510 con 0x7f55b00b0fe0 2021-11-15T19:32:25.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b0065ba0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b00666a0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f55a400f070 con 0x7f55b00b0fe0 2021-11-15T19:32:25.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55a27fc700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55900536f0 0x7f5590055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f55a406b1e0 con 0x7f55b00b0fe0 2021-11-15T19:32:25.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.293+0000 7f55b569f700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55900536f0 0x7f5590055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.297+0000 7f55b569f700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55900536f0 0x7f5590055bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f55ac002fb0 tx=0x7f55ac0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.297+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55a4042510 con 0x7f55b00b0fe0 2021-11-15T19:32:25.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.377+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f55b00ad690 con 0x7f55b00b0fe0 2021-11-15T19:32:25.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55a27fc700 1 -- 172.21.2.137:0/325595950 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55a4045b30 con 0x7f55b00b0fe0 2021-11-15T19:32:25.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55900536f0 msgr2=0x7f5590055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55900536f0 0x7f5590055bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f55ac002fb0 tx=0x7f55ac0069b0).stop 2021-11-15T19:32:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 msgr2=0x7f55b0152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 0x7f55b0152840 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f55a4002fb0 tx=0x7f55a4006df0).stop 2021-11-15T19:32:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 shutdown_connections 2021-11-15T19:32:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55900536f0 0x7f5590055bb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55b013f5c0 0x7f55b0113550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55b00b0fe0 0x7f55b0152840 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 --2- 172.21.2.137:0/325595950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55b00acff0 0x7f55b0152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.389+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 >> 172.21.2.137:0/325595950 conn(0x7f55b00b5f50 msgr2=0x7f55b00b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.393+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 shutdown_connections 2021-11-15T19:32:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.393+0000 7f55b7903700 1 -- 172.21.2.137:0/325595950 wait complete. 2021-11-15T19:32:25.401 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:32:25.401 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:25.409 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:25.423 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:25.435 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:25.448 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:32:25.457 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:32:25.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:25.458 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:25.459 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:25.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:25.494 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:32:25.494 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:32:25.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:25.495 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:25.495 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:25.502 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:32:25.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:25.503 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:32:25.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:25.504 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:25.504 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:32:25.513 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:32:25.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:32:25.515 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:32:25.516 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:32:25.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.621+0000 7fe5bdc93700 1 Processor -- start 2021-11-15T19:32:25.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5bdc93700 1 -- start start 2021-11-15T19:32:25.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5bdc93700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 0x7fe5b80aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5bdc93700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe5b813c780 0x7fe5b813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5bdc93700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80b1390 con 0x7fe5b80b0c50 2021-11-15T19:32:25.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5bdc93700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b813f840 con 0x7fe5b813c780 2021-11-15T19:32:25.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5bdc93700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80b1030 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b6ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 0x7fe5b80aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b7fff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe5b813c780 0x7fe5b813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b6ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 0x7fe5b80aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:37132/0 (socket says 172.21.2.137:37132) 2021-11-15T19:32:25.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b77fe700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fe5b80b0c50 0x7fe5b81401a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:46838/0 (socket says 172.21.2.137:46838) 2021-11-15T19:32:25.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b6ffd700 1 -- 172.21.2.137:0/2830522891 learned_addr learned my addr 172.21.2.137:0/2830522891 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:25.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b7fff700 1 -- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 msgr2=0x7fe5b80aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:25.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b7fff700 1 --2- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 0x7fe5b80aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b67fc700 1 -- 172.21.2.137:0/2830522891 <== mon.0 v1:172.21.2.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862034818 0 0) 0x7fe5b80b1390 con 0x7fe5b80b0c50 2021-11-15T19:32:25.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b7fff700 1 -- 172.21.2.137:0/2830522891 >> v1:172.21.2.111:6789/0 conn(0x7fe5b80b0c50 legacy=0x7fe5b81401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b7fff700 1 -- 172.21.2.137:0/2830522891 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b813fa60 con 0x7fe5b813c780 2021-11-15T19:32:25.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b6ffd700 1 --2- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 0x7fe5b80aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:32:25.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b7fff700 1 --2- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 0x7fe5b813cc30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe5b8140080 tx=0x7fe5a8006df0).ready entity=mon.0 client_cookie=ee044d9e80fa5199 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b67fc700 1 -- 172.21.2.137:0/2830522891 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5a800d570 con 0x7fe5b813c780 2021-11-15T19:32:25.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b67fc700 1 -- 172.21.2.137:0/2830522891 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8000e90 con 0x7fe5b813c780 2021-11-15T19:32:25.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.625+0000 7fe5b67fc700 1 -- 172.21.2.137:0/2830522891 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5a800d8c0 con 0x7fe5b813c780 2021-11-15T19:32:25.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 msgr2=0x7fe5b813cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 0x7fe5b813cc30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe5b8140080 tx=0x7fe5a8006df0).stop 2021-11-15T19:32:25.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2830522891 shutdown_connections 2021-11-15T19:32:25.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 0x7fe5b813cc30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2830522891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80aa4e0 0x7fe5b80aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2830522891 >> 172.21.2.137:0/2830522891 conn(0x7fe5b80b4e60 msgr2=0x7fe5b80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:25.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2830522891 shutdown_connections 2021-11-15T19:32:25.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2830522891 wait complete. 2021-11-15T19:32:25.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 Processor -- start 2021-11-15T19:32:25.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- start start 2021-11-15T19:32:25.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 0x7fe5b8141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80b0c50 0x7fe5b814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 0x7fe5b814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b813b620 con 0x7fe5b813c780 2021-11-15T19:32:25.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b814d8f0 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b813e920 con 0x7fe5b80b0c50 2021-11-15T19:32:25.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 0x7fe5b8141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 0x7fe5b8141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35572/0 (socket says 172.21.2.137:35572) 2021-11-15T19:32:25.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 -- 172.21.2.137:0/2077063473 learned_addr learned my addr 172.21.2.137:0/2077063473 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:25.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 -- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80b0c50 msgr2=0x7fe5b814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80b0c50 0x7fe5b814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 -- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 msgr2=0x7fe5b814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 0x7fe5b814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 -- 172.21.2.137:0/2077063473 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009530 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b77fe700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 0x7fe5b8141080 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fe5a0000ed0 tx=0x7fe5a0007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5a00072e0 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0005550 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5a00058b0 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a800b180 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b813aad0 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b813fd00 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe5a0010070 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b4ff9700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe59c053520 0x7fe59c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.629+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe5a006ae20 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.633+0000 7fe5b6ffd700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe59c053520 0x7fe59c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.633+0000 7fe5b6ffd700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe59c053520 0x7fe59c0559e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fe5b000c000 tx=0x7fe5b0009290).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.633+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5a0042260 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe5b80573d0 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5b4ff9700 1 -- 172.21.2.137:0/2077063473 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v66) v1 ==== 81+0+28826 (secure 0 0 0) 0x7fe5a0045880 con 0x7fe5b80aa4e0 2021-11-15T19:32:25.720 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:25.721 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:32:25.721 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 66, 2021-11-15T19:32:25.721 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:32:25.721 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:32:25.722 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:32:23.203165+0000", 2021-11-15T19:32:25.722 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:32:25.722 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:32:25.722 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:32:25.722 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:32:25.723 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:32:25.723 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:32:25.723 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:32:25.723 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:32:25.724 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:32:25.724 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:25.724 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:32:25.724 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:32:25.725 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:32:25.725 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:32:25.725 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:32:25.725 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 12, 2021-11-15T19:32:25.725 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:32:25.726 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:32:25.726 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:32:25.726 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:32:25.726 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:32:25.727 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.727 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:32:25.727 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:32:25.727 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:32:25.728 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:32:25.728 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:32:25.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:32:25.728 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:32:25.728 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:32:25.729 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:32:25.729 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:32:25.729 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:32:25.729 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:32:25.730 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:32:25.730 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:32:25.730 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:32:25.730 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:32:25.731 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:32:25.731 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:32:25.731 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:32:25.731 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:32:25.731 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:32:25.732 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:32:25.732 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:32:25.732 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.732 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:32:25.733 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:32:25.733 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:32:25.733 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:32:25.733 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:32:25.734 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:32:25.734 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:32:25.734 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:32:25.734 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:32:25.734 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:32:25.735 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:32:25.735 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:32:25.735 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:32:25.735 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:32:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:32:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:32:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:32:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:32:25.737 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:32:25.737 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:32:25.737 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:32:25.737 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:32:25.737 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:32:25.738 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:32:25.738 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:32:25.738 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:32:25.738 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:32:25.739 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.739 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:32:25.739 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:32:25.739 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:32:25.740 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:32:25.740 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:32:25.740 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:32:25.740 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:32:25.740 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:32:25.741 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:32:25.741 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:32:25.741 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:32:25.741 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:32:25.742 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:32:25.742 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.742 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:32:25.742 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:32:25.743 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.743 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.743 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.743 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:32:25.743 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:32:25.744 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:32:25.744 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:32:25.744 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:32:25.744 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:32:25.745 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:32:25.745 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:32:25.745 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:32:25.745 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:32:25.745 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:32:25.746 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:32:25.746 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:32:25.746 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:32:25.746 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:32:25.747 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:32:25.747 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:32:25.747 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:32:25.747 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:32:25.748 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:32:25.748 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:32:25.748 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:32:25.748 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:32:25.749 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.749 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:32:25.749 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:32:25.749 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:32:25.750 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:32:25.750 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:32:25.750 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:32:25.750 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:32:25.750 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:32:25.751 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:32:25.751 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:32:25.751 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:32:25.751 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:32:25.752 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:32:25.752 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:32:25.752 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:32:25.752 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:32:25.753 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:32:25.753 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:32:25.753 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:32:25.753 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:32:25.754 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:32:25.754 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:32:25.754 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:32:25.754 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:32:25.754 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:32:25.755 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:32:25.755 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:32:25.755 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.755 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:32:25.756 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:32:25.756 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:32:25.756 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:32:25.756 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:32:25.757 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:32:25.757 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:32:25.757 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:32:25.757 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:32:25.757 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:32:25.758 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:32:25.758 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:32:25.758 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:32:25.758 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:32:25.759 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.759 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.759 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:25.759 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:32:25.760 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.760 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:32:25.760 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:32:25.760 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.760 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.761 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.761 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.761 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.761 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.761 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.762 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:25.762 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.762 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.762 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.763 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.763 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.763 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.763 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:32:25.763 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.764 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.764 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.764 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.764 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:32:25.765 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.765 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.765 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.765 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.766 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.766 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.766 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.766 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.766 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:32:25.767 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.767 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.767 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.767 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.768 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:32:25.768 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.768 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.768 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.768 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.769 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.769 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.769 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.769 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.770 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:32:25.770 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.770 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.770 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.770 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.771 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:32:25.771 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.771 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.771 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.772 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.772 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.772 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.772 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.773 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.773 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:32:25.773 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.773 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.773 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.774 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.774 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:32:25.774 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:32:25.774 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.774 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.775 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.775 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:32:25.775 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:32:25.775 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:32:25.776 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:32:25.776 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.776 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.776 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.776 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.777 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.777 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.777 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:32:25.777 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:32:25.778 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.778 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.778 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.778 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.778 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.779 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.779 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.779 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:25.779 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.780 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.780 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.780 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.780 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.780 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:32:25.781 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.781 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.781 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.781 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.782 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:32:25.782 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.782 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.782 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.782 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.783 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.783 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.783 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.783 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.784 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:32:25.784 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.784 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.784 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.784 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.785 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:32:25.785 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.785 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.785 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.785 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.786 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.786 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.786 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.786 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.786 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:32:25.787 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.787 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.787 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.787 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.788 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:32:25.788 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.788 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.788 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.788 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.789 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.789 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.789 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.789 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.789 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:32:25.790 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.790 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.790 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.790 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:32:25.791 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:32:25.791 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.791 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.791 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.792 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:32:25.792 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:32:25.792 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:32:25.792 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:32:25.793 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.793 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.793 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.793 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.793 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.794 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.794 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:32:25.794 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:32:25.794 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.795 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.795 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.795 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.795 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.795 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.796 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.796 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 59, 2021-11-15T19:32:25.796 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.796 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.797 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.797 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.797 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:32:25.798 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.798 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.798 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.798 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.799 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:32:25.799 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.799 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.799 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.799 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.800 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.800 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.800 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:32:25.801 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.801 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.801 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.801 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.801 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:32:25.802 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.802 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.802 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.802 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.803 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.803 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.803 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.803 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.803 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:32:25.804 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.804 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.804 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.804 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.804 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:32:25.805 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.805 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.805 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.805 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.805 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.806 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.806 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.806 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.806 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:32:25.806 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.807 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.807 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.807 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.807 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:32:25.807 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:32:25.808 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.808 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.808 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.808 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:32:25.809 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:32:25.809 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:32:25.809 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:32:25.809 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.809 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.810 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.810 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.810 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.810 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.810 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:32:25.811 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:32:25.811 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.811 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.811 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.811 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.812 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.812 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.812 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.812 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 48, 2021-11-15T19:32:25.813 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.813 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.813 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.813 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.813 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.814 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.814 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:32:25.814 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.814 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.814 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.815 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.815 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:32:25.815 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.815 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.815 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.816 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.816 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.816 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.816 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.817 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:32:25.817 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.817 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.817 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.817 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.818 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:32:25.818 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.818 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.818 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.819 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.819 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.819 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.819 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.819 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.820 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:32:25.820 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.820 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.820 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.820 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.821 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:32:25.821 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.821 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.821 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.821 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.822 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.822 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.822 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.822 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.823 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:32:25.823 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.823 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.823 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.823 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.824 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:32:25.824 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:32:25.824 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.824 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.824 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.825 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:32:25.825 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:32:25.825 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:32:25.825 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:32:25.825 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.826 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.826 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.826 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.826 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.827 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.827 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:32:25.827 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:32:25.827 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.827 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.828 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.828 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.828 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.828 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.828 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.829 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:25.829 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.829 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.829 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.829 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.830 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.830 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.830 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:32:25.830 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.831 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.831 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.831 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.831 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:32:25.831 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.832 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.832 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.832 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.832 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.833 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.833 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.833 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.833 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:32:25.833 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.834 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.834 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.834 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.834 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:32:25.835 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.835 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.835 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.835 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.835 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.836 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.836 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.836 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.836 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:32:25.837 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.837 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.837 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.837 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.837 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:32:25.838 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.838 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.838 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.838 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.839 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.839 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.839 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.839 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.839 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:32:25.840 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.840 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.840 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.840 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.840 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:32:25.841 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:32:25.841 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.841 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.841 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.842 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:32:25.842 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:32:25.842 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:32:25.842 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:32:25.842 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.843 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.843 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.843 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.843 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.844 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.844 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:32:25.844 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:32:25.844 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.844 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.845 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.845 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.845 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.845 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.845 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.846 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 59, 2021-11-15T19:32:25.846 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.846 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.846 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.846 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.847 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.847 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.847 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:32:25.847 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.848 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.848 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.848 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.848 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:32:25.848 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.849 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.849 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.849 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.849 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.849 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.850 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.850 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.850 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:32:25.850 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.851 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.851 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.851 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.851 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:32:25.851 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.852 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.852 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.852 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.852 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.852 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.853 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.853 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.853 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:32:25.853 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.853 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.854 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.854 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.854 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:32:25.854 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.855 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.855 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.855 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.855 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.855 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.856 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.856 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.856 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:32:25.856 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.856 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.857 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.857 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.857 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:32:25.857 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:32:25.857 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.858 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.858 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:32:25.858 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:32:25.859 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:32:25.859 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:32:25.859 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.859 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.859 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.860 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.860 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.860 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.860 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:32:25.860 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:32:25.861 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.861 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.861 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.861 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.861 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.862 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.862 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.862 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:32:25.862 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.863 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.863 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.863 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.863 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.863 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.864 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:32:25.864 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.864 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.864 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.864 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.865 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:32:25.865 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.865 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.865 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.865 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.866 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.866 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.866 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.866 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.866 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:32:25.867 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.867 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.867 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.867 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.868 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:32:25.868 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.868 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.868 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.868 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.869 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.869 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.869 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:32:25.870 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.870 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.870 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.870 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.871 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:32:25.871 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.871 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.871 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.871 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.872 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.872 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.872 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.872 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.873 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:32:25.873 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.873 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.873 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.873 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.874 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:32:25.874 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:32:25.874 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.874 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.875 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.875 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:32:25.875 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:32:25.875 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:32:25.875 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:32:25.876 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.876 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.876 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.876 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.877 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.877 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.877 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:32:25.877 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:32:25.877 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:32:25.878 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:32:25.878 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:32:25.878 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:32:25.878 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:32:25.879 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:32:25.879 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:32:25.879 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 59, 2021-11-15T19:32:25.879 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:32:25.879 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:32:25.880 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:32:25.880 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.880 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.880 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.881 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:32:25.881 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.881 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.881 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.881 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.882 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:32:25.882 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.882 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.882 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.883 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.883 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:32:25.883 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.883 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.883 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.884 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:32:25.884 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.884 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.884 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.884 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.885 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:32:25.885 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.885 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.885 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.885 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.886 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:32:25.886 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.886 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.886 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.887 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:32:25.887 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.887 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.887 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.888 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.888 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:32:25.888 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.888 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.888 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.889 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.889 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:32:25.889 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:32:25.889 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.889 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:32:25.890 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:32:25.890 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.890 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.890 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.890 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:32:25.891 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:32:25.891 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:32:25.891 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.891 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.892 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.892 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:32:25.892 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:32:25.892 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:32:25.893 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:32:25.893 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:32:25.893 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:32:25.893 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:32:25.894 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:25.894 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.894 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:25.894 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:32:25.894 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.895 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:32:25.895 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.895 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.895 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.896 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.896 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.896 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:32:25.896 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.896 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.897 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.897 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:32:25.897 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.897 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.898 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.898 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.898 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.898 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:32:25.899 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.899 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.899 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.899 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:32:25.900 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.900 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.900 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.900 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.900 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.901 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:32:25.901 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.901 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.901 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.901 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:32:25.902 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.902 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.902 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.902 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.902 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.903 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:32:25.903 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.903 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.903 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.903 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:32:25.904 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.904 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.904 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.904 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.905 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.905 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:32:25.905 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.905 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.905 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.906 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:32:25.906 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.906 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.906 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.906 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.907 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.907 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:32:25.907 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.907 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.907 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.908 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:32:25.908 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.908 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.908 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.909 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.909 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.909 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:32:25.909 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.909 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.910 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:25.910 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:32:25.910 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:32:25.910 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:32:25.910 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:32:25.911 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:32:25.911 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:32:25.911 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:32:25.911 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:32:25.911 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.912 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:32:25.912 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:32:25.912 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:32:25.912 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:32:25.913 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:32:25.913 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:32:25.913 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/837201683": "2021-11-16T19:32:19.182472+0000", 2021-11-15T19:32:25.913 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/837201683": "2021-11-16T19:32:19.182472+0000" 2021-11-15T19:32:25.913 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.914 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:32:25.914 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:32:25.914 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:32:25.914 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:32:25.914 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:32:25.915 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:32:25.915 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:32:25.915 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:32:25.915 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:25.916 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:25.916 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:32:25.916 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:32:25.916 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:32:25.916 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:32:25.917 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:32:25.917 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:32:25.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe59c053520 msgr2=0x7fe59c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe59c053520 0x7fe59c0559e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fe5b000c000 tx=0x7fe5b0009290).stop 2021-11-15T19:32:25.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 msgr2=0x7fe5b8141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 0x7fe5b8141080 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fe5a0000ed0 tx=0x7fe5a0007ac0).stop 2021-11-15T19:32:25.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 shutdown_connections 2021-11-15T19:32:25.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe59c053520 0x7fe59c0559e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe5b813c780 0x7fe5b814e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5b80b0c50 0x7fe5b814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 --2- 172.21.2.137:0/2077063473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe5b80aa4e0 0x7fe5b8141080 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 >> 172.21.2.137:0/2077063473 conn(0x7fe5b80b4e60 msgr2=0x7fe5b80ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:25.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 shutdown_connections 2021-11-15T19:32:25.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.717+0000 7fe5bdc93700 1 -- 172.21.2.137:0/2077063473 wait complete. 2021-11-15T19:32:25.921 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:25.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2e505e700 1 Processor -- start 2021-11-15T19:32:25.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2e505e700 1 -- start start 2021-11-15T19:32:25.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2e505e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 0x7fd2e013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2e505e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e00b1720 con 0x7fd2e00af800 2021-11-15T19:32:25.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2e505e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e00abfe0 con 0x7fd2e0146160 2021-11-15T19:32:25.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2e505e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00aa230 con 0x7fd2e0066f40 2021-11-15T19:32:25.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2df59e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd2e0146160 0x7fd2e01465b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54358/0 (socket says 172.21.2.137:54358) 2021-11-15T19:32:25.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2df59e700 1 -- 172.21.2.137:0/1232244282 learned_addr learned my addr 172.21.2.137:0/1232244282 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:25.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965101874 0 0) 0x7fd2e00abfe0 con 0x7fd2e0146160 2021-11-15T19:32:25.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c4003260 con 0x7fd2e0146160 2021-11-15T19:32:25.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ded9d700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 0x7fd2e013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554449673 0 0) 0x7fd2c4003260 con 0x7fd2e0146160 2021-11-15T19:32:25.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 msgr2=0x7fd2e013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:25.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ddd9b700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 0x7fd2e013fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:25.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.977+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 >> v1:172.21.2.111:6789/0 conn(0x7fd2e00af800 legacy=0x7fd2e013ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:25.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e0060d50 con 0x7fd2e0146160 2021-11-15T19:32:25.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd2d80019e0 con 0x7fd2e0146160 2021-11-15T19:32:25.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 >> v1:172.21.2.137:6789/0 conn(0x7fd2e0146160 legacy=0x7fd2e01465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2c40037d0 0x7fd2c4003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 0x7fd2c4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2c4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00aa230 con 0x7fd2c40037d0 2021-11-15T19:32:25.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c400b9b0 con 0x7fd2c4004b40 2021-11-15T19:32:25.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c400bb70 con 0x7fd2e0066f40 2021-11-15T19:32:25.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2c4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 -- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 msgr2=0x7fd2c4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:25.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0066f40 0x7fd2c4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 -- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2c40037d0 msgr2=0x7fd2c4003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:25.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2c40037d0 0x7fd2c4003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 -- 172.21.2.137:0/1232244282 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4003260 con 0x7fd2c4004b40 2021-11-15T19:32:25.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2c4004fc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fd2e005cfa0 tx=0x7fd2e00675a0).ready entity=mon.1 client_cookie=d7345349fbc25ea0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d800cbe0 con 0x7fd2c4004b40 2021-11-15T19:32:25.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d800cd40 con 0x7fd2c4004b40 2021-11-15T19:32:25.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ddd9b700 1 -- 172.21.2.137:0/1232244282 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d8005b80 con 0x7fd2c4004b40 2021-11-15T19:32:25.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/1232244282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 msgr2=0x7fd2c4004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 --2- 172.21.2.137:0/1232244282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2c4004fc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fd2e005cfa0 tx=0x7fd2e00675a0).stop 2021-11-15T19:32:25.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2df59e700 1 -- 172.21.2.137:0/1232244282 reap_dead start 2021-11-15T19:32:25.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/1232244282 shutdown_connections 2021-11-15T19:32:25.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/1232244282 >> 172.21.2.137:0/1232244282 conn(0x7fd2e00b4e60 msgr2=0x7fd2e00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:25.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/1232244282 shutdown_connections 2021-11-15T19:32:25.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/1232244282 wait complete. 2021-11-15T19:32:25.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 Processor -- start 2021-11-15T19:32:25.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- start start 2021-11-15T19:32:25.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2e0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2e00ac5e0 0x7fd2e0148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0148d60 0x7fd2e0152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:25.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0141420 con 0x7fd2e00ac5e0 2021-11-15T19:32:25.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0155e10 con 0x7fd2c4004b40 2021-11-15T19:32:25.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e009a300 con 0x7fd2e0148d60 2021-11-15T19:32:25.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2e0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:25.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2e0156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35590/0 (socket says 172.21.2.137:35590) 2021-11-15T19:32:25.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 -- 172.21.2.137:0/4178081432 learned_addr learned my addr 172.21.2.137:0/4178081432 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:25.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 -- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0148d60 msgr2=0x7fd2e0152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0148d60 0x7fd2e0152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 -- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2e00ac5e0 msgr2=0x7fd2e0148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:25.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2e00ac5e0 0x7fd2e0148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:25.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 -- 172.21.2.137:0/4178081432 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00992c0 con 0x7fd2c4004b40 2021-11-15T19:32:25.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2ded9d700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2e0156060 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd2d0007000 tx=0x7fd2d0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d0010580 con 0x7fd2c4004b40 2021-11-15T19:32:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0000e90 con 0x7fd2c4004b40 2021-11-15T19:32:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d00106e0 con 0x7fd2c4004b40 2021-11-15T19:32:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e0151fa0 con 0x7fd2c4004b40 2021-11-15T19:32:25.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.981+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e00af150 con 0x7fd2c4004b40 2021-11-15T19:32:26.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e00aca00 con 0x7fd2c4004b40 2021-11-15T19:32:26.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2d0017020 con 0x7fd2c4004b40 2021-11-15T19:32:26.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2cffff700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2bc0536a0 0x7fd2bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd2d006a980 con 0x7fd2c4004b40 2021-11-15T19:32:26.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2de59c700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2bc0536a0 0x7fd2bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2de59c700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2bc0536a0 0x7fd2bc055b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fd2d4001fa0 tx=0x7fd2d40077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:25.985+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2d0041dc0 con 0x7fd2c4004b40 2021-11-15T19:32:26.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2e009a4c0 con 0x7fd2c4004b40 2021-11-15T19:32:26.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2cffff700 1 -- 172.21.2.137:0/4178081432 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fd2d0015030 con 0x7fd2c4004b40 2021-11-15T19:32:26.098 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:26.098 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/929226402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":929226402},{"type":"v1","addr":"172.21.2.137:6833","nonce":929226402}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[]} 2021-11-15T19:32:26.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2bc0536a0 msgr2=0x7fd2bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2bc0536a0 0x7fd2bc055b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fd2d4001fa0 tx=0x7fd2d40077f0).stop 2021-11-15T19:32:26.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 msgr2=0x7fd2e0156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2e0156060 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd2d0007000 tx=0x7fd2d0008040).stop 2021-11-15T19:32:26.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 shutdown_connections 2021-11-15T19:32:26.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2bc0536a0 0x7fd2bc055b60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2e0148d60 0x7fd2e0152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:26.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2e00ac5e0 0x7fd2e0148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:26.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.093+0000 7fd2e505e700 1 --2- 172.21.2.137:0/4178081432 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2c4004b40 0x7fd2e0156060 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.097+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 >> 172.21.2.137:0/4178081432 conn(0x7fd2e00b4e60 msgr2=0x7fd2e00b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:26.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.097+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 shutdown_connections 2021-11-15T19:32:26.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.097+0000 7fd2e505e700 1 -- 172.21.2.137:0/4178081432 wait complete. 2021-11-15T19:32:26.102 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 29 2021-11-15T19:32:26.105 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:26.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 Processor -- start 2021-11-15T19:32:26.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 -- start start 2021-11-15T19:32:26.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f84480b1340 0x7f8448147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8448143f00 0x7f8448144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8448148190 con 0x7f84480a9f50 2021-11-15T19:32:26.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84480b1720 con 0x7f84480b1340 2021-11-15T19:32:26.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844eba8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8448147e70 con 0x7f8448143f00 2021-11-15T19:32:26.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844c944700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f84480b1340 0x7f8448147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844c944700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f84480b1340 0x7f8448147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:42824/0 (socket says 172.21.2.137:42824) 2021-11-15T19:32:26.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844c944700 1 -- 172.21.2.137:0/2071615850 learned_addr learned my addr 172.21.2.137:0/2071615850 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:26.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f8447fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8448143f00 0x7f8448144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.153+0000 7f844d145700 1 --1- 172.21.2.137:0/2071615850 >> v1:172.21.2.111:6789/0 conn(0x7f84480a9f50 0x7f84480aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:46874/0 (socket says 172.21.2.137:46874) 2021-11-15T19:32:26.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8448143f00 msgr2=0x7f8448144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:26.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 --2- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8448143f00 0x7f8448144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2071615850 >> v1:172.21.2.111:6789/0 conn(0x7f84480a9f50 legacy=0x7f84480aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2071615850 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480af800 con 0x7f84480b1340 2021-11-15T19:32:26.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 --2- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84480b1340 0x7f8448147980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8430002f70 tx=0x7f8430006eb0).ready entity=mon.0 client_cookie=fccca1b3c9e9af7a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f84477fe700 1 -- 172.21.2.137:0/2071615850 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843000d570 con 0x7f84480b1340 2021-11-15T19:32:26.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f84477fe700 1 -- 172.21.2.137:0/2071615850 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430000e90 con 0x7f84480b1340 2021-11-15T19:32:26.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f84477fe700 1 -- 172.21.2.137:0/2071615850 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843000d900 con 0x7f84480b1340 2021-11-15T19:32:26.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84480b1340 msgr2=0x7f8448147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 --2- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84480b1340 0x7f8448147980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8430002f70 tx=0x7f8430006eb0).stop 2021-11-15T19:32:26.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- 172.21.2.137:0/2071615850 shutdown_connections 2021-11-15T19:32:26.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 --2- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8448143f00 0x7f8448144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 --2- 172.21.2.137:0/2071615850 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84480b1340 0x7f8448147980 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- 172.21.2.137:0/2071615850 >> 172.21.2.137:0/2071615850 conn(0x7f84480b4e60 msgr2=0x7f84480b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:26.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- 172.21.2.137:0/2071615850 shutdown_connections 2021-11-15T19:32:26.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- 172.21.2.137:0/2071615850 wait complete. 2021-11-15T19:32:26.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 Processor -- start 2021-11-15T19:32:26.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- start start 2021-11-15T19:32:26.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 0x7f8448149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84480b1340 0x7f84480983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8448143f00 0x7f8448098890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84480acd30 con 0x7f8448143f00 2021-11-15T19:32:26.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844814a8d0 con 0x7f84480a9f50 2021-11-15T19:32:26.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844eba8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844809aa60 con 0x7f84480b1340 2021-11-15T19:32:26.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 0x7f8448149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 0x7f8448149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35604/0 (socket says 172.21.2.137:35604) 2021-11-15T19:32:26.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2775358442 learned_addr learned my addr 172.21.2.137:0/2775358442 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:26.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84480b1340 msgr2=0x7f84480983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84480b1340 0x7f84480983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:26.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8448143f00 msgr2=0x7f8448098890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8448143f00 0x7f8448098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:26.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.157+0000 7f844c944700 1 -- 172.21.2.137:0/2775358442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843000b1e0 con 0x7f84480a9f50 2021-11-15T19:32:26.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f844c944700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 0x7f8448149fd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f8430002f70 tx=0x7f8430015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8430011950 con 0x7f84480a9f50 2021-11-15T19:32:26.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430011ab0 con 0x7f84480a9f50 2021-11-15T19:32:26.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8448098d80 con 0x7f84480a9f50 2021-11-15T19:32:26.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844809a240 con 0x7f84480a9f50 2021-11-15T19:32:26.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8430011e10 con 0x7f84480a9f50 2021-11-15T19:32:26.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8420003410 con 0x7f84480a9f50 2021-11-15T19:32:26.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8430025030 con 0x7f84480a9f50 2021-11-15T19:32:26.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8445ffb700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f842c0534f0 0x7f842c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f843006c5b0 con 0x7f84480a9f50 2021-11-15T19:32:26.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8447fff700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f842c0534f0 0x7f842c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.161+0000 7f8447fff700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f842c0534f0 0x7f842c0559b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f843800c000 tx=0x7f8438006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.165+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8430043aa0 con 0x7f84480a9f50 2021-11-15T19:32:26.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8420003c40 con 0x7f84480a9f50 2021-11-15T19:32:26.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f8445ffb700 1 -- 172.21.2.137:0/2775358442 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f8430023070 con 0x7f84480a9f50 2021-11-15T19:32:26.278 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:26.278 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4758,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/3117843964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3117843964},{"type":"v1","addr":"172.21.2.111:6835","nonce":3117843964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/929226402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":929226402},{"type":"v1","addr":"172.21.2.137:6833","nonce":929226402}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[]} 2021-11-15T19:32:26.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f842c0534f0 msgr2=0x7f842c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f842c0534f0 0x7f842c0559b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f843800c000 tx=0x7f8438006df0).stop 2021-11-15T19:32:26.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 msgr2=0x7f8448149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 0x7f8448149fd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f8430002f70 tx=0x7f8430015000).stop 2021-11-15T19:32:26.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 shutdown_connections 2021-11-15T19:32:26.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f842c0534f0 0x7f842c0559b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8448143f00 0x7f8448098890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:26.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84480b1340 0x7f84480983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:26.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 --2- 172.21.2.137:0/2775358442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84480a9f50 0x7f8448149fd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 >> 172.21.2.137:0/2775358442 conn(0x7f84480b4e60 msgr2=0x7f844813ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:26.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 shutdown_connections 2021-11-15T19:32:26.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.273+0000 7f844eba8700 1 -- 172.21.2.137:0/2775358442 wait complete. 2021-11-15T19:32:26.282 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 29 2021-11-15T19:32:26.285 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:32:26.286 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:32:26.286 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:32:26.286 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:32:26.287 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:32:26.287 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:32:26.287 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:32:26.288 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:32:26.291 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:32:26.292 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:32:26.297 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:32:26.297 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:32:26.299 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:32:26.299 DEBUG:teuthology.parallel:result is None 2021-11-15T19:32:26.336 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:32:26.336 DEBUG:teuthology.parallel:result is None 2021-11-15T19:32:26.337 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:32:26.338 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:32:26.371 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:32:26.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 Processor -- start 2021-11-15T19:32:26.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- start start 2021-11-15T19:32:26.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f954405c770 0x7f95440aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9544140aa0 0x7f9544140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954405cb50 con 0x7f95440b0550 2021-11-15T19:32:26.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440b1650 con 0x7f954405c770 2021-11-15T19:32:26.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440ad030 con 0x7f9544140aa0 2021-11-15T19:32:26.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f954405c770 0x7f95440aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f954405c770 0x7f95440aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35622/0 (socket says 172.21.2.137:35622) 2021-11-15T19:32:26.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 -- 172.21.2.137:0/2207563285 learned_addr learned my addr 172.21.2.137:0/2207563285 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:26.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f9549a8e700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9544140aa0 0x7f9544140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 -- 172.21.2.137:0/2207563285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9544140aa0 msgr2=0x7f9544140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:26.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9544140aa0 0x7f9544140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 -- 172.21.2.137:0/2207563285 >> v1:172.21.2.111:6789/0 conn(0x7f95440b0550 legacy=0x7f954414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 -- 172.21.2.137:0/2207563285 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440ad2d0 con 0x7f954405c770 2021-11-15T19:32:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f9549a8e700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9544140aa0 0x7f9544140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:32:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954928d700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f954405c770 0x7f95440aef30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f9540002f70 tx=0x7f9540006eb0).ready entity=mon.1 client_cookie=9cdeb8cf50f606ef server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f953bfff700 1 -- 172.21.2.137:0/2207563285 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f954000d5c0 con 0x7f954405c770 2021-11-15T19:32:26.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f953bfff700 1 -- 172.21.2.137:0/2207563285 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540000e90 con 0x7f954405c770 2021-11-15T19:32:26.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f953bfff700 1 -- 172.21.2.137:0/2207563285 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f954000d950 con 0x7f954405c770 2021-11-15T19:32:26.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- 172.21.2.137:0/2207563285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f954405c770 msgr2=0x7f95440aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f954405c770 0x7f95440aef30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f9540002f70 tx=0x7f9540006eb0).stop 2021-11-15T19:32:26.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- 172.21.2.137:0/2207563285 shutdown_connections 2021-11-15T19:32:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9544140aa0 0x7f9544140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- 172.21.2.137:0/2207563285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f954405c770 0x7f95440aef30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- 172.21.2.137:0/2207563285 >> 172.21.2.137:0/2207563285 conn(0x7f95440631e0 msgr2=0x7f954405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- 172.21.2.137:0/2207563285 shutdown_connections 2021-11-15T19:32:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- 172.21.2.137:0/2207563285 wait complete. 2021-11-15T19:32:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 Processor -- start 2021-11-15T19:32:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- start start 2021-11-15T19:32:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f954405c770 0x7f9544156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f95440b0550 0x7f9544144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 0x7f95441453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544066840 con 0x7f95440b0550 2021-11-15T19:32:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544064a60 con 0x7f9544140aa0 2021-11-15T19:32:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f954b4f1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9544064d00 con 0x7f954405c770 2021-11-15T19:32:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f9549a8e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 0x7f95441453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f9549a8e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 0x7f95441453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35632/0 (socket says 172.21.2.137:35632) 2021-11-15T19:32:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.389+0000 7f9549a8e700 1 -- 172.21.2.137:0/1395599065 learned_addr learned my addr 172.21.2.137:0/1395599065 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f954928d700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f954405c770 0x7f9544156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9549a8e700 1 -- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f954405c770 msgr2=0x7f9544156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9548a8c700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f95440b0550 0x7f9544144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9549a8e700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f954405c770 0x7f9544156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9549a8e700 1 -- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f95440b0550 msgr2=0x7f9544144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9549a8e700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f95440b0550 0x7f9544144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9549a8e700 1 -- 172.21.2.137:0/1395599065 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954000b1e0 con 0x7f9544140aa0 2021-11-15T19:32:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9548a8c700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f95440b0550 0x7f9544144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f9549a8e700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 0x7f95441453e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f953c006cc0 tx=0x7f953c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c011780 con 0x7f9544140aa0 2021-11-15T19:32:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c0118e0 con 0x7f9544140aa0 2021-11-15T19:32:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9544142a10 con 0x7f9544140aa0 2021-11-15T19:32:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c011c40 con 0x7f9544140aa0 2021-11-15T19:32:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9544142e90 con 0x7f9544140aa0 2021-11-15T19:32:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9544064ec0 con 0x7f9544140aa0 2021-11-15T19:32:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f953c012420 con 0x7f9544140aa0 2021-11-15T19:32:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f953a7fc700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f952c053610 0x7f952c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f953c06b880 con 0x7f9544140aa0 2021-11-15T19:32:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f954928d700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f952c053610 0x7f952c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.393+0000 7f954928d700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f952c053610 0x7f952c055ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f9540017000 tx=0x7f9540015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.397+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f953c042c60 con 0x7f9544140aa0 2021-11-15T19:32:26.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:26.489+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f95440ae7f0 con 0x7f9544140aa0 2021-11-15T19:32:27.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f953a7fc700 1 -- 172.21.2.137:0/1395599065 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f953c046280 con 0x7f9544140aa0 2021-11-15T19:32:27.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f952c053610 msgr2=0x7f952c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f952c053610 0x7f952c055ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f9540017000 tx=0x7f9540015000).stop 2021-11-15T19:32:27.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 msgr2=0x7f95441453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 0x7f95441453e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f953c006cc0 tx=0x7f953c008040).stop 2021-11-15T19:32:27.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 shutdown_connections 2021-11-15T19:32:27.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f952c053610 0x7f952c055ad0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9544140aa0 0x7f95441453e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f95440b0550 0x7f9544144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 --2- 172.21.2.137:0/1395599065 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f954405c770 0x7f9544156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 >> 172.21.2.137:0/1395599065 conn(0x7f95440631e0 msgr2=0x7f954413ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 shutdown_connections 2021-11-15T19:32:27.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.417+0000 7f954b4f1700 1 -- 172.21.2.137:0/1395599065 wait complete. 2021-11-15T19:32:27.425 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:32:27.428 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:32:27.429 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:32:27.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 Processor -- start 2021-11-15T19:32:27.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 -- start start 2021-11-15T19:32:27.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe6f80b1340 0x7fe6f8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f8148190 con 0x7fe6f8143f00 2021-11-15T19:32:27.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f80b1720 con 0x7fe6f80b1340 2021-11-15T19:32:27.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fe9c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8147e70 con 0x7fe6f80a9f50 2021-11-15T19:32:27.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6f7fff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe6f80b1340 0x7fe6f8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6fcf65700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6f77fe700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fe6f8143f00 0x7fe6f8144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:46912/0 (socket says 172.21.2.137:46912) 2021-11-15T19:32:27.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.485+0000 7fe6f77fe700 1 -- 172.21.2.137:0/3720811225 learned_addr learned my addr 172.21.2.137:0/3720811225 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:27.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/3720811225 >> v2:172.21.2.111:3300/0 conn(0x7fe6f80b1340 msgr2=0x7fe6f8147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- 172.21.2.137:0/3720811225 >> v2:172.21.2.111:3300/0 conn(0x7fe6f80b1340 0x7fe6f8147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/3720811225 >> v1:172.21.2.111:6789/0 conn(0x7fe6f8143f00 legacy=0x7fe6f8144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/3720811225 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80af800 con 0x7fe6f80a9f50 2021-11-15T19:32:27.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- 172.21.2.137:0/3720811225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aa3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe6f00032f0 tx=0x7fe6f00091d0).ready entity=mon.2 client_cookie=8c07fb760ffe6d4a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6f6ffd700 1 -- 172.21.2.137:0/3720811225 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f000b6c0 con 0x7fe6f80a9f50 2021-11-15T19:32:27.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6f6ffd700 1 -- 172.21.2.137:0/3720811225 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000b820 con 0x7fe6f80a9f50 2021-11-15T19:32:27.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6f6ffd700 1 -- 172.21.2.137:0/3720811225 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f000b990 con 0x7fe6f80a9f50 2021-11-15T19:32:27.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/3720811225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 msgr2=0x7fe6f80aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/3720811225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aa3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe6f00032f0 tx=0x7fe6f00091d0).stop 2021-11-15T19:32:27.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/3720811225 shutdown_connections 2021-11-15T19:32:27.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/3720811225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aa3a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/3720811225 >> v2:172.21.2.111:3300/0 conn(0x7fe6f80b1340 0x7fe6f8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/3720811225 >> 172.21.2.137:0/3720811225 conn(0x7fe6f80b4e60 msgr2=0x7fe6f80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/3720811225 shutdown_connections 2021-11-15T19:32:27.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/3720811225 wait complete. 2021-11-15T19:32:27.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 Processor -- start 2021-11-15T19:32:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- start start 2021-11-15T19:32:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe6f80b1340 0x7fe6f8159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 0x7fe6f815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8159ae0 con 0x7fe6f80b1340 2021-11-15T19:32:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80b2f30 con 0x7fe6f8143f00 2021-11-15T19:32:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fe9c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80b31d0 con 0x7fe6f80a9f50 2021-11-15T19:32:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 0x7fe6f815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 0x7fe6f815a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35648/0 (socket says 172.21.2.137:35648) 2021-11-15T19:32:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/914307070 learned_addr learned my addr 172.21.2.137:0/914307070 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6f7fff700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6f77fe700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe6f80b1340 0x7fe6f8159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 msgr2=0x7fe6f80aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe6f80b1340 msgr2=0x7fe6f8159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe6f80b1340 0x7fe6f8159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 -- 172.21.2.137:0/914307070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009470 con 0x7fe6f8143f00 2021-11-15T19:32:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6fcf65700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 0x7fe6f815a390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fe6f00032f0 tx=0x7fe6f0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.489+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f000b6c0 con 0x7fe6f8143f00 2021-11-15T19:32:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f80b3470 con 0x7fe6f8143f00 2021-11-15T19:32:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f815a880 con 0x7fe6f8143f00 2021-11-15T19:32:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f00107a0 con 0x7fe6f8143f00 2021-11-15T19:32:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f0010b00 con 0x7fe6f8143f00 2021-11-15T19:32:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d0003410 con 0x7fe6f8143f00 2021-11-15T19:32:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe6f0027020 con 0x7fe6f8143f00 2021-11-15T19:32:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f57fa700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe6dc0534f0 0x7fe6dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe6f006ca60 con 0x7fe6f8143f00 2021-11-15T19:32:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f7fff700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe6dc0534f0 0x7fe6dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f7fff700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe6dc0534f0 0x7fe6dc0559b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fe6e800b000 tx=0x7fe6e8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.493+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6f0043de0 con 0x7fe6f8143f00 2021-11-15T19:32:27.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe6d00036c0 con 0x7fe6f8143f00 2021-11-15T19:32:27.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6f57fa700 1 -- 172.21.2.137:0/914307070 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fe6f0015090 con 0x7fe6f8143f00 2021-11-15T19:32:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:27.609 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:32:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:32:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:32:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:32:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:32:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:32:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:32:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:32:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:32:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:32:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:32:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:32:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:32:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:32:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:32:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:32:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:32:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:32:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:32:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:32:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:32:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:32:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:32:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:32:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:32:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:32:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:32:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:32:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:32:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:32:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:32:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:32:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:32:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:32:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:32:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:32:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:32:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:32:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:32:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:32:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:32:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:32:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:32:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:32:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:32:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:32:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:32:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:32:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:32:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:32:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:32:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:32:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:32:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:32:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:32:27.643 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:32:27.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe6dc0534f0 msgr2=0x7fe6dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe6dc0534f0 0x7fe6dc0559b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fe6e800b000 tx=0x7fe6e8008040).stop 2021-11-15T19:32:27.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 msgr2=0x7fe6f815a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 0x7fe6f815a390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fe6f00032f0 tx=0x7fe6f0016000).stop 2021-11-15T19:32:27.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 shutdown_connections 2021-11-15T19:32:27.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe6dc0534f0 0x7fe6dc0559b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe6f8143f00 0x7fe6f815a390 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe6f80b1340 0x7fe6f8159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 --2- 172.21.2.137:0/914307070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe6f80a9f50 0x7fe6f80aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 >> 172.21.2.137:0/914307070 conn(0x7fe6f80b4e60 msgr2=0x7fe6f8144e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 shutdown_connections 2021-11-15T19:32:27.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.605+0000 7fe6fe9c8700 1 -- 172.21.2.137:0/914307070 wait complete. 2021-11-15T19:32:27.647 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:32:27.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38bdf80700 1 Processor -- start 2021-11-15T19:32:27.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38bdf80700 1 -- start start 2021-11-15T19:32:27.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38bdf80700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f38b8147980 0x7f38b80aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38bdf80700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b8148190 con 0x7f38b8144610 2021-11-15T19:32:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38bdf80700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b80b1720 con 0x7f38b80b1340 2021-11-15T19:32:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38bdf80700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80af800 con 0x7f38b8147980 2021-11-15T19:32:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38b77fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f38b80b1340 0x7f38b8143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54434/0 (socket says 172.21.2.137:54434) 2021-11-15T19:32:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38b77fe700 1 -- 172.21.2.137:0/1058968225 learned_addr learned my addr 172.21.2.137:0/1058968225 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154338358 0 0) 0x7f38b80b1720 con 0x7f38b80b1340 2021-11-15T19:32:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.693+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3898003260 con 0x7f38b80b1340 2021-11-15T19:32:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137737215 0 0) 0x7f3898003260 con 0x7f38b80b1340 2021-11-15T19:32:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 >> v2:172.21.2.111:3300/0 conn(0x7f38b8147980 msgr2=0x7f38b80aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 --2- 172.21.2.137:0/1058968225 >> v2:172.21.2.111:3300/0 conn(0x7f38b8147980 0x7f38b80aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 >> v1:172.21.2.111:6789/0 conn(0x7f38b8144610 legacy=0x7f38b80a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b805faf0 con 0x7f38b80b1340 2021-11-15T19:32:27.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f38a8001660 con 0x7f38b80b1340 2021-11-15T19:32:27.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 >> v1:172.21.2.137:6789/0 conn(0x7f38b80b1340 legacy=0x7f38b8143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3898003820 0x7f3898003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3898004500 0x7f3898004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898005050 0x7f389800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80af800 con 0x7f3898005050 2021-11-15T19:32:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389800bfe0 con 0x7f3898004500 2021-11-15T19:32:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389800c1a0 con 0x7f3898003820 2021-11-15T19:32:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3898004500 0x7f3898004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b7fff700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898005050 0x7f389800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b77fe700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3898003820 0x7f3898003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3898003820 msgr2=0x7f3898003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3898003820 0x7f3898003c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898005050 msgr2=0x7f389800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898005050 0x7f389800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/1058968225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898003260 con 0x7f3898004500 2021-11-15T19:32:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b7fff700 1 -- 172.21.2.137:0/1058968225 reap_dead start 2021-11-15T19:32:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3898004500 0x7f3898004980 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f38a0000f70 tx=0x7f38a00079e0).ready entity=mon.1 client_cookie=b87cf4104505c8b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a0007cf0 con 0x7f3898004500 2021-11-15T19:32:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0014410 con 0x7f3898004500 2021-11-15T19:32:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b67fc700 1 -- 172.21.2.137:0/1058968225 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a0014770 con 0x7f3898004500 2021-11-15T19:32:27.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- 172.21.2.137:0/1058968225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3898004500 msgr2=0x7f3898004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3898004500 0x7f3898004980 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f38a0000f70 tx=0x7f38a00079e0).stop 2021-11-15T19:32:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- 172.21.2.137:0/1058968225 shutdown_connections 2021-11-15T19:32:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 --2- 172.21.2.137:0/1058968225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3898004500 0x7f3898004980 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- 172.21.2.137:0/1058968225 >> 172.21.2.137:0/1058968225 conn(0x7f38b80b4e60 msgr2=0x7f38b80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- 172.21.2.137:0/1058968225 shutdown_connections 2021-11-15T19:32:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- 172.21.2.137:0/1058968225 wait complete. 2021-11-15T19:32:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 Processor -- start 2021-11-15T19:32:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- start start 2021-11-15T19:32:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898004500 0x7f38b80b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 0x7f38b8134850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38b8149e80 0x7f38b8134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814ad80 con 0x7f3898004500 2021-11-15T19:32:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814b020 con 0x7f38b80acc70 2021-11-15T19:32:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38bdf80700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814b2c0 con 0x7f38b8149e80 2021-11-15T19:32:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 0x7f38b8134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 0x7f38b8134850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35666/0 (socket says 172.21.2.137:35666) 2021-11-15T19:32:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/2752595383 learned_addr learned my addr 172.21.2.137:0/2752595383 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38b8149e80 msgr2=0x7f38b8134d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38b8149e80 0x7f38b8134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898004500 msgr2=0x7f38b80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898004500 0x7f38b80b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.697+0000 7f38b6ffd700 1 -- 172.21.2.137:0/2752595383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8135230 con 0x7f38b80acc70 2021-11-15T19:32:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b6ffd700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 0x7f38b8134850 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f38a0000f70 tx=0x7f38a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a00138c0 con 0x7f38b80acc70 2021-11-15T19:32:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0013a20 con 0x7f38b80acc70 2021-11-15T19:32:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a0013d80 con 0x7f38b80acc70 2021-11-15T19:32:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b80ae270 con 0x7f38b80acc70 2021-11-15T19:32:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b8159c40 con 0x7f38b80acc70 2021-11-15T19:32:27.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b814aba0 con 0x7f38b80acc70 2021-11-15T19:32:27.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38a0022470 con 0x7f38b80acc70 2021-11-15T19:32:27.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b4ff9700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f389c0536f0 0x7f389c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f38a001c040 con 0x7f38b80acc70 2021-11-15T19:32:27.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b77fe700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f389c0536f0 0x7f389c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.701+0000 7f38b77fe700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f389c0536f0 0x7f389c055bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f38a8008000 tx=0x7f38a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.705+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38a00440c0 con 0x7f38b80acc70 2021-11-15T19:32:27.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.785+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38b80573d0 con 0x7f38b80acc70 2021-11-15T19:32:27.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.785+0000 7f38b4ff9700 1 -- 172.21.2.137:0/2752595383 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f38a0047660 con 0x7f38b80acc70 2021-11-15T19:32:27.790 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:27.790 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":69,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:32:27.411384+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:32:27.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.785+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f389c0536f0 msgr2=0x7f389c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.785+0000 7f38bdf80700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f389c0536f0 0x7f389c055bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f38a8008000 tx=0x7f38a8009040).stop 2021-11-15T19:32:27.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 msgr2=0x7f38b8134850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 0x7f38b8134850 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f38a0000f70 tx=0x7f38a0015000).stop 2021-11-15T19:32:27.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 shutdown_connections 2021-11-15T19:32:27.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f389c0536f0 0x7f389c055bb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38b8149e80 0x7f38b8134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38b80acc70 0x7f38b8134850 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 --2- 172.21.2.137:0/2752595383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3898004500 0x7f38b80b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 >> 172.21.2.137:0/2752595383 conn(0x7f38b80b4e60 msgr2=0x7f38b8145690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 shutdown_connections 2021-11-15T19:32:27.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.789+0000 7f38bdf80700 1 -- 172.21.2.137:0/2752595383 wait complete. 2021-11-15T19:32:27.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:32:27.798 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:32:27.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.845+0000 7f5c4e270700 1 Processor -- start 2021-11-15T19:32:27.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.845+0000 7f5c4e270700 1 -- start start 2021-11-15T19:32:27.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5c480b72e0 0x7f5c480b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5c480ad320 0x7f5c481290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c480b76c0 con 0x7f5c480acd60 2021-11-15T19:32:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480b3100 con 0x7f5c480b72e0 2021-11-15T19:32:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4812a170 con 0x7f5c480ad320 2021-11-15T19:32:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5c480ad320 0x7f5c481290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5c480ad320 0x7f5c481290c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35676/0 (socket says 172.21.2.137:35676) 2021-11-15T19:32:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 -- 172.21.2.137:0/1170989520 learned_addr learned my addr 172.21.2.137:0/1170989520 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 -- 172.21.2.137:0/1170989520 >> v2:172.21.2.111:3300/0 conn(0x7f5c480b72e0 msgr2=0x7f5c480b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 --2- 172.21.2.137:0/1170989520 >> v2:172.21.2.111:3300/0 conn(0x7f5c480b72e0 0x7f5c480b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 -- 172.21.2.137:0/1170989520 >> v1:172.21.2.111:6789/0 conn(0x7f5c480acd60 legacy=0x7f5c480b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 -- 172.21.2.137:0/1170989520 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480ad8a0 con 0x7f5c480ad320 2021-11-15T19:32:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4c80d700 1 --2- 172.21.2.137:0/1170989520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c481290c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f5c48065c40 tx=0x7f5c40009290).ready entity=mon.1 client_cookie=78d32796fa4d7ad4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c46ffd700 1 -- 172.21.2.137:0/1170989520 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c4000b830 con 0x7f5c480ad320 2021-11-15T19:32:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c46ffd700 1 -- 172.21.2.137:0/1170989520 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000b990 con 0x7f5c480ad320 2021-11-15T19:32:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c46ffd700 1 -- 172.21.2.137:0/1170989520 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c4000bb40 con 0x7f5c480ad320 2021-11-15T19:32:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- 172.21.2.137:0/1170989520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 msgr2=0x7f5c481290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- 172.21.2.137:0/1170989520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c481290c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f5c48065c40 tx=0x7f5c40009290).stop 2021-11-15T19:32:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- 172.21.2.137:0/1170989520 shutdown_connections 2021-11-15T19:32:27.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- 172.21.2.137:0/1170989520 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c481290c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- 172.21.2.137:0/1170989520 >> v2:172.21.2.111:3300/0 conn(0x7f5c480b72e0 0x7f5c480b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- 172.21.2.137:0/1170989520 >> 172.21.2.137:0/1170989520 conn(0x7f5c48064960 msgr2=0x7f5c48064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- 172.21.2.137:0/1170989520 shutdown_connections 2021-11-15T19:32:27.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- 172.21.2.137:0/1170989520 wait complete. 2021-11-15T19:32:27.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 Processor -- start 2021-11-15T19:32:27.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- start start 2021-11-15T19:32:27.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5c480acd60 0x7f5c481287f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c480b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5c480b72e0 0x7f5c48155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480b52b0 con 0x7f5c480b72e0 2021-11-15T19:32:27.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480b5550 con 0x7f5c480ad320 2021-11-15T19:32:27.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c4e270700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480b57f0 con 0x7f5c480acd60 2021-11-15T19:32:27.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c477fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c480b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c477fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c480b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35680/0 (socket says 172.21.2.137:35680) 2021-11-15T19:32:27.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.849+0000 7f5c477fe700 1 -- 172.21.2.137:0/3846147478 learned_addr learned my addr 172.21.2.137:0/3846147478 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:27.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c477fe700 1 -- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5c480acd60 msgr2=0x7f5c481287f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c477fe700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5c480acd60 0x7f5c481287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c477fe700 1 -- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5c480b72e0 msgr2=0x7f5c48155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c477fe700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5c480b72e0 0x7f5c48155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c477fe700 1 -- 172.21.2.137:0/3846147478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40009530 con 0x7f5c480ad320 2021-11-15T19:32:27.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c477fe700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c480b10f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f5c30002f90 tx=0x7f5c30006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c30013460 con 0x7f5c480ad320 2021-11-15T19:32:27.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300135c0 con 0x7f5c480ad320 2021-11-15T19:32:27.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c30013920 con 0x7f5c480ad320 2021-11-15T19:32:27.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c480b02b0 con 0x7f5c480ad320 2021-11-15T19:32:27.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c48155870 con 0x7f5c480ad320 2021-11-15T19:32:27.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c480b59b0 con 0x7f5c480ad320 2021-11-15T19:32:27.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c3000f070 con 0x7f5c480ad320 2021-11-15T19:32:27.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c457fa700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5c2c0534f0 0x7f5c2c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:27.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f5c3006aec0 con 0x7f5c480ad320 2021-11-15T19:32:27.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c47fff700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5c2c0534f0 0x7f5c2c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:27.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.853+0000 7f5c47fff700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5c2c0534f0 0x7f5c2c0559b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f5c38002f70 tx=0x7f5c380069f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:27.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.857+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c30042350 con 0x7f5c480ad320 2021-11-15T19:32:27.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5c480b3a50 con 0x7f5c480ad320 2021-11-15T19:32:27.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c457fa700 1 -- 172.21.2.137:0/3846147478 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v69) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5c30045970 con 0x7f5c480ad320 2021-11-15T19:32:27.941 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:32:27.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5c2c0534f0 msgr2=0x7f5c2c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5c2c0534f0 0x7f5c2c0559b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f5c38002f70 tx=0x7f5c380069f0).stop 2021-11-15T19:32:27.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 msgr2=0x7f5c480b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:27.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c480b10f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f5c30002f90 tx=0x7f5c30006df0).stop 2021-11-15T19:32:27.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 shutdown_connections 2021-11-15T19:32:27.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5c2c0534f0 0x7f5c2c0559b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5c480b72e0 0x7f5c48155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5c480ad320 0x7f5c480b10f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:27.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 --2- 172.21.2.137:0/3846147478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5c480acd60 0x7f5c481287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:27.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 >> 172.21.2.137:0/3846147478 conn(0x7f5c48064960 msgr2=0x7f5c48122cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:27.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 shutdown_connections 2021-11-15T19:32:27.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.937+0000 7f5c4e270700 1 -- 172.21.2.137:0/3846147478 wait complete. 2021-11-15T19:32:27.948 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:32:28.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 Processor -- start 2021-11-15T19:32:28.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- start start 2021-11-15T19:32:28.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7feb1405c770 0x7feb140aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1405cb50 con 0x7feb14140aa0 2021-11-15T19:32:28.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140ad030 con 0x7feb140b0550 2021-11-15T19:32:28.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140b1650 con 0x7feb1405c770 2021-11-15T19:32:28.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb18fbb700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7feb140b0550 0x7feb1414a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54470/0 (socket says 172.21.2.137:54470) 2021-11-15T19:32:28.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb18fbb700 1 -- 172.21.2.137:0/3913808320 learned_addr learned my addr 172.21.2.137:0/3913808320 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:28.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb197bc700 1 --2- 172.21.2.137:0/3913808320 >> v2:172.21.2.137:3300/0 conn(0x7feb1405c770 0x7feb140aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb197bc700 1 -- 172.21.2.137:0/3913808320 >> v1:172.21.2.137:6789/0 conn(0x7feb140b0550 legacy=0x7feb1414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb03fff700 1 -- 172.21.2.137:0/3913808320 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411763721 0 0) 0x7feb140ad030 con 0x7feb140b0550 2021-11-15T19:32:28.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb197bc700 1 -- 172.21.2.137:0/3913808320 >> v1:172.21.2.111:6789/0 conn(0x7feb14140aa0 legacy=0x7feb14140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb197bc700 1 -- 172.21.2.137:0/3913808320 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140ad2d0 con 0x7feb1405c770 2021-11-15T19:32:28.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb197bc700 1 --2- 172.21.2.137:0/3913808320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb140aef30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7feb140aee10 tx=0x7feb10006df0).ready entity=mon.1 client_cookie=ef3e4db709cae370 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb03fff700 1 -- 172.21.2.137:0/3913808320 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb1000d5c0 con 0x7feb1405c770 2021-11-15T19:32:28.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb03fff700 1 -- 172.21.2.137:0/3913808320 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10000e90 con 0x7feb1405c770 2021-11-15T19:32:28.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb03fff700 1 -- 172.21.2.137:0/3913808320 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb1000d910 con 0x7feb1405c770 2021-11-15T19:32:28.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- 172.21.2.137:0/3913808320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 msgr2=0x7feb140aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3913808320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb140aef30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7feb140aee10 tx=0x7feb10006df0).stop 2021-11-15T19:32:28.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- 172.21.2.137:0/3913808320 shutdown_connections 2021-11-15T19:32:28.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3913808320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb140aef30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- 172.21.2.137:0/3913808320 >> 172.21.2.137:0/3913808320 conn(0x7feb140631e0 msgr2=0x7feb1405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:28.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- 172.21.2.137:0/3913808320 shutdown_connections 2021-11-15T19:32:28.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:27.997+0000 7feb1ba20700 1 -- 172.21.2.137:0/3913808320 wait complete. 2021-11-15T19:32:28.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 Processor -- start 2021-11-15T19:32:28.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- start start 2021-11-15T19:32:28.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb14064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feb140b0550 0x7feb1414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feb14140aa0 0x7feb14065c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14067080 con 0x7feb140b0550 2021-11-15T19:32:28.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14064ad0 con 0x7feb1405c770 2021-11-15T19:32:28.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb141564c0 con 0x7feb14140aa0 2021-11-15T19:32:28.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb14064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb14064130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35692/0 (socket says 172.21.2.137:35692) 2021-11-15T19:32:28.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 -- 172.21.2.137:0/3336151407 learned_addr learned my addr 172.21.2.137:0/3336151407 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:28.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 -- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feb14140aa0 msgr2=0x7feb14065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feb14140aa0 0x7feb14065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 -- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feb140b0550 msgr2=0x7feb1414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feb140b0550 0x7feb1414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 -- 172.21.2.137:0/3336151407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1000b180 con 0x7feb1405c770 2021-11-15T19:32:28.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb197bc700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb14064130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7feb14142130 tx=0x7feb10012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb10002f50 con 0x7feb1405c770 2021-11-15T19:32:28.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10013d10 con 0x7feb1405c770 2021-11-15T19:32:28.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140646f0 con 0x7feb1405c770 2021-11-15T19:32:28.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb1001f640 con 0x7feb1405c770 2021-11-15T19:32:28.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb14064d00 con 0x7feb1405c770 2021-11-15T19:32:28.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb140ae7f0 con 0x7feb1405c770 2021-11-15T19:32:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb1001c070 con 0x7feb1405c770 2021-11-15T19:32:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb027fc700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feaf40536f0 0x7feaf4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5249+0+0 (secure 0 0 0) 0x7feb1006c420 con 0x7feb1405c770 2021-11-15T19:32:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.001+0000 7feb18fbb700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feaf40536f0 0x7feaf4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.005+0000 7feb18fbb700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feaf40536f0 0x7feaf4055bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7feb04000ed0 tx=0x7feb040076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.005+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb100438b0 con 0x7feb1405c770 2021-11-15T19:32:28.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb140573d0 con 0x7feb1405c770 2021-11-15T19:32:28.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb027fc700 1 -- 172.21.2.137:0/3336151407 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb10046ed0 con 0x7feb1405c770 2021-11-15T19:32:28.092 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:28.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feaf40536f0 msgr2=0x7feaf4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feaf40536f0 0x7feaf4055bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7feb04000ed0 tx=0x7feb040076c0).stop 2021-11-15T19:32:28.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 msgr2=0x7feb14064130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb14064130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7feb14142130 tx=0x7feb10012000).stop 2021-11-15T19:32:28.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 shutdown_connections 2021-11-15T19:32:28.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7feaf40536f0 0x7feaf4055bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feb14140aa0 0x7feb14065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feb140b0550 0x7feb1414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 --2- 172.21.2.137:0/3336151407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feb1405c770 0x7feb14064130 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 >> 172.21.2.137:0/3336151407 conn(0x7feb140631e0 msgr2=0x7feb140b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:28.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 shutdown_connections 2021-11-15T19:32:28.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.089+0000 7feb1ba20700 1 -- 172.21.2.137:0/3336151407 wait complete. 2021-11-15T19:32:28.099 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:32:28.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 Processor -- start 2021-11-15T19:32:28.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- start start 2021-11-15T19:32:28.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 0x7f789c098a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f789c1473c0 0x7f789c147850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c098f70 con 0x7f789c0b1060 2021-11-15T19:32:28.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c0aa0a0 con 0x7f789c1473c0 2021-11-15T19:32:28.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0aa340 con 0x7f789c0aa850 2021-11-15T19:32:28.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789a59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f789c0b1060 0x7f789c098370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54482/0 (socket says 172.21.2.137:54482) 2021-11-15T19:32:28.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789a59c700 1 -- 172.21.2.137:0/1002185526 learned_addr learned my addr 172.21.2.137:0/1002185526 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:28.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 --2- 172.21.2.137:0/1002185526 >> v2:172.21.2.111:3300/0 conn(0x7f789c1473c0 0x7f789c147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633330592 0 0) 0x7f789c098f70 con 0x7f789c0b1060 2021-11-15T19:32:28.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c003260 con 0x7f789c0b1060 2021-11-15T19:32:28.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f7899d9b700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 0x7f789c098a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820827949 0 0) 0x7f787c003260 con 0x7f789c0b1060 2021-11-15T19:32:28.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 msgr2=0x7f789c098a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 0x7f789c098a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 >> v2:172.21.2.111:3300/0 conn(0x7f789c1473c0 msgr2=0x7f789c147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 --2- 172.21.2.137:0/1002185526 >> v2:172.21.2.111:3300/0 conn(0x7f789c1473c0 0x7f789c147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c0aa5e0 con 0x7f789c0b1060 2021-11-15T19:32:28.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f788c001660 con 0x7f789c0b1060 2021-11-15T19:32:28.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 >> v1:172.21.2.137:6789/0 conn(0x7f789c0b1060 legacy=0x7f789c098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 0x7f787c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f787c003e00 0x7f787c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f787c0049f0 0x7f787c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0aa0a0 con 0x7f787c003e00 2021-11-15T19:32:28.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0aa340 con 0x7f787c0049f0 2021-11-15T19:32:28.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c00b8e0 con 0x7f789c0aa850 2021-11-15T19:32:28.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f787c0049f0 0x7f787c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f7899d9b700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f787c003e00 0x7f787c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789a59c700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 0x7f787c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 -- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 msgr2=0x7f787c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0aa850 0x7f787c0037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 -- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f787c003e00 msgr2=0x7f787c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f787c003e00 0x7f787c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 -- 172.21.2.137:0/1002185526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c003260 con 0x7f787c0049f0 2021-11-15T19:32:28.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f787c0049f0 0x7f787c004e70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f789400a000 tx=0x7f7894008040).ready entity=mon.1 client_cookie=7492c658cdf0ef7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f789400c070 con 0x7f787c0049f0 2021-11-15T19:32:28.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789400e5f0 con 0x7f787c0049f0 2021-11-15T19:32:28.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789959a700 1 -- 172.21.2.137:0/1002185526 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f789400e950 con 0x7f787c0049f0 2021-11-15T19:32:28.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- 172.21.2.137:0/1002185526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f787c0049f0 msgr2=0x7f787c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 --2- 172.21.2.137:0/1002185526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f787c0049f0 0x7f787c004e70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f789400a000 tx=0x7f7894008040).stop 2021-11-15T19:32:28.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789ad9d700 1 -- 172.21.2.137:0/1002185526 reap_dead start 2021-11-15T19:32:28.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- 172.21.2.137:0/1002185526 shutdown_connections 2021-11-15T19:32:28.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- 172.21.2.137:0/1002185526 >> 172.21.2.137:0/1002185526 conn(0x7f789c0b22b0 msgr2=0x7f789c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:28.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- 172.21.2.137:0/1002185526 shutdown_connections 2021-11-15T19:32:28.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- 172.21.2.137:0/1002185526 wait complete. 2021-11-15T19:32:28.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 Processor -- start 2021-11-15T19:32:28.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.149+0000 7f789b59e700 1 -- start start 2021-11-15T19:32:28.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 0x7f789c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0638a0 0x7f789c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f789c062de0 0x7f789c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c065f80 con 0x7f789c062de0 2021-11-15T19:32:28.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0626a0 con 0x7f789c0ae330 2021-11-15T19:32:28.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c062940 con 0x7f789c0638a0 2021-11-15T19:32:28.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 0x7f789c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 0x7f789c0ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35714/0 (socket says 172.21.2.137:35714) 2021-11-15T19:32:28.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 -- 172.21.2.137:0/3723327154 learned_addr learned my addr 172.21.2.137:0/3723327154 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:28.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 -- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0638a0 msgr2=0x7f789c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0638a0 0x7f789c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 -- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f789c062de0 msgr2=0x7f789c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f789c062de0 0x7f789c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 -- 172.21.2.137:0/3723327154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c065c00 con 0x7f789c0ae330 2021-11-15T19:32:28.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789a59c700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 0x7f789c0ae710 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f788c008000 tx=0x7f788c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f788c007170 con 0x7f789c0ae330 2021-11-15T19:32:28.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c0072d0 con 0x7f789c0ae330 2021-11-15T19:32:28.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c0977b0 con 0x7f789c0ae330 2021-11-15T19:32:28.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f788c0049e0 con 0x7f789c0ae330 2021-11-15T19:32:28.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c156cf0 con 0x7f789c0ae330 2021-11-15T19:32:28.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c062b00 con 0x7f789c0ae330 2021-11-15T19:32:28.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f788c004b40 con 0x7f789c0ae330 2021-11-15T19:32:28.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f78937fe700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78800536f0 0x7f7880055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f788c06b9d0 con 0x7f789c0ae330 2021-11-15T19:32:28.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f7899d9b700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78800536f0 0x7f7880055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.153+0000 7f7899d9b700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78800536f0 0x7f7880055bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f788400c000 tx=0x7f7884008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.157+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f788c042e60 con 0x7f789c0ae330 2021-11-15T19:32:28.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.237+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f789c0a9d20 con 0x7f789c0ae330 2021-11-15T19:32:28.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f78937fe700 1 -- 172.21.2.137:0/3723327154 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+143 (secure 0 0 0) 0x7f788c046480 con 0x7f789c0ae330 2021-11-15T19:32:28.244 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:28.244 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:32:28.244 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:28.244 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:32:28.245 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:32:28.245 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:32:28.245 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:32:28.245 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:32:28.245 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:32:28.246 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:32:28.246 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:32:28.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78800536f0 msgr2=0x7f7880055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78800536f0 0x7f7880055bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f788400c000 tx=0x7f7884008040).stop 2021-11-15T19:32:28.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 msgr2=0x7f789c0ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 0x7f789c0ae710 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f788c008000 tx=0x7f788c009040).stop 2021-11-15T19:32:28.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 shutdown_connections 2021-11-15T19:32:28.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78800536f0 0x7f7880055bb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f789c062de0 0x7f789c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f789c0638a0 0x7f789c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 --2- 172.21.2.137:0/3723327154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f789c0ae330 0x7f789c0ae710 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 >> 172.21.2.137:0/3723327154 conn(0x7f789c0b22b0 msgr2=0x7f789c0b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:28.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 shutdown_connections 2021-11-15T19:32:28.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.241+0000 7f789b59e700 1 -- 172.21.2.137:0/3723327154 wait complete. 2021-11-15T19:32:28.251 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:32:28.252 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:32:28.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 Processor -- start 2021-11-15T19:32:28.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- start start 2021-11-15T19:32:28.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f866805c770 0x7f86680aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f86680b0550 0x7f866814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866805cb50 con 0x7f866814aaa0 2021-11-15T19:32:28.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680b1650 con 0x7f86680b0550 2021-11-15T19:32:28.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680ad030 con 0x7f866805c770 2021-11-15T19:32:28.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86677fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f866814aaa0 0x7f8668140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54502/0 (socket says 172.21.2.137:54502) 2021-11-15T19:32:28.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86677fe700 1 -- 172.21.2.137:0/328690430 learned_addr learned my addr 172.21.2.137:0/328690430 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:28.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388394945 0 0) 0x7f866805cb50 con 0x7f866814aaa0 2021-11-15T19:32:28.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8648003260 con 0x7f866814aaa0 2021-11-15T19:32:28.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8666ffd700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f866805c770 0x7f86680aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 --2- 172.21.2.137:0/328690430 >> v2:172.21.2.111:3300/0 conn(0x7f86680b0550 0x7f866814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3385699622 0 0) 0x7f8648003260 con 0x7f866814aaa0 2021-11-15T19:32:28.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f866805c770 msgr2=0x7f86680aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f866805c770 0x7f86680aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 >> v2:172.21.2.111:3300/0 conn(0x7f86680b0550 msgr2=0x7f866814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 --2- 172.21.2.137:0/328690430 >> v2:172.21.2.111:3300/0 conn(0x7f86680b0550 0x7f866814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680ad2d0 con 0x7f866814aaa0 2021-11-15T19:32:28.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f86600019e0 con 0x7f866814aaa0 2021-11-15T19:32:28.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 >> v1:172.21.2.137:6789/0 conn(0x7f866814aaa0 legacy=0x7f8668140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8648003750 0x7f8648003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8648004500 0x7f8648004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8648004f90 0x7f864800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680b1650 con 0x7f8648003750 2021-11-15T19:32:28.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680ad030 con 0x7f8648004500 2021-11-15T19:32:28.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864800be50 con 0x7f8648004f90 2021-11-15T19:32:28.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 --2- 172.21.2.137:0/328690430 >> v2:172.21.2.111:3300/0 conn(0x7f86680b0550 0x7f866814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:28.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8666ffd700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f866805c770 0x7f86680aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:28.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8648004500 0x7f8648004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86677fe700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8648004f90 0x7f864800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 -- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8648004f90 msgr2=0x7f864800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8648004f90 0x7f864800b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 -- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8648003750 msgr2=0x7f8648003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:28.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8666ffd700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8648003750 0x7f8648003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8648003750 0x7f8648003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:28.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 -- 172.21.2.137:0/328690430 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8648003260 con 0x7f8648004500 2021-11-15T19:32:28.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8666ffd700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8648003750 0x7f8648003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:28.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86667fc700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8648004500 0x7f8648004980 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f8658007000 tx=0x7f8658008040).ready entity=mon.1 client_cookie=95373163603c95dd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8658015070 con 0x7f8648004500 2021-11-15T19:32:28.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8658011410 con 0x7f8648004500 2021-11-15T19:32:28.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f8665ffb700 1 -- 172.21.2.137:0/328690430 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8658011770 con 0x7f8648004500 2021-11-15T19:32:28.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- 172.21.2.137:0/328690430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8648004500 msgr2=0x7f8648004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:28.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 --2- 172.21.2.137:0/328690430 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8648004500 0x7f8648004980 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f8658007000 tx=0x7f8658008040).stop 2021-11-15T19:32:28.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f86677fe700 1 -- 172.21.2.137:0/328690430 reap_dead start 2021-11-15T19:32:28.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- 172.21.2.137:0/328690430 shutdown_connections 2021-11-15T19:32:28.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- 172.21.2.137:0/328690430 >> 172.21.2.137:0/328690430 conn(0x7f86680631e0 msgr2=0x7f866805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:28.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- 172.21.2.137:0/328690430 shutdown_connections 2021-11-15T19:32:28.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.301+0000 7f866d3fe700 1 -- 172.21.2.137:0/328690430 wait complete. 2021-11-15T19:32:28.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 Processor -- start 2021-11-15T19:32:28.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- start start 2021-11-15T19:32:28.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 0x7f8668066630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8668067260 0x7f8668118430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86680676e0 0x7f8668118920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668118fc0 con 0x7f86680676e0 2021-11-15T19:32:28.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668116c70 con 0x7f8668066e80 2021-11-15T19:32:28.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86681191f0 con 0x7f8668067260 2021-11-15T19:32:28.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 0x7f8668066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 0x7f8668066630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35732/0 (socket says 172.21.2.137:35732) 2021-11-15T19:32:28.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 -- 172.21.2.137:0/1088706989 learned_addr learned my addr 172.21.2.137:0/1088706989 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:28.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 -- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8668067260 msgr2=0x7f8668118430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:28.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8668067260 0x7f8668118430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 -- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86680676e0 msgr2=0x7f8668118920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:28.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86680676e0 0x7f8668118920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:28.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 -- 172.21.2.137:0/1088706989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668116f10 con 0x7f8668066e80 2021-11-15T19:32:28.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f8666ffd700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 0x7f8668066630 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f8650008000 tx=0x7f8650008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8650010550 con 0x7f8668066e80 2021-11-15T19:32:28.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650000e90 con 0x7f8668066e80 2021-11-15T19:32:28.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8668067b50 con 0x7f8668066e80 2021-11-15T19:32:28.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8668156480 con 0x7f8668066e80 2021-11-15T19:32:28.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86500106b0 con 0x7f8668066e80 2021-11-15T19:32:28.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8650018020 con 0x7f8668066e80 2021-11-15T19:32:28.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668118e10 con 0x7f8668066e80 2021-11-15T19:32:28.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f865ffff700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f864c0536f0 0x7f864c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:28.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f865006ae00 con 0x7f8668066e80 2021-11-15T19:32:28.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.305+0000 7f86667fc700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f864c0536f0 0x7f864c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:28.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.309+0000 7f86667fc700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f864c0536f0 0x7f864c055bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f8658007000 tx=0x7f8658008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:28.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.309+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8650042180 con 0x7f8668066e80 2021-11-15T19:32:28.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:28.393+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f86680ae7f0 con 0x7f8668066e80 2021-11-15T19:32:29.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f865ffff700 1 -- 172.21.2.137:0/1088706989 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v70) v1 ==== 133+0+0 (secure 0 0 0) 0x7f86500210a0 con 0x7f8668066e80 2021-11-15T19:32:29.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f864c0536f0 msgr2=0x7f864c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:29.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f864c0536f0 0x7f864c055bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f8658007000 tx=0x7f8658008040).stop 2021-11-15T19:32:29.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 msgr2=0x7f8668066630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:29.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 0x7f8668066630 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f8650008000 tx=0x7f8650008040).stop 2021-11-15T19:32:29.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 shutdown_connections 2021-11-15T19:32:29.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f864c0536f0 0x7f864c055bb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:29.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86680676e0 0x7f8668118920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8668067260 0x7f8668118430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 --2- 172.21.2.137:0/1088706989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8668066e80 0x7f8668066630 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:29.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 >> 172.21.2.137:0/1088706989 conn(0x7f86680631e0 msgr2=0x7f86681484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:29.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 shutdown_connections 2021-11-15T19:32:29.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.257+0000 7f866d3fe700 1 -- 172.21.2.137:0/1088706989 wait complete. 2021-11-15T19:32:29.265 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:32:29.268 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:32:29.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 Processor -- start 2021-11-15T19:32:29.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- start start 2021-11-15T19:32:29.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d0405c770 0x7f6d040aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d040b0550 0x7f6d0414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6d0414aaa0 0x7f6d04140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040b1650 con 0x7f6d0414aaa0 2021-11-15T19:32:29.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0405cb50 con 0x7f6d0405c770 2021-11-15T19:32:29.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040ad030 con 0x7f6d040b0550 2021-11-15T19:32:29.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d0405c770 0x7f6d040aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:29.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d0405c770 0x7f6d040aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35740/0 (socket says 172.21.2.137:35740) 2021-11-15T19:32:29.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 -- 172.21.2.137:0/3739640166 learned_addr learned my addr 172.21.2.137:0/3739640166 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:29.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 -- 172.21.2.137:0/3739640166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d040b0550 msgr2=0x7f6d0414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:29.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 --2- 172.21.2.137:0/3739640166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d040b0550 0x7f6d0414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 -- 172.21.2.137:0/3739640166 >> v2:172.21.2.111:3300/0 conn(0x7f6d0414aaa0 msgr2=0x7f6d04140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:29.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 --2- 172.21.2.137:0/3739640166 >> v2:172.21.2.111:3300/0 conn(0x7f6d0414aaa0 0x7f6d04140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 -- 172.21.2.137:0/3739640166 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040ad2d0 con 0x7f6d0405c770 2021-11-15T19:32:29.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d09788700 1 --2- 172.21.2.137:0/3739640166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d040aef30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f6d00002f70 tx=0x7f6d00006eb0).ready entity=mon.1 client_cookie=59340224e622efcb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:29.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6cf7fff700 1 -- 172.21.2.137:0/3739640166 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d0000d570 con 0x7f6d0405c770 2021-11-15T19:32:29.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6cf7fff700 1 -- 172.21.2.137:0/3739640166 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00000e90 con 0x7f6d0405c770 2021-11-15T19:32:29.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6cf7fff700 1 -- 172.21.2.137:0/3739640166 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d0000d900 con 0x7f6d0405c770 2021-11-15T19:32:29.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/3739640166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 msgr2=0x7f6d040aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:29.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/3739640166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d040aef30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f6d00002f70 tx=0x7f6d00006eb0).stop 2021-11-15T19:32:29.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/3739640166 shutdown_connections 2021-11-15T19:32:29.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/3739640166 >> v2:172.21.2.111:3300/0 conn(0x7f6d0414aaa0 0x7f6d04140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/3739640166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d040b0550 0x7f6d0414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/3739640166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d040aef30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:29.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/3739640166 >> 172.21.2.137:0/3739640166 conn(0x7f6d040631e0 msgr2=0x7f6d0405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:29.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/3739640166 shutdown_connections 2021-11-15T19:32:29.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.317+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/3739640166 wait complete. 2021-11-15T19:32:29.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 Processor -- start 2021-11-15T19:32:29.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- start start 2021-11-15T19:32:29.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d04064af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d040b0550 0x7f6d04159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d0414aaa0 0x7f6d0415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040645c0 con 0x7f6d040b0550 2021-11-15T19:32:29.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04064fe0 con 0x7f6d0405c770 2021-11-15T19:32:29.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04065220 con 0x7f6d0414aaa0 2021-11-15T19:32:29.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d04064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:29.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d04064af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35748/0 (socket says 172.21.2.137:35748) 2021-11-15T19:32:29.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 -- 172.21.2.137:0/2603306377 learned_addr learned my addr 172.21.2.137:0/2603306377 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:29.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 -- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d0414aaa0 msgr2=0x7f6d0415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:29.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d0414aaa0 0x7f6d0415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 -- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d040b0550 msgr2=0x7f6d04159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:29.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d040b0550 0x7f6d04159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:29.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 -- 172.21.2.137:0/2603306377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0000b1e0 con 0x7f6d0405c770 2021-11-15T19:32:29.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d09788700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d04064af0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f6d040654f0 tx=0x7f6d00015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:29.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d00011950 con 0x7f6d0405c770 2021-11-15T19:32:29.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00011ab0 con 0x7f6d0405c770 2021-11-15T19:32:29.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d04063760 con 0x7f6d0405c770 2021-11-15T19:32:29.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d00011e10 con 0x7f6d0405c770 2021-11-15T19:32:29.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d04067540 con 0x7f6d0405c770 2021-11-15T19:32:29.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d040ae7f0 con 0x7f6d0405c770 2021-11-15T19:32:29.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d00025030 con 0x7f6d0405c770 2021-11-15T19:32:29.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6cf67fc700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ce40536a0 0x7f6ce4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:29.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f6d0006cb40 con 0x7f6d0405c770 2021-11-15T19:32:29.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.321+0000 7f6d08f87700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ce40536a0 0x7f6ce4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:29.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.325+0000 7f6d08f87700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ce40536a0 0x7f6ce4055b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f6cf8002f70 tx=0x7f6cf80069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:29.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.325+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d00043e70 con 0x7f6d0405c770 2021-11-15T19:32:29.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:29.409+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6d041449d0 con 0x7f6d0405c770 2021-11-15T19:32:30.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.269+0000 7f6cf67fc700 1 -- 172.21.2.137:0/2603306377 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v71) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6d00023020 con 0x7f6d0405c770 2021-11-15T19:32:30.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.269+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ce40536a0 msgr2=0x7f6ce4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.269+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ce40536a0 0x7f6ce4055b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f6cf8002f70 tx=0x7f6cf80069e0).stop 2021-11-15T19:32:30.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.269+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 msgr2=0x7f6d04064af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d04064af0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f6d040654f0 tx=0x7f6d00015000).stop 2021-11-15T19:32:30.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 shutdown_connections 2021-11-15T19:32:30.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ce40536a0 0x7f6ce4055b60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d0414aaa0 0x7f6d0415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d040b0550 0x7f6d04159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 --2- 172.21.2.137:0/2603306377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0405c770 0x7f6d04064af0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 >> 172.21.2.137:0/2603306377 conn(0x7f6d040631e0 msgr2=0x7f6d0405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 shutdown_connections 2021-11-15T19:32:30.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.273+0000 7f6d0b9ec700 1 -- 172.21.2.137:0/2603306377 wait complete. 2021-11-15T19:32:30.279 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:32:30.282 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:32:30.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 Processor -- start 2021-11-15T19:32:30.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- start start 2021-11-15T19:32:30.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f18380aaa80 0x7f18380af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838147f70 con 0x7f183805fd20 2021-11-15T19:32:30.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838060100 con 0x7f18380b0830 2021-11-15T19:32:30.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1838147cd0 con 0x7f18380aaa80 2021-11-15T19:32:30.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f1837fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f18380b0830 0x7f18380aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54540/0 (socket says 172.21.2.137:54540) 2021-11-15T19:32:30.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183d2ec700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f18380aaa80 0x7f18380af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f1837fff700 1 -- 172.21.2.137:0/1392059892 learned_addr learned my addr 172.21.2.137:0/1392059892 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:30.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183d2ec700 1 -- 172.21.2.137:0/1392059892 >> v1:172.21.2.137:6789/0 conn(0x7f18380b0830 legacy=0x7f18380aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183d2ec700 1 -- 172.21.2.137:0/1392059892 >> v1:172.21.2.111:6789/0 conn(0x7f183805fd20 legacy=0x7f18380b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183d2ec700 1 -- 172.21.2.137:0/1392059892 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380a9ed0 con 0x7f18380aaa80 2021-11-15T19:32:30.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183d2ec700 1 --2- 172.21.2.137:0/1392059892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18380aaa80 0x7f18380af800 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f18380b4db0 tx=0x7f18300091d0).ready entity=mon.1 client_cookie=9d61a7c8f718c814 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f18377fe700 1 -- 172.21.2.137:0/1392059892 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1830009ea0 con 0x7f18380aaa80 2021-11-15T19:32:30.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f18377fe700 1 -- 172.21.2.137:0/1392059892 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000b860 con 0x7f18380aaa80 2021-11-15T19:32:30.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f18377fe700 1 -- 172.21.2.137:0/1392059892 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183000b9d0 con 0x7f18380aaa80 2021-11-15T19:32:30.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- 172.21.2.137:0/1392059892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18380aaa80 msgr2=0x7f18380af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 --2- 172.21.2.137:0/1392059892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18380aaa80 0x7f18380af800 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f18380b4db0 tx=0x7f18300091d0).stop 2021-11-15T19:32:30.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- 172.21.2.137:0/1392059892 shutdown_connections 2021-11-15T19:32:30.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 --2- 172.21.2.137:0/1392059892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f18380aaa80 0x7f18380af800 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- 172.21.2.137:0/1392059892 >> 172.21.2.137:0/1392059892 conn(0x7f18380b4e60 msgr2=0x7f18380b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- 172.21.2.137:0/1392059892 shutdown_connections 2021-11-15T19:32:30.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.333+0000 7f183ed4f700 1 -- 172.21.2.137:0/1392059892 wait complete. 2021-11-15T19:32:30.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 Processor -- start 2021-11-15T19:32:30.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- start start 2021-11-15T19:32:30.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 0x7f1838065070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18380aaa80 0x7f1838062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18380b0830 0x7f18381409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380638f0 con 0x7f18380b0830 2021-11-15T19:32:30.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838143450 con 0x7f183805fd20 2021-11-15T19:32:30.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838143680 con 0x7f18380aaa80 2021-11-15T19:32:30.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 0x7f1838065070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 0x7f1838065070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35762/0 (socket says 172.21.2.137:35762) 2021-11-15T19:32:30.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 -- 172.21.2.137:0/4171760139 learned_addr learned my addr 172.21.2.137:0/4171760139 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:30.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 -- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18380aaa80 msgr2=0x7f1838062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18380aaa80 0x7f1838062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 -- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18380b0830 msgr2=0x7f18381409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18380b0830 0x7f18381409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 -- 172.21.2.137:0/4171760139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009470 con 0x7f183805fd20 2021-11-15T19:32:30.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183caeb700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 0x7f1838065070 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f1828002f90 tx=0x7f1828006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1828013460 con 0x7f183805fd20 2021-11-15T19:32:30.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18280135c0 con 0x7f183805fd20 2021-11-15T19:32:30.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18380af430 con 0x7f183805fd20 2021-11-15T19:32:30.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1828013920 con 0x7f183805fd20 2021-11-15T19:32:30.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838143210 con 0x7f183805fd20 2021-11-15T19:32:30.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18381479f0 con 0x7f183805fd20 2021-11-15T19:32:30.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f182801a060 con 0x7f183805fd20 2021-11-15T19:32:30.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1835ffb700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1818053580 0x7f1818055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f182806b240 con 0x7f183805fd20 2021-11-15T19:32:30.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.337+0000 7f1837fff700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1818053580 0x7f1818055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.341+0000 7f1837fff700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1818053580 0x7f1818055a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f18380b2a00 tx=0x7f182c007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.341+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1828042410 con 0x7f183805fd20 2021-11-15T19:32:30.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.449+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f18380573d0 con 0x7f183805fd20 2021-11-15T19:32:30.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.465+0000 7f1835ffb700 1 -- 172.21.2.137:0/4171760139 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v31) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1828045a30 con 0x7f183805fd20 2021-11-15T19:32:30.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1818053580 msgr2=0x7f1818055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1818053580 0x7f1818055a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f18380b2a00 tx=0x7f182c007860).stop 2021-11-15T19:32:30.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 msgr2=0x7f1838065070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 0x7f1838065070 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f1828002f90 tx=0x7f1828006df0).stop 2021-11-15T19:32:30.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 shutdown_connections 2021-11-15T19:32:30.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1818053580 0x7f1818055a40 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0x7f18380b2a00 tx=0x7f182c007860).stop 2021-11-15T19:32:30.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f18380b0830 0x7f18381409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f18380aaa80 0x7f1838062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 --2- 172.21.2.137:0/4171760139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f183805fd20 0x7f1838065070 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 >> 172.21.2.137:0/4171760139 conn(0x7f18380b4e60 msgr2=0x7f18380b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 shutdown_connections 2021-11-15T19:32:30.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.469+0000 7f183ed4f700 1 -- 172.21.2.137:0/4171760139 wait complete. 2021-11-15T19:32:30.474 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 13 and data pool 14 2021-11-15T19:32:30.478 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:32:30.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.521+0000 7fd6424bd700 1 Processor -- start 2021-11-15T19:32:30.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.521+0000 7fd6424bd700 1 -- start start 2021-11-15T19:32:30.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd63c0aa4e0 0x7fd63c0aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd63c13c780 0x7fd63c13cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c0b1390 con 0x7fd63c0b0c50 2021-11-15T19:32:30.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c13f840 con 0x7fd63c0aa4e0 2021-11-15T19:32:30.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0b1030 con 0x7fd63c13c780 2021-11-15T19:32:30.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd63c13c780 0x7fd63c13cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd63c13c780 0x7fd63c13cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35778/0 (socket says 172.21.2.137:35778) 2021-11-15T19:32:30.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 -- 172.21.2.137:0/1501288788 learned_addr learned my addr 172.21.2.137:0/1501288788 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:30.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 --2- 172.21.2.137:0/1501288788 >> v2:172.21.2.111:3300/0 conn(0x7fd63c0aa4e0 0x7fd63c0aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 -- 172.21.2.137:0/1501288788 >> v2:172.21.2.111:3300/0 conn(0x7fd63c0aa4e0 msgr2=0x7fd63c0aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 --2- 172.21.2.137:0/1501288788 >> v2:172.21.2.111:3300/0 conn(0x7fd63c0aa4e0 0x7fd63c0aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 -- 172.21.2.137:0/1501288788 >> v1:172.21.2.111:6789/0 conn(0x7fd63c0b0c50 legacy=0x7fd63c1401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 -- 172.21.2.137:0/1501288788 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c13fa60 con 0x7fd63c13c780 2021-11-15T19:32:30.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 --2- 172.21.2.137:0/1501288788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c13c780 0x7fd63c13cc30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fd63c098760 tx=0x7fd63400b530).ready entity=mon.1 client_cookie=e07fc653c76fc70d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63affd700 1 -- 172.21.2.137:0/1501288788 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63400be70 con 0x7fd63c13c780 2021-11-15T19:32:30.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63affd700 1 -- 172.21.2.137:0/1501288788 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd634010470 con 0x7fd63c13c780 2021-11-15T19:32:30.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63affd700 1 -- 172.21.2.137:0/1501288788 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6340107d0 con 0x7fd63c13c780 2021-11-15T19:32:30.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/1501288788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c13c780 msgr2=0x7fd63c13cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- 172.21.2.137:0/1501288788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c13c780 0x7fd63c13cc30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fd63c098760 tx=0x7fd63400b530).stop 2021-11-15T19:32:30.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/1501288788 shutdown_connections 2021-11-15T19:32:30.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- 172.21.2.137:0/1501288788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c13c780 0x7fd63c13cc30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- 172.21.2.137:0/1501288788 >> v2:172.21.2.111:3300/0 conn(0x7fd63c0aa4e0 0x7fd63c0aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/1501288788 >> 172.21.2.137:0/1501288788 conn(0x7fd63c0b4e60 msgr2=0x7fd63c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/1501288788 shutdown_connections 2021-11-15T19:32:30.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/1501288788 wait complete. 2021-11-15T19:32:30.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 Processor -- start 2021-11-15T19:32:30.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- start start 2021-11-15T19:32:30.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd63c0aa4e0 0x7fd63c13b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 0x7fd63c155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd63c13c780 0x7fd63c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c13f2e0 con 0x7fd63c13c780 2021-11-15T19:32:30.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0ac620 con 0x7fd63c0b0c50 2021-11-15T19:32:30.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0aca30 con 0x7fd63c0aa4e0 2021-11-15T19:32:30.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 0x7fd63c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 0x7fd63c155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35786/0 (socket says 172.21.2.137:35786) 2021-11-15T19:32:30.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 -- 172.21.2.137:0/3406992095 learned_addr learned my addr 172.21.2.137:0/3406992095 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:30.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd640a5a700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd63c13c780 0x7fd63c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63bfff700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd63c0aa4e0 0x7fd63c13b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 -- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd63c0aa4e0 msgr2=0x7fd63c13b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd63c0aa4e0 0x7fd63c13b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 -- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd63c13c780 msgr2=0x7fd63c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd63c13c780 0x7fd63c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 -- 172.21.2.137:0/3406992095 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63400b7d0 con 0x7fd63c0b0c50 2021-11-15T19:32:30.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd63b7fe700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 0x7fd63c155740 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fd62c00a000 tx=0x7fd62c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c011780 con 0x7fd63c0b0c50 2021-11-15T19:32:30.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c0118e0 con 0x7fd63c0b0c50 2021-11-15T19:32:30.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c0accd0 con 0x7fd63c0b0c50 2021-11-15T19:32:30.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c011c40 con 0x7fd63c0b0c50 2021-11-15T19:32:30.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.525+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c13cb90 con 0x7fd63c0b0c50 2021-11-15T19:32:30.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c0ac440 con 0x7fd63c0b0c50 2021-11-15T19:32:30.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd62c01c460 con 0x7fd63c0b0c50 2021-11-15T19:32:30.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd6397fa700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6200535b0 0x7fd620055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd62c06bc80 con 0x7fd63c0b0c50 2021-11-15T19:32:30.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd63bfff700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6200535b0 0x7fd620055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd63bfff700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6200535b0 0x7fd620055a70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fd62400b000 tx=0x7fd624009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.529+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd62c042d80 con 0x7fd63c0b0c50 2021-11-15T19:32:30.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd63c13fd00 con 0x7fd63c0b0c50 2021-11-15T19:32:30.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6397fa700 1 -- 172.21.2.137:0/3406992095 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fd62c0463a0 con 0x7fd63c0b0c50 2021-11-15T19:32:30.620 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:30.620 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":72,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:32:30.455443+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:32:28.410587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T19:32:29.429846+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:32:30.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6200535b0 msgr2=0x7fd620055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6200535b0 0x7fd620055a70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fd62400b000 tx=0x7fd624009040).stop 2021-11-15T19:32:30.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 msgr2=0x7fd63c155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 0x7fd63c155740 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fd62c00a000 tx=0x7fd62c008040).stop 2021-11-15T19:32:30.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 shutdown_connections 2021-11-15T19:32:30.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd6200535b0 0x7fd620055a70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd63c13c780 0x7fd63c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd63c0b0c50 0x7fd63c155740 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 --2- 172.21.2.137:0/3406992095 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd63c0aa4e0 0x7fd63c13b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 >> 172.21.2.137:0/3406992095 conn(0x7fd63c0b4e60 msgr2=0x7fd63c098ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 shutdown_connections 2021-11-15T19:32:30.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.617+0000 7fd6424bd700 1 -- 172.21.2.137:0/3406992095 wait complete. 2021-11-15T19:32:30.628 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:32:30.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.673+0000 7fd439764700 1 Processor -- start 2021-11-15T19:32:30.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.673+0000 7fd439764700 1 -- start start 2021-11-15T19:32:30.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd4340b0c50 0x7fd4341401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 0x7fd43413ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340b1390 con 0x7fd4340aa4e0 2021-11-15T19:32:30.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43413f840 con 0x7fd4340b0c50 2021-11-15T19:32:30.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b1030 con 0x7fd4340aa960 2021-11-15T19:32:30.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4327fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd4340aa4e0 0x7fd43413c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54572/0 (socket says 172.21.2.137:54572) 2021-11-15T19:32:30.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4327fc700 1 -- 172.21.2.137:0/2329620202 learned_addr learned my addr 172.21.2.137:0/2329620202 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:30.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805143199 0 0) 0x7fd4340b1390 con 0x7fd4340aa4e0 2021-11-15T19:32:30.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd414003260 con 0x7fd4340aa4e0 2021-11-15T19:32:30.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 --2- 172.21.2.137:0/2329620202 >> v2:172.21.2.111:3300/0 conn(0x7fd4340b0c50 0x7fd4341401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 0x7fd43413ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3305502466 0 0) 0x7fd414003260 con 0x7fd4340aa4e0 2021-11-15T19:32:30.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 msgr2=0x7fd43413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 0x7fd43413ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 >> v2:172.21.2.111:3300/0 conn(0x7fd4340b0c50 msgr2=0x7fd4341401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 --2- 172.21.2.137:0/2329620202 >> v2:172.21.2.111:3300/0 conn(0x7fd4340b0c50 0x7fd4341401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43413fa60 con 0x7fd4340aa4e0 2021-11-15T19:32:30.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd424001660 con 0x7fd4340aa4e0 2021-11-15T19:32:30.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 >> v1:172.21.2.137:6789/0 conn(0x7fd4340aa4e0 legacy=0x7fd43413c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 0x7fd4140037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd414003e00 0x7fd414004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd414004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43413f840 con 0x7fd414003e00 2021-11-15T19:32:30.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b1030 con 0x7fd4140049f0 2021-11-15T19:32:30.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41400b8e0 con 0x7fd4340aa960 2021-11-15T19:32:30.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd414004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 -- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 msgr2=0x7fd4140037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd4340aa960 0x7fd4140037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 -- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd414003e00 msgr2=0x7fd414004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4327fc700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd414003e00 0x7fd414004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd414003e00 0x7fd414004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 -- 172.21.2.137:0/2329620202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414003260 con 0x7fd4140049f0 2021-11-15T19:32:30.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd414004e70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fd42c00a000 tx=0x7fd42c008040).ready entity=mon.1 client_cookie=554634bc9349120e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c00c070 con 0x7fd4140049f0 2021-11-15T19:32:30.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c00e5f0 con 0x7fd4140049f0 2021-11-15T19:32:30.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd431ffb700 1 -- 172.21.2.137:0/2329620202 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c00e950 con 0x7fd4140049f0 2021-11-15T19:32:30.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- 172.21.2.137:0/2329620202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 msgr2=0x7fd414004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 --2- 172.21.2.137:0/2329620202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd414004e70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fd42c00a000 tx=0x7fd42c008040).stop 2021-11-15T19:32:30.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd4337fe700 1 -- 172.21.2.137:0/2329620202 reap_dead start 2021-11-15T19:32:30.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- 172.21.2.137:0/2329620202 shutdown_connections 2021-11-15T19:32:30.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- 172.21.2.137:0/2329620202 >> 172.21.2.137:0/2329620202 conn(0x7fd4340b4e60 msgr2=0x7fd4340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- 172.21.2.137:0/2329620202 shutdown_connections 2021-11-15T19:32:30.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- 172.21.2.137:0/2329620202 wait complete. 2021-11-15T19:32:30.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 Processor -- start 2021-11-15T19:32:30.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- start start 2021-11-15T19:32:30.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd43413df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4340af3c0 0x7fd4341414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd434142730 0x7fd4340acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340ade50 con 0x7fd4340af3c0 2021-11-15T19:32:30.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341419b0 con 0x7fd4140049f0 2021-11-15T19:32:30.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd439764700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340ac6e0 con 0x7fd434142730 2021-11-15T19:32:30.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd43413df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd43413df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35800/0 (socket says 172.21.2.137:35800) 2021-11-15T19:32:30.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 -- 172.21.2.137:0/2679224355 learned_addr learned my addr 172.21.2.137:0/2679224355 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:30.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 -- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd434142730 msgr2=0x7fd4340acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd434142730 0x7fd4340acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 -- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4340af3c0 msgr2=0x7fd4341414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4340af3c0 0x7fd4341414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.677+0000 7fd432ffd700 1 -- 172.21.2.137:0/2679224355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434142f60 con 0x7fd4140049f0 2021-11-15T19:32:30.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd432ffd700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd43413df40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fd4341434d0 tx=0x7fd41c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd41c011500 con 0x7fd4140049f0 2021-11-15T19:32:30.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c000e90 con 0x7fd4140049f0 2021-11-15T19:32:30.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd434143200 con 0x7fd4140049f0 2021-11-15T19:32:30.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4340ad000 con 0x7fd4140049f0 2021-11-15T19:32:30.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd41c011850 con 0x7fd4140049f0 2021-11-15T19:32:30.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4340ac820 con 0x7fd4140049f0 2021-11-15T19:32:30.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd41c019020 con 0x7fd4140049f0 2021-11-15T19:32:30.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd4180535d0 0x7fd418055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd41c06af50 con 0x7fd4140049f0 2021-11-15T19:32:30.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd4327fc700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd4180535d0 0x7fd418055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd4327fc700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd4180535d0 0x7fd418055a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd424008000 tx=0x7fd424009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.681+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd41c041fa0 con 0x7fd4140049f0 2021-11-15T19:32:30.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.765+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd43413fd00 con 0x7fd4140049f0 2021-11-15T19:32:30.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd42bfff700 1 -- 172.21.2.137:0/2679224355 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fd41c0455c0 con 0x7fd4140049f0 2021-11-15T19:32:30.772 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:30.773 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":72,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:32:30.455443+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:32:28.410587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T19:32:29.429846+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:32:30.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd4180535d0 msgr2=0x7fd418055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd4180535d0 0x7fd418055a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd424008000 tx=0x7fd424009040).stop 2021-11-15T19:32:30.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 msgr2=0x7fd43413df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd43413df40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fd4341434d0 tx=0x7fd41c008040).stop 2021-11-15T19:32:30.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 shutdown_connections 2021-11-15T19:32:30.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd4180535d0 0x7fd418055a90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd434142730 0x7fd4340acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd4340af3c0 0x7fd4341414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 --2- 172.21.2.137:0/2679224355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd4140049f0 0x7fd43413df40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 >> 172.21.2.137:0/2679224355 conn(0x7fd4340b4e60 msgr2=0x7fd4340b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 shutdown_connections 2021-11-15T19:32:30.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.769+0000 7fd439764700 1 -- 172.21.2.137:0/2679224355 wait complete. 2021-11-15T19:32:30.779 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:32:30.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 Processor -- start 2021-11-15T19:32:30.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- start start 2021-11-15T19:32:30.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ffad005c770 0x7ffad00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffad0140aa0 0x7ffad0140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad005cb50 con 0x7ffad00b0550 2021-11-15T19:32:30.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00b1650 con 0x7ffad005c770 2021-11-15T19:32:30.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00ad030 con 0x7ffad0140aa0 2021-11-15T19:32:30.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffad0140aa0 0x7ffad0140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffad0140aa0 0x7ffad0140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35810/0 (socket says 172.21.2.137:35810) 2021-11-15T19:32:30.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 -- 172.21.2.137:0/3759049836 learned_addr learned my addr 172.21.2.137:0/3759049836 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:30.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 -- 172.21.2.137:0/3759049836 >> v2:172.21.2.111:3300/0 conn(0x7ffad005c770 msgr2=0x7ffad00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 --2- 172.21.2.137:0/3759049836 >> v2:172.21.2.111:3300/0 conn(0x7ffad005c770 0x7ffad00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 -- 172.21.2.137:0/3759049836 >> v1:172.21.2.111:6789/0 conn(0x7ffad00b0550 legacy=0x7ffad014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:30.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 -- 172.21.2.137:0/3759049836 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00ad2d0 con 0x7ffad0140aa0 2021-11-15T19:32:30.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacf59e700 1 --2- 172.21.2.137:0/3759049836 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad0140aa0 0x7ffad0140ef0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ffad00aee10 tx=0x7ffac8009290).ready entity=mon.1 client_cookie=5929f763bfbb10f7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacdd9b700 1 -- 172.21.2.137:0/3759049836 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac800b830 con 0x7ffad0140aa0 2021-11-15T19:32:30.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacdd9b700 1 -- 172.21.2.137:0/3759049836 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800b990 con 0x7ffad0140aa0 2021-11-15T19:32:30.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffacdd9b700 1 -- 172.21.2.137:0/3759049836 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac800bb40 con 0x7ffad0140aa0 2021-11-15T19:32:30.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- 172.21.2.137:0/3759049836 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad0140aa0 msgr2=0x7ffad0140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 --2- 172.21.2.137:0/3759049836 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad0140aa0 0x7ffad0140ef0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ffad00aee10 tx=0x7ffac8009290).stop 2021-11-15T19:32:30.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- 172.21.2.137:0/3759049836 shutdown_connections 2021-11-15T19:32:30.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 --2- 172.21.2.137:0/3759049836 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad0140aa0 0x7ffad0140ef0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 --2- 172.21.2.137:0/3759049836 >> v2:172.21.2.111:3300/0 conn(0x7ffad005c770 0x7ffad00aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- 172.21.2.137:0/3759049836 >> 172.21.2.137:0/3759049836 conn(0x7ffad00631e0 msgr2=0x7ffad005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:30.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- 172.21.2.137:0/3759049836 shutdown_connections 2021-11-15T19:32:30.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.829+0000 7ffad522a700 1 -- 172.21.2.137:0/3759049836 wait complete. 2021-11-15T19:32:30.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 Processor -- start 2021-11-15T19:32:30.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- start start 2021-11-15T19:32:30.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad005c770 0x7ffad0145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 0x7ffad0145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad0140aa0 0x7ffad0156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01446d0 con 0x7ffad0140aa0 2021-11-15T19:32:30.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0066fe0 con 0x7ffad00b0550 2021-11-15T19:32:30.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0141c80 con 0x7ffad005c770 2021-11-15T19:32:30.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 0x7ffad0145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 0x7ffad0145d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35818/0 (socket says 172.21.2.137:35818) 2021-11-15T19:32:30.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 -- 172.21.2.137:0/1979794373 learned_addr learned my addr 172.21.2.137:0/1979794373 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:30.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffacf59e700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad0140aa0 0x7ffad0156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 -- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad005c770 msgr2=0x7ffad0145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad005c770 0x7ffad0145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:30.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 -- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad0140aa0 msgr2=0x7ffad0156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:30.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad0140aa0 0x7ffad0156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:30.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 -- 172.21.2.137:0/1979794373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8009530 con 0x7ffad00b0550 2021-11-15T19:32:30.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7fface59c700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 0x7ffad0145d70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7ffad0144a20 tx=0x7ffac0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac0013460 con 0x7ffad00b0550 2021-11-15T19:32:30.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac00135c0 con 0x7ffad00b0550 2021-11-15T19:32:30.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad0142350 con 0x7ffad00b0550 2021-11-15T19:32:30.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac0013920 con 0x7ffad00b0550 2021-11-15T19:32:30.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad0146260 con 0x7ffad00b0550 2021-11-15T19:32:30.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00ae7f0 con 0x7ffad00b0550 2021-11-15T19:32:30.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffac000f070 con 0x7ffad00b0550 2021-11-15T19:32:30.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffac7fff700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab4053640 0x7ffab4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:30.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ffac006b0e0 con 0x7ffad00b0550 2021-11-15T19:32:30.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.833+0000 7ffaced9d700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab4053640 0x7ffab4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:30.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.837+0000 7ffaced9d700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab4053640 0x7ffab4055b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ffab8002f70 tx=0x7ffab8006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:30.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.837+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffac0042240 con 0x7ffad00b0550 2021-11-15T19:32:30.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:30.949+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffad00573d0 con 0x7ffad00b0550 2021-11-15T19:32:31.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffac7fff700 1 -- 172.21.2.137:0/1979794373 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffac0045860 con 0x7ffad00b0550 2021-11-15T19:32:31.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab4053640 msgr2=0x7ffab4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab4053640 0x7ffab4055b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ffab8002f70 tx=0x7ffab8006a80).stop 2021-11-15T19:32:31.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 msgr2=0x7ffad0145d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 0x7ffad0145d70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7ffad0144a20 tx=0x7ffac0006df0).stop 2021-11-15T19:32:31.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 shutdown_connections 2021-11-15T19:32:31.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab4053640 0x7ffab4055b00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad0140aa0 0x7ffad0156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b0550 0x7ffad0145d70 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 --2- 172.21.2.137:0/1979794373 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad005c770 0x7ffad0145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 >> 172.21.2.137:0/1979794373 conn(0x7ffad00631e0 msgr2=0x7ffad013f680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 shutdown_connections 2021-11-15T19:32:31.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.469+0000 7ffad522a700 1 -- 172.21.2.137:0/1979794373 wait complete. 2021-11-15T19:32:31.481 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:31.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ec05b9700 1 Processor -- start 2021-11-15T19:32:31.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ec05b9700 1 -- start start 2021-11-15T19:32:31.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ec05b9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 0x7f9eb8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ec05b9700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb8148190 con 0x7f9eb80a9f50 2021-11-15T19:32:31.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ec05b9700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb80b1720 con 0x7f9eb8143f00 2021-11-15T19:32:31.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ec05b9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8147e70 con 0x7f9eb80b1340 2021-11-15T19:32:31.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ebdb54700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9eb8143f00 0x7f9eb8144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54608/0 (socket says 172.21.2.137:54608) 2021-11-15T19:32:31.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ebdb54700 1 -- 172.21.2.137:0/4060125469 learned_addr learned my addr 172.21.2.137:0/4060125469 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:31.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944068106 0 0) 0x7f9eb80b1720 con 0x7f9eb8143f00 2021-11-15T19:32:31.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.537+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea0003260 con 0x7f9eb8143f00 2021-11-15T19:32:31.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513558204 0 0) 0x7f9ea0003260 con 0x7f9eb8143f00 2021-11-15T19:32:31.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 msgr2=0x7f9eb8147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 0x7f9eb8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 >> v1:172.21.2.111:6789/0 conn(0x7f9eb80a9f50 legacy=0x7f9eb80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80af800 con 0x7f9eb8143f00 2021-11-15T19:32:31.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9ea8001660 con 0x7f9eb8143f00 2021-11-15T19:32:31.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 >> v1:172.21.2.137:6789/0 conn(0x7f9eb8143f00 legacy=0x7f9eb8144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 0x7f9ea00037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ea0003ec0 0x7f9ea0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ea0004b40 0x7f9ea0004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8147e70 con 0x7f9ea0003ec0 2021-11-15T19:32:31.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea000ba00 con 0x7f9ea0004b40 2021-11-15T19:32:31.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea000bbc0 con 0x7f9eb80b1340 2021-11-15T19:32:31.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ea0004b40 0x7f9ea0004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 -- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 msgr2=0x7f9ea00037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebe355700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 0x7f9ea00037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ea0003ec0 0x7f9ea0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 0x7f9ea00037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 -- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ea0003ec0 msgr2=0x7f9ea0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ea0003ec0 0x7f9ea0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 -- 172.21.2.137:0/4060125469 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea0003260 con 0x7f9ea0004b40 2021-11-15T19:32:31.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebe355700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eb80b1340 0x7f9ea00037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:31.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ea0003ec0 0x7f9ea0004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:31.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ea0004b40 0x7f9ea0004fc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f9eb00012f0 tx=0x7f9eb0007d60).ready entity=mon.1 client_cookie=f6943cfd2215b96 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eb00014c0 con 0x7f9ea0004b40 2021-11-15T19:32:31.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0006870 con 0x7f9ea0004b40 2021-11-15T19:32:31.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebd353700 1 -- 172.21.2.137:0/4060125469 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eb0006bd0 con 0x7f9ea0004b40 2021-11-15T19:32:31.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/4060125469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ea0004b40 msgr2=0x7f9ea0004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/4060125469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ea0004b40 0x7f9ea0004fc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f9eb00012f0 tx=0x7f9eb0007d60).stop 2021-11-15T19:32:31.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 -- 172.21.2.137:0/4060125469 reap_dead start 2021-11-15T19:32:31.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/4060125469 shutdown_connections 2021-11-15T19:32:31.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/4060125469 >> 172.21.2.137:0/4060125469 conn(0x7f9eb80b4e60 msgr2=0x7f9eb80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:31.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/4060125469 shutdown_connections 2021-11-15T19:32:31.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/4060125469 wait complete. 2021-11-15T19:32:31.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 Processor -- start 2021-11-15T19:32:31.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- start start 2021-11-15T19:32:31.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ea0004b40 0x7f9eb8062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 0x7f9eb80ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eb80ad7a0 0x7f9eb8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80aeb10 con 0x7f9eb80ad7a0 2021-11-15T19:32:31.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80aedb0 con 0x7f9eb8156c70 2021-11-15T19:32:31.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80adc50 con 0x7f9ea0004b40 2021-11-15T19:32:31.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 0x7f9eb80ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 0x7f9eb80ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35838/0 (socket says 172.21.2.137:35838) 2021-11-15T19:32:31.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 -- 172.21.2.137:0/1909519751 learned_addr learned my addr 172.21.2.137:0/1909519751 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:31.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebeb56700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eb80ad7a0 0x7f9eb8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebe355700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ea0004b40 0x7f9eb8062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 -- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ea0004b40 msgr2=0x7f9eb8062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ea0004b40 0x7f9eb8062a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 -- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eb80ad7a0 msgr2=0x7f9eb8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eb80ad7a0 0x7f9eb8159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 -- 172.21.2.137:0/1909519751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb81570f0 con 0x7f9eb8156c70 2021-11-15T19:32:31.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ebdb54700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 0x7f9eb80ad2b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f9ea8008000 tx=0x7f9ea8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea8007170 con 0x7f9eb8156c70 2021-11-15T19:32:31.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80072d0 con 0x7f9eb8156c70 2021-11-15T19:32:31.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb814b1c0 con 0x7f9eb8156c70 2021-11-15T19:32:31.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea8004920 con 0x7f9eb8156c70 2021-11-15T19:32:31.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.541+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb8159fd0 con 0x7f9eb8156c70 2021-11-15T19:32:31.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb80aef70 con 0x7f9eb8156c70 2021-11-15T19:32:31.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ea8004a80 con 0x7f9eb8156c70 2021-11-15T19:32:31.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ea77fe700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e98053610 0x7f9e98055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9ea806bd70 con 0x7f9eb8156c70 2021-11-15T19:32:31.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ebe355700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e98053610 0x7f9e98055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ebe355700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e98053610 0x7f9e98055ad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9eb4008000 tx=0x7f9eb4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.545+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ea8042e30 con 0x7f9eb8156c70 2021-11-15T19:32:31.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eb805faf0 con 0x7f9eb8156c70 2021-11-15T19:32:31.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ea77fe700 1 -- 172.21.2.137:0/1909519751 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f9ea8046450 con 0x7f9eb8156c70 2021-11-15T19:32:31.662 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:31.663 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:32:31.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e98053610 msgr2=0x7f9e98055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e98053610 0x7f9e98055ad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9eb4008000 tx=0x7f9eb4008040).stop 2021-11-15T19:32:31.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 msgr2=0x7f9eb80ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 0x7f9eb80ad2b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f9ea8008000 tx=0x7f9ea8009040).stop 2021-11-15T19:32:31.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 shutdown_connections 2021-11-15T19:32:31.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e98053610 0x7f9e98055ad0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eb80ad7a0 0x7f9eb8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eb8156c70 0x7f9eb80ad2b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 --2- 172.21.2.137:0/1909519751 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ea0004b40 0x7f9eb8062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 >> 172.21.2.137:0/1909519751 conn(0x7f9eb80b4e60 msgr2=0x7f9eb813d950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:31.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.657+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 shutdown_connections 2021-11-15T19:32:31.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.661+0000 7f9ec05b9700 1 -- 172.21.2.137:0/1909519751 wait complete. 2021-11-15T19:32:31.667 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:32:31.669 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:32:31.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 Processor -- start 2021-11-15T19:32:31.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- start start 2021-11-15T19:32:31.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6f6805bd20 0x7f6f6805c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f68060550 con 0x7f6f680abd90 2021-11-15T19:32:31.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6814a7a0 con 0x7f6f681475f0 2021-11-15T19:32:31.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680ab2b0 con 0x7f6f6805bd20 2021-11-15T19:32:31.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f677fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6f681475f0 0x7f6f6805fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54626/0 (socket says 172.21.2.137:54626) 2021-11-15T19:32:31.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f677fe700 1 -- 172.21.2.137:0/2891963379 learned_addr learned my addr 172.21.2.137:0/2891963379 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:31.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742958660 0 0) 0x7f6f6814a7a0 con 0x7f6f681475f0 2021-11-15T19:32:31.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f4c003260 con 0x7f6f681475f0 2021-11-15T19:32:31.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f66ffd700 1 --2- 172.21.2.137:0/2891963379 >> v2:172.21.2.111:3300/0 conn(0x7f6f6805bd20 0x7f6f6805c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535360568 0 0) 0x7f6f4c003260 con 0x7f6f681475f0 2021-11-15T19:32:31.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 >> v2:172.21.2.111:3300/0 conn(0x7f6f6805bd20 msgr2=0x7f6f6805c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 --2- 172.21.2.137:0/2891963379 >> v2:172.21.2.111:3300/0 conn(0x7f6f6805bd20 0x7f6f6805c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 >> v1:172.21.2.111:6789/0 conn(0x7f6f680abd90 legacy=0x7f6f6805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6814aa40 con 0x7f6f681475f0 2021-11-15T19:32:31.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6f600019e0 con 0x7f6f681475f0 2021-11-15T19:32:31.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 >> v1:172.21.2.137:6789/0 conn(0x7f6f681475f0 legacy=0x7f6f6805fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f4c003820 0x7f6f4c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f4c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f4c004f70 0x7f6f4c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680ab2b0 con 0x7f6f4c004f70 2021-11-15T19:32:31.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c00be50 con 0x7f6f4c004500 2021-11-15T19:32:31.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c00c010 con 0x7f6f4c003820 2021-11-15T19:32:31.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f4c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 -- 172.21.2.137:0/2891963379 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f4c003820 msgr2=0x7f6f4c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f4c003820 0x7f6f4c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 -- 172.21.2.137:0/2891963379 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f4c004f70 msgr2=0x7f6f4c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:31.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f4c004f70 0x7f6f4c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f677fe700 1 -- 172.21.2.137:0/2891963379 reap_dead start 2021-11-15T19:32:31.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 -- 172.21.2.137:0/2891963379 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c003260 con 0x7f6f4c004500 2021-11-15T19:32:31.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f667fc700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f4c004980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f6f5c001fa0 tx=0x7f6f5c007a00).ready entity=mon.1 client_cookie=1bac28b518990301 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f5c007070 con 0x7f6f4c004500 2021-11-15T19:32:31.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0071d0 con 0x7f6f4c004500 2021-11-15T19:32:31.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f65ffb700 1 -- 172.21.2.137:0/2891963379 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f5c006510 con 0x7f6f4c004500 2021-11-15T19:32:31.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/2891963379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 msgr2=0x7f6f4c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f4c004980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f6f5c001fa0 tx=0x7f6f5c007a00).stop 2021-11-15T19:32:31.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/2891963379 shutdown_connections 2021-11-15T19:32:31.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/2891963379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f4c004980 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/2891963379 >> 172.21.2.137:0/2891963379 conn(0x7f6f680b2a20 msgr2=0x7f6f680b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:31.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/2891963379 shutdown_connections 2021-11-15T19:32:31.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.721+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/2891963379 wait complete. 2021-11-15T19:32:31.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 Processor -- start 2021-11-15T19:32:31.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- start start 2021-11-15T19:32:31.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f6809a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f68099da0 0x7f6f6809ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f68142bc0 0x7f6f68143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68096650 con 0x7f6f68142bc0 2021-11-15T19:32:31.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68096880 con 0x7f6f4c004500 2021-11-15T19:32:31.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68099310 con 0x7f6f68099da0 2021-11-15T19:32:31.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f6809a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f6809a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35856/0 (socket says 172.21.2.137:35856) 2021-11-15T19:32:31.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 -- 172.21.2.137:0/1022835161 learned_addr learned my addr 172.21.2.137:0/1022835161 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:31.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 -- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f68099da0 msgr2=0x7f6f6809ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f68099da0 0x7f6f6809ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 -- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f68142bc0 msgr2=0x7f6f68143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f68142bc0 0x7f6f68143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 -- 172.21.2.137:0/1022835161 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680afd50 con 0x7f6f4c004500 2021-11-15T19:32:31.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f66ffd700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f6809a650 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f6f5800a000 tx=0x7f6f58008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58016070 con 0x7f6f4c004500 2021-11-15T19:32:31.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58000e90 con 0x7f6f4c004500 2021-11-15T19:32:31.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58011970 con 0x7f6f4c004500 2021-11-15T19:32:31.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f68143560 con 0x7f6f4c004500 2021-11-15T19:32:31.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f68156380 con 0x7f6f4c004500 2021-11-15T19:32:31.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68096a40 con 0x7f6f4c004500 2021-11-15T19:32:31.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f58011ad0 con 0x7f6f4c004500 2021-11-15T19:32:31.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f57fff700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f44053610 0x7f6f44055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6f5806b3e0 con 0x7f6f4c004500 2021-11-15T19:32:31.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.725+0000 7f6f667fc700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f44053610 0x7f6f44055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.729+0000 7f6f667fc700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f44053610 0x7f6f44055ad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f6f5c001fa0 tx=0x7f6f5c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.729+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f58042430 con 0x7f6f4c004500 2021-11-15T19:32:31.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6814ace0 con 0x7f6f4c004500 2021-11-15T19:32:31.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f57fff700 1 -- 172.21.2.137:0/1022835161 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f6f58045a50 con 0x7f6f4c004500 2021-11-15T19:32:31.817 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:31.818 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:32:31.461891+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:32:28.410587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T19:32:29.429846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:32:31.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f44053610 msgr2=0x7f6f44055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f44053610 0x7f6f44055ad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f6f5c001fa0 tx=0x7f6f5c015000).stop 2021-11-15T19:32:31.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 msgr2=0x7f6f6809a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f6809a650 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f6f5800a000 tx=0x7f6f58008040).stop 2021-11-15T19:32:31.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 shutdown_connections 2021-11-15T19:32:31.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6f44053610 0x7f6f44055ad0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6f68142bc0 0x7f6f68143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6f68099da0 0x7f6f6809ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 --2- 172.21.2.137:0/1022835161 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6f4c004500 0x7f6f6809a650 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 >> 172.21.2.137:0/1022835161 conn(0x7f6f680b2a20 msgr2=0x7f6f680b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:31.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 shutdown_connections 2021-11-15T19:32:31.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.813+0000 7f6f6d6b7700 1 -- 172.21.2.137:0/1022835161 wait complete. 2021-11-15T19:32:31.825 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:32:31.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 Processor -- start 2021-11-15T19:32:31.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- start start 2021-11-15T19:32:31.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4800b0830 0x7fe4800af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b10b0 0x7fe4800aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe480147f70 con 0x7fe48005fd20 2021-11-15T19:32:31.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe480060100 con 0x7fe4800b0830 2021-11-15T19:32:31.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe480147cd0 con 0x7fe4800b10b0 2021-11-15T19:32:31.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4800b0830 0x7fe4800af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4800b0830 0x7fe4800af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35864/0 (socket says 172.21.2.137:35864) 2021-11-15T19:32:31.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 -- 172.21.2.137:0/3609451069 learned_addr learned my addr 172.21.2.137:0/3609451069 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:31.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 -- 172.21.2.137:0/3609451069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b10b0 msgr2=0x7fe4800aa370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:31.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 --2- 172.21.2.137:0/3609451069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b10b0 0x7fe4800aa370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 -- 172.21.2.137:0/3609451069 >> v1:172.21.2.137:6789/0 conn(0x7fe48005fd20 legacy=0x7fe4800b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 -- 172.21.2.137:0/3609451069 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800a9ed0 con 0x7fe4800b0830 2021-11-15T19:32:31.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe484e18700 1 --2- 172.21.2.137:0/3609451069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b0830 0x7fe4800af800 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fe47c002f70 tx=0x7fe47c006eb0).ready entity=mon.1 client_cookie=b628211fb08fbb4a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe473fff700 1 -- 172.21.2.137:0/3609451069 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe47c00d5c0 con 0x7fe4800b0830 2021-11-15T19:32:31.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe473fff700 1 -- 172.21.2.137:0/3609451069 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c000e90 con 0x7fe4800b0830 2021-11-15T19:32:31.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe473fff700 1 -- 172.21.2.137:0/3609451069 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe47c00d950 con 0x7fe4800b0830 2021-11-15T19:32:31.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/3609451069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b0830 msgr2=0x7fe4800af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:31.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- 172.21.2.137:0/3609451069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b0830 0x7fe4800af800 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fe47c002f70 tx=0x7fe47c006eb0).stop 2021-11-15T19:32:31.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/3609451069 shutdown_connections 2021-11-15T19:32:31.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- 172.21.2.137:0/3609451069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b0830 0x7fe4800af800 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:31.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- 172.21.2.137:0/3609451069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b10b0 0x7fe4800aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/3609451069 >> 172.21.2.137:0/3609451069 conn(0x7fe4800b4e60 msgr2=0x7fe4800b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:31.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/3609451069 shutdown_connections 2021-11-15T19:32:31.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/3609451069 wait complete. 2021-11-15T19:32:31.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 Processor -- start 2021-11-15T19:32:31.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- start start 2021-11-15T19:32:31.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe48005fd20 0x7fe4800b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b0830 0x7fe4800644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 0x7fe480066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800649a0 con 0x7fe48005fd20 2021-11-15T19:32:31.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480067270 con 0x7fe4800b10b0 2021-11-15T19:32:31.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe480067490 con 0x7fe4800b0830 2021-11-15T19:32:31.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 0x7fe480066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 0x7fe480066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35872/0 (socket says 172.21.2.137:35872) 2021-11-15T19:32:31.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 -- 172.21.2.137:0/210224082 learned_addr learned my addr 172.21.2.137:0/210224082 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:31.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 -- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b0830 msgr2=0x7fe4800644b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:31.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b0830 0x7fe4800644b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 -- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe48005fd20 msgr2=0x7fe4800b4210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:31.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe48005fd20 0x7fe4800b4210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:31.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 -- 172.21.2.137:0/210224082 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c00b1e0 con 0x7fe4800b10b0 2021-11-15T19:32:31.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe485e1a700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 0x7fe480066d80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fe478003270 tx=0x7fe4780090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe47800d4a0 con 0x7fe4800b10b0 2021-11-15T19:32:31.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800d600 con 0x7fe4800b10b0 2021-11-15T19:32:31.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4800ae7b0 con 0x7fe4800b10b0 2021-11-15T19:32:31.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe47800d960 con 0x7fe4800b10b0 2021-11-15T19:32:31.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.877+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4800aedf0 con 0x7fe4800b10b0 2021-11-15T19:32:31.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4800ae940 con 0x7fe4800b10b0 2021-11-15T19:32:31.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe478018030 con 0x7fe4800b10b0 2021-11-15T19:32:31.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe4727fc700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4600534f0 0x7fe4600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:31.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe47806b1a0 con 0x7fe4800b10b0 2021-11-15T19:32:31.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe485619700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4600534f0 0x7fe4600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:31.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe485619700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4600534f0 0x7fe4600559b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fe4800b4db0 tx=0x7fe474007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:31.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.881+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4780423b0 con 0x7fe4800b10b0 2021-11-15T19:32:31.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:31.993+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe4801479f0 con 0x7fe4800b10b0 2021-11-15T19:32:32.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.005+0000 7fe4727fc700 1 -- 172.21.2.137:0/210224082 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe4780459d0 con 0x7fe4800b10b0 2021-11-15T19:32:32.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4600534f0 msgr2=0x7fe4600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4600534f0 0x7fe4600559b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fe4800b4db0 tx=0x7fe474007790).stop 2021-11-15T19:32:32.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 msgr2=0x7fe480066d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 0x7fe480066d80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fe478003270 tx=0x7fe4780090f0).stop 2021-11-15T19:32:32.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 shutdown_connections 2021-11-15T19:32:32.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4600534f0 0x7fe4600559b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4800b10b0 0x7fe480066d80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4800b0830 0x7fe4800644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 --2- 172.21.2.137:0/210224082 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe48005fd20 0x7fe4800b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 >> 172.21.2.137:0/210224082 conn(0x7fe4800b4e60 msgr2=0x7fe480146220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 shutdown_connections 2021-11-15T19:32:32.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.009+0000 7fe48787d700 1 -- 172.21.2.137:0/210224082 wait complete. 2021-11-15T19:32:32.015 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:32:32.018 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:32:32.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 Processor -- start 2021-11-15T19:32:32.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 -- start start 2021-11-15T19:32:32.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 0x7fd9980af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd9980b10b0 0x7fd9980b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd998147f70 con 0x7fd9980b0610 2021-11-15T19:32:32.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd998060100 con 0x7fd9980b10b0 2021-11-15T19:32:32.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99e39d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd998147cd0 con 0x7fd99805fd20 2021-11-15T19:32:32.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99c93a700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd9980b0610 0x7fd9980aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54658/0 (socket says 172.21.2.137:54658) 2021-11-15T19:32:32.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd99c93a700 1 -- 172.21.2.137:0/1189457440 learned_addr learned my addr 172.21.2.137:0/1189457440 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:32.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd9977fe700 1 --2- 172.21.2.137:0/1189457440 >> v2:172.21.2.111:3300/0 conn(0x7fd9980b10b0 0x7fd9980b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364913085 0 0) 0x7fd998147f70 con 0x7fd9980b0610 2021-11-15T19:32:32.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd978003260 con 0x7fd9980b0610 2021-11-15T19:32:32.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd997fff700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 0x7fd9980af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2029867502 0 0) 0x7fd978003260 con 0x7fd9980b0610 2021-11-15T19:32:32.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 msgr2=0x7fd9980af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 0x7fd9980af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 >> v2:172.21.2.111:3300/0 conn(0x7fd9980b10b0 msgr2=0x7fd9980b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 --2- 172.21.2.137:0/1189457440 >> v2:172.21.2.111:3300/0 conn(0x7fd9980b10b0 0x7fd9980b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980a9ed0 con 0x7fd9980b0610 2021-11-15T19:32:32.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd9900019e0 con 0x7fd9980b0610 2021-11-15T19:32:32.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 >> v1:172.21.2.137:6789/0 conn(0x7fd9980b0610 legacy=0x7fd9980aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 0x7fd9780037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd978003d50 0x7fd978004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd9780049f0 0x7fd978004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998060100 con 0x7fd978003d50 2021-11-15T19:32:32.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998147cd0 con 0x7fd9780049f0 2021-11-15T19:32:32.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.069+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97800b830 con 0x7fd99805fd20 2021-11-15T19:32:32.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd9780049f0 0x7fd978004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd997fff700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 0x7fd9780037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9977fe700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd978003d50 0x7fd978004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 msgr2=0x7fd9780037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99805fd20 0x7fd9780037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd978003d50 msgr2=0x7fd978004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd978003d50 0x7fd978004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/1189457440 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd978003260 con 0x7fd9780049f0 2021-11-15T19:32:32.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd9780049f0 0x7fd978004e70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fd9900016f0 tx=0x7fd9980b5e40).ready entity=mon.1 client_cookie=99f457c2898c4f2f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd99000cc70 con 0x7fd9780049f0 2021-11-15T19:32:32.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99000cdd0 con 0x7fd9780049f0 2021-11-15T19:32:32.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd996ffd700 1 -- 172.21.2.137:0/1189457440 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd990005b80 con 0x7fd9780049f0 2021-11-15T19:32:32.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/1189457440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd9780049f0 msgr2=0x7fd978004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 --2- 172.21.2.137:0/1189457440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd9780049f0 0x7fd978004e70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fd9900016f0 tx=0x7fd9980b5e40).stop 2021-11-15T19:32:32.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/1189457440 reap_dead start 2021-11-15T19:32:32.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/1189457440 shutdown_connections 2021-11-15T19:32:32.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/1189457440 >> 172.21.2.137:0/1189457440 conn(0x7fd9980b4e60 msgr2=0x7fd9980b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/1189457440 shutdown_connections 2021-11-15T19:32:32.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/1189457440 wait complete. 2021-11-15T19:32:32.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 Processor -- start 2021-11-15T19:32:32.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- start start 2021-11-15T19:32:32.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd9780049f0 0x7fd9981569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd9980984b0 0x7fd99809a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 0x7fd998159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998099d30 con 0x7fd9780049f0 2021-11-15T19:32:32.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998098ac0 con 0x7fd998148760 2021-11-15T19:32:32.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd998098d60 con 0x7fd9980984b0 2021-11-15T19:32:32.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 0x7fd998159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 0x7fd998159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35888/0 (socket says 172.21.2.137:35888) 2021-11-15T19:32:32.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/3505608545 learned_addr learned my addr 172.21.2.137:0/3505608545 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:32.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd997fff700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd9780049f0 0x7fd9981569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9977fe700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd9980984b0 0x7fd99809a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd9980984b0 msgr2=0x7fd99809a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd9980984b0 0x7fd99809a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd9780049f0 msgr2=0x7fd9981569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd9780049f0 0x7fd9981569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 -- 172.21.2.137:0/3505608545 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998099000 con 0x7fd998148760 2021-11-15T19:32:32.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99c93a700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 0x7fd998159bf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fd998144b70 tx=0x7fd990013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd990017070 con 0x7fd998148760 2021-11-15T19:32:32.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9900074d0 con 0x7fd998148760 2021-11-15T19:32:32.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd99000cc70 con 0x7fd998148760 2021-11-15T19:32:32.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99809a620 con 0x7fd998148760 2021-11-15T19:32:32.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd998157490 con 0x7fd998148760 2021-11-15T19:32:32.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9980b0a70 con 0x7fd998148760 2021-11-15T19:32:32.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd990010070 con 0x7fd998148760 2021-11-15T19:32:32.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9957fa700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd97c053520 0x7fd97c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.073+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd99001a040 con 0x7fd998148760 2021-11-15T19:32:32.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.077+0000 7fd997fff700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd97c053520 0x7fd97c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.077+0000 7fd997fff700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd97c053520 0x7fd97c0559e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fd98000c000 tx=0x7fd980008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.077+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9900437d0 con 0x7fd998148760 2021-11-15T19:32:32.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.185+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd9980573d0 con 0x7fd998148760 2021-11-15T19:32:32.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd9957fa700 1 -- 172.21.2.137:0/3505608545 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd990046df0 con 0x7fd998148760 2021-11-15T19:32:32.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd97c053520 msgr2=0x7fd97c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd97c053520 0x7fd97c0559e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fd98000c000 tx=0x7fd980008040).stop 2021-11-15T19:32:32.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 msgr2=0x7fd998159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 0x7fd998159bf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fd998144b70 tx=0x7fd990013000).stop 2021-11-15T19:32:32.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 shutdown_connections 2021-11-15T19:32:32.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd97c053520 0x7fd97c0559e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd998148760 0x7fd998159bf0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd9980984b0 0x7fd99809a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 --2- 172.21.2.137:0/3505608545 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd9780049f0 0x7fd9981569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 >> 172.21.2.137:0/3505608545 conn(0x7fd9980b4e60 msgr2=0x7fd998145ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 shutdown_connections 2021-11-15T19:32:32.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.201+0000 7fd99e39d700 1 -- 172.21.2.137:0/3505608545 wait complete. 2021-11-15T19:32:32.209 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:32:32.212 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:32:32.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f55006f2700 1 Processor -- start 2021-11-15T19:32:32.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f55006f2700 1 -- start start 2021-11-15T19:32:32.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f55006f2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 0x7f54f80af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f55006f2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f8147f70 con 0x7f54f805fd20 2021-11-15T19:32:32.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f55006f2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f8060100 con 0x7f54f80b0830 2021-11-15T19:32:32.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f55006f2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8147cd0 con 0x7f54f80aaa80 2021-11-15T19:32:32.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f54fdc8d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f54f80b0830 0x7f54f80aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54676/0 (socket says 172.21.2.137:54676) 2021-11-15T19:32:32.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f54fdc8d700 1 -- 172.21.2.137:0/4027092916 learned_addr learned my addr 172.21.2.137:0/4027092916 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:32.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426696090 0 0) 0x7f54f8060100 con 0x7f54f80b0830 2021-11-15T19:32:32.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.261+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e0003260 con 0x7f54f80b0830 2021-11-15T19:32:32.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949580456 0 0) 0x7f54e0003260 con 0x7f54f80b0830 2021-11-15T19:32:32.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 msgr2=0x7f54f80af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 0x7f54f80af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 >> v1:172.21.2.111:6789/0 conn(0x7f54f805fd20 legacy=0x7f54f80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80a9ed0 con 0x7f54f80b0830 2021-11-15T19:32:32.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f54f4001660 con 0x7f54f80b0830 2021-11-15T19:32:32.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 >> v1:172.21.2.137:6789/0 conn(0x7f54f80b0830 legacy=0x7f54f80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e00037d0 0x7f54e0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54e0004500 0x7f54e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 0x7f54e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8147cd0 con 0x7f54e00037d0 2021-11-15T19:32:32.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00052b0 con 0x7f54e0004500 2021-11-15T19:32:32.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e000bc40 con 0x7f54f80aaa80 2021-11-15T19:32:32.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54e0004500 0x7f54e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fe48e700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e00037d0 0x7f54e0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fec8f700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 0x7f54e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 msgr2=0x7f54e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f80aaa80 0x7f54e000b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e00037d0 msgr2=0x7f54e0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e00037d0 0x7f54e0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/4027092916 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0003260 con 0x7f54e0004500 2021-11-15T19:32:32.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54e0004500 0x7f54e0004980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f54f80b4db0 tx=0x7f54f80ac030).ready entity=mon.1 client_cookie=625a44db1f55a56f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f40070d0 con 0x7f54e0004500 2021-11-15T19:32:32.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4007230 con 0x7f54e0004500 2021-11-15T19:32:32.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fd48c700 1 -- 172.21.2.137:0/4027092916 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f400c8f0 con 0x7f54e0004500 2021-11-15T19:32:32.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/4027092916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54e0004500 msgr2=0x7f54e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 --2- 172.21.2.137:0/4027092916 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54e0004500 0x7f54e0004980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f54f80b4db0 tx=0x7f54f80ac030).stop 2021-11-15T19:32:32.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fec8f700 1 -- 172.21.2.137:0/4027092916 reap_dead start 2021-11-15T19:32:32.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/4027092916 shutdown_connections 2021-11-15T19:32:32.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/4027092916 >> 172.21.2.137:0/4027092916 conn(0x7f54f80b4e60 msgr2=0x7f54f80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/4027092916 shutdown_connections 2021-11-15T19:32:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/4027092916 wait complete. 2021-11-15T19:32:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 Processor -- start 2021-11-15T19:32:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- start start 2021-11-15T19:32:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e0004500 0x7f54f8098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 0x7f54f813f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f813fe10 0x7f54f8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80aef10 con 0x7f54e0004500 2021-11-15T19:32:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8099810 con 0x7f54f80993b0 2021-11-15T19:32:32.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80980c0 con 0x7f54f813fe10 2021-11-15T19:32:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 0x7f54f813f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 0x7f54f813f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35908/0 (socket says 172.21.2.137:35908) 2021-11-15T19:32:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/459197989 learned_addr learned my addr 172.21.2.137:0/459197989 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f813fe10 msgr2=0x7f54f8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f813fe10 0x7f54f8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e0004500 msgr2=0x7f54f8098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fe48e700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e0004500 0x7f54f8098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e0004500 0x7f54f8098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 -- 172.21.2.137:0/459197989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f809a5a0 con 0x7f54f80993b0 2021-11-15T19:32:32.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fe48e700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e0004500 0x7f54f8098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:32.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54fdc8d700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 0x7f54f813f920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f54f8156a60 tx=0x7f54f4013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f40070d0 con 0x7f54f80993b0 2021-11-15T19:32:32.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4004730 con 0x7f54f80993b0 2021-11-15T19:32:32.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f4004a90 con 0x7f54f80993b0 2021-11-15T19:32:32.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f809a840 con 0x7f54f80993b0 2021-11-15T19:32:32.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.265+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f81566e0 con 0x7f54f80993b0 2021-11-15T19:32:32.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f81568a0 con 0x7f54f80993b0 2021-11-15T19:32:32.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f54f4026070 con 0x7f54f80993b0 2021-11-15T19:32:32.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f54eb7fe700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54d8053570 0x7f54d8055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f54f406c160 con 0x7f54f80993b0 2021-11-15T19:32:32.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f54fe48e700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54d8053570 0x7f54d8055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f54fe48e700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54d8053570 0x7f54d8055a30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f54ec009000 tx=0x7f54ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.269+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54f40431b0 con 0x7f54f80993b0 2021-11-15T19:32:32.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.381+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f54f81479f0 con 0x7f54f80993b0 2021-11-15T19:32:32.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f54eb7fe700 1 -- 172.21.2.137:0/459197989 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f54f40467d0 con 0x7f54f80993b0 2021-11-15T19:32:32.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54d8053570 msgr2=0x7f54d8055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54d8053570 0x7f54d8055a30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f54ec009000 tx=0x7f54ec009040).stop 2021-11-15T19:32:32.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 msgr2=0x7f54f813f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 0x7f54f813f920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f54f8156a60 tx=0x7f54f4013000).stop 2021-11-15T19:32:32.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 shutdown_connections 2021-11-15T19:32:32.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54d8053570 0x7f54d8055a30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54f813fe10 0x7f54f8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54f80993b0 0x7f54f813f920 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 --2- 172.21.2.137:0/459197989 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54e0004500 0x7f54f8098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 >> 172.21.2.137:0/459197989 conn(0x7f54f80b4e60 msgr2=0x7f54f8146770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 shutdown_connections 2021-11-15T19:32:32.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.393+0000 7f55006f2700 1 -- 172.21.2.137:0/459197989 wait complete. 2021-11-15T19:32:32.401 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:32:32.404 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:32.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.449+0000 7ffab71d7700 1 Processor -- start 2021-11-15T19:32:32.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.449+0000 7ffab71d7700 1 -- start start 2021-11-15T19:32:32.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ffab0144610 0x7ffab0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab00a9f50 0x7ffab00aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab0148190 con 0x7ffab00b1340 2021-11-15T19:32:32.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00b1720 con 0x7ffab0144610 2021-11-15T19:32:32.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0147e70 con 0x7ffab00a9f50 2021-11-15T19:32:32.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab4f73700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ffab00b1340 0x7ffab0143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54696/0 (socket says 172.21.2.137:54696) 2021-11-15T19:32:32.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab4f73700 1 -- 172.21.2.137:0/1231854272 learned_addr learned my addr 172.21.2.137:0/1231854272 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:32.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931829711 0 0) 0x7ffa98001110 con 0x7ffab00b1340 2021-11-15T19:32:32.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90003260 con 0x7ffab00b1340 2021-11-15T19:32:32.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 --2- 172.21.2.137:0/1231854272 >> v2:172.21.2.111:3300/0 conn(0x7ffab0144610 0x7ffab0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab5774700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab00a9f50 0x7ffab00aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283344170 0 0) 0x7ffa90003260 con 0x7ffab00b1340 2021-11-15T19:32:32.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab00a9f50 msgr2=0x7ffab00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab00a9f50 0x7ffab00aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 >> v2:172.21.2.111:3300/0 conn(0x7ffab0144610 msgr2=0x7ffab0147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 --2- 172.21.2.137:0/1231854272 >> v2:172.21.2.111:3300/0 conn(0x7ffab0144610 0x7ffab0147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00af800 con 0x7ffab00b1340 2021-11-15T19:32:32.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ffa98001810 con 0x7ffab00b1340 2021-11-15T19:32:32.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 >> v1:172.21.2.137:6789/0 conn(0x7ffab00b1340 legacy=0x7ffab0143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa900037d0 0x7ffa90003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa90004500 0x7ffa90004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa90004e70 0x7ffa9000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b1720 con 0x7ffa90004e70 2021-11-15T19:32:32.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0147e70 con 0x7ffa90004500 2021-11-15T19:32:32.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000bda0 con 0x7ffa900037d0 2021-11-15T19:32:32.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa90004500 0x7ffa90004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab4f73700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa900037d0 0x7ffa90003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab5774700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa90004e70 0x7ffa9000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 -- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa900037d0 msgr2=0x7ffa90003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa900037d0 0x7ffa90003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 -- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa90004e70 msgr2=0x7ffa9000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa90004e70 0x7ffa9000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 -- 172.21.2.137:0/1231854272 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00af800 con 0x7ffa90004500 2021-11-15T19:32:32.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab5774700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa90004e70 0x7ffa9000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:32.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaffff700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa90004500 0x7ffa90004980 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7ffaa000a000 tx=0x7ffaa0008040).ready entity=mon.1 client_cookie=e1cd7b9b6ba9c58e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaa0013670 con 0x7ffa90004500 2021-11-15T19:32:32.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa00137d0 con 0x7ffa90004500 2021-11-15T19:32:32.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffaaf7fe700 1 -- 172.21.2.137:0/1231854272 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaa0013b30 con 0x7ffa90004500 2021-11-15T19:32:32.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- 172.21.2.137:0/1231854272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa90004500 msgr2=0x7ffa90004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 --2- 172.21.2.137:0/1231854272 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa90004500 0x7ffa90004980 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7ffaa000a000 tx=0x7ffaa0008040).stop 2021-11-15T19:32:32.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab5774700 1 -- 172.21.2.137:0/1231854272 reap_dead start 2021-11-15T19:32:32.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- 172.21.2.137:0/1231854272 shutdown_connections 2021-11-15T19:32:32.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- 172.21.2.137:0/1231854272 >> 172.21.2.137:0/1231854272 conn(0x7ffab00b4e60 msgr2=0x7ffab00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- 172.21.2.137:0/1231854272 shutdown_connections 2021-11-15T19:32:32.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- 172.21.2.137:0/1231854272 wait complete. 2021-11-15T19:32:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 Processor -- start 2021-11-15T19:32:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.453+0000 7ffab71d7700 1 -- start start 2021-11-15T19:32:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 0x7ffab0099d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffab0098d10 0x7ffab009a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab009a700 0x7ffab01558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0157320 con 0x7ffab0098d10 2021-11-15T19:32:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0156940 con 0x7ffab00ac960 2021-11-15T19:32:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0156be0 con 0x7ffab009a700 2021-11-15T19:32:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 0x7ffab0099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 0x7ffab0099d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35928/0 (socket says 172.21.2.137:35928) 2021-11-15T19:32:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 -- 172.21.2.137:0/577713719 learned_addr learned my addr 172.21.2.137:0/577713719 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab5774700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab009a700 0x7ffab01558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaaffff700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffab0098d10 0x7ffab009a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 -- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab009a700 msgr2=0x7ffab01558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab009a700 0x7ffab01558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 -- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffab0098d10 msgr2=0x7ffab009a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffab0098d10 0x7ffab009a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 -- 172.21.2.137:0/577713719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0156e80 con 0x7ffab00ac960 2021-11-15T19:32:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab4f73700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 0x7ffab0099d20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7ffa9800b000 tx=0x7ffa980015e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa98010640 con 0x7ffab00ac960 2021-11-15T19:32:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980107a0 con 0x7ffab00ac960 2021-11-15T19:32:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab014aea0 con 0x7ffab00ac960 2021-11-15T19:32:32.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa98010b00 con 0x7ffab00ac960 2021-11-15T19:32:32.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab00acee0 con 0x7ffab00ac960 2021-11-15T19:32:32.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab009aae0 con 0x7ffab00ac960 2021-11-15T19:32:32.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa9801a020 con 0x7ffab00ac960 2021-11-15T19:32:32.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaadffb700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa94053520 0x7ffa940559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ffa9806b640 con 0x7ffab00ac960 2021-11-15T19:32:32.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.457+0000 7ffaaffff700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa94053520 0x7ffa940559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.461+0000 7ffaaffff700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa94053520 0x7ffa940559e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ffaa001b000 tx=0x7ffaa0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.461+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa980427a0 con 0x7ffab00ac960 2021-11-15T19:32:32.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffab0148190 con 0x7ffab00ac960 2021-11-15T19:32:32.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffaadffb700 1 -- 172.21.2.137:0/577713719 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7ffab0148190 con 0x7ffab00ac960 2021-11-15T19:32:32.574 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:32.574 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:32:32.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa94053520 msgr2=0x7ffa940559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa94053520 0x7ffa940559e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ffaa001b000 tx=0x7ffaa0008040).stop 2021-11-15T19:32:32.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 msgr2=0x7ffab0099d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 0x7ffab0099d20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7ffa9800b000 tx=0x7ffa980015e0).stop 2021-11-15T19:32:32.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 shutdown_connections 2021-11-15T19:32:32.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa94053520 0x7ffa940559e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffab009a700 0x7ffab01558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffab0098d10 0x7ffab009a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 --2- 172.21.2.137:0/577713719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffab00ac960 0x7ffab0099d20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 >> 172.21.2.137:0/577713719 conn(0x7ffab00b4e60 msgr2=0x7ffab00b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 shutdown_connections 2021-11-15T19:32:32.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.569+0000 7ffab71d7700 1 -- 172.21.2.137:0/577713719 wait complete. 2021-11-15T19:32:32.578 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:32:32.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:32:30.455951+0000', 'modified': '2021-11-15T19:32:31.460820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6184': {'gid': 6184, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1730106945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1730106945}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1730106945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:32:32.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:32:32.784 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:32:32.848 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6184,"want_state":"up:active","state":"up:active","rank_uptime":2.380132095,"mdsmap_epoch":32,"osdmap_epoch":73,"osdmap_epoch_barrier":72,"uptime":6.4711097369999999} 2021-11-15T19:32:32.848 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6184, "mdsmap_epoch": 32, "osdmap_epoch": 73, "osdmap_epoch_barrier": 72, "rank_uptime": 2.380132095, "state": "up:active", "uptime": 6.471109737, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:32:32.849 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:32:32.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.893+0000 7f3190b56700 1 Processor -- start 2021-11-15T19:32:32.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.893+0000 7f3190b56700 1 -- start start 2021-11-15T19:32:32.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f318c0a9f50 0x7f318c0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c148190 con 0x7f318c0b1340 2021-11-15T19:32:32.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0b1720 con 0x7f318c0a9f50 2021-11-15T19:32:32.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c147e70 con 0x7f318c144610 2021-11-15T19:32:32.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f318c0a9f50 0x7f318c0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f318c0a9f50 0x7f318c0aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35936/0 (socket says 172.21.2.137:35936) 2021-11-15T19:32:32.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 -- 172.21.2.137:0/608224540 learned_addr learned my addr 172.21.2.137:0/608224540 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:32.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 -- 172.21.2.137:0/608224540 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 msgr2=0x7f318c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3189d9b700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 -- 172.21.2.137:0/608224540 >> v1:172.21.2.111:6789/0 conn(0x7f318c0b1340 legacy=0x7f318c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:32.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 -- 172.21.2.137:0/608224540 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0af800 con 0x7f318c0a9f50 2021-11-15T19:32:32.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3189d9b700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:32:32.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318ad9d700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0aa370 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f31840032f0 tx=0x7f3184009290).ready entity=mon.1 client_cookie=8b4e5d81de82e804 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318959a700 1 -- 172.21.2.137:0/608224540 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318400b8a0 con 0x7f318c0a9f50 2021-11-15T19:32:32.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318959a700 1 -- 172.21.2.137:0/608224540 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318400ba00 con 0x7f318c0a9f50 2021-11-15T19:32:32.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318959a700 1 -- 172.21.2.137:0/608224540 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318400bb70 con 0x7f318c0a9f50 2021-11-15T19:32:32.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- 172.21.2.137:0/608224540 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 msgr2=0x7f318c0aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0aa370 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f31840032f0 tx=0x7f3184009290).stop 2021-11-15T19:32:32.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- 172.21.2.137:0/608224540 shutdown_connections 2021-11-15T19:32:32.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0aa370 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- 172.21.2.137:0/608224540 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- 172.21.2.137:0/608224540 >> 172.21.2.137:0/608224540 conn(0x7f318c0b4e60 msgr2=0x7f318c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- 172.21.2.137:0/608224540 shutdown_connections 2021-11-15T19:32:32.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- 172.21.2.137:0/608224540 wait complete. 2021-11-15T19:32:32.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 Processor -- start 2021-11-15T19:32:32.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- start start 2021-11-15T19:32:32.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f318c0b1340 0x7f318c149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c099d70 con 0x7f318c0b1340 2021-11-15T19:32:32.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c09a010 con 0x7f318c0a9f50 2021-11-15T19:32:32.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f3190b56700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c09a2b0 con 0x7f318c144610 2021-11-15T19:32:32.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35944/0 (socket says 172.21.2.137:35944) 2021-11-15T19:32:32.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 -- 172.21.2.137:0/3679021690 learned_addr learned my addr 172.21.2.137:0/3679021690 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:32.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 -- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 msgr2=0x7f318c159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 -- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f318c0b1340 msgr2=0x7f318c149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f318c0b1340 0x7f318c149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 -- 172.21.2.137:0/3679021690 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009530 con 0x7f318c0a9f50 2021-11-15T19:32:32.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f318a59c700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0ad850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f318c05cfa0 tx=0x7f3174007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.897+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f317400ce30 con 0x7f318c0a9f50 2021-11-15T19:32:32.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317400f470 con 0x7f318c0a9f50 2021-11-15T19:32:32.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f317400f7d0 con 0x7f318c0a9f50 2021-11-15T19:32:32.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c099a60 con 0x7f318c0a9f50 2021-11-15T19:32:32.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c09aa70 con 0x7f318c0a9f50 2021-11-15T19:32:32.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c0b0b90 con 0x7f318c0a9f50 2021-11-15T19:32:32.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3174019030 con 0x7f318c0a9f50 2021-11-15T19:32:32.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f31837fe700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31700534f0 0x7f31700559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:32.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f317406ad20 con 0x7f318c0a9f50 2021-11-15T19:32:32.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f3189d9b700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31700534f0 0x7f31700559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:32.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f3189d9b700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31700534f0 0x7f31700559b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f317c007000 tx=0x7f317c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:32.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.901+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3174041cf0 con 0x7f318c0a9f50 2021-11-15T19:32:32.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.985+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f318c148190 con 0x7f318c0a9f50 2021-11-15T19:32:32.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.985+0000 7f31837fe700 1 -- 172.21.2.137:0/3679021690 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f318c148190 con 0x7f318c0a9f50 2021-11-15T19:32:32.992 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:32.992 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:32:31.461891+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:32:28.410587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T19:32:29.429846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:32:32.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31700534f0 msgr2=0x7f31700559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31700534f0 0x7f31700559b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f317c007000 tx=0x7f317c008040).stop 2021-11-15T19:32:32.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 msgr2=0x7f318c0ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:32.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0ad850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f318c05cfa0 tx=0x7f3174007c50).stop 2021-11-15T19:32:32.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 shutdown_connections 2021-11-15T19:32:32.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f31700534f0 0x7f31700559b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f318c144610 0x7f318c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f318c0b1340 0x7f318c149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:32.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 --2- 172.21.2.137:0/3679021690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f318c0a9f50 0x7f318c0ad850 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:32.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 >> 172.21.2.137:0/3679021690 conn(0x7f318c0b4e60 msgr2=0x7f318c0afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:32.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 shutdown_connections 2021-11-15T19:32:32.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:32.989+0000 7f3190b56700 1 -- 172.21.2.137:0/3679021690 wait complete. 2021-11-15T19:32:33.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:32:28.410587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:32:29.429846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:32:33.001 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:32:33.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.049+0000 7fae98686700 1 Processor -- start 2021-11-15T19:32:33.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.049+0000 7fae98686700 1 -- start start 2021-11-15T19:32:33.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae9005c770 0x7fae90140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fae900b1030 0x7fae90143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fae900ac910 0x7fae900acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9005cb50 con 0x7fae900ac910 2021-11-15T19:32:33.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9013f910 con 0x7fae900b1030 2021-11-15T19:32:33.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9013fbb0 con 0x7fae9005c770 2021-11-15T19:32:33.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fae900b1030 0x7fae90143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fae900b1030 0x7fae90143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35950/0 (socket says 172.21.2.137:35950) 2021-11-15T19:32:33.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 -- 172.21.2.137:0/2616456320 learned_addr learned my addr 172.21.2.137:0/2616456320 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 -- 172.21.2.137:0/2616456320 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae9005c770 msgr2=0x7fae90140590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:33.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 --2- 172.21.2.137:0/2616456320 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae9005c770 0x7fae90140590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 -- 172.21.2.137:0/2616456320 >> v2:172.21.2.111:3300/0 conn(0x7fae900ac910 msgr2=0x7fae900acd40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:33.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 --2- 172.21.2.137:0/2616456320 >> v2:172.21.2.111:3300/0 conn(0x7fae900ac910 0x7fae900acd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 -- 172.21.2.137:0/2616456320 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9013fe50 con 0x7fae900b1030 2021-11-15T19:32:33.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95c21700 1 --2- 172.21.2.137:0/2616456320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae90143a70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fae84002f70 tx=0x7fae84006eb0).ready entity=mon.1 client_cookie=91fac2c084272e6d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95420700 1 -- 172.21.2.137:0/2616456320 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8400d570 con 0x7fae900b1030 2021-11-15T19:32:33.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95420700 1 -- 172.21.2.137:0/2616456320 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84000e90 con 0x7fae900b1030 2021-11-15T19:32:33.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae95420700 1 -- 172.21.2.137:0/2616456320 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8400d900 con 0x7fae900b1030 2021-11-15T19:32:33.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- 172.21.2.137:0/2616456320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 msgr2=0x7fae90143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- 172.21.2.137:0/2616456320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae90143a70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fae84002f70 tx=0x7fae84006eb0).stop 2021-11-15T19:32:33.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- 172.21.2.137:0/2616456320 shutdown_connections 2021-11-15T19:32:33.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- 172.21.2.137:0/2616456320 >> v2:172.21.2.111:3300/0 conn(0x7fae900ac910 0x7fae900acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- 172.21.2.137:0/2616456320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae90143a70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- 172.21.2.137:0/2616456320 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae9005c770 0x7fae90140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- 172.21.2.137:0/2616456320 >> 172.21.2.137:0/2616456320 conn(0x7fae900631e0 msgr2=0x7fae9005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- 172.21.2.137:0/2616456320 shutdown_connections 2021-11-15T19:32:33.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- 172.21.2.137:0/2616456320 wait complete. 2021-11-15T19:32:33.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 Processor -- start 2021-11-15T19:32:33.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- start start 2021-11-15T19:32:33.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fae9005c770 0x7fae90067480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae900ac910 0x7fae9013f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae900b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90065f10 con 0x7fae9005c770 2021-11-15T19:32:33.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90063760 con 0x7fae900b1030 2021-11-15T19:32:33.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae98686700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90140de0 con 0x7fae900ac910 2021-11-15T19:32:33.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae96c23700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae900b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae96c23700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae900b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35958/0 (socket says 172.21.2.137:35958) 2021-11-15T19:32:33.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae96c23700 1 -- 172.21.2.137:0/797086695 learned_addr learned my addr 172.21.2.137:0/797086695 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae96c23700 1 -- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae900ac910 msgr2=0x7fae9013f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae96c23700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae900ac910 0x7fae9013f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.053+0000 7fae96c23700 1 -- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fae9005c770 msgr2=0x7fae90067480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae96c23700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fae9005c770 0x7fae90067480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae96c23700 1 -- 172.21.2.137:0/797086695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8400b1e0 con 0x7fae900b1030 2021-11-15T19:32:33.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae96c23700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae900b5220 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fae88003270 tx=0x7fae880090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8800d4a0 con 0x7fae900b1030 2021-11-15T19:32:33.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800d600 con 0x7fae900b1030 2021-11-15T19:32:33.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8800d960 con 0x7fae900b1030 2021-11-15T19:32:33.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae90063950 con 0x7fae900b1030 2021-11-15T19:32:33.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90156440 con 0x7fae900b1030 2021-11-15T19:32:33.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90140f20 con 0x7fae900b1030 2021-11-15T19:32:33.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae88018030 con 0x7fae900b1030 2021-11-15T19:32:33.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae837fe700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fae70053520 0x7fae700559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fae8806b260 con 0x7fae900b1030 2021-11-15T19:32:33.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae96422700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fae70053520 0x7fae700559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.057+0000 7fae96422700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fae70053520 0x7fae700559e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fae8c002ef0 tx=0x7fae8c006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.061+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae88042360 con 0x7fae900b1030 2021-11-15T19:32:33.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fae901400f0 con 0x7fae900b1030 2021-11-15T19:32:33.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae837fe700 1 -- 172.21.2.137:0/797086695 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7fae88045980 con 0x7fae900b1030 2021-11-15T19:32:33.146 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:32:33.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fae70053520 msgr2=0x7fae700559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fae70053520 0x7fae700559e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fae8c002ef0 tx=0x7fae8c006910).stop 2021-11-15T19:32:33.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 msgr2=0x7fae900b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae900b5220 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fae88003270 tx=0x7fae880090f0).stop 2021-11-15T19:32:33.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 shutdown_connections 2021-11-15T19:32:33.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fae70053520 0x7fae700559e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fae900b1030 0x7fae900b5220 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fae900ac910 0x7fae9013f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 --2- 172.21.2.137:0/797086695 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fae9005c770 0x7fae90067480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 >> 172.21.2.137:0/797086695 conn(0x7fae900631e0 msgr2=0x7fae900b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 shutdown_connections 2021-11-15T19:32:33.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.141+0000 7fae98686700 1 -- 172.21.2.137:0/797086695 wait complete. 2021-11-15T19:32:33.153 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:32:33.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.201+0000 7fd20d900700 1 Processor -- start 2021-11-15T19:32:33.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.201+0000 7fd20d900700 1 -- start start 2021-11-15T19:32:33.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2080b0550 0x7fd20814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20805cb50 con 0x7fd20814aaa0 2021-11-15T19:32:33.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080ad030 con 0x7fd20805c770 2021-11-15T19:32:33.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080b1650 con 0x7fd2080b0550 2021-11-15T19:32:33.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2080b0550 0x7fd20814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2080b0550 0x7fd20814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35964/0 (socket says 172.21.2.137:35964) 2021-11-15T19:32:33.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 -- 172.21.2.137:0/4207827198 learned_addr learned my addr 172.21.2.137:0/4207827198 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 --1- 172.21.2.137:0/4207827198 >> v1:172.21.2.137:6789/0 conn(0x7fd20805c770 0x7fd2080aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54744/0 (socket says 172.21.2.137:54744) 2021-11-15T19:32:33.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 -- 172.21.2.137:0/4207827198 >> v1:172.21.2.137:6789/0 conn(0x7fd20805c770 legacy=0x7fd2080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 -- 172.21.2.137:0/4207827198 >> v1:172.21.2.111:6789/0 conn(0x7fd20814aaa0 legacy=0x7fd208140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:33.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 -- 172.21.2.137:0/4207827198 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080ad2d0 con 0x7fd2080b0550 2021-11-15T19:32:33.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd2067fc700 1 --2- 172.21.2.137:0/4207827198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2080b0550 0x7fd20814a5b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fd2080aee10 tx=0x7fd1f8006eb0).ready entity=mon.1 client_cookie=b76c3c21e811912a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd205ffb700 1 -- 172.21.2.137:0/4207827198 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f800d610 con 0x7fd2080b0550 2021-11-15T19:32:33.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd205ffb700 1 -- 172.21.2.137:0/4207827198 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8000e90 con 0x7fd2080b0550 2021-11-15T19:32:33.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd205ffb700 1 -- 172.21.2.137:0/4207827198 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f800d960 con 0x7fd2080b0550 2021-11-15T19:32:33.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/4207827198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2080b0550 msgr2=0x7fd20814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 --2- 172.21.2.137:0/4207827198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2080b0550 0x7fd20814a5b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fd2080aee10 tx=0x7fd1f8006eb0).stop 2021-11-15T19:32:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/4207827198 shutdown_connections 2021-11-15T19:32:33.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 --2- 172.21.2.137:0/4207827198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2080b0550 0x7fd20814a5b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/4207827198 >> 172.21.2.137:0/4207827198 conn(0x7fd2080631e0 msgr2=0x7fd20805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/4207827198 shutdown_connections 2021-11-15T19:32:33.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/4207827198 wait complete. 2021-11-15T19:32:33.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 Processor -- start 2021-11-15T19:32:33.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- start start 2021-11-15T19:32:33.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 0x7fd208066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2080b0550 0x7fd20815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd20814aaa0 0x7fd208146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208159cf0 con 0x7fd2080b0550 2021-11-15T19:32:33.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208142d40 con 0x7fd20805c770 2021-11-15T19:32:33.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd208142fe0 con 0x7fd20814aaa0 2021-11-15T19:32:33.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 0x7fd208066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 0x7fd208066a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35968/0 (socket says 172.21.2.137:35968) 2021-11-15T19:32:33.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 -- 172.21.2.137:0/2999125457 learned_addr learned my addr 172.21.2.137:0/2999125457 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 -- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd20814aaa0 msgr2=0x7fd208146840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:33.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd20814aaa0 0x7fd208146840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 -- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2080b0550 msgr2=0x7fd20815a3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:33.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2080b0550 0x7fd20815a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 -- 172.21.2.137:0/2999125457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f800b1e0 con 0x7fd20805c770 2021-11-15T19:32:33.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd206ffd700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 0x7fd208066a40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fd2080620e0 tx=0x7fd1f0007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f000ce30 con 0x7fd20805c770 2021-11-15T19:32:33.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00072e0 con 0x7fd20805c770 2021-11-15T19:32:33.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd208143280 con 0x7fd20805c770 2021-11-15T19:32:33.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f0007450 con 0x7fd20805c770 2021-11-15T19:32:33.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2081477e0 con 0x7fd20805c770 2021-11-15T19:32:33.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.205+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208144240 con 0x7fd20805c770 2021-11-15T19:32:33.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.209+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1f0010070 con 0x7fd20805c770 2021-11-15T19:32:33.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.209+0000 7fd1fffff700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1ec0536f0 0x7fd1ec055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.209+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd1f006b130 con 0x7fd20805c770 2021-11-15T19:32:33.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.209+0000 7fd2067fc700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1ec0536f0 0x7fd1ec055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.209+0000 7fd2067fc700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1ec0536f0 0x7fd1ec055bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fd2080aee10 tx=0x7fd1f8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.209+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1f0042180 con 0x7fd20805c770 2021-11-15T19:32:33.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.293+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd208143410 con 0x7fd20805c770 2021-11-15T19:32:33.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.293+0000 7fd1fffff700 1 -- 172.21.2.137:0/2999125457 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1f00457a0 con 0x7fd20805c770 2021-11-15T19:32:33.300 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:33.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1ec0536f0 msgr2=0x7fd1ec055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1ec0536f0 0x7fd1ec055bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fd2080aee10 tx=0x7fd1f8015000).stop 2021-11-15T19:32:33.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 msgr2=0x7fd208066a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 0x7fd208066a40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fd2080620e0 tx=0x7fd1f0007c40).stop 2021-11-15T19:32:33.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 shutdown_connections 2021-11-15T19:32:33.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1ec0536f0 0x7fd1ec055bb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd20814aaa0 0x7fd208146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2080b0550 0x7fd20815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 --2- 172.21.2.137:0/2999125457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd20805c770 0x7fd208066a40 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 >> 172.21.2.137:0/2999125457 conn(0x7fd2080631e0 msgr2=0x7fd208140400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 shutdown_connections 2021-11-15T19:32:33.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.297+0000 7fd20d900700 1 -- 172.21.2.137:0/2999125457 wait complete. 2021-11-15T19:32:33.307 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:32:33.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 Processor -- start 2021-11-15T19:32:33.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- start start 2021-11-15T19:32:33.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf940608a0 0x7fbf940af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbf9409a2f0 0x7fbf9409a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf940a9e50 con 0x7fbf940b11b0 2021-11-15T19:32:33.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940b1590 con 0x7fbf9409a2f0 2021-11-15T19:32:33.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94098d50 con 0x7fbf940608a0 2021-11-15T19:32:33.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbf9409a2f0 0x7fbf9409a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbf9409a2f0 0x7fbf9409a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35980/0 (socket says 172.21.2.137:35980) 2021-11-15T19:32:33.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 -- 172.21.2.137:0/2933008227 learned_addr learned my addr 172.21.2.137:0/2933008227 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 -- 172.21.2.137:0/2933008227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf940608a0 msgr2=0x7fbf940af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:33.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 --2- 172.21.2.137:0/2933008227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf940608a0 0x7fbf940af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 -- 172.21.2.137:0/2933008227 >> v1:172.21.2.111:6789/0 conn(0x7fbf940b11b0 legacy=0x7fbf9405c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:33.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 -- 172.21.2.137:0/2933008227 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940aa080 con 0x7fbf9409a2f0 2021-11-15T19:32:33.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf937fe700 1 --2- 172.21.2.137:0/2933008227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf9409a2f0 0x7fbf9409a760 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fbf94062290 tx=0x7fbf8c009290).ready entity=mon.1 client_cookie=c2bf4e57b066c40b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf91ffb700 1 -- 172.21.2.137:0/2933008227 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf8c00b860 con 0x7fbf9409a2f0 2021-11-15T19:32:33.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf91ffb700 1 -- 172.21.2.137:0/2933008227 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c00b9c0 con 0x7fbf9409a2f0 2021-11-15T19:32:33.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf91ffb700 1 -- 172.21.2.137:0/2933008227 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf8c00bb70 con 0x7fbf9409a2f0 2021-11-15T19:32:33.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- 172.21.2.137:0/2933008227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf9409a2f0 msgr2=0x7fbf9409a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2933008227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf9409a2f0 0x7fbf9409a760 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fbf94062290 tx=0x7fbf8c009290).stop 2021-11-15T19:32:33.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- 172.21.2.137:0/2933008227 shutdown_connections 2021-11-15T19:32:33.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2933008227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf9409a2f0 0x7fbf9409a760 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2933008227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf940608a0 0x7fbf940af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- 172.21.2.137:0/2933008227 >> 172.21.2.137:0/2933008227 conn(0x7fbf940b22b0 msgr2=0x7fbf9405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- 172.21.2.137:0/2933008227 shutdown_connections 2021-11-15T19:32:33.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- 172.21.2.137:0/2933008227 wait complete. 2021-11-15T19:32:33.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 Processor -- start 2021-11-15T19:32:33.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.361+0000 7fbf93fff700 1 -- start start 2021-11-15T19:32:33.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 0x7fbf94066e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf9409a2f0 0x7fbf94067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbf940b11b0 0x7fbf94159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940633f0 con 0x7fbf940b11b0 2021-11-15T19:32:33.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94062780 con 0x7fbf940608a0 2021-11-15T19:32:33.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94062a20 con 0x7fbf9409a2f0 2021-11-15T19:32:33.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 0x7fbf94066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 0x7fbf94066e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35986/0 (socket says 172.21.2.137:35986) 2021-11-15T19:32:33.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 -- 172.21.2.137:0/2257777572 learned_addr learned my addr 172.21.2.137:0/2257777572 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 -- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf9409a2f0 msgr2=0x7fbf94067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf9409a2f0 0x7fbf94067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 -- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbf940b11b0 msgr2=0x7fbf94159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbf940b11b0 0x7fbf94159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 -- 172.21.2.137:0/2257777572 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c009530 con 0x7fbf940608a0 2021-11-15T19:32:33.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf92ffd700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 0x7fbf94066e50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fbf7c002f10 tx=0x7fbf7c006d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7c00f510 con 0x7fbf940608a0 2021-11-15T19:32:33.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c00f670 con 0x7fbf940608a0 2021-11-15T19:32:33.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf940aec20 con 0x7fbf940608a0 2021-11-15T19:32:33.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7c00f7e0 con 0x7fbf940608a0 2021-11-15T19:32:33.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf94066730 con 0x7fbf940608a0 2021-11-15T19:32:33.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94062be0 con 0x7fbf940608a0 2021-11-15T19:32:33.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf7c017020 con 0x7fbf940608a0 2021-11-15T19:32:33.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf8bfff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbf78053660 0x7fbf78055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbf7c06aca0 con 0x7fbf940608a0 2021-11-15T19:32:33.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.365+0000 7fbf927fc700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbf78053660 0x7fbf78055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.369+0000 7fbf927fc700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbf78053660 0x7fbf78055b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fbf84002f70 tx=0x7fbf84006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.369+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf7c041c90 con 0x7fbf940608a0 2021-11-15T19:32:33.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.449+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf940aedb0 con 0x7fbf940608a0 2021-11-15T19:32:33.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.449+0000 7fbf8bfff700 1 -- 172.21.2.137:0/2257777572 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbf940aedb0 con 0x7fbf940608a0 2021-11-15T19:32:33.455 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:33.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbf78053660 msgr2=0x7fbf78055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbf78053660 0x7fbf78055b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fbf84002f70 tx=0x7fbf84006a80).stop 2021-11-15T19:32:33.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 msgr2=0x7fbf94066e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 0x7fbf94066e50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fbf7c002f10 tx=0x7fbf7c006d70).stop 2021-11-15T19:32:33.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 shutdown_connections 2021-11-15T19:32:33.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbf78053660 0x7fbf78055b20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbf940b11b0 0x7fbf94159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbf9409a2f0 0x7fbf94067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 --2- 172.21.2.137:0/2257777572 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbf940608a0 0x7fbf94066e50 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 >> 172.21.2.137:0/2257777572 conn(0x7fbf940b22b0 msgr2=0x7fbf94099970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 shutdown_connections 2021-11-15T19:32:33.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.453+0000 7fbf93fff700 1 -- 172.21.2.137:0/2257777572 wait complete. 2021-11-15T19:32:33.462 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:32:33.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 Processor -- start 2021-11-15T19:32:33.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 -- start start 2021-11-15T19:32:33.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faa3805c770 0x7faa380aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faa380b0550 0x7faa3814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3805cb50 con 0x7faa3814aaa0 2021-11-15T19:32:33.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b1650 con 0x7faa3805c770 2021-11-15T19:32:33.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.509+0000 7faa3e9ab700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380ad030 con 0x7faa380b0550 2021-11-15T19:32:33.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faa380b0550 0x7faa3814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faa380b0550 0x7faa3814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:35994/0 (socket says 172.21.2.137:35994) 2021-11-15T19:32:33.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 -- 172.21.2.137:0/2040845277 learned_addr learned my addr 172.21.2.137:0/2040845277 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 -- 172.21.2.137:0/2040845277 >> v2:172.21.2.111:3300/0 conn(0x7faa3805c770 msgr2=0x7faa380aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:33.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 --2- 172.21.2.137:0/2040845277 >> v2:172.21.2.111:3300/0 conn(0x7faa3805c770 0x7faa380aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 -- 172.21.2.137:0/2040845277 >> v1:172.21.2.111:6789/0 conn(0x7faa3814aaa0 legacy=0x7faa38140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:33.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 -- 172.21.2.137:0/2040845277 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380ad2d0 con 0x7faa380b0550 2021-11-15T19:32:33.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa377fe700 1 --2- 172.21.2.137:0/2040845277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa380b0550 0x7faa3814a5b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7faa380aee10 tx=0x7faa2c006eb0).ready entity=mon.1 client_cookie=806345c56968492e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa36ffd700 1 -- 172.21.2.137:0/2040845277 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00d5c0 con 0x7faa380b0550 2021-11-15T19:32:33.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa36ffd700 1 -- 172.21.2.137:0/2040845277 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c000e90 con 0x7faa380b0550 2021-11-15T19:32:33.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa36ffd700 1 -- 172.21.2.137:0/2040845277 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00d910 con 0x7faa380b0550 2021-11-15T19:32:33.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/2040845277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa380b0550 msgr2=0x7faa3814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/2040845277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa380b0550 0x7faa3814a5b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7faa380aee10 tx=0x7faa2c006eb0).stop 2021-11-15T19:32:33.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/2040845277 shutdown_connections 2021-11-15T19:32:33.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/2040845277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa380b0550 0x7faa3814a5b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/2040845277 >> v2:172.21.2.111:3300/0 conn(0x7faa3805c770 0x7faa380aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/2040845277 >> 172.21.2.137:0/2040845277 conn(0x7faa380631e0 msgr2=0x7faa3805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/2040845277 shutdown_connections 2021-11-15T19:32:33.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/2040845277 wait complete. 2021-11-15T19:32:33.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 Processor -- start 2021-11-15T19:32:33.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- start start 2021-11-15T19:32:33.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa3805c770 0x7faa381474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa380b0550 0x7faa38066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 0x7faa38146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa381430e0 con 0x7faa3805c770 2021-11-15T19:32:33.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38142ba0 con 0x7faa3814aaa0 2021-11-15T19:32:33.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa38142e40 con 0x7faa380b0550 2021-11-15T19:32:33.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 0x7faa38146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 0x7faa38146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36000/0 (socket says 172.21.2.137:36000) 2021-11-15T19:32:33.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 -- 172.21.2.137:0/35132476 learned_addr learned my addr 172.21.2.137:0/35132476 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 -- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa380b0550 msgr2=0x7faa38066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa380b0550 0x7faa38066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 -- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa3805c770 msgr2=0x7faa381474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa3805c770 0x7faa381474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 -- 172.21.2.137:0/35132476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c00b1e0 con 0x7faa3814aaa0 2021-11-15T19:32:33.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3cf48700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 0x7faa38146eb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7faa30003270 tx=0x7faa300090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa3000d4a0 con 0x7faa3814aaa0 2021-11-15T19:32:33.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000d600 con 0x7faa3814aaa0 2021-11-15T19:32:33.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa38159de0 con 0x7faa3814aaa0 2021-11-15T19:32:33.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa3000d960 con 0x7faa3814aaa0 2021-11-15T19:32:33.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.513+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3815a300 con 0x7faa3814aaa0 2021-11-15T19:32:33.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa380ae7f0 con 0x7faa3814aaa0 2021-11-15T19:32:33.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa30018030 con 0x7faa3814aaa0 2021-11-15T19:32:33.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa357fa700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faa180536a0 0x7faa18055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faa3006b260 con 0x7faa3814aaa0 2021-11-15T19:32:33.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa37fff700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faa180536a0 0x7faa18055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa37fff700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faa180536a0 0x7faa18055b60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7faa28002f70 tx=0x7faa28006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.517+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa30042360 con 0x7faa3814aaa0 2021-11-15T19:32:33.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa380573d0 con 0x7faa3814aaa0 2021-11-15T19:32:33.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa357fa700 1 -- 172.21.2.137:0/35132476 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+10 (secure 0 0 0) 0x7faa30045980 con 0x7faa3814aaa0 2021-11-15T19:32:33.605 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:33.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faa180536a0 msgr2=0x7faa18055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faa180536a0 0x7faa18055b60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7faa28002f70 tx=0x7faa28006a80).stop 2021-11-15T19:32:33.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 msgr2=0x7faa38146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 0x7faa38146eb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7faa30003270 tx=0x7faa300090f0).stop 2021-11-15T19:32:33.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 shutdown_connections 2021-11-15T19:32:33.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faa180536a0 0x7faa18055b60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa3814aaa0 0x7faa38146eb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa380b0550 0x7faa38066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 --2- 172.21.2.137:0/35132476 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa3805c770 0x7faa381474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 >> 172.21.2.137:0/35132476 conn(0x7faa380631e0 msgr2=0x7faa38140390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 shutdown_connections 2021-11-15T19:32:33.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.601+0000 7faa3e9ab700 1 -- 172.21.2.137:0/35132476 wait complete. 2021-11-15T19:32:33.612 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:32:33.612 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:33.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.657+0000 7eff99c0c700 1 Processor -- start 2021-11-15T19:32:33.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- start start 2021-11-15T19:32:33.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff940b1340 0x7eff94147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff94144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7eff940a9f50 0x7eff940aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff94148190 con 0x7eff940a9f50 2021-11-15T19:32:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff940b1720 con 0x7eff940b1340 2021-11-15T19:32:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff94147e70 con 0x7eff94143f00 2021-11-15T19:32:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff940b1340 0x7eff94147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff940b1340 0x7eff94147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36004/0 (socket says 172.21.2.137:36004) 2021-11-15T19:32:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 -- 172.21.2.137:0/1826459509 learned_addr learned my addr 172.21.2.137:0/1826459509 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 -- 172.21.2.137:0/1826459509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 msgr2=0x7eff94144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 --2- 172.21.2.137:0/1826459509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff94144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 -- 172.21.2.137:0/1826459509 >> v2:172.21.2.111:3300/0 conn(0x7eff940a9f50 msgr2=0x7eff940aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 --2- 172.21.2.137:0/1826459509 >> v2:172.21.2.111:3300/0 conn(0x7eff940a9f50 0x7eff940aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 -- 172.21.2.137:0/1826459509 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940af800 con 0x7eff940b1340 2021-11-15T19:32:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff937fe700 1 --2- 172.21.2.137:0/1826459509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff94147980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7eff7c002f70 tx=0x7eff7c006eb0).ready entity=mon.1 client_cookie=45c189f2338a041a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff927fc700 1 -- 172.21.2.137:0/1826459509 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c00d570 con 0x7eff940b1340 2021-11-15T19:32:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff927fc700 1 -- 172.21.2.137:0/1826459509 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c000e90 con 0x7eff940b1340 2021-11-15T19:32:33.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff927fc700 1 -- 172.21.2.137:0/1826459509 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c00d900 con 0x7eff940b1340 2021-11-15T19:32:33.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- 172.21.2.137:0/1826459509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 msgr2=0x7eff94147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- 172.21.2.137:0/1826459509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff94147980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7eff7c002f70 tx=0x7eff7c006eb0).stop 2021-11-15T19:32:33.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- 172.21.2.137:0/1826459509 shutdown_connections 2021-11-15T19:32:33.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- 172.21.2.137:0/1826459509 >> v2:172.21.2.111:3300/0 conn(0x7eff940a9f50 0x7eff940aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- 172.21.2.137:0/1826459509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff94144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:33.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- 172.21.2.137:0/1826459509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff94147980 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- 172.21.2.137:0/1826459509 >> 172.21.2.137:0/1826459509 conn(0x7eff940b4e60 msgr2=0x7eff940b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- 172.21.2.137:0/1826459509 shutdown_connections 2021-11-15T19:32:33.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- 172.21.2.137:0/1826459509 wait complete. 2021-11-15T19:32:33.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 Processor -- start 2021-11-15T19:32:33.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- start start 2021-11-15T19:32:33.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff940a9f50 0x7eff94159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff9409a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff9413edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9413fe30 con 0x7eff940a9f50 2021-11-15T19:32:33.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9414b280 con 0x7eff940b1340 2021-11-15T19:32:33.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.661+0000 7eff99c0c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff94140060 con 0x7eff94143f00 2021-11-15T19:32:33.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff9409a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff9409a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36012/0 (socket says 172.21.2.137:36012) 2021-11-15T19:32:33.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 -- 172.21.2.137:0/2139109711 learned_addr learned my addr 172.21.2.137:0/2139109711 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:33.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff937fe700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff940a9f50 0x7eff94159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff93fff700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff9413edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 -- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 msgr2=0x7eff9413edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff9413edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 -- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff940a9f50 msgr2=0x7eff94159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff940a9f50 0x7eff94159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 -- 172.21.2.137:0/2139109711 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c00b1e0 con 0x7eff940b1340 2021-11-15T19:32:33.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff92ffd700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff9409a1a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7eff84002f70 tx=0x7eff84006e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff8400e470 con 0x7eff940b1340 2021-11-15T19:32:33.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400e5d0 con 0x7eff940b1340 2021-11-15T19:32:33.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff8400e930 con 0x7eff940b1340 2021-11-15T19:32:33.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff94148810 con 0x7eff940b1340 2021-11-15T19:32:33.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9414af00 con 0x7eff940b1340 2021-11-15T19:32:33.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9409ae20 con 0x7eff940b1340 2021-11-15T19:32:33.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff84018030 con 0x7eff940b1340 2021-11-15T19:32:33.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff90ff9700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff78053720 0x7eff78055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:33.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7eff8406aef0 con 0x7eff940b1340 2021-11-15T19:32:33.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.665+0000 7eff937fe700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff78053720 0x7eff78055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:33.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.669+0000 7eff937fe700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff78053720 0x7eff78055be0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7eff7c01a000 tx=0x7eff7c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:33.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.669+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff9409ae20 con 0x7eff940b1340 2021-11-15T19:32:33.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff94140220 con 0x7eff940b1340 2021-11-15T19:32:33.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff90ff9700 1 -- 172.21.2.137:0/2139109711 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7eff84041ff0 con 0x7eff940b1340 2021-11-15T19:32:33.780 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:33.781 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:32:33.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff78053720 msgr2=0x7eff78055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff78053720 0x7eff78055be0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7eff7c01a000 tx=0x7eff7c015000).stop 2021-11-15T19:32:33.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 msgr2=0x7eff9409a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:33.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff9409a1a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7eff84002f70 tx=0x7eff84006e50).stop 2021-11-15T19:32:33.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 shutdown_connections 2021-11-15T19:32:33.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff78053720 0x7eff78055be0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff94143f00 0x7eff9413edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff940b1340 0x7eff9409a1a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 --2- 172.21.2.137:0/2139109711 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff940a9f50 0x7eff94159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:33.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 >> 172.21.2.137:0/2139109711 conn(0x7eff940b4e60 msgr2=0x7eff940b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:33.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 shutdown_connections 2021-11-15T19:32:33.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:33.777+0000 7eff99c0c700 1 -- 172.21.2.137:0/2139109711 wait complete. 2021-11-15T19:32:33.784 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:32:33.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:32:30.455951+0000', 'modified': '2021-11-15T19:32:31.460820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6184': {'gid': 6184, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1730106945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1730106945}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1730106945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:32:33.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:32:33.990 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:32:34.054 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6184,"want_state":"up:active","state":"up:active","rank_uptime":3.5867106020000001,"mdsmap_epoch":32,"osdmap_epoch":73,"osdmap_epoch_barrier":72,"uptime":7.6776886470000001} 2021-11-15T19:32:34.055 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6184, "mdsmap_epoch": 32, "osdmap_epoch": 73, "osdmap_epoch_barrier": 72, "rank_uptime": 3.586710602, "state": "up:active", "uptime": 7.677688647, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:32:34.055 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:32:34.056 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:32:34.056 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:32:34.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.057 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:34.068 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:32:34.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:32:34.080 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:32:34.086 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:32:34.087 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:32:34.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.088 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:32:34.133 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:32:34.134 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:34.137 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:32:34.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:32:34.146 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:32:34.175 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14678]: starting ceph client 2021-11-15T19:32:34.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:32:34.170+0000 7f47b1609080 -1 init, newargv = 0x55e196dcac00 newargc=9 2021-11-15T19:32:34.181 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:32:34.182 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:32:34.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.183 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:32:34.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14678]: starting fuse 2021-11-15T19:32:34.189 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:32:34.190 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:32:34.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.191 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:32:34.191 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:32:34.192 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:32:34.192 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:32:34.192 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:32:34.193 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:32:34.193 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:32:34.193 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:32:34.194 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:32:34.194 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:32:34.195 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:32:34.195 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:32:34.195 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:32:34.196 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:32:34.196 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:32:34.197 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:32:34.197 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:32:34.197 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:32:34.198 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:32:34.198 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:32:34.199 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:32:34.199 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:32:34.199 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:32:34.256 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14678.asok 2021-11-15T19:32:34.259 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14678.asok 2021-11-15T19:32:34.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.260 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14678.asok status 2021-11-15T19:32:34.308 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:32:34.309 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:32:34.309 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:32:34.309 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:32:34.310 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:32:34.310 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:32:34.310 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:32:34.310 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14678", 2021-11-15T19:32:34.311 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:32:34.311 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:32:34.311 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:32:34.311 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:32:34.311 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 6346, 2021-11-15T19:32:34.312 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:32:34.312 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:32:34.312 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:32:34.312 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 6346 2021-11-15T19:32:34.313 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:32:34.313 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:32:34.313 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:32:34.313 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:32:34.313 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2457368916 2021-11-15T19:32:34.314 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:32:34.314 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:32:34.314 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:32:34.314 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:32:34.315 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:32:34.315 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2457368916 2021-11-15T19:32:34.315 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:32:34.315 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.6346 172.21.2.131:0/2457368916", 2021-11-15T19:32:34.315 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2457368916", 2021-11-15T19:32:34.316 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:32:34.316 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 32, 2021-11-15T19:32:34.316 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 73, 2021-11-15T19:32:34.316 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:32:34.317 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:32:34.317 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:32:34.317 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:32:34.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.319 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:34.319 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:34.325 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:32:34.325 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:32:34.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:34.326 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:34.375 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:32:34.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 Processor -- start 2021-11-15T19:32:34.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- start start 2021-11-15T19:32:34.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1f140b1340 0x7f1f14147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1f140a9f50 0x7f1f140aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f14148190 con 0x7f1f14143f00 2021-11-15T19:32:34.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140b1720 con 0x7f1f140a9f50 2021-11-15T19:32:34.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f14147e70 con 0x7f1f140b1340 2021-11-15T19:32:34.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f12ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1f140b1340 0x7f1f14147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f127fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1f14143f00 0x7f1f14144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54802/0 (socket says 172.21.2.137:54802) 2021-11-15T19:32:34.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f127fc700 1 -- 172.21.2.137:0/3677655022 learned_addr learned my addr 172.21.2.137:0/3677655022 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:34.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f12ffd700 1 -- 172.21.2.137:0/3677655022 >> v2:172.21.2.111:3300/0 conn(0x7f1f140a9f50 msgr2=0x7f1f140aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:34.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f12ffd700 1 --2- 172.21.2.137:0/3677655022 >> v2:172.21.2.111:3300/0 conn(0x7f1f140a9f50 0x7f1f140aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f12ffd700 1 -- 172.21.2.137:0/3677655022 >> v1:172.21.2.137:6789/0 conn(0x7f1f14143f00 legacy=0x7f1f14144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f12ffd700 1 -- 172.21.2.137:0/3677655022 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140af800 con 0x7f1f140b1340 2021-11-15T19:32:34.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f12ffd700 1 --2- 172.21.2.137:0/3677655022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140b1340 0x7f1f14147980 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f1f04002f70 tx=0x7f1f04006df0).ready entity=mon.1 client_cookie=576c24191bbc9a7f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f11ffb700 1 -- 172.21.2.137:0/3677655022 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0400d5c0 con 0x7f1f140b1340 2021-11-15T19:32:34.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f11ffb700 1 -- 172.21.2.137:0/3677655022 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f04000e90 con 0x7f1f140b1340 2021-11-15T19:32:34.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f11ffb700 1 -- 172.21.2.137:0/3677655022 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0400d910 con 0x7f1f140b1340 2021-11-15T19:32:34.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- 172.21.2.137:0/3677655022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140b1340 msgr2=0x7f1f14147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 --2- 172.21.2.137:0/3677655022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140b1340 0x7f1f14147980 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f1f04002f70 tx=0x7f1f04006df0).stop 2021-11-15T19:32:34.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- 172.21.2.137:0/3677655022 shutdown_connections 2021-11-15T19:32:34.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 --2- 172.21.2.137:0/3677655022 >> v2:172.21.2.111:3300/0 conn(0x7f1f140a9f50 0x7f1f140aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 --2- 172.21.2.137:0/3677655022 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140b1340 0x7f1f14147980 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.429+0000 7f1f1944c700 1 -- 172.21.2.137:0/3677655022 >> 172.21.2.137:0/3677655022 conn(0x7f1f140b4e60 msgr2=0x7f1f140b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- 172.21.2.137:0/3677655022 shutdown_connections 2021-11-15T19:32:34.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- 172.21.2.137:0/3677655022 wait complete. 2021-11-15T19:32:34.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 Processor -- start 2021-11-15T19:32:34.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- start start 2021-11-15T19:32:34.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 0x7f1f140aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f140b1340 0x7f1f141567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f14143f00 0x7f1f14156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140ad6e0 con 0x7f1f14143f00 2021-11-15T19:32:34.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1409a390 con 0x7f1f140a9f50 2021-11-15T19:32:34.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140ac830 con 0x7f1f140b1340 2021-11-15T19:32:34.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 0x7f1f140aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 0x7f1f140aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36024/0 (socket says 172.21.2.137:36024) 2021-11-15T19:32:34.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 -- 172.21.2.137:0/616027329 learned_addr learned my addr 172.21.2.137:0/616027329 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 -- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f140b1340 msgr2=0x7f1f141567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f140b1340 0x7f1f141567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 -- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f14143f00 msgr2=0x7f1f14156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f14143f00 0x7f1f14156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 -- 172.21.2.137:0/616027329 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0400b180 con 0x7f1f140a9f50 2021-11-15T19:32:34.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f12ffd700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 0x7f1f140aee60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f1f04002f70 tx=0x7f1f04014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f04016070 con 0x7f1f140a9f50 2021-11-15T19:32:34.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f04013800 con 0x7f1f140a9f50 2021-11-15T19:32:34.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f04013b60 con 0x7f1f140a9f50 2021-11-15T19:32:34.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f140af350 con 0x7f1f140a9f50 2021-11-15T19:32:34.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f14140180 con 0x7f1f140a9f50 2021-11-15T19:32:34.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f140af660 con 0x7f1f140a9f50 2021-11-15T19:32:34.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f04025030 con 0x7f1f140a9f50 2021-11-15T19:32:34.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f03fff700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ef0053610 0x7f1ef0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.433+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1f0406c970 con 0x7f1f140a9f50 2021-11-15T19:32:34.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.437+0000 7f1f127fc700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ef0053610 0x7f1ef0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.437+0000 7f1f127fc700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ef0053610 0x7f1ef0055ad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f1f14062250 tx=0x7f1f08007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.437+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f140af660 con 0x7f1f140a9f50 2021-11-15T19:32:34.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f140af660 con 0x7f1f140a9f50 2021-11-15T19:32:34.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f03fff700 1 -- 172.21.2.137:0/616027329 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f1f140af660 con 0x7f1f140a9f50 2021-11-15T19:32:34.525 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:34.526 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:32:31.461891+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:32:28.410587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T19:32:29.429846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:32:34.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ef0053610 msgr2=0x7f1ef0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ef0053610 0x7f1ef0055ad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f1f14062250 tx=0x7f1f08007800).stop 2021-11-15T19:32:34.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 msgr2=0x7f1f140aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 0x7f1f140aee60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f1f04002f70 tx=0x7f1f04014000).stop 2021-11-15T19:32:34.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 shutdown_connections 2021-11-15T19:32:34.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ef0053610 0x7f1ef0055ad0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1f14143f00 0x7f1f14156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1f140b1340 0x7f1f141567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 --2- 172.21.2.137:0/616027329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1f140a9f50 0x7f1f140aee60 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 >> 172.21.2.137:0/616027329 conn(0x7f1f140b4e60 msgr2=0x7f1f140b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 shutdown_connections 2021-11-15T19:32:34.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.521+0000 7f1f1944c700 1 -- 172.21.2.137:0/616027329 wait complete. 2021-11-15T19:32:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:32:28.410587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:32:29.429846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:32:34.534 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:32:34.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 Processor -- start 2021-11-15T19:32:34.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 -- start start 2021-11-15T19:32:34.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b0550 0x7ff30414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff30414aaa0 0x7ff304140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30405cb50 con 0x7ff30405c770 2021-11-15T19:32:34.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3040b1650 con 0x7ff30414aaa0 2021-11-15T19:32:34.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3097c1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040ad030 con 0x7ff3040b0550 2021-11-15T19:32:34.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff30414aaa0 0x7ff304140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff30414aaa0 0x7ff304140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36034/0 (socket says 172.21.2.137:36034) 2021-11-15T19:32:34.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 -- 172.21.2.137:0/2509841306 learned_addr learned my addr 172.21.2.137:0/2509841306 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 -- 172.21.2.137:0/2509841306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b0550 msgr2=0x7ff30414a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:34.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 --2- 172.21.2.137:0/2509841306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b0550 0x7ff30414a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 -- 172.21.2.137:0/2509841306 >> v1:172.21.2.111:6789/0 conn(0x7ff30405c770 legacy=0x7ff3040aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:34.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 -- 172.21.2.137:0/2509841306 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040ad2d0 con 0x7ff30414aaa0 2021-11-15T19:32:34.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff3037fe700 1 --2- 172.21.2.137:0/2509841306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff30414aaa0 0x7ff304140aa0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7ff3040adfd0 tx=0x7ff2fc009290).ready entity=mon.1 client_cookie=3067de1f24b0c6e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff301ffb700 1 -- 172.21.2.137:0/2509841306 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc00b860 con 0x7ff30414aaa0 2021-11-15T19:32:34.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff301ffb700 1 -- 172.21.2.137:0/2509841306 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00b9c0 con 0x7ff30414aaa0 2021-11-15T19:32:34.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.581+0000 7ff301ffb700 1 -- 172.21.2.137:0/2509841306 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc00bb70 con 0x7ff30414aaa0 2021-11-15T19:32:34.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/2509841306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff30414aaa0 msgr2=0x7ff304140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 --2- 172.21.2.137:0/2509841306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff30414aaa0 0x7ff304140aa0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7ff3040adfd0 tx=0x7ff2fc009290).stop 2021-11-15T19:32:34.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/2509841306 shutdown_connections 2021-11-15T19:32:34.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 --2- 172.21.2.137:0/2509841306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff30414aaa0 0x7ff304140aa0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 --2- 172.21.2.137:0/2509841306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b0550 0x7ff30414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/2509841306 >> 172.21.2.137:0/2509841306 conn(0x7ff3040631e0 msgr2=0x7ff30405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/2509841306 shutdown_connections 2021-11-15T19:32:34.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/2509841306 wait complete. 2021-11-15T19:32:34.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 Processor -- start 2021-11-15T19:32:34.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- start start 2021-11-15T19:32:34.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff30405c770 0x7ff304142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 0x7ff304066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff30414aaa0 0x7ff3040670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304141d10 con 0x7ff30414aaa0 2021-11-15T19:32:34.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304064480 con 0x7ff3040b0550 2021-11-15T19:32:34.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304064720 con 0x7ff30405c770 2021-11-15T19:32:34.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 0x7ff304066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 0x7ff304066bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36040/0 (socket says 172.21.2.137:36040) 2021-11-15T19:32:34.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 -- 172.21.2.137:0/3031639208 learned_addr learned my addr 172.21.2.137:0/3031639208 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 -- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff30405c770 msgr2=0x7ff304142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff30405c770 0x7ff304142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 -- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff30414aaa0 msgr2=0x7ff3040670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff30414aaa0 0x7ff3040670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 -- 172.21.2.137:0/3031639208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc009530 con 0x7ff3040b0550 2021-11-15T19:32:34.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3027fc700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 0x7ff304066bc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7ff2f8002fb0 tx=0x7ff2f8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f8013460 con 0x7ff3040b0550 2021-11-15T19:32:34.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f80135c0 con 0x7ff3040b0550 2021-11-15T19:32:34.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff304142270 con 0x7ff3040b0550 2021-11-15T19:32:34.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff304142710 con 0x7ff3040b0550 2021-11-15T19:32:34.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f8013920 con 0x7ff3040b0550 2021-11-15T19:32:34.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff304142400 con 0x7ff3040b0550 2021-11-15T19:32:34.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2f800f070 con 0x7ff3040b0550 2021-11-15T19:32:34.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff2f3fff700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e0053610 0x7ff2e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.585+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff2f806b4d0 con 0x7ff3040b0550 2021-11-15T19:32:34.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.589+0000 7ff302ffd700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e0053610 0x7ff2e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.589+0000 7ff302ffd700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e0053610 0x7ff2e0055ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff2f4002ef0 tx=0x7ff2f4006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.589+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2f8042520 con 0x7ff3040b0550 2021-11-15T19:32:34.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3040ae7f0 con 0x7ff3040b0550 2021-11-15T19:32:34.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff2f3fff700 1 -- 172.21.2.137:0/3031639208 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff2f8045b40 con 0x7ff3040b0550 2021-11-15T19:32:34.676 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:32:34.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e0053610 msgr2=0x7ff2e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e0053610 0x7ff2e0055ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff2f4002ef0 tx=0x7ff2f4006910).stop 2021-11-15T19:32:34.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 msgr2=0x7ff304066bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 0x7ff304066bc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7ff2f8002fb0 tx=0x7ff2f8006df0).stop 2021-11-15T19:32:34.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 shutdown_connections 2021-11-15T19:32:34.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e0053610 0x7ff2e0055ad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff30414aaa0 0x7ff3040670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff3040b0550 0x7ff304066bc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 --2- 172.21.2.137:0/3031639208 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff30405c770 0x7ff304142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 >> 172.21.2.137:0/3031639208 conn(0x7ff3040631e0 msgr2=0x7ff304149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 shutdown_connections 2021-11-15T19:32:34.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.673+0000 7ff3097c1700 1 -- 172.21.2.137:0/3031639208 wait complete. 2021-11-15T19:32:34.683 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:32:34.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 Processor -- start 2021-11-15T19:32:34.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- start start 2021-11-15T19:32:34.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff0d40b0fe0 0x7ff0d40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff0d40acff0 0x7ff0d40af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d413f5c0 0x7ff0d413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40ad4a0 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40ae070 con 0x7ff0d40acff0 2021-11-15T19:32:34.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40aedf0 con 0x7ff0d413f5c0 2021-11-15T19:32:34.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff0d40acff0 0x7ff0d40af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff0d40acff0 0x7ff0d40af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36048/0 (socket says 172.21.2.137:36048) 2021-11-15T19:32:34.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 -- 172.21.2.137:0/2446451609 learned_addr learned my addr 172.21.2.137:0/2446451609 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 -- 172.21.2.137:0/2446451609 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d413f5c0 msgr2=0x7ff0d413fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:34.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 --2- 172.21.2.137:0/2446451609 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d413f5c0 0x7ff0d413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 -- 172.21.2.137:0/2446451609 >> v2:172.21.2.111:3300/0 conn(0x7ff0d40b0fe0 msgr2=0x7ff0d40afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:34.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 --2- 172.21.2.137:0/2446451609 >> v2:172.21.2.111:3300/0 conn(0x7ff0d40b0fe0 0x7ff0d40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 -- 172.21.2.137:0/2446451609 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40b13c0 con 0x7ff0d40acff0 2021-11-15T19:32:34.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d37fe700 1 --2- 172.21.2.137:0/2446451609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40acff0 0x7ff0d40af4c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7ff0c4002f70 tx=0x7ff0c4006f40).ready entity=mon.1 client_cookie=f4830537b98ef722 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d2ffd700 1 -- 172.21.2.137:0/2446451609 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c400dc70 con 0x7ff0d40acff0 2021-11-15T19:32:34.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d2ffd700 1 -- 172.21.2.137:0/2446451609 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4000e90 con 0x7ff0d40acff0 2021-11-15T19:32:34.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0d2ffd700 1 -- 172.21.2.137:0/2446451609 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c400be90 con 0x7ff0d40acff0 2021-11-15T19:32:34.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- 172.21.2.137:0/2446451609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40acff0 msgr2=0x7ff0d40af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- 172.21.2.137:0/2446451609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40acff0 0x7ff0d40af4c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7ff0c4002f70 tx=0x7ff0c4006f40).stop 2021-11-15T19:32:34.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- 172.21.2.137:0/2446451609 shutdown_connections 2021-11-15T19:32:34.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- 172.21.2.137:0/2446451609 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d413f5c0 0x7ff0d413fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- 172.21.2.137:0/2446451609 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40acff0 0x7ff0d40af4c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 --2- 172.21.2.137:0/2446451609 >> v2:172.21.2.111:3300/0 conn(0x7ff0d40b0fe0 0x7ff0d40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- 172.21.2.137:0/2446451609 >> 172.21.2.137:0/2446451609 conn(0x7ff0d40b5f50 msgr2=0x7ff0d40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- 172.21.2.137:0/2446451609 shutdown_connections 2021-11-15T19:32:34.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- 172.21.2.137:0/2446451609 wait complete. 2021-11-15T19:32:34.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 Processor -- start 2021-11-15T19:32:34.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.733+0000 7ff0da942700 1 -- start start 2021-11-15T19:32:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d40acff0 0x7ff0d4065af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 0x7ff0d413dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0d413f5c0 0x7ff0d41127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4066d50 con 0x7ff0d413f5c0 2021-11-15T19:32:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4066ff0 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4067290 con 0x7ff0d40acff0 2021-11-15T19:32:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 0x7ff0d413dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 0x7ff0d413dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36052/0 (socket says 172.21.2.137:36052) 2021-11-15T19:32:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 -- 172.21.2.137:0/4217153650 learned_addr learned my addr 172.21.2.137:0/4217153650 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 -- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d40acff0 msgr2=0x7ff0d4065af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d40acff0 0x7ff0d4065af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 -- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0d413f5c0 msgr2=0x7ff0d41127f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0d413f5c0 0x7ff0d41127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 -- 172.21.2.137:0/4217153650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c400b460 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d37fe700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 0x7ff0d413dd10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7ff0c4002f70 tx=0x7ff0c4006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c401d070 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4022600 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c4022960 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d4065830 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40668b0 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d41107d0 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff0c4029070 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d17fa700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0b80536a0 0x7ff0b8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff0c406cdb0 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d3fff700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0b80536a0 0x7ff0b8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.737+0000 7ff0d3fff700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0b80536a0 0x7ff0b8055b60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff0bc002f70 tx=0x7ff0bc006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.741+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0c4043f50 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0d40ad690 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0d17fa700 1 -- 172.21.2.137:0/4217153650 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff0c4047530 con 0x7ff0d40b0fe0 2021-11-15T19:32:34.830 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:34.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0b80536a0 msgr2=0x7ff0b8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0b80536a0 0x7ff0b8055b60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff0bc002f70 tx=0x7ff0bc006a00).stop 2021-11-15T19:32:34.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 msgr2=0x7ff0d413dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 0x7ff0d413dd10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7ff0c4002f70 tx=0x7ff0c4006f40).stop 2021-11-15T19:32:34.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 shutdown_connections 2021-11-15T19:32:34.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0b80536a0 0x7ff0b8055b60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0d413f5c0 0x7ff0d41127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff0d40b0fe0 0x7ff0d413dd10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 --2- 172.21.2.137:0/4217153650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff0d40acff0 0x7ff0d4065af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 >> 172.21.2.137:0/4217153650 conn(0x7ff0d40b5f50 msgr2=0x7ff0d413ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 shutdown_connections 2021-11-15T19:32:34.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.825+0000 7ff0da942700 1 -- 172.21.2.137:0/4217153650 wait complete. 2021-11-15T19:32:34.836 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:32:34.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 Processor -- start 2021-11-15T19:32:34.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- start start 2021-11-15T19:32:34.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80b0fe0 0x7f52a80afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f52a80acff0 0x7f52a80af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f52a813f5c0 0x7f52a813fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a80ae070 con 0x7f52a813f5c0 2021-11-15T19:32:34.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a80ad470 con 0x7f52a80acff0 2021-11-15T19:32:34.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a80aedf0 con 0x7f52a80b0fe0 2021-11-15T19:32:34.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f52a80acff0 0x7f52a80af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f52a80acff0 0x7f52a80af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36060/0 (socket says 172.21.2.137:36060) 2021-11-15T19:32:34.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 -- 172.21.2.137:0/1042134696 learned_addr learned my addr 172.21.2.137:0/1042134696 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 -- 172.21.2.137:0/1042134696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80b0fe0 msgr2=0x7f52a80afde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:34.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 --2- 172.21.2.137:0/1042134696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80b0fe0 0x7f52a80afde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 -- 172.21.2.137:0/1042134696 >> v2:172.21.2.111:3300/0 conn(0x7f52a813f5c0 msgr2=0x7f52a813fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:34.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 --2- 172.21.2.137:0/1042134696 >> v2:172.21.2.111:3300/0 conn(0x7f52a813f5c0 0x7f52a813fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 -- 172.21.2.137:0/1042134696 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a80b13c0 con 0x7f52a80acff0 2021-11-15T19:32:34.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ad1f8700 1 --2- 172.21.2.137:0/1042134696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a80acff0 0x7f52a80af4c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f52a80ade90 tx=0x7f52a4006eb0).ready entity=mon.1 client_cookie=4598d57c536d77d4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ac9f7700 1 -- 172.21.2.137:0/1042134696 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a400d570 con 0x7f52a80acff0 2021-11-15T19:32:34.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ac9f7700 1 -- 172.21.2.137:0/1042134696 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a4000e90 con 0x7f52a80acff0 2021-11-15T19:32:34.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52ac9f7700 1 -- 172.21.2.137:0/1042134696 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a400d8c0 con 0x7f52a80acff0 2021-11-15T19:32:34.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- 172.21.2.137:0/1042134696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a80acff0 msgr2=0x7f52a80af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- 172.21.2.137:0/1042134696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a80acff0 0x7f52a80af4c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f52a80ade90 tx=0x7f52a4006eb0).stop 2021-11-15T19:32:34.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- 172.21.2.137:0/1042134696 shutdown_connections 2021-11-15T19:32:34.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- 172.21.2.137:0/1042134696 >> v2:172.21.2.111:3300/0 conn(0x7f52a813f5c0 0x7f52a813fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- 172.21.2.137:0/1042134696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a80acff0 0x7f52a80af4c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 --2- 172.21.2.137:0/1042134696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80b0fe0 0x7f52a80afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- 172.21.2.137:0/1042134696 >> 172.21.2.137:0/1042134696 conn(0x7f52a80b5f50 msgr2=0x7f52a80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- 172.21.2.137:0/1042134696 shutdown_connections 2021-11-15T19:32:34.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.885+0000 7f52afc5d700 1 -- 172.21.2.137:0/1042134696 wait complete. 2021-11-15T19:32:34.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 Processor -- start 2021-11-15T19:32:34.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- start start 2021-11-15T19:32:34.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80acff0 0x7f52a8140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52a80b0fe0 0x7f52a8067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 0x7f52a81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8067850 con 0x7f52a80b0fe0 2021-11-15T19:32:34.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a815a510 con 0x7f52a813f5c0 2021-11-15T19:32:34.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8066ec0 con 0x7f52a80acff0 2021-11-15T19:32:34.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 0x7f52a81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 0x7f52a81562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36068/0 (socket says 172.21.2.137:36068) 2021-11-15T19:32:34.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 -- 172.21.2.137:0/2546163523 learned_addr learned my addr 172.21.2.137:0/2546163523 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:34.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 -- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80acff0 msgr2=0x7f52a8140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80acff0 0x7f52a8140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 -- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52a80b0fe0 msgr2=0x7f52a8067360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52a80b0fe0 0x7f52a8067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 -- 172.21.2.137:0/2546163523 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a400b1e0 con 0x7f52a813f5c0 2021-11-15T19:32:34.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ae1fa700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 0x7f52a81562a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f52a00032f0 tx=0x7f52a00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a000d4a0 con 0x7f52a813f5c0 2021-11-15T19:32:34.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a000d600 con 0x7f52a813f5c0 2021-11-15T19:32:34.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a815a1d0 con 0x7f52a813f5c0 2021-11-15T19:32:34.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a8138890 con 0x7f52a813f5c0 2021-11-15T19:32:34.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a000d960 con 0x7f52a813f5c0 2021-11-15T19:32:34.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a815a360 con 0x7f52a813f5c0 2021-11-15T19:32:34.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52a0018030 con 0x7f52a813f5c0 2021-11-15T19:32:34.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f529affd700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52880535d0 0x7f5288055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:34.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f52a006b110 con 0x7f52a813f5c0 2021-11-15T19:32:34.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.889+0000 7f52ad9f9700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52880535d0 0x7f5288055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:34.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.893+0000 7f52ad9f9700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52880535d0 0x7f5288055a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f529c002fb0 tx=0x7f529c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:34.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.893+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52a0042320 con 0x7f52a813f5c0 2021-11-15T19:32:34.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52a8138890 con 0x7f52a813f5c0 2021-11-15T19:32:34.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f529affd700 1 -- 172.21.2.137:0/2546163523 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+10 (secure 0 0 0) 0x7f52a8138890 con 0x7f52a813f5c0 2021-11-15T19:32:34.981 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:34.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52880535d0 msgr2=0x7f5288055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52880535d0 0x7f5288055a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f529c002fb0 tx=0x7f529c0069b0).stop 2021-11-15T19:32:34.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 msgr2=0x7f52a81562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:34.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 0x7f52a81562a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f52a00032f0 tx=0x7f52a00091a0).stop 2021-11-15T19:32:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 shutdown_connections 2021-11-15T19:32:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52880535d0 0x7f5288055a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52a813f5c0 0x7f52a81562a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:34.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52a80b0fe0 0x7f52a8067360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 --2- 172.21.2.137:0/2546163523 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f52a80acff0 0x7f52a8140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 >> 172.21.2.137:0/2546163523 conn(0x7f52a80b5f50 msgr2=0x7f52a80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 shutdown_connections 2021-11-15T19:32:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:34.977+0000 7f52afc5d700 1 -- 172.21.2.137:0/2546163523 wait complete. 2021-11-15T19:32:34.988 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:32:35.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 Processor -- start 2021-11-15T19:32:35.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- start start 2021-11-15T19:32:35.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f864405c770 0x7f86440aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440b0550 0x7f864414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864405cb50 con 0x7f864414aaa0 2021-11-15T19:32:35.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86440b1650 con 0x7f864405c770 2021-11-15T19:32:35.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440ad030 con 0x7f86440b0550 2021-11-15T19:32:35.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8648be3700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f864414aaa0 0x7f8644140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54858/0 (socket says 172.21.2.137:54858) 2021-11-15T19:32:35.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8648be3700 1 -- 172.21.2.137:0/4135315072 learned_addr learned my addr 172.21.2.137:0/4135315072 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:32:35.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542636560 0 0) 0x7f864405cb50 con 0x7f864414aaa0 2021-11-15T19:32:35.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8630003260 con 0x7f864414aaa0 2021-11-15T19:32:35.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206794448 0 0) 0x7f8630003260 con 0x7f864414aaa0 2021-11-15T19:32:35.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440b0550 msgr2=0x7f864414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:35.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440b0550 0x7f864414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 >> v2:172.21.2.111:3300/0 conn(0x7f864405c770 msgr2=0x7f86440aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:35.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 --2- 172.21.2.137:0/4135315072 >> v2:172.21.2.111:3300/0 conn(0x7f864405c770 0x7f86440aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440ad2d0 con 0x7f864414aaa0 2021-11-15T19:32:35.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f863c0019e0 con 0x7f864414aaa0 2021-11-15T19:32:35.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 >> v1:172.21.2.137:6789/0 conn(0x7f864414aaa0 legacy=0x7f8644140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8630004500 0x7f8630004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440b0550 0x7f863000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440b1650 con 0x7f8630004500 2021-11-15T19:32:35.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440ad030 con 0x7f86300037d0 2021-11-15T19:32:35.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8630005300 con 0x7f86440b0550 2021-11-15T19:32:35.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:35.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 -- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440b0550 msgr2=0x7f863000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:35.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440b0550 0x7f863000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 -- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8630004500 msgr2=0x7f8630004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:35.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8630004500 0x7f8630004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 -- 172.21.2.137:0/4135315072 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630003260 con 0x7f86300037d0 2021-11-15T19:32:35.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8643fff700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bf0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f8634002f70 tx=0x7f8634006ca0).ready entity=mon.1 client_cookie=ebb0d2319cafdab4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:35.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8634012410 con 0x7f86300037d0 2021-11-15T19:32:35.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634012570 con 0x7f86300037d0 2021-11-15T19:32:35.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8642ffd700 1 -- 172.21.2.137:0/4135315072 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86340128d0 con 0x7f86300037d0 2021-11-15T19:32:35.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- 172.21.2.137:0/4135315072 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 msgr2=0x7f8630003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 --2- 172.21.2.137:0/4135315072 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bf0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f8634002f70 tx=0x7f8634006ca0).stop 2021-11-15T19:32:35.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f8648be3700 1 -- 172.21.2.137:0/4135315072 reap_dead start 2021-11-15T19:32:35.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- 172.21.2.137:0/4135315072 shutdown_connections 2021-11-15T19:32:35.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.037+0000 7f864a646700 1 -- 172.21.2.137:0/4135315072 >> 172.21.2.137:0/4135315072 conn(0x7f86440631e0 msgr2=0x7f864405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:35.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- 172.21.2.137:0/4135315072 shutdown_connections 2021-11-15T19:32:35.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- 172.21.2.137:0/4135315072 wait complete. 2021-11-15T19:32:35.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 Processor -- start 2021-11-15T19:32:35.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- start start 2021-11-15T19:32:35.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86300037d0 0x7f8644118400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 0x7f86440670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8644159d60 0x7f864415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644117970 con 0x7f86300037d0 2021-11-15T19:32:35.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644116fc0 con 0x7f8644116800 2021-11-15T19:32:35.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441189b0 con 0x7f8644159d60 2021-11-15T19:32:35.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 0x7f86440670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:35.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 0x7f86440670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36086/0 (socket says 172.21.2.137:36086) 2021-11-15T19:32:35.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 -- 172.21.2.137:0/192674514 learned_addr learned my addr 172.21.2.137:0/192674514 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:35.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 -- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8644159d60 msgr2=0x7f864415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8644159d60 0x7f864415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 -- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86300037d0 msgr2=0x7f8644118400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86300037d0 0x7f8644118400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 -- 172.21.2.137:0/192674514 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644118c50 con 0x7f8644116800 2021-11-15T19:32:35.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86437fe700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 0x7f86440670f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f8638002f70 tx=0x7f8638006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:35.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8638013460 con 0x7f8644116800 2021-11-15T19:32:35.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86380135c0 con 0x7f8644116800 2021-11-15T19:32:35.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8638013920 con 0x7f8644116800 2021-11-15T19:32:35.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8644118ef0 con 0x7f8644116800 2021-11-15T19:32:35.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864415a8f0 con 0x7f8644116800 2021-11-15T19:32:35.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644119080 con 0x7f8644116800 2021-11-15T19:32:35.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f863801a060 con 0x7f8644116800 2021-11-15T19:32:35.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86417fa700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8624053720 0x7f8624055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f863806b4b0 con 0x7f8644116800 2021-11-15T19:32:35.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.041+0000 7f8643fff700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8624053720 0x7f8624055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:35.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.045+0000 7f8643fff700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8624053720 0x7f8624055be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f8634002f70 tx=0x7f8634015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:35.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.045+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8638042500 con 0x7f8644116800 2021-11-15T19:32:35.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86440ae7f0 con 0x7f8644116800 2021-11-15T19:32:35.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f86417fa700 1 -- 172.21.2.137:0/192674514 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8638018020 con 0x7f8644116800 2021-11-15T19:32:35.132 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:32:35.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8624053720 msgr2=0x7f8624055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8624053720 0x7f8624055be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f8634002f70 tx=0x7f8634015000).stop 2021-11-15T19:32:35.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 msgr2=0x7f86440670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 0x7f86440670f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f8638002f70 tx=0x7f8638006e40).stop 2021-11-15T19:32:35.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 shutdown_connections 2021-11-15T19:32:35.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8624053720 0x7f8624055be0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:35.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8644159d60 0x7f864415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644116800 0x7f86440670f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:35.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 --2- 172.21.2.137:0/192674514 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86300037d0 0x7f8644118400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 >> 172.21.2.137:0/192674514 conn(0x7f86440631e0 msgr2=0x7f8644143500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:35.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 shutdown_connections 2021-11-15T19:32:35.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.129+0000 7f864a646700 1 -- 172.21.2.137:0/192674514 wait complete. 2021-11-15T19:32:35.139 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:32:35.140 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:35.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 Processor -- start 2021-11-15T19:32:35.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 -- start start 2021-11-15T19:32:35.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 0x7fcbf8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcbf80a9f50 0x7fcbf80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf8148190 con 0x7fcbf80b1340 2021-11-15T19:32:35.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf80b1720 con 0x7fcbf80a9f50 2021-11-15T19:32:35.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbfdcba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8147e70 con 0x7fcbf8144610 2021-11-15T19:32:35.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbf7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcbf80a9f50 0x7fcbf80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:35.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbf7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcbf80a9f50 0x7fcbf80aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36092/0 (socket says 172.21.2.137:36092) 2021-11-15T19:32:35.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbf7fff700 1 -- 172.21.2.137:0/1169136400 learned_addr learned my addr 172.21.2.137:0/1169136400 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:35.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.185+0000 7fcbf77fe700 1 --1- 172.21.2.137:0/1169136400 >> v1:172.21.2.137:6789/0 conn(0x7fcbf80b1340 0x7fcbf8143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54874/0 (socket says 172.21.2.137:54874) 2021-11-15T19:32:35.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf7fff700 1 -- 172.21.2.137:0/1169136400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 msgr2=0x7fcbf8147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:35.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf7fff700 1 --2- 172.21.2.137:0/1169136400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 0x7fcbf8147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf7fff700 1 -- 172.21.2.137:0/1169136400 >> v1:172.21.2.137:6789/0 conn(0x7fcbf80b1340 legacy=0x7fcbf8143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf67fc700 1 -- 172.21.2.137:0/1169136400 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202147668 0 0) 0x7fcbe8001110 con 0x7fcbf80b1340 2021-11-15T19:32:35.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf7fff700 1 -- 172.21.2.137:0/1169136400 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf80af800 con 0x7fcbf80a9f50 2021-11-15T19:32:35.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf7fff700 1 --2- 172.21.2.137:0/1169136400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80a9f50 0x7fcbf80aa370 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fcbf00032f0 tx=0x7fcbf0009290).ready entity=mon.1 client_cookie=87dc2bb7f0062217 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:35.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf67fc700 1 -- 172.21.2.137:0/1169136400 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbf000b8a0 con 0x7fcbf80a9f50 2021-11-15T19:32:35.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf67fc700 1 -- 172.21.2.137:0/1169136400 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000ba00 con 0x7fcbf80a9f50 2021-11-15T19:32:35.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf67fc700 1 -- 172.21.2.137:0/1169136400 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbf000bb70 con 0x7fcbf80a9f50 2021-11-15T19:32:35.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/1169136400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80a9f50 msgr2=0x7fcbf80aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/1169136400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80a9f50 0x7fcbf80aa370 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fcbf00032f0 tx=0x7fcbf0009290).stop 2021-11-15T19:32:35.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/1169136400 shutdown_connections 2021-11-15T19:32:35.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/1169136400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80a9f50 0x7fcbf80aa370 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:35.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/1169136400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 0x7fcbf8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/1169136400 >> 172.21.2.137:0/1169136400 conn(0x7fcbf80b4e60 msgr2=0x7fcbf80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:35.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/1169136400 shutdown_connections 2021-11-15T19:32:35.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/1169136400 wait complete. 2021-11-15T19:32:35.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 Processor -- start 2021-11-15T19:32:35.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- start start 2021-11-15T19:32:35.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcbf80a9f50 0x7fcbf8099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 0x7fcbf80b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 0x7fcbf80aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf815a940 con 0x7fcbf80a9f50 2021-11-15T19:32:35.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf815abe0 con 0x7fcbf80b1340 2021-11-15T19:32:35.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80ac4a0 con 0x7fcbf8144610 2021-11-15T19:32:35.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 0x7fcbf80b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:35.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 0x7fcbf80b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36102/0 (socket says 172.21.2.137:36102) 2021-11-15T19:32:35.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 -- 172.21.2.137:0/269657876 learned_addr learned my addr 172.21.2.137:0/269657876 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:35.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 -- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 msgr2=0x7fcbf80aea60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:35.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 0x7fcbf80aea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 -- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcbf80a9f50 msgr2=0x7fcbf8099f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:32:35.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcbf80a9f50 0x7fcbf8099f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 -- 172.21.2.137:0/269657876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009530 con 0x7fcbf80b1340 2021-11-15T19:32:35.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf6ffd700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 0x7fcbf80b3d90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fcbe0002fb0 tx=0x7fcbe0006e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:35.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe0013460 con 0x7fcbf80b1340 2021-11-15T19:32:35.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00135c0 con 0x7fcbf80b1340 2021-11-15T19:32:35.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe0013920 con 0x7fcbf80b1340 2021-11-15T19:32:35.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf809a8f0 con 0x7fcbf80b1340 2021-11-15T19:32:35.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf81402f0 con 0x7fcbf80b1340 2021-11-15T19:32:35.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf815a7a0 con 0x7fcbf80b1340 2021-11-15T19:32:35.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.189+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbe000f070 con 0x7fcbf80b1340 2021-11-15T19:32:35.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.193+0000 7fcbf4ff9700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcbdc053610 0x7fcbdc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:35.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.193+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fcbe006b090 con 0x7fcbf80b1340 2021-11-15T19:32:35.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.193+0000 7fcbf77fe700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcbdc053610 0x7fcbdc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:35.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.193+0000 7fcbf77fe700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcbdc053610 0x7fcbdc055ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fcbe8000ed0 tx=0x7fcbe8007820).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:35.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.193+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbf815a7a0 con 0x7fcbf80b1340 2021-11-15T19:32:35.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbf80b0b80 con 0x7fcbf80b1340 2021-11-15T19:32:35.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbf4ff9700 1 -- 172.21.2.137:0/269657876 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fcbf80b0b80 con 0x7fcbf80b1340 2021-11-15T19:32:35.306 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:35.307 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:32:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcbdc053610 msgr2=0x7fcbdc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcbdc053610 0x7fcbdc055ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fcbe8000ed0 tx=0x7fcbe8007820).stop 2021-11-15T19:32:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 msgr2=0x7fcbf80b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 0x7fcbf80b3d90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fcbe0002fb0 tx=0x7fcbe0006e10).stop 2021-11-15T19:32:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 shutdown_connections 2021-11-15T19:32:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcbdc053610 0x7fcbdc055ad0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcbf8144610 0x7fcbf80aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcbf80b1340 0x7fcbf80b3d90 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:35.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 --2- 172.21.2.137:0/269657876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcbf80a9f50 0x7fcbf8099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:35.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 >> 172.21.2.137:0/269657876 conn(0x7fcbf80b4e60 msgr2=0x7fcbf80afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:35.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 shutdown_connections 2021-11-15T19:32:35.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:35.301+0000 7fcbfdcba700 1 -- 172.21.2.137:0/269657876 wait complete. 2021-11-15T19:32:35.311 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:32:35.514 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:32:30.455951+0000', 'modified': '2021-11-15T19:32:31.460820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6184': {'gid': 6184, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1730106945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1730106945}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1730106945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:32:35.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:32:35.516 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:32:35.580 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6184,"want_state":"up:active","state":"up:active","rank_uptime":5.1120273640000002,"mdsmap_epoch":32,"osdmap_epoch":73,"osdmap_epoch_barrier":72,"uptime":9.2030050830000008} 2021-11-15T19:32:35.580 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6184, "mdsmap_epoch": 32, "osdmap_epoch": 73, "osdmap_epoch_barrier": 72, "rank_uptime": 5.112027364, "state": "up:active", "uptime": 9.203005083, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:32:35.581 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:32:35.581 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:32:35.582 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:32:35.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:35.583 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:35.594 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:32:35.605 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:32:35.606 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:32:35.658 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:32:35.659 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:32:35.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:35.660 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:32:35.665 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:32:35.666 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:35.709 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:32:35.720 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:32:35.721 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:32:35.726 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:32:35.726 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:32:35.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:35.728 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:32:35.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:32:35.755+0000 7fd603361080 -1 init, newargv = 0x565030dd8960 newargc=9ceph-fuse[14160]: starting ceph client 2021-11-15T19:32:35.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr: 2021-11-15T19:32:35.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14160]: starting fuse 2021-11-15T19:32:36.864 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:32:36.876 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:32:36.877 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:32:36.924 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:32:36.925 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:32:36.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:36.927 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:32:36.931 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:32:36.932 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:32:36.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:36.933 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:32:36.933 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:32:36.934 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:32:36.934 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:32:36.935 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:32:36.935 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:32:36.936 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:32:36.936 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:32:36.936 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:32:36.937 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:32:36.937 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:32:36.938 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:32:36.938 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:32:36.938 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:32:36.939 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:32:36.939 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:32:36.940 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:32:36.940 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:32:36.941 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:32:36.941 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:32:36.941 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:32:36.942 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:32:36.942 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:32:36.970 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14160.asok 2021-11-15T19:32:36.972 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14160.asok 2021-11-15T19:32:36.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:36.973 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14160.asok status 2021-11-15T19:32:37.073 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:32:37.074 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:32:37.074 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:32:37.074 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:32:37.074 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:32:37.075 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:32:37.075 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:32:37.075 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14160", 2021-11-15T19:32:37.075 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:32:37.075 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:32:37.076 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:32:37.076 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:32:37.076 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 6397, 2021-11-15T19:32:37.076 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:32:37.077 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:32:37.077 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:32:37.077 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 6397 2021-11-15T19:32:37.077 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:32:37.078 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:32:37.078 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:32:37.078 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:32:37.078 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 2295984028 2021-11-15T19:32:37.079 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:32:37.079 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:32:37.079 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:32:37.079 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:32:37.080 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:32:37.080 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 2295984028 2021-11-15T19:32:37.080 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:32:37.080 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.6397 172.21.2.118:0/2295984028", 2021-11-15T19:32:37.081 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/2295984028", 2021-11-15T19:32:37.081 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:32:37.081 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 32, 2021-11-15T19:32:37.081 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 73, 2021-11-15T19:32:37.082 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:32:37.082 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:32:37.082 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:32:37.082 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:32:37.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:37.084 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:37.085 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:37.090 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:32:37.091 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:32:37.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:37.092 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:37.100 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:37.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 Processor -- start 2021-11-15T19:32:37.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- start start 2021-11-15T19:32:37.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a740b1340 0x7f3a74147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a74143f00 0x7f3a74144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3a740a9f50 0x7f3a740aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a74148190 con 0x7f3a740a9f50 2021-11-15T19:32:37.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740b1720 con 0x7f3a740b1340 2021-11-15T19:32:37.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74147e70 con 0x7f3a74143f00 2021-11-15T19:32:37.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a740b1340 0x7f3a74147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a740b1340 0x7f3a74147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36106/0 (socket says 172.21.2.137:36106) 2021-11-15T19:32:37.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 -- 172.21.2.137:0/806309355 learned_addr learned my addr 172.21.2.137:0/806309355 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:37.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a7359e700 1 --2- 172.21.2.137:0/806309355 >> v2:172.21.2.111:3300/0 conn(0x7f3a740a9f50 0x7f3a740aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 -- 172.21.2.137:0/806309355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a74143f00 msgr2=0x7f3a74144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:37.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 --2- 172.21.2.137:0/806309355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a74143f00 0x7f3a74144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 -- 172.21.2.137:0/806309355 >> v2:172.21.2.111:3300/0 conn(0x7f3a740a9f50 msgr2=0x7f3a740aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:37.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 --2- 172.21.2.137:0/806309355 >> v2:172.21.2.111:3300/0 conn(0x7f3a740a9f50 0x7f3a740aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 -- 172.21.2.137:0/806309355 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740af800 con 0x7f3a740b1340 2021-11-15T19:32:37.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a72d9d700 1 --2- 172.21.2.137:0/806309355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a740b1340 0x7f3a74147980 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f3a5c002f70 tx=0x7f3a5c006eb0).ready entity=mon.1 client_cookie=c29b1a489f4c0a90 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:37.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a71d9b700 1 -- 172.21.2.137:0/806309355 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a5c00d570 con 0x7f3a740b1340 2021-11-15T19:32:37.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a71d9b700 1 -- 172.21.2.137:0/806309355 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c000e90 con 0x7f3a740b1340 2021-11-15T19:32:37.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a71d9b700 1 -- 172.21.2.137:0/806309355 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a5c00d900 con 0x7f3a740b1340 2021-11-15T19:32:37.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- 172.21.2.137:0/806309355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a740b1340 msgr2=0x7f3a74147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- 172.21.2.137:0/806309355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a740b1340 0x7f3a74147980 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f3a5c002f70 tx=0x7f3a5c006eb0).stop 2021-11-15T19:32:37.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- 172.21.2.137:0/806309355 shutdown_connections 2021-11-15T19:32:37.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- 172.21.2.137:0/806309355 >> v2:172.21.2.111:3300/0 conn(0x7f3a740a9f50 0x7f3a740aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- 172.21.2.137:0/806309355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a74143f00 0x7f3a74144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 --2- 172.21.2.137:0/806309355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a740b1340 0x7f3a74147980 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- 172.21.2.137:0/806309355 >> 172.21.2.137:0/806309355 conn(0x7f3a740b4e60 msgr2=0x7f3a740b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:37.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.149+0000 7f3a79087700 1 -- 172.21.2.137:0/806309355 shutdown_connections 2021-11-15T19:32:37.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- 172.21.2.137:0/806309355 wait complete. 2021-11-15T19:32:37.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 Processor -- start 2021-11-15T19:32:37.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- start start 2021-11-15T19:32:37.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a740a9f50 0x7f3a740aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a740b1340 0x7f3a740ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 0x7f3a741571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741568b0 con 0x7f3a740a9f50 2021-11-15T19:32:37.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74156aa0 con 0x7f3a74143f00 2021-11-15T19:32:37.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74156d40 con 0x7f3a740b1340 2021-11-15T19:32:37.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 0x7f3a741571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 0x7f3a741571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36116/0 (socket says 172.21.2.137:36116) 2021-11-15T19:32:37.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 -- 172.21.2.137:0/2934181232 learned_addr learned my addr 172.21.2.137:0/2934181232 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:37.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 -- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a740b1340 msgr2=0x7f3a740ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a740b1340 0x7f3a740ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 -- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a740a9f50 msgr2=0x7f3a740aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a740a9f50 0x7f3a740aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 -- 172.21.2.137:0/2934181232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c00b1e0 con 0x7f3a74143f00 2021-11-15T19:32:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a7359e700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 0x7f3a741571e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f3a6c007000 tx=0x7f3a6c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c010580 con 0x7f3a74143f00 2021-11-15T19:32:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0106e0 con 0x7f3a74143f00 2021-11-15T19:32:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c010a40 con 0x7f3a74143f00 2021-11-15T19:32:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a74098830 con 0x7f3a74143f00 2021-11-15T19:32:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7409a9d0 con 0x7f3a74143f00 2021-11-15T19:32:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7409ae20 con 0x7f3a74143f00 2021-11-15T19:32:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a6c010ba0 con 0x7f3a74143f00 2021-11-15T19:32:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a6bfff700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a58053600 0x7f3a58055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.153+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3a6c06bc90 con 0x7f3a74143f00 2021-11-15T19:32:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.157+0000 7f3a72d9d700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a58053600 0x7f3a58055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.157+0000 7f3a72d9d700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a58053600 0x7f3a58055ac0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3a5c002f70 tx=0x7f3a5c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.157+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a6c042df0 con 0x7f3a74143f00 2021-11-15T19:32:37.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a74156f00 con 0x7f3a74143f00 2021-11-15T19:32:37.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a6bfff700 1 -- 172.21.2.137:0/2934181232 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f3a6c046410 con 0x7f3a74143f00 2021-11-15T19:32:37.269 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:37.269 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:32:37.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a58053600 msgr2=0x7f3a58055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a58053600 0x7f3a58055ac0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3a5c002f70 tx=0x7f3a5c015000).stop 2021-11-15T19:32:37.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 msgr2=0x7f3a741571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 0x7f3a741571e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f3a6c007000 tx=0x7f3a6c008040).stop 2021-11-15T19:32:37.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 shutdown_connections 2021-11-15T19:32:37.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3a58053600 0x7f3a58055ac0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a74143f00 0x7f3a741571e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a740b1340 0x7f3a740ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 --2- 172.21.2.137:0/2934181232 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a740a9f50 0x7f3a740aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 >> 172.21.2.137:0/2934181232 conn(0x7f3a740b4e60 msgr2=0x7f3a740af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:37.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 shutdown_connections 2021-11-15T19:32:37.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.265+0000 7f3a79087700 1 -- 172.21.2.137:0/2934181232 wait complete. 2021-11-15T19:32:37.273 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:32:37.275 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:32:37.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 Processor -- start 2021-11-15T19:32:37.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 -- start start 2021-11-15T19:32:37.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80b1340 0x7f7ee8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7ee8143f00 0x7f7ee8144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ee80a9f50 0x7f7ee80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee8148190 con 0x7f7ee8143f00 2021-11-15T19:32:37.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80b1720 con 0x7f7ee80a9f50 2021-11-15T19:32:37.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7eedef4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8147e70 con 0x7f7ee80b1340 2021-11-15T19:32:37.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ee80a9f50 0x7f7ee80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7ee80a9f50 0x7f7ee80aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36120/0 (socket says 172.21.2.137:36120) 2021-11-15T19:32:37.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3174213910 learned_addr learned my addr 172.21.2.137:0/3174213910 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:37.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3174213910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80b1340 msgr2=0x7f7ee8147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:32:37.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 --2- 172.21.2.137:0/3174213910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80b1340 0x7f7ee8147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3174213910 >> v2:172.21.2.111:3300/0 conn(0x7f7ee8143f00 msgr2=0x7f7ee8144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:32:37.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 --2- 172.21.2.137:0/3174213910 >> v2:172.21.2.111:3300/0 conn(0x7f7ee8143f00 0x7f7ee8144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3174213910 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80af800 con 0x7f7ee80a9f50 2021-11-15T19:32:37.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee7fff700 1 --2- 172.21.2.137:0/3174213910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee80a9f50 0x7f7ee80aa370 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f7ee00032f0 tx=0x7f7ee0009290).ready entity=mon.1 client_cookie=290a2cb811d3c295 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:37.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee67fc700 1 -- 172.21.2.137:0/3174213910 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee000b870 con 0x7f7ee80a9f50 2021-11-15T19:32:37.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee67fc700 1 -- 172.21.2.137:0/3174213910 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee000b9d0 con 0x7f7ee80a9f50 2021-11-15T19:32:37.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.321+0000 7f7ee67fc700 1 -- 172.21.2.137:0/3174213910 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee000bb80 con 0x7f7ee80a9f50 2021-11-15T19:32:37.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3174213910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee80a9f50 msgr2=0x7f7ee80aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3174213910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee80a9f50 0x7f7ee80aa370 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f7ee00032f0 tx=0x7f7ee0009290).stop 2021-11-15T19:32:37.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3174213910 shutdown_connections 2021-11-15T19:32:37.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3174213910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee80a9f50 0x7f7ee80aa370 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3174213910 >> v2:172.21.2.111:3300/0 conn(0x7f7ee8143f00 0x7f7ee8144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3174213910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80b1340 0x7f7ee8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3174213910 >> 172.21.2.137:0/3174213910 conn(0x7f7ee80b4e60 msgr2=0x7f7ee80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:37.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3174213910 shutdown_connections 2021-11-15T19:32:37.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3174213910 wait complete. 2021-11-15T19:32:37.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 Processor -- start 2021-11-15T19:32:37.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- start start 2021-11-15T19:32:37.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80a9f50 0x7f7ee80b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ee80b1340 0x7f7ee81558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 0x7f7ee8155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80aea80 con 0x7f7ee80b1340 2021-11-15T19:32:37.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80aed20 con 0x7f7ee8143f00 2021-11-15T19:32:37.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80aefc0 con 0x7f7ee80a9f50 2021-11-15T19:32:37.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 0x7f7ee8155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 0x7f7ee8155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36128/0 (socket says 172.21.2.137:36128) 2021-11-15T19:32:37.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3853597960 learned_addr learned my addr 172.21.2.137:0/3853597960 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:32:37.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80a9f50 msgr2=0x7f7ee80b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80a9f50 0x7f7ee80b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ee80b1340 msgr2=0x7f7ee81558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ee80b1340 0x7f7ee81558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 -- 172.21.2.137:0/3853597960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009530 con 0x7f7ee8143f00 2021-11-15T19:32:37.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee7fff700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 0x7f7ee8155db0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f7ee00032f0 tx=0x7f7ee0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:37.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee000b870 con 0x7f7ee8143f00 2021-11-15T19:32:37.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0020430 con 0x7f7ee8143f00 2021-11-15T19:32:37.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee80ada40 con 0x7f7ee8143f00 2021-11-15T19:32:37.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee0020790 con 0x7f7ee8143f00 2021-11-15T19:32:37.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee81562a0 con 0x7f7ee8143f00 2021-11-15T19:32:37.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee805faf0 con 0x7f7ee8143f00 2021-11-15T19:32:37.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ee000f070 con 0x7f7ee8143f00 2021-11-15T19:32:37.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee4ff9700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ec80536f0 0x7f7ec8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:32:37.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.325+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7ee006cb40 con 0x7f7ee8143f00 2021-11-15T19:32:37.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.329+0000 7f7ee77fe700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ec80536f0 0x7f7ec8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:32:37.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.329+0000 7f7ee77fe700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ec80536f0 0x7f7ec8055bb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f7ed8002ef0 tx=0x7f7ed8006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:32:37.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.329+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ee0043ca0 con 0x7f7ee8143f00 2021-11-15T19:32:37.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ee80573d0 con 0x7f7ee8143f00 2021-11-15T19:32:37.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7ee4ff9700 1 -- 172.21.2.137:0/3853597960 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f7ee0015020 con 0x7f7ee8143f00 2021-11-15T19:32:37.442 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:32:37.442 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:32:37.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ec80536f0 msgr2=0x7f7ec8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ec80536f0 0x7f7ec8055bb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f7ed8002ef0 tx=0x7f7ed8006910).stop 2021-11-15T19:32:37.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 msgr2=0x7f7ee8155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:32:37.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 0x7f7ee8155db0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f7ee00032f0 tx=0x7f7ee0016000).stop 2021-11-15T19:32:37.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 shutdown_connections 2021-11-15T19:32:37.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ec80536f0 0x7f7ec8055bb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ee8143f00 0x7f7ee8155db0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:32:37.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ee80b1340 0x7f7ee81558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 --2- 172.21.2.137:0/3853597960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ee80a9f50 0x7f7ee80b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:32:37.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 >> 172.21.2.137:0/3853597960 conn(0x7f7ee80b4e60 msgr2=0x7f7ee813e810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:32:37.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 shutdown_connections 2021-11-15T19:32:37.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:32:37.437+0000 7f7eedef4700 1 -- 172.21.2.137:0/3853597960 wait complete. 2021-11-15T19:32:37.446 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:32:37.449 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-11-15T19:32:37.505 INFO:teuthology.orchestra.run.gibba037.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-11-15T19:32:37.505 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-11-15T19:32:37.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:37.506 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:37.507 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:32:37.518 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:32:37.519 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:32:37.520 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:32:37.520 DEBUG:teuthology.orchestra.run.gibba031:> import time 2021-11-15T19:32:37.521 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:32:37.521 DEBUG:teuthology.orchestra.run.gibba031:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-11-15T19:32:37.522 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content'"'"') 2021-11-15T19:32:37.522 DEBUG:teuthology.orchestra.run.gibba031:> f.flush() 2021-11-15T19:32:37.522 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content2'"'"') 2021-11-15T19:32:37.523 DEBUG:teuthology.orchestra.run.gibba031:> while True: 2021-11-15T19:32:37.523 DEBUG:teuthology.orchestra.run.gibba031:> time.sleep(1) 2021-11-15T19:32:37.524 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:32:37.527 DEBUG:teuthology.orchestra.run.gibba031:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-11-15T19:32:37.539 INFO:teuthology.orchestra.run.gibba031.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-11-15T19:32:37.540 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-11-15T19:32:38.541 DEBUG:teuthology.orchestra.run.gibba031:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-11-15T19:32:38.553 INFO:teuthology.orchestra.run.gibba031.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-11-15T19:32:38.554 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-11-15T19:32:38.555 DEBUG:teuthology.orchestra.run.gibba018:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-11-15T19:32:38.597 INFO:teuthology.orchestra.run.gibba018.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-11-15T19:32:38.599 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-11-15T19:32:38.599 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:32:38.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:32:38.609 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:32:38.609 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:32:38.652 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:32:38.654 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:32:38.654 DEBUG:teuthology.orchestra.run.gibba018:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:32:38.655 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:32:38.655 DEBUG:teuthology.orchestra.run.gibba018:> import time 2021-11-15T19:32:38.656 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:32:38.656 DEBUG:teuthology.orchestra.run.gibba018:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-11-15T19:32:38.657 DEBUG:teuthology.orchestra.run.gibba018:> try: 2021-11-15T19:32:38.657 DEBUG:teuthology.orchestra.run.gibba018:> while True: 2021-11-15T19:32:38.657 DEBUG:teuthology.orchestra.run.gibba018:> os.write(fd, b'"'"'content'"'"') 2021-11-15T19:32:38.658 DEBUG:teuthology.orchestra.run.gibba018:> time.sleep(1) 2021-11-15T19:32:38.658 DEBUG:teuthology.orchestra.run.gibba018:> if not False: 2021-11-15T19:32:38.659 DEBUG:teuthology.orchestra.run.gibba018:> break 2021-11-15T19:32:38.659 DEBUG:teuthology.orchestra.run.gibba018:> except IOError as e: 2021-11-15T19:32:38.659 DEBUG:teuthology.orchestra.run.gibba018:> pass 2021-11-15T19:32:38.660 DEBUG:teuthology.orchestra.run.gibba018:> os.close(fd) 2021-11-15T19:32:38.660 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:32:54.286 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:54.290 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:54.293 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:54.297 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:32:54.300 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:17.427 INFO:tasks.cephfs.test_misc:cap_waiter waited 38.76374578475952s 2021-11-15T19:33:17.428 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-11-15T19:33:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.477+0000 7fdc3ae18700 1 Processor -- start 2021-11-15T19:33:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.477+0000 7fdc3ae18700 1 -- start start 2021-11-15T19:33:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc3ae18700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3405c770 0x7fdc340aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc3ae18700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdc340b04c0 0x7fdc340b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc3ae18700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3405cb50 con 0x7fdc340af090 2021-11-15T19:33:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc3ae18700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340afd30 con 0x7fdc340b04c0 2021-11-15T19:33:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc3ae18700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340ae700 con 0x7fdc3405c770 2021-11-15T19:33:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc33fff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdc340b04c0 0x7fdc340b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc38bb4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3405c770 0x7fdc340aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc38bb4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3405c770 0x7fdc340aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:37706/0 (socket says 172.21.2.137:37706) 2021-11-15T19:33:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc38bb4700 1 -- 172.21.2.137:0/1039507653 learned_addr learned my addr 172.21.2.137:0/1039507653 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc33fff700 1 -- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3405c770 msgr2=0x7fdc340aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc33fff700 1 --2- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3405c770 0x7fdc340aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc33fff700 1 -- 172.21.2.137:0/1039507653 >> v1:172.21.2.111:6789/0 conn(0x7fdc340af090 legacy=0x7fdc34141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc33fff700 1 -- 172.21.2.137:0/1039507653 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340ac910 con 0x7fdc340b04c0 2021-11-15T19:33:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc33fff700 1 --2- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc340b1500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdc340ae420 tx=0x7fdc24006df0).ready entity=mon.0 client_cookie=6f2a6df2588899df server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc337fe700 1 -- 172.21.2.137:0/1039507653 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400d570 con 0x7fdc340b04c0 2021-11-15T19:33:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc337fe700 1 -- 172.21.2.137:0/1039507653 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24000e90 con 0x7fdc340b04c0 2021-11-15T19:33:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.481+0000 7fdc337fe700 1 -- 172.21.2.137:0/1039507653 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400d8c0 con 0x7fdc340b04c0 2021-11-15T19:33:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 msgr2=0x7fdc340b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc340b1500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdc340ae420 tx=0x7fdc24006df0).stop 2021-11-15T19:33:17.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/1039507653 shutdown_connections 2021-11-15T19:33:17.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc340b1500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/1039507653 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc3405c770 0x7fdc340aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/1039507653 >> 172.21.2.137:0/1039507653 conn(0x7fdc340631e0 msgr2=0x7fdc3405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:17.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/1039507653 shutdown_connections 2021-11-15T19:33:17.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/1039507653 wait complete. 2021-11-15T19:33:17.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 Processor -- start 2021-11-15T19:33:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- start start 2021-11-15T19:33:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 0x7fdc341410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc340af090 0x7fdc34145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc3413db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3413ed90 con 0x7fdc340b04c0 2021-11-15T19:33:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3413f400 con 0x7fdc3405c770 2021-11-15T19:33:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3413f6a0 con 0x7fdc340af090 2021-11-15T19:33:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 0x7fdc341410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 0x7fdc341410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36140/0 (socket says 172.21.2.137:36140) 2021-11-15T19:33:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 -- 172.21.2.137:0/3345902267 learned_addr learned my addr 172.21.2.137:0/3345902267 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc33fff700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc340af090 0x7fdc34145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc393b5700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc3413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 -- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc340af090 msgr2=0x7fdc34145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc340af090 0x7fdc34145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 -- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 msgr2=0x7fdc3413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc3413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 -- 172.21.2.137:0/3345902267 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2400b180 con 0x7fdc3405c770 2021-11-15T19:33:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc393b5700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc3413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc38bb4700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 0x7fdc341410d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fdc1c00c000 tx=0x7fdc1c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc1c0136e0 con 0x7fdc3405c770 2021-11-15T19:33:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3410f470 con 0x7fdc3405c770 2021-11-15T19:33:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c013840 con 0x7fdc3405c770 2021-11-15T19:33:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc1c013ba0 con 0x7fdc3405c770 2021-11-15T19:33:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3413fab0 con 0x7fdc3405c770 2021-11-15T19:33:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc340b19f0 con 0x7fdc3405c770 2021-11-15T19:33:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc1c023070 con 0x7fdc3405c770 2021-11-15T19:33:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc18053610 0x7fdc18055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fdc1c06bd80 con 0x7fdc3405c770 2021-11-15T19:33:17.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc33fff700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc18053610 0x7fdc18055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc33fff700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc18053610 0x7fdc18055ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fdc24015000 tx=0x7fdc24014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.485+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc1c042db0 con 0x7fdc3405c770 2021-11-15T19:33:17.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.573+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7fdc3405db30 con 0x7fdc3405c770 2021-11-15T19:33:17.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.573+0000 7fdc31ffb700 1 -- 172.21.2.137:0/3345902267 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v74) v1 ==== 98+0+80 (secure 0 0 0) 0x7fdc1c0463d0 con 0x7fdc3405c770 2021-11-15T19:33:17.584 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:17.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc18053610 msgr2=0x7fdc18055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc18053610 0x7fdc18055ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fdc24015000 tx=0x7fdc24014000).stop 2021-11-15T19:33:17.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 msgr2=0x7fdc341410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 0x7fdc341410d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fdc1c00c000 tx=0x7fdc1c008040).stop 2021-11-15T19:33:17.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 shutdown_connections 2021-11-15T19:33:17.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdc18053610 0x7fdc18055ad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdc340b04c0 0x7fdc3413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdc340af090 0x7fdc34145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 --2- 172.21.2.137:0/3345902267 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdc3405c770 0x7fdc341410d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 >> 172.21.2.137:0/3345902267 conn(0x7fdc340631e0 msgr2=0x7fdc340b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:17.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 shutdown_connections 2021-11-15T19:33:17.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.577+0000 7fdc3ae18700 1 -- 172.21.2.137:0/3345902267 wait complete. 2021-11-15T19:33:17.588 INFO:teuthology.orchestra.run.gibba037.stderr:listed 1 entries 2021-11-15T19:33:17.591 INFO:teuthology.orchestra.run.gibba037.stdout:[{"addr":"172.21.2.131:0/2457368916","until":"2021-11-15T20:33:11.377887+0000"}] 2021-11-15T19:33:17.602 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-15T19:33:17.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:17.603 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:17.604 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:17.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:17.608 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T19:33:17.609 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:17.609 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:33:17.609 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:33:17.610 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:17.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:17.658 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:17.659 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:17.664 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:33:17.665 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:33:17.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:17.666 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:17.673 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:17.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 Processor -- start 2021-11-15T19:33:17.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- start start 2021-11-15T19:33:17.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa0740acab0 0x7fa0740b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740aecf0 con 0x7fa0740af2f0 2021-11-15T19:33:17.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07413f180 con 0x7fa0740b1180 2021-11-15T19:33:17.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740aef20 con 0x7fa0740acab0 2021-11-15T19:33:17.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07259c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa0740acab0 0x7fa0740b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa071d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa0740b1180 0x7fa074142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54932/0 (socket says 172.21.2.137:54932) 2021-11-15T19:33:17.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa071d9b700 1 -- 172.21.2.137:0/2564521877 learned_addr learned my addr 172.21.2.137:0/2564521877 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:17.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07259c700 1 -- 172.21.2.137:0/2564521877 >> v1:172.21.2.137:6789/0 conn(0x7fa0740b1180 legacy=0x7fa074142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07259c700 1 -- 172.21.2.137:0/2564521877 >> v1:172.21.2.111:6789/0 conn(0x7fa0740af2f0 legacy=0x7fa074149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:17.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07259c700 1 -- 172.21.2.137:0/2564521877 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740ace90 con 0x7fa0740acab0 2021-11-15T19:33:17.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07259c700 1 --2- 172.21.2.137:0/2564521877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740acab0 0x7fa0740b2060 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fa0740b2bd0 tx=0x7fa05c006e80).ready entity=mon.1 client_cookie=6913b2eaf441acf5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07159a700 1 -- 172.21.2.137:0/2564521877 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa05c00a820 con 0x7fa0740acab0 2021-11-15T19:33:17.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07159a700 1 -- 172.21.2.137:0/2564521877 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c000e90 con 0x7fa0740acab0 2021-11-15T19:33:17.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa07159a700 1 -- 172.21.2.137:0/2564521877 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa05c00ab70 con 0x7fa0740acab0 2021-11-15T19:33:17.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- 172.21.2.137:0/2564521877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740acab0 msgr2=0x7fa0740b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 --2- 172.21.2.137:0/2564521877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740acab0 0x7fa0740b2060 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fa0740b2bd0 tx=0x7fa05c006e80).stop 2021-11-15T19:33:17.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- 172.21.2.137:0/2564521877 shutdown_connections 2021-11-15T19:33:17.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 --2- 172.21.2.137:0/2564521877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740acab0 0x7fa0740b2060 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- 172.21.2.137:0/2564521877 >> 172.21.2.137:0/2564521877 conn(0x7fa0740630f0 msgr2=0x7fa0740634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:17.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- 172.21.2.137:0/2564521877 shutdown_connections 2021-11-15T19:33:17.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- 172.21.2.137:0/2564521877 wait complete. 2021-11-15T19:33:17.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 Processor -- start 2021-11-15T19:33:17.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- start start 2021-11-15T19:33:17.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0740acab0 0x7fa07410ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0740af2f0 0x7fa07413d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 0x7fa07413dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074110290 con 0x7fa0740af2f0 2021-11-15T19:33:17.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074110530 con 0x7fa0740b1180 2021-11-15T19:33:17.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.721+0000 7fa078a59700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0741107d0 con 0x7fa0740acab0 2021-11-15T19:33:17.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 0x7fa07413dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 0x7fa07413dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36158/0 (socket says 172.21.2.137:36158) 2021-11-15T19:33:17.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 -- 172.21.2.137:0/4037227180 learned_addr learned my addr 172.21.2.137:0/4037227180 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:17.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 -- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0740acab0 msgr2=0x7fa07410ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0740acab0 0x7fa07410ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 -- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0740af2f0 msgr2=0x7fa07413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0740af2f0 0x7fa07413d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 -- 172.21.2.137:0/4037227180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c00c310 con 0x7fa0740b1180 2021-11-15T19:33:17.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa072d9d700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 0x7fa07413dac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fa06c003310 tx=0x7fa06c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06c001500 con 0x7fa0740b1180 2021-11-15T19:33:17.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c001660 con 0x7fa0740b1180 2021-11-15T19:33:17.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa074110c70 con 0x7fa0740b1180 2021-11-15T19:33:17.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07410ff10 con 0x7fa0740b1180 2021-11-15T19:33:17.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06c0019c0 con 0x7fa0740b1180 2021-11-15T19:33:17.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa074110990 con 0x7fa0740b1180 2021-11-15T19:33:17.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa06c018030 con 0x7fa0740b1180 2021-11-15T19:33:17.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa058053580 0x7fa058055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fa06c06b3b0 con 0x7fa0740b1180 2021-11-15T19:33:17.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa07259c700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa058053580 0x7fa058055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa07259c700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa058053580 0x7fa058055a40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa0740b2bd0 tx=0x7fa05c006e80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.729+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa06c0425a0 con 0x7fa0740b1180 2021-11-15T19:33:17.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.809+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0740573d0 con 0x7fa0740b1180 2021-11-15T19:33:17.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.809+0000 7fa06b7fe700 1 -- 172.21.2.137:0/4037227180 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fa06c045bc0 con 0x7fa0740b1180 2021-11-15T19:33:17.821 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:17.821 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":74,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:12.205843+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:32:28.410587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T19:32:29.429846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.131:0/2457368916":"2021-11-15T20:33:11.377887+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:17.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa058053580 msgr2=0x7fa058055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa058053580 0x7fa058055a40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa0740b2bd0 tx=0x7fa05c006e80).stop 2021-11-15T19:33:17.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 msgr2=0x7fa07413dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 0x7fa07413dac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fa06c003310 tx=0x7fa06c0091a0).stop 2021-11-15T19:33:17.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 shutdown_connections 2021-11-15T19:33:17.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa058053580 0x7fa058055a40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0740b1180 0x7fa07413dac0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0740af2f0 0x7fa07413d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 --2- 172.21.2.137:0/4037227180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0740acab0 0x7fa07410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 >> 172.21.2.137:0/4037227180 conn(0x7fa0740630f0 msgr2=0x7fa07405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:17.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 shutdown_connections 2021-11-15T19:33:17.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.813+0000 7fa078a59700 1 -- 172.21.2.137:0/4037227180 wait complete. 2021-11-15T19:33:17.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:32:28.410587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:32:29.429846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:33:17.829 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:17.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 Processor -- start 2021-11-15T19:33:17.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- start start 2021-11-15T19:33:17.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 0x7fa11414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa11414aaa0 0x7fa114140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11405cb50 con 0x7fa11405c770 2021-11-15T19:33:17.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140b1650 con 0x7fa11414aaa0 2021-11-15T19:33:17.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140ad030 con 0x7fa1140b0550 2021-11-15T19:33:17.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa11405c770 0x7fa1140aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54944/0 (socket says 172.21.2.137:54944) 2021-11-15T19:33:17.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 -- 172.21.2.137:0/4050638166 learned_addr learned my addr 172.21.2.137:0/4050638166 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:17.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11a4a8700 1 --2- 172.21.2.137:0/4050638166 >> v2:172.21.2.137:3300/0 conn(0x7fa11414aaa0 0x7fa114140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa118ca5700 1 -- 172.21.2.137:0/4050638166 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490678998 0 0) 0x7fa11405cb50 con 0x7fa11405c770 2021-11-15T19:33:17.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa118ca5700 1 -- 172.21.2.137:0/4050638166 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0fc003260 con 0x7fa11405c770 2021-11-15T19:33:17.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11a4a8700 1 -- 172.21.2.137:0/4050638166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 msgr2=0x7fa11414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:17.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11a4a8700 1 --2- 172.21.2.137:0/4050638166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 0x7fa11414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11a4a8700 1 -- 172.21.2.137:0/4050638166 >> v1:172.21.2.137:6789/0 conn(0x7fa11405c770 legacy=0x7fa1140aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11a4a8700 1 -- 172.21.2.137:0/4050638166 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140ad2d0 con 0x7fa11414aaa0 2021-11-15T19:33:17.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11a4a8700 1 --2- 172.21.2.137:0/4050638166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11414aaa0 0x7fa114140aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fa10c0032f0 tx=0x7fa10c0091d0).ready entity=mon.1 client_cookie=e06b4d9347ba5dd3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa118ca5700 1 -- 172.21.2.137:0/4050638166 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10c00b6c0 con 0x7fa11414aaa0 2021-11-15T19:33:17.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa118ca5700 1 -- 172.21.2.137:0/4050638166 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00b820 con 0x7fa11414aaa0 2021-11-15T19:33:17.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa118ca5700 1 -- 172.21.2.137:0/4050638166 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10c00b990 con 0x7fa11414aaa0 2021-11-15T19:33:17.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/4050638166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11414aaa0 msgr2=0x7fa114140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/4050638166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11414aaa0 0x7fa114140aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fa10c0032f0 tx=0x7fa10c0091d0).stop 2021-11-15T19:33:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/4050638166 shutdown_connections 2021-11-15T19:33:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/4050638166 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11414aaa0 0x7fa114140aa0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/4050638166 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 0x7fa11414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/4050638166 >> 172.21.2.137:0/4050638166 conn(0x7fa1140631e0 msgr2=0x7fa11405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:17.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/4050638166 shutdown_connections 2021-11-15T19:33:17.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/4050638166 wait complete. 2021-11-15T19:33:17.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 Processor -- start 2021-11-15T19:33:17.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- start start 2021-11-15T19:33:17.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 0x7fa114063d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 0x7fa1140b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa11414aaa0 0x7fa114156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114064240 con 0x7fa11414aaa0 2021-11-15T19:33:17.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114064490 con 0x7fa11405c770 2021-11-15T19:33:17.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa114064730 con 0x7fa1140b0550 2021-11-15T19:33:17.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 0x7fa114063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 0x7fa114063d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36168/0 (socket says 172.21.2.137:36168) 2021-11-15T19:33:17.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 -- 172.21.2.137:0/813218886 learned_addr learned my addr 172.21.2.137:0/813218886 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:17.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 -- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 msgr2=0x7fa1140b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 0x7fa1140b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 -- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa11414aaa0 msgr2=0x7fa114156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa11414aaa0 0x7fa114156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 -- 172.21.2.137:0/813218886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c009470 con 0x7fa11405c770 2021-11-15T19:33:17.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa119ca7700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 0x7fa114063d50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fa110001110 tx=0x7fa110007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1100070d0 con 0x7fa11405c770 2021-11-15T19:33:17.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110007230 con 0x7fa11405c770 2021-11-15T19:33:17.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1140b5320 con 0x7fa11405c770 2021-11-15T19:33:17.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa114156620 con 0x7fa11405c770 2021-11-15T19:33:17.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa110005610 con 0x7fa11405c770 2021-11-15T19:33:17.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f0003410 con 0x7fa11405c770 2021-11-15T19:33:17.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa110010070 con 0x7fa11405c770 2021-11-15T19:33:17.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa106ffd700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa0f4053660 0x7fa0f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:17.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fa11006b170 con 0x7fa11405c770 2021-11-15T19:33:17.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.877+0000 7fa1194a6700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa0f4053660 0x7fa0f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:17.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.885+0000 7fa1194a6700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa0f4053660 0x7fa0f4055b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fa108002f70 tx=0x7fa108006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:17.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.885+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa110042140 con 0x7fa11405c770 2021-11-15T19:33:17.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.961+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa0f0003c40 con 0x7fa11405c770 2021-11-15T19:33:17.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.961+0000 7fa106ffd700 1 -- 172.21.2.137:0/813218886 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v74) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa110045760 con 0x7fa11405c770 2021-11-15T19:33:17.972 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:17.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa0f4053660 msgr2=0x7fa0f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa0f4053660 0x7fa0f4055b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fa108002f70 tx=0x7fa108006a80).stop 2021-11-15T19:33:17.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 msgr2=0x7fa114063d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:17.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 0x7fa114063d50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fa110001110 tx=0x7fa110007aa0).stop 2021-11-15T19:33:17.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 shutdown_connections 2021-11-15T19:33:17.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa0f4053660 0x7fa0f4055b20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa11414aaa0 0x7fa114156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1140b0550 0x7fa1140b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:17.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 --2- 172.21.2.137:0/813218886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa11405c770 0x7fa114063d50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:17.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 >> 172.21.2.137:0/813218886 conn(0x7fa1140631e0 msgr2=0x7fa1140b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:17.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 shutdown_connections 2021-11-15T19:33:17.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:17.965+0000 7fa11bf0b700 1 -- 172.21.2.137:0/813218886 wait complete. 2021-11-15T19:33:17.978 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:18.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 Processor -- start 2021-11-15T19:33:18.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- start start 2021-11-15T19:33:18.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f96b4140590 0x7f96b40ad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b405cb50 con 0x7f96b405c770 2021-11-15T19:33:18.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b413f910 con 0x7f96b40b1030 2021-11-15T19:33:18.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b413fbb0 con 0x7f96b4140590 2021-11-15T19:33:18.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f96b4140590 0x7f96b40ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f96b4140590 0x7f96b40ad020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36180/0 (socket says 172.21.2.137:36180) 2021-11-15T19:33:18.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 -- 172.21.2.137:0/2087540017 learned_addr learned my addr 172.21.2.137:0/2087540017 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:18.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96b9b03700 1 --1- 172.21.2.137:0/2087540017 >> v1:172.21.2.137:6789/0 conn(0x7f96b40b1030 0x7f96b413c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54960/0 (socket says 172.21.2.137:54960) 2021-11-15T19:33:18.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 -- 172.21.2.137:0/2087540017 >> v1:172.21.2.137:6789/0 conn(0x7f96b40b1030 legacy=0x7f96b413c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 -- 172.21.2.137:0/2087540017 >> v1:172.21.2.111:6789/0 conn(0x7f96b405c770 legacy=0x7f96b40ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 -- 172.21.2.137:0/2087540017 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b413fe50 con 0x7f96b4140590 2021-11-15T19:33:18.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bab05700 1 --2- 172.21.2.137:0/2087540017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b4140590 0x7f96b40ad020 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f96b40aee10 tx=0x7f96ac009290).ready entity=mon.1 client_cookie=7707d4fcea42ca79 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96b9302700 1 -- 172.21.2.137:0/2087540017 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac00b820 con 0x7f96b4140590 2021-11-15T19:33:18.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96b9302700 1 -- 172.21.2.137:0/2087540017 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac00b980 con 0x7f96b4140590 2021-11-15T19:33:18.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96b9302700 1 -- 172.21.2.137:0/2087540017 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac00baf0 con 0x7f96b4140590 2021-11-15T19:33:18.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/2087540017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b4140590 msgr2=0x7f96b40ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 --2- 172.21.2.137:0/2087540017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b4140590 0x7f96b40ad020 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f96b40aee10 tx=0x7f96ac009290).stop 2021-11-15T19:33:18.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/2087540017 shutdown_connections 2021-11-15T19:33:18.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 --2- 172.21.2.137:0/2087540017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b4140590 0x7f96b40ad020 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/2087540017 >> 172.21.2.137:0/2087540017 conn(0x7f96b40631e0 msgr2=0x7f96b405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/2087540017 shutdown_connections 2021-11-15T19:33:18.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/2087540017 wait complete. 2021-11-15T19:33:18.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 Processor -- start 2021-11-15T19:33:18.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- start start 2021-11-15T19:33:18.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 0x7f96b40667b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96b40b1030 0x7f96b413a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96b4140590 0x7f96b413dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4139a20 con 0x7f96b4140590 2021-11-15T19:33:18.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b413d870 con 0x7f96b405c770 2021-11-15T19:33:18.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b413db10 con 0x7f96b40b1030 2021-11-15T19:33:18.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 0x7f96b40667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 0x7f96b40667b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36182/0 (socket says 172.21.2.137:36182) 2021-11-15T19:33:18.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 -- 172.21.2.137:0/4023298112 learned_addr learned my addr 172.21.2.137:0/4023298112 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:18.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 -- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96b40b1030 msgr2=0x7f96b413a680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:18.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96b40b1030 0x7f96b413a680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 -- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96b4140590 msgr2=0x7f96b413dd40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:18.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96b4140590 0x7f96b413dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 -- 172.21.2.137:0/4023298112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac009530 con 0x7f96b405c770 2021-11-15T19:33:18.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96ba304700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 0x7f96b40667b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f96b4138c10 tx=0x7f96a8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a8013460 con 0x7f96b405c770 2021-11-15T19:33:18.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a80135c0 con 0x7f96b405c770 2021-11-15T19:33:18.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b41392c0 con 0x7f96b405c770 2021-11-15T19:33:18.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b40672d0 con 0x7f96b405c770 2021-11-15T19:33:18.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a8013920 con 0x7f96b405c770 2021-11-15T19:33:18.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b4139820 con 0x7f96b405c770 2021-11-15T19:33:18.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96a801a060 con 0x7f96b405c770 2021-11-15T19:33:18.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96a77fe700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9694053610 0x7f9694055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f96a806b2c0 con 0x7f96b405c770 2021-11-15T19:33:18.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.025+0000 7f96b9b03700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9694053610 0x7f9694055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.033+0000 7f96b9b03700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9694053610 0x7f9694055ad0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f96b4140470 tx=0x7f96b0007780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.033+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96a8042400 con 0x7f96b405c770 2021-11-15T19:33:18.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96b41400f0 con 0x7f96b405c770 2021-11-15T19:33:18.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96a77fe700 1 -- 172.21.2.137:0/4023298112 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96a8018020 con 0x7f96b405c770 2021-11-15T19:33:18.121 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:18.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9694053610 msgr2=0x7f9694055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9694053610 0x7f9694055ad0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f96b4140470 tx=0x7f96b0007780).stop 2021-11-15T19:33:18.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 msgr2=0x7f96b40667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 0x7f96b40667b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f96b4138c10 tx=0x7f96a8006df0).stop 2021-11-15T19:33:18.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 shutdown_connections 2021-11-15T19:33:18.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9694053610 0x7f9694055ad0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96b4140590 0x7f96b413dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96b40b1030 0x7f96b413a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 --2- 172.21.2.137:0/4023298112 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96b405c770 0x7f96b40667b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 >> 172.21.2.137:0/4023298112 conn(0x7f96b40631e0 msgr2=0x7f96b40b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 shutdown_connections 2021-11-15T19:33:18.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.113+0000 7f96bc568700 1 -- 172.21.2.137:0/4023298112 wait complete. 2021-11-15T19:33:18.128 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:33:18.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 Processor -- start 2021-11-15T19:33:18.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 -- start start 2021-11-15T19:33:18.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f541c0b2520 0x7f541c13fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0b6d40 con 0x7f541c064e80 2021-11-15T19:33:18.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0b0e50 con 0x7f541c0b6960 2021-11-15T19:33:18.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c0b10f0 con 0x7f541c0b2520 2021-11-15T19:33:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541a59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f541c0b6960 0x7f541c142d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54972/0 (socket says 172.21.2.137:54972) 2021-11-15T19:33:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541a59c700 1 -- 172.21.2.137:0/1168123119 learned_addr learned my addr 172.21.2.137:0/1168123119 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708184551 0 0) 0x7f541c0b0e50 con 0x7f541c0b6960 2021-11-15T19:33:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53fc003260 con 0x7f541c0b6960 2021-11-15T19:33:18.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 --2- 172.21.2.137:0/1168123119 >> v2:172.21.2.111:3300/0 conn(0x7f541c0b2520 0x7f541c13fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789715011 0 0) 0x7f53fc003260 con 0x7f541c0b6960 2021-11-15T19:33:18.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 >> v2:172.21.2.111:3300/0 conn(0x7f541c0b2520 msgr2=0x7f541c13fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 --2- 172.21.2.137:0/1168123119 >> v2:172.21.2.111:3300/0 conn(0x7f541c0b2520 0x7f541c13fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 >> v1:172.21.2.111:6789/0 conn(0x7f541c064e80 legacy=0x7f541c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c13f940 con 0x7f541c0b6960 2021-11-15T19:33:18.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f540c0016b0 con 0x7f541c0b6960 2021-11-15T19:33:18.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 >> v1:172.21.2.137:6789/0 conn(0x7f541c0b6960 legacy=0x7f541c142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc003820 0x7f53fc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53fc004500 0x7f53fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53fc004f70 0x7f53fc00d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0b10f0 con 0x7f53fc003820 2021-11-15T19:33:18.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc00e060 con 0x7f53fc004500 2021-11-15T19:33:18.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc00e220 con 0x7f53fc004f70 2021-11-15T19:33:18.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53fc004500 0x7f53fc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541a59c700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc003820 0x7f53fc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541ad9d700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53fc004f70 0x7f53fc00d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 -- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53fc004f70 msgr2=0x7f53fc00d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53fc004f70 0x7f53fc00d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 -- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc003820 msgr2=0x7f53fc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc003820 0x7f53fc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 -- 172.21.2.137:0/1168123119 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc003260 con 0x7f53fc004500 2021-11-15T19:33:18.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541ad9d700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f53fc004f70 0x7f53fc00d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:18.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541ad9d700 1 -- 172.21.2.137:0/1168123119 reap_dead start 2021-11-15T19:33:18.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5419d9b700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53fc004500 0x7f53fc004980 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f540400a000 tx=0x7f5404008040).ready entity=mon.1 client_cookie=71fa4eb688a3e169 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5404013670 con 0x7f53fc004500 2021-11-15T19:33:18.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040137d0 con 0x7f53fc004500 2021-11-15T19:33:18.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f541959a700 1 -- 172.21.2.137:0/1168123119 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5404013b30 con 0x7f53fc004500 2021-11-15T19:33:18.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 -- 172.21.2.137:0/1168123119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53fc004500 msgr2=0x7f53fc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.173+0000 7f5420994700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53fc004500 0x7f53fc004980 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f540400a000 tx=0x7f5404008040).stop 2021-11-15T19:33:18.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1168123119 shutdown_connections 2021-11-15T19:33:18.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 --2- 172.21.2.137:0/1168123119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f53fc004500 0x7f53fc004980 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1168123119 >> 172.21.2.137:0/1168123119 conn(0x7f541c064420 msgr2=0x7f541c0b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1168123119 shutdown_connections 2021-11-15T19:33:18.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1168123119 wait complete. 2021-11-15T19:33:18.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 Processor -- start 2021-11-15T19:33:18.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- start start 2021-11-15T19:33:18.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc004500 0x7f541c066630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f541c066b20 0x7f541c13ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 0x7f541c1117f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0aeff0 con 0x7f53fc004500 2021-11-15T19:33:18.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c150e90 con 0x7f541c13cf20 2021-11-15T19:33:18.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0af590 con 0x7f541c066b20 2021-11-15T19:33:18.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 0x7f541c1117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 0x7f541c1117f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36206/0 (socket says 172.21.2.137:36206) 2021-11-15T19:33:18.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 -- 172.21.2.137:0/1970177809 learned_addr learned my addr 172.21.2.137:0/1970177809 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:18.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541a59c700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc004500 0x7f541c066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5419d9b700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f541c066b20 0x7f541c13ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 -- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f541c066b20 msgr2=0x7f541c13ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f541c066b20 0x7f541c13ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 -- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc004500 msgr2=0x7f541c066630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc004500 0x7f541c066630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 -- 172.21.2.137:0/1970177809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0af830 con 0x7f541c13cf20 2021-11-15T19:33:18.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541ad9d700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 0x7f541c1117f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f540c001890 tx=0x7f5414009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54140104e0 con 0x7f541c13cf20 2021-11-15T19:33:18.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414010640 con 0x7f541c13cf20 2021-11-15T19:33:18.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c0aec70 con 0x7f541c13cf20 2021-11-15T19:33:18.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54140109e0 con 0x7f541c13cf20 2021-11-15T19:33:18.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c110350 con 0x7f541c13cf20 2021-11-15T19:33:18.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c0aee60 con 0x7f541c13cf20 2021-11-15T19:33:18.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f541401a030 con 0x7f541c13cf20 2021-11-15T19:33:18.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f54137fe700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5400053640 0x7f5400055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f541406b0f0 con 0x7f541c13cf20 2021-11-15T19:33:18.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.177+0000 7f541a59c700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5400053640 0x7f5400055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.181+0000 7f541a59c700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5400053640 0x7f5400055b00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f540c005000 tx=0x7f540c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.181+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5414042230 con 0x7f541c13cf20 2021-11-15T19:33:18.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f541c110350 con 0x7f541c13cf20 2021-11-15T19:33:18.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f54137fe700 1 -- 172.21.2.137:0/1970177809 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+10 (secure 0 0 0) 0x7f541c110350 con 0x7f541c13cf20 2021-11-15T19:33:18.274 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5400053640 msgr2=0x7f5400055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5400053640 0x7f5400055b00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f540c005000 tx=0x7f540c009040).stop 2021-11-15T19:33:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 msgr2=0x7f541c1117f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 0x7f541c1117f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f540c001890 tx=0x7f5414009040).stop 2021-11-15T19:33:18.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 shutdown_connections 2021-11-15T19:33:18.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5400053640 0x7f5400055b00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f541c13cf20 0x7f541c1117f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f541c066b20 0x7f541c13ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 --2- 172.21.2.137:0/1970177809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f53fc004500 0x7f541c066630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 >> 172.21.2.137:0/1970177809 conn(0x7f541c064420 msgr2=0x7f541c0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 shutdown_connections 2021-11-15T19:33:18.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.265+0000 7f5420994700 1 -- 172.21.2.137:0/1970177809 wait complete. 2021-11-15T19:33:18.281 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:33:18.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 Processor -- start 2021-11-15T19:33:18.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- start start 2021-11-15T19:33:18.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fee38140aa0 0x7fee38140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3805cb50 con 0x7fee380b0550 2021-11-15T19:33:18.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee380ad030 con 0x7fee3805c770 2021-11-15T19:33:18.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee380b1650 con 0x7fee38140aa0 2021-11-15T19:33:18.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee36ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fee3805c770 0x7fee380aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:54994/0 (socket says 172.21.2.137:54994) 2021-11-15T19:33:18.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee36ffd700 1 -- 172.21.2.137:0/4273192045 learned_addr learned my addr 172.21.2.137:0/4273192045 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:18.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669362196 0 0) 0x7fee380ad030 con 0x7fee3805c770 2021-11-15T19:33:18.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee18003260 con 0x7fee3805c770 2021-11-15T19:33:18.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee377fe700 1 --2- 172.21.2.137:0/4273192045 >> v2:172.21.2.111:3300/0 conn(0x7fee38140aa0 0x7fee38140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906820935 0 0) 0x7fee18003260 con 0x7fee3805c770 2021-11-15T19:33:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 >> v2:172.21.2.111:3300/0 conn(0x7fee38140aa0 msgr2=0x7fee38140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 --2- 172.21.2.137:0/4273192045 >> v2:172.21.2.111:3300/0 conn(0x7fee38140aa0 0x7fee38140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 >> v1:172.21.2.111:6789/0 conn(0x7fee380b0550 legacy=0x7fee3814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380ad2d0 con 0x7fee3805c770 2021-11-15T19:33:18.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fee20001660 con 0x7fee3805c770 2021-11-15T19:33:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee377fe700 1 --2- 172.21.2.137:0/4273192045 >> v2:172.21.2.111:3300/0 conn(0x7fee38140aa0 0x7fee38140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 >> v1:172.21.2.137:6789/0 conn(0x7fee3805c770 legacy=0x7fee380aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee18003750 0x7fee18003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee18004500 0x7fee18004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004f90 0x7fee1800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380b1650 con 0x7fee18003750 2021-11-15T19:33:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1800be80 con 0x7fee18004500 2021-11-15T19:33:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1800c040 con 0x7fee18004f90 2021-11-15T19:33:18.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee18004500 0x7fee18004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee36ffd700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee18003750 0x7fee18003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee377fe700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004f90 0x7fee1800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004f90 msgr2=0x7fee1800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004f90 0x7fee1800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee18003750 msgr2=0x7fee18003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee18003750 0x7fee18003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/4273192045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18003260 con 0x7fee18004500 2021-11-15T19:33:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee377fe700 1 -- 172.21.2.137:0/4273192045 reap_dead start 2021-11-15T19:33:18.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee18004500 0x7fee18004980 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fee28000f70 tx=0x7fee280079e0).ready entity=mon.1 client_cookie=8c27b5f8d59d2be server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee28007cf0 con 0x7fee18004500 2021-11-15T19:33:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28014410 con 0x7fee18004500 2021-11-15T19:33:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee35ffb700 1 -- 172.21.2.137:0/4273192045 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee28014790 con 0x7fee18004500 2021-11-15T19:33:18.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/4273192045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee18004500 msgr2=0x7fee18004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee18004500 0x7fee18004980 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fee28000f70 tx=0x7fee280079e0).stop 2021-11-15T19:33:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/4273192045 shutdown_connections 2021-11-15T19:33:18.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/4273192045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee18004500 0x7fee18004980 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/4273192045 >> 172.21.2.137:0/4273192045 conn(0x7fee380631e0 msgr2=0x7fee3805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/4273192045 shutdown_connections 2021-11-15T19:33:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/4273192045 wait complete. 2021-11-15T19:33:18.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 Processor -- start 2021-11-15T19:33:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- start start 2021-11-15T19:33:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004500 0x7fee38142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 0x7fee38141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee3813fe80 0x7fee38140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3814e2a0 con 0x7fee3813fe80 2021-11-15T19:33:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3814e540 con 0x7fee381596b0 2021-11-15T19:33:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3814df90 con 0x7fee18004500 2021-11-15T19:33:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 0x7fee38141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 0x7fee38141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36222/0 (socket says 172.21.2.137:36222) 2021-11-15T19:33:18.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/1853338261 learned_addr learned my addr 172.21.2.137:0/1853338261 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:18.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004500 msgr2=0x7fee38142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004500 0x7fee38142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee3813fe80 msgr2=0x7fee38140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee3813fe80 0x7fee38140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 -- 172.21.2.137:0/1853338261 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee381407f0 con 0x7fee381596b0 2021-11-15T19:33:18.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee367fc700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 0x7fee38141a30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fee28000f70 tx=0x7fee28015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee28013940 con 0x7fee381596b0 2021-11-15T19:33:18.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28013aa0 con 0x7fee381596b0 2021-11-15T19:33:18.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee28013e00 con 0x7fee381596b0 2021-11-15T19:33:18.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee38143520 con 0x7fee381596b0 2021-11-15T19:33:18.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee38063c80 con 0x7fee381596b0 2021-11-15T19:33:18.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee380ae7f0 con 0x7fee381596b0 2021-11-15T19:33:18.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee28022470 con 0x7fee381596b0 2021-11-15T19:33:18.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee2ffff700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee1c053640 0x7fee1c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fee2801c040 con 0x7fee381596b0 2021-11-15T19:33:18.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.329+0000 7fee36ffd700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee1c053640 0x7fee1c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.333+0000 7fee36ffd700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee1c053640 0x7fee1c055b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fee2000b000 tx=0x7fee38146fe0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.333+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee28043e20 con 0x7fee381596b0 2021-11-15T19:33:18.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee380573d0 con 0x7fee381596b0 2021-11-15T19:33:18.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee2ffff700 1 -- 172.21.2.137:0/1853338261 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+10 (secure 0 0 0) 0x7fee28047440 con 0x7fee381596b0 2021-11-15T19:33:18.426 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:18.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee1c053640 msgr2=0x7fee1c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee1c053640 0x7fee1c055b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fee2000b000 tx=0x7fee38146fe0).stop 2021-11-15T19:33:18.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 msgr2=0x7fee38141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 0x7fee38141a30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fee28000f70 tx=0x7fee28015000).stop 2021-11-15T19:33:18.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 shutdown_connections 2021-11-15T19:33:18.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee1c053640 0x7fee1c055b00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee3813fe80 0x7fee38140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee381596b0 0x7fee38141a30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 --2- 172.21.2.137:0/1853338261 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee18004500 0x7fee38142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 >> 172.21.2.137:0/1853338261 conn(0x7fee380631e0 msgr2=0x7fee38147050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 shutdown_connections 2021-11-15T19:33:18.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.417+0000 7fee3d4aa700 1 -- 172.21.2.137:0/1853338261 wait complete. 2021-11-15T19:33:18.433 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:33:18.434 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:18.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 Processor -- start 2021-11-15T19:33:18.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- start start 2021-11-15T19:33:18.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0608f0 0x7faf7c13f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf7c0b1660 0x7faf7c0b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0b0c80 con 0x7faf7c0b2c00 2021-11-15T19:33:18.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c0ad6c0 con 0x7faf7c0b1660 2021-11-15T19:33:18.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0b0f20 con 0x7faf7c0608f0 2021-11-15T19:33:18.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf7c0b1660 0x7faf7c0b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faf7c0b1660 0x7faf7c0b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36230/0 (socket says 172.21.2.137:36230) 2021-11-15T19:33:18.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 -- 172.21.2.137:0/1992126686 learned_addr learned my addr 172.21.2.137:0/1992126686 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:18.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 -- 172.21.2.137:0/1992126686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0608f0 msgr2=0x7faf7c13f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 --2- 172.21.2.137:0/1992126686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0608f0 0x7faf7c13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 -- 172.21.2.137:0/1992126686 >> v1:172.21.2.111:6789/0 conn(0x7faf7c0b2c00 legacy=0x7faf7c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:18.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 -- 172.21.2.137:0/1992126686 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c0b11c0 con 0x7faf7c0b1660 2021-11-15T19:33:18.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 --2- 172.21.2.137:0/1992126686 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0b1660 0x7faf7c0b2710 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7faf7c0b3ac0 tx=0x7faf6c006f40).ready entity=mon.1 client_cookie=5c068605f07934ba server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7959a700 1 -- 172.21.2.137:0/1992126686 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6c00dc30 con 0x7faf7c0b1660 2021-11-15T19:33:18.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7959a700 1 -- 172.21.2.137:0/1992126686 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c000e90 con 0x7faf7c0b1660 2021-11-15T19:33:18.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7959a700 1 -- 172.21.2.137:0/1992126686 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6c00be90 con 0x7faf7c0b1660 2021-11-15T19:33:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- 172.21.2.137:0/1992126686 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0b1660 msgr2=0x7faf7c0b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- 172.21.2.137:0/1992126686 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0b1660 0x7faf7c0b2710 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7faf7c0b3ac0 tx=0x7faf6c006f40).stop 2021-11-15T19:33:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- 172.21.2.137:0/1992126686 shutdown_connections 2021-11-15T19:33:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- 172.21.2.137:0/1992126686 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0b1660 0x7faf7c0b2710 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- 172.21.2.137:0/1992126686 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0608f0 0x7faf7c13f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- 172.21.2.137:0/1992126686 >> 172.21.2.137:0/1992126686 conn(0x7faf7c063980 msgr2=0x7faf7c063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- 172.21.2.137:0/1992126686 shutdown_connections 2021-11-15T19:33:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- 172.21.2.137:0/1992126686 wait complete. 2021-11-15T19:33:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 Processor -- start 2021-11-15T19:33:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- start start 2021-11-15T19:33:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 0x7faf7c13d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf7c0b1660 0x7faf7c13ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0b2c00 0x7faf7c1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c139fa0 con 0x7faf7c0b1660 2021-11-15T19:33:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c13b4d0 con 0x7faf7c0608f0 2021-11-15T19:33:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf80a23700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c143380 con 0x7faf7c0b2c00 2021-11-15T19:33:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 0x7faf7c13d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 0x7faf7c13d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36238/0 (socket says 172.21.2.137:36238) 2021-11-15T19:33:18.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 -- 172.21.2.137:0/1825101857 learned_addr learned my addr 172.21.2.137:0/1825101857 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:18.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf7c0b1660 0x7faf7c13ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 -- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0b2c00 msgr2=0x7faf7c1510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7ad9d700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0b2c00 0x7faf7c1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0b2c00 0x7faf7c1510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 -- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf7c0b1660 msgr2=0x7faf7c13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf7c0b1660 0x7faf7c13ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf7a59c700 1 -- 172.21.2.137:0/1825101857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c00b460 con 0x7faf7c0608f0 2021-11-15T19:33:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.477+0000 7faf79d9b700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf7c0b1660 0x7faf7c13ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf7a59c700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 0x7faf7c13d420 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7faf64002f70 tx=0x7faf64006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf64013460 con 0x7faf7c0608f0 2021-11-15T19:33:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640135c0 con 0x7faf7c0608f0 2021-11-15T19:33:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c13b0f0 con 0x7faf7c0608f0 2021-11-15T19:33:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf64013920 con 0x7faf7c0608f0 2021-11-15T19:33:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c13a600 con 0x7faf7c0608f0 2021-11-15T19:33:18.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c13a110 con 0x7faf7c0608f0 2021-11-15T19:33:18.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf6401a060 con 0x7faf7c0608f0 2021-11-15T19:33:18.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf60053640 0x7faf60055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:18.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7faf6406b420 con 0x7faf7c0608f0 2021-11-15T19:33:18.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf79d9b700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf60053640 0x7faf60055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:18.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf79d9b700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf60053640 0x7faf60055b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7faf6c007000 tx=0x7faf6c006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:18.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.481+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf64042450 con 0x7faf7c0608f0 2021-11-15T19:33:18.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.589+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf7c0b1ac0 con 0x7faf7c0608f0 2021-11-15T19:33:18.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.589+0000 7faf737fe700 1 -- 172.21.2.137:0/1825101857 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7faf64045a70 con 0x7faf7c0608f0 2021-11-15T19:33:18.600 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:18.600 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:33:18.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.589+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf60053640 msgr2=0x7faf60055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.589+0000 7faf80a23700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf60053640 0x7faf60055b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7faf6c007000 tx=0x7faf6c006f40).stop 2021-11-15T19:33:18.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.589+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 msgr2=0x7faf7c13d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:18.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.589+0000 7faf80a23700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 0x7faf7c13d420 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7faf64002f70 tx=0x7faf64006ec0).stop 2021-11-15T19:33:18.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 shutdown_connections 2021-11-15T19:33:18.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7faf60053640 0x7faf60055b00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faf7c0b2c00 0x7faf7c1510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faf7c0b1660 0x7faf7c13ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 --2- 172.21.2.137:0/1825101857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faf7c0608f0 0x7faf7c13d420 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:18.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 >> 172.21.2.137:0/1825101857 conn(0x7faf7c063980 msgr2=0x7faf7c128a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:18.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 shutdown_connections 2021-11-15T19:33:18.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:18.593+0000 7faf80a23700 1 -- 172.21.2.137:0/1825101857 wait complete. 2021-11-15T19:33:18.608 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:33:18.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:32:30.455951+0000', 'modified': '2021-11-15T19:32:31.460820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6184': {'gid': 6184, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/1730106945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 1730106945}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 1730106945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:18.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:18.812 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:18.876 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6184,"want_state":"up:active","state":"up:active","rank_uptime":48.407079144999997,"mdsmap_epoch":32,"osdmap_epoch":74,"osdmap_epoch_barrier":74,"uptime":52.498058118000003} 2021-11-15T19:33:18.877 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6184, "mdsmap_epoch": 32, "osdmap_epoch": 74, "osdmap_epoch_barrier": 74, "rank_uptime": 48.407079145, "state": "up:active", "uptime": 52.498058118, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:18.877 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:33:18.878 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:33:18.879 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:33:18.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:18.879 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:18.890 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:18.901 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:18.902 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:18.952 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:18.953 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:18.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:18.954 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:18.960 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:33:18.960 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:19.004 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:19.015 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:19.015 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:19.020 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:19.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:19.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:19.022 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:19.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14759]: starting ceph client 2021-11-15T19:33:19.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:33:19.038+0000 7f1e23951080 -1 init, newargv = 0x5650d95fcbe0 newargc=9 2021-11-15T19:33:19.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14759]: starting fuse 2021-11-15T19:33:20.149 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:20.161 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:20.162 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:20.213 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:20.214 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:20.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.215 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:20.220 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:33:20.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:33:20.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.222 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:33:20.222 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:33:20.222 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:33:20.223 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:33:20.223 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:33:20.224 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:20.224 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:33:20.224 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:33:20.225 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:33:20.225 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:20.225 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:33:20.226 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:33:20.226 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:33:20.227 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:33:20.227 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:20.227 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:33:20.228 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:33:20.228 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:33:20.228 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:33:20.229 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:33:20.229 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:20.230 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:33:20.230 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:33:20.262 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14759.asok 2021-11-15T19:33:20.265 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14759.asok 2021-11-15T19:33:20.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.265 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14759.asok status 2021-11-15T19:33:20.313 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:33:20.313 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:33:20.313 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:33:20.313 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:33:20.314 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:33:20.314 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:33:20.314 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:33:20.314 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14759", 2021-11-15T19:33:20.315 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:33:20.315 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:20.315 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:33:20.315 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:33:20.316 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4661, 2021-11-15T19:33:20.316 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:33:20.316 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:33:20.316 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:33:20.316 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4661 2021-11-15T19:33:20.317 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:20.317 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:33:20.317 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:33:20.317 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:33:20.318 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2722794951 2021-11-15T19:33:20.318 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:33:20.318 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:20.318 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:33:20.318 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:33:20.319 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:33:20.319 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2722794951 2021-11-15T19:33:20.319 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:20.319 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4661 172.21.2.131:0/2722794951", 2021-11-15T19:33:20.320 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2722794951", 2021-11-15T19:33:20.320 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:33:20.320 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 32, 2021-11-15T19:33:20.320 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 74, 2021-11-15T19:33:20.321 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:33:20.321 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:33:20.321 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:33:20.321 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:33:20.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.323 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:20.323 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:20.332 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:33:20.333 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:20.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.333 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:20.350 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:33:20.351 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:20.362 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:20.375 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:20.389 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:20.399 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:20.412 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:33:20.412 INFO:tasks.cephfs.mount:Terminating background process 2021-11-15T19:33:20.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.413 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:20.414 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:20.451 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:33:20.452 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:20.453 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:33:20.453 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:33:20.454 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:20.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14759]: fuse finished with error 0 and tester_r 0 2021-11-15T19:33:20.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.474 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:20.475 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:20.483 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:33:20.484 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:33:20.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:20.596 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:20.641 INFO:tasks.cephfs.mount:Terminating background process 2021-11-15T19:33:20.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.642 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:20.643 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:20.654 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:33:20.655 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:33:20.656 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:33:20.656 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:33:20.657 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:20.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14160]: fuse finished with error 0 and tester_r 0 2021-11-15T19:33:20.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.712 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:20.713 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:20.717 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:33:20.717 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:33:20.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:20.831 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:20.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:20.878 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:20.878 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:33:20.888 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:33:20.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:20.889 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:33:20.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:20.890 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:33:20.939 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:33:20.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:20.941 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:33:20.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.985+0000 7fecdb2db700 1 Processor -- start 2021-11-15T19:33:20.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.985+0000 7fecdb2db700 1 -- start start 2021-11-15T19:33:20.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fecd4144610 0x7fecd4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:20.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fecd40a9f50 0x7fecd40aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:20.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd4148190 con 0x7fecd40b1340 2021-11-15T19:33:20.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40b1720 con 0x7fecd4144610 2021-11-15T19:33:20.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd4147e70 con 0x7fecd40a9f50 2021-11-15T19:33:20.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fecd40a9f50 0x7fecd40aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:20.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fecd40a9f50 0x7fecd40aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36244/0 (socket says 172.21.2.137:36244) 2021-11-15T19:33:20.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 -- 172.21.2.137:0/689612055 learned_addr learned my addr 172.21.2.137:0/689612055 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:20.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 -- 172.21.2.137:0/689612055 >> v2:172.21.2.111:3300/0 conn(0x7fecd4144610 msgr2=0x7fecd4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:20.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 --2- 172.21.2.137:0/689612055 >> v2:172.21.2.111:3300/0 conn(0x7fecd4144610 0x7fecd4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:20.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 -- 172.21.2.137:0/689612055 >> v1:172.21.2.111:6789/0 conn(0x7fecd40b1340 legacy=0x7fecd4143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:20.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 -- 172.21.2.137:0/689612055 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40af800 con 0x7fecd40a9f50 2021-11-15T19:33:21.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9878700 1 --2- 172.21.2.137:0/689612055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd40aa3a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fecd4062250 tx=0x7feccc006eb0).ready entity=mon.1 client_cookie=fee96bf4a1bb6b6f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd3fff700 1 -- 172.21.2.137:0/689612055 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feccc00d5c0 con 0x7fecd40a9f50 2021-11-15T19:33:21.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd3fff700 1 -- 172.21.2.137:0/689612055 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc000e90 con 0x7fecd40a9f50 2021-11-15T19:33:21.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd3fff700 1 -- 172.21.2.137:0/689612055 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feccc00d910 con 0x7fecd40a9f50 2021-11-15T19:33:21.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/689612055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 msgr2=0x7fecd40aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- 172.21.2.137:0/689612055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd40aa3a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fecd4062250 tx=0x7feccc006eb0).stop 2021-11-15T19:33:21.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/689612055 shutdown_connections 2021-11-15T19:33:21.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- 172.21.2.137:0/689612055 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd40aa3a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- 172.21.2.137:0/689612055 >> v2:172.21.2.111:3300/0 conn(0x7fecd4144610 0x7fecd4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/689612055 >> 172.21.2.137:0/689612055 conn(0x7fecd40b4e60 msgr2=0x7fecd40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:21.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/689612055 shutdown_connections 2021-11-15T19:33:21.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/689612055 wait complete. 2021-11-15T19:33:21.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 Processor -- start 2021-11-15T19:33:21.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- start start 2021-11-15T19:33:21.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd414a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fecd40b1340 0x7fecd41566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fecd4144610 0x7fecd4156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4148d90 con 0x7fecd4144610 2021-11-15T19:33:21.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41488c0 con 0x7fecd40a9f50 2021-11-15T19:33:21.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41486a0 con 0x7fecd40b1340 2021-11-15T19:33:21.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd414a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd414a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36248/0 (socket says 172.21.2.137:36248) 2021-11-15T19:33:21.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 -- 172.21.2.137:0/3117718383 learned_addr learned my addr 172.21.2.137:0/3117718383 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:21.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 -- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fecd40b1340 msgr2=0x7fecd41566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fecd40b1340 0x7fecd41566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 -- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fecd4144610 msgr2=0x7fecd4156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fecd4144610 0x7fecd4156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 -- 172.21.2.137:0/3117718383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc00b1e0 con 0x7fecd40a9f50 2021-11-15T19:33:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd9077700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd414a600 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fecc8002ef0 tx=0x7fecc8006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecc8012410 con 0x7fecd40a9f50 2021-11-15T19:33:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8012570 con 0x7fecd40a9f50 2021-11-15T19:33:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd4148af0 con 0x7fecd40a9f50 2021-11-15T19:33:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecc80128d0 con 0x7fecd40a9f50 2021-11-15T19:33:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd41412d0 con 0x7fecd40a9f50 2021-11-15T19:33:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd405faf0 con 0x7fecd40a9f50 2021-11-15T19:33:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fecc800f030 con 0x7fecd40a9f50 2021-11-15T19:33:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd27fc700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fecb40536f0 0x7fecb4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fecc806b790 con 0x7fecd40a9f50 2021-11-15T19:33:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd8876700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fecb40536f0 0x7fecb4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.993+0000 7fecd8876700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fecb40536f0 0x7fecb4055bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fecc40032f0 tx=0x7fecc4006e10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:20.997+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fecc80427c0 con 0x7fecd40a9f50 2021-11-15T19:33:21.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fecd40573d0 con 0x7fecd40a9f50 2021-11-15T19:33:21.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecd27fc700 1 -- 172.21.2.137:0/3117718383 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v74) v1 ==== 81+0+33724 (secure 0 0 0) 0x7fecc8045de0 con 0x7fecd40a9f50 2021-11-15T19:33:21.087 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:21.087 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:33:21.088 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 74, 2021-11-15T19:33:21.088 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:33:21.088 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:33:21.088 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:33:12.205843+0000", 2021-11-15T19:33:21.089 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:21.089 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:21.089 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:33:21.089 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:33:21.089 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:33:21.090 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:33:21.090 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:33:21.090 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:33:21.090 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:33:21.091 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:21.091 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:33:21.091 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:33:21.091 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:33:21.091 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:33:21.092 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:33:21.092 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 14, 2021-11-15T19:33:21.092 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:33:21.092 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:33:21.092 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:33:21.093 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:33:21.093 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:33:21.093 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.093 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:33:21.093 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:33:21.094 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:33:21.094 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:21.094 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:21.094 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:21.095 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:21.095 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:21.095 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:21.095 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:21.095 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:21.096 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:33:21.096 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:33:21.096 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:33:21.096 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:33:21.097 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:33:21.097 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:21.097 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:21.097 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:21.097 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:21.098 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:21.098 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:21.098 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:21.098 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.099 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:33:21.099 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:21.099 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:21.099 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:21.099 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:21.100 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:21.100 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:21.100 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:21.100 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:21.101 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:21.101 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:21.101 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:21.101 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:21.101 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:21.102 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:21.102 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:21.102 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:21.102 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:21.103 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:21.103 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:21.103 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:21.103 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:21.103 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:21.104 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:21.104 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:21.104 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:21.104 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:21.105 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.105 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:21.105 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:21.105 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:21.105 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:21.106 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:21.106 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:21.106 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:21.106 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:21.107 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:21.107 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:21.107 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:21.107 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:33:21.107 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:33:21.108 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.108 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:21.108 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:33:21.108 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.109 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.109 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.109 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:33:21.109 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:33:21.109 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:33:21.110 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:21.110 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:21.110 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:21.110 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:21.111 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:21.111 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:21.111 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:21.111 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:21.111 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:21.112 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:21.112 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:21.112 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:21.112 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:21.113 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:21.113 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:21.113 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:21.113 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:21.113 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:21.114 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:21.114 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:21.114 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.114 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:33:21.115 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:21.115 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:21.115 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:21.115 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:21.115 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:21.116 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:21.116 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:21.116 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:21.116 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:21.117 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:21.117 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:21.117 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:21.117 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:21.118 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:21.118 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:21.118 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:21.118 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:21.118 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:21.119 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:21.119 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:21.119 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:21.119 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:21.119 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:21.120 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:21.120 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:21.120 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:21.120 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.120 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:21.121 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:21.121 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:21.121 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:21.121 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:21.122 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:21.122 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:21.122 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:21.122 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:21.122 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:21.123 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:21.123 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:33:21.123 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:21.123 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:33:21.124 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.124 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.124 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.124 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 13, 2021-11-15T19:33:21.124 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:33:21.125 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:32:28.410587+0000", 2021-11-15T19:33:21.125 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:21.125 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:21.125 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:21.125 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:21.126 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:21.126 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:21.126 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:21.126 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:21.127 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:21.127 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:21.127 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:21.127 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:21.127 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:21.128 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:21.128 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:21.128 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:21.128 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:21.128 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:21.129 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:21.129 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:21.129 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.129 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "72", 2021-11-15T19:33:21.130 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:21.130 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:21.130 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:21.130 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:21.130 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:21.131 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:21.131 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:21.131 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:21.131 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:21.132 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:21.132 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:21.132 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:21.132 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:21.132 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:21.133 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:21.133 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:21.133 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:21.133 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:21.134 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:21.134 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:21.134 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:21.134 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:21.134 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:21.135 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:21.135 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:21.135 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:21.135 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.136 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:21.136 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:21.136 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:21.136 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:21.136 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:21.137 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:21.137 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:21.137 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:21.137 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:21.138 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:21.138 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:21.138 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:33:21.138 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:33:21.139 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:33:21.139 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:33:21.139 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.139 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:21.139 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:33:21.140 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:33:21.140 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.140 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.140 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.141 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.141 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 14, 2021-11-15T19:33:21.141 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:33:21.141 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:32:29.429846+0000", 2021-11-15T19:33:21.141 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:21.142 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:21.142 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:21.142 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:21.142 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:21.143 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:21.143 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:21.143 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:21.143 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:21.143 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:21.144 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:21.144 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:21.144 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:21.144 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:21.145 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:21.145 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:21.145 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:21.145 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:21.145 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:21.146 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:21.146 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.146 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "73", 2021-11-15T19:33:21.146 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:21.147 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:21.147 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:21.147 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:21.147 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:21.148 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:21.148 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:21.148 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:21.148 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:21.148 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:21.149 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:21.149 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:21.149 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:21.149 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:21.149 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:21.150 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:21.150 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:21.150 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:21.150 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:21.151 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:21.151 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:21.151 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:21.151 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:21.151 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:21.152 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:21.152 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:21.152 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.152 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:21.152 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:21.153 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:21.153 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:21.153 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:21.153 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:21.153 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:21.154 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:21.154 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:21.154 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:21.154 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:21.155 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:33:21.155 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:21.155 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:33:21.155 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:33:21.155 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.156 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.156 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.156 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:21.156 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:33:21.156 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.157 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:21.157 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:33:21.157 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.157 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.158 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.158 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.158 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.158 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.158 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.159 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:21.159 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.159 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.159 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.160 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.160 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.160 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.160 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:33:21.160 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.161 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.161 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.161 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.161 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:33:21.161 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.162 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.162 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.162 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.162 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.163 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.163 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.163 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.163 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:33:21.163 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.164 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.164 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.164 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.164 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:33:21.164 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.165 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.165 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.165 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.165 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.165 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.166 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.166 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.166 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:33:21.166 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.167 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.167 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.167 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.167 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:33:21.167 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.168 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.168 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.168 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.168 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.169 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.169 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.169 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.169 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:33:21.169 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.170 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.170 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.170 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.170 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:33:21.171 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:21.171 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.171 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.171 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.171 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:33:21.172 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:33:21.172 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:33:21.172 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:33:21.172 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.172 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.173 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.173 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.173 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.173 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.174 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:21.174 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:33:21.174 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.174 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.175 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.175 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.175 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.175 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.175 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.176 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:33:21.176 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.176 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.176 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.177 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.177 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.177 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.177 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:33:21.177 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.178 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.178 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.178 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.178 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:33:21.179 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.179 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.179 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.179 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.179 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.180 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.180 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.180 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.180 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:33:21.181 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.181 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.181 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.181 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.182 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:33:21.182 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.182 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.182 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.182 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.183 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.183 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.183 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.183 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.184 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:33:21.184 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.184 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.184 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.184 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.185 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:33:21.185 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.185 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.185 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.185 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.186 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.186 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.186 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.186 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.187 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:33:21.187 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.187 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.187 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.187 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.188 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:33:21.188 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:21.188 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.188 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.188 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.189 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:33:21.189 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:33:21.189 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:33:21.189 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:33:21.190 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.190 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.190 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.190 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.190 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.191 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.191 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:21.191 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:33:21.191 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.191 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.192 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.192 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.192 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.192 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.192 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.193 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:21.193 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.193 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.193 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.194 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.194 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.194 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.194 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:33:21.194 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.195 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.195 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.195 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.195 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:33:21.195 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.196 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.196 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.196 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.196 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.197 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.197 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.197 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.197 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:33:21.197 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.198 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.198 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.198 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.198 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:33:21.199 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.199 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.199 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.200 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.200 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.200 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.201 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.201 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.201 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:33:21.202 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.202 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.203 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.203 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.203 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:33:21.203 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.203 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.204 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.204 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.204 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.204 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.205 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.205 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.205 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:33:21.205 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.206 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.206 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.206 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.206 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:33:21.207 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:21.207 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.207 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.207 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.208 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:33:21.208 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:33:21.208 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:33:21.209 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:33:21.209 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.209 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.209 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.209 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.210 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.210 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.210 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:21.210 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:33:21.211 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.211 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.211 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.211 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.211 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.212 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.212 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.212 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:21.212 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.212 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.213 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.213 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.213 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.213 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.214 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:33:21.214 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.214 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.214 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.214 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.215 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:33:21.215 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.215 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.215 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.216 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.216 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.216 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.216 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.216 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.217 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:33:21.217 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.217 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.217 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.217 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.218 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:33:21.218 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.218 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.218 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.219 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.219 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.219 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.219 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.219 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.220 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:33:21.220 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.220 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.220 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.220 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.221 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:33:21.221 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.221 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.221 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.222 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.222 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.222 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.222 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.223 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.223 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:33:21.223 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.223 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.223 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.224 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.224 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:33:21.224 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:21.224 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.224 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.225 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.225 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:33:21.225 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:33:21.225 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:33:21.225 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:33:21.226 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.226 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.226 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.226 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.227 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.227 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.227 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:21.227 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:33:21.227 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.228 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.228 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.228 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.228 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.229 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.229 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.229 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 70, 2021-11-15T19:33:21.229 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.229 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.230 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.230 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.230 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.230 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.231 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:33:21.231 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.231 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.231 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.231 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.232 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:33:21.232 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.232 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.232 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.233 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.233 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.233 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.233 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.233 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.234 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:33:21.234 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.234 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.234 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.235 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.235 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:33:21.235 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.235 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.235 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.236 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.236 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.237 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.237 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.237 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.238 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:33:21.238 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.239 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.239 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.239 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.240 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:33:21.240 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.240 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.241 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.241 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.242 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.242 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.242 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.243 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.243 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:33:21.243 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.244 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.244 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.245 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.245 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:33:21.245 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:21.246 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.246 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.246 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.246 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:33:21.247 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:33:21.247 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:33:21.247 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:33:21.247 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.248 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.248 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.248 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.249 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.249 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.249 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:21.249 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:33:21.250 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.250 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.251 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.251 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.251 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.251 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.252 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.252 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:21.252 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.253 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.253 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.253 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.253 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.254 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.254 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:33:21.254 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.254 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.254 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.255 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.255 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:33:21.255 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.255 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.256 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.256 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.256 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.256 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.256 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.257 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.257 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:33:21.257 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.257 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.258 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.258 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.259 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:33:21.259 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.259 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.260 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.260 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.260 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.260 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.261 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.261 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.261 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:33:21.262 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.262 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.262 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.263 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.263 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:33:21.263 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.264 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.264 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.264 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.265 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.265 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.265 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.265 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.266 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:33:21.266 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.266 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.267 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.267 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.267 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:33:21.268 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:21.268 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.268 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.268 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.269 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:33:21.269 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:33:21.269 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:33:21.269 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:33:21.270 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.270 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.270 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.270 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.271 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.271 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.271 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:21.271 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:33:21.272 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.272 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.272 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.272 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.272 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.273 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.273 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.273 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:21.273 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.274 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.274 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.274 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.274 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.274 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.275 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:33:21.275 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.275 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.276 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.276 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.276 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:33:21.277 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.277 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.277 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.278 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.278 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.279 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.279 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.279 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.279 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:33:21.280 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.280 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.281 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.281 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.281 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:33:21.282 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.282 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.282 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.283 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.283 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.283 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.284 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.284 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.285 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:33:21.285 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.286 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.286 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.286 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.287 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:33:21.287 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.288 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.288 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.288 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.289 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.289 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.290 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.290 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.291 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:33:21.291 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.291 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.292 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.292 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.293 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:33:21.293 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:21.293 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.294 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.294 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.294 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:33:21.295 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:33:21.295 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:33:21.296 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:33:21.296 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.296 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.297 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.297 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.297 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.297 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.298 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:21.298 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:33:21.298 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:21.299 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:21.299 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:21.299 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:21.299 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:21.300 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:21.300 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:21.300 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 70, 2021-11-15T19:33:21.300 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:21.300 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:21.301 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:21.301 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.301 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.301 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.302 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:33:21.302 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.302 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.302 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.302 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.303 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:33:21.303 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.303 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.303 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.304 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.304 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:21.304 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.304 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.304 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.305 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:33:21.305 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.305 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.305 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.306 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.306 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:33:21.306 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.306 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.306 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.307 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.307 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:21.307 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.307 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.308 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.308 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:33:21.308 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.308 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.308 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.309 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.309 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:33:21.309 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.309 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.310 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.310 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.310 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:21.310 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:21.310 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.311 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:21.311 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:33:21.311 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.311 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.312 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.312 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:21.312 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:33:21.312 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:21.312 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.313 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.313 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.313 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:33:21.313 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:33:21.314 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:33:21.314 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:33:21.314 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:21.314 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:21.314 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:21.315 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:21.315 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.315 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:21.315 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:33:21.316 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.316 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:21.316 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.316 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.316 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.317 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.317 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.317 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:33:21.317 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.318 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.318 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.318 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:21.318 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.318 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.319 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.319 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.319 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.319 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:33:21.320 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.320 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.320 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.320 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:21.321 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.321 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.321 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.321 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.321 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.322 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:33:21.322 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.322 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.322 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.322 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:21.323 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.323 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.323 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.323 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.324 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.324 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:33:21.324 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.324 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.324 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.325 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:21.325 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.325 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.325 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.326 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.326 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:33:21.326 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.326 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.327 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.327 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:21.327 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.327 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.328 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.328 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.328 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.328 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:33:21.328 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.329 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.329 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.329 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:21.329 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.330 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.330 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.330 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.330 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.330 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:33:21.331 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.331 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.331 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:21.331 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:21.332 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:21.332 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:21.332 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:21.332 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:21.332 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:21.333 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:33:21.333 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:21.333 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.333 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:21.334 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:33:21.334 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:33:21.334 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:33:21.334 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:33:21.334 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:33:21.335 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.131:0/2457368916": "2021-11-15T20:33:11.377887+0000" 2021-11-15T19:33:21.335 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.335 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:33:21.335 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:33:21.336 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:33:21.336 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:33:21.336 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:33:21.336 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:33:21.336 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:33:21.337 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:33:21.337 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:21.337 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:21.337 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:33:21.338 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:33:21.338 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:33:21.338 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:33:21.338 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:33:21.338 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:33:21.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fecb40536f0 msgr2=0x7fecb4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fecb40536f0 0x7fecb4055bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fecc40032f0 tx=0x7fecc4006e10).stop 2021-11-15T19:33:21.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 msgr2=0x7fecd414a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd414a600 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fecc8002ef0 tx=0x7fecc8006d50).stop 2021-11-15T19:33:21.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 shutdown_connections 2021-11-15T19:33:21.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fecb40536f0 0x7fecb4055bb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fecd4144610 0x7fecd4156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fecd40b1340 0x7fecd41566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 --2- 172.21.2.137:0/3117718383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fecd40a9f50 0x7fecd414a600 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 >> 172.21.2.137:0/3117718383 conn(0x7fecd40b4e60 msgr2=0x7fecd40af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 shutdown_connections 2021-11-15T19:33:21.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.077+0000 7fecdb2db700 1 -- 172.21.2.137:0/3117718383 wait complete. 2021-11-15T19:33:21.343 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:21.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 Processor -- start 2021-11-15T19:33:21.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- start start 2021-11-15T19:33:21.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e40b1340 0x7f80e4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f80e4143f00 0x7f80e4144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e4148190 con 0x7f80e40a9f50 2021-11-15T19:33:21.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40b1720 con 0x7f80e4143f00 2021-11-15T19:33:21.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4147e70 con 0x7f80e40b1340 2021-11-15T19:33:21.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e9994700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f80e40a9f50 0x7f80e40aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55042/0 (socket says 172.21.2.137:55042) 2021-11-15T19:33:21.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e9994700 1 -- 172.21.2.137:0/3649744482 learned_addr learned my addr 172.21.2.137:0/3649744482 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:21.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- 172.21.2.137:0/3649744482 >> v2:172.21.2.137:3300/0 conn(0x7f80e4143f00 0x7f80e4144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/3649744482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e40b1340 msgr2=0x7f80e4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:21.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d3fff700 1 -- 172.21.2.137:0/3649744482 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112475337 0 0) 0x7f80dc001490 con 0x7f80e40a9f50 2021-11-15T19:33:21.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- 172.21.2.137:0/3649744482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e40b1340 0x7f80e4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/3649744482 >> v1:172.21.2.137:6789/0 conn(0x7f80e40a9f50 legacy=0x7f80e40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/3649744482 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40af800 con 0x7f80e4143f00 2021-11-15T19:33:21.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- 172.21.2.137:0/3649744482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e4143f00 0x7f80e4144360 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f80d4002f70 tx=0x7f80d4006df0).ready entity=mon.1 client_cookie=d5c5ad0172af32b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d3fff700 1 -- 172.21.2.137:0/3649744482 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d400d570 con 0x7f80e4143f00 2021-11-15T19:33:21.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d3fff700 1 -- 172.21.2.137:0/3649744482 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d4000e90 con 0x7f80e4143f00 2021-11-15T19:33:21.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d3fff700 1 -- 172.21.2.137:0/3649744482 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d400d8c0 con 0x7f80e4143f00 2021-11-15T19:33:21.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- 172.21.2.137:0/3649744482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e4143f00 msgr2=0x7f80e4144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/3649744482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e4143f00 0x7f80e4144360 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f80d4002f70 tx=0x7f80d4006df0).stop 2021-11-15T19:33:21.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- 172.21.2.137:0/3649744482 shutdown_connections 2021-11-15T19:33:21.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/3649744482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e4143f00 0x7f80e4144360 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/3649744482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e40b1340 0x7f80e4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- 172.21.2.137:0/3649744482 >> 172.21.2.137:0/3649744482 conn(0x7f80e40b4e60 msgr2=0x7f80e40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:21.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- 172.21.2.137:0/3649744482 shutdown_connections 2021-11-15T19:33:21.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- 172.21.2.137:0/3649744482 wait complete. 2021-11-15T19:33:21.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 Processor -- start 2021-11-15T19:33:21.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- start start 2021-11-15T19:33:21.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80e40a9f50 0x7f80e4140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 0x7f80e4155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e4143f00 0x7f80e4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e41564d0 con 0x7f80e40a9f50 2021-11-15T19:33:21.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4157160 con 0x7f80e40b1340 2021-11-15T19:33:21.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4157400 con 0x7f80e4143f00 2021-11-15T19:33:21.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 0x7f80e4155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 0x7f80e4155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36262/0 (socket says 172.21.2.137:36262) 2021-11-15T19:33:21.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/1589017651 learned_addr learned my addr 172.21.2.137:0/1589017651 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:21.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e9994700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e4143f00 0x7f80e4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e4143f00 msgr2=0x7f80e4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e4143f00 0x7f80e4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e9193700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80e40a9f50 0x7f80e4140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80e40a9f50 msgr2=0x7f80e4140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80e40a9f50 0x7f80e4140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 -- 172.21.2.137:0/1589017651 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d400b180 con 0x7f80e40b1340 2021-11-15T19:33:21.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e9994700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e4143f00 0x7f80e4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:21.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e9193700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80e40a9f50 0x7f80e4140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:21.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80e8992700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 0x7f80e4155af0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f80d4002f70 tx=0x7f80d4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d40119d0 con 0x7f80e40b1340 2021-11-15T19:33:21.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d4011b30 con 0x7f80e40b1340 2021-11-15T19:33:21.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e414a530 con 0x7f80e40b1340 2021-11-15T19:33:21.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.393+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d4011e90 con 0x7f80e40b1340 2021-11-15T19:33:21.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e414b180 con 0x7f80e40b1340 2021-11-15T19:33:21.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e414b370 con 0x7f80e40b1340 2021-11-15T19:33:21.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f80d4025030 con 0x7f80e40b1340 2021-11-15T19:33:21.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80d27fc700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f80c40536a0 0x7f80c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f80d406cd80 con 0x7f80e40b1340 2021-11-15T19:33:21.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80e9193700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f80c40536a0 0x7f80c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80e9193700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f80c40536a0 0x7f80c4055b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f80e0007000 tx=0x7f80e0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.397+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f80d4043db0 con 0x7f80e40b1340 2021-11-15T19:33:21.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80e405faf0 con 0x7f80e40b1340 2021-11-15T19:33:21.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80d27fc700 1 -- 172.21.2.137:0/1589017651 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f80d4023070 con 0x7f80e40b1340 2021-11-15T19:33:21.517 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:21.517 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:32:31.460820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6184":{"gid":6184,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/1730106945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1730106945},{"type":"v1","addr":"172.21.2.137:6833","nonce":1730106945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:33:21.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f80c40536a0 msgr2=0x7f80c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f80c40536a0 0x7f80c4055b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f80e0007000 tx=0x7f80e0008040).stop 2021-11-15T19:33:21.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 msgr2=0x7f80e4155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 0x7f80e4155af0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f80d4002f70 tx=0x7f80d4015000).stop 2021-11-15T19:33:21.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 shutdown_connections 2021-11-15T19:33:21.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f80c40536a0 0x7f80c4055b60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80e4143f00 0x7f80e4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80e40b1340 0x7f80e4155af0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 --2- 172.21.2.137:0/1589017651 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80e40a9f50 0x7f80e4140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:21.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 >> 172.21.2.137:0/1589017651 conn(0x7f80e40b4e60 msgr2=0x7f80e40b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:21.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 shutdown_connections 2021-11-15T19:33:21.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.509+0000 7f80eb3f7700 1 -- 172.21.2.137:0/1589017651 wait complete. 2021-11-15T19:33:21.522 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 32 2021-11-15T19:33:21.524 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:33:21.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.569+0000 7fa55257e700 1 Processor -- start 2021-11-15T19:33:21.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.569+0000 7fa55257e700 1 -- start start 2021-11-15T19:33:21.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa54c065730 0x7fa54c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c066270 con 0x7fa54c0b00a0 2021-11-15T19:33:21.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c065fd0 con 0x7fa54c065b10 2021-11-15T19:33:21.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c067410 con 0x7fa54c065730 2021-11-15T19:33:21.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa54c065b10 0x7fa54c13c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55054/0 (socket says 172.21.2.137:55054) 2021-11-15T19:33:21.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 -- 172.21.2.137:0/3699770417 learned_addr learned my addr 172.21.2.137:0/3699770417 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:21.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929226826 0 0) 0x7fa54c065fd0 con 0x7fa54c065b10 2021-11-15T19:33:21.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa52c004370 con 0x7fa54c065b10 2021-11-15T19:33:21.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856296777 0 0) 0x7fa52c004370 con 0x7fa54c065b10 2021-11-15T19:33:21.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa54c065730 msgr2=0x7fa54c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:21.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa54c065730 0x7fa54c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 >> v1:172.21.2.111:6789/0 conn(0x7fa54c0b00a0 legacy=0x7fa54c05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:21.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c066f70 con 0x7fa54c065b10 2021-11-15T19:33:21.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa53c0019e0 con 0x7fa54c065b10 2021-11-15T19:33:21.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 >> v1:172.21.2.137:6789/0 conn(0x7fa54c065b10 legacy=0x7fa54c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa52c0048e0 0x7fa52c004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa52c005610 0x7fa52c005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa54c065730 0x7fa52c003260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c067410 con 0x7fa52c0048e0 2021-11-15T19:33:21.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c006390 con 0x7fa52c005610 2021-11-15T19:33:21.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c003750 con 0x7fa54c065730 2021-11-15T19:33:21.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa52c005610 0x7fa52c005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 -- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa54c065730 msgr2=0x7fa52c003260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:21.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa54c065730 0x7fa52c003260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 -- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa52c0048e0 msgr2=0x7fa52c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:21.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa52c0048e0 0x7fa52c004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 -- 172.21.2.137:0/3699770417 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c004370 con 0x7fa52c005610 2021-11-15T19:33:21.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54b7fe700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa52c005610 0x7fa52c005a90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fa54c060dc0 tx=0x7fa54c0652b0).ready entity=mon.1 client_cookie=c4c8edb233ba25cb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c00cbe0 con 0x7fa52c005610 2021-11-15T19:33:21.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c00cd40 con 0x7fa52c005610 2021-11-15T19:33:21.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54affd700 1 -- 172.21.2.137:0/3699770417 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c005b80 con 0x7fa52c005610 2021-11-15T19:33:21.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/3699770417 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa52c005610 msgr2=0x7fa52c005a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 --2- 172.21.2.137:0/3699770417 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa52c005610 0x7fa52c005a90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fa54c060dc0 tx=0x7fa54c0652b0).stop 2021-11-15T19:33:21.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 -- 172.21.2.137:0/3699770417 reap_dead start 2021-11-15T19:33:21.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/3699770417 shutdown_connections 2021-11-15T19:33:21.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/3699770417 >> 172.21.2.137:0/3699770417 conn(0x7fa54c060290 msgr2=0x7fa54c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:21.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/3699770417 shutdown_connections 2021-11-15T19:33:21.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/3699770417 wait complete. 2021-11-15T19:33:21.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 Processor -- start 2021-11-15T19:33:21.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- start start 2021-11-15T19:33:21.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa52c005610 0x7fa54c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa54c1431c0 0x7fa54c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 0x7fa54c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c155510 con 0x7fa54c1431c0 2021-11-15T19:33:21.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0ae3f0 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0b5620 con 0x7fa52c005610 2021-11-15T19:33:21.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 0x7fa54c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 0x7fa54c155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36284/0 (socket says 172.21.2.137:36284) 2021-11-15T19:33:21.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 -- 172.21.2.137:0/4070023296 learned_addr learned my addr 172.21.2.137:0/4070023296 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:21.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 -- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa52c005610 msgr2=0x7fa54c05c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa52c005610 0x7fa54c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 -- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa54c1431c0 msgr2=0x7fa54c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:21.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa54c1431c0 0x7fa54c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:21.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 -- 172.21.2.137:0/4070023296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0b5380 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa550b1b700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 0x7fa54c155dc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fa54c0b57b0 tx=0x7fa544007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54400cc70 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c0b5940 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400cdd0 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa544007360 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c140610 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c0b0fb0 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa54401c070 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa5497fa700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa530053720 0x7fa530055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:21.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fa54406a990 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54bfff700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa530053720 0x7fa530055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:21.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.573+0000 7fa54bfff700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa530053720 0x7fa530055be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fa534002f70 tx=0x7fa534006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:21.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.581+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5440419c0 con 0x7fa54c0ad3b0 2021-11-15T19:33:21.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:21.685+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa54c0ae530 con 0x7fa54c0ad3b0 2021-11-15T19:33:22.273 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:33:22.269+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:33:22.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa5497fa700 1 -- 172.21.2.137:0/4070023296 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa544044fe0 con 0x7fa54c0ad3b0 2021-11-15T19:33:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa530053720 msgr2=0x7fa530055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa530053720 0x7fa530055be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fa534002f70 tx=0x7fa534006a10).stop 2021-11-15T19:33:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 msgr2=0x7fa54c155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 0x7fa54c155dc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fa54c0b57b0 tx=0x7fa544007ad0).stop 2021-11-15T19:33:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 shutdown_connections 2021-11-15T19:33:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa530053720 0x7fa530055be0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa54c0ad3b0 0x7fa54c155dc0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa54c1431c0 0x7fa54c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 --2- 172.21.2.137:0/4070023296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa52c005610 0x7fa54c05c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 >> 172.21.2.137:0/4070023296 conn(0x7fa54c060290 msgr2=0x7fa54c0b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 shutdown_connections 2021-11-15T19:33:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.281+0000 7fa55257e700 1 -- 172.21.2.137:0/4070023296 wait complete. 2021-11-15T19:33:22.291 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:33:22.294 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:22.302 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:33:22.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 Processor -- start 2021-11-15T19:33:22.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- start start 2021-11-15T19:33:22.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32b80b1340 0x7f32b8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f32b8143f00 0x7f32b8144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b8148190 con 0x7f32b80a9f50 2021-11-15T19:33:22.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80b1720 con 0x7f32b8143f00 2021-11-15T19:33:22.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8147e70 con 0x7f32b80b1340 2021-11-15T19:33:22.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f32b80a9f50 0x7f32b80aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55084/0 (socket says 172.21.2.137:55084) 2021-11-15T19:33:22.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 -- 172.21.2.137:0/2437079625 learned_addr learned my addr 172.21.2.137:0/2437079625 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:22.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264554232 0 0) 0x7f32b0001490 con 0x7f32b80a9f50 2021-11-15T19:33:22.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a4003260 con 0x7f32b80a9f50 2021-11-15T19:33:22.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 --2- 172.21.2.137:0/2437079625 >> v2:172.21.2.111:3300/0 conn(0x7f32b8143f00 0x7f32b8144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286373642 0 0) 0x7f32a4003260 con 0x7f32b80a9f50 2021-11-15T19:33:22.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32b80b1340 msgr2=0x7f32b8147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:22.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32b80b1340 0x7f32b8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 >> v2:172.21.2.111:3300/0 conn(0x7f32b8143f00 msgr2=0x7f32b8144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:22.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 --2- 172.21.2.137:0/2437079625 >> v2:172.21.2.111:3300/0 conn(0x7f32b8143f00 0x7f32b8144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:22.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80af800 con 0x7f32b80a9f50 2021-11-15T19:33:22.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f32b0001b70 con 0x7f32b80a9f50 2021-11-15T19:33:22.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 >> v1:172.21.2.137:6789/0 conn(0x7f32b80a9f50 legacy=0x7f32b80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32b80b1340 0x7f32a40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32a4003e90 0x7f32a4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32a4004b10 0x7f32a4004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b1720 con 0x7f32a4003e90 2021-11-15T19:33:22.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8147e70 con 0x7f32a4004b10 2021-11-15T19:33:22.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a400ba60 con 0x7f32b80b1340 2021-11-15T19:33:22.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32a4004b10 0x7f32a4004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 -- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32b80b1340 msgr2=0x7f32a40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:22.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32b80b1340 0x7f32a40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 -- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32a4003e90 msgr2=0x7f32a4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:22.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32a4003e90 0x7f32a4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 -- 172.21.2.137:0/2437079625 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80af800 con 0x7f32a4004b10 2021-11-15T19:33:22.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32a4004b10 0x7f32a4004f90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f32b0001880 tx=0x7f32b0007ac0).ready entity=mon.1 client_cookie=d5d5c87135617124 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:22.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32b000ce10 con 0x7f32a4004b10 2021-11-15T19:33:22.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b0005990 con 0x7f32a4004b10 2021-11-15T19:33:22.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b77fe700 1 -- 172.21.2.137:0/2437079625 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32b0005cf0 con 0x7f32a4004b10 2021-11-15T19:33:22.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/2437079625 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32a4004b10 msgr2=0x7f32a4004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 --2- 172.21.2.137:0/2437079625 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32a4004b10 0x7f32a4004f90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f32b0001880 tx=0x7f32b0007ac0).stop 2021-11-15T19:33:22.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bd7d5700 1 -- 172.21.2.137:0/2437079625 reap_dead start 2021-11-15T19:33:22.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/2437079625 shutdown_connections 2021-11-15T19:33:22.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/2437079625 >> 172.21.2.137:0/2437079625 conn(0x7f32b80b4e60 msgr2=0x7f32b80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:22.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/2437079625 shutdown_connections 2021-11-15T19:33:22.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/2437079625 wait complete. 2021-11-15T19:33:22.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 Processor -- start 2021-11-15T19:33:22.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- start start 2021-11-15T19:33:22.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32a4004b10 0x7f32b8145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 0x7f32b8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32b8146d10 0x7f32b8159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8146330 con 0x7f32b8146d10 2021-11-15T19:33:22.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81465d0 con 0x7f32b80992b0 2021-11-15T19:33:22.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8146870 con 0x7f32a4004b10 2021-11-15T19:33:22.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 0x7f32b8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 0x7f32b8156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36316/0 (socket says 172.21.2.137:36316) 2021-11-15T19:33:22.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 -- 172.21.2.137:0/4190636559 learned_addr learned my addr 172.21.2.137:0/4190636559 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:22.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 -- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32a4004b10 msgr2=0x7f32b8145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32a4004b10 0x7f32b8145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 -- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32b8146d10 msgr2=0x7f32b8159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32b8146d10 0x7f32b8159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 -- 172.21.2.137:0/4190636559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8147190 con 0x7f32b80992b0 2021-11-15T19:33:22.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b7fff700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 0x7f32b8156fd0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f32ac007000 tx=0x7f32ac008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:22.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32ac00f4e0 con 0x7f32b80992b0 2021-11-15T19:33:22.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac000e90 con 0x7f32b80992b0 2021-11-15T19:33:22.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b8159fa0 con 0x7f32b80992b0 2021-11-15T19:33:22.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b815a470 con 0x7f32b80992b0 2021-11-15T19:33:22.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32ac00f830 con 0x7f32b80992b0 2021-11-15T19:33:22.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8099730 con 0x7f32b80992b0 2021-11-15T19:33:22.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f32ac00f990 con 0x7f32b80992b0 2021-11-15T19:33:22.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b5ffb700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3298053720 0x7f3298055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6198+0+0 (secure 0 0 0) 0x7f32ac06b4b0 con 0x7f32b80992b0 2021-11-15T19:33:22.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.341+0000 7f32bcfd4700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3298053720 0x7f3298055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.345+0000 7f32bcfd4700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3298053720 0x7f3298055be0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f32a8002f70 tx=0x7f32a8006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:22.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.345+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f32ac042590 con 0x7f32b80992b0 2021-11-15T19:33:22.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32b805faf0 con 0x7f32b80992b0 2021-11-15T19:33:22.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32b5ffb700 1 -- 172.21.2.137:0/4190636559 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+1776 (secure 0 0 0) 0x7f32ac045bb0 con 0x7f32b80992b0 2021-11-15T19:33:22.467 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:22.467 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:32:30.455951+0000","modified":"2021-11-15T19:33:22.271299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T19:33:22.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3298053720 msgr2=0x7f3298055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3298053720 0x7f3298055be0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f32a8002f70 tx=0x7f32a8006a10).stop 2021-11-15T19:33:22.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 msgr2=0x7f32b8156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 0x7f32b8156fd0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f32ac007000 tx=0x7f32ac008040).stop 2021-11-15T19:33:22.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 shutdown_connections 2021-11-15T19:33:22.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3298053720 0x7f3298055be0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:22.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f32b8146d10 0x7f32b8159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f32b80992b0 0x7f32b8156fd0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:22.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 --2- 172.21.2.137:0/4190636559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f32a4004b10 0x7f32b8145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 >> 172.21.2.137:0/4190636559 conn(0x7f32b80b4e60 msgr2=0x7f32b80ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:22.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 shutdown_connections 2021-11-15T19:33:22.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.457+0000 7f32bf238700 1 -- 172.21.2.137:0/4190636559 wait complete. 2021-11-15T19:33:22.471 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 33 2021-11-15T19:33:22.474 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:33:22.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 Processor -- start 2021-11-15T19:33:22.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- start start 2021-11-15T19:33:22.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3e70065730 0x7f3e7013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3e70065b10 0x7f3e7013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e70066270 con 0x7f3e700b00a0 2021-11-15T19:33:22.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e70067410 con 0x7f3e70065730 2021-11-15T19:33:22.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e70065fd0 con 0x7f3e70065b10 2021-11-15T19:33:22.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3e70065b10 0x7f3e7013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3e70065b10 0x7f3e7013c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36322/0 (socket says 172.21.2.137:36322) 2021-11-15T19:33:22.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 -- 172.21.2.137:0/117244327 learned_addr learned my addr 172.21.2.137:0/117244327 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:22.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 -- 172.21.2.137:0/117244327 >> v2:172.21.2.111:3300/0 conn(0x7f3e70065730 msgr2=0x7f3e7013c2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:22.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 --2- 172.21.2.137:0/117244327 >> v2:172.21.2.111:3300/0 conn(0x7f3e70065730 0x7f3e7013c2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 -- 172.21.2.137:0/117244327 >> v1:172.21.2.111:6789/0 conn(0x7f3e700b00a0 legacy=0x7f3e7005bd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:22.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 -- 172.21.2.137:0/117244327 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70066f70 con 0x7f3e70065b10 2021-11-15T19:33:22.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7594d700 1 --2- 172.21.2.137:0/117244327 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e70065b10 0x7f3e7013c7a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f3e7013f060 tx=0x7f3e64006e40).ready entity=mon.1 client_cookie=909b110a268d6ac3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:22.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7514c700 1 -- 172.21.2.137:0/117244327 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e6400bcb0 con 0x7f3e70065b10 2021-11-15T19:33:22.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7514c700 1 -- 172.21.2.137:0/117244327 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64000e90 con 0x7f3e70065b10 2021-11-15T19:33:22.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e7514c700 1 -- 172.21.2.137:0/117244327 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e640155e0 con 0x7f3e70065b10 2021-11-15T19:33:22.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- 172.21.2.137:0/117244327 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e70065b10 msgr2=0x7f3e7013c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 --2- 172.21.2.137:0/117244327 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e70065b10 0x7f3e7013c7a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f3e7013f060 tx=0x7f3e64006e40).stop 2021-11-15T19:33:22.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- 172.21.2.137:0/117244327 shutdown_connections 2021-11-15T19:33:22.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 --2- 172.21.2.137:0/117244327 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e70065b10 0x7f3e7013c7a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:22.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 --2- 172.21.2.137:0/117244327 >> v2:172.21.2.111:3300/0 conn(0x7f3e70065730 0x7f3e7013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- 172.21.2.137:0/117244327 >> 172.21.2.137:0/117244327 conn(0x7f3e70060290 msgr2=0x7f3e70060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:22.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- 172.21.2.137:0/117244327 shutdown_connections 2021-11-15T19:33:22.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.517+0000 7f3e783b2700 1 -- 172.21.2.137:0/117244327 wait complete. 2021-11-15T19:33:22.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 Processor -- start 2021-11-15T19:33:22.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- start start 2021-11-15T19:33:22.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e70065730 0x7f3e70140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e70065b10 0x7f3e70159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 0x7f3e7015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70141810 con 0x7f3e70065730 2021-11-15T19:33:22.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700ac910 con 0x7f3e700b00a0 2021-11-15T19:33:22.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700adb80 con 0x7f3e70065b10 2021-11-15T19:33:22.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 0x7f3e7015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 0x7f3e7015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36330/0 (socket says 172.21.2.137:36330) 2021-11-15T19:33:22.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 -- 172.21.2.137:0/1980670585 learned_addr learned my addr 172.21.2.137:0/1980670585 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:22.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 -- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e70065b10 msgr2=0x7f3e70159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e70065b10 0x7f3e70159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 -- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e70065730 msgr2=0x7f3e70140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:22.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e70065730 0x7f3e70140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:22.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 -- 172.21.2.137:0/1980670585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6400d4d0 con 0x7f3e700b00a0 2021-11-15T19:33:22.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7694f700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 0x7f3e7015a2b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f3e68001250 tx=0x7f3e680090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:22.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e680014e0 con 0x7f3e700b00a0 2021-11-15T19:33:22.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68001640 con 0x7f3e700b00a0 2021-11-15T19:33:22.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e680019a0 con 0x7f3e700b00a0 2021-11-15T19:33:22.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700ad020 con 0x7f3e700b00a0 2021-11-15T19:33:22.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e70112790 con 0x7f3e700b00a0 2021-11-15T19:33:22.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e700acbe0 con 0x7f3e700b00a0 2021-11-15T19:33:22.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e68018030 con 0x7f3e700b00a0 2021-11-15T19:33:22.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e637fe700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e500536a0 0x7f3e50055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:22.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6198+0+0 (secure 0 0 0) 0x7f3e6806b2e0 con 0x7f3e700b00a0 2021-11-15T19:33:22.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.521+0000 7f3e7614e700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e500536a0 0x7f3e50055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:22.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.525+0000 7f3e7614e700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e500536a0 0x7f3e50055b60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f3e6c002fb0 tx=0x7f3e6c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:22.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.525+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e68042470 con 0x7f3e700b00a0 2021-11-15T19:33:22.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:22.633+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3e7013cc90 con 0x7f3e700b00a0 2021-11-15T19:33:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e637fe700 1 -- 172.21.2.137:0/1980670585 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3e68045a90 con 0x7f3e700b00a0 2021-11-15T19:33:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e500536a0 msgr2=0x7f3e50055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e500536a0 0x7f3e50055b60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f3e6c002fb0 tx=0x7f3e6c0069b0).stop 2021-11-15T19:33:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 msgr2=0x7f3e7015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 0x7f3e7015a2b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f3e68001250 tx=0x7f3e680090f0).stop 2021-11-15T19:33:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 shutdown_connections 2021-11-15T19:33:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e500536a0 0x7f3e50055b60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:23.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3e700b00a0 0x7f3e7015a2b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:23.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3e70065b10 0x7f3e70159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:23.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 --2- 172.21.2.137:0/1980670585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3e70065730 0x7f3e70140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:23.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 >> 172.21.2.137:0/1980670585 conn(0x7f3e70060290 msgr2=0x7f3e70069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:23.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 shutdown_connections 2021-11-15T19:33:23.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.293+0000 7f3e783b2700 1 -- 172.21.2.137:0/1980670585 wait complete. 2021-11-15T19:33:23.307 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:33:23.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 Processor -- start 2021-11-15T19:33:23.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 -- start start 2021-11-15T19:33:23.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7faa0c05fd20 0x7faa0c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:23.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7faa0c0b0830 0x7faa0c0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:23.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c147f70 con 0x7faa0c0b10b0 2021-11-15T19:33:23.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c060100 con 0x7faa0c05fd20 2021-11-15T19:33:23.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa11fa9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c147cd0 con 0x7faa0c0b0830 2021-11-15T19:33:23.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0affd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7faa0c0b10b0 0x7faa0c0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55120/0 (socket says 172.21.2.137:55120) 2021-11-15T19:33:23.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0affd700 1 -- 172.21.2.137:0/2669694617 learned_addr learned my addr 172.21.2.137:0/2669694617 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:23.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2669694617 >> v2:172.21.2.137:3300/0 conn(0x7faa0c0b0830 0x7faa0c0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:23.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0bfff700 1 -- 172.21.2.137:0/2669694617 >> v2:172.21.2.111:3300/0 conn(0x7faa0c05fd20 msgr2=0x7faa0c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:23.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2669694617 >> v2:172.21.2.111:3300/0 conn(0x7faa0c05fd20 0x7faa0c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:23.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0bfff700 1 -- 172.21.2.137:0/2669694617 >> v1:172.21.2.137:6789/0 conn(0x7faa0c0b10b0 legacy=0x7faa0c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:23.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0bfff700 1 -- 172.21.2.137:0/2669694617 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0a9ed0 con 0x7faa0c0b0830 2021-11-15T19:33:23.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0bfff700 1 --2- 172.21.2.137:0/2669694617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b0830 0x7faa0c0aa370 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7faa040032f0 tx=0x7faa040091d0).ready entity=mon.1 client_cookie=92f2d555bd5f0f23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:23.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0a7fc700 1 -- 172.21.2.137:0/2669694617 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa04009ea0 con 0x7faa0c0b0830 2021-11-15T19:33:23.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0a7fc700 1 -- 172.21.2.137:0/2669694617 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400b870 con 0x7faa0c0b0830 2021-11-15T19:33:23.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.353+0000 7faa0a7fc700 1 -- 172.21.2.137:0/2669694617 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0400b9e0 con 0x7faa0c0b0830 2021-11-15T19:33:23.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/2669694617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b0830 msgr2=0x7faa0c0aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:23.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 --2- 172.21.2.137:0/2669694617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b0830 0x7faa0c0aa370 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7faa040032f0 tx=0x7faa040091d0).stop 2021-11-15T19:33:23.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/2669694617 shutdown_connections 2021-11-15T19:33:23.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 --2- 172.21.2.137:0/2669694617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b0830 0x7faa0c0aa370 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:23.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 --2- 172.21.2.137:0/2669694617 >> v2:172.21.2.111:3300/0 conn(0x7faa0c05fd20 0x7faa0c0af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:23.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/2669694617 >> 172.21.2.137:0/2669694617 conn(0x7faa0c0b4e60 msgr2=0x7faa0c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:23.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/2669694617 shutdown_connections 2021-11-15T19:33:23.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/2669694617 wait complete. 2021-11-15T19:33:23.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 Processor -- start 2021-11-15T19:33:23.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- start start 2021-11-15T19:33:23.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c05fd20 0x7faa0c142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:23.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b0830 0x7faa0c099410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:23.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 0x7faa0c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:23.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c140630 con 0x7faa0c05fd20 2021-11-15T19:33:23.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1443b0 con 0x7faa0c0b10b0 2021-11-15T19:33:23.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c098d40 con 0x7faa0c0b0830 2021-11-15T19:33:23.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 0x7faa0c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:23.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 0x7faa0c156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36346/0 (socket says 172.21.2.137:36346) 2021-11-15T19:33:23.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 -- 172.21.2.137:0/4142436457 learned_addr learned my addr 172.21.2.137:0/4142436457 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:23.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 -- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b0830 msgr2=0x7faa0c099410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:23.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b0830 0x7faa0c099410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:23.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 -- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c05fd20 msgr2=0x7faa0c142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:23.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c05fd20 0x7faa0c142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:23.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 -- 172.21.2.137:0/4142436457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009470 con 0x7faa0c0b10b0 2021-11-15T19:33:23.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0bfff700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 0x7faa0c156760 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7faa040032f0 tx=0x7faa04016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:23.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa04021630 con 0x7faa0c0b10b0 2021-11-15T19:33:23.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa04021790 con 0x7faa0c0b10b0 2021-11-15T19:33:23.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa04021af0 con 0x7faa0c0b10b0 2021-11-15T19:33:23.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c141ee0 con 0x7faa0c0b10b0 2021-11-15T19:33:23.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c143110 con 0x7faa0c0b10b0 2021-11-15T19:33:23.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c1479f0 con 0x7faa0c0b10b0 2021-11-15T19:33:23.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa04027020 con 0x7faa0c0b10b0 2021-11-15T19:33:23.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa08ff9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053640 0x7fa9f0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:23.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6198+0+0 (secure 0 0 0) 0x7faa0406d380 con 0x7faa0c0b10b0 2021-11-15T19:33:23.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.357+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053640 0x7fa9f0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:23.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.361+0000 7faa0b7fe700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053640 0x7fa9f0055b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa9fc002f70 tx=0x7fa9fc006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:23.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.361+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa04044460 con 0x7faa0c0b10b0 2021-11-15T19:33:23.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:23.441+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa0c0573d0 con 0x7faa0c0b10b0 2021-11-15T19:33:24.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa08ff9700 1 -- 172.21.2.137:0/4142436457 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) v1 ==== 185+0+0 (secure 0 0 0) 0x7faa04015070 con 0x7faa0c0b10b0 2021-11-15T19:33:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053640 msgr2=0x7fa9f0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053640 0x7fa9f0055b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa9fc002f70 tx=0x7fa9fc006a80).stop 2021-11-15T19:33:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 msgr2=0x7faa0c156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:24.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 0x7faa0c156760 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7faa040032f0 tx=0x7faa04016000).stop 2021-11-15T19:33:24.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 shutdown_connections 2021-11-15T19:33:24.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9f0053640 0x7fa9f0055b00 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0x7fa9fc002f70 tx=0x7fa9fc006a80).stop 2021-11-15T19:33:24.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7faa0c0b10b0 0x7faa0c156760 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:24.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7faa0c0b0830 0x7faa0c099410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:24.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 --2- 172.21.2.137:0/4142436457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7faa0c05fd20 0x7faa0c142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:24.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 >> 172.21.2.137:0/4142436457 conn(0x7faa0c0b4e60 msgr2=0x7faa0c0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:24.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 shutdown_connections 2021-11-15T19:33:24.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.301+0000 7faa11fa9700 1 -- 172.21.2.137:0/4142436457 wait complete. 2021-11-15T19:33:24.313 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:33:24.316 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:33:24.348 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:24.350 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:24.353 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:24.356 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:24.360 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:24.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 Processor -- start 2021-11-15T19:33:24.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- start start 2021-11-15T19:33:24.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d6813ce00 0x7f6d68142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:24.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b6830 0x7f6d681433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:24.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d680b63b0 con 0x7f6d680b5fd0 2021-11-15T19:33:24.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d68147070 con 0x7f6d6813ce00 2021-11-15T19:33:24.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68146dd0 con 0x7f6d680b6830 2021-11-15T19:33:24.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d6813ce00 0x7f6d68142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:24.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6d6813ce00 0x7f6d68142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36352/0 (socket says 172.21.2.137:36352) 2021-11-15T19:33:24.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 -- 172.21.2.137:0/3027749330 learned_addr learned my addr 172.21.2.137:0/3027749330 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:24.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6659c700 1 --1- 172.21.2.137:0/3027749330 >> v1:172.21.2.137:6789/0 conn(0x7f6d680b5fd0 0x7f6d6813c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55132/0 (socket says 172.21.2.137:55132) 2021-11-15T19:33:24.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 -- 172.21.2.137:0/3027749330 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b6830 msgr2=0x7f6d681433c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:24.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 --2- 172.21.2.137:0/3027749330 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b6830 0x7f6d681433c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:24.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 -- 172.21.2.137:0/3027749330 >> v1:172.21.2.137:6789/0 conn(0x7f6d680b5fd0 legacy=0x7f6d6813c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:24.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 -- 172.21.2.137:0/3027749330 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68146af0 con 0x7f6d6813ce00 2021-11-15T19:33:24.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d65d9b700 1 --2- 172.21.2.137:0/3027749330 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68142ed0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f6d50002f70 tx=0x7f6d50006eb0).ready entity=mon.1 client_cookie=80387d26f8612fb1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:24.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6559a700 1 -- 172.21.2.137:0/3027749330 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5000d5c0 con 0x7f6d6813ce00 2021-11-15T19:33:24.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6559a700 1 -- 172.21.2.137:0/3027749330 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50000e90 con 0x7f6d6813ce00 2021-11-15T19:33:24.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6559a700 1 -- 172.21.2.137:0/3027749330 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5000d950 con 0x7f6d6813ce00 2021-11-15T19:33:24.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3027749330 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 msgr2=0x7f6d68142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:24.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3027749330 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68142ed0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f6d50002f70 tx=0x7f6d50006eb0).stop 2021-11-15T19:33:24.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3027749330 shutdown_connections 2021-11-15T19:33:24.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3027749330 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68142ed0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:24.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3027749330 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b6830 0x7f6d681433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:24.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3027749330 >> 172.21.2.137:0/3027749330 conn(0x7f6d680624b0 msgr2=0x7f6d68062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:24.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3027749330 shutdown_connections 2021-11-15T19:33:24.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3027749330 wait complete. 2021-11-15T19:33:24.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 Processor -- start 2021-11-15T19:33:24.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- start start 2021-11-15T19:33:24.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b5fd0 0x7f6d68064d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:24.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d680b6830 0x7f6d68065250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:24.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:24.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68065740 con 0x7f6d680b6830 2021-11-15T19:33:24.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6813a580 con 0x7f6d6813ce00 2021-11-15T19:33:24.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68157490 con 0x7f6d680b5fd0 2021-11-15T19:33:24.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:24.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68066a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36360/0 (socket says 172.21.2.137:36360) 2021-11-15T19:33:24.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 -- 172.21.2.137:0/3669593097 learned_addr learned my addr 172.21.2.137:0/3669593097 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:24.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 -- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b5fd0 msgr2=0x7f6d68064d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:24.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b5fd0 0x7f6d68064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:24.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 -- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d680b6830 msgr2=0x7f6d68065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:24.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d680b6830 0x7f6d68065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:24.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 -- 172.21.2.137:0/3669593097 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5000b1e0 con 0x7f6d6813ce00 2021-11-15T19:33:24.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d66d9d700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68066a40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f6d680aeac0 tx=0x7f6d600091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:24.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d60001520 con 0x7f6d6813ce00 2021-11-15T19:33:24.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60001680 con 0x7f6d6813ce00 2021-11-15T19:33:24.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d68157730 con 0x7f6d6813ce00 2021-11-15T19:33:24.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d600019e0 con 0x7f6d6813ce00 2021-11-15T19:33:24.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d68063780 con 0x7f6d6813ce00 2021-11-15T19:33:24.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d680ac9d0 con 0x7f6d6813ce00 2021-11-15T19:33:24.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d60018030 con 0x7f6d6813ce00 2021-11-15T19:33:24.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d5f7fe700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d4c0536a0 0x7f6d4c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:24.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.365+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5760+0+0 (secure 0 0 0) 0x7f6d6006b1e0 con 0x7f6d6813ce00 2021-11-15T19:33:24.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.369+0000 7f6d6659c700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d4c0536a0 0x7f6d4c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:24.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.369+0000 7f6d6659c700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d4c0536a0 0x7f6d4c055b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f6d680b91b0 tx=0x7f6d58007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:24.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.369+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d680ac9d0 con 0x7f6d6813ce00 2021-11-15T19:33:24.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:24.453+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d680ac9d0 con 0x7f6d6813ce00 2021-11-15T19:33:25.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.317+0000 7f6d5f7fe700 1 -- 172.21.2.137:0/3669593097 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6d680ac9d0 con 0x7f6d6813ce00 2021-11-15T19:33:25.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d4c0536a0 msgr2=0x7f6d4c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d4c0536a0 0x7f6d4c055b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f6d680b91b0 tx=0x7f6d58007790).stop 2021-11-15T19:33:25.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 msgr2=0x7f6d68066a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68066a40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f6d680aeac0 tx=0x7f6d600091a0).stop 2021-11-15T19:33:25.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 shutdown_connections 2021-11-15T19:33:25.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d4c0536a0 0x7f6d4c055b60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:25.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d6813ce00 0x7f6d68066a40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:25.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d680b6830 0x7f6d68065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 --2- 172.21.2.137:0/3669593097 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d680b5fd0 0x7f6d68064d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 >> 172.21.2.137:0/3669593097 conn(0x7f6d680624b0 msgr2=0x7f6d681435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:25.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 shutdown_connections 2021-11-15T19:33:25.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.321+0000 7f6d6cb8a700 1 -- 172.21.2.137:0/3669593097 wait complete. 2021-11-15T19:33:25.327 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:33:25.331 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:33:25.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 Processor -- start 2021-11-15T19:33:25.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- start start 2021-11-15T19:33:25.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0b0550 0x7fc1ec14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec05cb50 con 0x7fc1ec14aaa0 2021-11-15T19:33:25.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0ad030 con 0x7fc1ec05c770 2021-11-15T19:33:25.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b1650 con 0x7fc1ec0b0550 2021-11-15T19:33:25.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f088b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc1ec05c770 0x7fc1ec0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55146/0 (socket says 172.21.2.137:55146) 2021-11-15T19:33:25.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f088b700 1 -- 172.21.2.137:0/881667233 learned_addr learned my addr 172.21.2.137:0/881667233 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:25.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562020718 0 0) 0x7fc1ec0ad030 con 0x7fc1ec05c770 2021-11-15T19:33:25.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1cc003260 con 0x7fc1ec05c770 2021-11-15T19:33:25.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346962527 0 0) 0x7fc1cc003260 con 0x7fc1ec05c770 2021-11-15T19:33:25.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0b0550 msgr2=0x7fc1ec14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:25.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0b0550 0x7fc1ec14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 >> v1:172.21.2.111:6789/0 conn(0x7fc1ec14aaa0 legacy=0x7fc1ec140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:25.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0ad2d0 con 0x7fc1ec05c770 2021-11-15T19:33:25.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fc1d4001660 con 0x7fc1ec05c770 2021-11-15T19:33:25.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 >> v1:172.21.2.137:6789/0 conn(0x7fc1ec05c770 legacy=0x7fc1ec0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1cc003750 0x7fc1cc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1cc004500 0x7fc1cc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1cc004ec0 0x7fc1cc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b1650 con 0x7fc1cc004ec0 2021-11-15T19:33:25.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc00bd50 con 0x7fc1cc004500 2021-11-15T19:33:25.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc00bf10 con 0x7fc1cc003750 2021-11-15T19:33:25.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1cc004500 0x7fc1cc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f108c700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1cc004ec0 0x7fc1cc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 -- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1cc003750 msgr2=0x7fc1cc003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1cc003750 0x7fc1cc003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 -- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1cc004ec0 msgr2=0x7fc1cc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1cc004ec0 0x7fc1cc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:25.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 -- 172.21.2.137:0/881667233 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0ad2d0 con 0x7fc1cc004500 2021-11-15T19:33:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f108c700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1cc004ec0 0x7fc1cc00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1ebfff700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1cc004500 0x7fc1cc004980 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fc1dc002f70 tx=0x7fc1dc006bf0).ready entity=mon.1 client_cookie=e313786a1a42c7b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc012450 con 0x7fc1cc004500 2021-11-15T19:33:25.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0125b0 con 0x7fc1cc004500 2021-11-15T19:33:25.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1eb7fe700 1 -- 172.21.2.137:0/881667233 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc012910 con 0x7fc1cc004500 2021-11-15T19:33:25.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- 172.21.2.137:0/881667233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1cc004500 msgr2=0x7fc1cc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/881667233 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1cc004500 0x7fc1cc004980 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fc1dc002f70 tx=0x7fc1dc006bf0).stop 2021-11-15T19:33:25.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f108c700 1 -- 172.21.2.137:0/881667233 reap_dead start 2021-11-15T19:33:25.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- 172.21.2.137:0/881667233 shutdown_connections 2021-11-15T19:33:25.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- 172.21.2.137:0/881667233 >> 172.21.2.137:0/881667233 conn(0x7fc1ec0631e0 msgr2=0x7fc1ec05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:25.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- 172.21.2.137:0/881667233 shutdown_connections 2021-11-15T19:33:25.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.381+0000 7fc1f2aef700 1 -- 172.21.2.137:0/881667233 wait complete. 2021-11-15T19:33:25.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 Processor -- start 2021-11-15T19:33:25.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- start start 2021-11-15T19:33:25.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 0x7fc1ec142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec066910 0x7fc1ec15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec156630 0x7fc1ec156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec142380 con 0x7fc1ec156630 2021-11-15T19:33:25.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec15a810 con 0x7fc1ec159f40 2021-11-15T19:33:25.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec15ab50 con 0x7fc1ec066910 2021-11-15T19:33:25.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 0x7fc1ec142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 0x7fc1ec142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36378/0 (socket says 172.21.2.137:36378) 2021-11-15T19:33:25.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 -- 172.21.2.137:0/174577371 learned_addr learned my addr 172.21.2.137:0/174577371 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:25.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 -- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec066910 msgr2=0x7fc1ec15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec066910 0x7fc1ec15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 -- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec156630 msgr2=0x7fc1ec156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec156630 0x7fc1ec156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 -- 172.21.2.137:0/174577371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec066e90 con 0x7fc1ec159f40 2021-11-15T19:33:25.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f088b700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 0x7fc1ec142a50 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fc1d4001020 tx=0x7fc1d4001be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:25.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d4007170 con 0x7fc1ec159f40 2021-11-15T19:33:25.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40072d0 con 0x7fc1ec159f40 2021-11-15T19:33:25.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1425b0 con 0x7fc1ec159f40 2021-11-15T19:33:25.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d40049e0 con 0x7fc1ec159f40 2021-11-15T19:33:25.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec1571f0 con 0x7fc1ec159f40 2021-11-15T19:33:25.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec142740 con 0x7fc1ec159f40 2021-11-15T19:33:25.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1d4010070 con 0x7fc1ec159f40 2021-11-15T19:33:25.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1e9ffb700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d0053640 0x7fc1d0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fc1d406b6c0 con 0x7fc1ec159f40 2021-11-15T19:33:25.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.385+0000 7fc1ebfff700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d0053640 0x7fc1d0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.389+0000 7fc1ebfff700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d0053640 0x7fc1d0055b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc1dc002f70 tx=0x7fc1dc014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:25.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.389+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1d40429d0 con 0x7fc1ec159f40 2021-11-15T19:33:25.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.465+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1ec0ae7f0 con 0x7fc1ec159f40 2021-11-15T19:33:25.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1e9ffb700 1 -- 172.21.2.137:0/174577371 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1d4045ff0 con 0x7fc1ec159f40 2021-11-15T19:33:25.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d0053640 msgr2=0x7fc1d0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d0053640 0x7fc1d0055b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc1dc002f70 tx=0x7fc1dc014000).stop 2021-11-15T19:33:25.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 msgr2=0x7fc1ec142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 0x7fc1ec142a50 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fc1d4001020 tx=0x7fc1d4001be0).stop 2021-11-15T19:33:25.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 shutdown_connections 2021-11-15T19:33:25.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d0053640 0x7fc1d0055b00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:25.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec156630 0x7fc1ec156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec066910 0x7fc1ec15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 --2- 172.21.2.137:0/174577371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec159f40 0x7fc1ec142a50 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:25.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 >> 172.21.2.137:0/174577371 conn(0x7fc1ec0631e0 msgr2=0x7fc1ec0b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:25.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 shutdown_connections 2021-11-15T19:33:25.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.481+0000 7fc1f2aef700 1 -- 172.21.2.137:0/174577371 wait complete. 2021-11-15T19:33:25.495 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-11-15T19:33:25.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 Processor -- start 2021-11-15T19:33:25.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- start start 2021-11-15T19:33:25.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff8ac0b1340 0x7ff8ac147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff8ac143f00 0x7ff8ac144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac148190 con 0x7ff8ac0a9f50 2021-11-15T19:33:25.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b1720 con 0x7ff8ac0b1340 2021-11-15T19:33:25.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac147e70 con 0x7ff8ac143f00 2021-11-15T19:33:25.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b22ae700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff8ac0a9f50 0x7ff8ac0aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55168/0 (socket says 172.21.2.137:55168) 2021-11-15T19:33:25.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b22ae700 1 -- 172.21.2.137:0/1399350011 learned_addr learned my addr 172.21.2.137:0/1399350011 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:25.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b12ac700 1 --2- 172.21.2.137:0/1399350011 >> v2:172.21.2.137:3300/0 conn(0x7ff8ac143f00 0x7ff8ac144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b12ac700 1 -- 172.21.2.137:0/1399350011 >> v2:172.21.2.111:3300/0 conn(0x7ff8ac0b1340 msgr2=0x7ff8ac147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:25.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b12ac700 1 --2- 172.21.2.137:0/1399350011 >> v2:172.21.2.111:3300/0 conn(0x7ff8ac0b1340 0x7ff8ac147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b0aab700 1 -- 172.21.2.137:0/1399350011 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256831091 0 0) 0x7ff8a4001490 con 0x7ff8ac0a9f50 2021-11-15T19:33:25.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b12ac700 1 -- 172.21.2.137:0/1399350011 >> v1:172.21.2.137:6789/0 conn(0x7ff8ac0a9f50 legacy=0x7ff8ac0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b12ac700 1 -- 172.21.2.137:0/1399350011 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0af800 con 0x7ff8ac143f00 2021-11-15T19:33:25.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b12ac700 1 --2- 172.21.2.137:0/1399350011 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac144390 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7ff8a0002f70 tx=0x7ff8a0006df0).ready entity=mon.1 client_cookie=5d027ef829b34356 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:25.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b0aab700 1 -- 172.21.2.137:0/1399350011 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a000d5c0 con 0x7ff8ac143f00 2021-11-15T19:33:25.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b0aab700 1 -- 172.21.2.137:0/1399350011 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0000e90 con 0x7ff8ac143f00 2021-11-15T19:33:25.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b0aab700 1 -- 172.21.2.137:0/1399350011 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a000d910 con 0x7ff8ac143f00 2021-11-15T19:33:25.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- 172.21.2.137:0/1399350011 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 msgr2=0x7ff8ac144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/1399350011 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac144390 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7ff8a0002f70 tx=0x7ff8a0006df0).stop 2021-11-15T19:33:25.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- 172.21.2.137:0/1399350011 shutdown_connections 2021-11-15T19:33:25.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/1399350011 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac144390 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:25.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/1399350011 >> v2:172.21.2.111:3300/0 conn(0x7ff8ac0b1340 0x7ff8ac147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.537+0000 7ff8b3d11700 1 -- 172.21.2.137:0/1399350011 >> 172.21.2.137:0/1399350011 conn(0x7ff8ac0b4e60 msgr2=0x7ff8ac0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:25.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- 172.21.2.137:0/1399350011 shutdown_connections 2021-11-15T19:33:25.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- 172.21.2.137:0/1399350011 wait complete. 2021-11-15T19:33:25.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 Processor -- start 2021-11-15T19:33:25.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- start start 2021-11-15T19:33:25.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8ac0a9f50 0x7ff8ac0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8ac0b1340 0x7ff8ac148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac148920 con 0x7ff8ac0a9f50 2021-11-15T19:33:25.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac14a000 con 0x7ff8ac143f00 2021-11-15T19:33:25.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac14a3c0 con 0x7ff8ac0b1340 2021-11-15T19:33:25.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36392/0 (socket says 172.21.2.137:36392) 2021-11-15T19:33:25.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 -- 172.21.2.137:0/2940388451 learned_addr learned my addr 172.21.2.137:0/2940388451 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:25.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 -- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8ac0b1340 msgr2=0x7ff8ac148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8ac0b1340 0x7ff8ac148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 -- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8ac0a9f50 msgr2=0x7ff8ac0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:25.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8ac0a9f50 0x7ff8ac0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:25.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 -- 172.21.2.137:0/2940388451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a000b180 con 0x7ff8ac143f00 2021-11-15T19:33:25.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b22ae700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac15a350 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7ff8a4001250 tx=0x7ff8a4001360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:25.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a4005ba0 con 0x7ff8ac143f00 2021-11-15T19:33:25.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a4005d00 con 0x7ff8ac143f00 2021-11-15T19:33:25.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac159eb0 con 0x7ff8ac143f00 2021-11-15T19:33:25.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a4004a90 con 0x7ff8ac143f00 2021-11-15T19:33:25.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac09acf0 con 0x7ff8ac143f00 2021-11-15T19:33:25.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac15a040 con 0x7ff8ac143f00 2021-11-15T19:33:25.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8a4004bf0 con 0x7ff8ac143f00 2021-11-15T19:33:25.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff89effd700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff88c0536a0 0x7ff88c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:25.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7ff8a406b190 con 0x7ff8ac143f00 2021-11-15T19:33:25.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.541+0000 7ff8b1aad700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff88c0536a0 0x7ff88c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:25.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.545+0000 7ff8b1aad700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff88c0536a0 0x7ff88c055b60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff8a8002f70 tx=0x7ff8a80069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:25.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.545+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8a40425a0 con 0x7ff8ac143f00 2021-11-15T19:33:25.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:25.653+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7ff8ac148190 con 0x7ff8ac143f00 2021-11-15T19:33:26.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff89effd700 1 -- 172.21.2.137:0/2940388451 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v270) v1 ==== 139+0+0 (secure 0 0 0) 0x7ff8ac148190 con 0x7ff8ac143f00 2021-11-15T19:33:26.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff88c0536a0 msgr2=0x7ff88c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:26.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff88c0536a0 0x7ff88c055b60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff8a8002f70 tx=0x7ff8a80069e0).stop 2021-11-15T19:33:26.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 msgr2=0x7ff8ac15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:26.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac15a350 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7ff8a4001250 tx=0x7ff8a4001360).stop 2021-11-15T19:33:26.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 shutdown_connections 2021-11-15T19:33:26.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff88c0536a0 0x7ff88c055b60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8ac143f00 0x7ff8ac15a350 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff8ac0b1340 0x7ff8ac148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:26.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 --2- 172.21.2.137:0/2940388451 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8ac0a9f50 0x7ff8ac0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:26.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 >> 172.21.2.137:0/2940388451 conn(0x7ff8ac0b4e60 msgr2=0x7ff8ac13e580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:26.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 shutdown_connections 2021-11-15T19:33:26.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.325+0000 7ff8b3d11700 1 -- 172.21.2.137:0/2940388451 wait complete. 2021-11-15T19:33:26.341 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:33:26.342 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:33:26.343 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-11-15T19:33:26.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 Processor -- start 2021-11-15T19:33:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 -- start start 2021-11-15T19:33:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 0x7fa030147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa0300a9f50 0x7fa0300aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa030148190 con 0x7fa030143f00 2021-11-15T19:33:26.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300b1720 con 0x7fa0300a9f50 2021-11-15T19:33:26.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa03713a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa030147e70 con 0x7fa0300b1340 2021-11-15T19:33:26.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa030143f00 0x7fa030144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55184/0 (socket says 172.21.2.137:55184) 2021-11-15T19:33:26.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02ffff700 1 -- 172.21.2.137:0/3498678471 learned_addr learned my addr 172.21.2.137:0/3498678471 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:26.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742061286 0 0) 0x7fa020001110 con 0x7fa030143f00 2021-11-15T19:33:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa010003260 con 0x7fa030143f00 2021-11-15T19:33:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3843235011 0 0) 0x7fa010003260 con 0x7fa030143f00 2021-11-15T19:33:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 msgr2=0x7fa030147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:26.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa034ed6700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 0x7fa030147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa0356d7700 1 --2- 172.21.2.137:0/3498678471 >> v2:172.21.2.111:3300/0 conn(0x7fa0300a9f50 0x7fa0300aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 0x7fa030147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 >> v2:172.21.2.111:3300/0 conn(0x7fa0300a9f50 msgr2=0x7fa0300aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:26.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 --2- 172.21.2.137:0/3498678471 >> v2:172.21.2.111:3300/0 conn(0x7fa0300a9f50 0x7fa0300aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300af800 con 0x7fa030143f00 2021-11-15T19:33:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa0200017f0 con 0x7fa030143f00 2021-11-15T19:33:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa0356d7700 1 --2- 172.21.2.137:0/3498678471 >> v2:172.21.2.111:3300/0 conn(0x7fa0300a9f50 0x7fa0300aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:26.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 >> v1:172.21.2.137:6789/0 conn(0x7fa030143f00 legacy=0x7fa030144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa010003750 0x7fa010003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa010004500 0x7fa010004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 0x7fa010004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300b1720 con 0x7fa010004500 2021-11-15T19:33:26.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030147e70 con 0x7fa010003750 2021-11-15T19:33:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01000b990 con 0x7fa0300b1340 2021-11-15T19:33:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa034ed6700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa010003750 0x7fa010003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.385+0000 7fa02ffff700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa010004500 0x7fa010004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 -- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 msgr2=0x7fa010004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300b1340 0x7fa010004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 -- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa010004500 msgr2=0x7fa010004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa010004500 0x7fa010004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 -- 172.21.2.137:0/3498678471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010003260 con 0x7fa010003750 2021-11-15T19:33:26.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa010004500 0x7fa010004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa010003750 0x7fa010003b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7fa018007000 tx=0x7fa018008040).ready entity=mon.1 client_cookie=3631b31a9905100c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa018012470 con 0x7fa010003750 2021-11-15T19:33:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01800c030 con 0x7fa010003750 2021-11-15T19:33:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02f7fe700 1 -- 172.21.2.137:0/3498678471 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0180127c0 con 0x7fa010003750 2021-11-15T19:33:26.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/3498678471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa010003750 msgr2=0x7fa010003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 --2- 172.21.2.137:0/3498678471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa010003750 0x7fa010003b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7fa018007000 tx=0x7fa018008040).stop 2021-11-15T19:33:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa0356d7700 1 -- 172.21.2.137:0/3498678471 reap_dead start 2021-11-15T19:33:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/3498678471 shutdown_connections 2021-11-15T19:33:26.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/3498678471 >> 172.21.2.137:0/3498678471 conn(0x7fa0300b4e60 msgr2=0x7fa0300b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/3498678471 shutdown_connections 2021-11-15T19:33:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/3498678471 wait complete. 2021-11-15T19:33:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 Processor -- start 2021-11-15T19:33:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- start start 2021-11-15T19:33:26.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300ac510 0x7fa0301495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 0x7fa0301578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa03009a0f0 0x7fa03009a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03009aa70 con 0x7fa03009a0f0 2021-11-15T19:33:26.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300ac8f0 con 0x7fa030156a70 2021-11-15T19:33:26.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa030156f10 con 0x7fa0300ac510 2021-11-15T19:33:26.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 0x7fa0301578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 0x7fa0301578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36410/0 (socket says 172.21.2.137:36410) 2021-11-15T19:33:26.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 -- 172.21.2.137:0/1676600605 learned_addr learned my addr 172.21.2.137:0/1676600605 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:26.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa0356d7700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa03009a0f0 0x7fa03009a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa034ed6700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300ac510 0x7fa0301495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 -- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300ac510 msgr2=0x7fa0301495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:26.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300ac510 0x7fa0301495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 -- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa03009a0f0 msgr2=0x7fa03009a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:26.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa03009a0f0 0x7fa03009a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:26.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 -- 172.21.2.137:0/1676600605 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0301571b0 con 0x7fa030156a70 2021-11-15T19:33:26.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02ffff700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 0x7fa0301578f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fa0300ad5d0 tx=0x7fa020009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:26.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa020007170 con 0x7fa030156a70 2021-11-15T19:33:26.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0200072d0 con 0x7fa030156a70 2021-11-15T19:33:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030157450 con 0x7fa030156a70 2021-11-15T19:33:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0200049e0 con 0x7fa030156a70 2021-11-15T19:33:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa030099210 con 0x7fa030156a70 2021-11-15T19:33:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0301575e0 con 0x7fa030156a70 2021-11-15T19:33:26.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.389+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa020004b40 con 0x7fa030156a70 2021-11-15T19:33:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.393+0000 7fa02dffb700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa014053660 0x7fa014055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.393+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fa02006baa0 con 0x7fa030156a70 2021-11-15T19:33:26.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.393+0000 7fa034ed6700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa014053660 0x7fa014055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:26.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.393+0000 7fa034ed6700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa014053660 0x7fa014055b20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa018019000 tx=0x7fa018008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:26.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.393+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa020042da0 con 0x7fa030156a70 2021-11-15T19:33:26.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:26.509+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7fa030148190 con 0x7fa030156a70 2021-11-15T19:33:27.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.329+0000 7fa02dffb700 1 -- 172.21.2.137:0/1676600605 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v271) v1 ==== 129+0+0 (secure 0 0 0) 0x7fa030148190 con 0x7fa030156a70 2021-11-15T19:33:27.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa014053660 msgr2=0x7fa014055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa014053660 0x7fa014055b20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa018019000 tx=0x7fa018008040).stop 2021-11-15T19:33:27.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 msgr2=0x7fa0301578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 0x7fa0301578f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fa0300ad5d0 tx=0x7fa020009040).stop 2021-11-15T19:33:27.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 shutdown_connections 2021-11-15T19:33:27.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa014053660 0x7fa014055b20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa03009a0f0 0x7fa03009a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa030156a70 0x7fa0301578f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 --2- 172.21.2.137:0/1676600605 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0300ac510 0x7fa0301495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 >> 172.21.2.137:0/1676600605 conn(0x7fa0300b4e60 msgr2=0x7fa030146370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:27.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 shutdown_connections 2021-11-15T19:33:27.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.333+0000 7fa03713a700 1 -- 172.21.2.137:0/1676600605 wait complete. 2021-11-15T19:33:27.347 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:33:27.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 Processor -- start 2021-11-15T19:33:27.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- start start 2021-11-15T19:33:27.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8ad80b0550 0x7f8ad814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8ad814aaa0 0x7f8ad8140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad805cb50 con 0x7f8ad805c770 2021-11-15T19:33:27.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80b1650 con 0x7f8ad80b0550 2021-11-15T19:33:27.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80ad030 con 0x7f8ad814aaa0 2021-11-15T19:33:27.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8ad814aaa0 0x7f8ad8140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8ad814aaa0 0x7f8ad8140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36420/0 (socket says 172.21.2.137:36420) 2021-11-15T19:33:27.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 -- 172.21.2.137:0/1712597889 learned_addr learned my addr 172.21.2.137:0/1712597889 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:27.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 -- 172.21.2.137:0/1712597889 >> v2:172.21.2.111:3300/0 conn(0x7f8ad80b0550 msgr2=0x7f8ad814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:27.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 --2- 172.21.2.137:0/1712597889 >> v2:172.21.2.111:3300/0 conn(0x7f8ad80b0550 0x7f8ad814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:27.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 -- 172.21.2.137:0/1712597889 >> v1:172.21.2.111:6789/0 conn(0x7f8ad805c770 legacy=0x7f8ad80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:27.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 -- 172.21.2.137:0/1712597889 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80ad2d0 con 0x7f8ad814aaa0 2021-11-15T19:33:27.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8adcf34700 1 --2- 172.21.2.137:0/1712597889 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad8140aa0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f8ad80aee10 tx=0x7f8ad0009290).ready entity=mon.1 client_cookie=7cc7a9263d4af80 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:27.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ad6ffd700 1 -- 172.21.2.137:0/1712597889 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad000b830 con 0x7f8ad814aaa0 2021-11-15T19:33:27.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ad6ffd700 1 -- 172.21.2.137:0/1712597889 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000b990 con 0x7f8ad814aaa0 2021-11-15T19:33:27.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ad6ffd700 1 -- 172.21.2.137:0/1712597889 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad000bb40 con 0x7f8ad814aaa0 2021-11-15T19:33:27.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- 172.21.2.137:0/1712597889 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 msgr2=0x7f8ad8140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 --2- 172.21.2.137:0/1712597889 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad8140aa0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f8ad80aee10 tx=0x7f8ad0009290).stop 2021-11-15T19:33:27.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- 172.21.2.137:0/1712597889 shutdown_connections 2021-11-15T19:33:27.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 --2- 172.21.2.137:0/1712597889 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad8140aa0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 --2- 172.21.2.137:0/1712597889 >> v2:172.21.2.111:3300/0 conn(0x7f8ad80b0550 0x7f8ad814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:27.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- 172.21.2.137:0/1712597889 >> 172.21.2.137:0/1712597889 conn(0x7f8ad80631e0 msgr2=0x7f8ad805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:27.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- 172.21.2.137:0/1712597889 shutdown_connections 2021-11-15T19:33:27.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- 172.21.2.137:0/1712597889 wait complete. 2021-11-15T19:33:27.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 Processor -- start 2021-11-15T19:33:27.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 -- start start 2021-11-15T19:33:27.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.393+0000 7f8ade997700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad805c770 0x7f8ad8066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad80b0550 0x7f8ad813f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81431b0 con 0x7f8ad805c770 2021-11-15T19:33:27.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8146b30 con 0x7f8ad814aaa0 2021-11-15T19:33:27.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81433e0 con 0x7f8ad80b0550 2021-11-15T19:33:27.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad813f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36428/0 (socket says 172.21.2.137:36428) 2021-11-15T19:33:27.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 -- 172.21.2.137:0/278967239 learned_addr learned my addr 172.21.2.137:0/278967239 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:27.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad7fff700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad805c770 0x7f8ad8066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad77fe700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad80b0550 0x7f8ad813f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 -- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad80b0550 msgr2=0x7f8ad813f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad80b0550 0x7f8ad813f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 -- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad805c770 msgr2=0x7f8ad8066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad805c770 0x7f8ad8066a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 -- 172.21.2.137:0/278967239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009530 con 0x7f8ad814aaa0 2021-11-15T19:33:27.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8adcf34700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad813f5e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f8ad8146690 tx=0x7f8ad0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:27.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad000b830 con 0x7f8ad814aaa0 2021-11-15T19:33:27.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0020620 con 0x7f8ad814aaa0 2021-11-15T19:33:27.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad8146890 con 0x7f8ad814aaa0 2021-11-15T19:33:27.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad0020980 con 0x7f8ad814aaa0 2021-11-15T19:33:27.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad81477e0 con 0x7f8ad814aaa0 2021-11-15T19:33:27.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad8142f50 con 0x7f8ad814aaa0 2021-11-15T19:33:27.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ad0026020 con 0x7f8ad814aaa0 2021-11-15T19:33:27.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad57fa700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8abc0536a0 0x7f8abc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f8ad006c600 con 0x7f8ad814aaa0 2021-11-15T19:33:27.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad7fff700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8abc0536a0 0x7f8abc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.397+0000 7f8ad7fff700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8abc0536a0 0x7f8abc055b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f8ac800a000 tx=0x7f8ac8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:27.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.401+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ad0043a10 con 0x7f8ad814aaa0 2021-11-15T19:33:27.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.481+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8ad80ae7f0 con 0x7f8ad814aaa0 2021-11-15T19:33:27.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ad57fa700 1 -- 172.21.2.137:0/278967239 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ad0015020 con 0x7f8ad814aaa0 2021-11-15T19:33:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8abc0536a0 msgr2=0x7f8abc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8abc0536a0 0x7f8abc055b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f8ac800a000 tx=0x7f8ac8008040).stop 2021-11-15T19:33:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 msgr2=0x7f8ad813f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad813f5e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f8ad8146690 tx=0x7f8ad0016000).stop 2021-11-15T19:33:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 shutdown_connections 2021-11-15T19:33:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8abc0536a0 0x7f8abc055b60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ad814aaa0 0x7f8ad813f5e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ad80b0550 0x7f8ad813f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 --2- 172.21.2.137:0/278967239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ad805c770 0x7f8ad8066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 >> 172.21.2.137:0/278967239 conn(0x7f8ad80631e0 msgr2=0x7f8ad8140300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 shutdown_connections 2021-11-15T19:33:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.497+0000 7f8ade997700 1 -- 172.21.2.137:0/278967239 wait complete. 2021-11-15T19:33:27.511 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:33:27.511 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:27.520 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:27.533 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:27.547 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:27.561 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:27.570 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:33:27.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:27.571 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:27.571 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:27.614 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:33:27.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:27.615 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:27.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:27.616 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:27.617 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:27.625 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:33:27.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:27.626 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:33:27.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:27.627 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:27.628 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:33:27.637 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:33:27.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:27.640 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:33:27.641 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:33:27.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 Processor -- start 2021-11-15T19:33:27.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- start start 2021-11-15T19:33:27.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fab880b1340 0x7fab88147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab880aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab88148190 con 0x7fab88143f00 2021-11-15T19:33:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880b1720 con 0x7fab880b1340 2021-11-15T19:33:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab88147e70 con 0x7fab880a9f50 2021-11-15T19:33:27.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fab880b1340 0x7fab88147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab87fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab880aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fab880b1340 0x7fab88147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:43660/0 (socket says 172.21.2.137:43660) 2021-11-15T19:33:27.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 -- 172.21.2.137:0/2065854276 learned_addr learned my addr 172.21.2.137:0/2065854276 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 -- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 msgr2=0x7fab880aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:27.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 --2- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab880aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 -- 172.21.2.137:0/2065854276 >> v1:172.21.2.111:6789/0 conn(0x7fab88143f00 legacy=0x7fab88144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 -- 172.21.2.137:0/2065854276 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab880af800 con 0x7fab880b1340 2021-11-15T19:33:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab877fe700 1 --2- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab880b1340 0x7fab88147980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fab78002f70 tx=0x7fab78006eb0).ready entity=mon.0 client_cookie=cf5fdb8a7f10babd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:27.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab867fc700 1 -- 172.21.2.137:0/2065854276 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7800d570 con 0x7fab880b1340 2021-11-15T19:33:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab867fc700 1 -- 172.21.2.137:0/2065854276 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78000e90 con 0x7fab880b1340 2021-11-15T19:33:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab867fc700 1 -- 172.21.2.137:0/2065854276 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7800d900 con 0x7fab880b1340 2021-11-15T19:33:27.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab880b1340 msgr2=0x7fab88147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 --2- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab880b1340 0x7fab88147980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fab78002f70 tx=0x7fab78006eb0).stop 2021-11-15T19:33:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- 172.21.2.137:0/2065854276 shutdown_connections 2021-11-15T19:33:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 --2- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab880aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 --2- 172.21.2.137:0/2065854276 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab880b1340 0x7fab88147980 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- 172.21.2.137:0/2065854276 >> 172.21.2.137:0/2065854276 conn(0x7fab880b4e60 msgr2=0x7fab880b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:27.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- 172.21.2.137:0/2065854276 shutdown_connections 2021-11-15T19:33:27.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 -- 172.21.2.137:0/2065854276 wait complete. 2021-11-15T19:33:27.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.693+0000 7fab8dc49700 1 Processor -- start 2021-11-15T19:33:27.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- start start 2021-11-15T19:33:27.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab8814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 0x7fab88146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab88143f00 0x7fab88098820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8814a350 con 0x7fab88143f00 2021-11-15T19:33:27.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab88098220 con 0x7fab880b1340 2021-11-15T19:33:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8814a000 con 0x7fab880a9f50 2021-11-15T19:33:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 0x7fab88146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 0x7fab88146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36440/0 (socket says 172.21.2.137:36440) 2021-11-15T19:33:27.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 -- 172.21.2.137:0/673786857 learned_addr learned my addr 172.21.2.137:0/673786857 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 -- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 msgr2=0x7fab8814afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab8814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 -- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab88143f00 msgr2=0x7fab88098820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab87fff700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab88143f00 0x7fab88098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab88143f00 0x7fab88098820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 -- 172.21.2.137:0/673786857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7800b1e0 con 0x7fab880b1340 2021-11-15T19:33:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab86ffd700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 0x7fab88146140 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fab88062250 tx=0x7fab70007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:27.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7000ce00 con 0x7fab880b1340 2021-11-15T19:33:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70007240 con 0x7fab880b1340 2021-11-15T19:33:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8814a5f0 con 0x7fab880b1340 2021-11-15T19:33:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8809aba0 con 0x7fab880b1340 2021-11-15T19:33:27.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab70006700 con 0x7fab880b1340 2021-11-15T19:33:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8805faf0 con 0x7fab880b1340 2021-11-15T19:33:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab70006860 con 0x7fab880b1340 2021-11-15T19:33:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab6c0535d0 0x7fab6c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fab7006b080 con 0x7fab880b1340 2021-11-15T19:33:27.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab877fe700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab6c0535d0 0x7fab6c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:27.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab877fe700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab6c0535d0 0x7fab6c055a90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fab78002f70 tx=0x7fab78015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:27.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.701+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab70042380 con 0x7fab880b1340 2021-11-15T19:33:27.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fab88148190 con 0x7fab880b1340 2021-11-15T19:33:27.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab84ff9700 1 -- 172.21.2.137:0/673786857 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v77) v1 ==== 81+0+28900 (secure 0 0 0) 0x7fab88148190 con 0x7fab880b1340 2021-11-15T19:33:27.792 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:27.793 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:33:27.793 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 77, 2021-11-15T19:33:27.793 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:33:27.794 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:33:27.794 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:33:25.306414+0000", 2021-11-15T19:33:27.794 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:27.794 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:27.795 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:33:27.795 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:33:27.795 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:33:27.795 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:33:27.795 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:33:27.796 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:33:27.796 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:33:27.796 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:27.796 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:33:27.796 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:33:27.797 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:33:27.797 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:33:27.797 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:33:27.797 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 14, 2021-11-15T19:33:27.798 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:33:27.798 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:33:27.798 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:33:27.798 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:33:27.799 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:33:27.799 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.799 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:33:27.799 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:33:27.800 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:33:27.800 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:27.800 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:27.800 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:27.801 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:27.801 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:27.801 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:27.801 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:27.802 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:27.802 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:33:27.802 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:33:27.802 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:33:27.803 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:33:27.803 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:33:27.803 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:27.804 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:27.804 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:27.804 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:27.804 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:27.804 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:27.805 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:27.805 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:33:27.805 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:27.806 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:27.806 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:27.806 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:27.806 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:27.806 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:27.807 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:27.807 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:27.807 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:27.807 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:27.808 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:27.808 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:27.808 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:27.808 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:27.809 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:27.809 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:27.809 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:27.809 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:27.810 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:27.810 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:27.810 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:27.810 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:27.810 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:27.811 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:27.811 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:27.811 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:27.811 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.812 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:27.812 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:27.812 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:27.812 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:27.813 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:27.813 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:27.813 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:27.813 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:27.814 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:27.814 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:27.814 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:27.814 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:33:27.814 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:33:27.815 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.815 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:27.815 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:33:27.815 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.815 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.816 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:33:27.816 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:33:27.816 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:33:27.817 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:27.817 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:27.817 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:27.817 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:27.817 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:27.818 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:27.818 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:27.818 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:27.818 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:27.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:27.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:27.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:27.819 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:27.819 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:27.820 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:27.820 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:27.820 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:27.820 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:27.820 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:27.821 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:27.821 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.821 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:33:27.821 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:27.822 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:27.822 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:27.822 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:27.822 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:27.822 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:27.823 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:27.823 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:27.823 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:27.823 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:27.824 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:27.824 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:27.824 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:27.824 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:27.824 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:27.825 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:27.825 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:27.825 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:27.825 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:27.825 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:27.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:27.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:27.826 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:27.826 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:27.827 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:27.827 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:27.827 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.827 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:27.827 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:27.828 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:27.828 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:27.828 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:27.828 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:27.829 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:27.829 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:27.829 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:27.829 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:27.829 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:27.830 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:33:27.830 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:27.830 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:33:27.830 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.831 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.831 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:27.831 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:33:27.831 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.831 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:27.832 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:33:27.832 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.832 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.832 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.832 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.833 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.833 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.833 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.833 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:27.833 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.834 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.834 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.834 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.834 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.835 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.835 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:33:27.835 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.835 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.836 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.836 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.836 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:33:27.836 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.836 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.837 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.837 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.837 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.837 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.837 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.838 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.838 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:33:27.838 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.838 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.839 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.839 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.839 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:33:27.839 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.839 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.840 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.840 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.840 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.840 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.841 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.841 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.841 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:33:27.841 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.841 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.842 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.842 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.842 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:33:27.842 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.843 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.843 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.843 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.843 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.843 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.844 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.844 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.844 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:33:27.844 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.845 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.845 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.845 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.845 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:33:27.845 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:27.846 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.846 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.846 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.846 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:33:27.846 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:33:27.847 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:33:27.847 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:33:27.847 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.847 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.848 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.848 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.848 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.848 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.848 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:27.849 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:33:27.849 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.849 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.849 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.849 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.850 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.850 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.850 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.850 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 60, 2021-11-15T19:33:27.851 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.851 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.851 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.851 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.851 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.852 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.852 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:33:27.852 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.852 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.853 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.853 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.853 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:33:27.853 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.853 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.854 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.854 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.854 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.854 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.855 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.855 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.855 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:33:27.855 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.855 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.856 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.856 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.856 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:33:27.856 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.857 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.857 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.857 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.857 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.857 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.858 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.858 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.858 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:33:27.858 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.859 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.859 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.859 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:33:27.859 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.860 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.860 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.860 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.860 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.860 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.861 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.861 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.861 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:33:27.861 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.862 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.862 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.862 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.862 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:33:27.862 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:27.863 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.863 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.863 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.863 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:33:27.864 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:33:27.864 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:33:27.864 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:33:27.864 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.864 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.865 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.865 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.865 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.865 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.866 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:27.866 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:33:27.866 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.866 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.866 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.867 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.867 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.867 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.867 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.868 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:27.868 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.868 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.868 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.868 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.869 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.869 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.869 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:33:27.869 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.870 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.870 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.870 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.870 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:33:27.870 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.871 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.871 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.871 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.871 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.872 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.872 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.872 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.872 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:33:27.872 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.873 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.873 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.873 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.873 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:33:27.874 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.874 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.874 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.874 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.875 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.875 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.875 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.875 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.875 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:33:27.876 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.876 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.876 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.876 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.877 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:33:27.877 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.877 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.877 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.878 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.878 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.878 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.878 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.879 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.879 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:33:27.879 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.879 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.879 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.880 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.880 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:33:27.880 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:27.880 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.880 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.881 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.881 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:33:27.881 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:33:27.881 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:33:27.882 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:33:27.882 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.882 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.882 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.882 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.883 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.883 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.883 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:27.883 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:33:27.884 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.884 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.884 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.884 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.884 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.885 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.885 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.885 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:27.885 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.886 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.886 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.886 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.886 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.886 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.887 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:33:27.887 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.887 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.887 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.888 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.888 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:33:27.888 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.888 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.889 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.889 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.889 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.889 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.890 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.890 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.890 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:33:27.890 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.890 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.891 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.891 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.891 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:33:27.891 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.892 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.892 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.892 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.892 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.893 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.893 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.893 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.893 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:33:27.893 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.894 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.894 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.894 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.894 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:33:27.895 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.895 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.895 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.895 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.896 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.896 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.896 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.896 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.897 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:33:27.897 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.897 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.897 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.897 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.898 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:33:27.898 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:27.898 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.898 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.899 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.899 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:33:27.899 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:33:27.899 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:33:27.899 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:33:27.900 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.900 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.900 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.900 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.901 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.901 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.901 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:27.901 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:33:27.901 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.902 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.902 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.902 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.902 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.903 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.903 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.903 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 70, 2021-11-15T19:33:27.903 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.903 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.904 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.904 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.904 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.904 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.905 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:33:27.905 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.905 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.905 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.905 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.906 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:33:27.906 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.906 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.906 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.906 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.907 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.907 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.907 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.907 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.908 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:33:27.908 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.908 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.908 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.909 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.909 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:33:27.909 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.909 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.909 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.910 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.910 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.910 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.910 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.911 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.911 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:33:27.911 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.911 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.911 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.912 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.912 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:33:27.912 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.912 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.913 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.913 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.913 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.913 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.913 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.914 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.914 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:33:27.914 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.914 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.915 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.915 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.915 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:33:27.915 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:27.916 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.916 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.916 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.916 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:33:27.916 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:33:27.917 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:33:27.917 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:33:27.917 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.917 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.917 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.918 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.918 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.918 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.918 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:27.919 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:33:27.919 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.919 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.919 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.920 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.920 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.920 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.920 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.920 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:27.921 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.921 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.921 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.921 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.921 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.922 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.922 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:33:27.922 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.922 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.923 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.923 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.923 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:33:27.923 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.924 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.924 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.924 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.924 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.924 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.925 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.925 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.925 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:33:27.925 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.925 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.926 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.926 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.926 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:33:27.926 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.926 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.927 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.927 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.927 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.927 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.928 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.928 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.928 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:33:27.928 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.929 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.929 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.929 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.929 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:33:27.929 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.930 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.930 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.930 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.930 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.931 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.931 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.931 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.931 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:33:27.931 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.932 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.932 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.932 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.932 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:33:27.932 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:27.933 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.933 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.933 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.933 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:33:27.934 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:33:27.934 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:33:27.934 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:33:27.934 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.934 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.935 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.935 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.935 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.935 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.935 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:27.936 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:33:27.936 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.936 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.936 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.937 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.937 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.937 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.937 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.937 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 71, 2021-11-15T19:33:27.938 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.938 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.938 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.938 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.939 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.939 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.939 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:33:27.939 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.939 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.940 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.940 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.940 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:33:27.940 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.941 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.941 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.941 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.941 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.942 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.942 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.942 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.942 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:33:27.942 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.943 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.943 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.943 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.943 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:33:27.944 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.944 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.944 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.944 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.945 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.945 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.945 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.945 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.945 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:33:27.946 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.946 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.946 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.946 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.947 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:33:27.947 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.947 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.947 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.947 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.948 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.948 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.948 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.948 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.949 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:33:27.949 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.949 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.949 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.949 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.950 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:33:27.950 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:27.950 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.950 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.951 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.951 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:33:27.951 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:33:27.951 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:33:27.951 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:33:27.952 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.952 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.952 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.952 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.953 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.953 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.953 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:27.953 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:33:27.953 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:27.954 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:27.954 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:27.954 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:27.954 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:27.955 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:27.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:27.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 70, 2021-11-15T19:33:27.955 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:27.955 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:27.956 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:27.956 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.956 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.956 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.957 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:33:27.957 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.957 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.957 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.957 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.958 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:33:27.958 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.958 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.958 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.959 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.959 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:27.959 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.959 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.959 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.960 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:33:27.960 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.960 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.960 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.961 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.961 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:33:27.961 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.961 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.962 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.962 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.962 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:27.962 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.963 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.963 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.963 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:33:27.963 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.963 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.964 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.964 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.964 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:33:27.964 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.965 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.965 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.965 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.965 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:27.965 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:27.966 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.966 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:27.966 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:33:27.966 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.967 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.967 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.967 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:27.967 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:33:27.967 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:27.968 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.968 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.968 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.968 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:33:27.969 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:33:27.969 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:33:27.969 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:33:27.969 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:27.969 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:27.970 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:27.970 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:27.970 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.970 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:27.971 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:33:27.971 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.971 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:27.971 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.971 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.972 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.972 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.972 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:33:27.973 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.973 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.973 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.973 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:27.973 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.974 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.974 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.974 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.974 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.975 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:33:27.975 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.975 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.975 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.975 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:27.976 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.976 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.976 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.976 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.976 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.977 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:33:27.977 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.977 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.977 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.978 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:27.978 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.978 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.978 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.978 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.979 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.979 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:33:27.979 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.979 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.980 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.980 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:27.980 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.980 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.980 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.981 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.981 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.981 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:33:27.981 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.981 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.982 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.982 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:27.982 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.982 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.983 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.983 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.983 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.983 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:33:27.983 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.984 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.984 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.984 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:27.984 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.985 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.985 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.985 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.985 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.985 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:33:27.986 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.986 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.986 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:27.986 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:27.987 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:27.987 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:27.987 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:27.987 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:27.988 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:27.988 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:33:27.988 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:27.988 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.988 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:27.989 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:33:27.989 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:33:27.989 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:33:27.989 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:33:27.990 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:33:27.990 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/1730106945": "2021-11-16T19:33:21.693352+0000", 2021-11-15T19:33:27.990 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/1730106945": "2021-11-16T19:33:21.693352+0000", 2021-11-15T19:33:27.990 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.131:0/2457368916": "2021-11-15T20:33:11.377887+0000" 2021-11-15T19:33:27.990 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.991 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:33:27.991 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:33:27.991 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:33:27.991 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:33:27.992 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:33:27.992 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:33:27.992 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:33:27.992 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:33:27.992 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:27.993 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:27.993 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:33:27.993 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:33:27.993 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:33:27.993 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:33:27.994 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:33:27.994 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:33:27.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab6c0535d0 msgr2=0x7fab6c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab6c0535d0 0x7fab6c055a90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fab78002f70 tx=0x7fab78015000).stop 2021-11-15T19:33:27.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 msgr2=0x7fab88146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:27.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 0x7fab88146140 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fab88062250 tx=0x7fab70007be0).stop 2021-11-15T19:33:27.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 shutdown_connections 2021-11-15T19:33:27.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fab6c0535d0 0x7fab6c055a90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fab88143f00 0x7fab88098820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fab880b1340 0x7fab88146140 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:27.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 --2- 172.21.2.137:0/673786857 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fab880a9f50 0x7fab8814afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:27.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 >> 172.21.2.137:0/673786857 conn(0x7fab880b4e60 msgr2=0x7fab880af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:27.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 shutdown_connections 2021-11-15T19:33:27.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:27.785+0000 7fab8dc49700 1 -- 172.21.2.137:0/673786857 wait complete. 2021-11-15T19:33:27.999 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:28.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 Processor -- start 2021-11-15T19:33:28.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- start start 2021-11-15T19:33:28.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5b1c144610 0x7f5b1c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c148190 con 0x7f5b1c0b1340 2021-11-15T19:33:28.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c0b1720 con 0x7f5b1c144610 2021-11-15T19:33:28.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c147e70 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5b1c144610 0x7f5b1c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5b1c144610 0x7f5b1c147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36446/0 (socket says 172.21.2.137:36446) 2021-11-15T19:33:28.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 -- 172.21.2.137:0/2413082403 learned_addr learned my addr 172.21.2.137:0/2413082403 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:28.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 -- 172.21.2.137:0/2413082403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c0a9f50 msgr2=0x7f5b1c0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:28.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 --2- 172.21.2.137:0/2413082403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 -- 172.21.2.137:0/2413082403 >> v1:172.21.2.111:6789/0 conn(0x7f5b1c0b1340 legacy=0x7f5b1c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:28.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 -- 172.21.2.137:0/2413082403 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0af800 con 0x7f5b1c144610 2021-11-15T19:33:28.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b21bf3700 1 --2- 172.21.2.137:0/2413082403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c144610 0x7f5b1c147980 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f5b1c062250 tx=0x7f5b18006eb0).ready entity=mon.1 client_cookie=62ca2f6404b38c7c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b213f2700 1 -- 172.21.2.137:0/2413082403 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b1800d570 con 0x7f5b1c144610 2021-11-15T19:33:28.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b213f2700 1 -- 172.21.2.137:0/2413082403 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18000e90 con 0x7f5b1c144610 2021-11-15T19:33:28.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b213f2700 1 -- 172.21.2.137:0/2413082403 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b1800d8c0 con 0x7f5b1c144610 2021-11-15T19:33:28.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2413082403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c144610 msgr2=0x7f5b1c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- 172.21.2.137:0/2413082403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c144610 0x7f5b1c147980 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f5b1c062250 tx=0x7f5b18006eb0).stop 2021-11-15T19:33:28.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2413082403 shutdown_connections 2021-11-15T19:33:28.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- 172.21.2.137:0/2413082403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- 172.21.2.137:0/2413082403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c144610 0x7f5b1c147980 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2413082403 >> 172.21.2.137:0/2413082403 conn(0x7f5b1c0b4e60 msgr2=0x7f5b1c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:28.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2413082403 shutdown_connections 2021-11-15T19:33:28.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2413082403 wait complete. 2021-11-15T19:33:28.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 Processor -- start 2021-11-15T19:33:28.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- start start 2021-11-15T19:33:28.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b1c0b1340 0x7f5b1c0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c144610 0x7f5b1c142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c14ab40 con 0x7f5b1c0b1340 2021-11-15T19:33:28.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c14a600 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c14a8a0 con 0x7f5b1c144610 2021-11-15T19:33:28.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36454/0 (socket says 172.21.2.137:36454) 2021-11-15T19:33:28.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 -- 172.21.2.137:0/2197961342 learned_addr learned my addr 172.21.2.137:0/2197961342 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:28.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 -- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c144610 msgr2=0x7f5b1c142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c144610 0x7f5b1c142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 -- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b1c0b1340 msgr2=0x7f5b1c0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b1c0b1340 0x7f5b1c0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 -- 172.21.2.137:0/2197961342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1800b1e0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b223f4700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aed50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f5b0c002ef0 tx=0x7f5b0c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0c012410 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c012570 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c0b07c0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c0ac4b0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.049+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0c0128d0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c05faf0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5b0c00f030 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b0b7fe700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5afc0536f0 0x7f5afc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f5b0c06b4e0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b21bf3700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5afc0536f0 0x7f5afc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b21bf3700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5afc0536f0 0x7f5afc055bb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f5b1c062250 tx=0x7f5b18015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.053+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5b0c0427e0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b1c0573d0 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b0b7fe700 1 -- 172.21.2.137:0/2197961342 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f5b0c045e00 con 0x7f5b1c0a9f50 2021-11-15T19:33:28.170 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:28.170 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30},{"gid":6493,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1320468150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1320468150},{"type":"v1","addr":"172.21.2.137:6833","nonce":1320468150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-11-15T19:33:28.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5afc0536f0 msgr2=0x7f5afc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5afc0536f0 0x7f5afc055bb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f5b1c062250 tx=0x7f5b18015000).stop 2021-11-15T19:33:28.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 msgr2=0x7f5b1c0aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aed50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f5b0c002ef0 tx=0x7f5b0c006d50).stop 2021-11-15T19:33:28.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 shutdown_connections 2021-11-15T19:33:28.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5afc0536f0 0x7f5afc055bb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5b1c144610 0x7f5b1c142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5b1c0b1340 0x7f5b1c0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 --2- 172.21.2.137:0/2197961342 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5b1c0a9f50 0x7f5b1c0aed50 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 >> 172.21.2.137:0/2197961342 conn(0x7f5b1c0b4e60 msgr2=0x7f5b1c144ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:28.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 shutdown_connections 2021-11-15T19:33:28.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.161+0000 7f5b24658700 1 -- 172.21.2.137:0/2197961342 wait complete. 2021-11-15T19:33:28.174 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 34 2021-11-15T19:33:28.177 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:28.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 Processor -- start 2021-11-15T19:33:28.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 -- start start 2021-11-15T19:33:28.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f55080acab0 0x7f55080b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080b1180 0x7f55080b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f55080af2f0 0x7f5508069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080aecf0 con 0x7f55080af2f0 2021-11-15T19:33:28.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550813f180 con 0x7f55080acab0 2021-11-15T19:33:28.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550f02e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080aef20 con 0x7f55080b1180 2021-11-15T19:33:28.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f55080acab0 0x7f55080b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f55080acab0 0x7f55080b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36460/0 (socket says 172.21.2.137:36460) 2021-11-15T19:33:28.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 -- 172.21.2.137:0/636860598 learned_addr learned my addr 172.21.2.137:0/636860598 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:28.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 -- 172.21.2.137:0/636860598 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080b1180 msgr2=0x7f55080b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:28.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 --2- 172.21.2.137:0/636860598 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080b1180 0x7f55080b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 -- 172.21.2.137:0/636860598 >> v2:172.21.2.111:3300/0 conn(0x7f55080af2f0 msgr2=0x7f5508069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:28.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 --2- 172.21.2.137:0/636860598 >> v2:172.21.2.111:3300/0 conn(0x7f55080af2f0 0x7f5508069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.217+0000 7f550cdca700 1 -- 172.21.2.137:0/636860598 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080ace90 con 0x7f55080acab0 2021-11-15T19:33:28.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550cdca700 1 --2- 172.21.2.137:0/636860598 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080acab0 0x7f55080b2060 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f54f0002f70 tx=0x7f54f0006eb0).ready entity=mon.1 client_cookie=8ec6e7348dd110ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f55077fe700 1 -- 172.21.2.137:0/636860598 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f000d570 con 0x7f55080acab0 2021-11-15T19:33:28.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f55077fe700 1 -- 172.21.2.137:0/636860598 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0000e90 con 0x7f55080acab0 2021-11-15T19:33:28.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f55077fe700 1 -- 172.21.2.137:0/636860598 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f000d900 con 0x7f55080acab0 2021-11-15T19:33:28.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/636860598 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080acab0 msgr2=0x7f55080b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- 172.21.2.137:0/636860598 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080acab0 0x7f55080b2060 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f54f0002f70 tx=0x7f54f0006eb0).stop 2021-11-15T19:33:28.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/636860598 shutdown_connections 2021-11-15T19:33:28.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- 172.21.2.137:0/636860598 >> v2:172.21.2.111:3300/0 conn(0x7f55080af2f0 0x7f5508069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- 172.21.2.137:0/636860598 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080b1180 0x7f55080b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- 172.21.2.137:0/636860598 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080acab0 0x7f55080b2060 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/636860598 >> 172.21.2.137:0/636860598 conn(0x7f55080630f0 msgr2=0x7f55080634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:28.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/636860598 shutdown_connections 2021-11-15T19:33:28.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/636860598 wait complete. 2021-11-15T19:33:28.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 Processor -- start 2021-11-15T19:33:28.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- start start 2021-11-15T19:33:28.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55080acab0 0x7f55080673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080af2f0 0x7f55081378f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 0x7f5508137de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5508140160 con 0x7f55080acab0 2021-11-15T19:33:28.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080667a0 con 0x7f55080b1180 2021-11-15T19:33:28.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550813ea00 con 0x7f55080af2f0 2021-11-15T19:33:28.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 0x7f5508137de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 0x7f5508137de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36470/0 (socket says 172.21.2.137:36470) 2021-11-15T19:33:28.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 -- 172.21.2.137:0/3938272178 learned_addr learned my addr 172.21.2.137:0/3938272178 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:28.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 -- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080af2f0 msgr2=0x7f55081378f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080af2f0 0x7f55081378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 -- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55080acab0 msgr2=0x7f55080673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55080acab0 0x7f55080673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 -- 172.21.2.137:0/3938272178 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f000b1e0 con 0x7f55080b1180 2021-11-15T19:33:28.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550d5cb700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 0x7f5508137de0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f55000032f0 tx=0x7f5500009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550000d580 con 0x7f55080b1180 2021-11-15T19:33:28.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000d6e0 con 0x7f55080b1180 2021-11-15T19:33:28.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55081372d0 con 0x7f55080b1180 2021-11-15T19:33:28.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550000da40 con 0x7f55080b1180 2021-11-15T19:33:28.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550813a120 con 0x7f55080b1180 2021-11-15T19:33:28.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.221+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55080573d0 con 0x7f55080b1180 2021-11-15T19:33:28.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.225+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f550000dba0 con 0x7f55080b1180 2021-11-15T19:33:28.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.225+0000 7f5505ffb700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54ec053660 0x7f54ec055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.225+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f550006bb50 con 0x7f55080b1180 2021-11-15T19:33:28.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.225+0000 7f550cdca700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54ec053660 0x7f54ec055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.225+0000 7f550cdca700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54ec053660 0x7f54ec055b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f54f0002f70 tx=0x7f54f0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.225+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5500042e50 con 0x7f55080b1180 2021-11-15T19:33:28.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.333+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f550805da90 con 0x7f55080b1180 2021-11-15T19:33:28.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.333+0000 7f5505ffb700 1 -- 172.21.2.137:0/3938272178 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f5500046470 con 0x7f55080b1180 2021-11-15T19:33:28.343 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:28.343 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/465191155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":465191155},{"type":"v1","addr":"172.21.2.111:6835","nonce":465191155}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30},{"gid":6493,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/1320468150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":1320468150},{"type":"v1","addr":"172.21.2.137:6833","nonce":1320468150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-11-15T19:33:28.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.333+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54ec053660 msgr2=0x7f54ec055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54ec053660 0x7f54ec055b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f54f0002f70 tx=0x7f54f0015000).stop 2021-11-15T19:33:28.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 msgr2=0x7f5508137de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 0x7f5508137de0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f55000032f0 tx=0x7f5500009220).stop 2021-11-15T19:33:28.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 shutdown_connections 2021-11-15T19:33:28.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f54ec053660 0x7f54ec055b20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55080b1180 0x7f5508137de0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55080af2f0 0x7f55081378f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 --2- 172.21.2.137:0/3938272178 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55080acab0 0x7f55080673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 >> 172.21.2.137:0/3938272178 conn(0x7f55080630f0 msgr2=0x7f55080b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:28.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 shutdown_connections 2021-11-15T19:33:28.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.337+0000 7f550f02e700 1 -- 172.21.2.137:0/3938272178 wait complete. 2021-11-15T19:33:28.348 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 34 2021-11-15T19:33:28.351 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:33:28.351 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:33:28.352 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:33:28.352 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:33:28.352 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:33:28.352 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:33:28.353 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:33:28.353 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:33:28.357 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:33:28.357 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:33:28.359 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:33:28.359 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:33:28.402 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:33:28.403 DEBUG:teuthology.parallel:result is None 2021-11-15T19:33:28.406 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:33:28.406 DEBUG:teuthology.parallel:result is None 2021-11-15T19:33:28.407 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:33:28.442 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:33:28.446 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:33:28.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 Processor -- start 2021-11-15T19:33:28.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- start start 2021-11-15T19:33:28.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fda7c05c770 0x7fda7c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fda7c140aa0 0x7fda7c140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c05cb50 con 0x7fda7c0b0550 2021-11-15T19:33:28.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0b1650 con 0x7fda7c140aa0 2021-11-15T19:33:28.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0ad030 con 0x7fda7c05c770 2021-11-15T19:33:28.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fda7c0b0550 0x7fda7c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55270/0 (socket says 172.21.2.137:55270) 2021-11-15T19:33:28.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 -- 172.21.2.137:0/1081968100 learned_addr learned my addr 172.21.2.137:0/1081968100 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:28.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 --2- 172.21.2.137:0/1081968100 >> v2:172.21.2.137:3300/0 conn(0x7fda7c05c770 0x7fda7c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 -- 172.21.2.137:0/1081968100 >> v2:172.21.2.111:3300/0 conn(0x7fda7c140aa0 msgr2=0x7fda7c140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:28.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 --2- 172.21.2.137:0/1081968100 >> v2:172.21.2.111:3300/0 conn(0x7fda7c140aa0 0x7fda7c140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 -- 172.21.2.137:0/1081968100 >> v1:172.21.2.137:6789/0 conn(0x7fda7c0b0550 legacy=0x7fda7c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 -- 172.21.2.137:0/1081968100 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0ad2d0 con 0x7fda7c05c770 2021-11-15T19:33:28.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 --2- 172.21.2.137:0/1081968100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c05c770 0x7fda7c0aef30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fda740032f0 tx=0x7fda740091d0).ready entity=mon.1 client_cookie=4518982f8f00ef3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda80885700 1 -- 172.21.2.137:0/1081968100 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda74009ea0 con 0x7fda7c05c770 2021-11-15T19:33:28.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda80885700 1 -- 172.21.2.137:0/1081968100 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7400b870 con 0x7fda7c05c770 2021-11-15T19:33:28.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda80885700 1 -- 172.21.2.137:0/1081968100 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda7400b9e0 con 0x7fda7c05c770 2021-11-15T19:33:28.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/1081968100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c05c770 msgr2=0x7fda7c0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- 172.21.2.137:0/1081968100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c05c770 0x7fda7c0aef30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fda740032f0 tx=0x7fda740091d0).stop 2021-11-15T19:33:28.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/1081968100 shutdown_connections 2021-11-15T19:33:28.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- 172.21.2.137:0/1081968100 >> v2:172.21.2.111:3300/0 conn(0x7fda7c140aa0 0x7fda7c140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:28.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- 172.21.2.137:0/1081968100 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c05c770 0x7fda7c0aef30 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/1081968100 >> 172.21.2.137:0/1081968100 conn(0x7fda7c0631e0 msgr2=0x7fda7c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:28.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/1081968100 shutdown_connections 2021-11-15T19:33:28.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/1081968100 wait complete. 2021-11-15T19:33:28.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 Processor -- start 2021-11-15T19:33:28.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- start start 2021-11-15T19:33:28.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fda7c05c770 0x7fda7c065690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 0x7fda7c066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda7c140aa0 0x7fda7c141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c141830 con 0x7fda7c140aa0 2021-11-15T19:33:28.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c065cc0 con 0x7fda7c0b0550 2021-11-15T19:33:28.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c065f60 con 0x7fda7c05c770 2021-11-15T19:33:28.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 0x7fda7c066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 0x7fda7c066cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36496/0 (socket says 172.21.2.137:36496) 2021-11-15T19:33:28.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 -- 172.21.2.137:0/535141568 learned_addr learned my addr 172.21.2.137:0/535141568 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:28.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fda7c05c770 0x7fda7c065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda82088700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda7c140aa0 0x7fda7c141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 -- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fda7c05c770 msgr2=0x7fda7c065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fda7c05c770 0x7fda7c065690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 -- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda7c140aa0 msgr2=0x7fda7c141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:28.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda7c140aa0 0x7fda7c141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:28.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 -- 172.21.2.137:0/535141568 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009470 con 0x7fda7c0b0550 2021-11-15T19:33:28.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81086700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 0x7fda7c066cb0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fda7c0aee10 tx=0x7fda6c007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c0070d0 con 0x7fda7c0b0550 2021-11-15T19:33:28.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c007230 con 0x7fda7c0b0550 2021-11-15T19:33:28.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c0b4490 con 0x7fda7c0b0550 2021-11-15T19:33:28.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c005610 con 0x7fda7c0b0550 2021-11-15T19:33:28.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c159930 con 0x7fda7c0b0550 2021-11-15T19:33:28.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c1419a0 con 0x7fda7c0b0550 2021-11-15T19:33:28.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda6c010070 con 0x7fda7c0b0550 2021-11-15T19:33:28.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda6affd700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda5c053660 0x7fda5c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:28.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fda6c06ad50 con 0x7fda7c0b0550 2021-11-15T19:33:28.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda5c053660 0x7fda5c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:28.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.465+0000 7fda81887700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda5c053660 0x7fda5c055b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fda7401b000 tx=0x7fda74016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:28.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.469+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda7c1419a0 con 0x7fda7c0b0550 2021-11-15T19:33:28.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:28.561+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fda7c1419a0 con 0x7fda7c0b0550 2021-11-15T19:33:29.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.505+0000 7fda6affd700 1 -- 172.21.2.137:0/535141568 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda7c1419a0 con 0x7fda7c0b0550 2021-11-15T19:33:29.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda5c053660 msgr2=0x7fda5c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda5c053660 0x7fda5c055b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fda7401b000 tx=0x7fda74016000).stop 2021-11-15T19:33:29.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 msgr2=0x7fda7c066cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 0x7fda7c066cb0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fda7c0aee10 tx=0x7fda6c007c40).stop 2021-11-15T19:33:29.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 shutdown_connections 2021-11-15T19:33:29.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda5c053660 0x7fda5c055b20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda7c140aa0 0x7fda7c141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda7c0b0550 0x7fda7c066cb0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 --2- 172.21.2.137:0/535141568 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fda7c05c770 0x7fda7c065690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 >> 172.21.2.137:0/535141568 conn(0x7fda7c0631e0 msgr2=0x7fda7c0b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:29.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 shutdown_connections 2021-11-15T19:33:29.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.513+0000 7fda83aeb700 1 -- 172.21.2.137:0/535141568 wait complete. 2021-11-15T19:33:29.522 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:33:29.531 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:33:29.532 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:33:29.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 Processor -- start 2021-11-15T19:33:29.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- start start 2021-11-15T19:33:29.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6008147980 0x7f60080aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008148190 con 0x7f60080b1340 2021-11-15T19:33:29.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60080b1720 con 0x7f6008144610 2021-11-15T19:33:29.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60080af800 con 0x7f6008147980 2021-11-15T19:33:29.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6006ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6008144610 0x7f60080a9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55288/0 (socket says 172.21.2.137:55288) 2021-11-15T19:33:29.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6006ffd700 1 -- 172.21.2.137:0/836609891 learned_addr learned my addr 172.21.2.137:0/836609891 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:29.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168345768 0 0) 0x7f60080b1720 con 0x7f6008144610 2021-11-15T19:33:29.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe8003260 con 0x7f6008144610 2021-11-15T19:33:29.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929984037 0 0) 0x7f5fe8003260 con 0x7f6008144610 2021-11-15T19:33:29.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6008147980 msgr2=0x7f60080aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6008147980 0x7f60080aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 >> v1:172.21.2.111:6789/0 conn(0x7f60080b1340 legacy=0x7f6008143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600805faf0 con 0x7f6008144610 2021-11-15T19:33:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f5ff8001660 con 0x7f6008144610 2021-11-15T19:33:29.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 >> v1:172.21.2.137:6789/0 conn(0x7f6008144610 legacy=0x7f60080a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fe80037d0 0x7f5fe8003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6008147980 0x7f5fe8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fe8004bf0 0x7f5fe800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60080af800 con 0x7f5fe8004bf0 2021-11-15T19:33:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80052b0 con 0x7f5fe80037d0 2021-11-15T19:33:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe800bc40 con 0x7f6008147980 2021-11-15T19:33:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fe80037d0 0x7f5fe8003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 -- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6008147980 msgr2=0x7f5fe8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6008147980 0x7f5fe8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 -- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fe8004bf0 msgr2=0x7f5fe800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5fe8004bf0 0x7f5fe800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 -- 172.21.2.137:0/836609891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8003260 con 0x7f5fe80037d0 2021-11-15T19:33:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60077fe700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fe80037d0 0x7f5fe8003bf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f5ff0000f70 tx=0x7f5ff00079e0).ready entity=mon.1 client_cookie=b253c09467c46c89 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff0007cf0 con 0x7f5fe80037d0 2021-11-15T19:33:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0014410 con 0x7f5fe80037d0 2021-11-15T19:33:29.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f60067fc700 1 -- 172.21.2.137:0/836609891 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff0014770 con 0x7f5fe80037d0 2021-11-15T19:33:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/836609891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fe80037d0 msgr2=0x7f5fe8003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 --2- 172.21.2.137:0/836609891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5fe80037d0 0x7f5fe8003bf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f5ff0000f70 tx=0x7f5ff00079e0).stop 2021-11-15T19:33:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 -- 172.21.2.137:0/836609891 reap_dead start 2021-11-15T19:33:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/836609891 shutdown_connections 2021-11-15T19:33:29.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/836609891 >> 172.21.2.137:0/836609891 conn(0x7f60080b4e60 msgr2=0x7f60080b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/836609891 shutdown_connections 2021-11-15T19:33:29.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/836609891 wait complete. 2021-11-15T19:33:29.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 Processor -- start 2021-11-15T19:33:29.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- start start 2021-11-15T19:33:29.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fe80037d0 0x7f60080b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f600814aa70 0x7f6008142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 0x7f60080ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60080acf50 con 0x7f600814aa70 2021-11-15T19:33:29.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008149f60 con 0x7f60081433c0 2021-11-15T19:33:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600814a200 con 0x7f5fe80037d0 2021-11-15T19:33:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 0x7f60080ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 0x7f60080ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36518/0 (socket says 172.21.2.137:36518) 2021-11-15T19:33:29.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 -- 172.21.2.137:0/1566365959 learned_addr learned my addr 172.21.2.137:0/1566365959 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 -- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fe80037d0 msgr2=0x7f60080b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fe80037d0 0x7f60080b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 -- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f600814aa70 msgr2=0x7f6008142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f600814aa70 0x7f6008142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 -- 172.21.2.137:0/1566365959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080acc70 con 0x7f60081433c0 2021-11-15T19:33:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6007fff700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 0x7f60080ae600 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f5ff8001370 tx=0x7f600000a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600000cea0 con 0x7f60081433c0 2021-11-15T19:33:29.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6000005c30 con 0x7f60081433c0 2021-11-15T19:33:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6000007070 con 0x7f60081433c0 2021-11-15T19:33:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60080b42b0 con 0x7f60081433c0 2021-11-15T19:33:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6008159b90 con 0x7f60081433c0 2021-11-15T19:33:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600814a370 con 0x7f60081433c0 2021-11-15T19:33:29.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f600001b060 con 0x7f60081433c0 2021-11-15T19:33:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6004ff9700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5fec0536f0 0x7f5fec055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.577+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f600006aea0 con 0x7f60081433c0 2021-11-15T19:33:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.581+0000 7f60077fe700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5fec0536f0 0x7f5fec055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.581+0000 7f60077fe700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5fec0536f0 0x7f5fec055bb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5ff0000f70 tx=0x7f5ff0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.581+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f600814a370 con 0x7f60081433c0 2021-11-15T19:33:29.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.689+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f600814a370 con 0x7f60081433c0 2021-11-15T19:33:29.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.689+0000 7f6004ff9700 1 -- 172.21.2.137:0/1566365959 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f600814a370 con 0x7f60081433c0 2021-11-15T19:33:29.701 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:29.701 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:33:29.701 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:33:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:33:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:33:29.702 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.703 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:33:29.704 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:33:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.705 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.706 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:33:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:33:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.707 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.708 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:33:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:33:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.709 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.710 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:33:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:33:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.711 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:33:29.712 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:33:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.713 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:33:29.714 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:33:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.715 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:33:29.716 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:33:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.717 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:33:29.718 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:33:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.719 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:33:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:33:29.720 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.721 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:33:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:33:29.722 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:33:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:33:29.723 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:33:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:33:29.724 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:33:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:33:29.725 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:33:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:33:29.726 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:33:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:33:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:33:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:33:29.728 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:33:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.729 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:33:29.730 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:33:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:33:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:33:29.731 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:33:29.732 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:33:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:33:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:33:29.733 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:29.734 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:29.734 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:33:29.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5fec0536f0 msgr2=0x7f5fec055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5fec0536f0 0x7f5fec055bb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5ff0000f70 tx=0x7f5ff0015000).stop 2021-11-15T19:33:29.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 msgr2=0x7f60080ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 0x7f60080ae600 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f5ff8001370 tx=0x7f600000a060).stop 2021-11-15T19:33:29.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 shutdown_connections 2021-11-15T19:33:29.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5fec0536f0 0x7f5fec055bb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60081433c0 0x7f60080ae600 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f600814aa70 0x7f6008142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 --2- 172.21.2.137:0/1566365959 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5fe80037d0 0x7f60080b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 >> 172.21.2.137:0/1566365959 conn(0x7f60080b4e60 msgr2=0x7f6008143cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:29.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 shutdown_connections 2021-11-15T19:33:29.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.693+0000 7f600db5d700 1 -- 172.21.2.137:0/1566365959 wait complete. 2021-11-15T19:33:29.739 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:29.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 Processor -- start 2021-11-15T19:33:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- start start 2021-11-15T19:33:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89940b1340 0x7f8994147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89940a9f50 0x7f89940aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8994148190 con 0x7f8994143f00 2021-11-15T19:33:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940b1720 con 0x7f89940b1340 2021-11-15T19:33:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994147e70 con 0x7f89940a9f50 2021-11-15T19:33:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89940b1340 0x7f8994147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89940b1340 0x7f8994147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36522/0 (socket says 172.21.2.137:36522) 2021-11-15T19:33:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/2090780920 learned_addr learned my addr 172.21.2.137:0/2090780920 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/2090780920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89940a9f50 msgr2=0x7f89940aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- 172.21.2.137:0/2090780920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89940a9f50 0x7f89940aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/2090780920 >> v1:172.21.2.111:6789/0 conn(0x7f8994143f00 legacy=0x7f8994144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/2090780920 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940af800 con 0x7f89940b1340 2021-11-15T19:33:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- 172.21.2.137:0/2090780920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940b1340 0x7f8994147980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f8994062250 tx=0x7f8984006eb0).ready entity=mon.1 client_cookie=5f4d409694635901 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8991ffb700 1 -- 172.21.2.137:0/2090780920 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f898400d570 con 0x7f89940b1340 2021-11-15T19:33:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8991ffb700 1 -- 172.21.2.137:0/2090780920 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984000e90 con 0x7f89940b1340 2021-11-15T19:33:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8991ffb700 1 -- 172.21.2.137:0/2090780920 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f898400d8c0 con 0x7f89940b1340 2021-11-15T19:33:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/2090780920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940b1340 msgr2=0x7f8994147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- 172.21.2.137:0/2090780920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940b1340 0x7f8994147980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f8994062250 tx=0x7f8984006eb0).stop 2021-11-15T19:33:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/2090780920 shutdown_connections 2021-11-15T19:33:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- 172.21.2.137:0/2090780920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89940a9f50 0x7f89940aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- 172.21.2.137:0/2090780920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940b1340 0x7f8994147980 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/2090780920 >> 172.21.2.137:0/2090780920 conn(0x7f89940b4e60 msgr2=0x7f89940b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/2090780920 shutdown_connections 2021-11-15T19:33:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/2090780920 wait complete. 2021-11-15T19:33:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 Processor -- start 2021-11-15T19:33:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- start start 2021-11-15T19:33:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 0x7f899414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89940b1340 0x7f899413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8994143f00 0x7f899415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994099050 con 0x7f89940b1340 2021-11-15T19:33:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994099ce0 con 0x7f89940a9f50 2021-11-15T19:33:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994159c60 con 0x7f8994143f00 2021-11-15T19:33:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 0x7f899414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 0x7f899414a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36528/0 (socket says 172.21.2.137:36528) 2021-11-15T19:33:29.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/3020630613 learned_addr learned my addr 172.21.2.137:0/3020630613 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:29.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8994143f00 msgr2=0x7f899415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8994143f00 0x7f899415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89940b1340 msgr2=0x7f899413ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89940b1340 0x7f899413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 -- 172.21.2.137:0/3020630613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898400b1e0 con 0x7f89940a9f50 2021-11-15T19:33:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8992ffd700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 0x7f899414a8b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f8994062250 tx=0x7f8984015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89840117e0 con 0x7f89940a9f50 2021-11-15T19:33:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984011940 con 0x7f89940a9f50 2021-11-15T19:33:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8994099f10 con 0x7f89940a9f50 2021-11-15T19:33:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8984011ca0 con 0x7f89940a9f50 2021-11-15T19:33:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8994140500 con 0x7f89940a9f50 2021-11-15T19:33:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899405faf0 con 0x7f89940a9f50 2021-11-15T19:33:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8984025030 con 0x7f89940a9f50 2021-11-15T19:33:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f898bfff700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8978053720 0x7f8978055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f898406c890 con 0x7f89940a9f50 2021-11-15T19:33:29.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.785+0000 7f89927fc700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8978053720 0x7f8978055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.789+0000 7f89927fc700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8978053720 0x7f8978055be0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f897c000f70 tx=0x7f897c0077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.789+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8984043c10 con 0x7f89940a9f50 2021-11-15T19:33:29.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89940573d0 con 0x7f89940a9f50 2021-11-15T19:33:29.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f898bfff700 1 -- 172.21.2.137:0/3020630613 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f8984023090 con 0x7f89940a9f50 2021-11-15T19:33:29.881 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:29.882 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":79,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:29.498179+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8978053720 msgr2=0x7f8978055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8978053720 0x7f8978055be0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f897c000f70 tx=0x7f897c0077f0).stop 2021-11-15T19:33:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 msgr2=0x7f899414a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 0x7f899414a8b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f8994062250 tx=0x7f8984015000).stop 2021-11-15T19:33:29.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 shutdown_connections 2021-11-15T19:33:29.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8978053720 0x7f8978055be0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8994143f00 0x7f899415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89940b1340 0x7f899413ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 --2- 172.21.2.137:0/3020630613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89940a9f50 0x7f899414a8b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 >> 172.21.2.137:0/3020630613 conn(0x7f89940b4e60 msgr2=0x7f89940af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:29.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 shutdown_connections 2021-11-15T19:33:29.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.873+0000 7f8999a11700 1 -- 172.21.2.137:0/3020630613 wait complete. 2021-11-15T19:33:29.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:33:29.890 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:29.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 Processor -- start 2021-11-15T19:33:29.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- start start 2021-11-15T19:33:29.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 0x7fe2ec13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe2ec0b00a0 0x7fe2ec05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec066270 con 0x7fe2ec065b10 2021-11-15T19:33:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec067410 con 0x7fe2ec0b00a0 2021-11-15T19:33:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec065fd0 con 0x7fe2ec065730 2021-11-15T19:33:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f0b5b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe2ec065b10 0x7fe2ec13c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55322/0 (socket says 172.21.2.137:55322) 2021-11-15T19:33:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f0b5b700 1 -- 172.21.2.137:0/2576435244 learned_addr learned my addr 172.21.2.137:0/2576435244 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122159709 0 0) 0x7fe2ec066270 con 0x7fe2ec065b10 2021-11-15T19:33:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003260 con 0x7fe2ec065b10 2021-11-15T19:33:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2588099600 0 0) 0x7fe2d4003260 con 0x7fe2ec065b10 2021-11-15T19:33:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f1b5d700 1 --2- 172.21.2.137:0/2576435244 >> v2:172.21.2.111:3300/0 conn(0x7fe2ec0b00a0 0x7fe2ec05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 msgr2=0x7fe2ec13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 0x7fe2ec13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 0x7fe2ec13c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 >> v2:172.21.2.111:3300/0 conn(0x7fe2ec0b00a0 msgr2=0x7fe2ec05bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 --2- 172.21.2.137:0/2576435244 >> v2:172.21.2.111:3300/0 conn(0x7fe2ec0b00a0 0x7fe2ec05bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec066f70 con 0x7fe2ec065b10 2021-11-15T19:33:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe2e8001680 con 0x7fe2ec065b10 2021-11-15T19:33:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f1b5d700 1 --2- 172.21.2.137:0/2576435244 >> v2:172.21.2.111:3300/0 conn(0x7fe2ec0b00a0 0x7fe2ec05bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:29.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 >> v1:172.21.2.137:6789/0 conn(0x7fe2ec065b10 legacy=0x7fe2ec13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2d40037d0 0x7fe2d4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2d4004500 0x7fe2d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 0x7fe2d400c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec067410 con 0x7fe2d4004500 2021-11-15T19:33:29.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec065fd0 con 0x7fe2d40037d0 2021-11-15T19:33:29.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d4005300 con 0x7fe2ec065730 2021-11-15T19:33:29.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2d40037d0 0x7fe2d4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 -- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 msgr2=0x7fe2d400c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec065730 0x7fe2d400c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 -- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2d4004500 msgr2=0x7fe2d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2d4004500 0x7fe2d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 -- 172.21.2.137:0/2576435244 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4003260 con 0x7fe2d40037d0 2021-11-15T19:33:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f135c700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2d40037d0 0x7fe2d4003bf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fe2e0007000 tx=0x7fe2e0008040).ready entity=mon.1 client_cookie=d17293da2ccab258 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e0012470 con 0x7fe2d40037d0 2021-11-15T19:33:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000c030 con 0x7fe2d40037d0 2021-11-15T19:33:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2dffff700 1 -- 172.21.2.137:0/2576435244 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e00127c0 con 0x7fe2d40037d0 2021-11-15T19:33:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- 172.21.2.137:0/2576435244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2d40037d0 msgr2=0x7fe2d4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/2576435244 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2d40037d0 0x7fe2d4003bf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fe2e0007000 tx=0x7fe2e0008040).stop 2021-11-15T19:33:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f1b5d700 1 -- 172.21.2.137:0/2576435244 reap_dead start 2021-11-15T19:33:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- 172.21.2.137:0/2576435244 shutdown_connections 2021-11-15T19:33:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- 172.21.2.137:0/2576435244 >> 172.21.2.137:0/2576435244 conn(0x7fe2ec060290 msgr2=0x7fe2ec060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- 172.21.2.137:0/2576435244 shutdown_connections 2021-11-15T19:33:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.933+0000 7fe2f35c0700 1 -- 172.21.2.137:0/2576435244 wait complete. 2021-11-15T19:33:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 Processor -- start 2021-11-15T19:33:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- start start 2021-11-15T19:33:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 0x7fe2ec138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2ec139460 0x7fe2ec13e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec137f20 0x7fe2ec13e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec1403b0 con 0x7fe2ec139460 2021-11-15T19:33:29.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec140650 con 0x7fe2ec138a50 2021-11-15T19:33:29.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec1408f0 con 0x7fe2ec137f20 2021-11-15T19:33:29.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 0x7fe2ec138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 0x7fe2ec138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36550/0 (socket says 172.21.2.137:36550) 2021-11-15T19:33:29.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 -- 172.21.2.137:0/838470139 learned_addr learned my addr 172.21.2.137:0/838470139 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:29.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 -- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec137f20 msgr2=0x7fe2ec13e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec137f20 0x7fe2ec13e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 -- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2ec139460 msgr2=0x7fe2ec13e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:29.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2ec139460 0x7fe2ec13e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:29.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 -- 172.21.2.137:0/838470139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec140b90 con 0x7fe2ec138a50 2021-11-15T19:33:29.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f135c700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 0x7fe2ec138e30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fe2e0007000 tx=0x7fe2e0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e001f070 con 0x7fe2ec138a50 2021-11-15T19:33:29.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0000e90 con 0x7fe2ec138a50 2021-11-15T19:33:29.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e0019ae0 con 0x7fe2ec138a50 2021-11-15T19:33:29.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec151310 con 0x7fe2ec138a50 2021-11-15T19:33:29.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec151840 con 0x7fe2ec138a50 2021-11-15T19:33:29.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec140d20 con 0x7fe2ec138a50 2021-11-15T19:33:29.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2e0019c40 con 0x7fe2ec138a50 2021-11-15T19:33:29.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2de7fc700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2cc0536d0 0x7fe2cc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:29.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe2e006eb90 con 0x7fe2ec138a50 2021-11-15T19:33:29.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.937+0000 7fe2f0b5b700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2cc0536d0 0x7fe2cc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:29.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.941+0000 7fe2f0b5b700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2cc0536d0 0x7fe2cc055b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe2e8001390 tx=0x7fe2ec0652b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:29.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:29.941+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2e0045440 con 0x7fe2ec138a50 2021-11-15T19:33:30.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.021+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe2ec0b0fb0 con 0x7fe2ec138a50 2021-11-15T19:33:30.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.021+0000 7fe2de7fc700 1 -- 172.21.2.137:0/838470139 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe2e0028020 con 0x7fe2ec138a50 2021-11-15T19:33:30.032 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:30.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2cc0536d0 msgr2=0x7fe2cc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2cc0536d0 0x7fe2cc055b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe2e8001390 tx=0x7fe2ec0652b0).stop 2021-11-15T19:33:30.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 msgr2=0x7fe2ec138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 0x7fe2ec138e30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fe2e0007000 tx=0x7fe2e0008040).stop 2021-11-15T19:33:30.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 shutdown_connections 2021-11-15T19:33:30.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2cc0536d0 0x7fe2cc055b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2ec137f20 0x7fe2ec13e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe2ec139460 0x7fe2ec13e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 --2- 172.21.2.137:0/838470139 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2ec138a50 0x7fe2ec138e30 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 >> 172.21.2.137:0/838470139 conn(0x7fe2ec060290 msgr2=0x7fe2ec0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:30.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 shutdown_connections 2021-11-15T19:33:30.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.025+0000 7fe2f35c0700 1 -- 172.21.2.137:0/838470139 wait complete. 2021-11-15T19:33:30.040 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.081+0000 7f6938bb6700 1 Processor -- start 2021-11-15T19:33:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.081+0000 7f6938bb6700 1 -- start start 2021-11-15T19:33:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f69340b00a0 0x7f693413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6934066270 con 0x7f6934065730 2021-11-15T19:33:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6934065fd0 con 0x7f6934065b10 2021-11-15T19:33:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6934067410 con 0x7f69340b00a0 2021-11-15T19:33:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6934065b10 0x7f693405bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55338/0 (socket says 172.21.2.137:55338) 2021-11-15T19:33:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 -- 172.21.2.137:0/3254588742 learned_addr learned my addr 172.21.2.137:0/3254588742 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324715778 0 0) 0x7f6934065fd0 con 0x7f6934065b10 2021-11-15T19:33:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6918003260 con 0x7f6934065b10 2021-11-15T19:33:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810283288 0 0) 0x7f6918003260 con 0x7f6934065b10 2021-11-15T19:33:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 >> v2:172.21.2.111:3300/0 conn(0x7f69340b00a0 msgr2=0x7f693413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 --2- 172.21.2.137:0/3254588742 >> v2:172.21.2.111:3300/0 conn(0x7f69340b00a0 0x7f693413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 >> v1:172.21.2.111:6789/0 conn(0x7f6934065730 legacy=0x7f693413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934066f70 con 0x7f6934065b10 2021-11-15T19:33:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f692c0019e0 con 0x7f6934065b10 2021-11-15T19:33:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 >> v1:172.21.2.137:6789/0 conn(0x7f6934065b10 legacy=0x7f693405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6918003820 0x7f6918003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6918004500 0x7f6918004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918005050 0x7f691800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6934067410 con 0x7f6918003820 2021-11-15T19:33:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691800bf40 con 0x7f6918004500 2021-11-15T19:33:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691800c100 con 0x7f6918005050 2021-11-15T19:33:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6918004500 0x7f6918004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 -- 172.21.2.137:0/3254588742 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918005050 msgr2=0x7f691800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918005050 0x7f691800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 -- 172.21.2.137:0/3254588742 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6918003820 msgr2=0x7f6918003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6918003820 0x7f6918003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 -- 172.21.2.137:0/3254588742 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918003260 con 0x7f6918004500 2021-11-15T19:33:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 -- 172.21.2.137:0/3254588742 reap_dead start 2021-11-15T19:33:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6931d9b700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6918004500 0x7f6918004980 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f693413f060 tx=0x7f6934067100).ready entity=mon.1 client_cookie=dd27918b2ceda69 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692c00cbb0 con 0x7f6918004500 2021-11-15T19:33:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c00cd10 con 0x7f6918004500 2021-11-15T19:33:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f693159a700 1 -- 172.21.2.137:0/3254588742 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692c005b80 con 0x7f6918004500 2021-11-15T19:33:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- 172.21.2.137:0/3254588742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6918004500 msgr2=0x7f6918004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6918004500 0x7f6918004980 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f693413f060 tx=0x7f6934067100).stop 2021-11-15T19:33:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- 172.21.2.137:0/3254588742 shutdown_connections 2021-11-15T19:33:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 --2- 172.21.2.137:0/3254588742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6918004500 0x7f6918004980 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- 172.21.2.137:0/3254588742 >> 172.21.2.137:0/3254588742 conn(0x7f6934060290 msgr2=0x7f6934060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- 172.21.2.137:0/3254588742 shutdown_connections 2021-11-15T19:33:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- 172.21.2.137:0/3254588742 wait complete. 2021-11-15T19:33:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 Processor -- start 2021-11-15T19:33:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- start start 2021-11-15T19:33:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918004500 0x7f69340ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f69340add20 0x7f693412dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 0x7f69340ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340ae4d0 con 0x7f69340add20 2021-11-15T19:33:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69341405d0 con 0x7f693412e190 2021-11-15T19:33:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6938bb6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69340ae230 con 0x7f6918004500 2021-11-15T19:33:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 0x7f69340ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 0x7f69340ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36572/0 (socket says 172.21.2.137:36572) 2021-11-15T19:33:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 -- 172.21.2.137:0/1550484527 learned_addr learned my addr 172.21.2.137:0/1550484527 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 -- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918004500 msgr2=0x7f69340ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918004500 0x7f69340ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 -- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f69340add20 msgr2=0x7f693412dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f69340add20 0x7f693412dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 -- 172.21.2.137:0/1550484527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934140db0 con 0x7f693412e190 2021-11-15T19:33:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.085+0000 7f6932d9d700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 0x7f69340ae7c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f69340ad120 tx=0x7f6924007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692400aca0 con 0x7f693412e190 2021-11-15T19:33:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400ae00 con 0x7f693412e190 2021-11-15T19:33:30.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693412e640 con 0x7f693412e190 2021-11-15T19:33:30.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6934141690 con 0x7f693412e190 2021-11-15T19:33:30.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6924007260 con 0x7f693412e190 2021-11-15T19:33:30.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69340b0fb0 con 0x7f693412e190 2021-11-15T19:33:30.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f692401b060 con 0x7f693412e190 2021-11-15T19:33:30.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f69100536a0 0x7f6910055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f692406a8e0 con 0x7f693412e190 2021-11-15T19:33:30.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f693259c700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f69100536a0 0x7f6910055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f693259c700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f69100536a0 0x7f6910055b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f6928000f70 tx=0x7f69280069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.089+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6924041d70 con 0x7f693412e190 2021-11-15T19:33:30.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f693405fd80 con 0x7f693412e190 2021-11-15T19:33:30.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f69237fe700 1 -- 172.21.2.137:0/1550484527 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6924019030 con 0x7f693412e190 2021-11-15T19:33:30.182 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:30.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f69100536a0 msgr2=0x7f6910055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f69100536a0 0x7f6910055b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f6928000f70 tx=0x7f69280069b0).stop 2021-11-15T19:33:30.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 msgr2=0x7f69340ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 0x7f69340ae7c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f69340ad120 tx=0x7f6924007c70).stop 2021-11-15T19:33:30.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 shutdown_connections 2021-11-15T19:33:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f69100536a0 0x7f6910055b60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f693412e190 0x7f69340ae7c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f69340add20 0x7f693412dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 --2- 172.21.2.137:0/1550484527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6918004500 0x7f69340ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 >> 172.21.2.137:0/1550484527 conn(0x7f6934060290 msgr2=0x7f693413c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:30.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 shutdown_connections 2021-11-15T19:33:30.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.173+0000 7f6938bb6700 1 -- 172.21.2.137:0/1550484527 wait complete. 2021-11-15T19:33:30.189 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:33:30.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 Processor -- start 2021-11-15T19:33:30.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- start start 2021-11-15T19:33:30.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f51ac0b1340 0x7f51ac147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 0x7f51ac0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac148190 con 0x7f51ac143f00 2021-11-15T19:33:30.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0b1720 con 0x7f51ac0b1340 2021-11-15T19:33:30.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac147e70 con 0x7f51ac0a9f50 2021-11-15T19:33:30.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f51ac0b1340 0x7f51ac147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f51ac0b1340 0x7f51ac147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36576/0 (socket says 172.21.2.137:36576) 2021-11-15T19:33:30.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 -- 172.21.2.137:0/1149283175 learned_addr learned my addr 172.21.2.137:0/1149283175 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:30.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 -- 172.21.2.137:0/1149283175 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 msgr2=0x7f51ac0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 --2- 172.21.2.137:0/1149283175 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 0x7f51ac0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 -- 172.21.2.137:0/1149283175 >> v1:172.21.2.111:6789/0 conn(0x7f51ac143f00 legacy=0x7f51ac144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 -- 172.21.2.137:0/1149283175 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0af800 con 0x7f51ac0b1340 2021-11-15T19:33:30.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51abfff700 1 --2- 172.21.2.137:0/1149283175 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac147980 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f51ac062250 tx=0x7f5194006eb0).ready entity=mon.1 client_cookie=83f5c931eb02cfb5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51aaffd700 1 -- 172.21.2.137:0/1149283175 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400d570 con 0x7f51ac0b1340 2021-11-15T19:33:30.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51aaffd700 1 -- 172.21.2.137:0/1149283175 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5194000e90 con 0x7f51ac0b1340 2021-11-15T19:33:30.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51aaffd700 1 -- 172.21.2.137:0/1149283175 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400d8c0 con 0x7f51ac0b1340 2021-11-15T19:33:30.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/1149283175 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 msgr2=0x7f51ac147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- 172.21.2.137:0/1149283175 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac147980 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f51ac062250 tx=0x7f5194006eb0).stop 2021-11-15T19:33:30.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/1149283175 shutdown_connections 2021-11-15T19:33:30.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- 172.21.2.137:0/1149283175 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 0x7f51ac0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- 172.21.2.137:0/1149283175 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac147980 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/1149283175 >> 172.21.2.137:0/1149283175 conn(0x7f51ac0b4e60 msgr2=0x7f51ac0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:30.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/1149283175 shutdown_connections 2021-11-15T19:33:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/1149283175 wait complete. 2021-11-15T19:33:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 Processor -- start 2021-11-15T19:33:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- start start 2021-11-15T19:33:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 0x7f51ac146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51ac143f00 0x7f51ac1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac09a490 con 0x7f51ac143f00 2021-11-15T19:33:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac140210 con 0x7f51ac0b1340 2021-11-15T19:33:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac143000 con 0x7f51ac0a9f50 2021-11-15T19:33:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36584/0 (socket says 172.21.2.137:36584) 2021-11-15T19:33:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 -- 172.21.2.137:0/441466438 learned_addr learned my addr 172.21.2.137:0/441466438 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 -- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 msgr2=0x7f51ac146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 0x7f51ac146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 -- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51ac143f00 msgr2=0x7f51ac1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51ac143f00 0x7f51ac1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 -- 172.21.2.137:0/441466438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519400b1e0 con 0x7f51ac0b1340 2021-11-15T19:33:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51ab7fe700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac159ba0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f51ac1423b0 tx=0x7f519c007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519c00ce70 con 0x7f51ac0b1340 2021-11-15T19:33:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c013450 con 0x7f51ac0b1340 2021-11-15T19:33:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac09a680 con 0x7f51ac0b1340 2021-11-15T19:33:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519c0137b0 con 0x7f51ac0b1340 2021-11-15T19:33:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac099b80 con 0x7f51ac0b1340 2021-11-15T19:33:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.233+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac05faf0 con 0x7f51ac0b1340 2021-11-15T19:33:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.237+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f519c01a060 con 0x7f51ac0b1340 2021-11-15T19:33:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.237+0000 7f51a97fa700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51900536f0 0x7f5190055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.237+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f519c06af60 con 0x7f51ac0b1340 2021-11-15T19:33:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.237+0000 7f51abfff700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51900536f0 0x7f5190055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.237+0000 7f51abfff700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51900536f0 0x7f5190055bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f51ac062250 tx=0x7f5194015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.237+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f519c0423f0 con 0x7f51ac0b1340 2021-11-15T19:33:30.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f51ac140350 con 0x7f51ac0b1340 2021-11-15T19:33:30.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51a97fa700 1 -- 172.21.2.137:0/441466438 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+143 (secure 0 0 0) 0x7f519c018020 con 0x7f51ac0b1340 2021-11-15T19:33:30.331 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:30.331 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:33:30.332 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:30.332 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:33:30.332 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:33:30.332 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:30.333 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:30.333 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:33:30.333 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:33:30.333 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:30.333 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:33:30.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51900536f0 msgr2=0x7f5190055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51900536f0 0x7f5190055bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f51ac062250 tx=0x7f5194015000).stop 2021-11-15T19:33:30.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 msgr2=0x7f51ac159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac159ba0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f51ac1423b0 tx=0x7f519c007c30).stop 2021-11-15T19:33:30.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 shutdown_connections 2021-11-15T19:33:30.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51900536f0 0x7f5190055bb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51ac143f00 0x7f51ac1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51ac0b1340 0x7f51ac159ba0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 --2- 172.21.2.137:0/441466438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51ac0a9f50 0x7f51ac146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:30.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 >> 172.21.2.137:0/441466438 conn(0x7f51ac0b4e60 msgr2=0x7f51ac0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:30.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 shutdown_connections 2021-11-15T19:33:30.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.321+0000 7f51b2600700 1 -- 172.21.2.137:0/441466438 wait complete. 2021-11-15T19:33:30.338 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:33:30.338 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:33:30.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 Processor -- start 2021-11-15T19:33:30.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- start start 2021-11-15T19:33:30.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f83f80ad320 0x7f83f814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80b76c0 con 0x7f83f80acd60 2021-11-15T19:33:30.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f812a170 con 0x7f83f80b72e0 2021-11-15T19:33:30.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80b3100 con 0x7f83f80ad320 2021-11-15T19:33:30.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fd3f8700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f83f80b72e0 0x7f83f80b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55372/0 (socket says 172.21.2.137:55372) 2021-11-15T19:33:30.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fd3f8700 1 -- 172.21.2.137:0/2774599349 learned_addr learned my addr 172.21.2.137:0/2774599349 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:30.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242719180 0 0) 0x7f83f812a170 con 0x7f83f80b72e0 2021-11-15T19:33:30.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e0003260 con 0x7f83f80b72e0 2021-11-15T19:33:30.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- 172.21.2.137:0/2774599349 >> v2:172.21.2.111:3300/0 conn(0x7f83f80ad320 0x7f83f814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.0 v1:172.21.2.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993624065 0 0) 0x7f83f80b76c0 con 0x7f83f80acd60 2021-11-15T19:33:30.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 --> v1:172.21.2.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f812a170 con 0x7f83f80acd60 2021-11-15T19:33:30.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2509243736 0 0) 0x7f83e0003260 con 0x7f83f80b72e0 2021-11-15T19:33:30.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 >> v2:172.21.2.111:3300/0 conn(0x7f83f80ad320 msgr2=0x7f83f814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 --2- 172.21.2.137:0/2774599349 >> v2:172.21.2.111:3300/0 conn(0x7f83f80ad320 0x7f83f814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 >> v1:172.21.2.111:6789/0 conn(0x7f83f80acd60 legacy=0x7f83f80b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80ad8a0 con 0x7f83f80b72e0 2021-11-15T19:33:30.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f83ec0015e0 con 0x7f83f80b72e0 2021-11-15T19:33:30.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 >> v1:172.21.2.137:6789/0 conn(0x7f83f80b72e0 legacy=0x7f83f80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83e0003930 0x7f83e0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83e0004500 0x7f83e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004e70 0x7f83e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80b3100 con 0x7f83e0004e70 2021-11-15T19:33:30.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e000bd20 con 0x7f83e0004500 2021-11-15T19:33:30.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e000bee0 con 0x7f83e0003930 2021-11-15T19:33:30.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83e0004500 0x7f83e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004e70 0x7f83e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fd3f8700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83e0003930 0x7f83e0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 -- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83e0003930 msgr2=0x7f83e0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83e0003930 0x7f83e0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 -- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004e70 msgr2=0x7f83e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:30.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004e70 0x7f83e000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 -- 172.21.2.137:0/2774599349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0003260 con 0x7f83e0004500 2021-11-15T19:33:30.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 -- 172.21.2.137:0/2774599349 reap_dead start 2021-11-15T19:33:30.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83e0004500 0x7f83e0004980 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f83f4001110 tx=0x7f83f4007a00).ready entity=mon.1 client_cookie=dad351a3e3dff65b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f4007d10 con 0x7f83e0004500 2021-11-15T19:33:30.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4007030 con 0x7f83e0004500 2021-11-15T19:33:30.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ebfff700 1 -- 172.21.2.137:0/2774599349 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f4007390 con 0x7f83e0004500 2021-11-15T19:33:30.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/2774599349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83e0004500 msgr2=0x7f83e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83e0004500 0x7f83e0004980 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f83f4001110 tx=0x7f83f4007a00).stop 2021-11-15T19:33:30.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/2774599349 shutdown_connections 2021-11-15T19:33:30.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 --2- 172.21.2.137:0/2774599349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83e0004500 0x7f83e0004980 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/2774599349 >> 172.21.2.137:0/2774599349 conn(0x7f83f8064960 msgr2=0x7f83f8064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:30.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/2774599349 shutdown_connections 2021-11-15T19:33:30.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/2774599349 wait complete. 2021-11-15T19:33:30.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 Processor -- start 2021-11-15T19:33:30.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- start start 2021-11-15T19:33:30.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004500 0x7f83f8129670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83f813f910 0x7f83f8129b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 0x7f83f81277f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80b20c0 con 0x7f83e0004500 2021-11-15T19:33:30.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8125b10 con 0x7f83f8127340 2021-11-15T19:33:30.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81263f0 con 0x7f83f813f910 2021-11-15T19:33:30.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 0x7f83f81277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 0x7f83f81277f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36604/0 (socket says 172.21.2.137:36604) 2021-11-15T19:33:30.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 -- 172.21.2.137:0/4003002774 learned_addr learned my addr 172.21.2.137:0/4003002774 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:30.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fd3f8700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004500 0x7f83f8129670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fcbf7700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83f813f910 0x7f83f8129b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 -- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83f813f910 msgr2=0x7f83f8129b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83f813f910 0x7f83f8129b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 -- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004500 msgr2=0x7f83f8129670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:30.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004500 0x7f83f8129670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:30.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 -- 172.21.2.137:0/4003002774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8140230 con 0x7f83f8127340 2021-11-15T19:33:30.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fdbf9700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 0x7f83f81277f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f83f000b000 tx=0x7f83f0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0013550 con 0x7f83f8127340 2021-11-15T19:33:30.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00136b0 con 0x7f83f8127340 2021-11-15T19:33:30.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0013a10 con 0x7f83f8127340 2021-11-15T19:33:30.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f81404d0 con 0x7f83f8127340 2021-11-15T19:33:30.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f8126b90 con 0x7f83f8127340 2021-11-15T19:33:30.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f8126160 con 0x7f83f8127340 2021-11-15T19:33:30.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83f001d030 con 0x7f83f8127340 2021-11-15T19:33:30.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ea7fc700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83d8053600 0x7f83d8055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:30.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f83f006b770 con 0x7f83f8127340 2021-11-15T19:33:30.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.385+0000 7f83fd3f8700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83d8053600 0x7f83d8055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:30.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.393+0000 7f83fd3f8700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83d8053600 0x7f83d8055ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f83ec00d000 tx=0x7f83ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:30.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.393+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83f8126160 con 0x7f83f8127340 2021-11-15T19:33:30.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:30.473+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f83f8126160 con 0x7f83f8127340 2021-11-15T19:33:31.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ea7fc700 1 -- 172.21.2.137:0/4003002774 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v80) v1 ==== 133+0+0 (secure 0 0 0) 0x7f83f8126160 con 0x7f83f8127340 2021-11-15T19:33:31.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83d8053600 msgr2=0x7f83d8055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:31.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83d8053600 0x7f83d8055ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f83ec00d000 tx=0x7f83ec009040).stop 2021-11-15T19:33:31.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 msgr2=0x7f83f81277f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:31.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 0x7f83f81277f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f83f000b000 tx=0x7f83f0008040).stop 2021-11-15T19:33:31.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 shutdown_connections 2021-11-15T19:33:31.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83d8053600 0x7f83d8055ac0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83f8127340 0x7f83f81277f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83f813f910 0x7f83f8129b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 --2- 172.21.2.137:0/4003002774 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83e0004500 0x7f83f8129670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 >> 172.21.2.137:0/4003002774 conn(0x7f83f8064960 msgr2=0x7f83f8140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:31.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 shutdown_connections 2021-11-15T19:33:31.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.361+0000 7f83ff65c700 1 -- 172.21.2.137:0/4003002774 wait complete. 2021-11-15T19:33:31.374 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:33:31.377 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:33:31.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 Processor -- start 2021-11-15T19:33:31.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- start start 2021-11-15T19:33:31.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f41600b00a0 0x7f416013c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160066270 con 0x7f4160065730 2021-11-15T19:33:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160065fd0 con 0x7f4160065b10 2021-11-15T19:33:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160067410 con 0x7f41600b00a0 2021-11-15T19:33:31.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4164c18700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4160065b10 0x7f416005bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55392/0 (socket says 172.21.2.137:55392) 2021-11-15T19:33:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4164c18700 1 -- 172.21.2.137:0/1152011109 learned_addr learned my addr 172.21.2.137:0/1152011109 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775780877 0 0) 0x7f4160065fd0 con 0x7f4160065b10 2021-11-15T19:33:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4148003260 con 0x7f4160065b10 2021-11-15T19:33:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165c1a700 1 --2- 172.21.2.137:0/1152011109 >> v2:172.21.2.111:3300/0 conn(0x7f41600b00a0 0x7f416013c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:31.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3435174084 0 0) 0x7f4148003260 con 0x7f4160065b10 2021-11-15T19:33:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 >> v2:172.21.2.111:3300/0 conn(0x7f41600b00a0 msgr2=0x7f416013c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 --2- 172.21.2.137:0/1152011109 >> v2:172.21.2.111:3300/0 conn(0x7f41600b00a0 0x7f416013c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 >> v1:172.21.2.111:6789/0 conn(0x7f4160065730 legacy=0x7f416013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:31.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160066f70 con 0x7f4160065b10 2021-11-15T19:33:31.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4150001660 con 0x7f4160065b10 2021-11-15T19:33:31.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 >> v1:172.21.2.137:6789/0 conn(0x7f4160065b10 legacy=0x7f416005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:31.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f4148003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4148004500 0x7f4148004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4148004ec0 0x7f414800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160067410 con 0x7f4148004500 2021-11-15T19:33:31.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bd80 con 0x7f4148003750 2021-11-15T19:33:31.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bf40 con 0x7f4148004ec0 2021-11-15T19:33:31.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f4148003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:31.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4164c18700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4148004500 0x7f4148004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:31.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 -- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4148004ec0 msgr2=0x7f414800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:31.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4148004ec0 0x7f414800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:31.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 -- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4148004500 msgr2=0x7f4148004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:31.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4148004500 0x7f4148004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 -- 172.21.2.137:0/1152011109 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148003260 con 0x7f4148003750 2021-11-15T19:33:31.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165c1a700 1 -- 172.21.2.137:0/1152011109 reap_dead start 2021-11-15T19:33:31.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f4165419700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f4148003b50 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f415c001fa0 tx=0x7f415c007a00).ready entity=mon.1 client_cookie=247ac79d5fa4b9c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:31.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c007070 con 0x7f4148003750 2021-11-15T19:33:31.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0071d0 con 0x7f4148003750 2021-11-15T19:33:31.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f414ffff700 1 -- 172.21.2.137:0/1152011109 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c006510 con 0x7f4148003750 2021-11-15T19:33:31.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- 172.21.2.137:0/1152011109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 msgr2=0x7f4148003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:31.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f4148003b50 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f415c001fa0 tx=0x7f415c007a00).stop 2021-11-15T19:33:31.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- 172.21.2.137:0/1152011109 shutdown_connections 2021-11-15T19:33:31.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 --2- 172.21.2.137:0/1152011109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f4148003b50 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- 172.21.2.137:0/1152011109 >> 172.21.2.137:0/1152011109 conn(0x7f4160060290 msgr2=0x7f4160060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:31.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- 172.21.2.137:0/1152011109 shutdown_connections 2021-11-15T19:33:31.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.421+0000 7f416767d700 1 -- 172.21.2.137:0/1152011109 wait complete. 2021-11-15T19:33:31.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 Processor -- start 2021-11-15T19:33:31.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- start start 2021-11-15T19:33:31.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f41600b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41601553d0 0x7f416010f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416010f9f0 0x7f41600ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160140480 con 0x7f416010f9f0 2021-11-15T19:33:31.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416010f0d0 con 0x7f4148003750 2021-11-15T19:33:31.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160155850 con 0x7f41601553d0 2021-11-15T19:33:31.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f41600b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:31.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f41600b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36620/0 (socket says 172.21.2.137:36620) 2021-11-15T19:33:31.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 -- 172.21.2.137:0/3456864632 learned_addr learned my addr 172.21.2.137:0/3456864632 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:31.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 -- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41601553d0 msgr2=0x7f416010f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:31.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41601553d0 0x7f416010f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:31.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 -- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416010f9f0 msgr2=0x7f41600ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:31.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165c1a700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416010f9f0 0x7f41600ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:31.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416010f9f0 0x7f41600ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:31.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 -- 172.21.2.137:0/3456864632 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160140d20 con 0x7f4148003750 2021-11-15T19:33:31.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4165419700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f41600b4310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f415c008fc0 tx=0x7f415c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:31.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c014620 con 0x7f4148003750 2021-11-15T19:33:31.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c000e90 con 0x7f4148003750 2021-11-15T19:33:31.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416010fe70 con 0x7f4148003750 2021-11-15T19:33:31.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c014970 con 0x7f4148003750 2021-11-15T19:33:31.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41600aece0 con 0x7f4148003750 2021-11-15T19:33:31.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41600b0fb0 con 0x7f4148003750 2021-11-15T19:33:31.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f415c029030 con 0x7f4148003750 2021-11-15T19:33:31.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f414e7fc700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4140053580 0x7f4140055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:31.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f415c06cb20 con 0x7f4148003750 2021-11-15T19:33:31.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.425+0000 7f4164c18700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4140053580 0x7f4140055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:31.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.429+0000 7f4164c18700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4140053580 0x7f4140055a40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f4150008000 tx=0x7f4150009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:31.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.429+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f415c043e50 con 0x7f4148003750 2021-11-15T19:33:31.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:31.513+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f416010f210 con 0x7f4148003750 2021-11-15T19:33:32.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f414e7fc700 1 -- 172.21.2.137:0/3456864632 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v81) v1 ==== 125+0+0 (secure 0 0 0) 0x7f415c047470 con 0x7f4148003750 2021-11-15T19:33:32.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4140053580 msgr2=0x7f4140055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4140053580 0x7f4140055a40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f4150008000 tx=0x7f4150009040).stop 2021-11-15T19:33:32.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 msgr2=0x7f41600b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f41600b4310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f415c008fc0 tx=0x7f415c015000).stop 2021-11-15T19:33:32.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 shutdown_connections 2021-11-15T19:33:32.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4140053580 0x7f4140055a40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f416010f9f0 0x7f41600ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f41601553d0 0x7f416010f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.365+0000 7f416767d700 1 --2- 172.21.2.137:0/3456864632 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4148003750 0x7f41600b4310 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.369+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 >> 172.21.2.137:0/3456864632 conn(0x7f4160060290 msgr2=0x7f41600b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.369+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 shutdown_connections 2021-11-15T19:33:32.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.369+0000 7f416767d700 1 -- 172.21.2.137:0/3456864632 wait complete. 2021-11-15T19:33:32.379 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:33:32.383 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:33:32.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 Processor -- start 2021-11-15T19:33:32.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 -- start start 2021-11-15T19:33:32.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 0x7fea4c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fea4c0b0830 0x7fea4c0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4c147f70 con 0x7fea4c0b10b0 2021-11-15T19:33:32.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4c060100 con 0x7fea4c0b0830 2021-11-15T19:33:32.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea53020700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c147cd0 con 0x7fea4c05fd20 2021-11-15T19:33:32.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fea4c0b10b0 0x7fea4c0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55410/0 (socket says 172.21.2.137:55410) 2021-11-15T19:33:32.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4bfff700 1 -- 172.21.2.137:0/2929000109 learned_addr learned my addr 172.21.2.137:0/2929000109 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:32.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128819148 0 0) 0x7fea4c147f70 con 0x7fea4c0b10b0 2021-11-15T19:33:32.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea38003260 con 0x7fea4c0b10b0 2021-11-15T19:33:32.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea50dbc700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 0x7fea4c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea515bd700 1 --2- 172.21.2.137:0/2929000109 >> v2:172.21.2.111:3300/0 conn(0x7fea4c0b0830 0x7fea4c0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070254091 0 0) 0x7fea38003260 con 0x7fea4c0b10b0 2021-11-15T19:33:32.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 msgr2=0x7fea4c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 0x7fea4c0af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 >> v2:172.21.2.111:3300/0 conn(0x7fea4c0b0830 msgr2=0x7fea4c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 --2- 172.21.2.137:0/2929000109 >> v2:172.21.2.111:3300/0 conn(0x7fea4c0b0830 0x7fea4c0aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0a9ed0 con 0x7fea4c0b10b0 2021-11-15T19:33:32.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fea40001660 con 0x7fea4c0b10b0 2021-11-15T19:33:32.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 >> v1:172.21.2.137:6789/0 conn(0x7fea4c0b10b0 legacy=0x7fea4c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 0x7fea380037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea38003e00 0x7fea38004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.425+0000 7fea4b7fe700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea380049f0 0x7fea38004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c060100 con 0x7fea380049f0 2021-11-15T19:33:32.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c147cd0 con 0x7fea38003e00 2021-11-15T19:33:32.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3800b8e0 con 0x7fea4c05fd20 2021-11-15T19:33:32.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea38003e00 0x7fea38004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea50dbc700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 0x7fea380037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea380049f0 0x7fea38004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 -- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 msgr2=0x7fea380037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea4c05fd20 0x7fea380037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 -- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea380049f0 msgr2=0x7fea38004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea380049f0 0x7fea38004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 -- 172.21.2.137:0/2929000109 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38003260 con 0x7fea38003e00 2021-11-15T19:33:32.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea38003e00 0x7fea38004500 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fea40001370 tx=0x7fea4c0b5e40).ready entity=mon.1 client_cookie=e706190866965511 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea400070d0 con 0x7fea38003e00 2021-11-15T19:33:32.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40007230 con 0x7fea38003e00 2021-11-15T19:33:32.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4b7fe700 1 -- 172.21.2.137:0/2929000109 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea4000c8c0 con 0x7fea38003e00 2021-11-15T19:33:32.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/2929000109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea38003e00 msgr2=0x7fea38004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 --2- 172.21.2.137:0/2929000109 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea38003e00 0x7fea38004500 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fea40001370 tx=0x7fea4c0b5e40).stop 2021-11-15T19:33:32.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 -- 172.21.2.137:0/2929000109 reap_dead start 2021-11-15T19:33:32.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/2929000109 shutdown_connections 2021-11-15T19:33:32.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/2929000109 >> 172.21.2.137:0/2929000109 conn(0x7fea4c0b4e60 msgr2=0x7fea4c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/2929000109 shutdown_connections 2021-11-15T19:33:32.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/2929000109 wait complete. 2021-11-15T19:33:32.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 Processor -- start 2021-11-15T19:33:32.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- start start 2021-11-15T19:33:32.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea38003e00 0x7fea4c063830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea4c13f590 0x7fea4c141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 0x7fea4c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1567b0 con 0x7fea4c13f590 2021-11-15T19:33:32.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c156a50 con 0x7fea4c157190 2021-11-15T19:33:32.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c156cf0 con 0x7fea38003e00 2021-11-15T19:33:32.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 0x7fea4c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 0x7fea4c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36644/0 (socket says 172.21.2.137:36644) 2021-11-15T19:33:32.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 -- 172.21.2.137:0/1629025042 learned_addr learned my addr 172.21.2.137:0/1629025042 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:32.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea50dbc700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea38003e00 0x7fea4c063830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea4bfff700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea4c13f590 0x7fea4c141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 -- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea38003e00 msgr2=0x7fea4c063830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea38003e00 0x7fea4c063830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 -- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea4c13f590 msgr2=0x7fea4c141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea4c13f590 0x7fea4c141840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 -- 172.21.2.137:0/1629025042 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c141d30 con 0x7fea4c157190 2021-11-15T19:33:32.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea515bd700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 0x7fea4c159bf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fea4400d000 tx=0x7fea44008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea440126d0 con 0x7fea4c157190 2021-11-15T19:33:32.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400c070 con 0x7fea4c157190 2021-11-15T19:33:32.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c157640 con 0x7fea4c157190 2021-11-15T19:33:32.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea44012a20 con 0x7fea4c157190 2021-11-15T19:33:32.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c15a280 con 0x7fea4c157190 2021-11-15T19:33:32.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.429+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4c156eb0 con 0x7fea4c157190 2021-11-15T19:33:32.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.433+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea44012040 con 0x7fea4c157190 2021-11-15T19:33:32.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.433+0000 7fea49ffb700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea2c0536d0 0x7fea2c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.433+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5953+0+0 (secure 0 0 0) 0x7fea4406b9e0 con 0x7fea4c157190 2021-11-15T19:33:32.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.433+0000 7fea50dbc700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea2c0536d0 0x7fea2c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.433+0000 7fea50dbc700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea2c0536d0 0x7fea2c055b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fea3c00c000 tx=0x7fea3c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.433+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea44042aa0 con 0x7fea4c157190 2021-11-15T19:33:32.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.545+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fea4c0573d0 con 0x7fea4c157190 2021-11-15T19:33:32.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.553+0000 7fea49ffb700 1 -- 172.21.2.137:0/1629025042 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v36) v1 ==== 189+0+0 (secure 0 0 0) 0x7fea440460c0 con 0x7fea4c157190 2021-11-15T19:33:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea2c0536d0 msgr2=0x7fea2c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea2c0536d0 0x7fea2c055b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fea3c00c000 tx=0x7fea3c008040).stop 2021-11-15T19:33:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 msgr2=0x7fea4c159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 0x7fea4c159bf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fea4400d000 tx=0x7fea44008040).stop 2021-11-15T19:33:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 shutdown_connections 2021-11-15T19:33:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea2c0536d0 0x7fea2c055b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fea4c157190 0x7fea4c159bf0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fea4c13f590 0x7fea4c141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 --2- 172.21.2.137:0/1629025042 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fea38003e00 0x7fea4c063830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 >> 172.21.2.137:0/1629025042 conn(0x7fea4c0b4e60 msgr2=0x7fea4c0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 shutdown_connections 2021-11-15T19:33:32.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.557+0000 7fea53020700 1 -- 172.21.2.137:0/1629025042 wait complete. 2021-11-15T19:33:32.568 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 15 and data pool 16 2021-11-15T19:33:32.571 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:32.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 Processor -- start 2021-11-15T19:33:32.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- start start 2021-11-15T19:33:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3eec13f890 0x7f3eec0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 0x7f3eec05fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec060070 con 0x7f3eec0608f0 2021-11-15T19:33:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0ad6c0 con 0x7f3eec13f890 2021-11-15T19:33:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0b1b50 con 0x7f3eec05f730 2021-11-15T19:33:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeb7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3eec13f890 0x7f3eec0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eebfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3eec0608f0 0x7f3eec0b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55440/0 (socket says 172.21.2.137:55440) 2021-11-15T19:33:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eebfff700 1 -- 172.21.2.137:0/1170749976 learned_addr learned my addr 172.21.2.137:0/1170749976 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeb7fe700 1 -- 172.21.2.137:0/1170749976 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 msgr2=0x7f3eec05fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeb7fe700 1 --2- 172.21.2.137:0/1170749976 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 0x7f3eec05fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeb7fe700 1 -- 172.21.2.137:0/1170749976 >> v1:172.21.2.137:6789/0 conn(0x7f3eec0608f0 legacy=0x7f3eec0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeb7fe700 1 -- 172.21.2.137:0/1170749976 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0b0c80 con 0x7f3eec13f890 2021-11-15T19:33:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeb7fe700 1 --2- 172.21.2.137:0/1170749976 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec0b1660 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f3ed4002f70 tx=0x7f3ed4006df0).ready entity=mon.1 client_cookie=4486b26cbc3f2ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeaffd700 1 -- 172.21.2.137:0/1170749976 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed400d570 con 0x7f3eec13f890 2021-11-15T19:33:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeaffd700 1 -- 172.21.2.137:0/1170749976 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4000e90 con 0x7f3eec13f890 2021-11-15T19:33:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3eeaffd700 1 -- 172.21.2.137:0/1170749976 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed400d900 con 0x7f3eec13f890 2021-11-15T19:33:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- 172.21.2.137:0/1170749976 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 msgr2=0x7f3eec0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 --2- 172.21.2.137:0/1170749976 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec0b1660 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f3ed4002f70 tx=0x7f3ed4006df0).stop 2021-11-15T19:33:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- 172.21.2.137:0/1170749976 shutdown_connections 2021-11-15T19:33:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 --2- 172.21.2.137:0/1170749976 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec0b1660 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 --2- 172.21.2.137:0/1170749976 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 0x7f3eec05fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- 172.21.2.137:0/1170749976 >> 172.21.2.137:0/1170749976 conn(0x7f3eec063980 msgr2=0x7f3eec063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- 172.21.2.137:0/1170749976 shutdown_connections 2021-11-15T19:33:32.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.613+0000 7f3ef2341700 1 -- 172.21.2.137:0/1170749976 wait complete. 2021-11-15T19:33:32.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 Processor -- start 2021-11-15T19:33:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- start start 2021-11-15T19:33:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 0x7f3eec13c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3eec0608f0 0x7f3eec065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec1434e0 con 0x7f3eec0608f0 2021-11-15T19:33:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec143180 con 0x7f3eec13f890 2021-11-15T19:33:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec141e10 con 0x7f3eec05f730 2021-11-15T19:33:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec1425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36666/0 (socket says 172.21.2.137:36666) 2021-11-15T19:33:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 -- 172.21.2.137:0/3202386869 learned_addr learned my addr 172.21.2.137:0/3202386869 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 -- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 msgr2=0x7f3eec13c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 0x7f3eec13c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 -- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3eec0608f0 msgr2=0x7f3eec065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3eec0608f0 0x7f3eec065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 -- 172.21.2.137:0/3202386869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed400b180 con 0x7f3eec13f890 2021-11-15T19:33:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef08de700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec1425d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f3eec067130 tx=0x7f3ee40090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee400d4a0 con 0x7f3eec13f890 2021-11-15T19:33:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400d600 con 0x7f3eec13f890 2021-11-15T19:33:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec13c0b0 con 0x7f3eec13f890 2021-11-15T19:33:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee400d9a0 con 0x7f3eec13f890 2021-11-15T19:33:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec066790 con 0x7f3eec13f890 2021-11-15T19:33:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec142010 con 0x7f3eec13f890 2021-11-15T19:33:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ee4018030 con 0x7f3eec13f890 2021-11-15T19:33:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ee97fa700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ed0053610 0x7f3ed0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3ee406bc20 con 0x7f3eec13f890 2021-11-15T19:33:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3eebfff700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ed0053610 0x7f3ed0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.617+0000 7f3eebfff700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ed0053610 0x7f3ed0055ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f3eec0b3ac0 tx=0x7f3edc007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.621+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ee4042480 con 0x7f3eec13f890 2021-11-15T19:33:32.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.705+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3eec143890 con 0x7f3eec13f890 2021-11-15T19:33:32.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.705+0000 7f3ee97fa700 1 -- 172.21.2.137:0/3202386869 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f3ee4023ed0 con 0x7f3eec13f890 2021-11-15T19:33:32.719 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:32.719 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":83,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:32.554728+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:30.496786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:31.537268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:32.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.705+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ed0053610 msgr2=0x7f3ed0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.705+0000 7f3ef2341700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ed0053610 0x7f3ed0055ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f3eec0b3ac0 tx=0x7f3edc007860).stop 2021-11-15T19:33:32.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.705+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 msgr2=0x7f3eec1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.705+0000 7f3ef2341700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec1425d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f3eec067130 tx=0x7f3ee40090f0).stop 2021-11-15T19:33:32.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 shutdown_connections 2021-11-15T19:33:32.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ed0053610 0x7f3ed0055ad0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3eec13f890 0x7f3eec1425d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3eec0608f0 0x7f3eec065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 --2- 172.21.2.137:0/3202386869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3eec05f730 0x7f3eec13c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 >> 172.21.2.137:0/3202386869 conn(0x7f3eec063980 msgr2=0x7f3eec0ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 shutdown_connections 2021-11-15T19:33:32.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.709+0000 7f3ef2341700 1 -- 172.21.2.137:0/3202386869 wait complete. 2021-11-15T19:33:32.724 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:32.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d2c04f700 1 Processor -- start 2021-11-15T19:33:32.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d2c04f700 1 -- start start 2021-11-15T19:33:32.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d2c04f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 0x7f6d24147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d2c04f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d24148190 con 0x7f6d240a9f50 2021-11-15T19:33:32.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d2c04f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d240b1720 con 0x7f6d24143f00 2021-11-15T19:33:32.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d2c04f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24147e70 con 0x7f6d240b1340 2021-11-15T19:33:32.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d295ea700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6d24143f00 0x7f6d24144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55456/0 (socket says 172.21.2.137:55456) 2021-11-15T19:33:32.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d295ea700 1 -- 172.21.2.137:0/2771451090 learned_addr learned my addr 172.21.2.137:0/2771451090 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221561401 0 0) 0x7f6d240b1720 con 0x7f6d24143f00 2021-11-15T19:33:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.765+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d0c003260 con 0x7f6d24143f00 2021-11-15T19:33:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 0x7f6d24147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3345472751 0 0) 0x7f6d0c003260 con 0x7f6d24143f00 2021-11-15T19:33:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 msgr2=0x7f6d24147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 0x7f6d24147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 >> v1:172.21.2.111:6789/0 conn(0x7f6d240a9f50 legacy=0x7f6d240aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240af800 con 0x7f6d24143f00 2021-11-15T19:33:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6d20001660 con 0x7f6d24143f00 2021-11-15T19:33:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 >> v1:172.21.2.137:6789/0 conn(0x7f6d24143f00 legacy=0x7f6d24144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d0c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 0x7f6d0c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d0c0049f0 0x7f6d0c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24147e70 con 0x7f6d0c0049f0 2021-11-15T19:33:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00b800 con 0x7f6d0c003750 2021-11-15T19:33:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00b9c0 con 0x7f6d240b1340 2021-11-15T19:33:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d0c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 msgr2=0x7f6d0c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d240b1340 0x7f6d0c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d0c0049f0 msgr2=0x7f6d0c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d0c0049f0 0x7f6d0c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2771451090 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c003260 con 0x7f6d0c003750 2021-11-15T19:33:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d0c003b70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f6d1400a000 tx=0x7f6d14008040).ready entity=mon.1 client_cookie=cd0d935c38580f6a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d14013670 con 0x7f6d0c003750 2021-11-15T19:33:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d140137d0 con 0x7f6d0c003750 2021-11-15T19:33:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d28de9700 1 -- 172.21.2.137:0/2771451090 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d14013b30 con 0x7f6d0c003750 2021-11-15T19:33:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2771451090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 msgr2=0x7f6d0c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2771451090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d0c003b70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f6d1400a000 tx=0x7f6d14008040).stop 2021-11-15T19:33:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2a5ec700 1 -- 172.21.2.137:0/2771451090 reap_dead start 2021-11-15T19:33:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2771451090 shutdown_connections 2021-11-15T19:33:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2771451090 >> 172.21.2.137:0/2771451090 conn(0x7f6d240b4e60 msgr2=0x7f6d240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2771451090 shutdown_connections 2021-11-15T19:33:32.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2771451090 wait complete. 2021-11-15T19:33:32.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 Processor -- start 2021-11-15T19:33:32.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- start start 2021-11-15T19:33:32.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d24156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d24143670 0x7f6d240996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d24140990 0x7f6d24140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24144e50 con 0x7f6d24140990 2021-11-15T19:33:32.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24142540 con 0x7f6d0c003750 2021-11-15T19:33:32.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24140530 con 0x7f6d24143670 2021-11-15T19:33:32.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d24156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d24156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36684/0 (socket says 172.21.2.137:36684) 2021-11-15T19:33:32.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2686873152 learned_addr learned my addr 172.21.2.137:0/2686873152 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:32.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d24143670 msgr2=0x7f6d240996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d295ea700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d24143670 0x7f6d240996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d24143670 0x7f6d240996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d24140990 msgr2=0x7f6d24140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d24140990 0x7f6d24140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 -- 172.21.2.137:0/2686873152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24142770 con 0x7f6d0c003750 2021-11-15T19:33:32.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d295ea700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d24143670 0x7f6d240996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:32.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d29deb700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d24156790 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f6d24142a10 tx=0x7f6d14008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d14012d60 con 0x7f6d0c003750 2021-11-15T19:33:32.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d14000e90 con 0x7f6d0c003750 2021-11-15T19:33:32.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d1401d600 con 0x7f6d0c003750 2021-11-15T19:33:32.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d24141300 con 0x7f6d0c003750 2021-11-15T19:33:32.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.769+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d24141a60 con 0x7f6d0c003750 2021-11-15T19:33:32.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2405faf0 con 0x7f6d0c003750 2021-11-15T19:33:32.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d1401d760 con 0x7f6d0c003750 2021-11-15T19:33:32.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d12ffd700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d040536d0 0x7f6d04055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6d1406d3b0 con 0x7f6d0c003750 2021-11-15T19:33:32.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d295ea700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d040536d0 0x7f6d04055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d295ea700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d040536d0 0x7f6d04055b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f6d20008000 tx=0x7f6d20009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.773+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d14044400 con 0x7f6d0c003750 2021-11-15T19:33:32.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d240573d0 con 0x7f6d0c003750 2021-11-15T19:33:32.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d12ffd700 1 -- 172.21.2.137:0/2686873152 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f6d1400b120 con 0x7f6d0c003750 2021-11-15T19:33:32.868 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:32.868 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":83,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:32.554728+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:30.496786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:31.537268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:32.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d040536d0 msgr2=0x7f6d04055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d040536d0 0x7f6d04055b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f6d20008000 tx=0x7f6d20009040).stop 2021-11-15T19:33:32.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 msgr2=0x7f6d24156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d24156790 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f6d24142a10 tx=0x7f6d14008040).stop 2021-11-15T19:33:32.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 shutdown_connections 2021-11-15T19:33:32.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6d040536d0 0x7f6d04055b90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6d24140990 0x7f6d24140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6d24143670 0x7f6d240996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 --2- 172.21.2.137:0/2686873152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6d0c003750 0x7f6d24156790 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 >> 172.21.2.137:0/2686873152 conn(0x7f6d240b4e60 msgr2=0x7f6d240b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 shutdown_connections 2021-11-15T19:33:32.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.857+0000 7f6d2c04f700 1 -- 172.21.2.137:0/2686873152 wait complete. 2021-11-15T19:33:32.875 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:33:32.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 Processor -- start 2021-11-15T19:33:32.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- start start 2021-11-15T19:33:32.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc05c770 0x7f48fc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48fc140aa0 0x7f48fc140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc05cb50 con 0x7f48fc0b0550 2021-11-15T19:33:32.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc0b1650 con 0x7f48fc140aa0 2021-11-15T19:33:32.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0ad030 con 0x7f48fc05c770 2021-11-15T19:33:32.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f48fc0b0550 0x7f48fc14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55476/0 (socket says 172.21.2.137:55476) 2021-11-15T19:33:32.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 -- 172.21.2.137:0/1728719675 learned_addr learned my addr 172.21.2.137:0/1728719675 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:32.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48fad9d700 1 --2- 172.21.2.137:0/1728719675 >> v2:172.21.2.137:3300/0 conn(0x7f48fc140aa0 0x7f48fc140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48fad9d700 1 -- 172.21.2.137:0/1728719675 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc05c770 msgr2=0x7f48fc0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:32.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48fad9d700 1 --2- 172.21.2.137:0/1728719675 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc05c770 0x7f48fc0aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48fad9d700 1 -- 172.21.2.137:0/1728719675 >> v1:172.21.2.137:6789/0 conn(0x7f48fc0b0550 legacy=0x7f48fc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48fad9d700 1 -- 172.21.2.137:0/1728719675 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0ad2d0 con 0x7f48fc140aa0 2021-11-15T19:33:32.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48fad9d700 1 --2- 172.21.2.137:0/1728719675 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc140aa0 0x7f48fc140f10 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f48f0001110 tx=0x7f48f40091d0).ready entity=mon.1 client_cookie=b25240f0a3049b1f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f959a700 1 -- 172.21.2.137:0/1728719675 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48f4009ea0 con 0x7f48fc140aa0 2021-11-15T19:33:32.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f959a700 1 -- 172.21.2.137:0/1728719675 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f400b760 con 0x7f48fc140aa0 2021-11-15T19:33:32.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f959a700 1 -- 172.21.2.137:0/1728719675 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48f400b910 con 0x7f48fc140aa0 2021-11-15T19:33:32.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/1728719675 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc140aa0 msgr2=0x7f48fc140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- 172.21.2.137:0/1728719675 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc140aa0 0x7f48fc140f10 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f48f0001110 tx=0x7f48f40091d0).stop 2021-11-15T19:33:32.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/1728719675 shutdown_connections 2021-11-15T19:33:32.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- 172.21.2.137:0/1728719675 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc140aa0 0x7f48fc140f10 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:32.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- 172.21.2.137:0/1728719675 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc05c770 0x7f48fc0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/1728719675 >> 172.21.2.137:0/1728719675 conn(0x7f48fc0631e0 msgr2=0x7f48fc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:32.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/1728719675 shutdown_connections 2021-11-15T19:33:32.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/1728719675 wait complete. 2021-11-15T19:33:32.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 Processor -- start 2021-11-15T19:33:32.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- start start 2021-11-15T19:33:32.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48fc05c770 0x7f48fc147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 0x7f48fc147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc140aa0 0x7f48fc142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc144900 con 0x7f48fc05c770 2021-11-15T19:33:32.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc1439a0 con 0x7f48fc0b0550 2021-11-15T19:33:32.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc143c40 con 0x7f48fc140aa0 2021-11-15T19:33:32.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 0x7f48fc147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 0x7f48fc147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36702/0 (socket says 172.21.2.137:36702) 2021-11-15T19:33:32.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 -- 172.21.2.137:0/3225643891 learned_addr learned my addr 172.21.2.137:0/3225643891 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:32.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 -- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc140aa0 msgr2=0x7f48fc142100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:32.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc140aa0 0x7f48fc142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 -- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48fc05c770 msgr2=0x7f48fc147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:32.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48fc05c770 0x7f48fc147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:32.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 -- 172.21.2.137:0/3225643891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f4009470 con 0x7f48fc0b0550 2021-11-15T19:33:32.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48f9d9b700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 0x7f48fc147490 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f48f00011d0 tx=0x7f48f0007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48f00072e0 con 0x7f48fc0b0550 2021-11-15T19:33:32.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0007440 con 0x7f48fc0b0550 2021-11-15T19:33:32.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48f0005800 con 0x7f48fc0b0550 2021-11-15T19:33:32.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc1405c0 con 0x7f48fc0b0550 2021-11-15T19:33:32.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.925+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc066e70 con 0x7f48fc0b0550 2021-11-15T19:33:32.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc0ae7f0 con 0x7f48fc0b0550 2021-11-15T19:33:32.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f48f0010070 con 0x7f48fc0b0550 2021-11-15T19:33:32.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f48eb7fe700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48d8053660 0x7f48d8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:32.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f48f006b2b0 con 0x7f48fc0b0550 2021-11-15T19:33:32.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f48fa59c700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48d8053660 0x7f48d8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:32.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f48fa59c700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48d8053660 0x7f48d8055b20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f48ec002fb0 tx=0x7f48ec0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:32.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:32.929+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48f0042300 con 0x7f48fc0b0550 2021-11-15T19:33:33.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.037+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f48fc0573d0 con 0x7f48fc0b0550 2021-11-15T19:33:33.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.561+0000 7f48eb7fe700 1 -- 172.21.2.137:0/3225643891 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7f48f0045920 con 0x7f48fc0b0550 2021-11-15T19:33:33.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48d8053660 msgr2=0x7f48d8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48d8053660 0x7f48d8055b20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f48ec002fb0 tx=0x7f48ec0069b0).stop 2021-11-15T19:33:33.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 msgr2=0x7f48fc147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 0x7f48fc147490 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f48f00011d0 tx=0x7f48f0007c00).stop 2021-11-15T19:33:33.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 shutdown_connections 2021-11-15T19:33:33.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f48d8053660 0x7f48d8055b20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48fc140aa0 0x7f48fc142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48fc0b0550 0x7f48fc147490 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 --2- 172.21.2.137:0/3225643891 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48fc05c770 0x7f48fc147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 >> 172.21.2.137:0/3225643891 conn(0x7f48fc0631e0 msgr2=0x7f48fc14bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:33.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 shutdown_connections 2021-11-15T19:33:33.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.565+0000 7f4900f8d700 1 -- 172.21.2.137:0/3225643891 wait complete. 2021-11-15T19:33:33.579 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:33.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f295b509700 1 Processor -- start 2021-11-15T19:33:33.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f295b509700 1 -- start start 2021-11-15T19:33:33.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f295b509700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 0x7f2954069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f295b509700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29540aecf0 con 0x7f29540acab0 2021-11-15T19:33:33.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f295b509700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295413f180 con 0x7f29540af2f0 2021-11-15T19:33:33.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f295b509700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540aef20 con 0x7f29540b1180 2021-11-15T19:33:33.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2959aa6700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f29540af2f0 0x7f2954142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55490/0 (socket says 172.21.2.137:55490) 2021-11-15T19:33:33.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2959aa6700 1 -- 172.21.2.137:0/1190461372 learned_addr learned my addr 172.21.2.137:0/1190461372 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:33.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241532167 0 0) 0x7f294c001490 con 0x7f29540af2f0 2021-11-15T19:33:33.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c003260 con 0x7f29540af2f0 2021-11-15T19:33:33.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 0x7f2954069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 674018563 0 0) 0x7f293c003260 con 0x7f29540af2f0 2021-11-15T19:33:33.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 msgr2=0x7f2954069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 0x7f2954069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 >> v1:172.21.2.111:6789/0 conn(0x7f29540acab0 legacy=0x7f29540b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540b2770 con 0x7f29540af2f0 2021-11-15T19:33:33.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f294c001b70 con 0x7f29540af2f0 2021-11-15T19:33:33.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 >> v1:172.21.2.137:6789/0 conn(0x7f29540af2f0 legacy=0x7f2954142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 0x7f293c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f293c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293c004a40 0x7f293c004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540aef20 con 0x7f293c004a40 2021-11-15T19:33:33.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c00b8e0 con 0x7f293c003d80 2021-11-15T19:33:33.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c00ba70 con 0x7f29540b1180 2021-11-15T19:33:33.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f293c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 -- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 msgr2=0x7f293c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29540b1180 0x7f293c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 -- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293c004a40 msgr2=0x7f293c004ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293c004a40 0x7f293c004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 -- 172.21.2.137:0/1190461372 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c003260 con 0x7f293c003d80 2021-11-15T19:33:33.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.621+0000 7f2958aa4700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f293c004500 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f294400a000 tx=0x7f2944008040).ready entity=mon.1 client_cookie=7da8c97ab1e5f7b2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2944013670 con 0x7f293c003d80 2021-11-15T19:33:33.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29440137d0 con 0x7f293c003d80 2021-11-15T19:33:33.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f2943fff700 1 -- 172.21.2.137:0/1190461372 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2944013b30 con 0x7f293c003d80 2021-11-15T19:33:33.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/1190461372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 msgr2=0x7f293c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 --2- 172.21.2.137:0/1190461372 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f293c004500 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f294400a000 tx=0x7f2944008040).stop 2021-11-15T19:33:33.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f2959aa6700 1 -- 172.21.2.137:0/1190461372 reap_dead start 2021-11-15T19:33:33.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/1190461372 shutdown_connections 2021-11-15T19:33:33.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/1190461372 >> 172.21.2.137:0/1190461372 conn(0x7f29540630f0 msgr2=0x7f29540634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:33.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/1190461372 shutdown_connections 2021-11-15T19:33:33.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/1190461372 wait complete. 2021-11-15T19:33:33.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 Processor -- start 2021-11-15T19:33:33.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- start start 2021-11-15T19:33:33.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f2954146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2954145f00 0x7f2954140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2954140bf0 0x7f29541487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295413dde0 con 0x7f2954140bf0 2021-11-15T19:33:33.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295413ea90 con 0x7f293c003d80 2021-11-15T19:33:33.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295413e550 con 0x7f2954145f00 2021-11-15T19:33:33.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f2954146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f2954146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36718/0 (socket says 172.21.2.137:36718) 2021-11-15T19:33:33.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 -- 172.21.2.137:0/609853877 learned_addr learned my addr 172.21.2.137:0/609853877 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:33.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f2959aa6700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2954140bf0 0x7f29541487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f2958aa4700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2954145f00 0x7f2954140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 -- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2954145f00 msgr2=0x7f2954140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2954145f00 0x7f2954140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 -- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2954140bf0 msgr2=0x7f29541487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2954140bf0 0x7f29541487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 -- 172.21.2.137:0/609853877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295413e7f0 con 0x7f293c003d80 2021-11-15T19:33:33.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29592a5700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f2954146d80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f29540b2bd0 tx=0x7f2950007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f295000ce30 con 0x7f293c003d80 2021-11-15T19:33:33.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2950013450 con 0x7f293c003d80 2021-11-15T19:33:33.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29500137b0 con 0x7f293c003d80 2021-11-15T19:33:33.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295413d970 con 0x7f293c003d80 2021-11-15T19:33:33.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29541465a0 con 0x7f293c003d80 2021-11-15T19:33:33.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2954146b20 con 0x7f293c003d80 2021-11-15T19:33:33.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2950010070 con 0x7f293c003d80 2021-11-15T19:33:33.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29427fc700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f29340536d0 0x7f2934055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.625+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f295006b140 con 0x7f293c003d80 2021-11-15T19:33:33.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.629+0000 7f2958aa4700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f29340536d0 0x7f2934055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.629+0000 7f2958aa4700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f29340536d0 0x7f2934055b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f2944019000 tx=0x7f2944008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.629+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f29500422a0 con 0x7f293c003d80 2021-11-15T19:33:33.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f295405da90 con 0x7f293c003d80 2021-11-15T19:33:33.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f29427fc700 1 -- 172.21.2.137:0/609853877 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f29500458c0 con 0x7f293c003d80 2021-11-15T19:33:33.750 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:33.750 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:33.558072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6577":{"gid":6577,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2662817327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2662817327},{"type":"v1","addr":"172.21.2.137:6833","nonce":2662817327}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:33.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f29340536d0 msgr2=0x7f2934055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f29340536d0 0x7f2934055b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f2944019000 tx=0x7f2944008040).stop 2021-11-15T19:33:33.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 msgr2=0x7f2954146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f2954146d80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f29540b2bd0 tx=0x7f2950007c20).stop 2021-11-15T19:33:33.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 shutdown_connections 2021-11-15T19:33:33.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f29340536d0 0x7f2934055b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2954140bf0 0x7f29541487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2954145f00 0x7f2954140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 --2- 172.21.2.137:0/609853877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f293c003d80 0x7f2954146d80 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 >> 172.21.2.137:0/609853877 conn(0x7f29540630f0 msgr2=0x7f29540b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:33.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 shutdown_connections 2021-11-15T19:33:33.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.741+0000 7f295b509700 1 -- 172.21.2.137:0/609853877 wait complete. 2021-11-15T19:33:33.756 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 37 2021-11-15T19:33:33.758 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:33.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 Processor -- start 2021-11-15T19:33:33.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- start start 2021-11-15T19:33:33.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fac900b3140 0x7fac9009cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac9009ab00 0x7fac90143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9009d190 con 0x7fac9009c8c0 2021-11-15T19:33:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9005fe40 con 0x7fac900b3140 2021-11-15T19:33:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac90099790 con 0x7fac9009ab00 2021-11-15T19:33:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac94dbd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fac9009c8c0 0x7fac9005f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55508/0 (socket says 172.21.2.137:55508) 2021-11-15T19:33:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac94dbd700 1 -- 172.21.2.137:0/1873934876 learned_addr learned my addr 172.21.2.137:0/1873934876 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457940244 0 0) 0x7fac9009d190 con 0x7fac9009c8c0 2021-11-15T19:33:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac70003260 con 0x7fac9009c8c0 2021-11-15T19:33:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4221612086 0 0) 0x7fac70003260 con 0x7fac9009c8c0 2021-11-15T19:33:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac9009ab00 msgr2=0x7fac90143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac9009ab00 0x7fac90143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 >> v2:172.21.2.111:3300/0 conn(0x7fac900b3140 msgr2=0x7fac9009cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 --2- 172.21.2.137:0/1873934876 >> v2:172.21.2.111:3300/0 conn(0x7fac900b3140 0x7fac9009cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900b2940 con 0x7fac9009c8c0 2021-11-15T19:33:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fac80001680 con 0x7fac9009c8c0 2021-11-15T19:33:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 >> v1:172.21.2.137:6789/0 conn(0x7fac9009c8c0 legacy=0x7fac9005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac9009ab00 0x7fac700037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70003ee0 0x7fac70004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac70004bf0 0x7fac7000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9005fe40 con 0x7fac70003ee0 2021-11-15T19:33:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac90099790 con 0x7fac70004bf0 2021-11-15T19:33:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700053a0 con 0x7fac9009ab00 2021-11-15T19:33:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac70004bf0 0x7fac7000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac9009ab00 msgr2=0x7fac700037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac9009ab00 0x7fac700037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70003ee0 msgr2=0x7fac70004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70003ee0 0x7fac70004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/1873934876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70003260 con 0x7fac70004bf0 2021-11-15T19:33:33.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac70004bf0 0x7fac7000b750 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fac880032f0 tx=0x7fac88006f90).ready entity=mon.1 client_cookie=7139310bfea30dda server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8800b460 con 0x7fac70004bf0 2021-11-15T19:33:33.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8800b5c0 con 0x7fac70004bf0 2021-11-15T19:33:33.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8f7fe700 1 -- 172.21.2.137:0/1873934876 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8800b730 con 0x7fac70004bf0 2021-11-15T19:33:33.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/1873934876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac70004bf0 msgr2=0x7fac7000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 --2- 172.21.2.137:0/1873934876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac70004bf0 0x7fac7000b750 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fac880032f0 tx=0x7fac88006f90).stop 2021-11-15T19:33:33.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/1873934876 reap_dead start 2021-11-15T19:33:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/1873934876 shutdown_connections 2021-11-15T19:33:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/1873934876 >> 172.21.2.137:0/1873934876 conn(0x7fac900b45b0 msgr2=0x7fac9005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/1873934876 shutdown_connections 2021-11-15T19:33:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/1873934876 wait complete. 2021-11-15T19:33:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 Processor -- start 2021-11-15T19:33:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- start start 2021-11-15T19:33:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70004bf0 0x7fac900ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac90065370 0x7fac90065e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 0x7fac9013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac90146bc0 con 0x7fac70004bf0 2021-11-15T19:33:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac900adb30 con 0x7fac90066870 2021-11-15T19:33:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900addd0 con 0x7fac90065370 2021-11-15T19:33:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 0x7fac9013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 0x7fac9013eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36742/0 (socket says 172.21.2.137:36742) 2021-11-15T19:33:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/2665626352 learned_addr learned my addr 172.21.2.137:0/2665626352 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac90065370 msgr2=0x7fac90065e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8ffff700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac90065370 0x7fac90065e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac90065370 0x7fac90065e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac94dbd700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70004bf0 0x7fac900ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70004bf0 msgr2=0x7fac900ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70004bf0 0x7fac900ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 -- 172.21.2.137:0/2665626352 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900ae070 con 0x7fac90066870 2021-11-15T19:33:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8ffff700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac90065370 0x7fac90065e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac955be700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 0x7fac9013eec0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fac90064d60 tx=0x7fac88017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac88009370 con 0x7fac90066870 2021-11-15T19:33:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88011a70 con 0x7fac90066870 2021-11-15T19:33:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac88011dd0 con 0x7fac90066870 2021-11-15T19:33:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac90066320 con 0x7fac90066870 2021-11-15T19:33:33.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.801+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9013f3b0 con 0x7fac90066870 2021-11-15T19:33:33.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac90099a30 con 0x7fac90066870 2021-11-15T19:33:33.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac8800f070 con 0x7fac90066870 2021-11-15T19:33:33.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac8dffb700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac74053610 0x7fac74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fac8806cee0 con 0x7fac90066870 2021-11-15T19:33:33.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac94dbd700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac74053610 0x7fac74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac94dbd700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac74053610 0x7fac74055ad0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fac80008000 tx=0x7fac80009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.805+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac88043f70 con 0x7fac90066870 2021-11-15T19:33:33.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.885+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac900573d0 con 0x7fac90066870 2021-11-15T19:33:33.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac8dffb700 1 -- 172.21.2.137:0/2665626352 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fac88047550 con 0x7fac90066870 2021-11-15T19:33:33.897 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:33.897 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":84,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:33.559283+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:30.496786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:31.537268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:33.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac74053610 msgr2=0x7fac74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac74053610 0x7fac74055ad0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fac80008000 tx=0x7fac80009040).stop 2021-11-15T19:33:33.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 msgr2=0x7fac9013eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 0x7fac9013eec0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fac90064d60 tx=0x7fac88017000).stop 2021-11-15T19:33:33.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 shutdown_connections 2021-11-15T19:33:33.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac74053610 0x7fac74055ad0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac90066870 0x7fac9013eec0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac90065370 0x7fac90065e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 --2- 172.21.2.137:0/2665626352 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac70004bf0 0x7fac900ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 >> 172.21.2.137:0/2665626352 conn(0x7fac900b45b0 msgr2=0x7fac9005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:33.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 shutdown_connections 2021-11-15T19:33:33.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.889+0000 7fac97021700 1 -- 172.21.2.137:0/2665626352 wait complete. 2021-11-15T19:33:33.904 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:33:33.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 Processor -- start 2021-11-15T19:33:33.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 -- start start 2021-11-15T19:33:33.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f79240acab0 0x7f79240b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 0x7f79240b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79240aecf0 con 0x7f79240af2f0 2021-11-15T19:33:33.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792413f180 con 0x7f79240acab0 2021-11-15T19:33:33.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7929845700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240aef20 con 0x7f79240b1180 2021-11-15T19:33:33.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f79227fc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 0x7f79240b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f79227fc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 0x7f79240b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:38320/0 (socket says 172.21.2.137:38320) 2021-11-15T19:33:33.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f7922ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f79240acab0 0x7f79240b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f79227fc700 1 -- 172.21.2.137:0/385109819 learned_addr learned my addr 172.21.2.137:0/385109819 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:33.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.949+0000 7f79237fe700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f79240af2f0 0x7f7924142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:48022/0 (socket says 172.21.2.137:48022) 2021-11-15T19:33:33.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f79227fc700 1 -- 172.21.2.137:0/385109819 >> v2:172.21.2.111:3300/0 conn(0x7f79240acab0 msgr2=0x7f79240b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:33.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f79227fc700 1 --2- 172.21.2.137:0/385109819 >> v2:172.21.2.111:3300/0 conn(0x7f79240acab0 0x7f79240b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f79227fc700 1 -- 172.21.2.137:0/385109819 >> v1:172.21.2.111:6789/0 conn(0x7f79240af2f0 legacy=0x7f7924142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f79227fc700 1 -- 172.21.2.137:0/385109819 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240ace90 con 0x7f79240b1180 2021-11-15T19:33:33.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f79227fc700 1 --2- 172.21.2.137:0/385109819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 0x7f79240b2550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7914002f70 tx=0x7f7914006eb0).ready entity=mon.2 client_cookie=1e98abba78027472 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7921ffb700 1 -- 172.21.2.137:0/385109819 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f791400d570 con 0x7f79240b1180 2021-11-15T19:33:33.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7921ffb700 1 -- 172.21.2.137:0/385109819 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914000e90 con 0x7f79240b1180 2021-11-15T19:33:33.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7921ffb700 1 -- 172.21.2.137:0/385109819 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f791400d900 con 0x7f79240b1180 2021-11-15T19:33:33.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- 172.21.2.137:0/385109819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 msgr2=0x7f79240b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 --2- 172.21.2.137:0/385109819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 0x7f79240b2550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7914002f70 tx=0x7f7914006eb0).stop 2021-11-15T19:33:33.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- 172.21.2.137:0/385109819 shutdown_connections 2021-11-15T19:33:33.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 --2- 172.21.2.137:0/385109819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240b1180 0x7f79240b2550 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 --2- 172.21.2.137:0/385109819 >> v2:172.21.2.111:3300/0 conn(0x7f79240acab0 0x7f79240b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:33.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- 172.21.2.137:0/385109819 >> 172.21.2.137:0/385109819 conn(0x7f79240630f0 msgr2=0x7f79240634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:33.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- 172.21.2.137:0/385109819 shutdown_connections 2021-11-15T19:33:33.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- 172.21.2.137:0/385109819 wait complete. 2021-11-15T19:33:33.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 Processor -- start 2021-11-15T19:33:33.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- start start 2021-11-15T19:33:33.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 0x7f79240664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240af2f0 0x7f7924115be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79240b1180 0x7f7924152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79241521a0 con 0x7f79240b1180 2021-11-15T19:33:33.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924118440 con 0x7f79240acab0 2021-11-15T19:33:33.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7929845700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79241523d0 con 0x7f79240af2f0 2021-11-15T19:33:33.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 0x7f79240664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 0x7f79240664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36752/0 (socket says 172.21.2.137:36752) 2021-11-15T19:33:33.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 -- 172.21.2.137:0/2861165470 learned_addr learned my addr 172.21.2.137:0/2861165470 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:33.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 -- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240af2f0 msgr2=0x7f7924115be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240af2f0 0x7f7924115be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 -- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79240b1180 msgr2=0x7f7924152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:33.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79240b1180 0x7f7924152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:33.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.953+0000 7f7922ffd700 1 -- 172.21.2.137:0/2861165470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791400b1e0 con 0x7f79240acab0 2021-11-15T19:33:33.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f7922ffd700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 0x7f79240664a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f790c00d000 tx=0x7f790c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790c00aa20 con 0x7f79240acab0 2021-11-15T19:33:33.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c00ab80 con 0x7f79240acab0 2021-11-15T19:33:33.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790c0113f0 con 0x7f79240acab0 2021-11-15T19:33:33.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79241160d0 con 0x7f79240acab0 2021-11-15T19:33:33.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7924114860 con 0x7f79240acab0 2021-11-15T19:33:33.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79240b1820 con 0x7f79240acab0 2021-11-15T19:33:33.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f790c021070 con 0x7f79240acab0 2021-11-15T19:33:33.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f791bfff700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7908053600 0x7f7908055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:33.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f790c06bcd0 con 0x7f79240acab0 2021-11-15T19:33:33.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f79227fc700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7908053600 0x7f7908055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:33.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.957+0000 7f79227fc700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7908053600 0x7f7908055ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f7914002f70 tx=0x7f7914015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:33.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:33.961+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f790c071020 con 0x7f79240acab0 2021-11-15T19:33:34.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.069+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f79240573d0 con 0x7f79240acab0 2021-11-15T19:33:34.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.081+0000 7f791bfff700 1 -- 172.21.2.137:0/2861165470 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f790c042d20 con 0x7f79240acab0 2021-11-15T19:33:34.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7908053600 msgr2=0x7f7908055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7908053600 0x7f7908055ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f7914002f70 tx=0x7f7914015000).stop 2021-11-15T19:33:34.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 msgr2=0x7f79240664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 0x7f79240664a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f790c00d000 tx=0x7f790c008040).stop 2021-11-15T19:33:34.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 shutdown_connections 2021-11-15T19:33:34.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7908053600 0x7f7908055ac0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79240b1180 0x7f7924152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79240af2f0 0x7f7924115be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 --2- 172.21.2.137:0/2861165470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79240acab0 0x7f79240664a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 >> 172.21.2.137:0/2861165470 conn(0x7f79240630f0 msgr2=0x7f79240b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 shutdown_connections 2021-11-15T19:33:34.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.085+0000 7f7929845700 1 -- 172.21.2.137:0/2861165470 wait complete. 2021-11-15T19:33:34.096 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:33:34.099 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:33:34.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 Processor -- start 2021-11-15T19:33:34.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- start start 2021-11-15T19:33:34.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f06a805fd20 0x7f06a80af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 0x7f06a80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a8147f70 con 0x7f06a80b10b0 2021-11-15T19:33:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a8060100 con 0x7f06a805fd20 2021-11-15T19:33:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8147cd0 con 0x7f06a80b0830 2021-11-15T19:33:34.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a5d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f06a80b10b0 0x7f06a80b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55546/0 (socket says 172.21.2.137:55546) 2021-11-15T19:33:34.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a5d9b700 1 -- 172.21.2.137:0/3604298041 learned_addr learned my addr 172.21.2.137:0/3604298041 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:34.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425146604 0 0) 0x7f06a8147f70 con 0x7f06a80b10b0 2021-11-15T19:33:34.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0688003260 con 0x7f06a80b10b0 2021-11-15T19:33:34.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a6d9d700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 0x7f06a80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/3604298041 >> v2:172.21.2.111:3300/0 conn(0x7f06a805fd20 0x7f06a80af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048716377 0 0) 0x7f0688003260 con 0x7f06a80b10b0 2021-11-15T19:33:34.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 msgr2=0x7f06a80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 0x7f06a80aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 >> v2:172.21.2.111:3300/0 conn(0x7f06a805fd20 msgr2=0x7f06a80af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 --2- 172.21.2.137:0/3604298041 >> v2:172.21.2.111:3300/0 conn(0x7f06a805fd20 0x7f06a80af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80a9ed0 con 0x7f06a80b10b0 2021-11-15T19:33:34.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f0698001680 con 0x7f06a80b10b0 2021-11-15T19:33:34.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 >> v1:172.21.2.137:6789/0 conn(0x7f06a80b10b0 legacy=0x7f06a80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06880037d0 0x7f0688003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0688004500 0x7f0688004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 0x7f0688004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8060100 con 0x7f0688004500 2021-11-15T19:33:34.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8147cd0 con 0x7f06880037d0 2021-11-15T19:33:34.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068800b750 con 0x7f06a80b0830 2021-11-15T19:33:34.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06880037d0 0x7f0688003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a5d9b700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0688004500 0x7f0688004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a6d9d700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 0x7f0688004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 msgr2=0x7f0688004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a80b0830 0x7f0688004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0688004500 msgr2=0x7f0688004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0688004500 0x7f0688004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/3604298041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688003260 con 0x7f06880037d0 2021-11-15T19:33:34.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a5d9b700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0688004500 0x7f0688004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:33:34.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06880037d0 0x7f0688003bf0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f069000c000 tx=0x7f0690006df0).ready entity=mon.1 client_cookie=cd39208a0e2d68e3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069000e830 con 0x7f06880037d0 2021-11-15T19:33:34.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000e990 con 0x7f06880037d0 2021-11-15T19:33:34.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a559a700 1 -- 172.21.2.137:0/3604298041 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069000ecf0 con 0x7f06880037d0 2021-11-15T19:33:34.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/3604298041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06880037d0 msgr2=0x7f0688003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 --2- 172.21.2.137:0/3604298041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06880037d0 0x7f0688003bf0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f069000c000 tx=0x7f0690006df0).stop 2021-11-15T19:33:34.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a6d9d700 1 -- 172.21.2.137:0/3604298041 reap_dead start 2021-11-15T19:33:34.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/3604298041 shutdown_connections 2021-11-15T19:33:34.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/3604298041 >> 172.21.2.137:0/3604298041 conn(0x7f06a80b4e60 msgr2=0x7f06a80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/3604298041 shutdown_connections 2021-11-15T19:33:34.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/3604298041 wait complete. 2021-11-15T19:33:34.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 Processor -- start 2021-11-15T19:33:34.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- start start 2021-11-15T19:33:34.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 0x7f06a8159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f06a8144720 0x7f06a8066d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a8067250 0x7f06a8063e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8062d20 con 0x7f06a8144720 2021-11-15T19:33:34.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8141aa0 con 0x7f06a8146660 2021-11-15T19:33:34.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a81439c0 con 0x7f06a8067250 2021-11-15T19:33:34.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 0x7f06a8159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 0x7f06a8159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36772/0 (socket says 172.21.2.137:36772) 2021-11-15T19:33:34.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/478142063 learned_addr learned my addr 172.21.2.137:0/478142063 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a5d9b700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f06a8144720 0x7f06a8066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a6d9d700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a8067250 0x7f06a8063e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a8067250 msgr2=0x7f06a8063e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a8067250 0x7f06a8063e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f06a8144720 msgr2=0x7f06a8066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f06a8144720 0x7f06a8066d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 -- 172.21.2.137:0/478142063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a81428a0 con 0x7f06a8146660 2021-11-15T19:33:34.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a6d9d700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a8067250 0x7f06a8063e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:34.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06a659c700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 0x7f06a8159d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f069000c000 tx=0x7f0690019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069001ce50 con 0x7f06a8146660 2021-11-15T19:33:34.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690000e90 con 0x7f06a8146660 2021-11-15T19:33:34.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a81424a0 con 0x7f06a8146660 2021-11-15T19:33:34.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06900245e0 con 0x7f06a8146660 2021-11-15T19:33:34.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a8146be0 con 0x7f06a8146660 2021-11-15T19:33:34.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a81479f0 con 0x7f06a8146660 2021-11-15T19:33:34.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.149+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f069002a020 con 0x7f06a8146660 2021-11-15T19:33:34.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.153+0000 7f069f7fe700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f068c0534f0 0x7f068c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.153+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f069006cef0 con 0x7f06a8146660 2021-11-15T19:33:34.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.153+0000 7f06a5d9b700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f068c0534f0 0x7f068c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.153+0000 7f06a5d9b700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f068c0534f0 0x7f068c0559b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f069800d000 tx=0x7f0698009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.153+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0690044050 con 0x7f06a8146660 2021-11-15T19:33:34.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.265+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f06a80573d0 con 0x7f06a8146660 2021-11-15T19:33:34.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f069f7fe700 1 -- 172.21.2.137:0/478142063 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0690047670 con 0x7f06a8146660 2021-11-15T19:33:34.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f068c0534f0 msgr2=0x7f068c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f068c0534f0 0x7f068c0559b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f069800d000 tx=0x7f0698009040).stop 2021-11-15T19:33:34.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 msgr2=0x7f06a8159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 0x7f06a8159d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f069000c000 tx=0x7f0690019000).stop 2021-11-15T19:33:34.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 shutdown_connections 2021-11-15T19:33:34.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f068c0534f0 0x7f068c0559b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f06a8067250 0x7f06a8063e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f06a8144720 0x7f06a8066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 --2- 172.21.2.137:0/478142063 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06a8146660 0x7f06a8159d00 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 >> 172.21.2.137:0/478142063 conn(0x7f06a80b4e60 msgr2=0x7f06a80aa290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 shutdown_connections 2021-11-15T19:33:34.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.281+0000 7f06acc97700 1 -- 172.21.2.137:0/478142063 wait complete. 2021-11-15T19:33:34.291 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:33:34.293 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:33:34.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 Processor -- start 2021-11-15T19:33:34.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- start start 2021-11-15T19:33:34.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80acab0 0x7f5bd80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5bd80b1180 0x7f5bd80b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5bd80af2f0 0x7f5bd8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80aecf0 con 0x7f5bd80af2f0 2021-11-15T19:33:34.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd813f180 con 0x7f5bd80b1180 2021-11-15T19:33:34.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80aef20 con 0x7f5bd80acab0 2021-11-15T19:33:34.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5bd80b1180 0x7f5bd80b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5bd80b1180 0x7f5bd80b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36782/0 (socket says 172.21.2.137:36782) 2021-11-15T19:33:34.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 -- 172.21.2.137:0/1102564594 learned_addr learned my addr 172.21.2.137:0/1102564594 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 -- 172.21.2.137:0/1102564594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80acab0 msgr2=0x7f5bd80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 --2- 172.21.2.137:0/1102564594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80acab0 0x7f5bd80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 -- 172.21.2.137:0/1102564594 >> v2:172.21.2.111:3300/0 conn(0x7f5bd80af2f0 msgr2=0x7f5bd8142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 --2- 172.21.2.137:0/1102564594 >> v2:172.21.2.111:3300/0 conn(0x7f5bd80af2f0 0x7f5bd8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 -- 172.21.2.137:0/1102564594 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80ace90 con 0x7f5bd80b1180 2021-11-15T19:33:34.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd1f8700 1 --2- 172.21.2.137:0/1102564594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80b1180 0x7f5bd80b2550 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f5bcc002f70 tx=0x7f5bcc006eb0).ready entity=mon.1 client_cookie=45a10be989a73c04 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdc9f7700 1 -- 172.21.2.137:0/1102564594 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bcc010810 con 0x7f5bd80b1180 2021-11-15T19:33:34.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdc9f7700 1 -- 172.21.2.137:0/1102564594 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc000e90 con 0x7f5bd80b1180 2021-11-15T19:33:34.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdc9f7700 1 -- 172.21.2.137:0/1102564594 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bcc010ba0 con 0x7f5bd80b1180 2021-11-15T19:33:34.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1102564594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80b1180 msgr2=0x7f5bd80b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1102564594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80b1180 0x7f5bd80b2550 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f5bcc002f70 tx=0x7f5bcc006eb0).stop 2021-11-15T19:33:34.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1102564594 shutdown_connections 2021-11-15T19:33:34.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1102564594 >> v2:172.21.2.111:3300/0 conn(0x7f5bd80af2f0 0x7f5bd8142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1102564594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80b1180 0x7f5bd80b2550 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1102564594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80acab0 0x7f5bd80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1102564594 >> 172.21.2.137:0/1102564594 conn(0x7f5bd80630f0 msgr2=0x7f5bd80634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1102564594 shutdown_connections 2021-11-15T19:33:34.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1102564594 wait complete. 2021-11-15T19:33:34.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 Processor -- start 2021-11-15T19:33:34.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- start start 2021-11-15T19:33:34.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 0x7f5bd8064ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80af2f0 0x7f5bd8141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5bd80b1180 0x7f5bd8065720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8112220 con 0x7f5bd80b1180 2021-11-15T19:33:34.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81124c0 con 0x7f5bd80acab0 2021-11-15T19:33:34.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdfc5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8142100 con 0x7f5bd80af2f0 2021-11-15T19:33:34.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd9f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 0x7f5bd8064ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd9f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 0x7f5bd8064ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36786/0 (socket says 172.21.2.137:36786) 2021-11-15T19:33:34.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.341+0000 7f5bdd9f9700 1 -- 172.21.2.137:0/1672879788 learned_addr learned my addr 172.21.2.137:0/1672879788 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd9f9700 1 -- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80af2f0 msgr2=0x7f5bd8141c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:34.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd9f9700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80af2f0 0x7f5bd8141c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd9f9700 1 -- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5bd80b1180 msgr2=0x7f5bd8065720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:34.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd9f9700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5bd80b1180 0x7f5bd8065720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd9f9700 1 -- 172.21.2.137:0/1672879788 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc00c2f0 con 0x7f5bd80acab0 2021-11-15T19:33:34.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd9f9700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 0x7f5bd8064ee0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f5bd4002f70 tx=0x7f5bd4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd4013460 con 0x7f5bd80acab0 2021-11-15T19:33:34.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd40135c0 con 0x7f5bd80acab0 2021-11-15T19:33:34.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd4013920 con 0x7f5bd80acab0 2021-11-15T19:33:34.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd8156330 con 0x7f5bd80acab0 2021-11-15T19:33:34.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd810e8f0 con 0x7f5bd80acab0 2021-11-15T19:33:34.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd8066bc0 con 0x7f5bd80acab0 2021-11-15T19:33:34.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5bd400f070 con 0x7f5bd80acab0 2021-11-15T19:33:34.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bcaffd700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5bb80536d0 0x7f5bb8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5bd406b230 con 0x7f5bd80acab0 2021-11-15T19:33:34.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd1f8700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5bb80536d0 0x7f5bb8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.345+0000 7f5bdd1f8700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5bb80536d0 0x7f5bb8055b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f5bcc002f70 tx=0x7f5bcc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.349+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5bd8066bc0 con 0x7f5bd80acab0 2021-11-15T19:33:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.457+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5bd8066bc0 con 0x7f5bd80acab0 2021-11-15T19:33:34.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bcaffd700 1 -- 172.21.2.137:0/1672879788 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5bd8066bc0 con 0x7f5bd80acab0 2021-11-15T19:33:34.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5bb80536d0 msgr2=0x7f5bb8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5bb80536d0 0x7f5bb8055b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f5bcc002f70 tx=0x7f5bcc015000).stop 2021-11-15T19:33:34.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 msgr2=0x7f5bd8064ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 0x7f5bd8064ee0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f5bd4002f70 tx=0x7f5bd4006ec0).stop 2021-11-15T19:33:34.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 shutdown_connections 2021-11-15T19:33:34.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5bb80536d0 0x7f5bb8055b90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5bd80b1180 0x7f5bd8065720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5bd80af2f0 0x7f5bd8141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 --2- 172.21.2.137:0/1672879788 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5bd80acab0 0x7f5bd8064ee0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 >> 172.21.2.137:0/1672879788 conn(0x7f5bd80630f0 msgr2=0x7f5bd8141120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 shutdown_connections 2021-11-15T19:33:34.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.473+0000 7f5bdfc5d700 1 -- 172.21.2.137:0/1672879788 wait complete. 2021-11-15T19:33:34.483 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:33:34.486 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:34.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 Processor -- start 2021-11-15T19:33:34.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 -- start start 2021-11-15T19:33:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f457c13f890 0x7f457c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c05f730 0x7f457c05fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c060070 con 0x7f457c0608f0 2021-11-15T19:33:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c0ad6c0 con 0x7f457c13f890 2021-11-15T19:33:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.525+0000 7f4581f1d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0b1b50 con 0x7f457c05f730 2021-11-15T19:33:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f457c13f890 0x7f457c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f457c13f890 0x7f457c0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36798/0 (socket says 172.21.2.137:36798) 2021-11-15T19:33:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 -- 172.21.2.137:0/3492069270 learned_addr learned my addr 172.21.2.137:0/3492069270 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 -- 172.21.2.137:0/3492069270 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c05f730 msgr2=0x7f457c05fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 --2- 172.21.2.137:0/3492069270 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c05f730 0x7f457c05fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 -- 172.21.2.137:0/3492069270 >> v1:172.21.2.111:6789/0 conn(0x7f457c0608f0 legacy=0x7f457c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 -- 172.21.2.137:0/3492069270 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c0b0c80 con 0x7f457c13f890 2021-11-15T19:33:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457affd700 1 --2- 172.21.2.137:0/3492069270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c13f890 0x7f457c0b1660 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f457c0b3ac0 tx=0x7f456c006eb0).ready entity=mon.1 client_cookie=3b11e25239fc633d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457a7fc700 1 -- 172.21.2.137:0/3492069270 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456c00d570 con 0x7f457c13f890 2021-11-15T19:33:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457a7fc700 1 -- 172.21.2.137:0/3492069270 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c000e90 con 0x7f457c13f890 2021-11-15T19:33:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457a7fc700 1 -- 172.21.2.137:0/3492069270 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456c00d8c0 con 0x7f457c13f890 2021-11-15T19:33:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3492069270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c13f890 msgr2=0x7f457c0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3492069270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c13f890 0x7f457c0b1660 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f457c0b3ac0 tx=0x7f456c006eb0).stop 2021-11-15T19:33:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3492069270 shutdown_connections 2021-11-15T19:33:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3492069270 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c05f730 0x7f457c05fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3492069270 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c13f890 0x7f457c0b1660 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3492069270 >> 172.21.2.137:0/3492069270 conn(0x7f457c063980 msgr2=0x7f457c063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3492069270 shutdown_connections 2021-11-15T19:33:34.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3492069270 wait complete. 2021-11-15T19:33:34.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 Processor -- start 2021-11-15T19:33:34.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- start start 2021-11-15T19:33:34.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 0x7f457c13e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c0608f0 0x7f457c13eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f457c13f890 0x7f457c151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c13d3d0 con 0x7f457c13f890 2021-11-15T19:33:34.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c14e700 con 0x7f457c05f730 2021-11-15T19:33:34.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c14e9a0 con 0x7f457c0608f0 2021-11-15T19:33:34.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 0x7f457c13e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 0x7f457c13e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36800/0 (socket says 172.21.2.137:36800) 2021-11-15T19:33:34.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 -- 172.21.2.137:0/3380280858 learned_addr learned my addr 172.21.2.137:0/3380280858 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 -- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c0608f0 msgr2=0x7f457c13eb20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:34.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c0608f0 0x7f457c13eb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 -- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f457c13f890 msgr2=0x7f457c151250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:34.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f457c13f890 0x7f457c151250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 -- 172.21.2.137:0/3380280858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c00b1e0 con 0x7f457c05f730 2021-11-15T19:33:34.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f457b7fe700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 0x7f457c13e050 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f4564002f90 tx=0x7f4564006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4564013460 con 0x7f457c05f730 2021-11-15T19:33:34.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45640135c0 con 0x7f457c05f730 2021-11-15T19:33:34.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4564013920 con 0x7f457c05f730 2021-11-15T19:33:34.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c143920 con 0x7f457c05f730 2021-11-15T19:33:34.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.529+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c13f010 con 0x7f457c05f730 2021-11-15T19:33:34.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c13aa20 con 0x7f457c05f730 2021-11-15T19:33:34.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f456400f070 con 0x7f457c05f730 2021-11-15T19:33:34.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f4578ff9700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4560053610 0x7f4560055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f456406b2f0 con 0x7f457c05f730 2021-11-15T19:33:34.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f457affd700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4560053610 0x7f4560055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f457affd700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4560053610 0x7f4560055ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f457c0b3ac0 tx=0x7f456c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.533+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4564042340 con 0x7f457c05f730 2021-11-15T19:33:34.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f457c14eb60 con 0x7f457c05f730 2021-11-15T19:33:34.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4578ff9700 1 -- 172.21.2.137:0/3380280858 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f4564045960 con 0x7f457c05f730 2021-11-15T19:33:34.651 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:34.651 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:33.558072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6577":{"gid":6577,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2662817327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2662817327},{"type":"v1","addr":"172.21.2.137:6833","nonce":2662817327}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:34.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4560053610 msgr2=0x7f4560055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4560053610 0x7f4560055ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f457c0b3ac0 tx=0x7f456c015000).stop 2021-11-15T19:33:34.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 msgr2=0x7f457c13e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 0x7f457c13e050 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f4564002f90 tx=0x7f4564006df0).stop 2021-11-15T19:33:34.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 shutdown_connections 2021-11-15T19:33:34.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4560053610 0x7f4560055ad0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f457c13f890 0x7f457c151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f457c0608f0 0x7f457c13eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 --2- 172.21.2.137:0/3380280858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f457c05f730 0x7f457c13e050 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 >> 172.21.2.137:0/3380280858 conn(0x7f457c063980 msgr2=0x7f457c13fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 shutdown_connections 2021-11-15T19:33:34.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.641+0000 7f4581f1d700 1 -- 172.21.2.137:0/3380280858 wait complete. 2021-11-15T19:33:34.655 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 37 2021-11-15T19:33:34.860 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:33:32.554900+0000', 'modified': '2021-11-15T19:33:33.558072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6577': {'gid': 6577, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/2662817327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 2662817327}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 2662817327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:34.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:34.861 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:34.926 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6577,"want_state":"up:active","state":"up:active","rank_uptime":2.3608379469999998,"mdsmap_epoch":37,"osdmap_epoch":84,"osdmap_epoch_barrier":83,"uptime":6.4741074049999998} 2021-11-15T19:33:34.927 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6577, "mdsmap_epoch": 37, "osdmap_epoch": 84, "osdmap_epoch_barrier": 83, "rank_uptime": 2.360837947, "state": "up:active", "uptime": 6.474107405, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:34.927 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:34.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 Processor -- start 2021-11-15T19:33:34.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- start start 2021-11-15T19:33:34.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa444144610 0x7fa444147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4440a9f50 0x7fa4440aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa444148190 con 0x7fa4440b1340 2021-11-15T19:33:34.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4440b1720 con 0x7fa444144610 2021-11-15T19:33:34.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa444147e70 con 0x7fa4440a9f50 2021-11-15T19:33:34.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa444144610 0x7fa444147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa444144610 0x7fa444147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36810/0 (socket says 172.21.2.137:36810) 2021-11-15T19:33:34.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/459628787 learned_addr learned my addr 172.21.2.137:0/459628787 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa443fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa4440b1340 0x7fa444143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55590/0 (socket says 172.21.2.137:55590) 2021-11-15T19:33:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/459628787 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4440a9f50 msgr2=0x7fa4440aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:34.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- 172.21.2.137:0/459628787 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4440a9f50 0x7fa4440aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/459628787 >> v1:172.21.2.137:6789/0 conn(0x7fa4440b1340 legacy=0x7fa444143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/459628787 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440af800 con 0x7fa444144610 2021-11-15T19:33:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- 172.21.2.137:0/459628787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa444144610 0x7fa444147980 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7fa42c0012a0 tx=0x7fa434006eb0).ready entity=mon.1 client_cookie=e6d8aed09c1af8b2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa442ffd700 1 -- 172.21.2.137:0/459628787 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43400d570 con 0x7fa444144610 2021-11-15T19:33:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa442ffd700 1 -- 172.21.2.137:0/459628787 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434000e90 con 0x7fa444144610 2021-11-15T19:33:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa442ffd700 1 -- 172.21.2.137:0/459628787 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43400d900 con 0x7fa444144610 2021-11-15T19:33:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/459628787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa444144610 msgr2=0x7fa444147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- 172.21.2.137:0/459628787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa444144610 0x7fa444147980 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7fa42c0012a0 tx=0x7fa434006eb0).stop 2021-11-15T19:33:34.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/459628787 shutdown_connections 2021-11-15T19:33:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- 172.21.2.137:0/459628787 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa444144610 0x7fa444147980 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- 172.21.2.137:0/459628787 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4440a9f50 0x7fa4440aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/459628787 >> 172.21.2.137:0/459628787 conn(0x7fa4440b4e60 msgr2=0x7fa4440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:34.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/459628787 shutdown_connections 2021-11-15T19:33:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/459628787 wait complete. 2021-11-15T19:33:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 Processor -- start 2021-11-15T19:33:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- start start 2021-11-15T19:33:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4440a9f50 0x7fa44409a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 0x7fa4441401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa444144610 0x7fa44415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440af200 con 0x7fa4440a9f50 2021-11-15T19:33:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440aed00 con 0x7fa4440b1340 2021-11-15T19:33:34.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440aef60 con 0x7fa444144610 2021-11-15T19:33:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 0x7fa4441401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 0x7fa4441401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36816/0 (socket says 172.21.2.137:36816) 2021-11-15T19:33:34.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/2389661377 learned_addr learned my addr 172.21.2.137:0/2389661377 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa444144610 msgr2=0x7fa44415a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa444144610 0x7fa44415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4440a9f50 msgr2=0x7fa44409a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4440a9f50 0x7fa44409a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 -- 172.21.2.137:0/2389661377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43400b1e0 con 0x7fa4440b1340 2021-11-15T19:33:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4437fe700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 0x7fa4441401b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fa4440aeb00 tx=0x7fa434015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa434002f50 con 0x7fa4440b1340 2021-11-15T19:33:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400de60 con 0x7fa4440b1340 2021-11-15T19:33:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa434006e20 con 0x7fa4440b1340 2021-11-15T19:33:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44415ac30 con 0x7fa4440b1340 2021-11-15T19:33:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44409ad00 con 0x7fa4440b1340 2021-11-15T19:33:34.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44413fef0 con 0x7fa4440b1340 2021-11-15T19:33:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa434025030 con 0x7fa4440b1340 2021-11-15T19:33:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4417fa700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4280536f0 0x7fa428055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:34.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa43406cd00 con 0x7fa4440b1340 2021-11-15T19:33:34.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.973+0000 7fa443fff700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4280536f0 0x7fa428055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.977+0000 7fa443fff700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4280536f0 0x7fa428055bb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fa42c000bc0 tx=0x7fa42c007780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:34.977+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa44413fef0 con 0x7fa4440b1340 2021-11-15T19:33:35.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44413fef0 con 0x7fa4440b1340 2021-11-15T19:33:35.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa4417fa700 1 -- 172.21.2.137:0/2389661377 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fa44413fef0 con 0x7fa4440b1340 2021-11-15T19:33:35.070 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:35.070 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":84,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:33.559283+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:30.496786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:31.537268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:35.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4280536f0 msgr2=0x7fa428055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4280536f0 0x7fa428055bb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fa42c000bc0 tx=0x7fa42c007780).stop 2021-11-15T19:33:35.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 msgr2=0x7fa4441401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 0x7fa4441401b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fa4440aeb00 tx=0x7fa434015000).stop 2021-11-15T19:33:35.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 shutdown_connections 2021-11-15T19:33:35.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa4280536f0 0x7fa428055bb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa444144610 0x7fa44415a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4440b1340 0x7fa4441401b0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 --2- 172.21.2.137:0/2389661377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4440a9f50 0x7fa44409a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 >> 172.21.2.137:0/2389661377 conn(0x7fa4440b4e60 msgr2=0x7fa4440b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 shutdown_connections 2021-11-15T19:33:35.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.061+0000 7fa44a709700 1 -- 172.21.2.137:0/2389661377 wait complete. 2021-11-15T19:33:35.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:33:30.496786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:33:31.537268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:33:35.079 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:35.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 Processor -- start 2021-11-15T19:33:35.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- start start 2021-11-15T19:33:35.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc0940b0550 0x7fc09414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc09414aaa0 0x7fc094140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09405cb50 con 0x7fc09405c770 2021-11-15T19:33:35.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940b1650 con 0x7fc09414aaa0 2021-11-15T19:33:35.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940ad030 con 0x7fc0940b0550 2021-11-15T19:33:35.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc0937fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc09405c770 0x7fc0940aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55606/0 (socket says 172.21.2.137:55606) 2021-11-15T19:33:35.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc0937fe700 1 -- 172.21.2.137:0/3087068823 learned_addr learned my addr 172.21.2.137:0/3087068823 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:35.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc092ffd700 1 --2- 172.21.2.137:0/3087068823 >> v2:172.21.2.137:3300/0 conn(0x7fc0940b0550 0x7fc09414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc092ffd700 1 -- 172.21.2.137:0/3087068823 >> v2:172.21.2.111:3300/0 conn(0x7fc09414aaa0 msgr2=0x7fc094140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:35.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc092ffd700 1 --2- 172.21.2.137:0/3087068823 >> v2:172.21.2.111:3300/0 conn(0x7fc09414aaa0 0x7fc094140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc092ffd700 1 -- 172.21.2.137:0/3087068823 >> v1:172.21.2.137:6789/0 conn(0x7fc09405c770 legacy=0x7fc0940aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc092ffd700 1 -- 172.21.2.137:0/3087068823 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940ad2d0 con 0x7fc0940b0550 2021-11-15T19:33:35.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc092ffd700 1 --2- 172.21.2.137:0/3087068823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0940b0550 0x7fc09414a5b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fc088002f70 tx=0x7fc088006df0).ready entity=mon.1 client_cookie=f0186101e0b41ab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc0927fc700 1 -- 172.21.2.137:0/3087068823 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08800d5c0 con 0x7fc0940b0550 2021-11-15T19:33:35.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc0927fc700 1 -- 172.21.2.137:0/3087068823 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088000e90 con 0x7fc0940b0550 2021-11-15T19:33:35.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc0927fc700 1 -- 172.21.2.137:0/3087068823 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08800d950 con 0x7fc0940b0550 2021-11-15T19:33:35.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3087068823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0940b0550 msgr2=0x7fc09414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- 172.21.2.137:0/3087068823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0940b0550 0x7fc09414a5b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fc088002f70 tx=0x7fc088006df0).stop 2021-11-15T19:33:35.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3087068823 shutdown_connections 2021-11-15T19:33:35.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- 172.21.2.137:0/3087068823 >> v2:172.21.2.111:3300/0 conn(0x7fc09414aaa0 0x7fc094140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- 172.21.2.137:0/3087068823 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0940b0550 0x7fc09414a5b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3087068823 >> 172.21.2.137:0/3087068823 conn(0x7fc0940631e0 msgr2=0x7fc09405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3087068823 shutdown_connections 2021-11-15T19:33:35.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3087068823 wait complete. 2021-11-15T19:33:35.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 Processor -- start 2021-11-15T19:33:35.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- start start 2021-11-15T19:33:35.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc09405c770 0x7fc09415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0940b0550 0x7fc0941171a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 0x7fc094117690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094159cf0 con 0x7fc09405c770 2021-11-15T19:33:35.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094159f90 con 0x7fc09414aaa0 2021-11-15T19:33:35.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415a230 con 0x7fc0940b0550 2021-11-15T19:33:35.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 0x7fc094117690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 0x7fc094117690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36832/0 (socket says 172.21.2.137:36832) 2021-11-15T19:33:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 -- 172.21.2.137:0/3379909784 learned_addr learned my addr 172.21.2.137:0/3379909784 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 -- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0940b0550 msgr2=0x7fc0941171a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0940b0550 0x7fc0941171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 -- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc09405c770 msgr2=0x7fc09415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc09405c770 0x7fc09415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 -- 172.21.2.137:0/3379909784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08800b180 con 0x7fc09414aaa0 2021-11-15T19:33:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc093fff700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 0x7fc094117690 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fc08c003330 tx=0x7fc08c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08c001520 con 0x7fc09414aaa0 2021-11-15T19:33:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c001680 con 0x7fc09414aaa0 2021-11-15T19:33:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094117b80 con 0x7fc09414aaa0 2021-11-15T19:33:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08c0019e0 con 0x7fc09414aaa0 2021-11-15T19:33:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.125+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0941567c0 con 0x7fc09414aaa0 2021-11-15T19:33:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09415a3f0 con 0x7fc09414aaa0 2021-11-15T19:33:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc08c018030 con 0x7fc09414aaa0 2021-11-15T19:33:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc090ff9700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc074053610 0x7fc074055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc08c06b360 con 0x7fc09414aaa0 2021-11-15T19:33:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc0937fe700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc074053610 0x7fc074055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc0937fe700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc074053610 0x7fc074055ad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fc0940aee10 tx=0x7fc084007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.129+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc08c042570 con 0x7fc09414aaa0 2021-11-15T19:33:35.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc0940ae7f0 con 0x7fc09414aaa0 2021-11-15T19:33:35.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc090ff9700 1 -- 172.21.2.137:0/3379909784 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc08c045b90 con 0x7fc09414aaa0 2021-11-15T19:33:35.223 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc074053610 msgr2=0x7fc074055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc074053610 0x7fc074055ad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fc0940aee10 tx=0x7fc084007860).stop 2021-11-15T19:33:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 msgr2=0x7fc094117690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 0x7fc094117690 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fc08c003330 tx=0x7fc08c0091a0).stop 2021-11-15T19:33:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 shutdown_connections 2021-11-15T19:33:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc074053610 0x7fc074055ad0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc09414aaa0 0x7fc094117690 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0940b0550 0x7fc0941171a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 --2- 172.21.2.137:0/3379909784 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc09405c770 0x7fc09415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 >> 172.21.2.137:0/3379909784 conn(0x7fc0940631e0 msgr2=0x7fc0940b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 shutdown_connections 2021-11-15T19:33:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.213+0000 7fc099f89700 1 -- 172.21.2.137:0/3379909784 wait complete. 2021-11-15T19:33:35.230 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:35.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 Processor -- start 2021-11-15T19:33:35.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 -- start start 2021-11-15T19:33:35.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f008405c770 0x7f00840aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0084140aa0 0x7f0084140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008405cb50 con 0x7f00840b0550 2021-11-15T19:33:35.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840b1650 con 0x7f008405c770 2021-11-15T19:33:35.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840ad030 con 0x7f0084140aa0 2021-11-15T19:33:35.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0084140aa0 0x7f0084140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0084140aa0 0x7f0084140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36838/0 (socket says 172.21.2.137:36838) 2021-11-15T19:33:35.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 -- 172.21.2.137:0/2619084948 learned_addr learned my addr 172.21.2.137:0/2619084948 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:35.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 -- 172.21.2.137:0/2619084948 >> v2:172.21.2.111:3300/0 conn(0x7f008405c770 msgr2=0x7f00840aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:35.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 --2- 172.21.2.137:0/2619084948 >> v2:172.21.2.111:3300/0 conn(0x7f008405c770 0x7f00840aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 -- 172.21.2.137:0/2619084948 >> v1:172.21.2.111:6789/0 conn(0x7f00840b0550 legacy=0x7f008414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:35.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 -- 172.21.2.137:0/2619084948 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840ad2d0 con 0x7f0084140aa0 2021-11-15T19:33:35.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008a9a9700 1 --2- 172.21.2.137:0/2619084948 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0084140aa0 0x7f0084140ef0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f00840aee10 tx=0x7f007c009290).ready entity=mon.1 client_cookie=18e9ad76c750a65 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f00891a6700 1 -- 172.21.2.137:0/2619084948 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007c00b830 con 0x7f0084140aa0 2021-11-15T19:33:35.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f00891a6700 1 -- 172.21.2.137:0/2619084948 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c00b990 con 0x7f0084140aa0 2021-11-15T19:33:35.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f00891a6700 1 -- 172.21.2.137:0/2619084948 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007c00bb40 con 0x7f0084140aa0 2021-11-15T19:33:35.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 -- 172.21.2.137:0/2619084948 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0084140aa0 msgr2=0x7f0084140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.273+0000 7f008c40c700 1 --2- 172.21.2.137:0/2619084948 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0084140aa0 0x7f0084140ef0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f00840aee10 tx=0x7f007c009290).stop 2021-11-15T19:33:35.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/2619084948 shutdown_connections 2021-11-15T19:33:35.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 --2- 172.21.2.137:0/2619084948 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0084140aa0 0x7f0084140ef0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 --2- 172.21.2.137:0/2619084948 >> v2:172.21.2.111:3300/0 conn(0x7f008405c770 0x7f00840aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/2619084948 >> 172.21.2.137:0/2619084948 conn(0x7f00840631e0 msgr2=0x7f008405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/2619084948 shutdown_connections 2021-11-15T19:33:35.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/2619084948 wait complete. 2021-11-15T19:33:35.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 Processor -- start 2021-11-15T19:33:35.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- start start 2021-11-15T19:33:35.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 0x7f0084145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f00840b0550 0x7f0084145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0084140aa0 0x7f0084156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00841446d0 con 0x7f0084140aa0 2021-11-15T19:33:35.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084066fe0 con 0x7f008405c770 2021-11-15T19:33:35.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0084141c80 con 0x7f00840b0550 2021-11-15T19:33:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 0x7f0084145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 0x7f0084145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36842/0 (socket says 172.21.2.137:36842) 2021-11-15T19:33:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 -- 172.21.2.137:0/1456086907 learned_addr learned my addr 172.21.2.137:0/1456086907 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 -- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f00840b0550 msgr2=0x7f0084145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f00840b0550 0x7f0084145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 -- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0084140aa0 msgr2=0x7f0084156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0084140aa0 0x7f0084156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 -- 172.21.2.137:0/1456086907 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c009530 con 0x7f008405c770 2021-11-15T19:33:35.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008a1a8700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 0x7f0084145880 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f0084144a20 tx=0x7f0078006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0078013460 con 0x7f008405c770 2021-11-15T19:33:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780135c0 con 0x7f008405c770 2021-11-15T19:33:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084142350 con 0x7f008405c770 2021-11-15T19:33:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0078013920 con 0x7f008405c770 2021-11-15T19:33:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0084146260 con 0x7f008405c770 2021-11-15T19:33:35.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00840ae7f0 con 0x7f008405c770 2021-11-15T19:33:35.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f007800f070 con 0x7f008405c770 2021-11-15T19:33:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f00777fe700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0064053640 0x7f0064055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.277+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f007806b260 con 0x7f008405c770 2021-11-15T19:33:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.281+0000 7f00899a7700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0064053640 0x7f0064055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.281+0000 7f00899a7700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0064053640 0x7f0064055b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f0080002f90 tx=0x7f00800069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.281+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00780423c0 con 0x7f008405c770 2021-11-15T19:33:35.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00840573d0 con 0x7f008405c770 2021-11-15T19:33:35.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f00777fe700 1 -- 172.21.2.137:0/1456086907 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00780459e0 con 0x7f008405c770 2021-11-15T19:33:35.374 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:35.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0064053640 msgr2=0x7f0064055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0064053640 0x7f0064055b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f0080002f90 tx=0x7f00800069b0).stop 2021-11-15T19:33:35.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 msgr2=0x7f0084145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 0x7f0084145880 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f0084144a20 tx=0x7f0078006ec0).stop 2021-11-15T19:33:35.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 shutdown_connections 2021-11-15T19:33:35.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0064053640 0x7f0064055b00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0084140aa0 0x7f0084156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f00840b0550 0x7f0084145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 --2- 172.21.2.137:0/1456086907 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f008405c770 0x7f0084145880 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 >> 172.21.2.137:0/1456086907 conn(0x7f00840631e0 msgr2=0x7f008413f680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 shutdown_connections 2021-11-15T19:33:35.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.365+0000 7f008c40c700 1 -- 172.21.2.137:0/1456086907 wait complete. 2021-11-15T19:33:35.381 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:33:35.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 Processor -- start 2021-11-15T19:33:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 -- start start 2021-11-15T19:33:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d2405c770 0x7f4d240aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4d24140aa0 0x7f4d24140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2405cb50 con 0x7f4d240b0550 2021-11-15T19:33:35.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240b1650 con 0x7f4d24140aa0 2021-11-15T19:33:35.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d2b498700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240ad030 con 0x7f4d2405c770 2021-11-15T19:33:35.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d29a35700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4d24140aa0 0x7f4d24140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d28a33700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f4d240b0550 0x7f4d2414a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:48126/0 (socket says 172.21.2.137:48126) 2021-11-15T19:33:35.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d28a33700 1 -- 172.21.2.137:0/582998418 learned_addr learned my addr 172.21.2.137:0/582998418 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.425+0000 7f4d29234700 1 --2- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d2405c770 0x7f4d240aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d29a35700 1 -- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d2405c770 msgr2=0x7f4d240aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d29a35700 1 --2- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d2405c770 0x7f4d240aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d29a35700 1 -- 172.21.2.137:0/582998418 >> v1:172.21.2.111:6789/0 conn(0x7f4d240b0550 legacy=0x7f4d2414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d29a35700 1 -- 172.21.2.137:0/582998418 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240ad2d0 con 0x7f4d24140aa0 2021-11-15T19:33:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d29a35700 1 --2- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d24140aa0 0x7f4d24140f10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4d1c0032f0 tx=0x7f4d1c0091d0).ready entity=mon.0 client_cookie=e7637b864afb0637 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d17fff700 1 -- 172.21.2.137:0/582998418 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d1c00b6c0 con 0x7f4d24140aa0 2021-11-15T19:33:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d17fff700 1 -- 172.21.2.137:0/582998418 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00b820 con 0x7f4d24140aa0 2021-11-15T19:33:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d17fff700 1 -- 172.21.2.137:0/582998418 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d1c00b990 con 0x7f4d24140aa0 2021-11-15T19:33:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d24140aa0 msgr2=0x7f4d24140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 --2- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d24140aa0 0x7f4d24140f10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4d1c0032f0 tx=0x7f4d1c0091d0).stop 2021-11-15T19:33:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/582998418 shutdown_connections 2021-11-15T19:33:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 --2- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d24140aa0 0x7f4d24140f10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 --2- 172.21.2.137:0/582998418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d2405c770 0x7f4d240aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/582998418 >> 172.21.2.137:0/582998418 conn(0x7f4d240631e0 msgr2=0x7f4d2405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/582998418 shutdown_connections 2021-11-15T19:33:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/582998418 wait complete. 2021-11-15T19:33:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 Processor -- start 2021-11-15T19:33:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- start start 2021-11-15T19:33:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d2405c770 0x7f4d2414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 0x7f4d24146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d24140aa0 0x7f4d24142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d24142170 con 0x7f4d2405c770 2021-11-15T19:33:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d24146880 con 0x7f4d240b0550 2021-11-15T19:33:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d24146b20 con 0x7f4d24140aa0 2021-11-15T19:33:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 0x7f4d24146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 0x7f4d24146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36860/0 (socket says 172.21.2.137:36860) 2021-11-15T19:33:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 -- 172.21.2.137:0/4210944888 learned_addr learned my addr 172.21.2.137:0/4210944888 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 -- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d24140aa0 msgr2=0x7f4d24142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d24140aa0 0x7f4d24142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 -- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d2405c770 msgr2=0x7f4d2414a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d2405c770 0x7f4d2414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 -- 172.21.2.137:0/4210944888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c009470 con 0x7f4d240b0550 2021-11-15T19:33:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d28a33700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 0x7f4d24146fc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f4d240adfd0 tx=0x7f4d18007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d1800ce30 con 0x7f4d240b0550 2021-11-15T19:33:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d180072e0 con 0x7f4d240b0550 2021-11-15T19:33:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d241577a0 con 0x7f4d240b0550 2021-11-15T19:33:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d18005800 con 0x7f4d240b0550 2021-11-15T19:33:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.429+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2414adc0 con 0x7f4d240b0550 2021-11-15T19:33:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d24146ce0 con 0x7f4d240b0550 2021-11-15T19:33:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4d18010070 con 0x7f4d240b0550 2021-11-15T19:33:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d167fc700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d04053580 0x7f4d04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4d1806b0f0 con 0x7f4d240b0550 2021-11-15T19:33:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d29234700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d04053580 0x7f4d04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d29234700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d04053580 0x7f4d04055a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4d2000c000 tx=0x7f4d20006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.433+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4d18042140 con 0x7f4d240b0550 2021-11-15T19:33:35.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d241444a0 con 0x7f4d240b0550 2021-11-15T19:33:35.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d167fc700 1 -- 172.21.2.137:0/4210944888 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4d18045760 con 0x7f4d240b0550 2021-11-15T19:33:35.527 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:35.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d04053580 msgr2=0x7f4d04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d04053580 0x7f4d04055a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4d2000c000 tx=0x7f4d20006df0).stop 2021-11-15T19:33:35.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 msgr2=0x7f4d24146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 0x7f4d24146fc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f4d240adfd0 tx=0x7f4d18007c40).stop 2021-11-15T19:33:35.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 shutdown_connections 2021-11-15T19:33:35.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4d04053580 0x7f4d04055a40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4d24140aa0 0x7f4d24142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4d240b0550 0x7f4d24146fc0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 --2- 172.21.2.137:0/4210944888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4d2405c770 0x7f4d2414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 >> 172.21.2.137:0/4210944888 conn(0x7f4d240631e0 msgr2=0x7f4d240b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 shutdown_connections 2021-11-15T19:33:35.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.517+0000 7f4d2b498700 1 -- 172.21.2.137:0/4210944888 wait complete. 2021-11-15T19:33:35.534 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:33:35.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 Processor -- start 2021-11-15T19:33:35.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- start start 2021-11-15T19:33:35.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4805c770 0x7f1d480af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1d480b1100 0x7f1d4813fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4805cb50 con 0x7f1d4813c130 2021-11-15T19:33:35.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480b1540 con 0x7f1d480b1100 2021-11-15T19:33:35.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4813f1b0 con 0x7f1d4805c770 2021-11-15T19:33:35.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4dde1700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1d4813c130 0x7f1d4813c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55650/0 (socket says 172.21.2.137:55650) 2021-11-15T19:33:35.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4dde1700 1 -- 172.21.2.137:0/1350145028 learned_addr learned my addr 172.21.2.137:0/1350145028 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:35.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4d5e0700 1 --2- 172.21.2.137:0/1350145028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4805c770 0x7f1d480af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4cddf700 1 --2- 172.21.2.137:0/1350145028 >> v2:172.21.2.111:3300/0 conn(0x7f1d480b1100 0x7f1d4813fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d37fff700 1 -- 172.21.2.137:0/1350145028 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471039467 0 0) 0x7f1d4805cb50 con 0x7f1d4813c130 2021-11-15T19:33:35.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d37fff700 1 -- 172.21.2.137:0/1350145028 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d30003260 con 0x7f1d4813c130 2021-11-15T19:33:35.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4d5e0700 1 -- 172.21.2.137:0/1350145028 >> v2:172.21.2.111:3300/0 conn(0x7f1d480b1100 msgr2=0x7f1d4813fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:35.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4d5e0700 1 --2- 172.21.2.137:0/1350145028 >> v2:172.21.2.111:3300/0 conn(0x7f1d480b1100 0x7f1d4813fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4d5e0700 1 -- 172.21.2.137:0/1350145028 >> v1:172.21.2.137:6789/0 conn(0x7f1d4813c130 legacy=0x7f1d4813c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4d5e0700 1 -- 172.21.2.137:0/1350145028 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4813f450 con 0x7f1d4805c770 2021-11-15T19:33:35.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4d5e0700 1 --2- 172.21.2.137:0/1350145028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4805c770 0x7f1d480af310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1d400032f0 tx=0x7f1d4000ac00).ready entity=mon.2 client_cookie=563a58f4c86474de server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d37fff700 1 -- 172.21.2.137:0/1350145028 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d4000a3a0 con 0x7f1d4805c770 2021-11-15T19:33:35.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d37fff700 1 -- 172.21.2.137:0/1350145028 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4000a500 con 0x7f1d4805c770 2021-11-15T19:33:35.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d37fff700 1 -- 172.21.2.137:0/1350145028 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d4000a860 con 0x7f1d4805c770 2021-11-15T19:33:35.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- 172.21.2.137:0/1350145028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4805c770 msgr2=0x7f1d480af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 --2- 172.21.2.137:0/1350145028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4805c770 0x7f1d480af310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1d400032f0 tx=0x7f1d4000ac00).stop 2021-11-15T19:33:35.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- 172.21.2.137:0/1350145028 shutdown_connections 2021-11-15T19:33:35.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 --2- 172.21.2.137:0/1350145028 >> v2:172.21.2.111:3300/0 conn(0x7f1d480b1100 0x7f1d4813fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 --2- 172.21.2.137:0/1350145028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4805c770 0x7f1d480af310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- 172.21.2.137:0/1350145028 >> 172.21.2.137:0/1350145028 conn(0x7f1d48060200 msgr2=0x7f1d4805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- 172.21.2.137:0/1350145028 shutdown_connections 2021-11-15T19:33:35.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.577+0000 7f1d4f844700 1 -- 172.21.2.137:0/1350145028 wait complete. 2021-11-15T19:33:35.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 Processor -- start 2021-11-15T19:33:35.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- start start 2021-11-15T19:33:35.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d480b1100 0x7f1d48066920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4813c130 0x7f1d48066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d480636f0 0x7f1d4813b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4814ea80 con 0x7f1d480b1100 2021-11-15T19:33:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4814ed20 con 0x7f1d480636f0 2021-11-15T19:33:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48142e50 con 0x7f1d4813c130 2021-11-15T19:33:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4dde1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d480636f0 0x7f1d4813b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4dde1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d480636f0 0x7f1d4813b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36872/0 (socket says 172.21.2.137:36872) 2021-11-15T19:33:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4dde1700 1 -- 172.21.2.137:0/769508301 learned_addr learned my addr 172.21.2.137:0/769508301 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4813c130 0x7f1d48066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4d5e0700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d480b1100 0x7f1d48066920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 -- 172.21.2.137:0/769508301 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d480636f0 msgr2=0x7f1d4813b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d480636f0 0x7f1d4813b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 -- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d480b1100 msgr2=0x7f1d48066920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d480b1100 0x7f1d48066920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 -- 172.21.2.137:0/769508301 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4000c050 con 0x7f1d4813c130 2021-11-15T19:33:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4cddf700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4813c130 0x7f1d48066e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1d3800e000 tx=0x7f1d38006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3800ec50 con 0x7f1d4813c130 2021-11-15T19:33:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800edb0 con 0x7f1d4813c130 2021-11-15T19:33:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d481432f0 con 0x7f1d4813c130 2021-11-15T19:33:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d38011640 con 0x7f1d4813c130 2021-11-15T19:33:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4813bb90 con 0x7f1d4813c130 2021-11-15T19:33:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d48143010 con 0x7f1d4813c130 2021-11-15T19:33:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d380117a0 con 0x7f1d4813c130 2021-11-15T19:33:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d367fc700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d280534f0 0x7f1d280559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1d3806e190 con 0x7f1d4813c130 2021-11-15T19:33:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4d5e0700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d280534f0 0x7f1d280559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.581+0000 7f1d4d5e0700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d280534f0 0x7f1d280559b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f1d40019000 tx=0x7f1d40015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.585+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d38045100 con 0x7f1d4813c130 2021-11-15T19:33:35.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d480573d0 con 0x7f1d4813c130 2021-11-15T19:33:35.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d367fc700 1 -- 172.21.2.137:0/769508301 <== mon.2 v2:172.21.2.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1d38048720 con 0x7f1d4813c130 2021-11-15T19:33:35.678 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:35.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d280534f0 msgr2=0x7f1d280559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d280534f0 0x7f1d280559b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f1d40019000 tx=0x7f1d40015000).stop 2021-11-15T19:33:35.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4813c130 msgr2=0x7f1d48066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4813c130 0x7f1d48066e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1d3800e000 tx=0x7f1d38006df0).stop 2021-11-15T19:33:35.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 shutdown_connections 2021-11-15T19:33:35.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d280534f0 0x7f1d280559b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d480636f0 0x7f1d4813b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d4813c130 0x7f1d48066e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 --2- 172.21.2.137:0/769508301 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d480b1100 0x7f1d48066920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 >> 172.21.2.137:0/769508301 conn(0x7f1d4805c770 msgr2=0x7f1d4813df20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 shutdown_connections 2021-11-15T19:33:35.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.669+0000 7f1d4f844700 1 -- 172.21.2.137:0/769508301 wait complete. 2021-11-15T19:33:35.686 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:33:35.686 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:35.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 Processor -- start 2021-11-15T19:33:35.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- start start 2021-11-15T19:33:35.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7febe805f730 0x7febe805fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe8060070 con 0x7febe80b1660 2021-11-15T19:33:35.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80ad6c0 con 0x7febe805f730 2021-11-15T19:33:35.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe80b0c80 con 0x7febe80608f0 2021-11-15T19:33:35.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe7fff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7febe805f730 0x7febe805fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe6ffd700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7febe80b1660 0x7febe80b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:48156/0 (socket says 172.21.2.137:48156) 2021-11-15T19:33:35.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe6ffd700 1 -- 172.21.2.137:0/1051256510 learned_addr learned my addr 172.21.2.137:0/1051256510 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:35.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/1051256510 >> v2:172.21.2.111:3300/0 conn(0x7febe805f730 msgr2=0x7febe805fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:35.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- 172.21.2.137:0/1051256510 >> v2:172.21.2.111:3300/0 conn(0x7febe805f730 0x7febe805fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/1051256510 >> v1:172.21.2.111:6789/0 conn(0x7febe80b1660 legacy=0x7febe80b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/1051256510 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80b0f20 con 0x7febe80608f0 2021-11-15T19:33:35.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- 172.21.2.137:0/1051256510 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe813f890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7febd0002f70 tx=0x7febd0006e80).ready entity=mon.2 client_cookie=ac5fad61c963c0af server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe67fc700 1 -- 172.21.2.137:0/1051256510 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd000b7d0 con 0x7febe80608f0 2021-11-15T19:33:35.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe67fc700 1 -- 172.21.2.137:0/1051256510 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000b930 con 0x7febe80608f0 2021-11-15T19:33:35.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe67fc700 1 -- 172.21.2.137:0/1051256510 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd000bc90 con 0x7febe80608f0 2021-11-15T19:33:35.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/1051256510 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 msgr2=0x7febe813f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- 172.21.2.137:0/1051256510 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe813f890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7febd0002f70 tx=0x7febd0006e80).stop 2021-11-15T19:33:35.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/1051256510 shutdown_connections 2021-11-15T19:33:35.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- 172.21.2.137:0/1051256510 >> v2:172.21.2.111:3300/0 conn(0x7febe805f730 0x7febe805fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- 172.21.2.137:0/1051256510 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe813f890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/1051256510 >> 172.21.2.137:0/1051256510 conn(0x7febe8063980 msgr2=0x7febe8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/1051256510 shutdown_connections 2021-11-15T19:33:35.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/1051256510 wait complete. 2021-11-15T19:33:35.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 Processor -- start 2021-11-15T19:33:35.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- start start 2021-11-15T19:33:35.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 0x7febe8128090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe81426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe80b1660 0x7febe81268e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8142be0 con 0x7febe80b1660 2021-11-15T19:33:35.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8139c50 con 0x7febe805f730 2021-11-15T19:33:35.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8143690 con 0x7febe80608f0 2021-11-15T19:33:35.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 0x7febe8128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 0x7febe8128090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36884/0 (socket says 172.21.2.137:36884) 2021-11-15T19:33:35.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/3610693548 learned_addr learned my addr 172.21.2.137:0/3610693548 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:35.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe6ffd700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe81426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 msgr2=0x7febe81426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe81426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe80b1660 msgr2=0x7febe81268e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe80b1660 0x7febe81268e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 -- 172.21.2.137:0/3610693548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd000d410 con 0x7febe805f730 2021-11-15T19:33:35.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe77fe700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 0x7febe8128090 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7febd0002f70 tx=0x7febd0006e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd0010ea0 con 0x7febe805f730 2021-11-15T19:33:35.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd00226c0 con 0x7febe805f730 2021-11-15T19:33:35.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd0022a20 con 0x7febe805f730 2021-11-15T19:33:35.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe8143930 con 0x7febe805f730 2021-11-15T19:33:35.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe8142dd0 con 0x7febe805f730 2021-11-15T19:33:35.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe80b11c0 con 0x7febe805f730 2021-11-15T19:33:35.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febd0029030 con 0x7febe805f730 2021-11-15T19:33:35.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.733+0000 7febe4ff9700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febcc0536a0 0x7febcc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:35.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.737+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7febd0070b70 con 0x7febe805f730 2021-11-15T19:33:35.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.737+0000 7febe6ffd700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febcc0536a0 0x7febcc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:35.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.737+0000 7febe6ffd700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febcc0536a0 0x7febcc055b60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7febd8008000 tx=0x7febd8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:35.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.737+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febd0047cd0 con 0x7febe805f730 2021-11-15T19:33:35.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febe80573d0 con 0x7febe805f730 2021-11-15T19:33:35.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febe4ff9700 1 -- 172.21.2.137:0/3610693548 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7febd0027090 con 0x7febe805f730 2021-11-15T19:33:35.856 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:35.856 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:33.558072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6577":{"gid":6577,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2662817327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2662817327},{"type":"v1","addr":"172.21.2.137:6833","nonce":2662817327}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:35.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febcc0536a0 msgr2=0x7febcc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febcc0536a0 0x7febcc055b60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7febd8008000 tx=0x7febd8009040).stop 2021-11-15T19:33:35.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 msgr2=0x7febe8128090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:35.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 0x7febe8128090 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7febd0002f70 tx=0x7febd0006e80).stop 2021-11-15T19:33:35.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 shutdown_connections 2021-11-15T19:33:35.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febcc0536a0 0x7febcc055b60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe80b1660 0x7febe81268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:35.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febe80608f0 0x7febe81426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 --2- 172.21.2.137:0/3610693548 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe805f730 0x7febe8128090 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:35.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.845+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 >> 172.21.2.137:0/3610693548 conn(0x7febe8063980 msgr2=0x7febe8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:35.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.849+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 shutdown_connections 2021-11-15T19:33:35.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:35.849+0000 7febedb97700 1 -- 172.21.2.137:0/3610693548 wait complete. 2021-11-15T19:33:35.860 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 37 2021-11-15T19:33:36.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:33:32.554900+0000', 'modified': '2021-11-15T19:33:33.558072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6577': {'gid': 6577, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/2662817327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 2662817327}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 2662817327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:36.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:36.065 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:36.125 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6577,"want_state":"up:active","state":"up:active","rank_uptime":3.5601916689999999,"mdsmap_epoch":37,"osdmap_epoch":84,"osdmap_epoch_barrier":83,"uptime":7.6734617910000003} 2021-11-15T19:33:36.125 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6577, "mdsmap_epoch": 37, "osdmap_epoch": 84, "osdmap_epoch_barrier": 83, "rank_uptime": 3.560191669, "state": "up:active", "uptime": 7.673461791, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:36.126 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:33:36.126 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:33:36.127 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:33:36.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:36.127 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:36.139 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:36.192 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:36.192 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:36.198 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:36.199 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:36.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:36.200 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:36.204 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:33:36.204 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:36.247 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:36.256 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:36.257 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:36.262 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:36.262 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:36.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:36.264 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:36.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:33:36.282+0000 7fab7e67d080 -1 init, newargv = 0x55c0d98254c0 newargc=9ceph-fuse[14843]: starting ceph client 2021-11-15T19:33:36.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr: 2021-11-15T19:33:36.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14843]: starting fuse 2021-11-15T19:33:37.393 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:37.405 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:37.406 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:37.457 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:37.457 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:37.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:37.459 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:37.464 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:33:37.465 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:33:37.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:37.466 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:33:37.466 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:33:37.466 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:33:37.467 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:33:37.467 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:33:37.468 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:37.468 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:33:37.468 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:33:37.469 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:33:37.469 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:37.470 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:33:37.470 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:33:37.470 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:33:37.471 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:33:37.471 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:37.472 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:33:37.472 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:33:37.472 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:33:37.473 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:33:37.473 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:33:37.474 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:37.474 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:33:37.474 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:33:37.505 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14843.asok 2021-11-15T19:33:37.508 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14843.asok 2021-11-15T19:33:37.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:37.508 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14843.asok status 2021-11-15T19:33:37.610 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:33:37.610 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:33:37.610 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:33:37.611 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:33:37.611 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:33:37.611 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:33:37.611 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:33:37.612 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14843", 2021-11-15T19:33:37.612 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:33:37.612 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:37.612 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:33:37.613 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:33:37.613 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4724, 2021-11-15T19:33:37.613 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:33:37.613 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:33:37.613 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:33:37.614 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4724 2021-11-15T19:33:37.614 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:37.614 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:33:37.614 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:33:37.615 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:33:37.615 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 210210924 2021-11-15T19:33:37.615 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:33:37.615 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:37.615 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:33:37.616 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:33:37.616 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:33:37.616 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 210210924 2021-11-15T19:33:37.616 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:37.616 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4724 172.21.2.131:0/210210924", 2021-11-15T19:33:37.617 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/210210924", 2021-11-15T19:33:37.617 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:33:37.617 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 37, 2021-11-15T19:33:37.617 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 84, 2021-11-15T19:33:37.618 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:33:37.618 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:33:37.618 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:33:37.618 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:33:37.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:37.620 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:37.620 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:37.625 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:33:37.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:37.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:37.627 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:37.634 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:37.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.693+0000 7f7fa5011700 1 Processor -- start 2021-11-15T19:33:37.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.693+0000 7f7fa5011700 1 -- start start 2021-11-15T19:33:37.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7fa00b1130 0x7f7fa013fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7fa01401d0 0x7f7fa0140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa0141bc0 con 0x7f7fa005fb80 2021-11-15T19:33:37.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa0097ff0 con 0x7f7fa01401d0 2021-11-15T19:33:37.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa009a1f0 con 0x7f7fa00b1130 2021-11-15T19:33:37.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7fa00b1130 0x7f7fa013fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7fa00b1130 0x7f7fa013fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36894/0 (socket says 172.21.2.137:36894) 2021-11-15T19:33:37.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 -- 172.21.2.137:0/706415818 learned_addr learned my addr 172.21.2.137:0/706415818 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:37.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 -- 172.21.2.137:0/706415818 >> v2:172.21.2.111:3300/0 conn(0x7f7fa01401d0 msgr2=0x7f7fa0140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:37.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 --2- 172.21.2.137:0/706415818 >> v2:172.21.2.111:3300/0 conn(0x7f7fa01401d0 0x7f7fa0140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 -- 172.21.2.137:0/706415818 >> v1:172.21.2.111:6789/0 conn(0x7f7fa005fb80 legacy=0x7f7fa009a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:37.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 -- 172.21.2.137:0/706415818 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa00b1660 con 0x7f7fa00b1130 2021-11-15T19:33:37.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9e59c700 1 --2- 172.21.2.137:0/706415818 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa00b1130 0x7f7fa013fce0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f7fa00b2bd0 tx=0x7f7f88006eb0).ready entity=mon.1 client_cookie=5cc4cb4884ea4236 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:37.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9dd9b700 1 -- 172.21.2.137:0/706415818 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8800d5c0 con 0x7f7fa00b1130 2021-11-15T19:33:37.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9dd9b700 1 -- 172.21.2.137:0/706415818 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88000e90 con 0x7f7fa00b1130 2021-11-15T19:33:37.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9dd9b700 1 -- 172.21.2.137:0/706415818 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8800d910 con 0x7f7fa00b1130 2021-11-15T19:33:37.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- 172.21.2.137:0/706415818 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa00b1130 msgr2=0x7f7fa013fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- 172.21.2.137:0/706415818 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa00b1130 0x7f7fa013fce0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f7fa00b2bd0 tx=0x7f7f88006eb0).stop 2021-11-15T19:33:37.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- 172.21.2.137:0/706415818 shutdown_connections 2021-11-15T19:33:37.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- 172.21.2.137:0/706415818 >> v2:172.21.2.111:3300/0 conn(0x7f7fa01401d0 0x7f7fa0140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- 172.21.2.137:0/706415818 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa00b1130 0x7f7fa013fce0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- 172.21.2.137:0/706415818 >> 172.21.2.137:0/706415818 conn(0x7f7fa00b4e60 msgr2=0x7f7fa00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:37.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- 172.21.2.137:0/706415818 shutdown_connections 2021-11-15T19:33:37.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- 172.21.2.137:0/706415818 wait complete. 2021-11-15T19:33:37.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 Processor -- start 2021-11-15T19:33:37.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- start start 2021-11-15T19:33:37.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7fa005fb80 0x7f7fa0140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7fa00b1130 0x7f7fa013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 0x7f7fa0155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa013ec20 con 0x7f7fa005fb80 2021-11-15T19:33:37.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa0147db0 con 0x7f7fa01401d0 2021-11-15T19:33:37.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7fa5011700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa0148050 con 0x7f7fa00b1130 2021-11-15T19:33:37.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 0x7f7fa0155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 0x7f7fa0155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36902/0 (socket says 172.21.2.137:36902) 2021-11-15T19:33:37.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.697+0000 7f7f9f59e700 1 -- 172.21.2.137:0/4215746748 learned_addr learned my addr 172.21.2.137:0/4215746748 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:37.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9f59e700 1 -- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7fa00b1130 msgr2=0x7f7fa013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9f59e700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7fa00b1130 0x7f7fa013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9f59e700 1 -- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7fa005fb80 msgr2=0x7f7fa0140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9f59e700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7fa005fb80 0x7f7fa0140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9f59e700 1 -- 172.21.2.137:0/4215746748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8800b1e0 con 0x7f7fa01401d0 2021-11-15T19:33:37.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9f59e700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 0x7f7fa0155630 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f7f980032f0 tx=0x7f7f980091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:37.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f9800f510 con 0x7f7fa01401d0 2021-11-15T19:33:37.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9800f670 con 0x7f7fa01401d0 2021-11-15T19:33:37.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa013ee60 con 0x7f7fa01401d0 2021-11-15T19:33:37.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f9800f7e0 con 0x7f7fa01401d0 2021-11-15T19:33:37.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa0141320 con 0x7f7fa01401d0 2021-11-15T19:33:37.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa0097a10 con 0x7f7fa01401d0 2021-11-15T19:33:37.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f9800f070 con 0x7f7fa01401d0 2021-11-15T19:33:37.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f97fff700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7f840535b0 0x7f7f84055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7f9806b580 con 0x7f7fa01401d0 2021-11-15T19:33:37.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9ed9d700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7f840535b0 0x7f7f84055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.701+0000 7f7f9ed9d700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7f840535b0 0x7f7f84055a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f7f90002f90 tx=0x7f7f900069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:37.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.705+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fa0097a10 con 0x7f7fa01401d0 2021-11-15T19:33:37.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.785+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fa0097a10 con 0x7f7fa01401d0 2021-11-15T19:33:37.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.785+0000 7f7f97fff700 1 -- 172.21.2.137:0/4215746748 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f7fa0097a10 con 0x7f7fa01401d0 2021-11-15T19:33:37.796 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:37.796 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":84,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:33.559283+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:30.496786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:31.537268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:37.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7f840535b0 msgr2=0x7f7f84055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7f840535b0 0x7f7f84055a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f7f90002f90 tx=0x7f7f900069b0).stop 2021-11-15T19:33:37.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 msgr2=0x7f7fa0155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 0x7f7fa0155630 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f7f980032f0 tx=0x7f7f980091a0).stop 2021-11-15T19:33:37.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 shutdown_connections 2021-11-15T19:33:37.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7f840535b0 0x7f7f84055a70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7fa01401d0 0x7f7fa0155630 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7fa00b1130 0x7f7fa013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 --2- 172.21.2.137:0/4215746748 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7fa005fb80 0x7f7fa0140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 >> 172.21.2.137:0/4215746748 conn(0x7f7fa00b4e60 msgr2=0x7f7fa013d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:37.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 shutdown_connections 2021-11-15T19:33:37.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.789+0000 7f7fa5011700 1 -- 172.21.2.137:0/4215746748 wait complete. 2021-11-15T19:33:37.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:33:30.496786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:33:31.537268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:33:37.804 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:37.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.849+0000 7f24461d3700 1 Processor -- start 2021-11-15T19:33:37.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.849+0000 7f24461d3700 1 -- start start 2021-11-15T19:33:37.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 0x7f24400b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f24400acd60 0x7f24400b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24400b76c0 con 0x7f24400b4680 2021-11-15T19:33:37.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24400b3100 con 0x7f24400acd60 2021-11-15T19:33:37.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244012a170 con 0x7f24400b72e0 2021-11-15T19:33:37.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f24400b4680 0x7f2440143ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55688/0 (socket says 172.21.2.137:55688) 2021-11-15T19:33:37.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 -- 172.21.2.137:0/4180276136 learned_addr learned my addr 172.21.2.137:0/4180276136 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:37.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536790804 0 0) 0x7f24400b76c0 con 0x7f24400b4680 2021-11-15T19:33:37.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2420003260 con 0x7f24400b4680 2021-11-15T19:33:37.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243f7fe700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 0x7f24400b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243effd700 1 --2- 172.21.2.137:0/4180276136 >> v2:172.21.2.111:3300/0 conn(0x7f24400acd60 0x7f24400b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000647838 0 0) 0x7f2420003260 con 0x7f24400b4680 2021-11-15T19:33:37.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 msgr2=0x7f24400b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:37.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 0x7f24400b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 >> v2:172.21.2.111:3300/0 conn(0x7f24400acd60 msgr2=0x7f24400b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:37.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 --2- 172.21.2.137:0/4180276136 >> v2:172.21.2.111:3300/0 conn(0x7f24400acd60 0x7f24400b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400ad8a0 con 0x7f24400b4680 2021-11-15T19:33:37.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f2438001a00 con 0x7f24400b4680 2021-11-15T19:33:37.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 >> v1:172.21.2.137:6789/0 conn(0x7f24400b4680 legacy=0x7f2440143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2420003750 0x7f2420003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 0x7f2420004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f2420004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400b3100 con 0x7f2420003750 2021-11-15T19:33:37.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244012a170 con 0x7f24200049f0 2021-11-15T19:33:37.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242000fbb0 con 0x7f24400b72e0 2021-11-15T19:33:37.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f2420004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243f7fe700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2420003750 0x7f2420003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243effd700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 0x7f2420004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 -- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 msgr2=0x7f2420004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:37.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24400b72e0 0x7f2420004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 -- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2420003750 msgr2=0x7f2420003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:37.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2420003750 0x7f2420003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 -- 172.21.2.137:0/4180276136 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420003260 con 0x7f24200049f0 2021-11-15T19:33:37.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f2420004e70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f2438001710 tx=0x7f244012a2e0).ready entity=mon.1 client_cookie=5184a1ecef346fb9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:37.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243800cca0 con 0x7f24200049f0 2021-11-15T19:33:37.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243800ce00 con 0x7f24200049f0 2021-11-15T19:33:37.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243e7fc700 1 -- 172.21.2.137:0/4180276136 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2438004b50 con 0x7f24200049f0 2021-11-15T19:33:37.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- 172.21.2.137:0/4180276136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 msgr2=0x7f2420004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 --2- 172.21.2.137:0/4180276136 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f2420004e70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f2438001710 tx=0x7f244012a2e0).stop 2021-11-15T19:33:37.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f243ffff700 1 -- 172.21.2.137:0/4180276136 reap_dead start 2021-11-15T19:33:37.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- 172.21.2.137:0/4180276136 shutdown_connections 2021-11-15T19:33:37.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- 172.21.2.137:0/4180276136 >> 172.21.2.137:0/4180276136 conn(0x7f2440064960 msgr2=0x7f2440064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:37.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- 172.21.2.137:0/4180276136 shutdown_connections 2021-11-15T19:33:37.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.853+0000 7f24461d3700 1 -- 172.21.2.137:0/4180276136 wait complete. 2021-11-15T19:33:37.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 Processor -- start 2021-11-15T19:33:37.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- start start 2021-11-15T19:33:37.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f244014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2440144a30 0x7f24400af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2440141dd0 0x7f244014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24401268f0 con 0x7f2440141dd0 2021-11-15T19:33:37.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244014de00 con 0x7f24200049f0 2021-11-15T19:33:37.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24400b06b0 con 0x7f2440144a30 2021-11-15T19:33:37.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f244014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f244014d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36918/0 (socket says 172.21.2.137:36918) 2021-11-15T19:33:37.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 -- 172.21.2.137:0/633142591 learned_addr learned my addr 172.21.2.137:0/633142591 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:37.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 -- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2440144a30 msgr2=0x7f24400af170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:37.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2440144a30 0x7f24400af170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 -- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2440141dd0 msgr2=0x7f244014e330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:37.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2440141dd0 0x7f244014e330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 -- 172.21.2.137:0/633142591 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440142350 con 0x7f24200049f0 2021-11-15T19:33:37.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243f7fe700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f244014d910 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f2440144e90 tx=0x7f2430008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:37.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2430013800 con 0x7f24200049f0 2021-11-15T19:33:37.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430000e90 con 0x7f24200049f0 2021-11-15T19:33:37.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24401425f0 con 0x7f24200049f0 2021-11-15T19:33:37.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2430013b50 con 0x7f24200049f0 2021-11-15T19:33:37.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24400af660 con 0x7f24200049f0 2021-11-15T19:33:37.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24400b3a50 con 0x7f24200049f0 2021-11-15T19:33:37.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2430013cb0 con 0x7f24200049f0 2021-11-15T19:33:37.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243cff9700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24240535b0 0x7f2424055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:37.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f243006bd90 con 0x7f24200049f0 2021-11-15T19:33:37.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.857+0000 7f243effd700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24240535b0 0x7f2424055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:37.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.861+0000 7f243effd700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24240535b0 0x7f2424055a70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f242800c000 tx=0x7f2428008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:37.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.861+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2430042ef0 con 0x7f24200049f0 2021-11-15T19:33:37.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f24400573d0 con 0x7f24200049f0 2021-11-15T19:33:37.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f243cff9700 1 -- 172.21.2.137:0/633142591 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2430017070 con 0x7f24200049f0 2021-11-15T19:33:37.951 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:37.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24240535b0 msgr2=0x7f2424055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24240535b0 0x7f2424055a70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f242800c000 tx=0x7f2428008040).stop 2021-11-15T19:33:37.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 msgr2=0x7f244014d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:37.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f244014d910 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f2440144e90 tx=0x7f2430008040).stop 2021-11-15T19:33:37.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 shutdown_connections 2021-11-15T19:33:37.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24240535b0 0x7f2424055a70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2440141dd0 0x7f244014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2440144a30 0x7f24400af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:37.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 --2- 172.21.2.137:0/633142591 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24200049f0 0x7f244014d910 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:37.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 >> 172.21.2.137:0/633142591 conn(0x7f2440064960 msgr2=0x7f24400b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:37.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 shutdown_connections 2021-11-15T19:33:37.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:37.941+0000 7f24461d3700 1 -- 172.21.2.137:0/633142591 wait complete. 2021-11-15T19:33:37.958 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:38.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff255940700 1 Processor -- start 2021-11-15T19:33:38.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff255940700 1 -- start start 2021-11-15T19:33:38.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff255940700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff25005c770 0x7ff2500aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff255940700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25005cb50 con 0x7ff250140aa0 2021-11-15T19:33:38.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff255940700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2500ad030 con 0x7ff2500b0550 2021-11-15T19:33:38.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff255940700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2500b1650 con 0x7ff25005c770 2021-11-15T19:33:38.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24e7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff2500b0550 0x7ff25014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55710/0 (socket says 172.21.2.137:55710) 2021-11-15T19:33:38.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24e7fc700 1 -- 172.21.2.137:0/785858716 learned_addr learned my addr 172.21.2.137:0/785858716 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:38.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751108017 0 0) 0x7ff2500ad030 con 0x7ff2500b0550 2021-11-15T19:33:38.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff230003260 con 0x7ff2500b0550 2021-11-15T19:33:38.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000632851 0 0) 0x7ff230003260 con 0x7ff2500b0550 2021-11-15T19:33:38.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 >> v2:172.21.2.111:3300/0 conn(0x7ff25005c770 msgr2=0x7ff2500aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 --2- 172.21.2.137:0/785858716 >> v2:172.21.2.111:3300/0 conn(0x7ff25005c770 0x7ff2500aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 >> v1:172.21.2.111:6789/0 conn(0x7ff250140aa0 legacy=0x7ff250140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500ad2d0 con 0x7ff2500b0550 2021-11-15T19:33:38.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff238001660 con 0x7ff2500b0550 2021-11-15T19:33:38.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 >> v1:172.21.2.137:6789/0 conn(0x7ff2500b0550 legacy=0x7ff25014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff230003820 0x7ff230003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff230004500 0x7ff230004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230005050 0x7ff23000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500b1650 con 0x7ff230005050 2021-11-15T19:33:38.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23000bf40 con 0x7ff230003820 2021-11-15T19:33:38.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23000c100 con 0x7ff230004500 2021-11-15T19:33:38.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24effd700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff230003820 0x7ff230003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24effd700 1 -- 172.21.2.137:0/785858716 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff230004500 msgr2=0x7ff230004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24effd700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff230004500 0x7ff230004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24effd700 1 -- 172.21.2.137:0/785858716 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230005050 msgr2=0x7ff23000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24effd700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230005050 0x7ff23000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24effd700 1 -- 172.21.2.137:0/785858716 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff230003260 con 0x7ff230003820 2021-11-15T19:33:38.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.001+0000 7ff24f7fe700 1 -- 172.21.2.137:0/785858716 reap_dead start 2021-11-15T19:33:38.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24effd700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff230003820 0x7ff230003c20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7ff240002f70 tx=0x7ff240006ca0).ready entity=mon.1 client_cookie=a2b801c9b21d54d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff240012460 con 0x7ff230003820 2021-11-15T19:33:38.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2400125c0 con 0x7ff230003820 2021-11-15T19:33:38.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24dffb700 1 -- 172.21.2.137:0/785858716 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff240012920 con 0x7ff230003820 2021-11-15T19:33:38.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/785858716 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff230003820 msgr2=0x7ff230003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff230003820 0x7ff230003c20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7ff240002f70 tx=0x7ff240006ca0).stop 2021-11-15T19:33:38.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/785858716 shutdown_connections 2021-11-15T19:33:38.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 --2- 172.21.2.137:0/785858716 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff230003820 0x7ff230003c20 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/785858716 >> 172.21.2.137:0/785858716 conn(0x7ff2500631e0 msgr2=0x7ff25005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/785858716 shutdown_connections 2021-11-15T19:33:38.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/785858716 wait complete. 2021-11-15T19:33:38.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 Processor -- start 2021-11-15T19:33:38.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- start start 2021-11-15T19:33:38.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230003820 0x7ff250067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2500b5320 0x7ff250159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 0x7ff2501484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250144a10 con 0x7ff230003820 2021-11-15T19:33:38.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250066ee0 con 0x7ff250159f50 2021-11-15T19:33:38.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25014a600 con 0x7ff2500b5320 2021-11-15T19:33:38.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 0x7ff2501484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 0x7ff2501484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36942/0 (socket says 172.21.2.137:36942) 2021-11-15T19:33:38.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 -- 172.21.2.137:0/29458890 learned_addr learned my addr 172.21.2.137:0/29458890 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 -- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2500b5320 msgr2=0x7ff250159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2500b5320 0x7ff250159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 -- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230003820 msgr2=0x7ff250067310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230003820 0x7ff250067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 -- 172.21.2.137:0/29458890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25014a8a0 con 0x7ff250159f50 2021-11-15T19:33:38.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff24f7fe700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 0x7ff2501484b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7ff250062470 tx=0x7ff248007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2480070d0 con 0x7ff250159f50 2021-11-15T19:33:38.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248007230 con 0x7ff250159f50 2021-11-15T19:33:38.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff248007590 con 0x7ff250159f50 2021-11-15T19:33:38.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25015a400 con 0x7ff250159f50 2021-11-15T19:33:38.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff250063760 con 0x7ff250159f50 2021-11-15T19:33:38.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250067020 con 0x7ff250159f50 2021-11-15T19:33:38.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff24801c070 con 0x7ff250159f50 2021-11-15T19:33:38.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff247fff700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2340536a0 0x7ff234055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.005+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff24806aa00 con 0x7ff250159f50 2021-11-15T19:33:38.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.009+0000 7ff24effd700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2340536a0 0x7ff234055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.009+0000 7ff24effd700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2340536a0 0x7ff234055b60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7ff240002f70 tx=0x7ff240014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.009+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff248041b60 con 0x7ff250159f50 2021-11-15T19:33:38.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2500ae7f0 con 0x7ff250159f50 2021-11-15T19:33:38.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff247fff700 1 -- 172.21.2.137:0/29458890 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff248045180 con 0x7ff250159f50 2021-11-15T19:33:38.103 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:38.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2340536a0 msgr2=0x7ff234055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2340536a0 0x7ff234055b60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7ff240002f70 tx=0x7ff240014000).stop 2021-11-15T19:33:38.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 msgr2=0x7ff2501484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 0x7ff2501484b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7ff250062470 tx=0x7ff248007dd0).stop 2021-11-15T19:33:38.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 shutdown_connections 2021-11-15T19:33:38.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2340536a0 0x7ff234055b60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff250159f50 0x7ff2501484b0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2500b5320 0x7ff250159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 --2- 172.21.2.137:0/29458890 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff230003820 0x7ff250067310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 >> 172.21.2.137:0/29458890 conn(0x7ff2500631e0 msgr2=0x7ff25013ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 shutdown_connections 2021-11-15T19:33:38.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.093+0000 7ff255940700 1 -- 172.21.2.137:0/29458890 wait complete. 2021-11-15T19:33:38.110 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:33:38.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 Processor -- start 2021-11-15T19:33:38.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- start start 2021-11-15T19:33:38.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 0x7fb8f40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8f40b0550 0x7fb8f414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f405cb50 con 0x7fb8f414aaa0 2021-11-15T19:33:38.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40b1650 con 0x7fb8f40b0550 2021-11-15T19:33:38.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40ad030 con 0x7fb8f405c770 2021-11-15T19:33:38.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8f40b0550 0x7fb8f414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb8f40b0550 0x7fb8f414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36948/0 (socket says 172.21.2.137:36948) 2021-11-15T19:33:38.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 -- 172.21.2.137:0/215231702 learned_addr learned my addr 172.21.2.137:0/215231702 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 -- 172.21.2.137:0/215231702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 msgr2=0x7fb8f40aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:38.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 --2- 172.21.2.137:0/215231702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 0x7fb8f40aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 -- 172.21.2.137:0/215231702 >> v1:172.21.2.111:6789/0 conn(0x7fb8f414aaa0 legacy=0x7fb8f4140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:38.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 -- 172.21.2.137:0/215231702 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40ad2d0 con 0x7fb8f40b0550 2021-11-15T19:33:38.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f9740700 1 --2- 172.21.2.137:0/215231702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f414a5b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fb8f40adfd0 tx=0x7fb8e8006eb0).ready entity=mon.1 client_cookie=9971e814a4b23e03 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f8f3f700 1 -- 172.21.2.137:0/215231702 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e800d570 con 0x7fb8f40b0550 2021-11-15T19:33:38.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f8f3f700 1 -- 172.21.2.137:0/215231702 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8000e90 con 0x7fb8f40b0550 2021-11-15T19:33:38.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8f8f3f700 1 -- 172.21.2.137:0/215231702 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e800d8c0 con 0x7fb8f40b0550 2021-11-15T19:33:38.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/215231702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 msgr2=0x7fb8f414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/215231702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f414a5b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fb8f40adfd0 tx=0x7fb8e8006eb0).stop 2021-11-15T19:33:38.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/215231702 shutdown_connections 2021-11-15T19:33:38.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/215231702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f414a5b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/215231702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 0x7fb8f40aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/215231702 >> 172.21.2.137:0/215231702 conn(0x7fb8f40631e0 msgr2=0x7fb8f405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/215231702 shutdown_connections 2021-11-15T19:33:38.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.153+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/215231702 wait complete. 2021-11-15T19:33:38.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 Processor -- start 2021-11-15T19:33:38.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- start start 2021-11-15T19:33:38.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 0x7fb8f4067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f4156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8f414aaa0 0x7fb8f4066330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4065710 con 0x7fb8f414aaa0 2021-11-15T19:33:38.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4143fe0 con 0x7fb8f40b0550 2021-11-15T19:33:38.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4066bc0 con 0x7fb8f405c770 2021-11-15T19:33:38.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f4156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f4156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36956/0 (socket says 172.21.2.137:36956) 2021-11-15T19:33:38.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 -- 172.21.2.137:0/1580220431 learned_addr learned my addr 172.21.2.137:0/1580220431 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 -- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 msgr2=0x7fb8f4067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 0x7fb8f4067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 -- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8f414aaa0 msgr2=0x7fb8f4066330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8f414aaa0 0x7fb8f4066330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 -- 172.21.2.137:0/1580220431 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e800b1e0 con 0x7fb8f40b0550 2021-11-15T19:33:38.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8f9740700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f4156f50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fb8f40adfd0 tx=0x7fb8e8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e8006b60 con 0x7fb8f40b0550 2021-11-15T19:33:38.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8002f70 con 0x7fb8f40b0550 2021-11-15T19:33:38.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4157440 con 0x7fb8f40b0550 2021-11-15T19:33:38.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e800de20 con 0x7fb8f40b0550 2021-11-15T19:33:38.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4066820 con 0x7fb8f40b0550 2021-11-15T19:33:38.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f40ae7f0 con 0x7fb8f40b0550 2021-11-15T19:33:38.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8e8025030 con 0x7fb8f40b0550 2021-11-15T19:33:38.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8e6ffd700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8d4053640 0x7fb8d4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.157+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb8e806cd40 con 0x7fb8f40b0550 2021-11-15T19:33:38.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.161+0000 7fb8f9f41700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8d4053640 0x7fb8d4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.161+0000 7fb8f9f41700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8d4053640 0x7fb8d4055b00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fb8f0002fb0 tx=0x7fb8f00069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.161+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8e8043ea0 con 0x7fb8f40b0550 2021-11-15T19:33:38.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8f40573d0 con 0x7fb8f40b0550 2021-11-15T19:33:38.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8e6ffd700 1 -- 172.21.2.137:0/1580220431 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb8e80230a0 con 0x7fb8f40b0550 2021-11-15T19:33:38.254 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:38.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8d4053640 msgr2=0x7fb8d4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8d4053640 0x7fb8d4055b00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fb8f0002fb0 tx=0x7fb8f00069b0).stop 2021-11-15T19:33:38.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 msgr2=0x7fb8f4156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f4156f50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fb8f40adfd0 tx=0x7fb8e8015000).stop 2021-11-15T19:33:38.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 shutdown_connections 2021-11-15T19:33:38.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb8d4053640 0x7fb8d4055b00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8f414aaa0 0x7fb8f4066330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8f40b0550 0x7fb8f4156f50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 --2- 172.21.2.137:0/1580220431 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8f405c770 0x7fb8f4067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 >> 172.21.2.137:0/1580220431 conn(0x7fb8f40631e0 msgr2=0x7fb8f414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 shutdown_connections 2021-11-15T19:33:38.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.245+0000 7fb8fc1a5700 1 -- 172.21.2.137:0/1580220431 wait complete. 2021-11-15T19:33:38.261 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:33:38.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 Processor -- start 2021-11-15T19:33:38.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- start start 2021-11-15T19:33:38.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 0x7ff2fc0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff2fc0acd60 0x7ff2fc0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff2fc0b4680 0x7ff2fc143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b3100 con 0x7ff2fc0acd60 2021-11-15T19:33:38.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b76c0 con 0x7ff2fc0b4680 2021-11-15T19:33:38.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc12a170 con 0x7ff2fc0b72e0 2021-11-15T19:33:38.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff2fc0b4680 0x7ff2fc143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff2fc0b4680 0x7ff2fc143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36962/0 (socket says 172.21.2.137:36962) 2021-11-15T19:33:38.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 -- 172.21.2.137:0/2540749266 learned_addr learned my addr 172.21.2.137:0/2540749266 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 -- 172.21.2.137:0/2540749266 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 msgr2=0x7ff2fc0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 --2- 172.21.2.137:0/2540749266 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 0x7ff2fc0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 -- 172.21.2.137:0/2540749266 >> v2:172.21.2.111:3300/0 conn(0x7ff2fc0acd60 msgr2=0x7ff2fc0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 --2- 172.21.2.137:0/2540749266 >> v2:172.21.2.111:3300/0 conn(0x7ff2fc0acd60 0x7ff2fc0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 -- 172.21.2.137:0/2540749266 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0ad8a0 con 0x7ff2fc0b4680 2021-11-15T19:33:38.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301869700 1 --2- 172.21.2.137:0/2540749266 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0b4680 0x7ff2fc143ed0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7ff2f40032f0 tx=0x7ff2f4009290).ready entity=mon.1 client_cookie=b08aa41ffa129387 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff2effff700 1 -- 172.21.2.137:0/2540749266 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f400ba60 con 0x7ff2fc0b4680 2021-11-15T19:33:38.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff2effff700 1 -- 172.21.2.137:0/2540749266 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f400bbc0 con 0x7ff2fc0b4680 2021-11-15T19:33:38.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff2effff700 1 -- 172.21.2.137:0/2540749266 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f4010560 con 0x7ff2fc0b4680 2021-11-15T19:33:38.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- 172.21.2.137:0/2540749266 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0b4680 msgr2=0x7ff2fc143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2540749266 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0b4680 0x7ff2fc143ed0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7ff2f40032f0 tx=0x7ff2f4009290).stop 2021-11-15T19:33:38.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- 172.21.2.137:0/2540749266 shutdown_connections 2021-11-15T19:33:38.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2540749266 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0b4680 0x7ff2fc143ed0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2540749266 >> v2:172.21.2.111:3300/0 conn(0x7ff2fc0acd60 0x7ff2fc0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2540749266 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 0x7ff2fc0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- 172.21.2.137:0/2540749266 >> 172.21.2.137:0/2540749266 conn(0x7ff2fc064960 msgr2=0x7ff2fc064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- 172.21.2.137:0/2540749266 shutdown_connections 2021-11-15T19:33:38.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- 172.21.2.137:0/2540749266 wait complete. 2021-11-15T19:33:38.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 Processor -- start 2021-11-15T19:33:38.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- start start 2021-11-15T19:33:38.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 0x7ff2fc1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2fc0b4680 0x7ff2fc124be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 0x7ff2fc062d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc150ec0 con 0x7ff2fc0b4680 2021-11-15T19:33:38.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc151160 con 0x7ff2fc0acd60 2021-11-15T19:33:38.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff3032cc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc151400 con 0x7ff2fc0b72e0 2021-11-15T19:33:38.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301068700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 0x7ff2fc1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301068700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 0x7ff2fc1518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36970/0 (socket says 172.21.2.137:36970) 2021-11-15T19:33:38.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.305+0000 7ff301068700 1 -- 172.21.2.137:0/2521681978 learned_addr learned my addr 172.21.2.137:0/2521681978 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff301068700 1 -- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 msgr2=0x7ff2fc062d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff301068700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 0x7ff2fc062d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff301068700 1 -- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2fc0b4680 msgr2=0x7ff2fc124be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff301068700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2fc0b4680 0x7ff2fc124be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff301068700 1 -- 172.21.2.137:0/2521681978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4009530 con 0x7ff2fc0acd60 2021-11-15T19:33:38.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff301068700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 0x7ff2fc1518a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7ff2f0002f70 tx=0x7ff2f0006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f000e470 con 0x7ff2fc0acd60 2021-11-15T19:33:38.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f000e5d0 con 0x7ff2fc0acd60 2021-11-15T19:33:38.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc063210 con 0x7ff2fc0acd60 2021-11-15T19:33:38.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f000e930 con 0x7ff2fc0acd60 2021-11-15T19:33:38.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc0ae370 con 0x7ff2fc0acd60 2021-11-15T19:33:38.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc0b3a50 con 0x7ff2fc0acd60 2021-11-15T19:33:38.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2f0018030 con 0x7ff2fc0acd60 2021-11-15T19:33:38.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2dc0536f0 0x7ff2dc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff2f006ae90 con 0x7ff2fc0acd60 2021-11-15T19:33:38.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff300867700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2dc0536f0 0x7ff2dc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff300867700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2dc0536f0 0x7ff2dc055bb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ff2f8002f70 tx=0x7ff2f8006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.309+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2f0041f90 con 0x7ff2fc0acd60 2021-11-15T19:33:38.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2fc0573d0 con 0x7ff2fc0acd60 2021-11-15T19:33:38.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff2ee7fc700 1 -- 172.21.2.137:0/2521681978 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff2f00455b0 con 0x7ff2fc0acd60 2021-11-15T19:33:38.403 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:38.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2dc0536f0 msgr2=0x7ff2dc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2dc0536f0 0x7ff2dc055bb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ff2f8002f70 tx=0x7ff2f8006a80).stop 2021-11-15T19:33:38.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 msgr2=0x7ff2fc1518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 0x7ff2fc1518a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7ff2f0002f70 tx=0x7ff2f0006db0).stop 2021-11-15T19:33:38.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 shutdown_connections 2021-11-15T19:33:38.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2dc0536f0 0x7ff2dc055bb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2fc0b72e0 0x7ff2fc062d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2fc0b4680 0x7ff2fc124be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 --2- 172.21.2.137:0/2521681978 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2fc0acd60 0x7ff2fc1518a0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 >> 172.21.2.137:0/2521681978 conn(0x7ff2fc064960 msgr2=0x7ff2fc140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 shutdown_connections 2021-11-15T19:33:38.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.393+0000 7ff3032cc700 1 -- 172.21.2.137:0/2521681978 wait complete. 2021-11-15T19:33:38.410 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:33:38.411 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:38.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 Processor -- start 2021-11-15T19:33:38.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- start start 2021-11-15T19:33:38.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48000b1060 0x7f48000aa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4800098370 0x7f48000987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48000aa0a0 con 0x7f4800098ca0 2021-11-15T19:33:38.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48000aa340 con 0x7f48000b1060 2021-11-15T19:33:38.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48000aa5e0 con 0x7f4800098370 2021-11-15T19:33:38.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48000b1060 0x7f48000aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48000b1060 0x7f48000aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36974/0 (socket says 172.21.2.137:36974) 2021-11-15T19:33:38.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 -- 172.21.2.137:0/566714960 learned_addr learned my addr 172.21.2.137:0/566714960 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 -- 172.21.2.137:0/566714960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4800098370 msgr2=0x7f48000987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 --2- 172.21.2.137:0/566714960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4800098370 0x7f48000987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 -- 172.21.2.137:0/566714960 >> v1:172.21.2.111:6789/0 conn(0x7f4800098ca0 legacy=0x7f480014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:38.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 -- 172.21.2.137:0/566714960 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000a9d20 con 0x7f48000b1060 2021-11-15T19:33:38.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 --2- 172.21.2.137:0/566714960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48000b1060 0x7f48000aa850 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f480005cee0 tx=0x7f47f0006eb0).ready entity=mon.1 client_cookie=2b8a8ff8fdbab8f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f47ff7fe700 1 -- 172.21.2.137:0/566714960 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f000d570 con 0x7f48000b1060 2021-11-15T19:33:38.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f47ff7fe700 1 -- 172.21.2.137:0/566714960 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0000e90 con 0x7f48000b1060 2021-11-15T19:33:38.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f47ff7fe700 1 -- 172.21.2.137:0/566714960 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f000d8c0 con 0x7f48000b1060 2021-11-15T19:33:38.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- 172.21.2.137:0/566714960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48000b1060 msgr2=0x7f48000aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- 172.21.2.137:0/566714960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48000b1060 0x7f48000aa850 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f480005cee0 tx=0x7f47f0006eb0).stop 2021-11-15T19:33:38.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- 172.21.2.137:0/566714960 shutdown_connections 2021-11-15T19:33:38.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- 172.21.2.137:0/566714960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4800098370 0x7f48000987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- 172.21.2.137:0/566714960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48000b1060 0x7f48000aa850 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- 172.21.2.137:0/566714960 >> 172.21.2.137:0/566714960 conn(0x7f48000b22b0 msgr2=0x7f480005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- 172.21.2.137:0/566714960 shutdown_connections 2021-11-15T19:33:38.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- 172.21.2.137:0/566714960 wait complete. 2021-11-15T19:33:38.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 Processor -- start 2021-11-15T19:33:38.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- start start 2021-11-15T19:33:38.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 0x7f4800099c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4800098ca0 0x7f4800065060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48000b1060 0x7f4800065550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48000aeb70 con 0x7f4800098ca0 2021-11-15T19:33:38.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4800062f40 con 0x7f4800098370 2021-11-15T19:33:38.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4805ddc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48000aefb0 con 0x7f48000b1060 2021-11-15T19:33:38.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 0x7f4800099c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 0x7f4800099c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36980/0 (socket says 172.21.2.137:36980) 2021-11-15T19:33:38.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.453+0000 7f4804dda700 1 -- 172.21.2.137:0/307299478 learned_addr learned my addr 172.21.2.137:0/307299478 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:38.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4804dda700 1 -- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48000b1060 msgr2=0x7f4800065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4804dda700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48000b1060 0x7f4800065550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4804dda700 1 -- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4800098ca0 msgr2=0x7f4800065060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4804dda700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4800098ca0 0x7f4800065060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4804dda700 1 -- 172.21.2.137:0/307299478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f000b1e0 con 0x7f4800098370 2021-11-15T19:33:38.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4804dda700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 0x7f4800099c20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f480005cee0 tx=0x7f47f0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f0002f70 con 0x7f4800098370 2021-11-15T19:33:38.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000de20 con 0x7f4800098370 2021-11-15T19:33:38.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f001e460 con 0x7f4800098370 2021-11-15T19:33:38.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4800062ca0 con 0x7f4800098370 2021-11-15T19:33:38.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480009a110 con 0x7f4800098370 2021-11-15T19:33:38.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48000573d0 con 0x7f4800098370 2021-11-15T19:33:38.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f47f0025030 con 0x7f4800098370 2021-11-15T19:33:38.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fdffb700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:38.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f47f006cd30 con 0x7f4800098370 2021-11-15T19:33:38.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fffff700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:38.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.457+0000 7f47fffff700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f47e8002f70 tx=0x7f47e8006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:38.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.461+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f47f0043dc0 con 0x7f4800098370 2021-11-15T19:33:38.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.565+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4800064de0 con 0x7f4800098370 2021-11-15T19:33:38.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f47fdffb700 1 -- 172.21.2.137:0/307299478 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f47f0023020 con 0x7f4800098370 2021-11-15T19:33:38.577 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:38.577 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:33.558072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6577":{"gid":6577,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2662817327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2662817327},{"type":"v1","addr":"172.21.2.137:6833","nonce":2662817327}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:38.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 msgr2=0x7f47e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f47e8002f70 tx=0x7f47e8006a80).stop 2021-11-15T19:33:38.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 msgr2=0x7f4800099c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:38.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 0x7f4800099c20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f480005cee0 tx=0x7f47f0015000).stop 2021-11-15T19:33:38.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 shutdown_connections 2021-11-15T19:33:38.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48000b1060 0x7f4800065550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4800098ca0 0x7f4800065060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:38.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 --2- 172.21.2.137:0/307299478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4800098370 0x7f4800099c20 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:38.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 >> 172.21.2.137:0/307299478 conn(0x7f48000b22b0 msgr2=0x7f48000b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:38.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 shutdown_connections 2021-11-15T19:33:38.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:38.569+0000 7f4805ddc700 1 -- 172.21.2.137:0/307299478 wait complete. 2021-11-15T19:33:38.581 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 37 2021-11-15T19:33:38.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:33:32.554900+0000', 'modified': '2021-11-15T19:33:33.558072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6577': {'gid': 6577, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/2662817327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 2662817327}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 2662817327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:38.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:38.787 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:38.852 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6577,"want_state":"up:active","state":"up:active","rank_uptime":6.2866532639999999,"mdsmap_epoch":37,"osdmap_epoch":84,"osdmap_epoch_barrier":83,"uptime":10.399922021} 2021-11-15T19:33:38.852 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6577, "mdsmap_epoch": 37, "osdmap_epoch": 84, "osdmap_epoch_barrier": 83, "rank_uptime": 6.286653264, "state": "up:active", "uptime": 10.399922021, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:38.853 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:33:38.853 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:33:38.854 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:33:38.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:38.855 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:38.865 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:33:38.920 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:38.921 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:38.926 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:38.927 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:38.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:38.928 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:33:38.932 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:33:38.933 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:38.975 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:33:38.985 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:38.985 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:38.990 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:38.991 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:38.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:38.992 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:33:39.013 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:33:39.011+0000 7fcea55d7080 -1 init, newargv = 0x55ec89e5a900 newargc=9 2021-11-15T19:33:39.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14258]: starting ceph client 2021-11-15T19:33:39.024 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14258]: starting fuse 2021-11-15T19:33:40.096 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:33:40.108 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:40.109 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:40.169 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:40.171 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:40.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.172 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:33:40.181 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:33:40.182 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:33:40.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.183 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:33:40.183 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:33:40.183 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:33:40.184 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:33:40.184 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:33:40.185 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:40.185 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:33:40.186 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:33:40.186 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:33:40.186 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:40.187 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:33:40.187 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:33:40.188 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:33:40.188 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:33:40.188 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:40.189 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:33:40.189 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:33:40.190 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:33:40.190 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:33:40.191 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:33:40.191 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:40.191 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:33:40.192 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:33:40.227 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14258.asok 2021-11-15T19:33:40.230 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14258.asok 2021-11-15T19:33:40.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.231 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14258.asok status 2021-11-15T19:33:40.338 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:33:40.338 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:33:40.339 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:33:40.339 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:33:40.339 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:33:40.339 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:33:40.339 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:33:40.340 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14258", 2021-11-15T19:33:40.340 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:33:40.340 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:33:40.340 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:33:40.341 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:33:40.341 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 4733, 2021-11-15T19:33:40.341 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:33:40.341 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:33:40.342 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:33:40.342 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 4733 2021-11-15T19:33:40.342 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:33:40.342 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:33:40.343 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:33:40.343 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:33:40.343 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 50614383 2021-11-15T19:33:40.343 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:33:40.343 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:33:40.344 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:33:40.344 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:33:40.344 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:33:40.344 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 50614383 2021-11-15T19:33:40.345 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:33:40.345 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.4733 172.21.2.118:0/50614383", 2021-11-15T19:33:40.345 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/50614383", 2021-11-15T19:33:40.345 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:33:40.346 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 37, 2021-11-15T19:33:40.346 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 84, 2021-11-15T19:33:40.346 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:33:40.346 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:33:40.347 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:33:40.347 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:33:40.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.349 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:40.349 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:40.356 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:33:40.357 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:33:40.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.358 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:40.372 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:40.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 Processor -- start 2021-11-15T19:33:40.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 -- start start 2021-11-15T19:33:40.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f66380b1340 0x7f6638147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6638143f00 0x7f6638144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380a9f50 0x7f66380aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6638148190 con 0x7f66380b1340 2021-11-15T19:33:40.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380b1720 con 0x7f6638143f00 2021-11-15T19:33:40.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f663de9e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638147e70 con 0x7f66380a9f50 2021-11-15T19:33:40.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6638143f00 0x7f6638144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:40.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6638143f00 0x7f6638144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36990/0 (socket says 172.21.2.137:36990) 2021-11-15T19:33:40.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 -- 172.21.2.137:0/3125275553 learned_addr learned my addr 172.21.2.137:0/3125275553 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:40.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 -- 172.21.2.137:0/3125275553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380a9f50 msgr2=0x7f66380aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:40.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 --2- 172.21.2.137:0/3125275553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380a9f50 0x7f66380aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 -- 172.21.2.137:0/3125275553 >> v2:172.21.2.111:3300/0 conn(0x7f66380b1340 msgr2=0x7f6638147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:40.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 --2- 172.21.2.137:0/3125275553 >> v2:172.21.2.111:3300/0 conn(0x7f66380b1340 0x7f6638147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 -- 172.21.2.137:0/3125275553 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380af800 con 0x7f6638143f00 2021-11-15T19:33:40.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f6636ffd700 1 --2- 172.21.2.137:0/3125275553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638144390 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f662c002f70 tx=0x7f662c006eb0).ready entity=mon.1 client_cookie=44c897f507bf98f9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:40.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f66367fc700 1 -- 172.21.2.137:0/3125275553 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662c00d570 con 0x7f6638143f00 2021-11-15T19:33:40.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f66367fc700 1 -- 172.21.2.137:0/3125275553 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c000e90 con 0x7f6638143f00 2021-11-15T19:33:40.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.417+0000 7f66367fc700 1 -- 172.21.2.137:0/3125275553 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662c00d900 con 0x7f6638143f00 2021-11-15T19:33:40.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/3125275553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 msgr2=0x7f6638144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:40.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- 172.21.2.137:0/3125275553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638144390 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f662c002f70 tx=0x7f662c006eb0).stop 2021-11-15T19:33:40.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/3125275553 shutdown_connections 2021-11-15T19:33:40.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- 172.21.2.137:0/3125275553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380a9f50 0x7f66380aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- 172.21.2.137:0/3125275553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638144390 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:40.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- 172.21.2.137:0/3125275553 >> v2:172.21.2.111:3300/0 conn(0x7f66380b1340 0x7f6638147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/3125275553 >> 172.21.2.137:0/3125275553 conn(0x7f66380b4e60 msgr2=0x7f66380b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:40.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/3125275553 shutdown_connections 2021-11-15T19:33:40.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/3125275553 wait complete. 2021-11-15T19:33:40.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 Processor -- start 2021-11-15T19:33:40.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- start start 2021-11-15T19:33:40.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66380a9f50 0x7f6638098130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380b1340 0x7f6638142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6638098780 con 0x7f66380a9f50 2021-11-15T19:33:40.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6638098a20 con 0x7f6638143f00 2021-11-15T19:33:40.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638143910 con 0x7f66380b1340 2021-11-15T19:33:40.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:40.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638143420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:36996/0 (socket says 172.21.2.137:36996) 2021-11-15T19:33:40.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 -- 172.21.2.137:0/1372658045 learned_addr learned my addr 172.21.2.137:0/1372658045 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:40.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 -- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380b1340 msgr2=0x7f6638142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:40.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380b1340 0x7f6638142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 -- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66380a9f50 msgr2=0x7f6638098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:40.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66380a9f50 0x7f6638098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 -- 172.21.2.137:0/1372658045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c00b1e0 con 0x7f6638143f00 2021-11-15T19:33:40.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6637fff700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638143420 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f66300032f0 tx=0x7f66300091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:40.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663000d4a0 con 0x7f6638143f00 2021-11-15T19:33:40.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000d600 con 0x7f6638143f00 2021-11-15T19:33:40.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66381498c0 con 0x7f6638143f00 2021-11-15T19:33:40.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663000d960 con 0x7f6638143f00 2021-11-15T19:33:40.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66380ade50 con 0x7f6638143f00 2021-11-15T19:33:40.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6638149ab0 con 0x7f6638143f00 2021-11-15T19:33:40.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.421+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6630018030 con 0x7f6638143f00 2021-11-15T19:33:40.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.425+0000 7f6634ff9700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66180536a0 0x7f6618055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:40.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.425+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f663006b260 con 0x7f6638143f00 2021-11-15T19:33:40.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.425+0000 7f66377fe700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66180536a0 0x7f6618055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:40.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.425+0000 7f66377fe700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66180536a0 0x7f6618055b60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6628002f70 tx=0x7f6628006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:40.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.425+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6630042470 con 0x7f6638143f00 2021-11-15T19:33:40.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.533+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f663805faf0 con 0x7f6638143f00 2021-11-15T19:33:40.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f6634ff9700 1 -- 172.21.2.137:0/1372658045 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f6630045a90 con 0x7f6638143f00 2021-11-15T19:33:40.545 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:40.546 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:33.558072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6577":{"gid":6577,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2662817327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2662817327},{"type":"v1","addr":"172.21.2.137:6833","nonce":2662817327}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:40.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66180536a0 msgr2=0x7f6618055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:40.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66180536a0 0x7f6618055b60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6628002f70 tx=0x7f6628006960).stop 2021-11-15T19:33:40.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 msgr2=0x7f6638143420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:40.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638143420 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f66300032f0 tx=0x7f66300091a0).stop 2021-11-15T19:33:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 shutdown_connections 2021-11-15T19:33:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66180536a0 0x7f6618055b60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6638143f00 0x7f6638143420 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66380b1340 0x7f6638142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 --2- 172.21.2.137:0/1372658045 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66380a9f50 0x7f6638098130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 >> 172.21.2.137:0/1372658045 conn(0x7f66380b4e60 msgr2=0x7f663813e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 shutdown_connections 2021-11-15T19:33:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:40.537+0000 7f663de9e700 1 -- 172.21.2.137:0/1372658045 wait complete. 2021-11-15T19:33:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 37 2021-11-15T19:33:40.552 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1 2021-11-15T19:33:40.610 INFO:teuthology.orchestra.run.gibba037.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-11-15T19:33:37.632836+0000","btime":"2021-11-15T19:33:32.558162+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-11-15T19:33:32.558162+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-11-15T19:33:37.632836+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-11-15T19:33:32.558162+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":4724,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":4733,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-11-15T19:33:40.611 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-11-15T19:33:32.558162+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-11-15T19:33:32.558162+0000", "change_attr": 1, "client_caps": [ { "client_id": 4724, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 4733, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-11-15T19:33:37.632836+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-11-15T19:33:32.558162+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-11-15T19:33:37.632836+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-11-15T19:33:40.611 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:33:40.612 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:40.620 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:40.633 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:40.646 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:40.659 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:40.669 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:33:40.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.669 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:40.670 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:40.675 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:33:40.676 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:40.676 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:33:40.677 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:33:40.677 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:40.684 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14843]: fuse finished with error 0 and tester_r 0 2021-11-15T19:33:40.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.685 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:40.686 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:40.734 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:33:40.735 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:33:40.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:40.856 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:40.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.866 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:40.866 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:40.878 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:33:40.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:33:40.879 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:33:40.880 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:33:40.880 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:40.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14258]: fuse finished with error 0 and tester_r 0 2021-11-15T19:33:40.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:40.896 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:40.896 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:40.900 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:33:40.901 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:33:41.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:41.011 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:41.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:41.015 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:41.016 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:33:41.025 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:33:41.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:41.027 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:33:41.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:33:41.028 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:33:41.076 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:33:41.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:41.078 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:33:41.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 Processor -- start 2021-11-15T19:33:41.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- start start 2021-11-15T19:33:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1bf40b1340 0x7f1bf4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1bf4143f00 0x7f1bf4144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf4148190 con 0x7f1bf40a9f50 2021-11-15T19:33:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf40b1720 con 0x7f1bf4143f00 2021-11-15T19:33:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf4147e70 con 0x7f1bf40b1340 2021-11-15T19:33:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1bf40b1340 0x7f1bf4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1bf40b1340 0x7f1bf4147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37004/0 (socket says 172.21.2.137:37004) 2021-11-15T19:33:41.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 -- 172.21.2.137:0/2870232280 learned_addr learned my addr 172.21.2.137:0/2870232280 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:41.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 -- 172.21.2.137:0/2870232280 >> v2:172.21.2.111:3300/0 conn(0x7f1bf4143f00 msgr2=0x7f1bf4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 --2- 172.21.2.137:0/2870232280 >> v2:172.21.2.111:3300/0 conn(0x7f1bf4143f00 0x7f1bf4144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 -- 172.21.2.137:0/2870232280 >> v1:172.21.2.111:6789/0 conn(0x7f1bf40a9f50 legacy=0x7f1bf40aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 -- 172.21.2.137:0/2870232280 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf40af800 con 0x7f1bf40b1340 2021-11-15T19:33:41.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf9eea700 1 --2- 172.21.2.137:0/2870232280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf40b1340 0x7f1bf4147980 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f1bf4062250 tx=0x7f1bf0006eb0).ready entity=mon.1 client_cookie=beaad0c886542f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf8ee8700 1 -- 172.21.2.137:0/2870232280 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf000d5c0 con 0x7f1bf40b1340 2021-11-15T19:33:41.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf8ee8700 1 -- 172.21.2.137:0/2870232280 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0000e90 con 0x7f1bf40b1340 2021-11-15T19:33:41.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bf8ee8700 1 -- 172.21.2.137:0/2870232280 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf000d910 con 0x7f1bf40b1340 2021-11-15T19:33:41.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- 172.21.2.137:0/2870232280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf40b1340 msgr2=0x7f1bf4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/2870232280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf40b1340 0x7f1bf4147980 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f1bf4062250 tx=0x7f1bf0006eb0).stop 2021-11-15T19:33:41.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- 172.21.2.137:0/2870232280 shutdown_connections 2021-11-15T19:33:41.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/2870232280 >> v2:172.21.2.111:3300/0 conn(0x7f1bf4143f00 0x7f1bf4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/2870232280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf40b1340 0x7f1bf4147980 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- 172.21.2.137:0/2870232280 >> 172.21.2.137:0/2870232280 conn(0x7f1bf40b4e60 msgr2=0x7f1bf40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:41.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- 172.21.2.137:0/2870232280 shutdown_connections 2021-11-15T19:33:41.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- 172.21.2.137:0/2870232280 wait complete. 2021-11-15T19:33:41.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 Processor -- start 2021-11-15T19:33:41.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.121+0000 7f1bfc14e700 1 -- start start 2021-11-15T19:33:41.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bf40a9f50 0x7f1bf4140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bf40b1340 0x7f1bf4142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 0x7f1bf41433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf414ae20 con 0x7f1bf40b1340 2021-11-15T19:33:41.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf40ac9e0 con 0x7f1bf4143f00 2021-11-15T19:33:41.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf41438d0 con 0x7f1bf40a9f50 2021-11-15T19:33:41.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 0x7f1bf41433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 0x7f1bf41433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37012/0 (socket says 172.21.2.137:37012) 2021-11-15T19:33:41.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 -- 172.21.2.137:0/3181061707 learned_addr learned my addr 172.21.2.137:0/3181061707 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:41.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bf9eea700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bf40a9f50 0x7f1bf4140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 -- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bf40a9f50 msgr2=0x7f1bf4140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bf96e9700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bf40b1340 0x7f1bf4142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bf40a9f50 0x7f1bf4140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 -- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bf40b1340 msgr2=0x7f1bf4142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bf40b1340 0x7f1bf4142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 -- 172.21.2.137:0/3181061707 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf000b1e0 con 0x7f1bf4143f00 2021-11-15T19:33:41.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bf9eea700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bf40a9f50 0x7f1bf4140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:41.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bf96e9700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bf40b1340 0x7f1bf4142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:41.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfa6eb700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 0x7f1bf41433e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f1bec003270 tx=0x7f1bec0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bec00d4a0 con 0x7f1bf4143f00 2021-11-15T19:33:41.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00d600 con 0x7f1bf4143f00 2021-11-15T19:33:41.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bec00d960 con 0x7f1bf4143f00 2021-11-15T19:33:41.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf40acc80 con 0x7f1bf4143f00 2021-11-15T19:33:41.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf40ac2a0 con 0x7f1bf4143f00 2021-11-15T19:33:41.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf414af90 con 0x7f1bf4143f00 2021-11-15T19:33:41.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1bec018030 con 0x7f1bf4143f00 2021-11-15T19:33:41.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1be2ffd700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bd4053520 0x7f1bd40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1bec06b1f0 con 0x7f1bf4143f00 2021-11-15T19:33:41.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bf9eea700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bd4053520 0x7f1bd40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.125+0000 7f1bf9eea700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bd4053520 0x7f1bd40559e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f1bf0017000 tx=0x7f1bf0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.129+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1bf414af90 con 0x7f1bf4143f00 2021-11-15T19:33:41.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.209+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1bf414af90 con 0x7f1bf4143f00 2021-11-15T19:33:41.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.209+0000 7f1be2ffd700 1 -- 172.21.2.137:0/3181061707 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v84) v1 ==== 81+0+33648 (secure 0 0 0) 0x7f1bec028380 con 0x7f1bf4143f00 2021-11-15T19:33:41.220 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:41.220 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:33:41.220 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 84, 2021-11-15T19:33:41.221 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:33:41.221 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:33:41.221 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:33:33.559283+0000", 2021-11-15T19:33:41.221 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:41.221 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:41.222 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:33:41.222 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:33:41.222 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:33:41.222 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:33:41.223 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:33:41.223 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:33:41.223 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:33:41.223 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:41.224 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:33:41.224 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:33:41.224 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:33:41.224 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:33:41.224 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:33:41.224 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 16, 2021-11-15T19:33:41.225 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:33:41.225 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:33:41.225 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:33:41.225 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:33:41.225 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:33:41.226 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.226 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:33:41.226 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:33:41.226 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:33:41.227 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:41.227 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:41.227 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:41.227 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:41.227 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:41.228 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:41.228 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:41.228 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:41.228 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:33:41.228 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:33:41.229 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:33:41.229 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:33:41.229 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:33:41.229 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:41.230 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:41.230 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:41.230 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:41.230 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:41.230 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:41.231 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:41.231 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.231 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:33:41.231 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:41.231 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:41.232 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:41.232 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:41.232 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:41.232 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:41.233 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:41.233 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:41.233 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:41.233 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:41.233 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:41.234 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:41.234 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:41.234 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:41.234 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:41.234 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:41.235 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:41.235 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:41.235 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:41.235 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:41.236 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:41.236 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:41.236 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:41.236 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:41.236 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:41.237 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:41.237 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.237 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:41.237 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:41.238 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:41.238 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:41.238 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:41.238 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:41.238 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:41.239 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:41.239 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:41.239 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:41.239 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:41.240 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:33:41.240 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:33:41.240 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.240 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:41.240 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:33:41.241 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.241 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.241 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.241 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:33:41.242 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:33:41.242 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:33:41.242 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:41.242 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:41.242 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:41.243 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:41.243 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:41.243 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:41.243 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:41.243 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:41.244 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:41.244 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:41.244 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:41.244 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:41.245 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:41.245 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:41.245 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:41.245 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:41.245 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:41.246 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:41.246 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:41.246 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:41.246 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.247 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:33:41.247 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:41.247 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:41.247 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:41.247 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:41.248 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:41.248 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:41.248 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:41.248 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:41.248 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:41.249 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:41.249 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:41.249 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:41.249 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:41.250 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:41.250 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:41.250 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:41.250 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:41.251 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:41.251 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:41.251 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:41.251 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:41.251 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:41.252 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:41.252 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:41.252 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:41.252 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:41.253 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.253 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:41.253 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:41.253 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:41.253 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:41.254 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:41.254 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:41.254 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:41.254 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:41.255 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:41.255 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:41.255 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:41.255 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:33:41.255 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:41.256 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:33:41.256 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.256 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.256 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.256 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 15, 2021-11-15T19:33:41.257 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:33:41.257 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:33:30.496786+0000", 2021-11-15T19:33:41.257 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:41.257 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:41.257 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:41.258 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:41.258 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:41.258 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:41.258 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:41.259 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:41.259 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:41.259 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:41.259 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:41.259 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:41.260 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:41.260 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:41.260 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:41.260 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:41.260 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:41.261 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:41.261 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:41.261 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:41.261 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.262 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "83", 2021-11-15T19:33:41.262 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:41.262 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:41.262 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:41.262 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:41.263 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:41.263 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:41.263 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:41.263 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:41.263 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:41.264 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:41.264 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:41.264 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:41.264 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:41.264 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:41.265 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:41.265 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:41.265 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:41.265 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:41.266 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:41.266 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:41.266 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:41.266 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:41.266 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:41.267 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:41.267 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:41.267 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:41.267 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.267 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:41.268 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:41.268 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:41.268 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:41.268 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:41.268 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:41.269 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:41.269 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:41.269 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:41.269 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:41.270 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:41.270 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:33:41.270 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:33:41.270 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:33:41.270 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:33:41.271 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.271 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:41.271 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:33:41.271 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:33:41.271 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.272 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.272 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.272 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.272 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 16, 2021-11-15T19:33:41.272 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:33:41.273 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:33:31.537268+0000", 2021-11-15T19:33:41.273 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:41.273 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:41.273 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:41.274 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:41.274 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:41.274 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:41.274 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:41.274 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:41.275 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:41.275 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:41.275 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:41.275 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:41.275 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:41.276 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:41.276 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:41.276 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:41.276 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:41.276 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:41.277 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:41.277 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:41.277 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.277 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "84", 2021-11-15T19:33:41.278 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:41.278 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:41.278 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:41.278 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:41.278 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:41.279 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:41.279 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:41.279 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:41.279 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:41.279 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:41.280 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:41.280 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:41.280 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:41.280 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:41.280 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:41.281 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:41.281 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:41.281 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:41.281 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:41.281 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:41.282 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:41.282 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:41.282 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:41.282 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:41.282 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:41.283 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:41.283 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.283 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:41.283 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:41.284 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:41.284 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:41.284 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:41.284 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:41.284 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:41.285 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:41.285 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:41.285 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:41.285 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:41.285 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:33:41.286 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:41.286 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:33:41.286 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:33:41.286 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.287 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.287 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.287 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:41.287 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:33:41.287 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.288 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:41.288 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:33:41.288 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.288 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.289 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.289 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.289 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.289 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.289 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.290 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:41.290 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.290 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.290 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.291 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.291 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.291 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.291 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:33:41.292 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.292 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.292 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.292 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.292 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:33:41.293 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.293 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.293 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.293 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.294 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.294 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.294 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.294 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.294 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:33:41.295 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.295 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.295 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.295 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.295 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:33:41.296 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.296 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.296 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.296 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.296 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.297 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.297 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.297 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.297 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:33:41.297 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.298 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.298 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.298 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.298 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:33:41.298 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.299 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.299 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.299 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.299 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.299 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.300 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.300 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.300 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:33:41.300 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.300 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.301 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.301 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.301 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:33:41.301 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:41.301 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.302 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.302 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.302 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:33:41.302 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:33:41.303 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:33:41.303 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:33:41.303 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.303 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.303 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.304 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.304 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.304 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.304 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:41.304 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:33:41.305 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.305 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.305 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.305 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.305 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.306 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.306 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.306 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 80, 2021-11-15T19:33:41.306 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.307 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.307 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.307 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.307 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.307 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.308 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:33:41.308 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.308 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.308 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.308 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.309 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:33:41.309 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.309 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.309 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.309 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.310 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.310 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.310 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.310 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.310 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:33:41.311 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.311 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.311 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.311 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.311 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:33:41.312 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.312 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.312 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.312 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.312 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.313 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.313 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.313 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.313 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:33:41.314 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.314 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.314 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.314 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.314 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:33:41.315 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.315 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.315 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.315 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.316 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.316 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.316 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.316 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.316 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:33:41.317 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.317 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.317 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.317 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.317 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:33:41.318 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:41.318 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.318 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.318 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.318 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:33:41.319 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:33:41.319 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:33:41.319 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:33:41.319 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.320 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.320 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.320 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.320 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.320 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.321 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:41.321 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:33:41.321 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.321 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.321 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.322 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.322 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.322 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.322 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.322 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:41.323 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.323 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.323 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.323 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.323 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.324 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.324 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:33:41.324 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.324 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.324 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.325 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.325 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:33:41.325 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.325 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.325 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.326 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.326 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.326 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.326 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.326 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.327 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:33:41.327 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.327 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.327 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.327 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.328 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:33:41.328 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.328 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.328 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.328 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.329 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.329 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.329 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.329 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.329 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:33:41.330 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.330 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.330 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.330 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.330 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:33:41.331 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.331 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.331 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.331 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.331 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.332 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.332 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.332 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.332 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:33:41.332 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.333 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.333 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.333 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.333 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:33:41.333 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:41.334 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.334 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.334 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.334 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:33:41.335 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:33:41.335 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:33:41.335 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:33:41.335 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.335 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.336 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.336 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.336 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.336 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.336 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:41.336 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:33:41.337 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.337 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.337 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.337 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.337 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.338 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.338 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.338 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:41.338 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.339 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.339 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.339 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.339 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.339 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.340 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:33:41.340 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.340 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.340 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.340 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.341 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:33:41.341 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.341 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.341 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.342 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.342 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.342 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.342 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.342 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.343 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:33:41.343 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.343 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.343 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.344 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.344 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:33:41.344 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.344 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.344 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.345 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.345 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.345 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.345 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.346 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.346 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:33:41.346 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.346 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.346 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.347 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.347 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:33:41.347 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.347 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.347 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.348 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.348 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.348 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.348 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.348 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.349 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:33:41.349 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.349 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.349 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.349 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.350 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:33:41.350 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:41.350 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.350 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.351 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.351 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:33:41.351 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:33:41.351 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:33:41.351 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:33:41.352 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.352 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.352 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.352 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.352 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.353 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.353 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:41.353 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:33:41.353 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.353 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.354 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.354 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.354 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.354 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.355 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.355 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:41.355 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.355 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.355 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.356 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.356 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.356 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.356 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:33:41.356 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.357 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.357 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.357 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.357 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:33:41.357 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.358 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.358 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.358 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.358 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.359 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.359 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.359 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.359 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:33:41.359 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.360 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.360 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.360 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.360 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:33:41.360 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.361 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.361 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.361 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.361 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.362 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.362 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.362 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.362 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:33:41.362 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.363 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.363 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.363 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.363 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:33:41.364 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.364 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.364 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.364 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.364 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.365 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.365 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.365 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.365 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:33:41.365 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.366 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.366 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.366 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.366 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:33:41.366 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:41.367 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.367 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.367 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.367 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:33:41.368 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:33:41.368 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:33:41.368 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:33:41.368 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.368 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.369 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.369 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.369 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.369 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.369 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:41.370 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:33:41.370 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.370 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.370 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.371 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.371 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.371 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.371 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.371 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:41.372 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.372 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.372 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.372 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.372 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.373 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.373 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:33:41.373 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.373 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.373 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.374 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.374 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:33:41.374 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.374 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.374 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.375 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.375 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.375 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.375 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.375 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.376 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:33:41.376 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.376 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.376 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.377 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.377 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:33:41.377 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.377 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.377 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.378 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.378 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.378 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.378 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.378 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.379 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:33:41.379 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.379 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.379 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.380 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.380 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:33:41.380 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.380 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.380 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.381 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.381 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.381 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.381 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.381 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.382 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:33:41.382 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.382 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.382 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.382 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.383 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:33:41.383 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:41.383 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.383 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.384 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.384 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:33:41.384 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:33:41.384 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:33:41.384 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:33:41.385 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.385 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.385 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.385 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.385 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.386 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.386 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:41.386 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:33:41.386 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.387 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.387 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.387 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.387 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.387 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.388 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.388 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:41.388 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.388 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.388 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.389 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.389 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.389 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.389 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:33:41.389 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.390 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.390 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.390 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.390 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:33:41.391 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.391 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.391 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.391 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.391 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.392 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.392 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.392 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.392 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:33:41.393 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.393 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.393 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.393 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.393 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:33:41.394 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.394 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.394 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.394 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.394 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.395 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.395 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.395 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.395 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:33:41.395 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.396 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.396 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.396 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.397 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:33:41.397 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.397 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.397 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.398 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.398 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.398 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.398 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.398 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.399 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:33:41.399 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.399 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.399 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.400 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.400 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:33:41.400 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:41.400 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.400 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.401 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.401 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:33:41.401 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:33:41.401 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:33:41.401 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:33:41.402 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.402 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.402 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.402 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.403 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.403 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.403 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:41.403 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:33:41.403 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:41.404 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:41.404 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:41.404 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:41.404 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:41.405 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:41.405 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:41.405 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 70, 2021-11-15T19:33:41.405 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:41.405 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:41.406 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:41.406 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.406 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.406 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.407 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:33:41.407 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.407 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.407 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.408 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.408 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:33:41.408 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.408 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.408 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.409 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.409 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:41.409 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.409 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.410 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.410 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:33:41.410 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.410 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.410 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.411 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.411 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:33:41.411 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.411 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.411 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.412 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.412 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:41.412 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.412 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.413 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.413 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:33:41.413 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.413 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.413 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.414 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.414 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:33:41.414 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.414 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.415 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.415 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.415 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:41.415 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:41.416 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.416 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:41.416 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:33:41.416 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.416 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.417 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.417 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:41.417 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:33:41.417 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:41.417 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.418 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.418 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.418 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:33:41.418 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:33:41.419 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:33:41.419 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:33:41.419 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:41.419 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:41.419 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:41.420 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:41.420 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.420 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:41.420 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:33:41.420 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.421 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:41.421 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.421 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.421 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.422 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.422 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.422 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:33:41.422 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.422 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.423 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.423 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:41.423 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.423 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.424 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.424 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.424 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.424 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:33:41.424 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.425 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.425 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.425 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:41.425 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.426 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.426 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.426 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.426 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.426 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:33:41.427 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.427 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.427 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.427 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:41.428 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.428 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.428 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.428 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.429 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.429 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:33:41.429 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.429 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.429 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.430 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:41.430 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.430 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.430 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.430 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.431 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.431 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:33:41.431 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.431 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.431 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.432 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:41.432 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.432 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.432 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.432 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.433 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.433 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:33:41.433 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.433 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.433 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.434 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:41.434 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.434 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.434 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.434 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.435 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.435 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:33:41.435 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.435 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.436 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:41.436 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:41.436 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:41.436 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:41.436 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:41.437 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:41.437 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:41.437 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:33:41.437 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:41.437 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.437 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:41.438 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:33:41.438 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:33:41.438 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:33:41.438 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:33:41.438 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:33:41.439 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:33:41.439 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:33:41.439 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:33:41.439 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:33:41.440 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:33:41.440 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:33:41.440 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:33:41.440 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:33:41.440 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:41.441 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:41.441 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:33:41.441 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:33:41.441 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:33:41.441 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:33:41.442 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:33:41.442 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:33:41.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.209+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bd4053520 msgr2=0x7f1bd40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.209+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bd4053520 0x7f1bd40559e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f1bf0017000 tx=0x7f1bf0015000).stop 2021-11-15T19:33:41.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.209+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 msgr2=0x7f1bf41433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.209+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 0x7f1bf41433e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f1bec003270 tx=0x7f1bec0090f0).stop 2021-11-15T19:33:41.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 shutdown_connections 2021-11-15T19:33:41.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bd4053520 0x7f1bd40559e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bf4143f00 0x7f1bf41433e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bf40b1340 0x7f1bf4142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 --2- 172.21.2.137:0/3181061707 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bf40a9f50 0x7f1bf4140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 >> 172.21.2.137:0/3181061707 conn(0x7f1bf40b4e60 msgr2=0x7f1bf40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:41.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 shutdown_connections 2021-11-15T19:33:41.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.213+0000 7f1bfc14e700 1 -- 172.21.2.137:0/3181061707 wait complete. 2021-11-15T19:33:41.446 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:41.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 Processor -- start 2021-11-15T19:33:41.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- start start 2021-11-15T19:33:41.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700b1340 0x7f3370147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3370143f00 0x7f3370144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f33700a9f50 0x7f33700aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3370148190 con 0x7f33700a9f50 2021-11-15T19:33:41.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700b1720 con 0x7f3370143f00 2021-11-15T19:33:41.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3370147e70 con 0x7f33700b1340 2021-11-15T19:33:41.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3370143f00 0x7f3370144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3370143f00 0x7f3370144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37020/0 (socket says 172.21.2.137:37020) 2021-11-15T19:33:41.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 -- 172.21.2.137:0/1972812134 learned_addr learned my addr 172.21.2.137:0/1972812134 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:41.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 -- 172.21.2.137:0/1972812134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700b1340 msgr2=0x7f3370147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 --2- 172.21.2.137:0/1972812134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700b1340 0x7f3370147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 -- 172.21.2.137:0/1972812134 >> v2:172.21.2.111:3300/0 conn(0x7f33700a9f50 msgr2=0x7f33700aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 --2- 172.21.2.137:0/1972812134 >> v2:172.21.2.111:3300/0 conn(0x7f33700a9f50 0x7f33700aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 -- 172.21.2.137:0/1972812134 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700af800 con 0x7f3370143f00 2021-11-15T19:33:41.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336e7fc700 1 --2- 172.21.2.137:0/1972812134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3370143f00 0x7f3370144360 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f3364002f70 tx=0x7f3364006eb0).ready entity=mon.1 client_cookie=6b1713dd43d78af9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336dffb700 1 -- 172.21.2.137:0/1972812134 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336400d570 con 0x7f3370143f00 2021-11-15T19:33:41.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336dffb700 1 -- 172.21.2.137:0/1972812134 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364000e90 con 0x7f3370143f00 2021-11-15T19:33:41.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f336dffb700 1 -- 172.21.2.137:0/1972812134 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336400d900 con 0x7f3370143f00 2021-11-15T19:33:41.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- 172.21.2.137:0/1972812134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3370143f00 msgr2=0x7f3370144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- 172.21.2.137:0/1972812134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3370143f00 0x7f3370144360 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f3364002f70 tx=0x7f3364006eb0).stop 2021-11-15T19:33:41.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- 172.21.2.137:0/1972812134 shutdown_connections 2021-11-15T19:33:41.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- 172.21.2.137:0/1972812134 >> v2:172.21.2.111:3300/0 conn(0x7f33700a9f50 0x7f33700aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- 172.21.2.137:0/1972812134 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3370143f00 0x7f3370144360 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 --2- 172.21.2.137:0/1972812134 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700b1340 0x7f3370147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- 172.21.2.137:0/1972812134 >> 172.21.2.137:0/1972812134 conn(0x7f33700b4e60 msgr2=0x7f33700b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:41.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- 172.21.2.137:0/1972812134 shutdown_connections 2021-11-15T19:33:41.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.493+0000 7f3375a27700 1 -- 172.21.2.137:0/1972812134 wait complete. 2021-11-15T19:33:41.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 Processor -- start 2021-11-15T19:33:41.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- start start 2021-11-15T19:33:41.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700a9f50 0x7f33700b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 0x7f33700b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3370143f00 0x7f3370159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700ae450 con 0x7f3370143f00 2021-11-15T19:33:41.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337015a220 con 0x7f33700b1340 2021-11-15T19:33:41.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3370099950 con 0x7f33700a9f50 2021-11-15T19:33:41.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 0x7f33700b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 0x7f33700b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37024/0 (socket says 172.21.2.137:37024) 2021-11-15T19:33:41.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 -- 172.21.2.137:0/3977362655 learned_addr learned my addr 172.21.2.137:0/3977362655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:41.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 -- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700a9f50 msgr2=0x7f33700b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700a9f50 0x7f33700b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 -- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3370143f00 msgr2=0x7f3370159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3370143f00 0x7f3370159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 -- 172.21.2.137:0/3977362655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336400b1e0 con 0x7f33700b1340 2021-11-15T19:33:41.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336e7fc700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 0x7f33700b3f60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f3364002f70 tx=0x7f3364015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3364011990 con 0x7f33700b1340 2021-11-15T19:33:41.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364011af0 con 0x7f33700b1340 2021-11-15T19:33:41.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3364011e50 con 0x7f33700b1340 2021-11-15T19:33:41.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370099bf0 con 0x7f33700b1340 2021-11-15T19:33:41.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33700ace80 con 0x7f33700b1340 2021-11-15T19:33:41.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337005faf0 con 0x7f33700b1340 2021-11-15T19:33:41.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f336401a040 con 0x7f33700b1340 2021-11-15T19:33:41.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f335ffff700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f334c0536d0 0x7f334c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f336406c920 con 0x7f33700b1340 2021-11-15T19:33:41.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.497+0000 7f336effd700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f334c0536d0 0x7f334c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.501+0000 7f336effd700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f334c0536d0 0x7f334c055b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f3360002f70 tx=0x7f3360006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.501+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3364043a80 con 0x7f33700b1340 2021-11-15T19:33:41.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.605+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33700ae5c0 con 0x7f33700b1340 2021-11-15T19:33:41.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.605+0000 7f335ffff700 1 -- 172.21.2.137:0/3977362655 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f3364023090 con 0x7f33700b1340 2021-11-15T19:33:41.617 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:41.617 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:33.558072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6577":{"gid":6577,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/2662817327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2662817327},{"type":"v1","addr":"172.21.2.137:6833","nonce":2662817327}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:41.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f334c0536d0 msgr2=0x7f334c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f334c0536d0 0x7f334c055b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f3360002f70 tx=0x7f3360006960).stop 2021-11-15T19:33:41.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 msgr2=0x7f33700b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 0x7f33700b3f60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f3364002f70 tx=0x7f3364015000).stop 2021-11-15T19:33:41.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 shutdown_connections 2021-11-15T19:33:41.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f334c0536d0 0x7f334c055b90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3370143f00 0x7f3370159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33700b1340 0x7f33700b3f60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 --2- 172.21.2.137:0/3977362655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f33700a9f50 0x7f33700b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 >> 172.21.2.137:0/3977362655 conn(0x7f33700b4e60 msgr2=0x7f337013e670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:41.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 shutdown_connections 2021-11-15T19:33:41.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.609+0000 7f3375a27700 1 -- 172.21.2.137:0/3977362655 wait complete. 2021-11-15T19:33:41.621 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 37 2021-11-15T19:33:41.624 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:33:41.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a75199700 1 Processor -- start 2021-11-15T19:33:41.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a75199700 1 -- start start 2021-11-15T19:33:41.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a75199700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6a70140aa0 0x7f6a70140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a75199700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7005cb50 con 0x7f6a7005c770 2021-11-15T19:33:41.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a75199700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700ad030 con 0x7f6a700b0550 2021-11-15T19:33:41.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a75199700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700b1650 con 0x7f6a70140aa0 2021-11-15T19:33:41.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6a700b0550 0x7f6a7014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55814/0 (socket says 172.21.2.137:55814) 2021-11-15T19:33:41.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3315466040 learned_addr learned my addr 172.21.2.137:0/3315466040 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:41.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6f59e700 1 --2- 172.21.2.137:0/3315466040 >> v2:172.21.2.111:3300/0 conn(0x7f6a70140aa0 0x7f6a70140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102254786 0 0) 0x7f6a700ad030 con 0x7f6a700b0550 2021-11-15T19:33:41.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a50003260 con 0x7f6a700b0550 2021-11-15T19:33:41.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615278912 0 0) 0x7f6a50003260 con 0x7f6a700b0550 2021-11-15T19:33:41.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 >> v2:172.21.2.111:3300/0 conn(0x7f6a70140aa0 msgr2=0x7f6a70140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 --2- 172.21.2.137:0/3315466040 >> v2:172.21.2.111:3300/0 conn(0x7f6a70140aa0 0x7f6a70140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 >> v1:172.21.2.111:6789/0 conn(0x7f6a7005c770 legacy=0x7f6a700aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700ad2d0 con 0x7f6a700b0550 2021-11-15T19:33:41.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6a60001660 con 0x7f6a700b0550 2021-11-15T19:33:41.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 >> v1:172.21.2.137:6789/0 conn(0x7f6a700b0550 legacy=0x7f6a7014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a500037a0 0x7f6a50003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a50004500 0x7f6a50004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004e70 0x7f6a5000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b1650 con 0x7f6a50004e70 2021-11-15T19:33:41.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5000bda0 con 0x7f6a50004500 2021-11-15T19:33:41.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5000bf60 con 0x7f6a500037a0 2021-11-15T19:33:41.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a50004500 0x7f6a50004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3315466040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a500037a0 msgr2=0x7f6a50003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a500037a0 0x7f6a50003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3315466040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004e70 msgr2=0x7f6a5000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:41.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.665+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004e70 0x7f6a5000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6f59e700 1 -- 172.21.2.137:0/3315466040 reap_dead start 2021-11-15T19:33:41.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3315466040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50003260 con 0x7f6a50004500 2021-11-15T19:33:41.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a50004500 0x7f6a50004980 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f6a60001370 tx=0x7f6a70146fe0).ready entity=mon.1 client_cookie=2581e2c6ce97caa6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a600070d0 con 0x7f6a50004500 2021-11-15T19:33:41.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60007230 con 0x7f6a50004500 2021-11-15T19:33:41.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6dd9b700 1 -- 172.21.2.137:0/3315466040 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6000c8f0 con 0x7f6a50004500 2021-11-15T19:33:41.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3315466040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a50004500 msgr2=0x7f6a50004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a50004500 0x7f6a50004980 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f6a60001370 tx=0x7f6a70146fe0).stop 2021-11-15T19:33:41.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3315466040 shutdown_connections 2021-11-15T19:33:41.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 --2- 172.21.2.137:0/3315466040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a50004500 0x7f6a50004980 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3315466040 >> 172.21.2.137:0/3315466040 conn(0x7f6a700631e0 msgr2=0x7f6a7005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:41.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3315466040 shutdown_connections 2021-11-15T19:33:41.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3315466040 wait complete. 2021-11-15T19:33:41.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 Processor -- start 2021-11-15T19:33:41.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- start start 2021-11-15T19:33:41.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004500 0x7f6a70149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 0x7f6a701598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a70067380 0x7f6a70159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70143e90 con 0x7f6a50004500 2021-11-15T19:33:41.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70143af0 con 0x7f6a701447c0 2021-11-15T19:33:41.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70143cb0 con 0x7f6a70067380 2021-11-15T19:33:41.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 0x7f6a701598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 0x7f6a701598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37046/0 (socket says 172.21.2.137:37046) 2021-11-15T19:33:41.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3918809129 learned_addr learned my addr 172.21.2.137:0/3918809129 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:41.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6ed9d700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004500 0x7f6a70149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a70067380 msgr2=0x7f6a70159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a70067380 0x7f6a70159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:41.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004500 msgr2=0x7f6a70149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:41.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004500 0x7f6a70149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:41.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 -- 172.21.2.137:0/3918809129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7015a280 con 0x7f6a701447c0 2021-11-15T19:33:41.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6ed9d700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004500 0x7f6a70149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:41.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a6e59c700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 0x7f6a701598a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f6a60001370 tx=0x7f6a60015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a600070d0 con 0x7f6a701447c0 2021-11-15T19:33:41.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60018070 con 0x7f6a701447c0 2021-11-15T19:33:41.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a60004920 con 0x7f6a701447c0 2021-11-15T19:33:41.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7015a470 con 0x7f6a701447c0 2021-11-15T19:33:41.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.669+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7013ec20 con 0x7f6a701447c0 2021-11-15T19:33:41.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a70065fd0 con 0x7f6a701447c0 2021-11-15T19:33:41.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a60024020 con 0x7f6a701447c0 2021-11-15T19:33:41.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a67fff700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a54053660 0x7f6a54055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:41.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6a6006c5b0 con 0x7f6a701447c0 2021-11-15T19:33:41.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a6ed9d700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a54053660 0x7f6a54055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:41.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a6ed9d700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a54053660 0x7f6a54055b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f6a58008000 tx=0x7f6a58009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:41.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.673+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a60043600 con 0x7f6a701447c0 2021-11-15T19:33:41.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:41.781+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6a70144000 con 0x7f6a701447c0 2021-11-15T19:33:42.058 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:33:42.053+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:33:42.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a67fff700 1 -- 172.21.2.137:0/3918809129 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6a60046c20 con 0x7f6a701447c0 2021-11-15T19:33:42.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a54053660 msgr2=0x7f6a54055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a54053660 0x7f6a54055b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f6a58008000 tx=0x7f6a58009040).stop 2021-11-15T19:33:42.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 msgr2=0x7f6a701598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 0x7f6a701598a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f6a60001370 tx=0x7f6a60015000).stop 2021-11-15T19:33:42.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 shutdown_connections 2021-11-15T19:33:42.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6a54053660 0x7f6a54055b20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6a70067380 0x7f6a70159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6a701447c0 0x7f6a701598a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 --2- 172.21.2.137:0/3918809129 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6a50004500 0x7f6a70149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 >> 172.21.2.137:0/3918809129 conn(0x7f6a700631e0 msgr2=0x7f6a70148540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:42.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 shutdown_connections 2021-11-15T19:33:42.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.065+0000 7f6a75199700 1 -- 172.21.2.137:0/3918809129 wait complete. 2021-11-15T19:33:42.077 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:33:42.080 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:42.085 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:33:42.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 Processor -- start 2021-11-15T19:33:42.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 -- start start 2021-11-15T19:33:42.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48040ad5b0 0x7f4804060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f48040ac400 0x7f480405f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4804061850 con 0x7f48040ac870 2021-11-15T19:33:42.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4804062610 con 0x7f48040ac400 2021-11-15T19:33:42.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f480bf51700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4804067c00 con 0x7f48040ad5b0 2021-11-15T19:33:42.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48040ad5b0 0x7f4804060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f48040ad5b0 0x7f4804060ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37062/0 (socket says 172.21.2.137:37062) 2021-11-15T19:33:42.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 -- 172.21.2.137:0/2750318005 learned_addr learned my addr 172.21.2.137:0/2750318005 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:42.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f48094ec700 1 --2- 172.21.2.137:0/2750318005 >> v2:172.21.2.111:3300/0 conn(0x7f48040ac400 0x7f480405f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 -- 172.21.2.137:0/2750318005 >> v2:172.21.2.111:3300/0 conn(0x7f48040ac400 msgr2=0x7f480405f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:42.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 --2- 172.21.2.137:0/2750318005 >> v2:172.21.2.111:3300/0 conn(0x7f48040ac400 0x7f480405f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 -- 172.21.2.137:0/2750318005 >> v1:172.21.2.111:6789/0 conn(0x7f48040ac870 legacy=0x7f480405fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:42.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 -- 172.21.2.137:0/2750318005 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48040614f0 con 0x7f48040ad5b0 2021-11-15T19:33:42.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.121+0000 7f4809ced700 1 --2- 172.21.2.137:0/2750318005 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804060ad0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f4800002f70 tx=0x7f4800006eb0).ready entity=mon.1 client_cookie=46d415f0008976a0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:42.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f4808ceb700 1 -- 172.21.2.137:0/2750318005 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480000d610 con 0x7f48040ad5b0 2021-11-15T19:33:42.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f4808ceb700 1 -- 172.21.2.137:0/2750318005 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4800000e90 con 0x7f48040ad5b0 2021-11-15T19:33:42.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f4808ceb700 1 -- 172.21.2.137:0/2750318005 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480000d9a0 con 0x7f48040ad5b0 2021-11-15T19:33:42.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/2750318005 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 msgr2=0x7f4804060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 --2- 172.21.2.137:0/2750318005 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804060ad0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f4800002f70 tx=0x7f4800006eb0).stop 2021-11-15T19:33:42.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/2750318005 shutdown_connections 2021-11-15T19:33:42.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 --2- 172.21.2.137:0/2750318005 >> v2:172.21.2.111:3300/0 conn(0x7f48040ac400 0x7f480405f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 --2- 172.21.2.137:0/2750318005 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804060ad0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/2750318005 >> 172.21.2.137:0/2750318005 conn(0x7f48040b7070 msgr2=0x7f48040b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:42.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/2750318005 shutdown_connections 2021-11-15T19:33:42.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/2750318005 wait complete. 2021-11-15T19:33:42.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 Processor -- start 2021-11-15T19:33:42.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- start start 2021-11-15T19:33:42.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48040ac400 0x7f480408f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48040ac870 0x7f4804156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040b0290 con 0x7f48040ac400 2021-11-15T19:33:42.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040aef40 con 0x7f48040ad5b0 2021-11-15T19:33:42.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48040aeca0 con 0x7f48040ac870 2021-11-15T19:33:42.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37072/0 (socket says 172.21.2.137:37072) 2021-11-15T19:33:42.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 -- 172.21.2.137:0/3711606584 learned_addr learned my addr 172.21.2.137:0/3711606584 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:42.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 -- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48040ac870 msgr2=0x7f4804156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48040ac870 0x7f4804156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 -- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48040ac400 msgr2=0x7f480408f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48040ac400 0x7f480408f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 -- 172.21.2.137:0/3711606584 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480000b1e0 con 0x7f48040ad5b0 2021-11-15T19:33:42.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480a4ee700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804156970 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f48040b25f0 tx=0x7f47fc007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:42.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47fc00e4a0 con 0x7f48040ad5b0 2021-11-15T19:33:42.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc00e600 con 0x7f48040ad5b0 2021-11-15T19:33:42.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48040b1350 con 0x7f48040ad5b0 2021-11-15T19:33:42.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47fc00e960 con 0x7f48040ad5b0 2021-11-15T19:33:42.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480409cf60 con 0x7f48040ad5b0 2021-11-15T19:33:42.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48040b14e0 con 0x7f48040ad5b0 2021-11-15T19:33:42.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f47fc019030 con 0x7f48040ad5b0 2021-11-15T19:33:42.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f47f2ffd700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.125+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f47fc06b090 con 0x7f48040ad5b0 2021-11-15T19:33:42.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.129+0000 7f4809ced700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.129+0000 7f4809ced700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f4800002f70 tx=0x7f4800015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:42.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.129+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f47fc042140 con 0x7f48040ad5b0 2021-11-15T19:33:42.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.237+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48040573d0 con 0x7f48040ad5b0 2021-11-15T19:33:42.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.237+0000 7f47f2ffd700 1 -- 172.21.2.137:0/3711606584 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f47fc045760 con 0x7f48040ad5b0 2021-11-15T19:33:42.249 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:42.249 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:32.554900+0000","modified":"2021-11-15T19:33:42.056021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T19:33:42.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 msgr2=0x7f47e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f4800002f70 tx=0x7f4800015000).stop 2021-11-15T19:33:42.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 msgr2=0x7f4804156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804156970 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f48040b25f0 tx=0x7f47fc007f40).stop 2021-11-15T19:33:42.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 shutdown_connections 2021-11-15T19:33:42.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f47e40536a0 0x7f47e4055b60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f48040ad5b0 0x7f4804156970 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f48040ac870 0x7f4804156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 --2- 172.21.2.137:0/3711606584 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f48040ac400 0x7f480408f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 >> 172.21.2.137:0/3711606584 conn(0x7f48040b7070 msgr2=0x7f48040b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:42.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 shutdown_connections 2021-11-15T19:33:42.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.241+0000 7f480bf51700 1 -- 172.21.2.137:0/3711606584 wait complete. 2021-11-15T19:33:42.253 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 38 2021-11-15T19:33:42.256 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:33:42.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd044e6d700 1 Processor -- start 2021-11-15T19:33:42.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd044e6d700 1 -- start start 2021-11-15T19:33:42.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd044e6d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0400ad320 0x7fd04014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd044e6d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400b76c0 con 0x7fd0400b72e0 2021-11-15T19:33:42.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd044e6d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04012a170 con 0x7fd0400acd60 2021-11-15T19:33:42.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd044e6d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400b3100 con 0x7fd0400ad320 2021-11-15T19:33:42.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03dd9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd0400acd60 0x7fd0400b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55858/0 (socket says 172.21.2.137:55858) 2021-11-15T19:33:42.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03dd9b700 1 -- 172.21.2.137:0/3234898758 learned_addr learned my addr 172.21.2.137:0/3234898758 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:42.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03ed9d700 1 --2- 172.21.2.137:0/3234898758 >> v2:172.21.2.137:3300/0 conn(0x7fd0400ad320 0x7fd04014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03d59a700 1 -- 172.21.2.137:0/3234898758 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395891233 0 0) 0x7fd04012a170 con 0x7fd0400acd60 2021-11-15T19:33:42.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03d59a700 1 -- 172.21.2.137:0/3234898758 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd024003260 con 0x7fd0400acd60 2021-11-15T19:33:42.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03ed9d700 1 -- 172.21.2.137:0/3234898758 >> v1:172.21.2.137:6789/0 conn(0x7fd0400acd60 legacy=0x7fd0400b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03ed9d700 1 -- 172.21.2.137:0/3234898758 >> v1:172.21.2.111:6789/0 conn(0x7fd0400b72e0 legacy=0x7fd0400b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:42.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.297+0000 7fd03ed9d700 1 -- 172.21.2.137:0/3234898758 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400ad8a0 con 0x7fd0400ad320 2021-11-15T19:33:42.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03ed9d700 1 --2- 172.21.2.137:0/3234898758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400ad320 0x7fd04014b480 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fd040065c40 tx=0x7fd0380091d0).ready entity=mon.1 client_cookie=c376af883c24ae4c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:42.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03d59a700 1 -- 172.21.2.137:0/3234898758 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03800b680 con 0x7fd0400ad320 2021-11-15T19:33:42.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03d59a700 1 -- 172.21.2.137:0/3234898758 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800b7e0 con 0x7fd0400ad320 2021-11-15T19:33:42.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03d59a700 1 -- 172.21.2.137:0/3234898758 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03800b950 con 0x7fd0400ad320 2021-11-15T19:33:42.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/3234898758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400ad320 msgr2=0x7fd04014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:42.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 --2- 172.21.2.137:0/3234898758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400ad320 0x7fd04014b480 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fd040065c40 tx=0x7fd0380091d0).stop 2021-11-15T19:33:42.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/3234898758 shutdown_connections 2021-11-15T19:33:42.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 --2- 172.21.2.137:0/3234898758 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400ad320 0x7fd04014b480 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:42.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/3234898758 >> 172.21.2.137:0/3234898758 conn(0x7fd040064960 msgr2=0x7fd040064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:42.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/3234898758 shutdown_connections 2021-11-15T19:33:42.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/3234898758 wait complete. 2021-11-15T19:33:42.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 Processor -- start 2021-11-15T19:33:42.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- start start 2021-11-15T19:33:42.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 0x7fd040156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0400ad320 0x7fd0400b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400b72e0 0x7fd04015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400b20c0 con 0x7fd0400ad320 2021-11-15T19:33:42.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040159d10 con 0x7fd0400acd60 2021-11-15T19:33:42.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040066530 con 0x7fd0400b72e0 2021-11-15T19:33:42.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 0x7fd040156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 0x7fd040156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37080/0 (socket says 172.21.2.137:37080) 2021-11-15T19:33:42.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 -- 172.21.2.137:0/2758403098 learned_addr learned my addr 172.21.2.137:0/2758403098 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:42.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 -- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400b72e0 msgr2=0x7fd04015a140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:42.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400b72e0 0x7fd04015a140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 -- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0400ad320 msgr2=0x7fd0400b0c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:42.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0400ad320 0x7fd0400b0c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:42.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 -- 172.21.2.137:0/2758403098 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038009470 con 0x7fd0400acd60 2021-11-15T19:33:42.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03e59c700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 0x7fd040156740 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fd030002ef0 tx=0x7fd030006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:42.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd030009ea0 con 0x7fd0400acd60 2021-11-15T19:33:42.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030002320 con 0x7fd0400acd60 2021-11-15T19:33:42.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd030002680 con 0x7fd0400acd60 2021-11-15T19:33:42.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400667d0 con 0x7fd0400acd60 2021-11-15T19:33:42.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0400661b0 con 0x7fd0400acd60 2021-11-15T19:33:42.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400b3cf0 con 0x7fd0400acd60 2021-11-15T19:33:42.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd03000f030 con 0x7fd0400acd60 2021-11-15T19:33:42.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd02f7fe700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd01c053570 0x7fd01c055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:42.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fd03006b740 con 0x7fd0400acd60 2021-11-15T19:33:42.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.301+0000 7fd03dd9b700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd01c053570 0x7fd01c055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:42.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.305+0000 7fd03dd9b700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd01c053570 0x7fd01c055a30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd034001110 tx=0x7fd034007630).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:42.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.305+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd030042740 con 0x7fd0400acd60 2021-11-15T19:33:42.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:42.413+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd040159e50 con 0x7fd0400acd60 2021-11-15T19:33:43.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd02f7fe700 1 -- 172.21.2.137:0/2758403098 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd030045d60 con 0x7fd0400acd60 2021-11-15T19:33:43.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd01c053570 msgr2=0x7fd01c055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd01c053570 0x7fd01c055a30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd034001110 tx=0x7fd034007630).stop 2021-11-15T19:33:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 msgr2=0x7fd040156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 0x7fd040156740 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fd030002ef0 tx=0x7fd030006d50).stop 2021-11-15T19:33:43.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 shutdown_connections 2021-11-15T19:33:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd01c053570 0x7fd01c055a30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0400b72e0 0x7fd04015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0400ad320 0x7fd0400b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 --2- 172.21.2.137:0/2758403098 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0400acd60 0x7fd040156740 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 >> 172.21.2.137:0/2758403098 conn(0x7fd040064960 msgr2=0x7fd040140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:43.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 shutdown_connections 2021-11-15T19:33:43.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.077+0000 7fd044e6d700 1 -- 172.21.2.137:0/2758403098 wait complete. 2021-11-15T19:33:43.094 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:33:43.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.137+0000 7f54a6ae4700 1 Processor -- start 2021-11-15T19:33:43.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.137+0000 7f54a6ae4700 1 -- start start 2021-11-15T19:33:43.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.137+0000 7f54a6ae4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a00608f0 0x7f54a013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.137+0000 7f54a6ae4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00b0c80 con 0x7f54a00b1660 2021-11-15T19:33:43.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.137+0000 7f54a6ae4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00b0f20 con 0x7f54a005f730 2021-11-15T19:33:43.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.137+0000 7f54a6ae4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00ad6c0 con 0x7f54a00608f0 2021-11-15T19:33:43.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a5081700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f54a005f730 0x7f54a014a200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55872/0 (socket says 172.21.2.137:55872) 2021-11-15T19:33:43.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a5081700 1 -- 172.21.2.137:0/1492454737 learned_addr learned my addr 172.21.2.137:0/1492454737 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:43.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614985249 0 0) 0x7f54a00b0f20 con 0x7f54a005f730 2021-11-15T19:33:43.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5480003260 con 0x7f54a005f730 2021-11-15T19:33:43.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a00608f0 0x7f54a013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 19591661 0 0) 0x7f5480003260 con 0x7f54a005f730 2021-11-15T19:33:43.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a00608f0 msgr2=0x7f54a013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:43.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a00608f0 0x7f54a013f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 >> v1:172.21.2.111:6789/0 conn(0x7f54a00b1660 legacy=0x7f54a00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:43.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00b11c0 con 0x7f54a005f730 2021-11-15T19:33:43.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f54980019e0 con 0x7f54a005f730 2021-11-15T19:33:43.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 >> v1:172.21.2.137:6789/0 conn(0x7f54a005f730 legacy=0x7f54a014a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:43.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54800037d0 0x7f5480003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5480004500 0x7f5480004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5480004f90 0x7f548000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00ad6c0 con 0x7f5480004f90 2021-11-15T19:33:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548000be30 con 0x7f54800037d0 2021-11-15T19:33:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548000bff0 con 0x7f5480004500 2021-11-15T19:33:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a00608f0 0x7f54a013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54800037d0 0x7f5480003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5480004500 0x7f5480004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a5081700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5480004f90 0x7f548000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 -- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5480004500 msgr2=0x7f5480004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5480004500 0x7f5480004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 -- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5480004f90 msgr2=0x7f548000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5480004f90 0x7f548000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 -- 172.21.2.137:0/1492454737 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00b11c0 con 0x7f54800037d0 2021-11-15T19:33:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54800037d0 0x7f5480003bd0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f5490007000 tx=0x7f5490008040).ready entity=mon.1 client_cookie=f74f115d72c1ad57 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490012430 con 0x7f54800037d0 2021-11-15T19:33:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000c030 con 0x7f54800037d0 2021-11-15T19:33:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549f7fe700 1 -- 172.21.2.137:0/1492454737 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490012780 con 0x7f54800037d0 2021-11-15T19:33:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1492454737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54800037d0 msgr2=0x7f5480003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1492454737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54800037d0 0x7f5480003bd0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f5490007000 tx=0x7f5490008040).stop 2021-11-15T19:33:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a5081700 1 -- 172.21.2.137:0/1492454737 reap_dead start 2021-11-15T19:33:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1492454737 shutdown_connections 2021-11-15T19:33:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1492454737 >> 172.21.2.137:0/1492454737 conn(0x7f54a0063980 msgr2=0x7f54a0063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1492454737 shutdown_connections 2021-11-15T19:33:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1492454737 wait complete. 2021-11-15T19:33:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 Processor -- start 2021-11-15T19:33:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- start start 2021-11-15T19:33:43.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54800037d0 0x7f54a00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 0x7f54a0139500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a01399f0 0x7f54a005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0142610 con 0x7f54800037d0 2021-11-15T19:33:43.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a013f110 con 0x7f54a0142800 2021-11-15T19:33:43.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a6ae4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a013f3b0 con 0x7f54a01399f0 2021-11-15T19:33:43.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 0x7f54a0139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 0x7f54a0139500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37102/0 (socket says 172.21.2.137:37102) 2021-11-15T19:33:43.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 -- 172.21.2.137:0/1935264888 learned_addr learned my addr 172.21.2.137:0/1935264888 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a4880700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54800037d0 0x7f54a00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f54a5081700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a01399f0 0x7f54a005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 -- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a01399f0 msgr2=0x7f54a005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a01399f0 0x7f54a005bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 -- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54800037d0 msgr2=0x7f54a00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54800037d0 0x7f54a00b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 -- 172.21.2.137:0/1935264888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0129f40 con 0x7f54a0142800 2021-11-15T19:33:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.141+0000 7f549ffff700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 0x7f54a0139500 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f54a013edc0 tx=0x7f5488007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54880114c0 con 0x7f54a0142800 2021-11-15T19:33:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488000e90 con 0x7f54a0142800 2021-11-15T19:33:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0142c80 con 0x7f54a0142800 2021-11-15T19:33:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5488011810 con 0x7f54a0142800 2021-11-15T19:33:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0142290 con 0x7f54a0142800 2021-11-15T19:33:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a00b1ac0 con 0x7f54a0142800 2021-11-15T19:33:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f548801a030 con 0x7f54a0142800 2021-11-15T19:33:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5484053660 0x7f5484055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f548806b370 con 0x7f54a0142800 2021-11-15T19:33:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f54a4880700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5484053660 0x7f5484055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f54a4880700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5484053660 0x7f5484055b20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f549001a000 tx=0x7f5490008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:43.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.145+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5488042370 con 0x7f54a0142800 2021-11-15T19:33:43.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:43.229+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54a00573d0 con 0x7f54a0142800 2021-11-15T19:33:44.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.085+0000 7f549dffb700 1 -- 172.21.2.137:0/1935264888 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5488045990 con 0x7f54a0142800 2021-11-15T19:33:44.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5484053660 msgr2=0x7f5484055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:44.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5484053660 0x7f5484055b20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f549001a000 tx=0x7f5490008040).stop 2021-11-15T19:33:44.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 msgr2=0x7f54a0139500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:44.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 0x7f54a0139500 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f54a013edc0 tx=0x7f5488007a00).stop 2021-11-15T19:33:44.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 shutdown_connections 2021-11-15T19:33:44.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5484053660 0x7f5484055b20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:44.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54a01399f0 0x7f54a005bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:44.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54a0142800 0x7f54a0139500 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:44.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 --2- 172.21.2.137:0/1935264888 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54800037d0 0x7f54a00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:44.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 >> 172.21.2.137:0/1935264888 conn(0x7f54a0063980 msgr2=0x7f54a00b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:44.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 shutdown_connections 2021-11-15T19:33:44.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.089+0000 7f54a6ae4700 1 -- 172.21.2.137:0/1935264888 wait complete. 2021-11-15T19:33:44.100 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:33:44.103 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:33:44.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feabcf5a700 1 Processor -- start 2021-11-15T19:33:44.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feabcf5a700 1 -- start start 2021-11-15T19:33:44.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feabcf5a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab814b500 0x7feab814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feabcf5a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80b41c0 con 0x7feab80b4f50 2021-11-15T19:33:44.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feabcf5a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80622c0 con 0x7feab80b3de0 2021-11-15T19:33:44.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feabcf5a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab8062560 con 0x7feab814b500 2021-11-15T19:33:44.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab77fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7feab80b3de0 0x7feab8146410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55890/0 (socket says 172.21.2.137:55890) 2021-11-15T19:33:44.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab77fe700 1 -- 172.21.2.137:0/766922317 learned_addr learned my addr 172.21.2.137:0/766922317 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:44.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704170606 0 0) 0x7feab80622c0 con 0x7feab80b3de0 2021-11-15T19:33:44.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa4003260 con 0x7feab80b3de0 2021-11-15T19:33:44.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3684338576 0 0) 0x7feaa4003260 con 0x7feab80b3de0 2021-11-15T19:33:44.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab814b500 msgr2=0x7feab814d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:44.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab814b500 0x7feab814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:44.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 >> v1:172.21.2.111:6789/0 conn(0x7feab80b4f50 legacy=0x7feab8146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:44.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8062800 con 0x7feab80b3de0 2021-11-15T19:33:44.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7feab00019e0 con 0x7feab80b3de0 2021-11-15T19:33:44.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 >> v1:172.21.2.137:6789/0 conn(0x7feab80b3de0 legacy=0x7feab8146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:44.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab814b500 0x7feaa40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feaa4003ec0 0x7feaa4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4004b40 0x7feaa4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8062560 con 0x7feaa4004b40 2021-11-15T19:33:44.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400ba00 con 0x7feaa4003ec0 2021-11-15T19:33:44.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400bbc0 con 0x7feab814b500 2021-11-15T19:33:44.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feaa4003ec0 0x7feaa4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:44.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 -- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab814b500 msgr2=0x7feaa40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:44.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab814b500 0x7feaa40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:44.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 -- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4004b40 msgr2=0x7feaa4004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:44.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4004b40 0x7feaa4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:44.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 -- 172.21.2.137:0/766922317 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4003260 con 0x7feaa4003ec0 2021-11-15T19:33:44.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab6ffd700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feaa4003ec0 0x7feaa4004500 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7feaac000f70 tx=0x7feaac0079e0).ready entity=mon.1 client_cookie=ba7e29447798c7c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:44.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.149+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaac007cf0 con 0x7feaa4003ec0 2021-11-15T19:33:44.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac014410 con 0x7feaa4003ec0 2021-11-15T19:33:44.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab67fc700 1 -- 172.21.2.137:0/766922317 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaac014770 con 0x7feaa4003ec0 2021-11-15T19:33:44.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/766922317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feaa4003ec0 msgr2=0x7feaa4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:44.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 --2- 172.21.2.137:0/766922317 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feaa4003ec0 0x7feaa4004500 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7feaac000f70 tx=0x7feaac0079e0).stop 2021-11-15T19:33:44.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 -- 172.21.2.137:0/766922317 reap_dead start 2021-11-15T19:33:44.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/766922317 shutdown_connections 2021-11-15T19:33:44.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/766922317 >> 172.21.2.137:0/766922317 conn(0x7feab80b9100 msgr2=0x7feab80b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:44.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/766922317 shutdown_connections 2021-11-15T19:33:44.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/766922317 wait complete. 2021-11-15T19:33:44.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 Processor -- start 2021-11-15T19:33:44.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- start start 2021-11-15T19:33:44.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4003ec0 0x7feab80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab80b8930 0x7feab813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 0x7feab80b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8159cc0 con 0x7feaa4003ec0 2021-11-15T19:33:44.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8159f60 con 0x7feab815a400 2021-11-15T19:33:44.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab8144150 con 0x7feab80b8930 2021-11-15T19:33:44.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 0x7feab80b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:44.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 0x7feab80b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37124/0 (socket says 172.21.2.137:37124) 2021-11-15T19:33:44.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 -- 172.21.2.137:0/1459732877 learned_addr learned my addr 172.21.2.137:0/1459732877 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:44.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab77fe700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4003ec0 0x7feab80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:44.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab6ffd700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab80b8930 0x7feab813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:44.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 -- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab80b8930 msgr2=0x7feab813ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:44.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab80b8930 0x7feab813ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:44.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 -- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4003ec0 msgr2=0x7feab80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:44.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4003ec0 0x7feab80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:44.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 -- 172.21.2.137:0/1459732877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab815a880 con 0x7feab815a400 2021-11-15T19:33:44.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab7fff700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 0x7feab80b6f30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7feab0001490 tx=0x7feaa8007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:44.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa800acc0 con 0x7feab815a400 2021-11-15T19:33:44.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800ae20 con 0x7feab815a400 2021-11-15T19:33:44.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab80b7420 con 0x7feab815a400 2021-11-15T19:33:44.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa8007300 con 0x7feab815a400 2021-11-15T19:33:44.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80b7950 con 0x7feab815a400 2021-11-15T19:33:44.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab815aa10 con 0x7feab815a400 2021-11-15T19:33:44.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feaa8010030 con 0x7feab815a400 2021-11-15T19:33:44.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab4ff9700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea98053610 0x7fea98055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:44.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5717+0+0 (secure 0 0 0) 0x7feaa806a3d0 con 0x7feab815a400 2021-11-15T19:33:44.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.153+0000 7feab77fe700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea98053610 0x7fea98055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:44.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.157+0000 7feab77fe700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea98053610 0x7fea98055ad0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7feab000b000 tx=0x7feab0000f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:44.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.157+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feaa80415f0 con 0x7feab815a400 2021-11-15T19:33:44.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:44.241+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feab8062aa0 con 0x7feab815a400 2021-11-15T19:33:45.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feab4ff9700 1 -- 172.21.2.137:0/1459732877 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 173+0+0 (secure 0 0 0) 0x7feaa8044c10 con 0x7feab815a400 2021-11-15T19:33:45.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea98053610 msgr2=0x7fea98055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea98053610 0x7fea98055ad0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7feab000b000 tx=0x7feab0000f40).stop 2021-11-15T19:33:45.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 msgr2=0x7feab80b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 0x7feab80b6f30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7feab0001490 tx=0x7feaa8007c70).stop 2021-11-15T19:33:45.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 shutdown_connections 2021-11-15T19:33:45.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fea98053610 0x7fea98055ad0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7feab815a400 0x7feab80b6f30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7feab80b8930 0x7feab813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 --2- 172.21.2.137:0/1459732877 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7feaa4003ec0 0x7feab80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 >> 172.21.2.137:0/1459732877 conn(0x7feab80b9100 msgr2=0x7feab80b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:45.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 shutdown_connections 2021-11-15T19:33:45.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.101+0000 7feabcf5a700 1 -- 172.21.2.137:0/1459732877 wait complete. 2021-11-15T19:33:45.115 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:33:45.119 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:33:45.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 Processor -- start 2021-11-15T19:33:45.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 -- start start 2021-11-15T19:33:45.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b40b0550 0x7fe1b414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe1b414aaa0 0x7fe1b4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b405cb50 con 0x7fe1b405c770 2021-11-15T19:33:45.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40b1650 con 0x7fe1b414aaa0 2021-11-15T19:33:45.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1bb923700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40ad030 con 0x7fe1b40b0550 2021-11-15T19:33:45.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b96bf700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe1b405c770 0x7fe1b40aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55910/0 (socket says 172.21.2.137:55910) 2021-11-15T19:33:45.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b96bf700 1 -- 172.21.2.137:0/4282875081 learned_addr learned my addr 172.21.2.137:0/4282875081 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:45.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b9ec0700 1 --2- 172.21.2.137:0/4282875081 >> v2:172.21.2.137:3300/0 conn(0x7fe1b414aaa0 0x7fe1b4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b8ebe700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b40b0550 0x7fe1b414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b9ec0700 1 -- 172.21.2.137:0/4282875081 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b40b0550 msgr2=0x7fe1b414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:45.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b9ec0700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b40b0550 0x7fe1b414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b9ec0700 1 -- 172.21.2.137:0/4282875081 >> v1:172.21.2.137:6789/0 conn(0x7fe1b405c770 legacy=0x7fe1b40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b9ec0700 1 -- 172.21.2.137:0/4282875081 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40ad2d0 con 0x7fe1b414aaa0 2021-11-15T19:33:45.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b8ebe700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b40b0550 0x7fe1b414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:45.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1b9ec0700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b414aaa0 0x7fe1b4140aa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fe1ac0032f0 tx=0x7fe1ac0091d0).ready entity=mon.1 client_cookie=96553ea613b573bb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:45.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.161+0000 7fe1a7fff700 1 -- 172.21.2.137:0/4282875081 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1ac009ea0 con 0x7fe1b414aaa0 2021-11-15T19:33:45.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a7fff700 1 -- 172.21.2.137:0/4282875081 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00b8a0 con 0x7fe1b414aaa0 2021-11-15T19:33:45.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a7fff700 1 -- 172.21.2.137:0/4282875081 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1ac00ba10 con 0x7fe1b414aaa0 2021-11-15T19:33:45.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/4282875081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b414aaa0 msgr2=0x7fe1b4140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b414aaa0 0x7fe1b4140aa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fe1ac0032f0 tx=0x7fe1ac0091d0).stop 2021-11-15T19:33:45.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/4282875081 shutdown_connections 2021-11-15T19:33:45.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b414aaa0 0x7fe1b4140aa0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 --2- 172.21.2.137:0/4282875081 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b40b0550 0x7fe1b414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/4282875081 >> 172.21.2.137:0/4282875081 conn(0x7fe1b40631e0 msgr2=0x7fe1b405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:45.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/4282875081 shutdown_connections 2021-11-15T19:33:45.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/4282875081 wait complete. 2021-11-15T19:33:45.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 Processor -- start 2021-11-15T19:33:45.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- start start 2021-11-15T19:33:45.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b405c770 0x7fe1b4145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 0x7fe1b4145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1b414aaa0 0x7fe1b4066b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4063ae0 con 0x7fe1b414aaa0 2021-11-15T19:33:45.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4063e20 con 0x7fe1b40b0550 2021-11-15T19:33:45.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4064620 con 0x7fe1b405c770 2021-11-15T19:33:45.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 0x7fe1b4145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 0x7fe1b4145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37134/0 (socket says 172.21.2.137:37134) 2021-11-15T19:33:45.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 -- 172.21.2.137:0/1205843608 learned_addr learned my addr 172.21.2.137:0/1205843608 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:45.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 -- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b405c770 msgr2=0x7fe1b4145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b405c770 0x7fe1b4145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 -- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1b414aaa0 msgr2=0x7fe1b4066b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1b414aaa0 0x7fe1b4066b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 -- 172.21.2.137:0/1205843608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009470 con 0x7fe1b40b0550 2021-11-15T19:33:45.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1b8ebe700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 0x7fe1b4145080 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe1b4064540 tx=0x7fe1a8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:45.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a8010580 con 0x7fe1b40b0550 2021-11-15T19:33:45.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a80106e0 con 0x7fe1b40b0550 2021-11-15T19:33:45.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40648c0 con 0x7fe1b40b0550 2021-11-15T19:33:45.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a8010a40 con 0x7fe1b40b0550 2021-11-15T19:33:45.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b4116800 con 0x7fe1b40b0550 2021-11-15T19:33:45.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b4064a50 con 0x7fe1b40b0550 2021-11-15T19:33:45.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe1a8010ba0 con 0x7fe1b40b0550 2021-11-15T19:33:45.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.165+0000 7fe1a67fc700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe194053580 0x7fe194055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.169+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe1a806b810 con 0x7fe1b40b0550 2021-11-15T19:33:45.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.169+0000 7fe1b96bf700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe194053580 0x7fe194055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.169+0000 7fe1b96bf700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe194053580 0x7fe194055a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fe1b40adfd0 tx=0x7fe1b0007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:45.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.169+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1a8042bf0 con 0x7fe1b40b0550 2021-11-15T19:33:45.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.253+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe1b40ae7f0 con 0x7fe1b40b0550 2021-11-15T19:33:45.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1a67fc700 1 -- 172.21.2.137:0/1205843608 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1a8046210 con 0x7fe1b40b0550 2021-11-15T19:33:45.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe194053580 msgr2=0x7fe194055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe194053580 0x7fe194055a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fe1b40adfd0 tx=0x7fe1b0007860).stop 2021-11-15T19:33:45.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 msgr2=0x7fe1b4145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 0x7fe1b4145080 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe1b4064540 tx=0x7fe1a8008040).stop 2021-11-15T19:33:45.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 shutdown_connections 2021-11-15T19:33:45.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe194053580 0x7fe194055a40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1b414aaa0 0x7fe1b4066b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe1b40b0550 0x7fe1b4145080 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 --2- 172.21.2.137:0/1205843608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1b405c770 0x7fe1b4145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 >> 172.21.2.137:0/1205843608 conn(0x7fe1b40631e0 msgr2=0x7fe1b40b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:45.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 shutdown_connections 2021-11-15T19:33:45.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.269+0000 7fe1bb923700 1 -- 172.21.2.137:0/1205843608 wait complete. 2021-11-15T19:33:45.282 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-11-15T19:33:45.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.321+0000 7f2d3f8e0700 1 Processor -- start 2021-11-15T19:33:45.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- start start 2021-11-15T19:33:45.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2d380b1340 0x7f2d38147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f2d38143f00 0x7f2d38144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d38148190 con 0x7f2d380a9f50 2021-11-15T19:33:45.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380b1720 con 0x7f2d38143f00 2021-11-15T19:33:45.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d38147e70 con 0x7f2d380b1340 2021-11-15T19:33:45.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3d67c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2d380b1340 0x7f2d38147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3de7d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f2d380a9f50 0x7f2d380aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55924/0 (socket says 172.21.2.137:55924) 2021-11-15T19:33:45.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3de7d700 1 -- 172.21.2.137:0/442343496 learned_addr learned my addr 172.21.2.137:0/442343496 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:45.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3d67c700 1 -- 172.21.2.137:0/442343496 >> v2:172.21.2.111:3300/0 conn(0x7f2d38143f00 msgr2=0x7f2d38144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:45.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3d67c700 1 --2- 172.21.2.137:0/442343496 >> v2:172.21.2.111:3300/0 conn(0x7f2d38143f00 0x7f2d38144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3d67c700 1 -- 172.21.2.137:0/442343496 >> v1:172.21.2.137:6789/0 conn(0x7f2d380a9f50 legacy=0x7f2d380aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3d67c700 1 -- 172.21.2.137:0/442343496 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380af800 con 0x7f2d380b1340 2021-11-15T19:33:45.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3d67c700 1 --2- 172.21.2.137:0/442343496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d38147980 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f2d34002f70 tx=0x7f2d34006df0).ready entity=mon.1 client_cookie=8da2b305b2a5ecea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:45.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d2bfff700 1 -- 172.21.2.137:0/442343496 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d3400d5c0 con 0x7f2d380b1340 2021-11-15T19:33:45.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d2bfff700 1 -- 172.21.2.137:0/442343496 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34000e90 con 0x7f2d380b1340 2021-11-15T19:33:45.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d2bfff700 1 -- 172.21.2.137:0/442343496 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d3400d910 con 0x7f2d380b1340 2021-11-15T19:33:45.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/442343496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 msgr2=0x7f2d38147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/442343496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d38147980 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f2d34002f70 tx=0x7f2d34006df0).stop 2021-11-15T19:33:45.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/442343496 shutdown_connections 2021-11-15T19:33:45.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/442343496 >> v2:172.21.2.111:3300/0 conn(0x7f2d38143f00 0x7f2d38144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/442343496 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d38147980 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:45.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/442343496 >> 172.21.2.137:0/442343496 conn(0x7f2d380b4e60 msgr2=0x7f2d380b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:45.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/442343496 shutdown_connections 2021-11-15T19:33:45.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/442343496 wait complete. 2021-11-15T19:33:45.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 Processor -- start 2021-11-15T19:33:45.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- start start 2021-11-15T19:33:45.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2d380a9f50 0x7f2d38140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d3813da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2d38143f00 0x7f2d3813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380adbb0 con 0x7f2d38143f00 2021-11-15T19:33:45.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3814afd0 con 0x7f2d380b1340 2021-11-15T19:33:45.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3814a840 con 0x7f2d380a9f50 2021-11-15T19:33:45.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d3813da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d3813da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37150/0 (socket says 172.21.2.137:37150) 2021-11-15T19:33:45.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 -- 172.21.2.137:0/2132640691 learned_addr learned my addr 172.21.2.137:0/2132640691 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:45.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 -- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2d380a9f50 msgr2=0x7f2d38140170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:45.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2d380a9f50 0x7f2d38140170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 -- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2d38143f00 msgr2=0x7f2d3813df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:45.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2d38143f00 0x7f2d3813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:45.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 -- 172.21.2.137:0/2132640691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3400b180 con 0x7f2d380b1340 2021-11-15T19:33:45.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3ce7b700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d3813da60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f2d2c002f70 tx=0x7f2d2c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:45.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2c013460 con 0x7f2d380b1340 2021-11-15T19:33:45.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c0135c0 con 0x7f2d380b1340 2021-11-15T19:33:45.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3814aae0 con 0x7f2d380b1340 2021-11-15T19:33:45.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380af010 con 0x7f2d380b1340 2021-11-15T19:33:45.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.325+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2c013920 con 0x7f2d380b1340 2021-11-15T19:33:45.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d380ac9f0 con 0x7f2d380b1340 2021-11-15T19:33:45.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d2c01a060 con 0x7f2d380b1340 2021-11-15T19:33:45.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d2a7fc700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2d180536f0 0x7f2d18055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:45.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2d2c06b1c0 con 0x7f2d380b1340 2021-11-15T19:33:45.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d3d67c700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2d180536f0 0x7f2d18055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:45.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d3d67c700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2d180536f0 0x7f2d18055bb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f2d34002f70 tx=0x7f2d34014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:45.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.329+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d380ac9f0 con 0x7f2d380b1340 2021-11-15T19:33:45.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:45.445+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f2d380ac9f0 con 0x7f2d380b1340 2021-11-15T19:33:46.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d2a7fc700 1 -- 172.21.2.137:0/2132640691 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v287) v1 ==== 126+0+0 (secure 0 0 0) 0x7f2d380ac9f0 con 0x7f2d380b1340 2021-11-15T19:33:46.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2d180536f0 msgr2=0x7f2d18055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:46.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2d180536f0 0x7f2d18055bb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f2d34002f70 tx=0x7f2d34014000).stop 2021-11-15T19:33:46.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 msgr2=0x7f2d3813da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:46.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d3813da60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f2d2c002f70 tx=0x7f2d2c006ec0).stop 2021-11-15T19:33:46.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 shutdown_connections 2021-11-15T19:33:46.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2d180536f0 0x7f2d18055bb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:46.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2d38143f00 0x7f2d3813df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:46.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2d380b1340 0x7f2d3813da60 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:46.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 --2- 172.21.2.137:0/2132640691 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2d380a9f50 0x7f2d38140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:46.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 >> 172.21.2.137:0/2132640691 conn(0x7f2d380b4e60 msgr2=0x7f2d380af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:46.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 shutdown_connections 2021-11-15T19:33:46.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.105+0000 7f2d3f8e0700 1 -- 172.21.2.137:0/2132640691 wait complete. 2021-11-15T19:33:46.123 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:33:46.124 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:33:46.124 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-11-15T19:33:46.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 Processor -- start 2021-11-15T19:33:46.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- start start 2021-11-15T19:33:46.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff84809c8c0 0x7ff84809cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84809d190 con 0x7ff84809ab00 2021-11-15T19:33:46.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84805fe40 con 0x7ff8480b3140 2021-11-15T19:33:46.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff848099790 con 0x7ff84809c8c0 2021-11-15T19:33:46.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff845d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff8480b3140 0x7ff84805f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55936/0 (socket says 172.21.2.137:55936) 2021-11-15T19:33:46.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff845d9b700 1 -- 172.21.2.137:0/2964131721 learned_addr learned my addr 172.21.2.137:0/2964131721 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:46.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877020066 0 0) 0x7ff84805fe40 con 0x7ff8480b3140 2021-11-15T19:33:46.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff828003260 con 0x7ff8480b3140 2021-11-15T19:33:46.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711925808 0 0) 0x7ff828003260 con 0x7ff8480b3140 2021-11-15T19:33:46.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff84809c8c0 msgr2=0x7ff84809cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:46.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff84809c8c0 0x7ff84809cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:46.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 >> v1:172.21.2.111:6789/0 conn(0x7ff84809ab00 legacy=0x7ff848143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:46.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480b2940 con 0x7ff8480b3140 2021-11-15T19:33:46.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff830001660 con 0x7ff8480b3140 2021-11-15T19:33:46.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 >> v1:172.21.2.137:6789/0 conn(0x7ff8480b3140 legacy=0x7ff84805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:46.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8280037d0 0x7ff828003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff84809c8c0 0x7ff828004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff828004b40 0x7ff828004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff848099790 con 0x7ff8280037d0 2021-11-15T19:33:46.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82800b9b0 con 0x7ff828004b40 2021-11-15T19:33:46.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82800bb70 con 0x7ff84809c8c0 2021-11-15T19:33:46.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff828004b40 0x7ff828004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:46.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 -- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff84809c8c0 msgr2=0x7ff828004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:46.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff84809c8c0 0x7ff828004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:46.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 -- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8280037d0 msgr2=0x7ff828003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:46.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8280037d0 0x7ff828003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:46.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 -- 172.21.2.137:0/2964131721 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828003260 con 0x7ff828004b40 2021-11-15T19:33:46.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff828004b40 0x7ff828004fc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7ff8400012f0 tx=0x7ff840007d60).ready entity=mon.1 client_cookie=1bc41a0a600344ab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:46.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8400014c0 con 0x7ff828004b40 2021-11-15T19:33:46.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840006870 con 0x7ff828004b40 2021-11-15T19:33:46.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84559a700 1 -- 172.21.2.137:0/2964131721 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff840006bd0 con 0x7ff828004b40 2021-11-15T19:33:46.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- 172.21.2.137:0/2964131721 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff828004b40 msgr2=0x7ff828004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:46.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/2964131721 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff828004b40 0x7ff828004fc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7ff8400012f0 tx=0x7ff840007d60).stop 2021-11-15T19:33:46.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff846d9d700 1 -- 172.21.2.137:0/2964131721 reap_dead start 2021-11-15T19:33:46.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- 172.21.2.137:0/2964131721 shutdown_connections 2021-11-15T19:33:46.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- 172.21.2.137:0/2964131721 >> 172.21.2.137:0/2964131721 conn(0x7ff8480b45b0 msgr2=0x7ff84805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:46.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- 172.21.2.137:0/2964131721 shutdown_connections 2021-11-15T19:33:46.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.173+0000 7ff84c8e5700 1 -- 172.21.2.137:0/2964131721 wait complete. 2021-11-15T19:33:46.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 Processor -- start 2021-11-15T19:33:46.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- start start 2021-11-15T19:33:46.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff828004b40 0x7ff848145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 0x7ff8480b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8480b1190 0x7ff848152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480ac770 con 0x7ff8480b1190 2021-11-15T19:33:46.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff848146710 con 0x7ff8480ac310 2021-11-15T19:33:46.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480ae7a0 con 0x7ff828004b40 2021-11-15T19:33:46.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 0x7ff8480b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:46.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 0x7ff8480b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37164/0 (socket says 172.21.2.137:37164) 2021-11-15T19:33:46.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 -- 172.21.2.137:0/3357617950 learned_addr learned my addr 172.21.2.137:0/3357617950 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:46.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84659c700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff828004b40 0x7ff848145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:46.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 -- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff828004b40 msgr2=0x7ff848145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:46.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff828004b40 0x7ff848145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:46.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 -- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8480b1190 msgr2=0x7ff848152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:46.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8480b1190 0x7ff848152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:46.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 -- 172.21.2.137:0/3357617950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480ae340 con 0x7ff8480ac310 2021-11-15T19:33:46.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84659c700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff828004b40 0x7ff848145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:46.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff845d9b700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 0x7ff8480b0ca0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7ff848144d30 tx=0x7ff8480b2830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:46.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff830007170 con 0x7ff8480ac310 2021-11-15T19:33:46.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8300072d0 con 0x7ff8480ac310 2021-11-15T19:33:46.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff848146940 con 0x7ff8480ac310 2021-11-15T19:33:46.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff848146220 con 0x7ff8480ac310 2021-11-15T19:33:46.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff830004920 con 0x7ff8480ac310 2021-11-15T19:33:46.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff848146530 con 0x7ff8480ac310 2021-11-15T19:33:46.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff83001b070 con 0x7ff8480ac310 2021-11-15T19:33:46.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff83f7fe700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff82c0535d0 0x7ff82c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:46.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.177+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff83006afe0 con 0x7ff8480ac310 2021-11-15T19:33:46.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.181+0000 7ff84659c700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff82c0535d0 0x7ff82c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:46.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.181+0000 7ff84659c700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff82c0535d0 0x7ff82c055a90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff838007000 tx=0x7ff838008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:46.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.181+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff830042310 con 0x7ff8480ac310 2021-11-15T19:33:46.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:46.293+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7ff848099a30 con 0x7ff8480ac310 2021-11-15T19:33:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff83f7fe700 1 -- 172.21.2.137:0/3357617950 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v288) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff830045930 con 0x7ff8480ac310 2021-11-15T19:33:47.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff82c0535d0 msgr2=0x7ff82c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff82c0535d0 0x7ff82c055a90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff838007000 tx=0x7ff838008040).stop 2021-11-15T19:33:47.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 msgr2=0x7ff8480b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 0x7ff8480b0ca0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7ff848144d30 tx=0x7ff8480b2830).stop 2021-11-15T19:33:47.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 shutdown_connections 2021-11-15T19:33:47.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff82c0535d0 0x7ff82c055a90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff8480b1190 0x7ff848152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff8480ac310 0x7ff8480b0ca0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 --2- 172.21.2.137:0/3357617950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff828004b40 0x7ff848145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 >> 172.21.2.137:0/3357617950 conn(0x7ff8480b45b0 msgr2=0x7ff848147280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 shutdown_connections 2021-11-15T19:33:47.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.113+0000 7ff84c8e5700 1 -- 172.21.2.137:0/3357617950 wait complete. 2021-11-15T19:33:47.129 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:33:47.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.177+0000 7f1259e80700 1 Processor -- start 2021-11-15T19:33:47.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.177+0000 7f1259e80700 1 -- start start 2021-11-15T19:33:47.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f12540b0550 0x7f125414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f1254140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125405cb50 con 0x7f125405c770 2021-11-15T19:33:47.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540b1650 con 0x7f12540b0550 2021-11-15T19:33:47.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ad030 con 0x7f125414aaa0 2021-11-15T19:33:47.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f12540b0550 0x7f125414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f12540b0550 0x7f125414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37176/0 (socket says 172.21.2.137:37176) 2021-11-15T19:33:47.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 -- 172.21.2.137:0/1999199856 learned_addr learned my addr 172.21.2.137:0/1999199856 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:47.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 -- 172.21.2.137:0/1999199856 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 msgr2=0x7f1254140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:47.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 --2- 172.21.2.137:0/1999199856 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f1254140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 -- 172.21.2.137:0/1999199856 >> v1:172.21.2.111:6789/0 conn(0x7f125405c770 legacy=0x7f12540aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 -- 172.21.2.137:0/1999199856 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540ad2d0 con 0x7f12540b0550 2021-11-15T19:33:47.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 --2- 172.21.2.137:0/1999199856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f12540b0550 0x7f125414a5b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f12540620e0 tx=0x7f123c006eb0).ready entity=mon.1 client_cookie=b31641c1a817cb52 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12527fc700 1 -- 172.21.2.137:0/1999199856 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f123c00d570 con 0x7f12540b0550 2021-11-15T19:33:47.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12527fc700 1 -- 172.21.2.137:0/1999199856 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c000e90 con 0x7f12540b0550 2021-11-15T19:33:47.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12527fc700 1 -- 172.21.2.137:0/1999199856 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f123c00d8c0 con 0x7f12540b0550 2021-11-15T19:33:47.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- 172.21.2.137:0/1999199856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f12540b0550 msgr2=0x7f125414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- 172.21.2.137:0/1999199856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f12540b0550 0x7f125414a5b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f12540620e0 tx=0x7f123c006eb0).stop 2021-11-15T19:33:47.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- 172.21.2.137:0/1999199856 shutdown_connections 2021-11-15T19:33:47.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- 172.21.2.137:0/1999199856 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f1254140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- 172.21.2.137:0/1999199856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f12540b0550 0x7f125414a5b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- 172.21.2.137:0/1999199856 >> 172.21.2.137:0/1999199856 conn(0x7f12540631e0 msgr2=0x7f125405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- 172.21.2.137:0/1999199856 shutdown_connections 2021-11-15T19:33:47.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- 172.21.2.137:0/1999199856 wait complete. 2021-11-15T19:33:47.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 Processor -- start 2021-11-15T19:33:47.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- start start 2021-11-15T19:33:47.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 0x7f1254149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f12540b0550 0x7f12541565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f125415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254159b80 con 0x7f12540b0550 2021-11-15T19:33:47.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254144890 con 0x7f125405c770 2021-11-15T19:33:47.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1259e80700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1254144b30 con 0x7f125414aaa0 2021-11-15T19:33:47.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 0x7f1254149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 0x7f1254149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37180/0 (socket says 172.21.2.137:37180) 2021-11-15T19:33:47.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 -- 172.21.2.137:0/1747908650 learned_addr learned my addr 172.21.2.137:0/1747908650 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:47.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1253fff700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f125415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f1252ffd700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f12540b0550 0x7f12541565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 -- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 msgr2=0x7f125415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f125415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 -- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f12540b0550 msgr2=0x7f12541565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f12540b0550 0x7f12541565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 -- 172.21.2.137:0/1747908650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c00b1e0 con 0x7f125405c770 2021-11-15T19:33:47.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.181+0000 7f12537fe700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 0x7f1254149610 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f1254143460 tx=0x7f1244006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1244012410 con 0x7f125405c770 2021-11-15T19:33:47.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244012570 con 0x7f125405c770 2021-11-15T19:33:47.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1254159db0 con 0x7f125405c770 2021-11-15T19:33:47.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12440128d0 con 0x7f125405c770 2021-11-15T19:33:47.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1254156ae0 con 0x7f125405c770 2021-11-15T19:33:47.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12540ae7f0 con 0x7f125405c770 2021-11-15T19:33:47.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f124400f030 con 0x7f125405c770 2021-11-15T19:33:47.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12380536f0 0x7f1238055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f124406b410 con 0x7f125405c770 2021-11-15T19:33:47.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1252ffd700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12380536f0 0x7f1238055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1252ffd700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12380536f0 0x7f1238055bb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f123c017000 tx=0x7f123c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.185+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1244042850 con 0x7f125405c770 2021-11-15T19:33:47.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.269+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f125405db30 con 0x7f125405c770 2021-11-15T19:33:47.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1250ff9700 1 -- 172.21.2.137:0/1747908650 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1244045e70 con 0x7f125405c770 2021-11-15T19:33:47.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12380536f0 msgr2=0x7f1238055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12380536f0 0x7f1238055bb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f123c017000 tx=0x7f123c015000).stop 2021-11-15T19:33:47.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 msgr2=0x7f1254149610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 0x7f1254149610 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f1254143460 tx=0x7f1244006d50).stop 2021-11-15T19:33:47.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 shutdown_connections 2021-11-15T19:33:47.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f12380536f0 0x7f1238055bb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f125414aaa0 0x7f125415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f12540b0550 0x7f12541565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 --2- 172.21.2.137:0/1747908650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f125405c770 0x7f1254149610 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 >> 172.21.2.137:0/1747908650 conn(0x7f12540631e0 msgr2=0x7f12540b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 shutdown_connections 2021-11-15T19:33:47.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.285+0000 7f1259e80700 1 -- 172.21.2.137:0/1747908650 wait complete. 2021-11-15T19:33:47.297 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:33:47.298 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:47.306 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:47.319 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:47.332 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:47.346 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:33:47.358 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:33:47.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:47.360 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:47.360 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:47.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:47.364 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:33:47.365 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:47.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:47.366 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:47.366 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:47.382 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:33:47.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:47.384 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:33:47.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:47.385 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:47.385 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:33:47.390 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:33:47.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:33:47.392 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:33:47.393 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:33:47.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 Processor -- start 2021-11-15T19:33:47.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 -- start start 2021-11-15T19:33:47.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f24500b1340 0x7f2450147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2450143f00 0x7f2450144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2450148190 con 0x7f24500a9f50 2021-11-15T19:33:47.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24500b1720 con 0x7f24500b1340 2021-11-15T19:33:47.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f24562d1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450147e70 con 0x7f2450143f00 2021-11-15T19:33:47.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f245486e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f24500a9f50 0x7f24500aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55970/0 (socket says 172.21.2.137:55970) 2021-11-15T19:33:47.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f245486e700 1 -- 172.21.2.137:0/3707042534 learned_addr learned my addr 172.21.2.137:0/3707042534 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:47.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f244f7fe700 1 --2- 172.21.2.137:0/3707042534 >> v2:172.21.2.137:3300/0 conn(0x7f2450143f00 0x7f2450144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f244effd700 1 -- 172.21.2.137:0/3707042534 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898549088 0 0) 0x7f2448001490 con 0x7f24500a9f50 2021-11-15T19:33:47.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f244effd700 1 -- 172.21.2.137:0/3707042534 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2430003260 con 0x7f24500a9f50 2021-11-15T19:33:47.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f244f7fe700 1 -- 172.21.2.137:0/3707042534 >> v2:172.21.2.111:3300/0 conn(0x7f24500b1340 msgr2=0x7f2450147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f244f7fe700 1 --2- 172.21.2.137:0/3707042534 >> v2:172.21.2.111:3300/0 conn(0x7f24500b1340 0x7f2450147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.465+0000 7f244f7fe700 1 -- 172.21.2.137:0/3707042534 >> v1:172.21.2.137:6789/0 conn(0x7f24500a9f50 legacy=0x7f24500aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244f7fe700 1 -- 172.21.2.137:0/3707042534 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500af800 con 0x7f2450143f00 2021-11-15T19:33:47.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244f7fe700 1 --2- 172.21.2.137:0/3707042534 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2450143f00 0x7f2450144390 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f2438002f70 tx=0x7f2438006df0).ready entity=mon.1 client_cookie=d538b6ab27e1b9a1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244effd700 1 -- 172.21.2.137:0/3707042534 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243800d570 con 0x7f2450143f00 2021-11-15T19:33:47.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244effd700 1 -- 172.21.2.137:0/3707042534 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438000e90 con 0x7f2450143f00 2021-11-15T19:33:47.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244effd700 1 -- 172.21.2.137:0/3707042534 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243800d8c0 con 0x7f2450143f00 2021-11-15T19:33:47.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/3707042534 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2450143f00 msgr2=0x7f2450144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 --2- 172.21.2.137:0/3707042534 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2450143f00 0x7f2450144390 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f2438002f70 tx=0x7f2438006df0).stop 2021-11-15T19:33:47.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/3707042534 shutdown_connections 2021-11-15T19:33:47.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 --2- 172.21.2.137:0/3707042534 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2450143f00 0x7f2450144390 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 --2- 172.21.2.137:0/3707042534 >> v2:172.21.2.111:3300/0 conn(0x7f24500b1340 0x7f2450147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/3707042534 >> 172.21.2.137:0/3707042534 conn(0x7f24500b4e60 msgr2=0x7f24500b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/3707042534 shutdown_connections 2021-11-15T19:33:47.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/3707042534 wait complete. 2021-11-15T19:33:47.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 Processor -- start 2021-11-15T19:33:47.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- start start 2021-11-15T19:33:47.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 0x7f245013ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24500b1340 0x7f245009a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2450143f00 0x7f2450097fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245009a210 con 0x7f2450143f00 2021-11-15T19:33:47.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245009a4b0 con 0x7f24500a9f50 2021-11-15T19:33:47.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24500af0b0 con 0x7f24500b1340 2021-11-15T19:33:47.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 0x7f245013ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 0x7f245013ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37196/0 (socket says 172.21.2.137:37196) 2021-11-15T19:33:47.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 -- 172.21.2.137:0/1584218438 learned_addr learned my addr 172.21.2.137:0/1584218438 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:47.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 -- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24500b1340 msgr2=0x7f245009a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24500b1340 0x7f245009a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 -- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2450143f00 msgr2=0x7f2450097fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2450143f00 0x7f2450097fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 -- 172.21.2.137:0/1584218438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243800b180 con 0x7f24500a9f50 2021-11-15T19:33:47.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244ffff700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 0x7f245013ebc0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f2440002f70 tx=0x7f2440006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2440013460 con 0x7f24500a9f50 2021-11-15T19:33:47.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24400135c0 con 0x7f24500a9f50 2021-11-15T19:33:47.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24500984c0 con 0x7f24500a9f50 2021-11-15T19:33:47.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2440013920 con 0x7f24500a9f50 2021-11-15T19:33:47.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245013db10 con 0x7f24500a9f50 2021-11-15T19:33:47.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.469+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245009a670 con 0x7f24500a9f50 2021-11-15T19:33:47.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.473+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f244000f070 con 0x7f24500a9f50 2021-11-15T19:33:47.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.473+0000 7f244d7fa700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24340536d0 0x7f2434055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.473+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f244006afe0 con 0x7f24500a9f50 2021-11-15T19:33:47.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.473+0000 7f244f7fe700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24340536d0 0x7f2434055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.473+0000 7f244f7fe700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24340536d0 0x7f2434055b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f2438002f70 tx=0x7f2438014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.473+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2440042310 con 0x7f24500a9f50 2021-11-15T19:33:47.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f245005faf0 con 0x7f24500a9f50 2021-11-15T19:33:47.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f244d7fa700 1 -- 172.21.2.137:0/1584218438 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v87) v1 ==== 81+0+28828 (secure 0 0 0) 0x7f2440045930 con 0x7f24500a9f50 2021-11-15T19:33:47.567 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:47.567 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:33:47.568 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 87, 2021-11-15T19:33:47.568 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:33:47.568 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:33:47.568 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:33:45.093055+0000", 2021-11-15T19:33:47.569 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:47.569 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:33:47.569 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:33:47.569 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:33:47.569 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:33:47.570 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:33:47.570 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:33:47.570 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:33:47.570 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:33:47.571 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:47.571 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:33:47.571 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:33:47.571 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:33:47.571 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:33:47.572 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:33:47.572 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 16, 2021-11-15T19:33:47.572 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:33:47.572 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:33:47.572 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:33:47.573 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:33:47.573 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:33:47.573 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.573 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:33:47.574 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:33:47.574 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:33:47.574 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:47.574 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:47.574 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:47.575 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:47.575 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:47.575 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:47.575 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:47.575 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:47.576 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:33:47.576 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:33:47.576 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:33:47.576 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:33:47.577 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:33:47.577 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:47.577 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:47.577 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:47.577 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:47.578 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:47.578 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:47.578 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:47.578 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.579 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:33:47.579 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:47.579 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:47.579 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:47.579 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:47.580 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:47.580 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:47.580 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:47.580 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:47.580 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:47.581 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:47.581 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:47.581 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:47.581 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:47.582 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:47.582 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:47.582 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:47.582 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:47.582 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:47.583 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:47.583 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:47.583 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:47.583 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:47.584 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:47.584 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:47.584 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:47.584 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:47.584 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.585 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:47.585 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:47.585 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:47.585 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:47.585 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:47.586 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:47.586 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:47.586 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:47.586 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:47.586 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:47.587 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:47.587 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:33:47.587 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:33:47.587 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.588 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:47.588 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:33:47.588 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.588 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.588 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.589 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:33:47.589 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:33:47.589 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:33:47.589 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:33:47.589 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:33:47.590 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:33:47.590 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:33:47.590 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:33:47.590 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:33:47.590 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:33:47.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:33:47.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:33:47.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:33:47.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:33:47.592 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:33:47.592 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:33:47.592 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:33:47.592 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:33:47.592 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:33:47.593 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:33:47.593 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:33:47.593 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:33:47.593 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:33:47.593 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.594 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:33:47.594 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:33:47.594 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:33:47.594 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:33:47.595 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:33:47.595 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:33:47.595 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:33:47.595 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:33:47.595 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:33:47.596 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:33:47.596 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:33:47.596 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:33:47.596 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:33:47.596 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:33:47.597 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:33:47.597 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:33:47.597 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:33:47.597 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:33:47.598 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:33:47.598 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:33:47.598 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:33:47.598 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:33:47.598 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:33:47.599 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:33:47.599 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:33:47.599 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:33:47.599 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:33:47.600 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.600 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:33:47.600 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:33:47.600 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:33:47.600 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:33:47.601 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:33:47.601 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:33:47.601 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:33:47.601 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:33:47.601 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:33:47.602 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:33:47.602 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:33:47.602 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:33:47.602 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:33:47.602 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:33:47.603 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.603 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.603 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:47.603 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:33:47.604 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.604 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:47.604 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:33:47.604 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.604 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.605 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.605 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.605 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.605 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.605 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.606 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:47.606 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.606 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.606 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.606 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.607 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.607 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.607 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:33:47.607 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.608 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.608 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.608 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.608 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:33:47.608 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.609 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.609 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.609 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.609 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.609 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.610 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.610 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.610 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:33:47.610 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.610 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.611 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.611 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.611 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:33:47.611 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.612 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.612 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.612 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.612 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.612 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.613 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.613 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.613 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:33:47.613 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.613 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.614 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.614 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.614 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:33:47.614 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.615 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.615 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.615 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.615 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.615 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.616 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.616 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.616 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:33:47.616 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.616 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.616 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.617 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.617 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:33:47.617 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:33:47.617 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.617 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.618 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.618 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:33:47.618 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:33:47.618 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:33:47.618 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:33:47.619 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.619 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.619 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.619 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.620 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.620 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.620 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:47.620 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:33:47.620 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.621 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.621 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.621 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.621 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.621 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.622 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.622 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 80, 2021-11-15T19:33:47.622 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.622 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.622 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.623 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.623 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.623 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.623 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:33:47.624 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.624 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.624 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.624 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.624 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:33:47.625 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.625 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.625 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.625 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.625 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.625 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.626 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.626 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.626 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:33:47.626 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.626 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.627 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.627 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.627 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:33:47.627 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.627 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.628 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.628 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.628 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.628 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.628 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.629 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.629 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:33:47.629 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.629 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.630 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.630 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.630 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:33:47.630 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.630 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.631 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.631 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.631 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.631 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.631 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.632 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.632 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:33:47.632 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.632 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.632 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.633 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.633 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:33:47.633 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:33:47.633 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.634 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.634 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.634 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:33:47.634 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:33:47.634 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:33:47.635 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:33:47.635 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.635 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.635 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.636 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.636 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.636 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.636 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:47.636 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:33:47.637 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.637 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.637 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.637 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.638 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.638 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.638 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.638 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:47.638 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.639 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.639 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.639 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.639 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.640 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.640 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:33:47.640 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.640 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.640 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.641 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.641 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:33:47.641 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.641 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.641 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.642 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.642 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.642 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.642 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.643 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.643 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:33:47.643 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.643 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.643 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.644 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.644 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:33:47.644 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.644 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.644 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.645 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.645 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.645 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.645 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.646 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.646 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:33:47.646 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.646 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.646 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.647 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.647 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:33:47.647 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.647 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.647 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.648 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.648 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.648 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.648 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.648 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.649 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:33:47.649 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.649 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.649 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.650 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.650 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:33:47.650 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:33:47.650 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.650 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.651 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.651 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:33:47.651 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:33:47.651 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:33:47.651 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:33:47.652 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.652 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.652 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.652 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.652 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.652 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.653 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:47.653 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:33:47.653 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.653 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.653 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.654 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.654 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.654 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.654 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.654 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:47.655 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.655 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.655 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.655 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.655 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.656 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.656 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:33:47.656 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.656 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.657 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.657 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.657 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:33:47.657 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.657 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.658 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.658 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.658 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.658 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.659 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.659 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:33:47.659 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.659 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.659 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.660 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.660 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:33:47.660 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.660 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.660 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.661 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.661 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.661 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.661 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.661 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.662 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:33:47.662 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.662 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.662 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.662 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.663 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:33:47.663 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.663 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.663 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.663 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.664 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.664 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.664 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.664 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.664 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:33:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.666 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:33:47.666 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:33:47.666 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.666 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.666 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.667 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:33:47.667 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:33:47.667 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:33:47.667 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:33:47.668 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.668 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.668 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.668 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.668 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.669 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.669 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:47.669 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:33:47.669 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.669 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.670 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.670 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.670 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.671 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:47.671 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.671 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.671 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.672 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.672 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.672 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.672 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:33:47.672 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.673 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.673 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.673 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.673 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:33:47.673 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.674 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.674 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.674 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.674 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.675 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.675 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.675 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:33:47.675 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.675 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.676 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.676 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.676 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:33:47.676 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.677 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.677 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.677 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.677 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.677 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.678 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.678 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.678 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:33:47.678 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.678 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.679 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.679 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.679 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:33:47.679 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.680 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.680 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.680 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.680 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.681 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.681 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.681 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:33:47.681 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.681 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.681 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.682 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.682 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:33:47.682 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:33:47.682 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.682 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.683 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.683 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:33:47.683 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:33:47.683 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:33:47.683 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:33:47.684 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.684 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.684 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.684 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.684 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.685 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:47.685 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:33:47.685 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.686 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.686 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.686 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.686 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.686 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.687 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.687 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:47.687 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.687 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.688 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.688 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.688 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.688 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:33:47.689 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.689 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.689 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.689 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.689 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:33:47.690 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.690 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.690 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.690 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.690 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.691 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.691 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.691 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.691 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:33:47.691 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.692 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.692 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.692 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.692 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:33:47.692 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.693 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.693 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.693 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.693 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.694 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.694 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.694 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:33:47.694 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.695 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.695 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.695 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.695 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:33:47.695 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.696 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.696 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.696 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.696 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.696 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.697 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.697 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.697 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:33:47.697 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.697 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.698 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.698 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.698 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:33:47.698 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:33:47.699 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.699 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.699 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.699 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:33:47.699 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:33:47.700 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:33:47.700 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:33:47.700 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.700 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.700 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.701 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.701 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.701 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:47.701 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:33:47.702 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.702 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.702 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.702 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.703 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.703 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.703 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.703 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:33:47.703 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.704 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.704 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.704 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.704 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.705 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:33:47.705 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.705 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.705 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.705 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.706 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:33:47.706 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.706 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.707 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.707 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.707 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.707 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.707 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.708 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:33:47.708 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.708 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.708 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.708 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.709 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:33:47.709 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.709 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.709 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.709 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.710 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.710 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.710 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.710 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.710 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:33:47.711 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.711 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.711 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:33:47.712 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.712 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.712 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.712 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.713 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.713 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.713 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.713 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:33:47.713 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.714 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.714 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.714 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.714 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:33:47.715 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:33:47.715 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.715 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.715 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.715 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:33:47.716 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:33:47.716 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:33:47.716 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:33:47.716 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.716 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.717 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.717 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.717 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.717 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.717 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:47.718 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:33:47.718 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:33:47.718 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:33:47.718 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:33:47.719 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:33:47.719 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:33:47.719 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:33:47.719 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:33:47.719 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 70, 2021-11-15T19:33:47.720 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:33:47.720 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:33:47.720 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:33:47.720 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.721 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.721 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:33:47.721 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.721 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.721 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.722 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.722 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:33:47.722 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.722 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.723 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.723 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:33:47.723 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.723 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.724 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.724 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:33:47.724 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.724 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.725 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.725 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.725 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:33:47.725 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.725 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.726 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.726 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.726 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:33:47.726 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.726 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.727 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.727 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:33:47.727 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.727 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.728 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:33:47.728 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.728 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.728 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.729 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:33:47.729 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:33:47.729 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.729 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:33:47.730 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:33:47.730 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.730 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.730 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.731 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:33:47.731 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:33:47.731 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:33:47.731 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.731 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.732 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.732 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:33:47.732 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:33:47.732 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:33:47.732 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:33:47.733 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:33:47.733 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:33:47.733 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:33:47.733 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:47.734 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.734 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:47.734 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:33:47.734 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.734 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:33:47.735 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.735 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.735 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.735 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.735 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.736 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:33:47.736 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.736 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.736 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.736 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:33:47.737 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.737 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.737 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.737 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.737 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.738 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:33:47.738 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.738 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.738 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.738 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:33:47.739 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.739 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.739 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.739 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.739 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.740 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:33:47.740 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.740 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.740 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.741 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:33:47.741 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.741 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.741 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.741 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.742 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.742 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:33:47.742 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.742 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.742 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.743 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:33:47.743 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.743 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.743 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.744 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.744 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.744 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:33:47.744 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.744 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.745 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.745 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:33:47.745 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.745 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.745 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.746 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.746 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.746 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:33:47.746 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.746 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.747 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.747 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:33:47.747 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.747 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.747 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.748 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.748 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.748 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:33:47.748 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.748 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.749 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:47.749 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:33:47.749 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:33:47.749 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:33:47.749 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:33:47.750 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:33:47.750 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:33:47.750 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:33:47.750 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:33:47.750 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.751 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:33:47.751 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:33:47.751 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:33:47.751 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:33:47.752 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:33:47.752 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:33:47.752 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/2662817327": "2021-11-16T19:33:41.791871+0000", 2021-11-15T19:33:47.752 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/2662817327": "2021-11-16T19:33:41.791871+0000" 2021-11-15T19:33:47.752 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.753 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:33:47.753 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:33:47.753 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:33:47.753 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:33:47.753 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:33:47.754 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:33:47.754 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:33:47.754 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:33:47.754 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:47.755 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:47.755 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:33:47.755 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:33:47.755 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:33:47.755 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:33:47.755 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:33:47.756 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:33:47.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24340536d0 msgr2=0x7f2434055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24340536d0 0x7f2434055b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f2438002f70 tx=0x7f2438014000).stop 2021-11-15T19:33:47.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 msgr2=0x7f245013ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 0x7f245013ebc0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f2440002f70 tx=0x7f2440006e20).stop 2021-11-15T19:33:47.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 shutdown_connections 2021-11-15T19:33:47.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24340536d0 0x7f2434055b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2450143f00 0x7f2450097fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f24500b1340 0x7f245009a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 --2- 172.21.2.137:0/1584218438 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f24500a9f50 0x7f245013ebc0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 >> 172.21.2.137:0/1584218438 conn(0x7f24500b4e60 msgr2=0x7f24500b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 shutdown_connections 2021-11-15T19:33:47.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.557+0000 7f24562d1700 1 -- 172.21.2.137:0/1584218438 wait complete. 2021-11-15T19:33:47.760 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:47.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 Processor -- start 2021-11-15T19:33:47.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 -- start start 2021-11-15T19:33:47.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c0b1340 0x7fd43c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd43c143f00 0x7fd43c144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c148190 con 0x7fd43c0a9f50 2021-11-15T19:33:47.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0b1720 con 0x7fd43c143f00 2021-11-15T19:33:47.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd44472f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c147e70 con 0x7fd43c0b1340 2021-11-15T19:33:47.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd442ccc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd43c0a9f50 0x7fd43c0aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55988/0 (socket says 172.21.2.137:55988) 2021-11-15T19:33:47.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd442ccc700 1 -- 172.21.2.137:0/2891463357 learned_addr learned my addr 172.21.2.137:0/2891463357 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:47.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd441cca700 1 --2- 172.21.2.137:0/2891463357 >> v2:172.21.2.137:3300/0 conn(0x7fd43c143f00 0x7fd43c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd441cca700 1 -- 172.21.2.137:0/2891463357 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c0b1340 msgr2=0x7fd43c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd441cca700 1 --2- 172.21.2.137:0/2891463357 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c0b1340 0x7fd43c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd441cca700 1 -- 172.21.2.137:0/2891463357 >> v1:172.21.2.137:6789/0 conn(0x7fd43c0a9f50 legacy=0x7fd43c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd441cca700 1 -- 172.21.2.137:0/2891463357 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0af800 con 0x7fd43c143f00 2021-11-15T19:33:47.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd441cca700 1 --2- 172.21.2.137:0/2891463357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c143f00 0x7fd43c144360 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fd42c002f70 tx=0x7fd42c006df0).ready entity=mon.1 client_cookie=f8388a8e2f42c971 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd4414c9700 1 -- 172.21.2.137:0/2891463357 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c00d570 con 0x7fd43c143f00 2021-11-15T19:33:47.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd4414c9700 1 -- 172.21.2.137:0/2891463357 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c000e90 con 0x7fd43c143f00 2021-11-15T19:33:47.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.805+0000 7fd4414c9700 1 -- 172.21.2.137:0/2891463357 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c00d8c0 con 0x7fd43c143f00 2021-11-15T19:33:47.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2891463357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c143f00 msgr2=0x7fd43c144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 --2- 172.21.2.137:0/2891463357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c143f00 0x7fd43c144360 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fd42c002f70 tx=0x7fd42c006df0).stop 2021-11-15T19:33:47.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2891463357 shutdown_connections 2021-11-15T19:33:47.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 --2- 172.21.2.137:0/2891463357 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c143f00 0x7fd43c144360 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 --2- 172.21.2.137:0/2891463357 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c0b1340 0x7fd43c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2891463357 >> 172.21.2.137:0/2891463357 conn(0x7fd43c0b4e60 msgr2=0x7fd43c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2891463357 shutdown_connections 2021-11-15T19:33:47.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2891463357 wait complete. 2021-11-15T19:33:47.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 Processor -- start 2021-11-15T19:33:47.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- start start 2021-11-15T19:33:47.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 0x7fd43c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd43c0b1340 0x7fd43c145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c143f00 0x7fd43c0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0af190 con 0x7fd43c0b1340 2021-11-15T19:33:47.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0ac2a0 con 0x7fd43c0a9f50 2021-11-15T19:33:47.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c15a4b0 con 0x7fd43c143f00 2021-11-15T19:33:47.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 0x7fd43c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 0x7fd43c159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37208/0 (socket says 172.21.2.137:37208) 2021-11-15T19:33:47.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 -- 172.21.2.137:0/2082858872 learned_addr learned my addr 172.21.2.137:0/2082858872 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:47.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 -- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c143f00 msgr2=0x7fd43c0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c143f00 0x7fd43c0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 -- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd43c0b1340 msgr2=0x7fd43c145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd43c0b1340 0x7fd43c145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 -- 172.21.2.137:0/2082858872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c00b180 con 0x7fd43c0a9f50 2021-11-15T19:33:47.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd4424cb700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 0x7fd43c159fc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fd438002f70 tx=0x7fd438006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd438013460 con 0x7fd43c0a9f50 2021-11-15T19:33:47.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4380135c0 con 0x7fd43c0a9f50 2021-11-15T19:33:47.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c141bb0 con 0x7fd43c0a9f50 2021-11-15T19:33:47.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c1461d0 con 0x7fd43c0a9f50 2021-11-15T19:33:47.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd438013920 con 0x7fd43c0a9f50 2021-11-15T19:33:47.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd418003410 con 0x7fd43c0a9f50 2021-11-15T19:33:47.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd43801a060 con 0x7fd43c0a9f50 2021-11-15T19:33:47.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd42b7fe700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd41c0536f0 0x7fd41c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.809+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd43806b190 con 0x7fd43c0a9f50 2021-11-15T19:33:47.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.813+0000 7fd441cca700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd41c0536f0 0x7fd41c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.813+0000 7fd441cca700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd41c0536f0 0x7fd41c055bb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fd42c002f70 tx=0x7fd42c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.813+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd438042460 con 0x7fd43c0a9f50 2021-11-15T19:33:47.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd418003c40 con 0x7fd43c0a9f50 2021-11-15T19:33:47.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd42b7fe700 1 -- 172.21.2.137:0/2082858872 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fd438018020 con 0x7fd43c0a9f50 2021-11-15T19:33:47.931 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:47.931 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/3004644946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3004644946},{"type":"v1","addr":"172.21.2.137:6833","nonce":3004644946}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-11-15T19:33:47.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd41c0536f0 msgr2=0x7fd41c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd41c0536f0 0x7fd41c055bb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fd42c002f70 tx=0x7fd42c015000).stop 2021-11-15T19:33:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 msgr2=0x7fd43c159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 0x7fd43c159fc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fd438002f70 tx=0x7fd438006e20).stop 2021-11-15T19:33:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 shutdown_connections 2021-11-15T19:33:47.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd41c0536f0 0x7fd41c055bb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd43c143f00 0x7fd43c0ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd43c0b1340 0x7fd43c145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 --2- 172.21.2.137:0/2082858872 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd43c0a9f50 0x7fd43c159fc0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 >> 172.21.2.137:0/2082858872 conn(0x7fd43c0b4e60 msgr2=0x7fd43c13e740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:47.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 shutdown_connections 2021-11-15T19:33:47.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.921+0000 7fd44472f700 1 -- 172.21.2.137:0/2082858872 wait complete. 2021-11-15T19:33:47.935 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 40 2021-11-15T19:33:47.938 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:47.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.977+0000 7f4518a0f700 1 Processor -- start 2021-11-15T19:33:47.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.977+0000 7f4518a0f700 1 -- start start 2021-11-15T19:33:47.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f45140b0c50 0x7f45141401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 0x7f45140aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45140b1390 con 0x7f451413c780 2021-11-15T19:33:47.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451413f840 con 0x7f45140b0c50 2021-11-15T19:33:47.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b1030 con 0x7f45140aa4e0 2021-11-15T19:33:47.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4512d9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f451413c780 0x7f451413cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:55998/0 (socket says 172.21.2.137:55998) 2021-11-15T19:33:47.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4512d9d700 1 -- 172.21.2.137:0/312888207 learned_addr learned my addr 172.21.2.137:0/312888207 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483833078 0 0) 0x7f45140b1390 con 0x7f451413c780 2021-11-15T19:33:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f4003260 con 0x7f451413c780 2021-11-15T19:33:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302855603 0 0) 0x7f44f4003260 con 0x7f451413c780 2021-11-15T19:33:47.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4511d9b700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 0x7f45140aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 msgr2=0x7f45140aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 0x7f45140aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 >> v2:172.21.2.111:3300/0 conn(0x7f45140b0c50 msgr2=0x7f45141401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 --2- 172.21.2.137:0/312888207 >> v2:172.21.2.111:3300/0 conn(0x7f45140b0c50 0x7f45141401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 --2- 172.21.2.137:0/312888207 >> v2:172.21.2.111:3300/0 conn(0x7f45140b0c50 0x7f45141401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451413fa60 con 0x7f451413c780 2021-11-15T19:33:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4504001660 con 0x7f451413c780 2021-11-15T19:33:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 >> v1:172.21.2.137:6789/0 conn(0x7f451413c780 legacy=0x7f451413cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:47.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44f40037d0 0x7f44f4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f4004500 0x7f44f4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 0x7f44f400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451413f840 con 0x7f44f4004500 2021-11-15T19:33:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b1030 con 0x7f44f40037d0 2021-11-15T19:33:47.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4005300 con 0x7f45140aa4e0 2021-11-15T19:33:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44f40037d0 0x7f44f4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 -- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 msgr2=0x7f44f400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45140aa4e0 0x7f44f400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 -- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f4004500 msgr2=0x7f44f4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:47.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f4004500 0x7f44f4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 -- 172.21.2.137:0/312888207 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4003260 con 0x7f44f40037d0 2021-11-15T19:33:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451259c700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44f40037d0 0x7f44f4003bf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f44fc007000 tx=0x7f44fc008040).ready entity=mon.1 client_cookie=b448ba5bd465b8b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44fc012470 con 0x7f44f40037d0 2021-11-15T19:33:47.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc00c030 con 0x7f44f40037d0 2021-11-15T19:33:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f451159a700 1 -- 172.21.2.137:0/312888207 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44fc0127c0 con 0x7f44f40037d0 2021-11-15T19:33:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- 172.21.2.137:0/312888207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44f40037d0 msgr2=0x7f44f4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 --2- 172.21.2.137:0/312888207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44f40037d0 0x7f44f4003bf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f44fc007000 tx=0x7f44fc008040).stop 2021-11-15T19:33:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4512d9d700 1 -- 172.21.2.137:0/312888207 reap_dead start 2021-11-15T19:33:48.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- 172.21.2.137:0/312888207 shutdown_connections 2021-11-15T19:33:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- 172.21.2.137:0/312888207 >> 172.21.2.137:0/312888207 conn(0x7f45140b4e60 msgr2=0x7f45140b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- 172.21.2.137:0/312888207 shutdown_connections 2021-11-15T19:33:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- 172.21.2.137:0/312888207 wait complete. 2021-11-15T19:33:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 Processor -- start 2021-11-15T19:33:48.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.981+0000 7f4518a0f700 1 -- start start 2021-11-15T19:33:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f40037d0 0x7f4514143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45141459f0 0x7f45140b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 0x7f451413b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451409aca0 con 0x7f44f40037d0 2021-11-15T19:33:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451409aa00 con 0x7f451413b490 2021-11-15T19:33:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514144770 con 0x7f45141459f0 2021-11-15T19:33:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 0x7f451413b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:48.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 0x7f451413b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37230/0 (socket says 172.21.2.137:37230) 2021-11-15T19:33:48.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 -- 172.21.2.137:0/4187701804 learned_addr learned my addr 172.21.2.137:0/4187701804 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:48.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 -- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45141459f0 msgr2=0x7f45140b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45141459f0 0x7f45140b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 -- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f40037d0 msgr2=0x7f4514143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f40037d0 0x7f4514143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 -- 172.21.2.137:0/4187701804 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140b4960 con 0x7f451413b490 2021-11-15T19:33:48.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4512d9d700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 0x7f451413b940 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f4504001370 tx=0x7f4504001760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:48.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45040070d0 con 0x7f451413b490 2021-11-15T19:33:48.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504007230 con 0x7f451413b490 2021-11-15T19:33:48.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4504004710 con 0x7f451413b490 2021-11-15T19:33:48.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451413be30 con 0x7f451413b490 2021-11-15T19:33:48.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514144db0 con 0x7f451413b490 2021-11-15T19:33:48.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45141445a0 con 0x7f451413b490 2021-11-15T19:33:48.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f450401c070 con 0x7f451413b490 2021-11-15T19:33:48.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f450b7fe700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44f8053690 0x7f44f8055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f450406a8b0 con 0x7f451413b490 2021-11-15T19:33:48.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.985+0000 7f451259c700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44f8053690 0x7f44f8055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:48.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.989+0000 7f451259c700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44f8053690 0x7f44f8055b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f44fc007000 tx=0x7f44fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:48.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:47.989+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4504041b80 con 0x7f451413b490 2021-11-15T19:33:48.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.093+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f451413fd00 con 0x7f451413b490 2021-11-15T19:33:48.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f450b7fe700 1 -- 172.21.2.137:0/4187701804 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f45040451a0 con 0x7f451413b490 2021-11-15T19:33:48.105 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:48.106 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/1387387971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1387387971},{"type":"v1","addr":"172.21.2.111:6835","nonce":1387387971}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/3004644946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3004644946},{"type":"v1","addr":"172.21.2.137:6833","nonce":3004644946}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-11-15T19:33:48.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44f8053690 msgr2=0x7f44f8055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44f8053690 0x7f44f8055b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f44fc007000 tx=0x7f44fc008040).stop 2021-11-15T19:33:48.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 msgr2=0x7f451413b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 0x7f451413b940 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f4504001370 tx=0x7f4504001760).stop 2021-11-15T19:33:48.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 shutdown_connections 2021-11-15T19:33:48.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44f8053690 0x7f44f8055b50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:48.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f451413b490 0x7f451413b940 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:48.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f45141459f0 0x7f45140b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 --2- 172.21.2.137:0/4187701804 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44f40037d0 0x7f4514143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 >> 172.21.2.137:0/4187701804 conn(0x7f45140b4e60 msgr2=0x7f45140ab680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:48.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 shutdown_connections 2021-11-15T19:33:48.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.097+0000 7f4518a0f700 1 -- 172.21.2.137:0/4187701804 wait complete. 2021-11-15T19:33:48.110 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 40 2021-11-15T19:33:48.112 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:33:48.113 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:33:48.113 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:33:48.113 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:33:48.114 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:33:48.114 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:33:48.114 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:33:48.114 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:33:48.119 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:33:48.119 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:33:48.121 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:33:48.121 DEBUG:teuthology.parallel:result is None 2021-11-15T19:33:48.126 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:33:48.127 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:33:48.129 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:33:48.129 DEBUG:teuthology.parallel:result is None 2021-11-15T19:33:48.129 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:33:48.153 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:33:48.161 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:33:48.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 Processor -- start 2021-11-15T19:33:48.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 -- start start 2021-11-15T19:33:48.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 0x7f256c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f256c14aaa0 0x7f256c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c05cb50 con 0x7f256c05c770 2021-11-15T19:33:48.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c0b1650 con 0x7f256c14aaa0 2021-11-15T19:33:48.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f2573b51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0ad030 con 0x7f256c0b0550 2021-11-15T19:33:48.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f25718ed700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f256c05c770 0x7f256c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56028/0 (socket says 172.21.2.137:56028) 2021-11-15T19:33:48.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f25720ee700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f256c14aaa0 0x7f256c140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:48.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.173+0000 7f25718ed700 1 -- 172.21.2.137:0/856227945 learned_addr learned my addr 172.21.2.137:0/856227945 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:48.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25708eb700 1 -- 172.21.2.137:0/856227945 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199784589 0 0) 0x7f256c05cb50 con 0x7f256c05c770 2021-11-15T19:33:48.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25708eb700 1 -- 172.21.2.137:0/856227945 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2554003260 con 0x7f256c05c770 2021-11-15T19:33:48.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/856227945 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 msgr2=0x7f256c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:48.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- 172.21.2.137:0/856227945 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 0x7f256c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/856227945 >> v1:172.21.2.137:6789/0 conn(0x7f256c05c770 legacy=0x7f256c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/856227945 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0ad2d0 con 0x7f256c14aaa0 2021-11-15T19:33:48.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- 172.21.2.137:0/856227945 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c140aa0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f25640032f0 tx=0x7f25640091d0).ready entity=mon.1 client_cookie=697eae5f51dab8ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:48.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25708eb700 1 -- 172.21.2.137:0/856227945 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256400b6c0 con 0x7f256c14aaa0 2021-11-15T19:33:48.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25708eb700 1 -- 172.21.2.137:0/856227945 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256400b820 con 0x7f256c14aaa0 2021-11-15T19:33:48.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25708eb700 1 -- 172.21.2.137:0/856227945 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256400b990 con 0x7f256c14aaa0 2021-11-15T19:33:48.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/856227945 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 msgr2=0x7f256c140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 --2- 172.21.2.137:0/856227945 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c140aa0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f25640032f0 tx=0x7f25640091d0).stop 2021-11-15T19:33:48.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/856227945 shutdown_connections 2021-11-15T19:33:48.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 --2- 172.21.2.137:0/856227945 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c140aa0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:48.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 --2- 172.21.2.137:0/856227945 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 0x7f256c14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/856227945 >> 172.21.2.137:0/856227945 conn(0x7f256c0631e0 msgr2=0x7f256c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:48.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/856227945 shutdown_connections 2021-11-15T19:33:48.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/856227945 wait complete. 2021-11-15T19:33:48.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 Processor -- start 2021-11-15T19:33:48.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- start start 2021-11-15T19:33:48.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f256c05c770 0x7f256c063d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 0x7f256c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c064240 con 0x7f256c05c770 2021-11-15T19:33:48.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c064490 con 0x7f256c14aaa0 2021-11-15T19:33:48.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c064730 con 0x7f256c0b0550 2021-11-15T19:33:48.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:48.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37256/0 (socket says 172.21.2.137:37256) 2021-11-15T19:33:48.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/3726594565 learned_addr learned my addr 172.21.2.137:0/3726594565 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:48.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 msgr2=0x7f256c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 0x7f256c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f256c05c770 msgr2=0x7f256c063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:48.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f256c05c770 0x7f256c063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:48.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 -- 172.21.2.137:0/3726594565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564009470 con 0x7f256c14aaa0 2021-11-15T19:33:48.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f25720ee700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c156a60 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f25640032f0 tx=0x7f2564016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:48.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256400b6c0 con 0x7f256c14aaa0 2021-11-15T19:33:48.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2564011e50 con 0x7f256c14aaa0 2021-11-15T19:33:48.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c0b5320 con 0x7f256c14aaa0 2021-11-15T19:33:48.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25640107a0 con 0x7f256c14aaa0 2021-11-15T19:33:48.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.177+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c156620 con 0x7f256c14aaa0 2021-11-15T19:33:48.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c067640 con 0x7f256c14aaa0 2021-11-15T19:33:48.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f256400f070 con 0x7f256c14aaa0 2021-11-15T19:33:48.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f255effd700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f254c053660 0x7f254c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:48.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f256406c9d0 con 0x7f256c14aaa0 2021-11-15T19:33:48.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f25718ed700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f254c053660 0x7f254c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:48.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f25718ed700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f254c053660 0x7f254c055b20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f2568001110 tx=0x7f25680076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:48.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.181+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f256c067640 con 0x7f256c14aaa0 2021-11-15T19:33:48.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:48.273+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f256c067640 con 0x7f256c14aaa0 2021-11-15T19:33:49.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.165+0000 7f255effd700 1 -- 172.21.2.137:0/3726594565 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v89) v1 ==== 97+0+0 (secure 0 0 0) 0x7f256c067640 con 0x7f256c14aaa0 2021-11-15T19:33:49.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f254c053660 msgr2=0x7f254c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f254c053660 0x7f254c055b20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f2568001110 tx=0x7f25680076c0).stop 2021-11-15T19:33:49.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 msgr2=0x7f256c156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c156a60 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f25640032f0 tx=0x7f2564016000).stop 2021-11-15T19:33:49.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 shutdown_connections 2021-11-15T19:33:49.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f254c053660 0x7f254c055b20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f256c14aaa0 0x7f256c156a60 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f256c0b0550 0x7f256c0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 --2- 172.21.2.137:0/3726594565 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f256c05c770 0x7f256c063d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 >> 172.21.2.137:0/3726594565 conn(0x7f256c0631e0 msgr2=0x7f256c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 shutdown_connections 2021-11-15T19:33:49.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.169+0000 7f2573b51700 1 -- 172.21.2.137:0/3726594565 wait complete. 2021-11-15T19:33:49.180 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:33:49.186 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:33:49.187 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:33:49.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 Processor -- start 2021-11-15T19:33:49.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- start start 2021-11-15T19:33:49.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f66c40b1340 0x7f66c4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c4148190 con 0x7f66c4143f00 2021-11-15T19:33:49.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c40b1720 con 0x7f66c40a9f50 2021-11-15T19:33:49.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c4147e70 con 0x7f66c40b1340 2021-11-15T19:33:49.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f66c40b1340 0x7f66c4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c37fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f66c40a9f50 0x7f66c40aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56044/0 (socket says 172.21.2.137:56044) 2021-11-15T19:33:49.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c37fe700 1 -- 172.21.2.137:0/3472255057 learned_addr learned my addr 172.21.2.137:0/3472255057 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:49.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/3472255057 >> v1:172.21.2.137:6789/0 conn(0x7f66c40a9f50 legacy=0x7f66c40aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/3472255057 >> v1:172.21.2.111:6789/0 conn(0x7f66c4143f00 legacy=0x7f66c4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c1ffb700 1 -- 172.21.2.137:0/3472255057 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399389951 0 0) 0x7f66c40b1720 con 0x7f66c40a9f50 2021-11-15T19:33:49.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/3472255057 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40af800 con 0x7f66c40b1340 2021-11-15T19:33:49.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- 172.21.2.137:0/3472255057 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40b1340 0x7f66c4147980 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f66c4062250 tx=0x7f66b4006df0).ready entity=mon.1 client_cookie=31d07e2716d322ab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c1ffb700 1 -- 172.21.2.137:0/3472255057 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66b400d5c0 con 0x7f66c40b1340 2021-11-15T19:33:49.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c1ffb700 1 -- 172.21.2.137:0/3472255057 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4000e90 con 0x7f66c40b1340 2021-11-15T19:33:49.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c1ffb700 1 -- 172.21.2.137:0/3472255057 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66b400d910 con 0x7f66c40b1340 2021-11-15T19:33:49.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- 172.21.2.137:0/3472255057 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40b1340 msgr2=0x7f66c4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 --2- 172.21.2.137:0/3472255057 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40b1340 0x7f66c4147980 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f66c4062250 tx=0x7f66b4006df0).stop 2021-11-15T19:33:49.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- 172.21.2.137:0/3472255057 shutdown_connections 2021-11-15T19:33:49.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 --2- 172.21.2.137:0/3472255057 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40b1340 0x7f66c4147980 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- 172.21.2.137:0/3472255057 >> 172.21.2.137:0/3472255057 conn(0x7f66c40b4e60 msgr2=0x7f66c40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- 172.21.2.137:0/3472255057 shutdown_connections 2021-11-15T19:33:49.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- 172.21.2.137:0/3472255057 wait complete. 2021-11-15T19:33:49.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 Processor -- start 2021-11-15T19:33:49.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- start start 2021-11-15T19:33:49.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 0x7f66c40ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66c40b1340 0x7f66c4063460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66c4143f00 0x7f66c4159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40aea00 con 0x7f66c4143f00 2021-11-15T19:33:49.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c414a810 con 0x7f66c40a9f50 2021-11-15T19:33:49.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c97cd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c414aab0 con 0x7f66c40b1340 2021-11-15T19:33:49.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 0x7f66c40ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 0x7f66c40ac5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37266/0 (socket says 172.21.2.137:37266) 2021-11-15T19:33:49.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/2191624311 learned_addr learned my addr 172.21.2.137:0/2191624311 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:49.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66c40b1340 msgr2=0x7f66c4063460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:49.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66c40b1340 0x7f66c4063460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66c4143f00 msgr2=0x7f66c4159d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:49.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66c4143f00 0x7f66c4159d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 -- 172.21.2.137:0/2191624311 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b400b180 con 0x7f66c40a9f50 2021-11-15T19:33:49.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66c2ffd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 0x7f66c40ac5e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f66c4062250 tx=0x7f66b4012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.305+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66b4016070 con 0x7f66c40a9f50 2021-11-15T19:33:49.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b400de90 con 0x7f66c40a9f50 2021-11-15T19:33:49.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c414ad50 con 0x7f66c40a9f50 2021-11-15T19:33:49.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66b4002f70 con 0x7f66c40a9f50 2021-11-15T19:33:49.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c40672e0 con 0x7f66c40a9f50 2021-11-15T19:33:49.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c405faf0 con 0x7f66c40a9f50 2021-11-15T19:33:49.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66b4025030 con 0x7f66c40a9f50 2021-11-15T19:33:49.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66bbfff700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66a8053610 0x7f66a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f66b406c4d0 con 0x7f66c40a9f50 2021-11-15T19:33:49.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66c27fc700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66a8053610 0x7f66a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66c27fc700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66a8053610 0x7f66a8055ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f66ac002f10 tx=0x7f66ac0068b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.309+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66b4043960 con 0x7f66c40a9f50 2021-11-15T19:33:49.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f66c4148190 con 0x7f66c40a9f50 2021-11-15T19:33:49.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66bbfff700 1 -- 172.21.2.137:0/2191624311 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f66c4148190 con 0x7f66c40a9f50 2021-11-15T19:33:49.430 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:49.430 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:33:49.430 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:33:49.431 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.431 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:33:49.431 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:33:49.431 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.432 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:49.432 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.432 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.432 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.433 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.433 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.433 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.433 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:33:49.433 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:33:49.434 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.434 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:49.434 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.434 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.435 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.435 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.435 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.435 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.435 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:33:49.436 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:33:49.436 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.436 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.436 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.437 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.437 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.437 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.437 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.437 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:33:49.438 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:33:49.438 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.438 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.438 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.439 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.439 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.439 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.439 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.439 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:33:49.440 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:33:49.440 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.440 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.440 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.441 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.441 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.441 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.441 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.441 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:33:49.441 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:33:49.442 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.442 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.442 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.442 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.443 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.443 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.443 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.443 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:33:49.443 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:33:49.444 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.444 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.444 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.444 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.444 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.445 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.445 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.445 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:33:49.445 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:33:49.446 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.446 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.446 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.446 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.446 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.447 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.447 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.447 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:33:49.447 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:33:49.448 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.448 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.448 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.448 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.448 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.449 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.449 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.449 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:33:49.449 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:33:49.450 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.450 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.450 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.450 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.450 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.451 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.451 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.451 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:33:49.451 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:33:49.452 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.452 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:49.452 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:33:49.452 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:33:49.452 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.453 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.453 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.453 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:33:49.453 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:33:49.453 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.454 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:49.454 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:33:49.454 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:33:49.454 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.455 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.455 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.455 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:33:49.455 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:33:49.455 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.456 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:33:49.456 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:33:49.456 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:33:49.456 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.457 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.457 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.457 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:33:49.457 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:33:49.457 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.458 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:33:49.458 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:33:49.458 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:33:49.458 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.458 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.459 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.459 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.459 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:33:49.459 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:33:49.460 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.460 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:33:49.460 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:33:49.460 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.460 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.461 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:49.461 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:49.461 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:33:49.461 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:33:49.461 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:33:49.462 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:33:49.462 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:33:49.462 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:33:49.462 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.463 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:49.463 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:33:49.463 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:33:49.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66a8053610 msgr2=0x7f66a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66a8053610 0x7f66a8055ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f66ac002f10 tx=0x7f66ac0068b0).stop 2021-11-15T19:33:49.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 msgr2=0x7f66c40ac5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 0x7f66c40ac5e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f66c4062250 tx=0x7f66b4012000).stop 2021-11-15T19:33:49.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 shutdown_connections 2021-11-15T19:33:49.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66a8053610 0x7f66a8055ad0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66c4143f00 0x7f66c4159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66c40b1340 0x7f66c4063460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 --2- 172.21.2.137:0/2191624311 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66c40a9f50 0x7f66c40ac5e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 >> 172.21.2.137:0/2191624311 conn(0x7f66c40b4e60 msgr2=0x7f66c40af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 shutdown_connections 2021-11-15T19:33:49.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.421+0000 7f66c97cd700 1 -- 172.21.2.137:0/2191624311 wait complete. 2021-11-15T19:33:49.467 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:49.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 Processor -- start 2021-11-15T19:33:49.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 -- start start 2021-11-15T19:33:49.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 0x7f9324147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 0x7f93240aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9324148190 con 0x7f9324143f00 2021-11-15T19:33:49.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93240b1720 con 0x7f93240a9f50 2021-11-15T19:33:49.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f932b54e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9324147e70 con 0x7f93240b1340 2021-11-15T19:33:49.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f93292ea700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 0x7f9324147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f9329aeb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 0x7f93240aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f93292ea700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 0x7f9324147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:38844/0 (socket says 172.21.2.137:38844) 2021-11-15T19:33:49.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f9329aeb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 0x7f93240aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:44504/0 (socket says 172.21.2.137:44504) 2021-11-15T19:33:49.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f93292ea700 1 -- 172.21.2.137:0/1136375869 learned_addr learned my addr 172.21.2.137:0/1136375869 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:49.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.509+0000 7f9328ae9700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f9324143f00 0x7f9324144360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:48548/0 (socket says 172.21.2.137:48548) 2021-11-15T19:33:49.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f93292ea700 1 -- 172.21.2.137:0/1136375869 >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 msgr2=0x7f93240aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f93292ea700 1 --2- 172.21.2.137:0/1136375869 >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 0x7f93240aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f93292ea700 1 -- 172.21.2.137:0/1136375869 >> v1:172.21.2.111:6789/0 conn(0x7f9324143f00 legacy=0x7f9324144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f93292ea700 1 -- 172.21.2.137:0/1136375869 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240af800 con 0x7f93240b1340 2021-11-15T19:33:49.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f9329aeb700 1 --2- 172.21.2.137:0/1136375869 >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 0x7f93240aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:33:49.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f93292ea700 1 --2- 172.21.2.137:0/1136375869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 0x7f9324147980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9320002f70 tx=0x7f9320006eb0).ready entity=mon.2 client_cookie=6aece76d22e9626e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f9317fff700 1 -- 172.21.2.137:0/1136375869 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f932000d570 con 0x7f93240b1340 2021-11-15T19:33:49.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f9317fff700 1 -- 172.21.2.137:0/1136375869 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320000e90 con 0x7f93240b1340 2021-11-15T19:33:49.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f9317fff700 1 -- 172.21.2.137:0/1136375869 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f932000d900 con 0x7f93240b1340 2021-11-15T19:33:49.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 -- 172.21.2.137:0/1136375869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 msgr2=0x7f9324147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 --2- 172.21.2.137:0/1136375869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 0x7f9324147980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9320002f70 tx=0x7f9320006eb0).stop 2021-11-15T19:33:49.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 -- 172.21.2.137:0/1136375869 shutdown_connections 2021-11-15T19:33:49.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 --2- 172.21.2.137:0/1136375869 >> v2:172.21.2.111:3300/0 conn(0x7f93240a9f50 0x7f93240aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 --2- 172.21.2.137:0/1136375869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f93240b1340 0x7f9324147980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 -- 172.21.2.137:0/1136375869 >> 172.21.2.137:0/1136375869 conn(0x7f93240b4e60 msgr2=0x7f93240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 -- 172.21.2.137:0/1136375869 shutdown_connections 2021-11-15T19:33:49.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 -- 172.21.2.137:0/1136375869 wait complete. 2021-11-15T19:33:49.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 Processor -- start 2021-11-15T19:33:49.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.513+0000 7f932b54e700 1 -- start start 2021-11-15T19:33:49.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93240a9f50 0x7f93240ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 0x7f93241570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9324143f00 0x7f93241402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240af1c0 con 0x7f93240a9f50 2021-11-15T19:33:49.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240af460 con 0x7f93240b1340 2021-11-15T19:33:49.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932414aa80 con 0x7f9324143f00 2021-11-15T19:33:49.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 0x7f93241570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 0x7f93241570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37282/0 (socket says 172.21.2.137:37282) 2021-11-15T19:33:49.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 -- 172.21.2.137:0/255969814 learned_addr learned my addr 172.21.2.137:0/255969814 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:49.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 -- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9324143f00 msgr2=0x7f93241402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9324143f00 0x7f93241402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 -- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93240a9f50 msgr2=0x7f93240ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93292ea700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93240a9f50 0x7f93240ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93240a9f50 0x7f93240ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 -- 172.21.2.137:0/255969814 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c009470 con 0x7f93240b1340 2021-11-15T19:33:49.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f9328ae9700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 0x7f93241570d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f932405cfa0 tx=0x7f9318007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f931800ce30 con 0x7f93240b1340 2021-11-15T19:33:49.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93180072e0 con 0x7f93240b1340 2021-11-15T19:33:49.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9318005740 con 0x7f93240b1340 2021-11-15T19:33:49.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932000b1e0 con 0x7f93240b1340 2021-11-15T19:33:49.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93240acff0 con 0x7f93240b1340 2021-11-15T19:33:49.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93240af000 con 0x7f93240b1340 2021-11-15T19:33:49.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9318010070 con 0x7f93240b1340 2021-11-15T19:33:49.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93167fc700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9304053610 0x7f9304055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f931806ab60 con 0x7f93240b1340 2021-11-15T19:33:49.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.517+0000 7f93292ea700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9304053610 0x7f9304055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.521+0000 7f93292ea700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9304053610 0x7f9304055ad0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f9320017000 tx=0x7f9320015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.521+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9318041ee0 con 0x7f93240b1340 2021-11-15T19:33:49.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9324148190 con 0x7f93240b1340 2021-11-15T19:33:49.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f93167fc700 1 -- 172.21.2.137:0/255969814 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f9324148190 con 0x7f93240b1340 2021-11-15T19:33:49.615 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:49.615 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":89,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:49.167831+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:49.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9304053610 msgr2=0x7f9304055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9304053610 0x7f9304055ad0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f9320017000 tx=0x7f9320015000).stop 2021-11-15T19:33:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 msgr2=0x7f93241570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 0x7f93241570d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f932405cfa0 tx=0x7f9318007c00).stop 2021-11-15T19:33:49.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 shutdown_connections 2021-11-15T19:33:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9304053610 0x7f9304055ad0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9324143f00 0x7f93241402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f93240b1340 0x7f93241570d0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 --2- 172.21.2.137:0/255969814 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93240a9f50 0x7f93240ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 >> 172.21.2.137:0/255969814 conn(0x7f93240b4e60 msgr2=0x7f93240b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 shutdown_connections 2021-11-15T19:33:49.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.605+0000 7f932b54e700 1 -- 172.21.2.137:0/255969814 wait complete. 2021-11-15T19:33:49.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:33:49.623 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:49.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba4567700 1 Processor -- start 2021-11-15T19:33:49.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba4567700 1 -- start start 2021-11-15T19:33:49.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba4567700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b9c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba4567700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c05cb50 con 0x7f4b9c14aaa0 2021-11-15T19:33:49.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba4567700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0ad030 con 0x7f4b9c05c770 2021-11-15T19:33:49.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba4567700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0b1650 con 0x7f4b9c0b0550 2021-11-15T19:33:49.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba2303700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4b9c05c770 0x7f4b9c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56068/0 (socket says 172.21.2.137:56068) 2021-11-15T19:33:49.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba2303700 1 -- 172.21.2.137:0/3851769020 learned_addr learned my addr 172.21.2.137:0/3851769020 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:49.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899794002 0 0) 0x7f4b9c0ad030 con 0x7f4b9c05c770 2021-11-15T19:33:49.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003260 con 0x7f4b9c05c770 2021-11-15T19:33:49.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b9c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 531027820 0 0) 0x7f4b84003260 con 0x7f4b9c05c770 2021-11-15T19:33:49.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 msgr2=0x7f4b9c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b9c14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 >> v1:172.21.2.111:6789/0 conn(0x7f4b9c14aaa0 legacy=0x7f4b9c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0ad2d0 con 0x7f4b9c05c770 2021-11-15T19:33:49.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.665+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4b98001660 con 0x7f4b9c05c770 2021-11-15T19:33:49.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 >> v1:172.21.2.137:6789/0 conn(0x7f4b9c05c770 legacy=0x7f4b9c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b84003750 0x7f4b84003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b84004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b84004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0b1650 con 0x7f4b84003750 2021-11-15T19:33:49.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400b800 con 0x7f4b84004500 2021-11-15T19:33:49.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400b9c0 con 0x7f4b9c0b0550 2021-11-15T19:33:49.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b84004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2b04700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b84004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b84003750 0x7f4b84003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 -- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 msgr2=0x7f4b84004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b84004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 -- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b84003750 msgr2=0x7f4b84003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b84003750 0x7f4b84003b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 -- 172.21.2.137:0/3851769020 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84003260 con 0x7f4b84004500 2021-11-15T19:33:49.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2b04700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c0b0550 0x7f4b84004eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:49.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b84004980 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f4b9000a000 tx=0x7f4b90008040).ready entity=mon.1 client_cookie=a22e7dc9abd12c4b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b90013670 con 0x7f4b84004500 2021-11-15T19:33:49.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b900137d0 con 0x7f4b84004500 2021-11-15T19:33:49.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba1301700 1 -- 172.21.2.137:0/3851769020 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b90013b30 con 0x7f4b84004500 2021-11-15T19:33:49.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/3851769020 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 msgr2=0x7f4b84004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 --2- 172.21.2.137:0/3851769020 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b84004980 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f4b9000a000 tx=0x7f4b90008040).stop 2021-11-15T19:33:49.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2b04700 1 -- 172.21.2.137:0/3851769020 reap_dead start 2021-11-15T19:33:49.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/3851769020 shutdown_connections 2021-11-15T19:33:49.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/3851769020 >> 172.21.2.137:0/3851769020 conn(0x7f4b9c0631e0 msgr2=0x7f4b9c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/3851769020 shutdown_connections 2021-11-15T19:33:49.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/3851769020 wait complete. 2021-11-15T19:33:49.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 Processor -- start 2021-11-15T19:33:49.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- start start 2021-11-15T19:33:49.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b9c144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b9c141de0 0x7f4b9c142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c147510 0x7f4b9c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0671b0 con 0x7f4b9c141de0 2021-11-15T19:33:49.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c066db0 con 0x7f4b84004500 2021-11-15T19:33:49.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c147e80 con 0x7f4b9c147510 2021-11-15T19:33:49.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b9c144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b9c144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37298/0 (socket says 172.21.2.137:37298) 2021-11-15T19:33:49.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 -- 172.21.2.137:0/94204847 learned_addr learned my addr 172.21.2.137:0/94204847 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:49.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 -- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c147510 msgr2=0x7f4b9c147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c147510 0x7f4b9c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 -- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b9c141de0 msgr2=0x7f4b9c142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b9c141de0 0x7f4b9c142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 -- 172.21.2.137:0/94204847 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0668a0 con 0x7f4b84004500 2021-11-15T19:33:49.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba2303700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b9c144da0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f4b98008000 tx=0x7f4b98009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b98007170 con 0x7f4b84004500 2021-11-15T19:33:49.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980072d0 con 0x7f4b84004500 2021-11-15T19:33:49.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c066a30 con 0x7f4b84004500 2021-11-15T19:33:49.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c156380 con 0x7f4b84004500 2021-11-15T19:33:49.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.669+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b98004920 con 0x7f4b84004500 2021-11-15T19:33:49.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c066f70 con 0x7f4b84004500 2021-11-15T19:33:49.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b98004a80 con 0x7f4b84004500 2021-11-15T19:33:49.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4b8f7fe700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b7c053690 0x7f4b7c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4b9806bb90 con 0x7f4b84004500 2021-11-15T19:33:49.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b7c053690 0x7f4b7c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4ba1b02700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b7c053690 0x7f4b7c055b50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f4b9000a000 tx=0x7f4b90008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.673+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b98042f10 con 0x7f4b84004500 2021-11-15T19:33:49.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4b9c0ae7f0 con 0x7f4b84004500 2021-11-15T19:33:49.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4b8f7fe700 1 -- 172.21.2.137:0/94204847 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v89) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4b98046530 con 0x7f4b84004500 2021-11-15T19:33:49.766 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:49.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b7c053690 msgr2=0x7f4b7c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b7c053690 0x7f4b7c055b50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f4b9000a000 tx=0x7f4b90008040).stop 2021-11-15T19:33:49.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 msgr2=0x7f4b9c144da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b9c144da0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f4b98008000 tx=0x7f4b98009040).stop 2021-11-15T19:33:49.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 shutdown_connections 2021-11-15T19:33:49.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b7c053690 0x7f4b7c055b50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b9c147510 0x7f4b9c147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b9c141de0 0x7f4b9c142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 --2- 172.21.2.137:0/94204847 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b84004500 0x7f4b9c144da0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 >> 172.21.2.137:0/94204847 conn(0x7f4b9c0631e0 msgr2=0x7f4b9c0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 shutdown_connections 2021-11-15T19:33:49.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.757+0000 7f4ba4567700 1 -- 172.21.2.137:0/94204847 wait complete. 2021-11-15T19:33:49.773 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:49.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.813+0000 7fd09cfdb700 1 Processor -- start 2021-11-15T19:33:49.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.813+0000 7fd09cfdb700 1 -- start start 2021-11-15T19:33:49.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd0980ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0980af470 con 0x7fd0980b0ec0 2021-11-15T19:33:49.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0980676a0 con 0x7fd09805c430 2021-11-15T19:33:49.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd098067940 con 0x7fd09805c890 2021-11-15T19:33:49.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd09805c430 0x7fd09813c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56088/0 (socket says 172.21.2.137:56088) 2021-11-15T19:33:49.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 -- 172.21.2.137:0/254189767 learned_addr learned my addr 172.21.2.137:0/254189767 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:49.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178208994 0 0) 0x7fd0980676a0 con 0x7fd09805c430 2021-11-15T19:33:49.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd078003260 con 0x7fd09805c430 2021-11-15T19:33:49.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1686308412 0 0) 0x7fd078003260 con 0x7fd09805c430 2021-11-15T19:33:49.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd096d9d700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd0980ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 msgr2=0x7fd0980ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd0980ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 >> v1:172.21.2.111:6789/0 conn(0x7fd0980b0ec0 legacy=0x7fd098063900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098140220 con 0x7fd09805c430 2021-11-15T19:33:49.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd088001660 con 0x7fd09805c430 2021-11-15T19:33:49.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd096d9d700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd0980ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:49.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 >> v1:172.21.2.137:6789/0 conn(0x7fd09805c430 legacy=0x7fd09813c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0780037d0 0x7fd078003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd078004500 0x7fd078004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd07800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd098067940 con 0x7fd0780037d0 2021-11-15T19:33:49.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780052c0 con 0x7fd078004500 2021-11-15T19:33:49.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07800de50 con 0x7fd09805c890 2021-11-15T19:33:49.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd078004500 0x7fd078004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09659c700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0780037d0 0x7fd078003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd096d9d700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd07800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 -- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 msgr2=0x7fd07800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd07800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 -- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0780037d0 msgr2=0x7fd078003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0780037d0 0x7fd078003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 -- 172.21.2.137:0/254189767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078003260 con 0x7fd078004500 2021-11-15T19:33:49.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd096d9d700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd09805c890 0x7fd07800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:49.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd095d9b700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd078004500 0x7fd078004980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fd098061f30 tx=0x7fd088001d60).ready entity=mon.1 client_cookie=96b7347150cda373 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0880070d0 con 0x7fd078004500 2021-11-15T19:33:49.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088007230 con 0x7fd078004500 2021-11-15T19:33:49.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09559a700 1 -- 172.21.2.137:0/254189767 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd08800c8f0 con 0x7fd078004500 2021-11-15T19:33:49.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- 172.21.2.137:0/254189767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd078004500 msgr2=0x7fd078004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/254189767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd078004500 0x7fd078004980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fd098061f30 tx=0x7fd088001d60).stop 2021-11-15T19:33:49.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd096d9d700 1 -- 172.21.2.137:0/254189767 reap_dead start 2021-11-15T19:33:49.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- 172.21.2.137:0/254189767 shutdown_connections 2021-11-15T19:33:49.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- 172.21.2.137:0/254189767 >> 172.21.2.137:0/254189767 conn(0x7fd0980631e0 msgr2=0x7fd09805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- 172.21.2.137:0/254189767 shutdown_connections 2021-11-15T19:33:49.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- 172.21.2.137:0/254189767 wait complete. 2021-11-15T19:33:49.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 Processor -- start 2021-11-15T19:33:49.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.817+0000 7fd09cfdb700 1 -- start start 2021-11-15T19:33:49.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd078004500 0x7fd0980b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 0x7fd098139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd098137110 0x7fd098137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd098067110 con 0x7fd098137110 2021-11-15T19:33:49.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd098137a80 con 0x7fd0980647e0 2021-11-15T19:33:49.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980b5a20 con 0x7fd078004500 2021-11-15T19:33:49.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 0x7fd098139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 0x7fd098139fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37320/0 (socket says 172.21.2.137:37320) 2021-11-15T19:33:49.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 -- 172.21.2.137:0/2655711873 learned_addr learned my addr 172.21.2.137:0/2655711873 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:49.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 -- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd078004500 msgr2=0x7fd0980b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd078004500 0x7fd0980b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 -- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd098137110 msgr2=0x7fd098137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd098137110 0x7fd098137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 -- 172.21.2.137:0/2655711873 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098064340 con 0x7fd0980647e0 2021-11-15T19:33:49.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd095d9b700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 0x7fd098139fa0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fd098061f30 tx=0x7fd088015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0880070d0 con 0x7fd0980647e0 2021-11-15T19:33:49.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088004710 con 0x7fd0980647e0 2021-11-15T19:33:49.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd088004a70 con 0x7fd0980647e0 2021-11-15T19:33:49.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0980b4aa0 con 0x7fd0980647e0 2021-11-15T19:33:49.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd098065cf0 con 0x7fd0980647e0 2021-11-15T19:33:49.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0980644d0 con 0x7fd0980647e0 2021-11-15T19:33:49.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd088026070 con 0x7fd0980647e0 2021-11-15T19:33:49.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd08f7fe700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd07c053610 0x7fd07c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd08806bd50 con 0x7fd0980647e0 2021-11-15T19:33:49.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.821+0000 7fd09659c700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd07c053610 0x7fd07c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.825+0000 7fd09659c700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd07c053610 0x7fd07c055ad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd08000b000 tx=0x7fd080009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.825+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0880430d0 con 0x7fd0980647e0 2021-11-15T19:33:49.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0980b5be0 con 0x7fd0980647e0 2021-11-15T19:33:49.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd08f7fe700 1 -- 172.21.2.137:0/2655711873 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd088001d60 con 0x7fd0980647e0 2021-11-15T19:33:49.918 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:49.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd07c053610 msgr2=0x7fd07c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd07c053610 0x7fd07c055ad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd08000b000 tx=0x7fd080009040).stop 2021-11-15T19:33:49.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 msgr2=0x7fd098139fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 0x7fd098139fa0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fd098061f30 tx=0x7fd088015000).stop 2021-11-15T19:33:49.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 shutdown_connections 2021-11-15T19:33:49.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd07c053610 0x7fd07c055ad0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd098137110 0x7fd098137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0980647e0 0x7fd098139fa0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 --2- 172.21.2.137:0/2655711873 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd078004500 0x7fd0980b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 >> 172.21.2.137:0/2655711873 conn(0x7fd0980631e0 msgr2=0x7fd09805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 shutdown_connections 2021-11-15T19:33:49.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.909+0000 7fd09cfdb700 1 -- 172.21.2.137:0/2655711873 wait complete. 2021-11-15T19:33:49.925 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:33:49.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac806ed700 1 Processor -- start 2021-11-15T19:33:49.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac806ed700 1 -- start start 2021-11-15T19:33:49.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac806ed700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fac78147980 0x7fac780aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac806ed700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac78148190 con 0x7fac78144610 2021-11-15T19:33:49.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac806ed700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac780b1720 con 0x7fac780b1340 2021-11-15T19:33:49.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac806ed700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac780af800 con 0x7fac78147980 2021-11-15T19:33:49.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac7e489700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fac780b1340 0x7fac78143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56108/0 (socket says 172.21.2.137:56108) 2021-11-15T19:33:49.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac7e489700 1 -- 172.21.2.137:0/662178030 learned_addr learned my addr 172.21.2.137:0/662178030 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:49.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743493686 0 0) 0x7fac780b1720 con 0x7fac780b1340 2021-11-15T19:33:49.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.965+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac60003260 con 0x7fac780b1340 2021-11-15T19:33:49.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3656583125 0 0) 0x7fac60003260 con 0x7fac780b1340 2021-11-15T19:33:49.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 >> v2:172.21.2.111:3300/0 conn(0x7fac78147980 msgr2=0x7fac780aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 --2- 172.21.2.137:0/662178030 >> v2:172.21.2.111:3300/0 conn(0x7fac78147980 0x7fac780aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 >> v1:172.21.2.111:6789/0 conn(0x7fac78144610 legacy=0x7fac780a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7805faf0 con 0x7fac780b1340 2021-11-15T19:33:49.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fac6c001660 con 0x7fac780b1340 2021-11-15T19:33:49.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 >> v1:172.21.2.137:6789/0 conn(0x7fac780b1340 legacy=0x7fac78143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac60003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac60004500 0x7fac60004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac60005050 0x7fac6000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac780af800 con 0x7fac60005050 2021-11-15T19:33:49.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6000bfe0 con 0x7fac60003820 2021-11-15T19:33:49.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6000c1a0 con 0x7fac60004500 2021-11-15T19:33:49.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac60003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac60004500 msgr2=0x7fac60004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7dc88700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac60004500 0x7fac60004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac60004500 0x7fac60004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac60005050 msgr2=0x7fac6000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:49.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7ec8a700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac60005050 0x7fac6000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac60005050 0x7fac6000b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7ec8a700 1 -- 172.21.2.137:0/662178030 reap_dead start 2021-11-15T19:33:49.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/662178030 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac60003260 con 0x7fac60003820 2021-11-15T19:33:49.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac60003c20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fac78062250 tx=0x7fac7805f9e0).ready entity=mon.1 client_cookie=4501085bf994cbf9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6c0070d0 con 0x7fac60003820 2021-11-15T19:33:49.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c007230 con 0x7fac60003820 2021-11-15T19:33:49.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7d487700 1 -- 172.21.2.137:0/662178030 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6c00c8f0 con 0x7fac60003820 2021-11-15T19:33:49.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/662178030 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 msgr2=0x7fac60003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac60003c20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fac78062250 tx=0x7fac7805f9e0).stop 2021-11-15T19:33:49.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/662178030 shutdown_connections 2021-11-15T19:33:49.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 --2- 172.21.2.137:0/662178030 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac60003c20 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/662178030 >> 172.21.2.137:0/662178030 conn(0x7fac780b4e60 msgr2=0x7fac780b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:49.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/662178030 shutdown_connections 2021-11-15T19:33:49.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/662178030 wait complete. 2021-11-15T19:33:49.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 Processor -- start 2021-11-15T19:33:49.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- start start 2021-11-15T19:33:49.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac780b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac78149ed0 0x7fac780ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac780ac790 0x7fac78142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac780af610 con 0x7fac780ac790 2021-11-15T19:33:49.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7814ad20 con 0x7fac60003820 2021-11-15T19:33:49.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac780af0c0 con 0x7fac78149ed0 2021-11-15T19:33:49.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac780b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac780b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37338/0 (socket says 172.21.2.137:37338) 2021-11-15T19:33:49.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/423938471 learned_addr learned my addr 172.21.2.137:0/423938471 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:49.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac78149ed0 msgr2=0x7fac780ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac78149ed0 0x7fac780ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:49.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7ec8a700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac780ac790 0x7fac78142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac780ac790 msgr2=0x7fac78142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:49.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac780ac790 0x7fac78142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:49.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 -- 172.21.2.137:0/423938471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac780af320 con 0x7fac60003820 2021-11-15T19:33:49.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac7e489700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac780b3540 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fac78062250 tx=0x7fac6c013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6c01b070 con 0x7fac60003820 2021-11-15T19:33:49.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c004920 con 0x7fac60003820 2021-11-15T19:33:49.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac780acc10 con 0x7fac60003820 2021-11-15T19:33:49.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6c001b80 con 0x7fac60003820 2021-11-15T19:33:49.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.969+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac78149af0 con 0x7fac60003820 2021-11-15T19:33:49.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7805fd90 con 0x7fac60003820 2021-11-15T19:33:49.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac6c010070 con 0x7fac60003820 2021-11-15T19:33:49.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac6b7fe700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac580536a0 0x7fac58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:49.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fac6c06ba00 con 0x7fac60003820 2021-11-15T19:33:49.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac7dc88700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac580536a0 0x7fac58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:49.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac7dc88700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac580536a0 0x7fac58055b60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fac74008000 tx=0x7fac74009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:49.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:49.973+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac6c042e90 con 0x7fac60003820 2021-11-15T19:33:50.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.085+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fac780573d0 con 0x7fac60003820 2021-11-15T19:33:50.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.085+0000 7fac6b7fe700 1 -- 172.21.2.137:0/423938471 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) v1 ==== 84+0+143 (secure 0 0 0) 0x7fac6c0464b0 con 0x7fac60003820 2021-11-15T19:33:50.096 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:50.096 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:33:50.096 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:50.097 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:33:50.097 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:33:50.097 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:33:50.097 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:33:50.098 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:33:50.098 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:33:50.098 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:33:50.098 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:33:50.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac580536a0 msgr2=0x7fac58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:50.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac580536a0 0x7fac58055b60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fac74008000 tx=0x7fac74009040).stop 2021-11-15T19:33:50.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 msgr2=0x7fac780b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:50.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac780b3540 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fac78062250 tx=0x7fac6c013000).stop 2021-11-15T19:33:50.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 shutdown_connections 2021-11-15T19:33:50.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac580536a0 0x7fac58055b60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:50.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac780ac790 0x7fac78142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:50.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac78149ed0 0x7fac780ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:50.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 --2- 172.21.2.137:0/423938471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac60003820 0x7fac780b3540 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:50.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 >> 172.21.2.137:0/423938471 conn(0x7fac780b4e60 msgr2=0x7fac7813daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:50.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 shutdown_connections 2021-11-15T19:33:50.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.089+0000 7fac806ed700 1 -- 172.21.2.137:0/423938471 wait complete. 2021-11-15T19:33:50.103 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:33:50.104 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:33:50.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 Processor -- start 2021-11-15T19:33:50.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- start start 2021-11-15T19:33:50.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe8f8140aa0 0x7fe8f8140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:50.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f805cb50 con 0x7fe8f805c770 2021-11-15T19:33:50.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f80ad030 con 0x7fe8f80b0550 2021-11-15T19:33:50.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f80b1650 con 0x7fe8f8140aa0 2021-11-15T19:33:50.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fe100700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe8f8140aa0 0x7fe8f8140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:50.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd0fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe8f80b0550 0x7fe8f814a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56132/0 (socket says 172.21.2.137:56132) 2021-11-15T19:33:50.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd0fe700 1 -- 172.21.2.137:0/3653721754 learned_addr learned my addr 172.21.2.137:0/3653721754 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:50.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fc8fd700 1 -- 172.21.2.137:0/3653721754 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334843316 0 0) 0x7fe8f80ad030 con 0x7fe8f80b0550 2021-11-15T19:33:50.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fc8fd700 1 -- 172.21.2.137:0/3653721754 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e4003260 con 0x7fe8f80b0550 2021-11-15T19:33:50.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fe100700 1 -- 172.21.2.137:0/3653721754 >> v1:172.21.2.137:6789/0 conn(0x7fe8f80b0550 legacy=0x7fe8f814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:50.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fe100700 1 -- 172.21.2.137:0/3653721754 >> v1:172.21.2.111:6789/0 conn(0x7fe8f805c770 legacy=0x7fe8f80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:50.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fe100700 1 -- 172.21.2.137:0/3653721754 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f80ad2d0 con 0x7fe8f8140aa0 2021-11-15T19:33:50.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fe100700 1 --2- 172.21.2.137:0/3653721754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f8140aa0 0x7fe8f8140f10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fe8f80aee10 tx=0x7fe8f00091d0).ready entity=mon.1 client_cookie=6558a22ca69d5690 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:50.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fc8fd700 1 -- 172.21.2.137:0/3653721754 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f000b680 con 0x7fe8f8140aa0 2021-11-15T19:33:50.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fc8fd700 1 -- 172.21.2.137:0/3653721754 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f000b7e0 con 0x7fe8f8140aa0 2021-11-15T19:33:50.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fc8fd700 1 -- 172.21.2.137:0/3653721754 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f000b950 con 0x7fe8f8140aa0 2021-11-15T19:33:50.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- 172.21.2.137:0/3653721754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f8140aa0 msgr2=0x7fe8f8140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:50.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/3653721754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f8140aa0 0x7fe8f8140f10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fe8f80aee10 tx=0x7fe8f00091d0).stop 2021-11-15T19:33:50.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- 172.21.2.137:0/3653721754 shutdown_connections 2021-11-15T19:33:50.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/3653721754 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f8140aa0 0x7fe8f8140f10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:50.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- 172.21.2.137:0/3653721754 >> 172.21.2.137:0/3653721754 conn(0x7fe8f80631e0 msgr2=0x7fe8f805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:50.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- 172.21.2.137:0/3653721754 shutdown_connections 2021-11-15T19:33:50.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- 172.21.2.137:0/3653721754 wait complete. 2021-11-15T19:33:50.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 Processor -- start 2021-11-15T19:33:50.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- start start 2021-11-15T19:33:50.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 0x7fe8f8067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:50.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8f80b0550 0x7fe8f814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:50.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8f8140aa0 0x7fe8f8063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:50.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8142100 con 0x7fe8f8140aa0 2021-11-15T19:33:50.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8063c50 con 0x7fe8f805c770 2021-11-15T19:33:50.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8ffb63700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8142c60 con 0x7fe8f80b0550 2021-11-15T19:33:50.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 0x7fe8f8067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:50.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 0x7fe8f8067230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37354/0 (socket says 172.21.2.137:37354) 2021-11-15T19:33:50.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 -- 172.21.2.137:0/431650503 learned_addr learned my addr 172.21.2.137:0/431650503 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:50.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 -- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8f80b0550 msgr2=0x7fe8f814e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:50.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8f80b0550 0x7fe8f814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:50.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 -- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8f8140aa0 msgr2=0x7fe8f8063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:50.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8f8140aa0 0x7fe8f8063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:50.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 -- 172.21.2.137:0/431650503 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009470 con 0x7fe8f805c770 2021-11-15T19:33:50.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.149+0000 7fe8fd8ff700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 0x7fe8f8067230 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fe8f8065ee0 tx=0x7fe8e8006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:50.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e8012410 con 0x7fe8f805c770 2021-11-15T19:33:50.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8012570 con 0x7fe8f805c770 2021-11-15T19:33:50.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f80655d0 con 0x7fe8f805c770 2021-11-15T19:33:50.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e80128d0 con 0x7fe8f805c770 2021-11-15T19:33:50.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f8065870 con 0x7fe8f805c770 2021-11-15T19:33:50.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f8142da0 con 0x7fe8f805c770 2021-11-15T19:33:50.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe8e800f030 con 0x7fe8f805c770 2021-11-15T19:33:50.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8d80536a0 0x7fe8d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:50.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe8e806b2d0 con 0x7fe8f805c770 2021-11-15T19:33:50.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8fd0fe700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8d80536a0 0x7fe8d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:50.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8fd0fe700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8d80536a0 0x7fe8d8055b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fe8ec001110 tx=0x7fe8ec0076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:50.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.153+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe8e8042760 con 0x7fe8f805c770 2021-11-15T19:33:50.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:50.237+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe8f80ae7f0 con 0x7fe8f805c770 2021-11-15T19:33:51.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8f6ffd700 1 -- 172.21.2.137:0/431650503 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v90) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe8e8045d80 con 0x7fe8f805c770 2021-11-15T19:33:51.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8d80536a0 msgr2=0x7fe8d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:51.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8d80536a0 0x7fe8d8055b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fe8ec001110 tx=0x7fe8ec0076c0).stop 2021-11-15T19:33:51.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 msgr2=0x7fe8f8067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:51.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 0x7fe8f8067230 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fe8f8065ee0 tx=0x7fe8e8006d50).stop 2021-11-15T19:33:51.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 shutdown_connections 2021-11-15T19:33:51.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe8d80536a0 0x7fe8d8055b60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:51.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe8f8140aa0 0x7fe8f8063760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:51.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe8f80b0550 0x7fe8f814e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:51.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 --2- 172.21.2.137:0/431650503 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe8f805c770 0x7fe8f8067230 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:51.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 >> 172.21.2.137:0/431650503 conn(0x7fe8f80631e0 msgr2=0x7fe8f80b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:51.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 shutdown_connections 2021-11-15T19:33:51.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.181+0000 7fe8ffb63700 1 -- 172.21.2.137:0/431650503 wait complete. 2021-11-15T19:33:51.195 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:33:51.198 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:33:51.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 Processor -- start 2021-11-15T19:33:51.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- start start 2021-11-15T19:33:51.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef280b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:51.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fef28064180 0x7fef2813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:51.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef280b6670 con 0x7fef280b2240 2021-11-15T19:33:51.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef281438e0 con 0x7fef28064180 2021-11-15T19:33:51.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef28143b80 con 0x7fef280b6290 2021-11-15T19:33:51.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2dd68700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fef28064180 0x7fef2813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:51.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2cd66700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fef280b2240 0x7fef281288d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56144/0 (socket says 172.21.2.137:56144) 2021-11-15T19:33:51.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2cd66700 1 -- 172.21.2.137:0/4090937316 learned_addr learned my addr 172.21.2.137:0/4090937316 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:51.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2dd68700 1 -- 172.21.2.137:0/4090937316 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 msgr2=0x7fef280b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:51.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2dd68700 1 --2- 172.21.2.137:0/4090937316 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef280b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:51.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2dd68700 1 -- 172.21.2.137:0/4090937316 >> v1:172.21.2.137:6789/0 conn(0x7fef280b2240 legacy=0x7fef281288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:51.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2dd68700 1 -- 172.21.2.137:0/4090937316 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2813f830 con 0x7fef28064180 2021-11-15T19:33:51.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2dd68700 1 --2- 172.21.2.137:0/4090937316 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef28064180 0x7fef2813fd00 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fef200032f0 tx=0x7fef2000b470).ready entity=mon.1 client_cookie=f828fb313466c17f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:51.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef17fff700 1 -- 172.21.2.137:0/4090937316 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2000de20 con 0x7fef28064180 2021-11-15T19:33:51.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef17fff700 1 -- 172.21.2.137:0/4090937316 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20010470 con 0x7fef28064180 2021-11-15T19:33:51.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef17fff700 1 -- 172.21.2.137:0/4090937316 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef200107d0 con 0x7fef28064180 2021-11-15T19:33:51.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- 172.21.2.137:0/4090937316 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef28064180 msgr2=0x7fef2813fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:51.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/4090937316 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef28064180 0x7fef2813fd00 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fef200032f0 tx=0x7fef2000b470).stop 2021-11-15T19:33:51.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- 172.21.2.137:0/4090937316 shutdown_connections 2021-11-15T19:33:51.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/4090937316 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef28064180 0x7fef2813fd00 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:51.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/4090937316 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef280b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:51.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.241+0000 7fef2f7cb700 1 -- 172.21.2.137:0/4090937316 >> 172.21.2.137:0/4090937316 conn(0x7fef28069e70 msgr2=0x7fef280639e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:51.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- 172.21.2.137:0/4090937316 shutdown_connections 2021-11-15T19:33:51.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- 172.21.2.137:0/4090937316 wait complete. 2021-11-15T19:33:51.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 Processor -- start 2021-11-15T19:33:51.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- start start 2021-11-15T19:33:51.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef28064180 0x7fef280ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:51.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 0x7fef28143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:51.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef281422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:51.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280ae8e0 con 0x7fef28064180 2021-11-15T19:33:51.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28152b70 con 0x7fef280b2240 2021-11-15T19:33:51.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef28152e10 con 0x7fef280b6290 2021-11-15T19:33:51.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 0x7fef28143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:51.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 0x7fef28143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37366/0 (socket says 172.21.2.137:37366) 2021-11-15T19:33:51.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 -- 172.21.2.137:0/3030603502 learned_addr learned my addr 172.21.2.137:0/3030603502 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:51.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2dd68700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef281422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:51.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 -- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 msgr2=0x7fef281422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:51.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef281422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:51.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 -- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef28064180 msgr2=0x7fef280ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:51.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef28064180 0x7fef280ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:51.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 -- 172.21.2.137:0/3030603502 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2000b710 con 0x7fef280b2240 2021-11-15T19:33:51.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2cd66700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 0x7fef28143f70 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fef28145dc0 tx=0x7fef24007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:51.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2400ce20 con 0x7fef280b2240 2021-11-15T19:33:51.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240072e0 con 0x7fef280b2240 2021-11-15T19:33:51.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef281530b0 con 0x7fef280b2240 2021-11-15T19:33:51.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef24005800 con 0x7fef280b2240 2021-11-15T19:33:51.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef280afe90 con 0x7fef280b2240 2021-11-15T19:33:51.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef28141920 con 0x7fef280b2240 2021-11-15T19:33:51.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef24010070 con 0x7fef280b2240 2021-11-15T19:33:51.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef167fc700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef08053610 0x7fef08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:51.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5603+0+0 (secure 0 0 0) 0x7fef2406ae20 con 0x7fef280b2240 2021-11-15T19:33:51.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.245+0000 7fef2d567700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef08053610 0x7fef08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:51.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.249+0000 7fef2d567700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef08053610 0x7fef08055ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fef18002f70 tx=0x7fef180069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:51.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.249+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef28141920 con 0x7fef280b2240 2021-11-15T19:33:51.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:51.333+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fef28141920 con 0x7fef280b2240 2021-11-15T19:33:52.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef167fc700 1 -- 172.21.2.137:0/3030603502 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v91) v1 ==== 125+0+0 (secure 0 0 0) 0x7fef28141920 con 0x7fef280b2240 2021-11-15T19:33:52.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef08053610 msgr2=0x7fef08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef08053610 0x7fef08055ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fef18002f70 tx=0x7fef180069e0).stop 2021-11-15T19:33:52.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 msgr2=0x7fef28143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 0x7fef28143f70 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fef28145dc0 tx=0x7fef24007c40).stop 2021-11-15T19:33:52.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 shutdown_connections 2021-11-15T19:33:52.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef08053610 0x7fef08055ad0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fef280b6290 0x7fef281422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fef280b2240 0x7fef28143f70 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 --2- 172.21.2.137:0/3030603502 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fef28064180 0x7fef280ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 >> 172.21.2.137:0/3030603502 conn(0x7fef28069e70 msgr2=0x7fef280b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 shutdown_connections 2021-11-15T19:33:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.165+0000 7fef2f7cb700 1 -- 172.21.2.137:0/3030603502 wait complete. 2021-11-15T19:33:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:33:52.181 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:33:52.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 Processor -- start 2021-11-15T19:33:52.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- start start 2021-11-15T19:33:52.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4e14097260 0x7f4e14097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4e140b2c30 0x7f4e140990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140aca80 con 0x7f4e140969e0 2021-11-15T19:33:52.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140ad150 con 0x7f4e14097260 2021-11-15T19:33:52.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140accb0 con 0x7f4e140b2c30 2021-11-15T19:33:52.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e11d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4e140b2c30 0x7f4e140990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e12d9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4e140969e0 0x7f4e140995d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56162/0 (socket says 172.21.2.137:56162) 2021-11-15T19:33:52.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e12d9d700 1 -- 172.21.2.137:0/2633825046 learned_addr learned my addr 172.21.2.137:0/2633825046 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:52.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e11d9b700 1 -- 172.21.2.137:0/2633825046 >> v2:172.21.2.111:3300/0 conn(0x7f4e14097260 msgr2=0x7f4e14097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e11d9b700 1 --2- 172.21.2.137:0/2633825046 >> v2:172.21.2.111:3300/0 conn(0x7f4e14097260 0x7f4e14097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e11d9b700 1 -- 172.21.2.137:0/2633825046 >> v1:172.21.2.137:6789/0 conn(0x7f4e140969e0 legacy=0x7f4e140995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e11d9b700 1 -- 172.21.2.137:0/2633825046 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14097c50 con 0x7f4e140b2c30 2021-11-15T19:33:52.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e11d9b700 1 --2- 172.21.2.137:0/2633825046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e140990e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4dfc002f70 tx=0x7f4dfc006df0).ready entity=mon.1 client_cookie=f780539335e07326 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e1159a700 1 -- 172.21.2.137:0/2633825046 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dfc00d5c0 con 0x7f4e140b2c30 2021-11-15T19:33:52.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e1159a700 1 -- 172.21.2.137:0/2633825046 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc000e90 con 0x7f4e140b2c30 2021-11-15T19:33:52.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e1159a700 1 -- 172.21.2.137:0/2633825046 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dfc00d910 con 0x7f4e140b2c30 2021-11-15T19:33:52.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- 172.21.2.137:0/2633825046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 msgr2=0x7f4e140990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2633825046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e140990e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4dfc002f70 tx=0x7f4dfc006df0).stop 2021-11-15T19:33:52.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- 172.21.2.137:0/2633825046 shutdown_connections 2021-11-15T19:33:52.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2633825046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e140990e0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2633825046 >> v2:172.21.2.111:3300/0 conn(0x7f4e14097260 0x7f4e14097640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- 172.21.2.137:0/2633825046 >> 172.21.2.137:0/2633825046 conn(0x7f4e140b7070 msgr2=0x7f4e140b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- 172.21.2.137:0/2633825046 shutdown_connections 2021-11-15T19:33:52.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.229+0000 7f4e18c11700 1 -- 172.21.2.137:0/2633825046 wait complete. 2021-11-15T19:33:52.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 Processor -- start 2021-11-15T19:33:52.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- start start 2021-11-15T19:33:52.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e140969e0 0x7f4e14064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4e14097260 0x7f4e14067720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e1409c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141516a0 con 0x7f4e14097260 2021-11-15T19:33:52.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140b06d0 con 0x7f4e140b2c30 2021-11-15T19:33:52.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140b0970 con 0x7f4e140969e0 2021-11-15T19:33:52.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e1409c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e1409c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37384/0 (socket says 172.21.2.137:37384) 2021-11-15T19:33:52.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 -- 172.21.2.137:0/2001723173 learned_addr learned my addr 172.21.2.137:0/2001723173 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:52.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 -- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e140969e0 msgr2=0x7f4e14064920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e140969e0 0x7f4e14064920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 -- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4e14097260 msgr2=0x7f4e14067720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4e14097260 0x7f4e14067720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 -- 172.21.2.137:0/2001723173 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc00b180 con 0x7f4e140b2c30 2021-11-15T19:33:52.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e12d9d700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e1409c620 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f4e140b0c40 tx=0x7f4e0c007ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c005ba0 con 0x7f4e140b2c30 2021-11-15T19:33:52.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c005d00 con 0x7f4e140b2c30 2021-11-15T19:33:52.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1409cb10 con 0x7f4e140b2c30 2021-11-15T19:33:52.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c0072c0 con 0x7f4e140b2c30 2021-11-15T19:33:52.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140b11a0 con 0x7f4e140b2c30 2021-11-15T19:33:52.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e141517e0 con 0x7f4e140b2c30 2021-11-15T19:33:52.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e0c010070 con 0x7f4e140b2c30 2021-11-15T19:33:52.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e0b7fe700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4df80536f0 0x7f4df8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f4e0c06b290 con 0x7f4e140b2c30 2021-11-15T19:33:52.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.233+0000 7f4e1259c700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4df80536f0 0x7f4df8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.237+0000 7f4e1259c700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4df80536f0 0x7f4df8055bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4e04002f70 tx=0x7f4e04006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.237+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e0c042460 con 0x7f4e140b2c30 2021-11-15T19:33:52.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.349+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4e140573d0 con 0x7f4e140b2c30 2021-11-15T19:33:52.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e0b7fe700 1 -- 172.21.2.137:0/2001723173 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v43) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4e0c045a80 con 0x7f4e140b2c30 2021-11-15T19:33:52.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4df80536f0 msgr2=0x7f4df8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4df80536f0 0x7f4df8055bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4e04002f70 tx=0x7f4e04006a80).stop 2021-11-15T19:33:52.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 msgr2=0x7f4e1409c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e1409c620 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f4e140b0c40 tx=0x7f4e0c007ee0).stop 2021-11-15T19:33:52.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 shutdown_connections 2021-11-15T19:33:52.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4df80536f0 0x7f4df8055bb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e140b2c30 0x7f4e1409c620 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4e14097260 0x7f4e14067720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 --2- 172.21.2.137:0/2001723173 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e140969e0 0x7f4e14064920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 >> 172.21.2.137:0/2001723173 conn(0x7f4e140b7070 msgr2=0x7f4e14062920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 shutdown_connections 2021-11-15T19:33:52.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.361+0000 7f4e18c11700 1 -- 172.21.2.137:0/2001723173 wait complete. 2021-11-15T19:33:52.375 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 17 and data pool 18 2021-11-15T19:33:52.379 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:52.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1ac52e700 1 Processor -- start 2021-11-15T19:33:52.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1ac52e700 1 -- start start 2021-11-15T19:33:52.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1ac52e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd1a4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1ac52e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a4148190 con 0x7fd1a40b1340 2021-11-15T19:33:52.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1ac52e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40b1720 con 0x7fd1a40a9f50 2021-11-15T19:33:52.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1ac52e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4147e70 con 0x7fd1a4144610 2021-11-15T19:33:52.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1aaacb700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd1a40a9f50 0x7fd1a40aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56182/0 (socket says 172.21.2.137:56182) 2021-11-15T19:33:52.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1aaacb700 1 -- 172.21.2.137:0/2964639627 learned_addr learned my addr 172.21.2.137:0/2964639627 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:52.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.417+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962483171 0 0) 0x7fd1a40b1720 con 0x7fd1a40a9f50 2021-11-15T19:33:52.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd18c003260 con 0x7fd1a40a9f50 2021-11-15T19:33:52.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd1a4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2387679094 0 0) 0x7fd18c003260 con 0x7fd1a40a9f50 2021-11-15T19:33:52.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 msgr2=0x7fd1a4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd1a4147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 >> v1:172.21.2.111:6789/0 conn(0x7fd1a40b1340 legacy=0x7fd1a4143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40af800 con 0x7fd1a40a9f50 2021-11-15T19:33:52.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd19c0019e0 con 0x7fd1a40a9f50 2021-11-15T19:33:52.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 >> v1:172.21.2.137:6789/0 conn(0x7fd1a40a9f50 legacy=0x7fd1a40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd18c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd18c003de0 0x7fd18c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c004a60 0x7fd18c004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4147e70 con 0x7fd18c004a60 2021-11-15T19:33:52.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c00b910 con 0x7fd18c003de0 2021-11-15T19:33:52.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c00bad0 con 0x7fd1a4144610 2021-11-15T19:33:52.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd18c003de0 0x7fd18c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aaacb700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c004a60 0x7fd18c004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aa2ca700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd18c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 msgr2=0x7fd18c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd18c0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c004a60 msgr2=0x7fd18c004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c004a60 0x7fd18c004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2964639627 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c003260 con 0x7fd18c003de0 2021-11-15T19:33:52.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aaacb700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c004a60 0x7fd18c004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:52.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aa2ca700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a4144610 0x7fd18c0037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:52.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd18c003de0 0x7fd18c004500 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fd19800a000 tx=0x7fd198008040).ready entity=mon.1 client_cookie=d8be1dbe70308361 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd198013670 con 0x7fd18c003de0 2021-11-15T19:33:52.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1980137d0 con 0x7fd18c003de0 2021-11-15T19:33:52.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a92c8700 1 -- 172.21.2.137:0/2964639627 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd198013b30 con 0x7fd18c003de0 2021-11-15T19:33:52.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2964639627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd18c003de0 msgr2=0x7fd18c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2964639627 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd18c003de0 0x7fd18c004500 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fd19800a000 tx=0x7fd198008040).stop 2021-11-15T19:33:52.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aaacb700 1 -- 172.21.2.137:0/2964639627 reap_dead start 2021-11-15T19:33:52.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2964639627 shutdown_connections 2021-11-15T19:33:52.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2964639627 >> 172.21.2.137:0/2964639627 conn(0x7fd1a40b4e60 msgr2=0x7fd1a40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2964639627 shutdown_connections 2021-11-15T19:33:52.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2964639627 wait complete. 2021-11-15T19:33:52.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 Processor -- start 2021-11-15T19:33:52.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- start start 2021-11-15T19:33:52.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c003de0 0x7fd1a4146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 0x7fd1a4099f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a415a050 0x7fd1a415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40aed80 con 0x7fd18c003de0 2021-11-15T19:33:52.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4159bf0 con 0x7fd1a41453b0 2021-11-15T19:33:52.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40aefb0 con 0x7fd1a415a050 2021-11-15T19:33:52.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 0x7fd1a4099f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 0x7fd1a4099f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37412/0 (socket says 172.21.2.137:37412) 2021-11-15T19:33:52.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2614385887 learned_addr learned my addr 172.21.2.137:0/2614385887 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:52.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aa2ca700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c003de0 0x7fd1a4146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aaacb700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a415a050 0x7fd1a415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a415a050 msgr2=0x7fd1a415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a415a050 0x7fd1a415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c003de0 msgr2=0x7fd1a4146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c003de0 0x7fd1a4146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 -- 172.21.2.137:0/2614385887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a415a9c0 con 0x7fd1a41453b0 2021-11-15T19:33:52.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1aaacb700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a415a050 0x7fd1a415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:52.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1a9ac9700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 0x7fd1a4099f50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fd19800a000 tx=0x7fd198008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd198012d00 con 0x7fd1a41453b0 2021-11-15T19:33:52.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198000e90 con 0x7fd1a41453b0 2021-11-15T19:33:52.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a40adcd0 con 0x7fd1a41453b0 2021-11-15T19:33:52.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd19801d600 con 0x7fd1a41453b0 2021-11-15T19:33:52.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.421+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40ae1e0 con 0x7fd1a41453b0 2021-11-15T19:33:52.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a4159bf0 con 0x7fd1a41453b0 2021-11-15T19:33:52.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd19801d760 con 0x7fd1a41453b0 2021-11-15T19:33:52.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1977fe700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1840536d0 0x7fd184055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd19806d480 con 0x7fd1a41453b0 2021-11-15T19:33:52.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1aa2ca700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1840536d0 0x7fd184055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1aa2ca700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1840536d0 0x7fd184055b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd1a000c000 tx=0x7fd1a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.425+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1980444d0 con 0x7fd1a41453b0 2021-11-15T19:33:52.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a4159d80 con 0x7fd1a41453b0 2021-11-15T19:33:52.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1977fe700 1 -- 172.21.2.137:0/2614385887 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fd198012e60 con 0x7fd1a41453b0 2021-11-15T19:33:52.522 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:52.522 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":92,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:52.356770+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:50.260810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:51.357957+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:52.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1840536d0 msgr2=0x7fd184055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1840536d0 0x7fd184055b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd1a000c000 tx=0x7fd1a0009040).stop 2021-11-15T19:33:52.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 msgr2=0x7fd1a4099f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 0x7fd1a4099f50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fd19800a000 tx=0x7fd198008040).stop 2021-11-15T19:33:52.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 shutdown_connections 2021-11-15T19:33:52.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1840536d0 0x7fd184055b90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1a415a050 0x7fd1a415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1a41453b0 0x7fd1a4099f50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 --2- 172.21.2.137:0/2614385887 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd18c003de0 0x7fd1a4146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 >> 172.21.2.137:0/2614385887 conn(0x7fd1a40b4e60 msgr2=0x7fd1a40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 shutdown_connections 2021-11-15T19:33:52.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.513+0000 7fd1ac52e700 1 -- 172.21.2.137:0/2614385887 wait complete. 2021-11-15T19:33:52.530 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:52.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.569+0000 7f7532f1e700 1 Processor -- start 2021-11-15T19:33:52.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.569+0000 7f7532f1e700 1 -- start start 2021-11-15T19:33:52.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f752c066f40 0x7f752c13fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0b1720 con 0x7f752c146160 2021-11-15T19:33:52.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0abfe0 con 0x7f752c0af800 2021-11-15T19:33:52.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0aa230 con 0x7f752c066f40 2021-11-15T19:33:52.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f752c0af800 0x7f752c13ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56202/0 (socket says 172.21.2.137:56202) 2021-11-15T19:33:52.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 -- 172.21.2.137:0/2559105102 learned_addr learned my addr 172.21.2.137:0/2559105102 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:52.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7530cba700 1 --2- 172.21.2.137:0/2559105102 >> v2:172.21.2.137:3300/0 conn(0x7f752c066f40 0x7f752c13fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7530cba700 1 -- 172.21.2.137:0/2559105102 >> v1:172.21.2.137:6789/0 conn(0x7f752c0af800 legacy=0x7f752c13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7530cba700 1 -- 172.21.2.137:0/2559105102 >> v1:172.21.2.111:6789/0 conn(0x7f752c146160 legacy=0x7f752c1465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7530cba700 1 -- 172.21.2.137:0/2559105102 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c060d50 con 0x7f752c066f40 2021-11-15T19:33:52.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7530cba700 1 --2- 172.21.2.137:0/2559105102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c066f40 0x7f752c13fa90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f752c09b040 tx=0x7f7514006df0).ready entity=mon.1 client_cookie=72bf176974397ef1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752b7fe700 1 -- 172.21.2.137:0/2559105102 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751400d4a0 con 0x7f752c066f40 2021-11-15T19:33:52.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752b7fe700 1 -- 172.21.2.137:0/2559105102 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514000e90 con 0x7f752c066f40 2021-11-15T19:33:52.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752b7fe700 1 -- 172.21.2.137:0/2559105102 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751400d7f0 con 0x7f752c066f40 2021-11-15T19:33:52.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- 172.21.2.137:0/2559105102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c066f40 msgr2=0x7f752c13fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 --2- 172.21.2.137:0/2559105102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c066f40 0x7f752c13fa90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f752c09b040 tx=0x7f7514006df0).stop 2021-11-15T19:33:52.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- 172.21.2.137:0/2559105102 shutdown_connections 2021-11-15T19:33:52.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 --2- 172.21.2.137:0/2559105102 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c066f40 0x7f752c13fa90 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- 172.21.2.137:0/2559105102 >> 172.21.2.137:0/2559105102 conn(0x7f752c0b4e60 msgr2=0x7f752c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- 172.21.2.137:0/2559105102 shutdown_connections 2021-11-15T19:33:52.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- 172.21.2.137:0/2559105102 wait complete. 2021-11-15T19:33:52.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 Processor -- start 2021-11-15T19:33:52.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- start start 2021-11-15T19:33:52.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f752c066f40 0x7f752c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 0x7f752c0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f752c146160 0x7f752c099730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c098ce0 con 0x7f752c066f40 2021-11-15T19:33:52.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c098f80 con 0x7f752c0af800 2021-11-15T19:33:52.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7532f1e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0ad770 con 0x7f752c146160 2021-11-15T19:33:52.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 0x7f752c0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 0x7f752c0adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37424/0 (socket says 172.21.2.137:37424) 2021-11-15T19:33:52.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 -- 172.21.2.137:0/522534546 learned_addr learned my addr 172.21.2.137:0/522534546 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:52.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 -- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f752c146160 msgr2=0x7f752c099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f752c146160 0x7f752c099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 -- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f752c066f40 msgr2=0x7f752c0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f752c066f40 0x7f752c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 -- 172.21.2.137:0/522534546 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751400b180 con 0x7f752c0af800 2021-11-15T19:33:52.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f752bfff700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 0x7f752c0adeb0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f75240011d0 tx=0x7f7524007bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75240072e0 con 0x7f752c0af800 2021-11-15T19:33:52.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524007440 con 0x7f752c0af800 2021-11-15T19:33:52.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.573+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7524005800 con 0x7f752c0af800 2021-11-15T19:33:52.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c0ada10 con 0x7f752c0af800 2021-11-15T19:33:52.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c13e8b0 con 0x7f752c0af800 2021-11-15T19:33:52.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0abd40 con 0x7f752c0af800 2021-11-15T19:33:52.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7524010070 con 0x7f752c0af800 2021-11-15T19:33:52.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7529ffb700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75100536a0 0x7f7510055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f752406b120 con 0x7f752c0af800 2021-11-15T19:33:52.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7530cba700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75100536a0 0x7f7510055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7530cba700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75100536a0 0x7f7510055b60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f752c09b040 tx=0x7f7514014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.577+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7524068e90 con 0x7f752c0af800 2021-11-15T19:33:52.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f752c05f730 con 0x7f752c0af800 2021-11-15T19:33:52.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7529ffb700 1 -- 172.21.2.137:0/522534546 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f752404aed0 con 0x7f752c0af800 2021-11-15T19:33:52.671 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:52.671 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":92,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:52.356770+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:50.260810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:51.357957+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:52.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75100536a0 msgr2=0x7f7510055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75100536a0 0x7f7510055b60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f752c09b040 tx=0x7f7514014000).stop 2021-11-15T19:33:52.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 msgr2=0x7f752c0adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 0x7f752c0adeb0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f75240011d0 tx=0x7f7524007bc0).stop 2021-11-15T19:33:52.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 shutdown_connections 2021-11-15T19:33:52.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75100536a0 0x7f7510055b60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f752c146160 0x7f752c099730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f752c0af800 0x7f752c0adeb0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 --2- 172.21.2.137:0/522534546 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f752c066f40 0x7f752c0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 >> 172.21.2.137:0/522534546 conn(0x7f752c0b4e60 msgr2=0x7f752c139f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 shutdown_connections 2021-11-15T19:33:52.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.661+0000 7f7532f1e700 1 -- 172.21.2.137:0/522534546 wait complete. 2021-11-15T19:33:52.678 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:33:52.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc8e4a700 1 Processor -- start 2021-11-15T19:33:52.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc8e4a700 1 -- start start 2021-11-15T19:33:52.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc8e4a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 0x7f3fc413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc8e4a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc4066270 con 0x7f3fc4065b10 2021-11-15T19:33:52.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc8e4a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc4065fd0 con 0x7f3fc40b00a0 2021-11-15T19:33:52.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc8e4a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4067410 con 0x7f3fc4065730 2021-11-15T19:33:52.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc2d9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3fc40b00a0 0x7f3fc4069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56216/0 (socket says 172.21.2.137:56216) 2021-11-15T19:33:52.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc2d9d700 1 -- 172.21.2.137:0/3996893127 learned_addr learned my addr 172.21.2.137:0/3996893127 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:52.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969228191 0 0) 0x7f3fc4065fd0 con 0x7f3fc40b00a0 2021-11-15T19:33:52.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa4003260 con 0x7f3fc40b00a0 2021-11-15T19:33:52.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 0x7f3fc413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1583543262 0 0) 0x7f3fa4003260 con 0x7f3fc40b00a0 2021-11-15T19:33:52.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 msgr2=0x7f3fc413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 0x7f3fc413c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 >> v1:172.21.2.111:6789/0 conn(0x7f3fc4065b10 legacy=0x7f3fc413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4066f70 con 0x7f3fc40b00a0 2021-11-15T19:33:52.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3fbc0019e0 con 0x7f3fc40b00a0 2021-11-15T19:33:52.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 >> v1:172.21.2.137:6789/0 conn(0x7f3fc40b00a0 legacy=0x7f3fc4069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fa40037d0 0x7f3fa4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fa4004500 0x7f3fa4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 0x7f3fa4004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4067410 con 0x7f3fa4004500 2021-11-15T19:33:52.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa400b8e0 con 0x7f3fa40037d0 2021-11-15T19:33:52.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa400baa0 con 0x7f3fc4065730 2021-11-15T19:33:52.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fa40037d0 0x7f3fa4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 -- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 msgr2=0x7f3fa4004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fc4065730 0x7f3fa4004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 -- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fa4004500 msgr2=0x7f3fa4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:52.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fa4004500 0x7f3fa4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 -- 172.21.2.137:0/3996893127 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4003260 con 0x7f3fa40037d0 2021-11-15T19:33:52.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc259c700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fa40037d0 0x7f3fa4003bf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f3fa40054d0 tx=0x7f3fb4008040).ready entity=mon.1 client_cookie=33b9d50e0bbe7867 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb4013670 con 0x7f3fa40037d0 2021-11-15T19:33:52.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.721+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb40137d0 con 0x7f3fa40037d0 2021-11-15T19:33:52.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc159a700 1 -- 172.21.2.137:0/3996893127 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb4013b30 con 0x7f3fa40037d0 2021-11-15T19:33:52.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/3996893127 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fa40037d0 msgr2=0x7f3fa4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/3996893127 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fa40037d0 0x7f3fa4003bf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f3fa40054d0 tx=0x7f3fb4008040).stop 2021-11-15T19:33:52.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc2d9d700 1 -- 172.21.2.137:0/3996893127 reap_dead start 2021-11-15T19:33:52.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/3996893127 shutdown_connections 2021-11-15T19:33:52.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/3996893127 >> 172.21.2.137:0/3996893127 conn(0x7f3fc4060290 msgr2=0x7f3fc4060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:52.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/3996893127 shutdown_connections 2021-11-15T19:33:52.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/3996893127 wait complete. 2021-11-15T19:33:52.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 Processor -- start 2021-11-15T19:33:52.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- start start 2021-11-15T19:33:52.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fa40037d0 0x7f3fc40b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 0x7f3fc415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fc40af380 0x7f3fc4140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40ae080 con 0x7f3fc40af380 2021-11-15T19:33:52.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4159860 con 0x7f3fc4130880 2021-11-15T19:33:52.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4159b00 con 0x7f3fa40037d0 2021-11-15T19:33:52.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 0x7f3fc415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 0x7f3fc415a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37448/0 (socket says 172.21.2.137:37448) 2021-11-15T19:33:52.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 -- 172.21.2.137:0/4163294326 learned_addr learned my addr 172.21.2.137:0/4163294326 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:52.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc2d9d700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fc40af380 0x7f3fc4140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 -- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fa40037d0 msgr2=0x7f3fc40b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fa40037d0 0x7f3fc40b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:52.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 -- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fc40af380 msgr2=0x7f3fc4140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:52.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fc40af380 0x7f3fc4140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:52.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 -- 172.21.2.137:0/4163294326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4159da0 con 0x7f3fc4130880 2021-11-15T19:33:52.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc2d9d700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fc40af380 0x7f3fc4140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:52.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc1d9b700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 0x7f3fc415a240 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f3fac001fa0 tx=0x7f3fac007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fac00ce80 con 0x7f3fc4130880 2021-11-15T19:33:52.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac000e90 con 0x7f3fc4130880 2021-11-15T19:33:52.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc415a730 con 0x7f3fc4130880 2021-11-15T19:33:52.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4140970 con 0x7f3fc4130880 2021-11-15T19:33:52.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fac007430 con 0x7f3fc4130880 2021-11-15T19:33:52.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4159f30 con 0x7f3fc4130880 2021-11-15T19:33:52.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3fac01a060 con 0x7f3fc4130880 2021-11-15T19:33:52.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fbb7fe700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3fa80535d0 0x7f3fa8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:52.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.725+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3fac06b1c0 con 0x7f3fc4130880 2021-11-15T19:33:52.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.729+0000 7f3fc259c700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3fa80535d0 0x7f3fa8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:52.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.729+0000 7f3fc259c700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3fa80535d0 0x7f3fa8055a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f3fa40054d0 tx=0x7f3fb4018000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:52.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.729+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fac0422a0 con 0x7f3fc4130880 2021-11-15T19:33:52.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:52.841+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3fc40573d0 con 0x7f3fc4130880 2021-11-15T19:33:53.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fbb7fe700 1 -- 172.21.2.137:0/4163294326 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3fac018020 con 0x7f3fc4130880 2021-11-15T19:33:53.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3fa80535d0 msgr2=0x7f3fa8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3fa80535d0 0x7f3fa8055a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f3fa40054d0 tx=0x7f3fb4018000).stop 2021-11-15T19:33:53.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 msgr2=0x7f3fc415a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 0x7f3fc415a240 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f3fac001fa0 tx=0x7f3fac007c30).stop 2021-11-15T19:33:53.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 shutdown_connections 2021-11-15T19:33:53.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3fa80535d0 0x7f3fa8055a90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3fc40af380 0x7f3fc4140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3fc4130880 0x7f3fc415a240 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 --2- 172.21.2.137:0/4163294326 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3fa40037d0 0x7f3fc40b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 >> 172.21.2.137:0/4163294326 conn(0x7f3fc4060290 msgr2=0x7f3fc41314e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 shutdown_connections 2021-11-15T19:33:53.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.369+0000 7f3fc8e4a700 1 -- 172.21.2.137:0/4163294326 wait complete. 2021-11-15T19:33:53.387 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:53.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 Processor -- start 2021-11-15T19:33:53.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- start start 2021-11-15T19:33:53.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f96d80608f0 0x7f96d813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f96d805f730 0x7f96d805fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d80b1af0 con 0x7f96d80b1660 2021-11-15T19:33:53.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d80ad6c0 con 0x7f96d80608f0 2021-11-15T19:33:53.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d80b0c80 con 0x7f96d805f730 2021-11-15T19:33:53.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d6ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f96d80b1660 0x7f96d80b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56236/0 (socket says 172.21.2.137:56236) 2021-11-15T19:33:53.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d6ffd700 1 -- 172.21.2.137:0/510681645 learned_addr learned my addr 172.21.2.137:0/510681645 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:53.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d7fff700 1 --2- 172.21.2.137:0/510681645 >> v2:172.21.2.137:3300/0 conn(0x7f96d805f730 0x7f96d805fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d77fe700 1 --2- 172.21.2.137:0/510681645 >> v2:172.21.2.111:3300/0 conn(0x7f96d80608f0 0x7f96d813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d7fff700 1 -- 172.21.2.137:0/510681645 >> v2:172.21.2.111:3300/0 conn(0x7f96d80608f0 msgr2=0x7f96d813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d7fff700 1 --2- 172.21.2.137:0/510681645 >> v2:172.21.2.111:3300/0 conn(0x7f96d80608f0 0x7f96d813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d7fff700 1 -- 172.21.2.137:0/510681645 >> v1:172.21.2.137:6789/0 conn(0x7f96d80b1660 legacy=0x7f96d80b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d7fff700 1 -- 172.21.2.137:0/510681645 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80b0f20 con 0x7f96d805f730 2021-11-15T19:33:53.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d77fe700 1 --2- 172.21.2.137:0/510681645 >> v2:172.21.2.111:3300/0 conn(0x7f96d80608f0 0x7f96d813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:53.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d7fff700 1 --2- 172.21.2.137:0/510681645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d805fb40 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f96cc001110 tx=0x7f96d00091d0).ready entity=mon.1 client_cookie=4a49827297019f65 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d67fc700 1 -- 172.21.2.137:0/510681645 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d0009ea0 con 0x7f96d805f730 2021-11-15T19:33:53.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d67fc700 1 -- 172.21.2.137:0/510681645 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000b920 con 0x7f96d805f730 2021-11-15T19:33:53.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96d67fc700 1 -- 172.21.2.137:0/510681645 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d000bc80 con 0x7f96d805f730 2021-11-15T19:33:53.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- 172.21.2.137:0/510681645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 msgr2=0x7f96d805fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 --2- 172.21.2.137:0/510681645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d805fb40 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f96cc001110 tx=0x7f96d00091d0).stop 2021-11-15T19:33:53.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- 172.21.2.137:0/510681645 shutdown_connections 2021-11-15T19:33:53.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 --2- 172.21.2.137:0/510681645 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d805fb40 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 --2- 172.21.2.137:0/510681645 >> v2:172.21.2.111:3300/0 conn(0x7f96d80608f0 0x7f96d813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- 172.21.2.137:0/510681645 >> 172.21.2.137:0/510681645 conn(0x7f96d8063980 msgr2=0x7f96d8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- 172.21.2.137:0/510681645 shutdown_connections 2021-11-15T19:33:53.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.429+0000 7f96de232700 1 -- 172.21.2.137:0/510681645 wait complete. 2021-11-15T19:33:53.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 Processor -- start 2021-11-15T19:33:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- start start 2021-11-15T19:33:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96d80608f0 0x7f96d8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96d80b1660 0x7f96d81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8143310 con 0x7f96d80b1660 2021-11-15T19:33:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8143070 con 0x7f96d805f730 2021-11-15T19:33:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8152250 con 0x7f96d80608f0 2021-11-15T19:33:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d813e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37460/0 (socket says 172.21.2.137:37460) 2021-11-15T19:33:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 -- 172.21.2.137:0/1440929067 learned_addr learned my addr 172.21.2.137:0/1440929067 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 -- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96d80608f0 msgr2=0x7f96d8156000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96d80608f0 0x7f96d8156000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 -- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96d80b1660 msgr2=0x7f96d81526f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:53.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96d80b1660 0x7f96d81526f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 -- 172.21.2.137:0/1440929067 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0009470 con 0x7f96d805f730 2021-11-15T19:33:53.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d77fe700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d813e780 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f96c8007000 tx=0x7f96c8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c8010580 con 0x7f96d805f730 2021-11-15T19:33:53.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c80106e0 con 0x7f96d805f730 2021-11-15T19:33:53.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c8010a40 con 0x7f96d805f730 2021-11-15T19:33:53.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d81564f0 con 0x7f96d805f730 2021-11-15T19:33:53.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d8142de0 con 0x7f96d805f730 2021-11-15T19:33:53.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d80b11c0 con 0x7f96d805f730 2021-11-15T19:33:53.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96c8010ba0 con 0x7f96d805f730 2021-11-15T19:33:53.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d4ff9700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96b80536f0 0x7f96b8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f96c806bc80 con 0x7f96d805f730 2021-11-15T19:33:53.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d6ffd700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96b80536f0 0x7f96b8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.433+0000 7f96d6ffd700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96b80536f0 0x7f96b8055bb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f96cc000fe0 tx=0x7f96cc007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.437+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96c8072080 con 0x7f96d805f730 2021-11-15T19:33:53.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.545+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96d80573d0 con 0x7f96d805f730 2021-11-15T19:33:53.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.545+0000 7f96d4ff9700 1 -- 172.21.2.137:0/1440929067 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f96c8042c70 con 0x7f96d805f730 2021-11-15T19:33:53.556 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:53.557 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:33:53.363248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6892":{"gid":6892,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3296577708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3296577708},{"type":"v1","addr":"172.21.2.137:6833","nonce":3296577708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:33:53.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.545+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96b80536f0 msgr2=0x7f96b8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.545+0000 7f96de232700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96b80536f0 0x7f96b8055bb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f96cc000fe0 tx=0x7f96cc007790).stop 2021-11-15T19:33:53.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.545+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 msgr2=0x7f96d813e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.545+0000 7f96de232700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d813e780 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f96c8007000 tx=0x7f96c8008040).stop 2021-11-15T19:33:53.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 shutdown_connections 2021-11-15T19:33:53.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f96b80536f0 0x7f96b8055bb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f96d80b1660 0x7f96d81526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f96d80608f0 0x7f96d8156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 --2- 172.21.2.137:0/1440929067 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f96d805f730 0x7f96d813e780 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 >> 172.21.2.137:0/1440929067 conn(0x7f96d8063980 msgr2=0x7f96d8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 shutdown_connections 2021-11-15T19:33:53.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.549+0000 7f96de232700 1 -- 172.21.2.137:0/1440929067 wait complete. 2021-11-15T19:33:53.561 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 44 2021-11-15T19:33:53.563 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:53.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 Processor -- start 2021-11-15T19:33:53.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- start start 2021-11-15T19:33:53.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b30147980 0x7f4b300aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b30148190 con 0x7f4b30144610 2021-11-15T19:33:53.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b300b1720 con 0x7f4b300b1340 2021-11-15T19:33:53.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300af800 con 0x7f4b30147980 2021-11-15T19:33:53.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2f7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4b300b1340 0x7f4b30143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56248/0 (socket says 172.21.2.137:56248) 2021-11-15T19:33:53.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2f7fe700 1 -- 172.21.2.137:0/1108083509 learned_addr learned my addr 172.21.2.137:0/1108083509 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:53.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551681806 0 0) 0x7f4b300b1720 con 0x7f4b300b1340 2021-11-15T19:33:53.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b1c003260 con 0x7f4b300b1340 2021-11-15T19:33:53.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b30147980 0x7f4b300aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541067700 0 0) 0x7f4b1c003260 con 0x7f4b300b1340 2021-11-15T19:33:53.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b30147980 msgr2=0x7f4b300aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b30147980 0x7f4b300aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 >> v1:172.21.2.111:6789/0 conn(0x7f4b30144610 legacy=0x7f4b300a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3005faf0 con 0x7f4b300b1340 2021-11-15T19:33:53.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4b280019e0 con 0x7f4b300b1340 2021-11-15T19:33:53.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 >> v1:172.21.2.137:6789/0 conn(0x7f4b300b1340 legacy=0x7f4b30143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c0037d0 0x7f4b1c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b1c004500 0x7f4b1c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b1c004f90 0x7f4b1c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300af800 con 0x7f4b1c004500 2021-11-15T19:33:53.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00be50 con 0x7f4b1c004f90 2021-11-15T19:33:53.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00c010 con 0x7f4b1c0037d0 2021-11-15T19:33:53.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b1c004f90 0x7f4b1c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2f7fe700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c0037d0 0x7f4b1c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2effd700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b1c004500 0x7f4b1c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 -- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c0037d0 msgr2=0x7f4b1c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c0037d0 0x7f4b1c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 -- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b1c004500 msgr2=0x7f4b1c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b1c004500 0x7f4b1c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 -- 172.21.2.137:0/1108083509 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c003260 con 0x7f4b1c004f90 2021-11-15T19:33:53.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2effd700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b1c004500 0x7f4b1c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:33:53.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b1c004f90 0x7f4b1c00b750 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f4b20000b60 tx=0x7f4b20008040).ready entity=mon.1 client_cookie=4b4fcee91bf45e33 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b20013630 con 0x7f4b1c004f90 2021-11-15T19:33:53.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20000e90 con 0x7f4b1c004f90 2021-11-15T19:33:53.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2e7fc700 1 -- 172.21.2.137:0/1108083509 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b20013980 con 0x7f4b1c004f90 2021-11-15T19:33:53.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- 172.21.2.137:0/1108083509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b1c004f90 msgr2=0x7f4b1c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 --2- 172.21.2.137:0/1108083509 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b1c004f90 0x7f4b1c00b750 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f4b20000b60 tx=0x7f4b20008040).stop 2021-11-15T19:33:53.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b2ffff700 1 -- 172.21.2.137:0/1108083509 reap_dead start 2021-11-15T19:33:53.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- 172.21.2.137:0/1108083509 shutdown_connections 2021-11-15T19:33:53.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- 172.21.2.137:0/1108083509 >> 172.21.2.137:0/1108083509 conn(0x7f4b300b4e60 msgr2=0x7f4b300b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- 172.21.2.137:0/1108083509 shutdown_connections 2021-11-15T19:33:53.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.605+0000 7f4b360d3700 1 -- 172.21.2.137:0/1108083509 wait complete. 2021-11-15T19:33:53.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 Processor -- start 2021-11-15T19:33:53.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- start start 2021-11-15T19:33:53.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c004f90 0x7f4b300b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 0x7f4b30141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b301423c0 0x7f4b30097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300aedf0 con 0x7f4b301423c0 2021-11-15T19:33:53.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30142870 con 0x7f4b30141a50 2021-11-15T19:33:53.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3009adb0 con 0x7f4b1c004f90 2021-11-15T19:33:53.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 0x7f4b30141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 0x7f4b30141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37480/0 (socket says 172.21.2.137:37480) 2021-11-15T19:33:53.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 -- 172.21.2.137:0/555067607 learned_addr learned my addr 172.21.2.137:0/555067607 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:53.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 -- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c004f90 msgr2=0x7f4b300b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c004f90 0x7f4b300b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 -- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b301423c0 msgr2=0x7f4b30097df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b301423c0 0x7f4b30097df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 -- 172.21.2.137:0/555067607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300996c0 con 0x7f4b30141a50 2021-11-15T19:33:53.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2effd700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 0x7f4b30141ed0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f4b301418f0 tx=0x7f4b24009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b24007e60 con 0x7f4b30141a50 2021-11-15T19:33:53.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24000e90 con 0x7f4b30141a50 2021-11-15T19:33:53.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b30142a40 con 0x7f4b30141a50 2021-11-15T19:33:53.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3013fdf0 con 0x7f4b30141a50 2021-11-15T19:33:53.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b240106d0 con 0x7f4b30141a50 2021-11-15T19:33:53.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3013ff80 con 0x7f4b30141a50 2021-11-15T19:33:53.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b24019030 con 0x7f4b30141a50 2021-11-15T19:33:53.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2cff9700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b10053720 0x7f4b10055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4b2406afc0 con 0x7f4b30141a50 2021-11-15T19:33:53.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.609+0000 7f4b2f7fe700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b10053720 0x7f4b10055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.613+0000 7f4b2f7fe700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b10053720 0x7f4b10055be0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f4b2800b000 tx=0x7f4b300abfb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.613+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b3013ff80 con 0x7f4b30141a50 2021-11-15T19:33:53.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.697+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b3013ff80 con 0x7f4b30141a50 2021-11-15T19:33:53.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.697+0000 7f4b2cff9700 1 -- 172.21.2.137:0/555067607 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f4b3013ff80 con 0x7f4b30141a50 2021-11-15T19:33:53.709 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:53.709 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":93,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:53.361674+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:50.260810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:51.357957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:53.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b10053720 msgr2=0x7f4b10055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b10053720 0x7f4b10055be0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f4b2800b000 tx=0x7f4b300abfb0).stop 2021-11-15T19:33:53.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 msgr2=0x7f4b30141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 0x7f4b30141ed0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f4b301418f0 tx=0x7f4b24009040).stop 2021-11-15T19:33:53.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 shutdown_connections 2021-11-15T19:33:53.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b10053720 0x7f4b10055be0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b301423c0 0x7f4b30097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b30141a50 0x7f4b30141ed0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 --2- 172.21.2.137:0/555067607 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b1c004f90 0x7f4b300b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 >> 172.21.2.137:0/555067607 conn(0x7f4b300b4e60 msgr2=0x7f4b3013ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 shutdown_connections 2021-11-15T19:33:53.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.701+0000 7f4b360d3700 1 -- 172.21.2.137:0/555067607 wait complete. 2021-11-15T19:33:53.717 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:33:53.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.761+0000 7fbe3b8b3700 1 Processor -- start 2021-11-15T19:33:53.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.761+0000 7fbe3b8b3700 1 -- start start 2021-11-15T19:33:53.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe34063010 0x7fbe3413e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbe340ac8c0 0x7fbe3413e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbe340b1270 0x7fbe3413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe340633f0 con 0x7fbe340ac8c0 2021-11-15T19:33:53.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe34067af0 con 0x7fbe340b1270 2021-11-15T19:33:53.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340af790 con 0x7fbe34063010 2021-11-15T19:33:53.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbe340b1270 0x7fbe3413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbe340b1270 0x7fbe3413ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37490/0 (socket says 172.21.2.137:37490) 2021-11-15T19:33:53.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 -- 172.21.2.137:0/287845442 learned_addr learned my addr 172.21.2.137:0/287845442 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:53.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe38e4e700 1 --2- 172.21.2.137:0/287845442 >> v2:172.21.2.111:3300/0 conn(0x7fbe340ac8c0 0x7fbe3413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 --2- 172.21.2.137:0/287845442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe34063010 0x7fbe3413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 -- 172.21.2.137:0/287845442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe34063010 msgr2=0x7fbe3413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 --2- 172.21.2.137:0/287845442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe34063010 0x7fbe3413e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 -- 172.21.2.137:0/287845442 >> v2:172.21.2.111:3300/0 conn(0x7fbe340ac8c0 msgr2=0x7fbe3413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 --2- 172.21.2.137:0/287845442 >> v2:172.21.2.111:3300/0 conn(0x7fbe340ac8c0 0x7fbe3413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 -- 172.21.2.137:0/287845442 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe340afa30 con 0x7fbe340b1270 2021-11-15T19:33:53.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe39e50700 1 --2- 172.21.2.137:0/287845442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe340b1270 0x7fbe3413ea10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7fbe2c0032f0 tx=0x7fbe2c009290).ready entity=mon.1 client_cookie=78378ae2ac22122d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe27fff700 1 -- 172.21.2.137:0/287845442 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe2c00ba20 con 0x7fbe340b1270 2021-11-15T19:33:53.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe27fff700 1 -- 172.21.2.137:0/287845442 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00bb80 con 0x7fbe340b1270 2021-11-15T19:33:53.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe27fff700 1 -- 172.21.2.137:0/287845442 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe2c010470 con 0x7fbe340b1270 2021-11-15T19:33:53.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/287845442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe340b1270 msgr2=0x7fbe3413ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/287845442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe340b1270 0x7fbe3413ea10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7fbe2c0032f0 tx=0x7fbe2c009290).stop 2021-11-15T19:33:53.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/287845442 shutdown_connections 2021-11-15T19:33:53.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/287845442 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe340b1270 0x7fbe3413ea10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/287845442 >> v2:172.21.2.111:3300/0 conn(0x7fbe340ac8c0 0x7fbe3413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/287845442 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe34063010 0x7fbe3413e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/287845442 >> 172.21.2.137:0/287845442 conn(0x7fbe3405bd20 msgr2=0x7fbe3405c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/287845442 shutdown_connections 2021-11-15T19:33:53.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/287845442 wait complete. 2021-11-15T19:33:53.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 Processor -- start 2021-11-15T19:33:53.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- start start 2021-11-15T19:33:53.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 0x7fbe3413d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe340ac8c0 0x7fbe341422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbe340b1270 0x7fbe340b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34139e20 con 0x7fbe340b1270 2021-11-15T19:33:53.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe341529a0 con 0x7fbe34063010 2021-11-15T19:33:53.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3b8b3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34152c40 con 0x7fbe340ac8c0 2021-11-15T19:33:53.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 0x7fbe3413d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 0x7fbe3413d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37494/0 (socket says 172.21.2.137:37494) 2021-11-15T19:33:53.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 -- 172.21.2.137:0/2982271809 learned_addr learned my addr 172.21.2.137:0/2982271809 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:53.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 -- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe340ac8c0 msgr2=0x7fbe341422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe340ac8c0 0x7fbe341422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 -- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbe340b1270 msgr2=0x7fbe340b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbe340b1270 0x7fbe340b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.765+0000 7fbe3964f700 1 -- 172.21.2.137:0/2982271809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c009530 con 0x7fbe34063010 2021-11-15T19:33:53.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe3964f700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 0x7fbe3413d530 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fbe280030b0 tx=0x7fbe28008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe28011780 con 0x7fbe34063010 2021-11-15T19:33:53.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280118e0 con 0x7fbe34063010 2021-11-15T19:33:53.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe28011c40 con 0x7fbe34063010 2021-11-15T19:33:53.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe34139350 con 0x7fbe34063010 2021-11-15T19:33:53.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe34139a10 con 0x7fbe34063010 2021-11-15T19:33:53.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe341527e0 con 0x7fbe34063010 2021-11-15T19:33:53.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe28012420 con 0x7fbe34063010 2021-11-15T19:33:53.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe267fc700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbe14053600 0x7fbe14055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbe2806b8d0 con 0x7fbe34063010 2021-11-15T19:33:53.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe38e4e700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbe14053600 0x7fbe14055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.769+0000 7fbe38e4e700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbe14053600 0x7fbe14055ac0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbe3000a000 tx=0x7fbe30008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.773+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe280428c0 con 0x7fbe34063010 2021-11-15T19:33:53.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.881+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbe341394e0 con 0x7fbe34063010 2021-11-15T19:33:53.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe267fc700 1 -- 172.21.2.137:0/2982271809 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbe28045ee0 con 0x7fbe34063010 2021-11-15T19:33:53.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbe14053600 msgr2=0x7fbe14055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbe14053600 0x7fbe14055ac0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbe3000a000 tx=0x7fbe30008040).stop 2021-11-15T19:33:53.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 msgr2=0x7fbe3413d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 0x7fbe3413d530 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fbe280030b0 tx=0x7fbe28008040).stop 2021-11-15T19:33:53.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 shutdown_connections 2021-11-15T19:33:53.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbe14053600 0x7fbe14055ac0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbe340b1270 0x7fbe340b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbe340ac8c0 0x7fbe341422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 --2- 172.21.2.137:0/2982271809 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbe34063010 0x7fbe3413d530 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 >> 172.21.2.137:0/2982271809 conn(0x7fbe3405bd20 msgr2=0x7fbe341483c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 shutdown_connections 2021-11-15T19:33:53.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.897+0000 7fbe3b8b3700 1 -- 172.21.2.137:0/2982271809 wait complete. 2021-11-15T19:33:53.906 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:33:53.909 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:33:53.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.953+0000 7f9c47dc7700 1 Processor -- start 2021-11-15T19:33:53.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.953+0000 7f9c47dc7700 1 -- start start 2021-11-15T19:33:53.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.953+0000 7f9c47dc7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9c4005fd20 0x7f9c400af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.953+0000 7f9c47dc7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9c400b10b0 0x7f9c400b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.953+0000 7f9c47dc7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b0610 0x7f9c400aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.953+0000 7f9c47dc7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c40147f70 con 0x7f9c400b10b0 2021-11-15T19:33:53.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c40060100 con 0x7f9c4005fd20 2021-11-15T19:33:53.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40147cd0 con 0x7f9c400b0610 2021-11-15T19:33:53.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9c4005fd20 0x7f9c400af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9c4005fd20 0x7f9c400af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37500/0 (socket says 172.21.2.137:37500) 2021-11-15T19:33:53.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 -- 172.21.2.137:0/1385314722 learned_addr learned my addr 172.21.2.137:0/1385314722 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:53.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 -- 172.21.2.137:0/1385314722 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b0610 msgr2=0x7f9c400aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 --2- 172.21.2.137:0/1385314722 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b0610 0x7f9c400aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 -- 172.21.2.137:0/1385314722 >> v2:172.21.2.111:3300/0 conn(0x7f9c400b10b0 msgr2=0x7f9c400b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 --2- 172.21.2.137:0/1385314722 >> v2:172.21.2.111:3300/0 conn(0x7f9c400b10b0 0x7f9c400b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 -- 172.21.2.137:0/1385314722 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400a9ed0 con 0x7f9c4005fd20 2021-11-15T19:33:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45b63700 1 --2- 172.21.2.137:0/1385314722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c4005fd20 0x7f9c400af800 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f9c3c002f70 tx=0x7f9c3c006eb0).ready entity=mon.1 client_cookie=95b67240a3366d41 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c44b61700 1 -- 172.21.2.137:0/1385314722 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c3c00d570 con 0x7f9c4005fd20 2021-11-15T19:33:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c44b61700 1 -- 172.21.2.137:0/1385314722 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c000e90 con 0x7f9c4005fd20 2021-11-15T19:33:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c44b61700 1 -- 172.21.2.137:0/1385314722 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c3c00d900 con 0x7f9c4005fd20 2021-11-15T19:33:53.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- 172.21.2.137:0/1385314722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c4005fd20 msgr2=0x7f9c400af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/1385314722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c4005fd20 0x7f9c400af800 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f9c3c002f70 tx=0x7f9c3c006eb0).stop 2021-11-15T19:33:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- 172.21.2.137:0/1385314722 shutdown_connections 2021-11-15T19:33:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/1385314722 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b0610 0x7f9c400aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/1385314722 >> v2:172.21.2.111:3300/0 conn(0x7f9c400b10b0 0x7f9c400b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/1385314722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c4005fd20 0x7f9c400af800 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:53.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- 172.21.2.137:0/1385314722 >> 172.21.2.137:0/1385314722 conn(0x7f9c400b4e60 msgr2=0x7f9c400b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:53.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- 172.21.2.137:0/1385314722 shutdown_connections 2021-11-15T19:33:53.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- 172.21.2.137:0/1385314722 wait complete. 2021-11-15T19:33:53.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 Processor -- start 2021-11-15T19:33:53.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- start start 2021-11-15T19:33:53.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9c4005fd20 0x7f9c400b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 0x7f9c40066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b10b0 0x7f9c400671e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c400ad8a0 con 0x7f9c4005fd20 2021-11-15T19:33:53.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c400ad360 con 0x7f9c400b0610 2021-11-15T19:33:53.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c47dc7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c400ad600 con 0x7f9c400b10b0 2021-11-15T19:33:53.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 0x7f9c40066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 0x7f9c40066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37508/0 (socket says 172.21.2.137:37508) 2021-11-15T19:33:53.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 -- 172.21.2.137:0/649140634 learned_addr learned my addr 172.21.2.137:0/649140634 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:53.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 -- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b10b0 msgr2=0x7f9c400671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b10b0 0x7f9c400671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 -- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9c4005fd20 msgr2=0x7f9c400b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:53.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9c4005fd20 0x7f9c400b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:53.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 -- 172.21.2.137:0/649140634 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c00b1e0 con 0x7f9c400b0610 2021-11-15T19:33:53.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c45362700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 0x7f9c40066cf0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f9c34002f70 tx=0x7f9c34006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c3400e470 con 0x7f9c400b0610 2021-11-15T19:33:53.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.957+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3400e5d0 con 0x7f9c400b0610 2021-11-15T19:33:53.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c400676d0 con 0x7f9c400b0610 2021-11-15T19:33:53.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4015a0a0 con 0x7f9c400b0610 2021-11-15T19:33:53.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c3400e930 con 0x7f9c400b0610 2021-11-15T19:33:53.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c003410 con 0x7f9c400b0610 2021-11-15T19:33:53.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c34018030 con 0x7f9c400b0610 2021-11-15T19:33:53.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c32ffd700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9c20053580 0x7f9c20055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:53.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9c3406ad60 con 0x7f9c400b0610 2021-11-15T19:33:53.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c45b63700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9c20053580 0x7f9c20055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:53.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c45b63700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9c20053580 0x7f9c20055a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f9c3c002f70 tx=0x7f9c3c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:53.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:53.961+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c34041f10 con 0x7f9c400b0610 2021-11-15T19:33:54.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.073+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9c1c0036c0 con 0x7f9c400b0610 2021-11-15T19:33:54.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c32ffd700 1 -- 172.21.2.137:0/649140634 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9c34045530 con 0x7f9c400b0610 2021-11-15T19:33:54.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9c20053580 msgr2=0x7f9c20055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9c20053580 0x7f9c20055a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f9c3c002f70 tx=0x7f9c3c015000).stop 2021-11-15T19:33:54.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 msgr2=0x7f9c40066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 0x7f9c40066cf0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f9c34002f70 tx=0x7f9c34006db0).stop 2021-11-15T19:33:54.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 shutdown_connections 2021-11-15T19:33:54.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9c20053580 0x7f9c20055a40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9c400b10b0 0x7f9c400671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9c400b0610 0x7f9c40066cf0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 --2- 172.21.2.137:0/649140634 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9c4005fd20 0x7f9c400b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 >> 172.21.2.137:0/649140634 conn(0x7f9c400b4e60 msgr2=0x7f9c400af800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 shutdown_connections 2021-11-15T19:33:54.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.089+0000 7f9c47dc7700 1 -- 172.21.2.137:0/649140634 wait complete. 2021-11-15T19:33:54.099 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:33:54.102 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:33:54.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.145+0000 7efc66e9f700 1 Processor -- start 2021-11-15T19:33:54.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.145+0000 7efc66e9f700 1 -- start start 2021-11-15T19:33:54.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efc600b10b0 0x7efc600b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc60147f70 con 0x7efc600b0610 2021-11-15T19:33:54.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc60060100 con 0x7efc600b10b0 2021-11-15T19:33:54.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc60147cd0 con 0x7efc6005fd20 2021-11-15T19:33:54.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efc600b0610 0x7efc600aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56296/0 (socket says 172.21.2.137:56296) 2021-11-15T19:33:54.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 -- 172.21.2.137:0/2989671162 learned_addr learned my addr 172.21.2.137:0/2989671162 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:54.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 --2- 172.21.2.137:0/2989671162 >> v2:172.21.2.111:3300/0 conn(0x7efc600b10b0 0x7efc600b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc64c3b700 1 --2- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5f7fe700 1 -- 172.21.2.137:0/2989671162 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905082511 0 0) 0x7efc60147f70 con 0x7efc600b0610 2021-11-15T19:33:54.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5f7fe700 1 -- 172.21.2.137:0/2989671162 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc40003260 con 0x7efc600b0610 2021-11-15T19:33:54.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 -- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 msgr2=0x7efc600af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 --2- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 -- 172.21.2.137:0/2989671162 >> v1:172.21.2.137:6789/0 conn(0x7efc600b0610 legacy=0x7efc600aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 -- 172.21.2.137:0/2989671162 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc600a9ed0 con 0x7efc600b10b0 2021-11-15T19:33:54.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 --2- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b10b0 0x7efc600b0120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7efc58001490 tx=0x7efc48006df0).ready entity=mon.0 client_cookie=b1805c29fe46e567 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5f7fe700 1 -- 172.21.2.137:0/2989671162 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4800d4a0 con 0x7efc600b10b0 2021-11-15T19:33:54.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5f7fe700 1 -- 172.21.2.137:0/2989671162 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48000e90 con 0x7efc600b10b0 2021-11-15T19:33:54.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5f7fe700 1 -- 172.21.2.137:0/2989671162 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4800d7f0 con 0x7efc600b10b0 2021-11-15T19:33:54.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b10b0 msgr2=0x7efc600b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b10b0 0x7efc600b0120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7efc58001490 tx=0x7efc48006df0).stop 2021-11-15T19:33:54.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- 172.21.2.137:0/2989671162 shutdown_connections 2021-11-15T19:33:54.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b10b0 0x7efc600b0120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- 172.21.2.137:0/2989671162 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- 172.21.2.137:0/2989671162 >> 172.21.2.137:0/2989671162 conn(0x7efc600b4e60 msgr2=0x7efc600b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- 172.21.2.137:0/2989671162 shutdown_connections 2021-11-15T19:33:54.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- 172.21.2.137:0/2989671162 wait complete. 2021-11-15T19:33:54.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 Processor -- start 2021-11-15T19:33:54.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- start start 2021-11-15T19:33:54.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b0610 0x7efc60149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 0x7efc601567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6009a330 con 0x7efc600b0610 2021-11-15T19:33:54.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600aef80 con 0x7efc600b10b0 2021-11-15T19:33:54.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc66e9f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc60159d60 con 0x7efc6005fd20 2021-11-15T19:33:54.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 0x7efc601567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 0x7efc601567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37520/0 (socket says 172.21.2.137:37520) 2021-11-15T19:33:54.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 -- 172.21.2.137:0/614458522 learned_addr learned my addr 172.21.2.137:0/614458522 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:54.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc5ffff700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b0610 0x7efc60149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc64c3b700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 -- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 msgr2=0x7efc600ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 -- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b0610 msgr2=0x7efc60149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b0610 0x7efc60149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 -- 172.21.2.137:0/614458522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4800b180 con 0x7efc600b10b0 2021-11-15T19:33:54.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.149+0000 7efc6543c700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 0x7efc601567d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7efc60099bf0 tx=0x7efc58007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc58005c70 con 0x7efc600b10b0 2021-11-15T19:33:54.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58005dd0 con 0x7efc600b10b0 2021-11-15T19:33:54.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc58007300 con 0x7efc600b10b0 2021-11-15T19:33:54.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6015a060 con 0x7efc600b10b0 2021-11-15T19:33:54.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc60144870 con 0x7efc600b10b0 2021-11-15T19:33:54.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc600b0a70 con 0x7efc600b10b0 2021-11-15T19:33:54.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc58010030 con 0x7efc600b10b0 2021-11-15T19:33:54.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc440536a0 0x7efc44055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7efc5806b860 con 0x7efc600b10b0 2021-11-15T19:33:54.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc64c3b700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc440536a0 0x7efc44055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc64c3b700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc440536a0 0x7efc44055b60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7efc5000b000 tx=0x7efc50008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.153+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc580428b0 con 0x7efc600b10b0 2021-11-15T19:33:54.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.265+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efc600573d0 con 0x7efc600b10b0 2021-11-15T19:33:54.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc5dffb700 1 -- 172.21.2.137:0/614458522 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7efc58045ed0 con 0x7efc600b10b0 2021-11-15T19:33:54.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc440536a0 msgr2=0x7efc44055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc440536a0 0x7efc44055b60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7efc5000b000 tx=0x7efc50008040).stop 2021-11-15T19:33:54.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 msgr2=0x7efc601567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 0x7efc601567d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7efc60099bf0 tx=0x7efc58007dc0).stop 2021-11-15T19:33:54.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 shutdown_connections 2021-11-15T19:33:54.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efc440536a0 0x7efc44055b60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efc600b10b0 0x7efc601567d0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efc600b0610 0x7efc60149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 --2- 172.21.2.137:0/614458522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efc6005fd20 0x7efc600ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 >> 172.21.2.137:0/614458522 conn(0x7efc600b4e60 msgr2=0x7efc60147000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 shutdown_connections 2021-11-15T19:33:54.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.281+0000 7efc66e9f700 1 -- 172.21.2.137:0/614458522 wait complete. 2021-11-15T19:33:54.291 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:33:54.300 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:54.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 Processor -- start 2021-11-15T19:33:54.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- start start 2021-11-15T19:33:54.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdfb0147980 0x7fdfb00aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb0148190 con 0x7fdfb0144610 2021-11-15T19:33:54.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00b1720 con 0x7fdfb00b1340 2021-11-15T19:33:54.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00af800 con 0x7fdfb0147980 2021-11-15T19:33:54.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5064700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdfb00b1340 0x7fdfb0143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56310/0 (socket says 172.21.2.137:56310) 2021-11-15T19:33:54.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5064700 1 -- 172.21.2.137:0/4121909737 learned_addr learned my addr 172.21.2.137:0/4121909737 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:54.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5865700 1 --2- 172.21.2.137:0/4121909737 >> v2:172.21.2.137:3300/0 conn(0x7fdfb0147980 0x7fdfb00aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfa3fff700 1 -- 172.21.2.137:0/4121909737 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498862191 0 0) 0x7fdfb00b1720 con 0x7fdfb00b1340 2021-11-15T19:33:54.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfa3fff700 1 -- 172.21.2.137:0/4121909737 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf98003260 con 0x7fdfb00b1340 2021-11-15T19:33:54.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5865700 1 -- 172.21.2.137:0/4121909737 >> v1:172.21.2.137:6789/0 conn(0x7fdfb00b1340 legacy=0x7fdfb0143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5865700 1 -- 172.21.2.137:0/4121909737 >> v1:172.21.2.111:6789/0 conn(0x7fdfb0144610 legacy=0x7fdfb00a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5865700 1 -- 172.21.2.137:0/4121909737 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb005faf0 con 0x7fdfb0147980 2021-11-15T19:33:54.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb5865700 1 --2- 172.21.2.137:0/4121909737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb0147980 0x7fdfb00aa660 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fdfb0062250 tx=0x7fdfa80091d0).ready entity=mon.1 client_cookie=6b9d7c34b2167b4e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfa3fff700 1 -- 172.21.2.137:0/4121909737 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa800b680 con 0x7fdfb0147980 2021-11-15T19:33:54.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfa3fff700 1 -- 172.21.2.137:0/4121909737 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800b7e0 con 0x7fdfb0147980 2021-11-15T19:33:54.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfa3fff700 1 -- 172.21.2.137:0/4121909737 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa800b950 con 0x7fdfb0147980 2021-11-15T19:33:54.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- 172.21.2.137:0/4121909737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb0147980 msgr2=0x7fdfb00aa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/4121909737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb0147980 0x7fdfb00aa660 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fdfb0062250 tx=0x7fdfa80091d0).stop 2021-11-15T19:33:54.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- 172.21.2.137:0/4121909737 shutdown_connections 2021-11-15T19:33:54.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/4121909737 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb0147980 0x7fdfb00aa660 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.345+0000 7fdfb72c8700 1 -- 172.21.2.137:0/4121909737 >> 172.21.2.137:0/4121909737 conn(0x7fdfb00b4e60 msgr2=0x7fdfb00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- 172.21.2.137:0/4121909737 shutdown_connections 2021-11-15T19:33:54.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- 172.21.2.137:0/4121909737 wait complete. 2021-11-15T19:33:54.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 Processor -- start 2021-11-15T19:33:54.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- start start 2021-11-15T19:33:54.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 0x7fdfb009ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfb0144610 0x7fdfb00ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfb0147980 0x7fdfb0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0098490 con 0x7fdfb0144610 2021-11-15T19:33:54.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0099bf0 con 0x7fdfb00b1340 2021-11-15T19:33:54.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0099e20 con 0x7fdfb0147980 2021-11-15T19:33:54.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 0x7fdfb009ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 0x7fdfb009ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37534/0 (socket says 172.21.2.137:37534) 2021-11-15T19:33:54.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 -- 172.21.2.137:0/3197916988 learned_addr learned my addr 172.21.2.137:0/3197916988 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:54.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 -- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfb0147980 msgr2=0x7fdfb0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfb0147980 0x7fdfb0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 -- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfb0144610 msgr2=0x7fdfb00ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfb0144610 0x7fdfb00ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 -- 172.21.2.137:0/3197916988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009470 con 0x7fdfb00b1340 2021-11-15T19:33:54.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb5064700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 0x7fdfb009ab20 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fdfac001110 tx=0x7fdfac007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfac0070d0 con 0x7fdfb00b1340 2021-11-15T19:33:54.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac007230 con 0x7fdfb00b1340 2021-11-15T19:33:54.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb00ae250 con 0x7fdfb00b1340 2021-11-15T19:33:54.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfac005610 con 0x7fdfb00b1340 2021-11-15T19:33:54.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb014b240 con 0x7fdfb00b1340 2021-11-15T19:33:54.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb009a020 con 0x7fdfb00b1340 2021-11-15T19:33:54.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfac010070 con 0x7fdfb00b1340 2021-11-15T19:33:54.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfa27fc700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf900535b0 0x7fdf90055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.349+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdfac06b0b0 con 0x7fdfb00b1340 2021-11-15T19:33:54.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.353+0000 7fdfb4863700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf900535b0 0x7fdf90055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.353+0000 7fdfb4863700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf900535b0 0x7fdf90055a70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fdfa4002f90 tx=0x7fdfa40069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.353+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfac042100 con 0x7fdfb00b1340 2021-11-15T19:33:54.411 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:54.414 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:54.417 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:54.421 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:54.424 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:33:54.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.461+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb009a530 con 0x7fdfb00b1340 2021-11-15T19:33:54.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.461+0000 7fdfa27fc700 1 -- 172.21.2.137:0/3197916988 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fdfac045720 con 0x7fdfb00b1340 2021-11-15T19:33:54.473 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:54.473 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:33:53.363248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6892":{"gid":6892,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3296577708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3296577708},{"type":"v1","addr":"172.21.2.137:6833","nonce":3296577708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:33:54.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf900535b0 msgr2=0x7fdf90055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf900535b0 0x7fdf90055a70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fdfa4002f90 tx=0x7fdfa40069b0).stop 2021-11-15T19:33:54.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 msgr2=0x7fdfb009ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 0x7fdfb009ab20 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fdfac001110 tx=0x7fdfac007aa0).stop 2021-11-15T19:33:54.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 shutdown_connections 2021-11-15T19:33:54.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf900535b0 0x7fdf90055a70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdfb0147980 0x7fdfb0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdfb0144610 0x7fdfb00ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 --2- 172.21.2.137:0/3197916988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdfb00b1340 0x7fdfb009ab20 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 >> 172.21.2.137:0/3197916988 conn(0x7fdfb00b4e60 msgr2=0x7fdfb0142f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 shutdown_connections 2021-11-15T19:33:54.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.465+0000 7fdfb72c8700 1 -- 172.21.2.137:0/3197916988 wait complete. 2021-11-15T19:33:54.477 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 44 2021-11-15T19:33:54.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:33:52.357259+0000', 'modified': '2021-11-15T19:33:53.363248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6892}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6892': {'gid': 6892, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/3296577708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 3296577708}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 3296577708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:54.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:54.682 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:54.746 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6892,"want_state":"up:active","state":"up:active","rank_uptime":2.3763005929999999,"mdsmap_epoch":44,"osdmap_epoch":93,"osdmap_epoch_barrier":93,"uptime":6.5871351950000001} 2021-11-15T19:33:54.746 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6892, "mdsmap_epoch": 44, "osdmap_epoch": 93, "osdmap_epoch_barrier": 93, "rank_uptime": 2.376300593, "state": "up:active", "uptime": 6.587135195, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:54.747 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:54.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.785+0000 7f1434c51700 1 Processor -- start 2021-11-15T19:33:54.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.785+0000 7f1434c51700 1 -- start start 2021-11-15T19:33:54.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f1434c51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300adda0 0x7f143005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f1434c51700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f143005d220 0x7f1430143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f1434c51700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1430067b90 con 0x7f14300b00a0 2021-11-15T19:33:54.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f1434c51700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300ae730 con 0x7f143005d220 2021-11-15T19:33:54.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f1434c51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300ae490 con 0x7f14300adda0 2021-11-15T19:33:54.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142e59c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300adda0 0x7f143005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142ed9d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f143005d220 0x7f1430143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142dd9b700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f14300b00a0 0x7f143005c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:48816/0 (socket says 172.21.2.137:48816) 2021-11-15T19:33:54.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142dd9b700 1 -- 172.21.2.137:0/3458189936 learned_addr learned my addr 172.21.2.137:0/3458189936 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:54.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142e59c700 1 -- 172.21.2.137:0/3458189936 >> v2:172.21.2.111:3300/0 conn(0x7f143005d220 msgr2=0x7f1430143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142e59c700 1 --2- 172.21.2.137:0/3458189936 >> v2:172.21.2.111:3300/0 conn(0x7f143005d220 0x7f1430143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142e59c700 1 -- 172.21.2.137:0/3458189936 >> v1:172.21.2.111:6789/0 conn(0x7f14300b00a0 legacy=0x7f143005c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142e59c700 1 -- 172.21.2.137:0/3458189936 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300b0880 con 0x7f14300adda0 2021-11-15T19:33:54.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.789+0000 7f142e59c700 1 --2- 172.21.2.137:0/3458189936 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300adda0 0x7f143005bd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1418002f70 tx=0x7f1418006df0).ready entity=mon.2 client_cookie=18143c6150c2c6e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142d59a700 1 -- 172.21.2.137:0/3458189936 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141800d570 con 0x7f14300adda0 2021-11-15T19:33:54.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142d59a700 1 -- 172.21.2.137:0/3458189936 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1418000e90 con 0x7f14300adda0 2021-11-15T19:33:54.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142d59a700 1 -- 172.21.2.137:0/3458189936 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141800d8c0 con 0x7f14300adda0 2021-11-15T19:33:54.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3458189936 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300adda0 msgr2=0x7f143005bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 --2- 172.21.2.137:0/3458189936 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300adda0 0x7f143005bd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1418002f70 tx=0x7f1418006df0).stop 2021-11-15T19:33:54.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3458189936 shutdown_connections 2021-11-15T19:33:54.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 --2- 172.21.2.137:0/3458189936 >> v2:172.21.2.111:3300/0 conn(0x7f143005d220 0x7f1430143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 --2- 172.21.2.137:0/3458189936 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300adda0 0x7f143005bd20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3458189936 >> 172.21.2.137:0/3458189936 conn(0x7f14300630f0 msgr2=0x7f14300634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3458189936 shutdown_connections 2021-11-15T19:33:54.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3458189936 wait complete. 2021-11-15T19:33:54.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 Processor -- start 2021-11-15T19:33:54.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- start start 2021-11-15T19:33:54.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 0x7f1430156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14300adda0 0x7f14300b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300b00a0 0x7f1430153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430159950 con 0x7f14300adda0 2021-11-15T19:33:54.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143011c700 con 0x7f143005d220 2021-11-15T19:33:54.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143011c9a0 con 0x7f14300b00a0 2021-11-15T19:33:54.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 0x7f1430156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 0x7f1430156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37548/0 (socket says 172.21.2.137:37548) 2021-11-15T19:33:54.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 -- 172.21.2.137:0/3298718212 learned_addr learned my addr 172.21.2.137:0/3298718212 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:54.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142ed9d700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300b00a0 0x7f1430153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142dd9b700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14300adda0 0x7f14300b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 -- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300b00a0 msgr2=0x7f1430153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300b00a0 0x7f1430153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 -- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14300adda0 msgr2=0x7f14300b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14300adda0 0x7f14300b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 -- 172.21.2.137:0/3298718212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141800b180 con 0x7f143005d220 2021-11-15T19:33:54.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142e59c700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 0x7f1430156350 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f1418002f70 tx=0x7f1418014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1418016070 con 0x7f143005d220 2021-11-15T19:33:54.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800de40 con 0x7f143005d220 2021-11-15T19:33:54.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141801e450 con 0x7f143005d220 2021-11-15T19:33:54.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1430110010 con 0x7f143005d220 2021-11-15T19:33:54.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143010fbd0 con 0x7f143005d220 2021-11-15T19:33:54.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1430159ac0 con 0x7f143005d220 2021-11-15T19:33:54.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f141800f030 con 0x7f143005d220 2021-11-15T19:33:54.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1414053610 0x7f1414055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f141806c6d0 con 0x7f143005d220 2021-11-15T19:33:54.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142dd9b700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1414053610 0x7f1414055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f142dd9b700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1414053610 0x7f1414055ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f142000b000 tx=0x7f1420009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.797+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1430159ac0 con 0x7f143005d220 2021-11-15T19:33:54.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1430159ac0 con 0x7f143005d220 2021-11-15T19:33:54.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f14277fe700 1 -- 172.21.2.137:0/3298718212 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f1430159ac0 con 0x7f143005d220 2021-11-15T19:33:54.891 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:54.891 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":93,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:53.361674+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:50.260810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:51.357957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:54.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1414053610 msgr2=0x7f1414055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1414053610 0x7f1414055ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f142000b000 tx=0x7f1420009040).stop 2021-11-15T19:33:54.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 msgr2=0x7f1430156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 0x7f1430156350 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f1418002f70 tx=0x7f1418014000).stop 2021-11-15T19:33:54.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 shutdown_connections 2021-11-15T19:33:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1414053610 0x7f1414055ad0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14300b00a0 0x7f1430153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14300adda0 0x7f14300b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 --2- 172.21.2.137:0/3298718212 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f143005d220 0x7f1430156350 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 >> 172.21.2.137:0/3298718212 conn(0x7f14300630f0 msgr2=0x7f14300b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 shutdown_connections 2021-11-15T19:33:54.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.881+0000 7f1434c51700 1 -- 172.21.2.137:0/3298718212 wait complete. 2021-11-15T19:33:54.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:33:50.260810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:33:51.357957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:33:54.899 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:54.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3efd77e700 1 Processor -- start 2021-11-15T19:33:54.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3efd77e700 1 -- start start 2021-11-15T19:33:54.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3efd77e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ef80acd60 0x7f3ef80b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3efd77e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80b76c0 con 0x7f3ef80b72e0 2021-11-15T19:33:54.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3efd77e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef812a170 con 0x7f3ef80b4680 2021-11-15T19:33:54.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3efd77e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b3100 con 0x7f3ef80acd60 2021-11-15T19:33:54.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3ef77fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3ef80b4680 0x7f3ef81290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56342/0 (socket says 172.21.2.137:56342) 2021-11-15T19:33:54.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3ef77fe700 1 -- 172.21.2.137:0/929173403 learned_addr learned my addr 172.21.2.137:0/929173403 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:54.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625159734 0 0) 0x7f3ef812a170 con 0x7f3ef80b4680 2021-11-15T19:33:54.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.941+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003260 con 0x7f3ef80b4680 2021-11-15T19:33:54.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2655057786 0 0) 0x7f3ed8003260 con 0x7f3ef80b4680 2021-11-15T19:33:54.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ef80acd60 msgr2=0x7f3ef80b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ef80acd60 0x7f3ef80b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 >> v1:172.21.2.111:6789/0 conn(0x7f3ef80b72e0 legacy=0x7f3ef80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80ad8a0 con 0x7f3ef80b4680 2021-11-15T19:33:54.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3ef00019e0 con 0x7f3ef80b4680 2021-11-15T19:33:54.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 >> v1:172.21.2.137:6789/0 conn(0x7f3ef80b4680 legacy=0x7f3ef81290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ed80037d0 0x7f3ed8003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ed8004500 0x7f3ed8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ef80acd60 0x7f3ed800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b3100 con 0x7f3ed80037d0 2021-11-15T19:33:54.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8005310 con 0x7f3ed8004500 2021-11-15T19:33:54.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800bc40 con 0x7f3ef80acd60 2021-11-15T19:33:54.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ed8004500 0x7f3ed8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef6ffd700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ed80037d0 0x7f3ed8003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 -- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ef80acd60 msgr2=0x7f3ed800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ef80acd60 0x7f3ed800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 -- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ed80037d0 msgr2=0x7f3ed8003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:54.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ed80037d0 0x7f3ed8003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:54.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 -- 172.21.2.137:0/929173403 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8003260 con 0x7f3ed8004500 2021-11-15T19:33:54.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef67fc700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ed8004500 0x7f3ed8004980 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f3ed80054d0 tx=0x7f3ee0006ca0).ready entity=mon.1 client_cookie=881daf9b8973ac9d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0012410 con 0x7f3ed8004500 2021-11-15T19:33:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0012570 con 0x7f3ed8004500 2021-11-15T19:33:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef5ffb700 1 -- 172.21.2.137:0/929173403 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee00128d0 con 0x7f3ed8004500 2021-11-15T19:33:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- 172.21.2.137:0/929173403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ed8004500 msgr2=0x7f3ed8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 --2- 172.21.2.137:0/929173403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ed8004500 0x7f3ed8004980 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f3ed80054d0 tx=0x7f3ee0006ca0).stop 2021-11-15T19:33:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 -- 172.21.2.137:0/929173403 reap_dead start 2021-11-15T19:33:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- 172.21.2.137:0/929173403 shutdown_connections 2021-11-15T19:33:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- 172.21.2.137:0/929173403 >> 172.21.2.137:0/929173403 conn(0x7f3ef8064960 msgr2=0x7f3ef8064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- 172.21.2.137:0/929173403 shutdown_connections 2021-11-15T19:33:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- 172.21.2.137:0/929173403 wait complete. 2021-11-15T19:33:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 Processor -- start 2021-11-15T19:33:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- start start 2021-11-15T19:33:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ed8004500 0x7f3ef80af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ef80afae0 0x7f3ef8066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 0x7f3ef8066700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b20c0 con 0x7f3ef80afae0 2021-11-15T19:33:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80ae8a0 con 0x7f3ef8142c80 2021-11-15T19:33:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3efd77e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b0840 con 0x7f3ed8004500 2021-11-15T19:33:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 0x7f3ef8066700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 0x7f3ef8066700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37570/0 (socket says 172.21.2.137:37570) 2021-11-15T19:33:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 -- 172.21.2.137:0/3851007559 learned_addr learned my addr 172.21.2.137:0/3851007559 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 -- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ed8004500 msgr2=0x7f3ef80af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ed8004500 0x7f3ef80af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 -- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ef80afae0 msgr2=0x7f3ef8066210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:54.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ef80afae0 0x7f3ef8066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:54.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 -- 172.21.2.137:0/3851007559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80b0ee0 con 0x7f3ef8142c80 2021-11-15T19:33:54.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.945+0000 7f3ef77fe700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 0x7f3ef8066700 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f3ef8142290 tx=0x7f3ef80ada30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef0004ab0 con 0x7f3ef8142c80 2021-11-15T19:33:54.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0004c10 con 0x7f3ef8142c80 2021-11-15T19:33:54.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef0007170 con 0x7f3ef8142c80 2021-11-15T19:33:54.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef8141ff0 con 0x7f3ef8142c80 2021-11-15T19:33:54.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef8066bf0 con 0x7f3ef8142c80 2021-11-15T19:33:54.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef80b3a50 con 0x7f3ef8142c80 2021-11-15T19:33:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ef00072d0 con 0x7f3ef8142c80 2021-11-15T19:33:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3edc053600 0x7f3edc055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3ef006b490 con 0x7f3ef8142c80 2021-11-15T19:33:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3ef6ffd700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3edc053600 0x7f3edc055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:54.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3ef6ffd700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3edc053600 0x7f3edc055ac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f3ee800b000 tx=0x7f3ee8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:54.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:54.949+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ef00425f0 con 0x7f3ef8142c80 2021-11-15T19:33:55.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3ef80573d0 con 0x7f3ef8142c80 2021-11-15T19:33:55.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3eeffff700 1 -- 172.21.2.137:0/3851007559 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v93) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3ef0045c10 con 0x7f3ef8142c80 2021-11-15T19:33:55.042 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:55.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3edc053600 msgr2=0x7f3edc055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3edc053600 0x7f3edc055ac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f3ee800b000 tx=0x7f3ee8009040).stop 2021-11-15T19:33:55.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 msgr2=0x7f3ef8066700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 0x7f3ef8066700 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f3ef8142290 tx=0x7f3ef80ada30).stop 2021-11-15T19:33:55.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 shutdown_connections 2021-11-15T19:33:55.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3edc053600 0x7f3edc055ac0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ef8142c80 0x7f3ef8066700 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ef80afae0 0x7f3ef8066210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 --2- 172.21.2.137:0/3851007559 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ed8004500 0x7f3ef80af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 >> 172.21.2.137:0/3851007559 conn(0x7f3ef8064960 msgr2=0x7f3ef80629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 shutdown_connections 2021-11-15T19:33:55.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.033+0000 7f3efd77e700 1 -- 172.21.2.137:0/3851007559 wait complete. 2021-11-15T19:33:55.049 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:55.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 Processor -- start 2021-11-15T19:33:55.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- start start 2021-11-15T19:33:55.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1aa405c770 0x7f1aa40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1aa40b0550 0x7f1aa414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40b1650 con 0x7f1aa405c770 2021-11-15T19:33:55.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa405cb50 con 0x7f1aa40b0550 2021-11-15T19:33:55.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40ad030 con 0x7f1aa414aaa0 2021-11-15T19:33:55.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1aa40b0550 0x7f1aa414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1aa40b0550 0x7f1aa414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37580/0 (socket says 172.21.2.137:37580) 2021-11-15T19:33:55.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 -- 172.21.2.137:0/3567567412 learned_addr learned my addr 172.21.2.137:0/3567567412 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:55.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 -- 172.21.2.137:0/3567567412 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 msgr2=0x7f1aa4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 --2- 172.21.2.137:0/3567567412 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 -- 172.21.2.137:0/3567567412 >> v2:172.21.2.111:3300/0 conn(0x7f1aa405c770 msgr2=0x7f1aa40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 --2- 172.21.2.137:0/3567567412 >> v2:172.21.2.111:3300/0 conn(0x7f1aa405c770 0x7f1aa40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 -- 172.21.2.137:0/3567567412 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40ad2d0 con 0x7f1aa40b0550 2021-11-15T19:33:55.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aa8878700 1 --2- 172.21.2.137:0/3567567412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa40b0550 0x7f1aa414a5b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f1a98002f70 tx=0x7f1a98006eb0).ready entity=mon.1 client_cookie=f663f7d460be43a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1a97fff700 1 -- 172.21.2.137:0/3567567412 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800d570 con 0x7f1aa40b0550 2021-11-15T19:33:55.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1a97fff700 1 -- 172.21.2.137:0/3567567412 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98000e90 con 0x7f1aa40b0550 2021-11-15T19:33:55.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1a97fff700 1 -- 172.21.2.137:0/3567567412 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800d900 con 0x7f1aa40b0550 2021-11-15T19:33:55.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3567567412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa40b0550 msgr2=0x7f1aa414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3567567412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa40b0550 0x7f1aa414a5b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f1a98002f70 tx=0x7f1a98006eb0).stop 2021-11-15T19:33:55.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3567567412 shutdown_connections 2021-11-15T19:33:55.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3567567412 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa4140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3567567412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa40b0550 0x7f1aa414a5b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3567567412 >> v2:172.21.2.111:3300/0 conn(0x7f1aa405c770 0x7f1aa40aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3567567412 >> 172.21.2.137:0/3567567412 conn(0x7f1aa40631e0 msgr2=0x7f1aa405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3567567412 shutdown_connections 2021-11-15T19:33:55.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.093+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3567567412 wait complete. 2021-11-15T19:33:55.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 Processor -- start 2021-11-15T19:33:55.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- start start 2021-11-15T19:33:55.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 0x7f1aa4145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1aa40b0550 0x7f1aa40669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4146d80 con 0x7f1aa40b0550 2021-11-15T19:33:55.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4144c20 con 0x7f1aa405c770 2021-11-15T19:33:55.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4144ec0 con 0x7f1aa414aaa0 2021-11-15T19:33:55.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 0x7f1aa4145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 0x7f1aa4145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37586/0 (socket says 172.21.2.137:37586) 2021-11-15T19:33:55.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 -- 172.21.2.137:0/3237382277 learned_addr learned my addr 172.21.2.137:0/3237382277 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:55.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa987a700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 -- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 msgr2=0x7f1aa413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa413fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 -- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1aa40b0550 msgr2=0x7f1aa40669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1aa40b0550 0x7f1aa40669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 -- 172.21.2.137:0/3237382277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9800b1e0 con 0x7f1aa405c770 2021-11-15T19:33:55.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa9079700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 0x7f1aa4145c20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f1aa0002f70 tx=0x7f1aa0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0013460 con 0x7f1aa405c770 2021-11-15T19:33:55.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa00135c0 con 0x7f1aa405c770 2021-11-15T19:33:55.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0013920 con 0x7f1aa405c770 2021-11-15T19:33:55.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4145160 con 0x7f1aa405c770 2021-11-15T19:33:55.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4159be0 con 0x7f1aa405c770 2021-11-15T19:33:55.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa40ae7f0 con 0x7f1aa405c770 2021-11-15T19:33:55.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1aa001a060 con 0x7f1aa405c770 2021-11-15T19:33:55.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1a967fc700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a840535d0 0x7f1a84055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1aa006b570 con 0x7f1aa405c770 2021-11-15T19:33:55.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.097+0000 7f1aa8878700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a840535d0 0x7f1a84055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.101+0000 7f1aa8878700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a840535d0 0x7f1a84055a90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f1a98002f70 tx=0x7f1a98015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.101+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1aa00425c0 con 0x7f1aa405c770 2021-11-15T19:33:55.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1aa40573d0 con 0x7f1aa405c770 2021-11-15T19:33:55.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1a967fc700 1 -- 172.21.2.137:0/3237382277 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1aa0018020 con 0x7f1aa405c770 2021-11-15T19:33:55.195 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:55.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a840535d0 msgr2=0x7f1a84055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a840535d0 0x7f1a84055a90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f1a98002f70 tx=0x7f1a98015000).stop 2021-11-15T19:33:55.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 msgr2=0x7f1aa4145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 0x7f1aa4145c20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f1aa0002f70 tx=0x7f1aa0006ec0).stop 2021-11-15T19:33:55.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 shutdown_connections 2021-11-15T19:33:55.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a840535d0 0x7f1a84055a90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1aa414aaa0 0x7f1aa413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1aa40b0550 0x7f1aa40669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 --2- 172.21.2.137:0/3237382277 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1aa405c770 0x7f1aa4145c20 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 >> 172.21.2.137:0/3237382277 conn(0x7f1aa40631e0 msgr2=0x7f1aa40b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 shutdown_connections 2021-11-15T19:33:55.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.185+0000 7f1aab2dd700 1 -- 172.21.2.137:0/3237382277 wait complete. 2021-11-15T19:33:55.202 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:33:55.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 Processor -- start 2021-11-15T19:33:55.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- start start 2021-11-15T19:33:55.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffbac13f390 0x7ffbac14a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac0acf30 con 0x7ffbac0adc30 2021-11-15T19:33:55.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac13f7b0 con 0x7ffbac0ac910 2021-11-15T19:33:55.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac05c5b0 con 0x7ffbac13f390 2021-11-15T19:33:55.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbabfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ffbac0ac910 0x7ffbac13ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56374/0 (socket says 172.21.2.137:56374) 2021-11-15T19:33:55.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbabfff700 1 -- 172.21.2.137:0/3015276647 learned_addr learned my addr 172.21.2.137:0/3015276647 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:55.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb178b700 1 --2- 172.21.2.137:0/3015276647 >> v2:172.21.2.137:3300/0 conn(0x7ffbac13f390 0x7ffbac14a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb178b700 1 -- 172.21.2.137:0/3015276647 >> v1:172.21.2.137:6789/0 conn(0x7ffbac0ac910 legacy=0x7ffbac13ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb178b700 1 -- 172.21.2.137:0/3015276647 >> v1:172.21.2.111:6789/0 conn(0x7ffbac0adc30 legacy=0x7ffbac0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb178b700 1 -- 172.21.2.137:0/3015276647 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac064590 con 0x7ffbac13f390 2021-11-15T19:33:55.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb178b700 1 --2- 172.21.2.137:0/3015276647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac13f390 0x7ffbac14a270 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7ffbac062170 tx=0x7ffba40091d0).ready entity=mon.1 client_cookie=74815d0ee0055316 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbab7fe700 1 -- 172.21.2.137:0/3015276647 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffba4009ea0 con 0x7ffbac13f390 2021-11-15T19:33:55.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbab7fe700 1 -- 172.21.2.137:0/3015276647 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba400b830 con 0x7ffbac13f390 2021-11-15T19:33:55.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbab7fe700 1 -- 172.21.2.137:0/3015276647 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffba400b9a0 con 0x7ffbac13f390 2021-11-15T19:33:55.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3015276647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac13f390 msgr2=0x7ffbac14a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3015276647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac13f390 0x7ffbac14a270 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7ffbac062170 tx=0x7ffba40091d0).stop 2021-11-15T19:33:55.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3015276647 shutdown_connections 2021-11-15T19:33:55.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3015276647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac13f390 0x7ffbac14a270 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3015276647 >> 172.21.2.137:0/3015276647 conn(0x7ffbac0631e0 msgr2=0x7ffbac05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3015276647 shutdown_connections 2021-11-15T19:33:55.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.245+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3015276647 wait complete. 2021-11-15T19:33:55.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 Processor -- start 2021-11-15T19:33:55.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- start start 2021-11-15T19:33:55.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 0x7ffbac13e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbac0adc30 0x7ffbac13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbac13f390 0x7ffbac13c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15a680 con 0x7ffbac13f390 2021-11-15T19:33:55.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac064a10 con 0x7ffbac0ac910 2021-11-15T19:33:55.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac05c2e0 con 0x7ffbac0adc30 2021-11-15T19:33:55.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 0x7ffbac13e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 0x7ffbac13e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37598/0 (socket says 172.21.2.137:37598) 2021-11-15T19:33:55.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 -- 172.21.2.137:0/3977963988 learned_addr learned my addr 172.21.2.137:0/3977963988 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:55.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 -- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbac0adc30 msgr2=0x7ffbac13bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbac0adc30 0x7ffbac13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 -- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbac13f390 msgr2=0x7ffbac13c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb178b700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbac13f390 0x7ffbac13c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbac13f390 0x7ffbac13c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 -- 172.21.2.137:0/3977963988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4009470 con 0x7ffbac0ac910 2021-11-15T19:33:55.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb0f8a700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 0x7ffbac13e170 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7ffb9c002f90 tx=0x7ffb9c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9c013460 con 0x7ffbac0ac910 2021-11-15T19:33:55.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c0135c0 con 0x7ffbac0ac910 2021-11-15T19:33:55.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac15a880 con 0x7ffbac0ac910 2021-11-15T19:33:55.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac066e60 con 0x7ffbac0ac910 2021-11-15T19:33:55.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9c013920 con 0x7ffbac0ac910 2021-11-15T19:33:55.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac15ac30 con 0x7ffbac0ac910 2021-11-15T19:33:55.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb9c01a060 con 0x7ffbac0ac910 2021-11-15T19:33:55.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffba9ffb700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb90053540 0x7ffb90055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ffb9c06b3d0 con 0x7ffbac0ac910 2021-11-15T19:33:55.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.249+0000 7ffbabfff700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb90053540 0x7ffb90055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.253+0000 7ffbabfff700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb90053540 0x7ffb90055a00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ffbac0621b0 tx=0x7ffb94007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.253+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb9c042420 con 0x7ffbac0ac910 2021-11-15T19:33:55.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.333+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbac0675a0 con 0x7ffbac0ac910 2021-11-15T19:33:55.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.333+0000 7ffba9ffb700 1 -- 172.21.2.137:0/3977963988 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+10 (secure 0 0 0) 0x7ffbac0675a0 con 0x7ffbac0ac910 2021-11-15T19:33:55.345 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:55.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb90053540 msgr2=0x7ffb90055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb90053540 0x7ffb90055a00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ffbac0621b0 tx=0x7ffb94007800).stop 2021-11-15T19:33:55.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 msgr2=0x7ffbac13e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 0x7ffbac13e170 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7ffb9c002f90 tx=0x7ffb9c006df0).stop 2021-11-15T19:33:55.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 shutdown_connections 2021-11-15T19:33:55.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb90053540 0x7ffb90055a00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbac13f390 0x7ffbac13c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbac0adc30 0x7ffbac13bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 --2- 172.21.2.137:0/3977963988 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbac0ac910 0x7ffbac13e170 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 >> 172.21.2.137:0/3977963988 conn(0x7ffbac0631e0 msgr2=0x7ffbac0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 shutdown_connections 2021-11-15T19:33:55.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.337+0000 7ffbb31ee700 1 -- 172.21.2.137:0/3977963988 wait complete. 2021-11-15T19:33:55.352 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:33:55.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.393+0000 7f363ff87700 1 Processor -- start 2021-11-15T19:33:55.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.393+0000 7f363ff87700 1 -- start start 2021-11-15T19:33:55.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f36380b0550 0x7f363814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 0x7f3638140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363805cb50 con 0x7f363805c770 2021-11-15T19:33:55.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36380b1650 con 0x7f36380b0550 2021-11-15T19:33:55.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36380ad030 con 0x7f363814aaa0 2021-11-15T19:33:55.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363dd23700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f363805c770 0x7f36380aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56384/0 (socket says 172.21.2.137:56384) 2021-11-15T19:33:55.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363dd23700 1 -- 172.21.2.137:0/2966298712 learned_addr learned my addr 172.21.2.137:0/2966298712 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:55.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917769995 0 0) 0x7f363805cb50 con 0x7f363805c770 2021-11-15T19:33:55.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f361c003260 con 0x7f363805c770 2021-11-15T19:33:55.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2604669011 0 0) 0x7f361c003260 con 0x7f363805c770 2021-11-15T19:33:55.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 msgr2=0x7f3638140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363e524700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 0x7f3638140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 --2- 172.21.2.137:0/2966298712 >> v2:172.21.2.111:3300/0 conn(0x7f36380b0550 0x7f363814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 0x7f3638140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 >> v2:172.21.2.111:3300/0 conn(0x7f36380b0550 msgr2=0x7f363814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 --2- 172.21.2.137:0/2966298712 >> v2:172.21.2.111:3300/0 conn(0x7f36380b0550 0x7f363814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36380ad2d0 con 0x7f363805c770 2021-11-15T19:33:55.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3634001660 con 0x7f363805c770 2021-11-15T19:33:55.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 >> v1:172.21.2.137:6789/0 conn(0x7f363805c770 legacy=0x7f36380aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 0x7f361c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f361c003e90 0x7f361c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c004b10 0x7f361c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36380b1650 con 0x7f361c004b10 2021-11-15T19:33:55.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36380ad030 con 0x7f361c003e90 2021-11-15T19:33:55.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c00ba60 con 0x7f363814aaa0 2021-11-15T19:33:55.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f361c003e90 0x7f361c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 -- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 msgr2=0x7f361c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f363814aaa0 0x7f361c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 -- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c004b10 msgr2=0x7f361c004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c004b10 0x7f361c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 -- 172.21.2.137:0/2966298712 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36380ad2d0 con 0x7f361c003e90 2021-11-15T19:33:55.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363d522700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f361c003e90 0x7f361c004500 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f362c007000 tx=0x7f362c008040).ready entity=mon.1 client_cookie=ad5f2f5dd2c38a33 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f362c012470 con 0x7f361c003e90 2021-11-15T19:33:55.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00c030 con 0x7f361c003e90 2021-11-15T19:33:55.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363cd21700 1 -- 172.21.2.137:0/2966298712 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f362c0127c0 con 0x7f361c003e90 2021-11-15T19:33:55.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- 172.21.2.137:0/2966298712 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f361c003e90 msgr2=0x7f361c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 --2- 172.21.2.137:0/2966298712 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f361c003e90 0x7f361c004500 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f362c007000 tx=0x7f362c008040).stop 2021-11-15T19:33:55.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363e524700 1 -- 172.21.2.137:0/2966298712 reap_dead start 2021-11-15T19:33:55.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- 172.21.2.137:0/2966298712 shutdown_connections 2021-11-15T19:33:55.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- 172.21.2.137:0/2966298712 >> 172.21.2.137:0/2966298712 conn(0x7f36380631e0 msgr2=0x7f363805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- 172.21.2.137:0/2966298712 shutdown_connections 2021-11-15T19:33:55.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- 172.21.2.137:0/2966298712 wait complete. 2021-11-15T19:33:55.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 Processor -- start 2021-11-15T19:33:55.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- start start 2021-11-15T19:33:55.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c003e90 0x7f36381475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3638066a40 0x7f3638146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 0x7f3638157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3638143270 con 0x7f361c003e90 2021-11-15T19:33:55.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3638142d30 con 0x7f3638156ba0 2021-11-15T19:33:55.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.397+0000 7f363ff87700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3638142fd0 con 0x7f3638066a40 2021-11-15T19:33:55.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 0x7f3638157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 0x7f3638157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37618/0 (socket says 172.21.2.137:37618) 2021-11-15T19:33:55.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 -- 172.21.2.137:0/2115380468 learned_addr learned my addr 172.21.2.137:0/2115380468 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:55.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 -- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3638066a40 msgr2=0x7f3638146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3638066a40 0x7f3638146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 -- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c003e90 msgr2=0x7f36381475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c003e90 0x7f36381475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 -- 172.21.2.137:0/2115380468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638157510 con 0x7f3638156ba0 2021-11-15T19:33:55.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363e524700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 0x7f3638157020 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f3634001840 tx=0x7f3630008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3630010580 con 0x7f3638156ba0 2021-11-15T19:33:55.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36300106e0 con 0x7f3638156ba0 2021-11-15T19:33:55.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36381565f0 con 0x7f3638156ba0 2021-11-15T19:33:55.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3630010a40 con 0x7f3638156ba0 2021-11-15T19:33:55.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363815a030 con 0x7f3638156ba0 2021-11-15T19:33:55.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36380ae7f0 con 0x7f3638156ba0 2021-11-15T19:33:55.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3630010ba0 con 0x7f3638156ba0 2021-11-15T19:33:55.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f362affd700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f36200535b0 0x7f3620055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f363006b9e0 con 0x7f3638156ba0 2021-11-15T19:33:55.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363dd23700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f36200535b0 0x7f3620055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.401+0000 7f363dd23700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f36200535b0 0x7f3620055a70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3634001370 tx=0x7f36340015f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.405+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3630042b40 con 0x7f3638156ba0 2021-11-15T19:33:55.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36380573d0 con 0x7f3638156ba0 2021-11-15T19:33:55.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f362affd700 1 -- 172.21.2.137:0/2115380468 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3630046160 con 0x7f3638156ba0 2021-11-15T19:33:55.498 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:55.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f36200535b0 msgr2=0x7f3620055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f36200535b0 0x7f3620055a70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3634001370 tx=0x7f36340015f0).stop 2021-11-15T19:33:55.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 msgr2=0x7f3638157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 0x7f3638157020 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f3634001840 tx=0x7f3630008040).stop 2021-11-15T19:33:55.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 shutdown_connections 2021-11-15T19:33:55.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f36200535b0 0x7f3620055a70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3638156ba0 0x7f3638157020 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3638066a40 0x7f3638146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 --2- 172.21.2.137:0/2115380468 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f361c003e90 0x7f36381475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 >> 172.21.2.137:0/2115380468 conn(0x7f36380631e0 msgr2=0x7f36381403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 shutdown_connections 2021-11-15T19:33:55.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.489+0000 7f363ff87700 1 -- 172.21.2.137:0/2115380468 wait complete. 2021-11-15T19:33:55.505 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:33:55.506 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:55.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.545+0000 7f9b896a6700 1 Processor -- start 2021-11-15T19:33:55.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.545+0000 7f9b896a6700 1 -- start start 2021-11-15T19:33:55.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9b84144610 0x7f9b84147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840a9f50 0x7f9b840aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b84148190 con 0x7f9b840b1340 2021-11-15T19:33:55.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840b1720 con 0x7f9b84144610 2021-11-15T19:33:55.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84147e70 con 0x7f9b840a9f50 2021-11-15T19:33:55.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9b840b1340 0x7f9b84143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56404/0 (socket says 172.21.2.137:56404) 2021-11-15T19:33:55.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 -- 172.21.2.137:0/3923402629 learned_addr learned my addr 172.21.2.137:0/3923402629 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:55.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b827fc700 1 --2- 172.21.2.137:0/3923402629 >> v2:172.21.2.137:3300/0 conn(0x7f9b84144610 0x7f9b84147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b827fc700 1 -- 172.21.2.137:0/3923402629 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840a9f50 msgr2=0x7f9b840aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:55.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b827fc700 1 --2- 172.21.2.137:0/3923402629 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840a9f50 0x7f9b840aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b827fc700 1 -- 172.21.2.137:0/3923402629 >> v1:172.21.2.137:6789/0 conn(0x7f9b840b1340 legacy=0x7f9b84143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b827fc700 1 -- 172.21.2.137:0/3923402629 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840af800 con 0x7f9b84144610 2021-11-15T19:33:55.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b827fc700 1 --2- 172.21.2.137:0/3923402629 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b84144610 0x7f9b84147980 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f9b78002f70 tx=0x7f9b78006df0).ready entity=mon.1 client_cookie=dbdde7b59bba8ea1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b81ffb700 1 -- 172.21.2.137:0/3923402629 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7800d570 con 0x7f9b84144610 2021-11-15T19:33:55.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b81ffb700 1 -- 172.21.2.137:0/3923402629 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78000e90 con 0x7f9b84144610 2021-11-15T19:33:55.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b81ffb700 1 -- 172.21.2.137:0/3923402629 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7800d8c0 con 0x7f9b84144610 2021-11-15T19:33:55.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/3923402629 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b84144610 msgr2=0x7f9b84147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- 172.21.2.137:0/3923402629 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b84144610 0x7f9b84147980 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f9b78002f70 tx=0x7f9b78006df0).stop 2021-11-15T19:33:55.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/3923402629 shutdown_connections 2021-11-15T19:33:55.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- 172.21.2.137:0/3923402629 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b84144610 0x7f9b84147980 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- 172.21.2.137:0/3923402629 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840a9f50 0x7f9b840aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/3923402629 >> 172.21.2.137:0/3923402629 conn(0x7f9b840b4e60 msgr2=0x7f9b840b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/3923402629 shutdown_connections 2021-11-15T19:33:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/3923402629 wait complete. 2021-11-15T19:33:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 Processor -- start 2021-11-15T19:33:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- start start 2021-11-15T19:33:55.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 0x7f9b840ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840b1340 0x7f9b8415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b84144610 0x7f9b8415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84140660 con 0x7f9b84144610 2021-11-15T19:33:55.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840b3cf0 con 0x7f9b840a9f50 2021-11-15T19:33:55.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b841403c0 con 0x7f9b840b1340 2021-11-15T19:33:55.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 0x7f9b840ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 0x7f9b840ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37632/0 (socket says 172.21.2.137:37632) 2021-11-15T19:33:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 -- 172.21.2.137:0/589971476 learned_addr learned my addr 172.21.2.137:0/589971476 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 -- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840b1340 msgr2=0x7f9b8415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840b1340 0x7f9b8415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 -- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b84144610 msgr2=0x7f9b8415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b84144610 0x7f9b8415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 -- 172.21.2.137:0/589971476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7800b180 con 0x7f9b840a9f50 2021-11-15T19:33:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b82ffd700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 0x7f9b840ae510 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f9b84062250 tx=0x7f9b74007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7400ce30 con 0x7f9b840a9f50 2021-11-15T19:33:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740072e0 con 0x7f9b840a9f50 2021-11-15T19:33:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b74005800 con 0x7f9b840a9f50 2021-11-15T19:33:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b84159c80 con 0x7f9b840a9f50 2021-11-15T19:33:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.549+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840ad820 con 0x7f9b840a9f50 2021-11-15T19:33:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84159e10 con 0x7f9b840a9f50 2021-11-15T19:33:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b74010070 con 0x7f9b840a9f50 2021-11-15T19:33:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b73fff700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9b600536d0 0x7f9b60055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9b7406aed0 con 0x7f9b840a9f50 2021-11-15T19:33:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b827fc700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9b600536d0 0x7f9b60055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:55.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b827fc700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9b600536d0 0x7f9b60055b90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f9b78002f70 tx=0x7f9b78015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:55.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.553+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b74041f20 con 0x7f9b840a9f50 2021-11-15T19:33:55.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.661+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b84148190 con 0x7f9b840a9f50 2021-11-15T19:33:55.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.661+0000 7f9b73fff700 1 -- 172.21.2.137:0/589971476 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f9b84148190 con 0x7f9b840a9f50 2021-11-15T19:33:55.673 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:55.674 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:33:53.363248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6892":{"gid":6892,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3296577708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3296577708},{"type":"v1","addr":"172.21.2.137:6833","nonce":3296577708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:33:55.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9b600536d0 msgr2=0x7f9b60055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9b600536d0 0x7f9b60055b90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f9b78002f70 tx=0x7f9b78015000).stop 2021-11-15T19:33:55.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 msgr2=0x7f9b840ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:55.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 0x7f9b840ae510 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f9b84062250 tx=0x7f9b74007c40).stop 2021-11-15T19:33:55.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 shutdown_connections 2021-11-15T19:33:55.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9b600536d0 0x7f9b60055b90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b84144610 0x7f9b8415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b840b1340 0x7f9b8415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:55.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 --2- 172.21.2.137:0/589971476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b840a9f50 0x7f9b840ae510 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:55.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 >> 172.21.2.137:0/589971476 conn(0x7f9b840b4e60 msgr2=0x7f9b840b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:55.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 shutdown_connections 2021-11-15T19:33:55.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:55.665+0000 7f9b896a6700 1 -- 172.21.2.137:0/589971476 wait complete. 2021-11-15T19:33:55.680 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 44 2021-11-15T19:33:55.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:33:52.357259+0000', 'modified': '2021-11-15T19:33:53.363248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6892}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6892': {'gid': 6892, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/3296577708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 3296577708}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 3296577708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:55.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:55.886 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:55.949 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6892,"want_state":"up:active","state":"up:active","rank_uptime":3.579465457,"mdsmap_epoch":44,"osdmap_epoch":93,"osdmap_epoch_barrier":93,"uptime":7.7903137100000004} 2021-11-15T19:33:55.949 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6892, "mdsmap_epoch": 44, "osdmap_epoch": 93, "osdmap_epoch_barrier": 93, "rank_uptime": 3.579465457, "state": "up:active", "uptime": 7.79031371, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:55.950 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:33:55.950 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:33:55.950 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:33:55.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:55.951 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:55.962 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:56.016 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:56.016 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:56.022 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:56.023 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:56.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:56.024 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:56.028 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:33:56.028 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:56.072 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:56.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:56.083 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:56.088 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:56.088 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:56.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:56.090 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:56.113 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:33:56.106+0000 7ff66f522080 -1 init, newargv = 0x561321f1b920 newargc=9 2021-11-15T19:33:56.113 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14931]: starting ceph client 2021-11-15T19:33:56.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14931]: starting fuse 2021-11-15T19:33:57.195 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:33:57.207 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:57.208 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:57.257 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:57.257 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:57.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:57.259 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:33:57.264 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:33:57.264 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:33:57.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:57.265 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:33:57.266 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:33:57.266 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:33:57.267 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:33:57.267 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:33:57.267 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:57.268 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:33:57.268 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:33:57.268 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:33:57.269 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:57.269 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:33:57.270 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:33:57.270 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:33:57.270 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:33:57.271 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:57.271 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:33:57.271 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:33:57.272 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:33:57.272 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:33:57.273 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:33:57.273 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:33:57.273 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:33:57.274 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:33:57.304 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.14931.asok 2021-11-15T19:33:57.306 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14931.asok 2021-11-15T19:33:57.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:57.307 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14931.asok status 2021-11-15T19:33:57.410 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:33:57.410 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:33:57.410 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:33:57.411 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:33:57.411 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:33:57.411 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:33:57.411 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:33:57.411 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "14931", 2021-11-15T19:33:57.412 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:33:57.412 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:57.412 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:33:57.412 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:33:57.412 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4787, 2021-11-15T19:33:57.413 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:33:57.413 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:33:57.413 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:33:57.413 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4787 2021-11-15T19:33:57.413 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:57.414 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:33:57.414 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:33:57.414 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:33:57.414 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 4244979189 2021-11-15T19:33:57.414 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:33:57.415 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:57.415 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:33:57.415 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:33:57.415 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:33:57.415 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 4244979189 2021-11-15T19:33:57.416 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:33:57.416 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4787 172.21.2.131:0/4244979189", 2021-11-15T19:33:57.416 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/4244979189", 2021-11-15T19:33:57.416 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:33:57.417 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 44, 2021-11-15T19:33:57.417 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 93, 2021-11-15T19:33:57.417 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:33:57.417 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:33:57.417 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:33:57.418 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:33:57.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:57.419 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:33:57.420 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:57.428 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:33:57.429 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:33:57.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:57.429 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:33:57.447 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:33:57.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 Processor -- start 2021-11-15T19:33:57.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- start start 2021-11-15T19:33:57.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe2500af800 0x7fe2501401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe250146160 0x7fe2501465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2500b1720 con 0x7fe250066f40 2021-11-15T19:33:57.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500aa230 con 0x7fe250146160 2021-11-15T19:33:57.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe250060d50 con 0x7fe2500af800 2021-11-15T19:33:57.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe2500af800 0x7fe2501401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe250066f40 0x7fe25013fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56418/0 (socket says 172.21.2.137:56418) 2021-11-15T19:33:57.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24ffff700 1 -- 172.21.2.137:0/1830879211 learned_addr learned my addr 172.21.2.137:0/1830879211 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:57.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24f7fe700 1 -- 172.21.2.137:0/1830879211 >> v2:172.21.2.111:3300/0 conn(0x7fe250146160 msgr2=0x7fe2501465a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:57.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24f7fe700 1 --2- 172.21.2.137:0/1830879211 >> v2:172.21.2.111:3300/0 conn(0x7fe250146160 0x7fe2501465a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24f7fe700 1 -- 172.21.2.137:0/1830879211 >> v1:172.21.2.137:6789/0 conn(0x7fe250066f40 legacy=0x7fe25013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24f7fe700 1 -- 172.21.2.137:0/1830879211 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500abfe0 con 0x7fe2500af800 2021-11-15T19:33:57.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24f7fe700 1 --2- 172.21.2.137:0/1830879211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe2501401a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fe244002f70 tx=0x7fe244006df0).ready entity=mon.1 client_cookie=8823cef1ad43477 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24effd700 1 -- 172.21.2.137:0/1830879211 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400d5c0 con 0x7fe2500af800 2021-11-15T19:33:57.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24effd700 1 -- 172.21.2.137:0/1830879211 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244000e90 con 0x7fe2500af800 2021-11-15T19:33:57.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe24effd700 1 -- 172.21.2.137:0/1830879211 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400d950 con 0x7fe2500af800 2021-11-15T19:33:57.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- 172.21.2.137:0/1830879211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 msgr2=0x7fe2501401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 --2- 172.21.2.137:0/1830879211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe2501401a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fe244002f70 tx=0x7fe244006df0).stop 2021-11-15T19:33:57.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- 172.21.2.137:0/1830879211 shutdown_connections 2021-11-15T19:33:57.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 --2- 172.21.2.137:0/1830879211 >> v2:172.21.2.111:3300/0 conn(0x7fe250146160 0x7fe2501465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 --2- 172.21.2.137:0/1830879211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe2501401a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- 172.21.2.137:0/1830879211 >> 172.21.2.137:0/1830879211 conn(0x7fe2500b4e60 msgr2=0x7fe2500b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- 172.21.2.137:0/1830879211 shutdown_connections 2021-11-15T19:33:57.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.493+0000 7fe2566cd700 1 -- 172.21.2.137:0/1830879211 wait complete. 2021-11-15T19:33:57.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 Processor -- start 2021-11-15T19:33:57.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- start start 2021-11-15T19:33:57.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe250066f40 0x7fe250159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe25009a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe250146160 0x7fe2501419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25009a4d0 con 0x7fe250066f40 2021-11-15T19:33:57.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2500acd00 con 0x7fe2500af800 2021-11-15T19:33:57.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2500ace70 con 0x7fe250146160 2021-11-15T19:33:57.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe25009a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe25009a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37642/0 (socket says 172.21.2.137:37642) 2021-11-15T19:33:57.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 -- 172.21.2.137:0/3471692037 learned_addr learned my addr 172.21.2.137:0/3471692037 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:57.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 -- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe250146160 msgr2=0x7fe2501419f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:57.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe250146160 0x7fe2501419f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 -- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe250066f40 msgr2=0x7fe250159ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:57.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe250066f40 0x7fe250159ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 -- 172.21.2.137:0/3471692037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24400b180 con 0x7fe2500af800 2021-11-15T19:33:57.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24f7fe700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe25009a9c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fe25009a690 tx=0x7fe244014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400de70 con 0x7fe2500af800 2021-11-15T19:33:57.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24401e400 con 0x7fe2500af800 2021-11-15T19:33:57.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24401e760 con 0x7fe2500af800 2021-11-15T19:33:57.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2500997d0 con 0x7fe2500af800 2021-11-15T19:33:57.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25013a410 con 0x7fe2500af800 2021-11-15T19:33:57.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25009a6d0 con 0x7fe2500af800 2021-11-15T19:33:57.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe244025030 con 0x7fe2500af800 2021-11-15T19:33:57.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24d7fa700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2300535d0 0x7fe230055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe24406c9d0 con 0x7fe2500af800 2021-11-15T19:33:57.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.497+0000 7fe24ffff700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2300535d0 0x7fe230055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.501+0000 7fe24ffff700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2300535d0 0x7fe230055a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fe25009b040 tx=0x7fe240007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.501+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe244043a20 con 0x7fe2500af800 2021-11-15T19:33:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.581+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2500abd40 con 0x7fe2500af800 2021-11-15T19:33:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.581+0000 7fe24d7fa700 1 -- 172.21.2.137:0/3471692037 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fe244023020 con 0x7fe2500af800 2021-11-15T19:33:57.593 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:57.593 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":93,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:33:53.361674+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:33:50.260810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T19:33:51.357957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:33:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2300535d0 msgr2=0x7fe230055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2300535d0 0x7fe230055a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fe25009b040 tx=0x7fe240007790).stop 2021-11-15T19:33:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 msgr2=0x7fe25009a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe25009a9c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fe25009a690 tx=0x7fe244014000).stop 2021-11-15T19:33:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 shutdown_connections 2021-11-15T19:33:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe2300535d0 0x7fe230055a90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe250146160 0x7fe2501419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2500af800 0x7fe25009a9c0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 --2- 172.21.2.137:0/3471692037 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe250066f40 0x7fe250159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 >> 172.21.2.137:0/3471692037 conn(0x7fe2500b4e60 msgr2=0x7fe2500b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 shutdown_connections 2021-11-15T19:33:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.585+0000 7fe2566cd700 1 -- 172.21.2.137:0/3471692037 wait complete. 2021-11-15T19:33:57.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:33:50.260810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:33:51.357957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:33:57.601 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:33:57.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 Processor -- start 2021-11-15T19:33:57.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- start start 2021-11-15T19:33:57.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0f800acd60 0x7f0f800b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0f800b4680 0x7f0f801290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f800b76c0 con 0x7f0f800b72e0 2021-11-15T19:33:57.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800b3100 con 0x7f0f800acd60 2021-11-15T19:33:57.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800b20c0 con 0x7f0f800b4680 2021-11-15T19:33:57.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0f800b72e0 0x7f0f800b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56430/0 (socket says 172.21.2.137:56430) 2021-11-15T19:33:57.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7ffff700 1 -- 172.21.2.137:0/4205200303 learned_addr learned my addr 172.21.2.137:0/4205200303 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:57.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f84a3f700 1 --2- 172.21.2.137:0/4205200303 >> v2:172.21.2.137:3300/0 conn(0x7f0f800b4680 0x7f0f801290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7effd700 1 -- 172.21.2.137:0/4205200303 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487057510 0 0) 0x7f0f800b76c0 con 0x7f0f800b72e0 2021-11-15T19:33:57.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7effd700 1 -- 172.21.2.137:0/4205200303 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f60003260 con 0x7f0f800b72e0 2021-11-15T19:33:57.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f84a3f700 1 -- 172.21.2.137:0/4205200303 >> v2:172.21.2.111:3300/0 conn(0x7f0f800acd60 msgr2=0x7f0f800b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:57.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f84a3f700 1 --2- 172.21.2.137:0/4205200303 >> v2:172.21.2.111:3300/0 conn(0x7f0f800acd60 0x7f0f800b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f84a3f700 1 -- 172.21.2.137:0/4205200303 >> v1:172.21.2.137:6789/0 conn(0x7f0f800b72e0 legacy=0x7f0f800b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f84a3f700 1 -- 172.21.2.137:0/4205200303 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8012a170 con 0x7f0f800b4680 2021-11-15T19:33:57.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f84a3f700 1 --2- 172.21.2.137:0/4205200303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f801290c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f0f780032f0 tx=0x7f0f780091d0).ready entity=mon.1 client_cookie=fbc621d5aa9a1e41 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7effd700 1 -- 172.21.2.137:0/4205200303 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7800b680 con 0x7f0f800b4680 2021-11-15T19:33:57.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7effd700 1 -- 172.21.2.137:0/4205200303 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800b7e0 con 0x7f0f800b4680 2021-11-15T19:33:57.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f7effd700 1 -- 172.21.2.137:0/4205200303 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7800b950 con 0x7f0f800b4680 2021-11-15T19:33:57.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- 172.21.2.137:0/4205200303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 msgr2=0x7f0f801290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 --2- 172.21.2.137:0/4205200303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f801290c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f0f780032f0 tx=0x7f0f780091d0).stop 2021-11-15T19:33:57.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- 172.21.2.137:0/4205200303 shutdown_connections 2021-11-15T19:33:57.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 --2- 172.21.2.137:0/4205200303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f801290c0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 --2- 172.21.2.137:0/4205200303 >> v2:172.21.2.111:3300/0 conn(0x7f0f800acd60 0x7f0f800b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- 172.21.2.137:0/4205200303 >> 172.21.2.137:0/4205200303 conn(0x7f0f80064960 msgr2=0x7f0f80064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- 172.21.2.137:0/4205200303 shutdown_connections 2021-11-15T19:33:57.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.645+0000 7f0f864a2700 1 -- 172.21.2.137:0/4205200303 wait complete. 2021-11-15T19:33:57.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 Processor -- start 2021-11-15T19:33:57.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- start start 2021-11-15T19:33:57.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f800acd60 0x7f0f80062710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f8013e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f800b72e0 0x7f0f800afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80128a30 con 0x7f0f800acd60 2021-11-15T19:33:57.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800ae6a0 con 0x7f0f800b4680 2021-11-15T19:33:57.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800ae400 con 0x7f0f800b72e0 2021-11-15T19:33:57.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f8013e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f8013e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37658/0 (socket says 172.21.2.137:37658) 2021-11-15T19:33:57.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 -- 172.21.2.137:0/1617659062 learned_addr learned my addr 172.21.2.137:0/1617659062 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:57.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 -- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f800b72e0 msgr2=0x7f0f800afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f800b72e0 0x7f0f800afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 -- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f800acd60 msgr2=0x7f0f80062710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f800acd60 0x7f0f80062710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 -- 172.21.2.137:0/1617659062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78009470 con 0x7f0f800b4680 2021-11-15T19:33:57.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7f7fe700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f8013e6f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f0f8013f5f0 tx=0x7f0f68006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f68013460 con 0x7f0f800b4680 2021-11-15T19:33:57.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680135c0 con 0x7f0f800b4680 2021-11-15T19:33:57.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f800b0e70 con 0x7f0f800b4680 2021-11-15T19:33:57.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f68013920 con 0x7f0f800b4680 2021-11-15T19:33:57.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f800618f0 con 0x7f0f800b4680 2021-11-15T19:33:57.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f800b1000 con 0x7f0f800b4680 2021-11-15T19:33:57.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f6801a060 con 0x7f0f800b4680 2021-11-15T19:33:57.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7d7fa700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f64053610 0x7f0f64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0f6806b4b0 con 0x7f0f800b4680 2021-11-15T19:33:57.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.649+0000 7f0f7ffff700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f64053610 0x7f0f64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.653+0000 7f0f7ffff700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f64053610 0x7f0f64055ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f0f70001110 tx=0x7f0f700076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.653+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f68042500 con 0x7f0f800b4680 2021-11-15T19:33:57.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.733+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0f800b3a50 con 0x7f0f800b4680 2021-11-15T19:33:57.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.733+0000 7f0f7d7fa700 1 -- 172.21.2.137:0/1617659062 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v93) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0f68018030 con 0x7f0f800b4680 2021-11-15T19:33:57.744 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:33:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.733+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f64053610 msgr2=0x7f0f64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.733+0000 7f0f864a2700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f64053610 0x7f0f64055ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f0f70001110 tx=0x7f0f700076c0).stop 2021-11-15T19:33:57.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.733+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 msgr2=0x7f0f8013e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.733+0000 7f0f864a2700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f8013e6f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f0f8013f5f0 tx=0x7f0f68006ec0).stop 2021-11-15T19:33:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 shutdown_connections 2021-11-15T19:33:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f64053610 0x7f0f64055ad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f800b72e0 0x7f0f800afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f800b4680 0x7f0f8013e6f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 --2- 172.21.2.137:0/1617659062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f800acd60 0x7f0f80062710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 >> 172.21.2.137:0/1617659062 conn(0x7f0f80064960 msgr2=0x7f0f800b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 shutdown_connections 2021-11-15T19:33:57.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.737+0000 7f0f864a2700 1 -- 172.21.2.137:0/1617659062 wait complete. 2021-11-15T19:33:57.751 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:33:57.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 Processor -- start 2021-11-15T19:33:57.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 -- start start 2021-11-15T19:33:57.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065730 0x7fa66c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa66c0b00a0 0x7fa66c05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c066270 con 0x7fa66c065b10 2021-11-15T19:33:57.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c067410 con 0x7fa66c0b00a0 2021-11-15T19:33:57.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.793+0000 7fa670f67700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c065fd0 con 0x7fa66c065730 2021-11-15T19:33:57.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa66c0b00a0 0x7fa66c05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa669d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa66c065b10 0x7fa66c13c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56444/0 (socket says 172.21.2.137:56444) 2021-11-15T19:33:57.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa669d9b700 1 -- 172.21.2.137:0/1928121734 learned_addr learned my addr 172.21.2.137:0/1928121734 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:57.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/1928121734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065730 msgr2=0x7fa66c13c2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:33:57.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- 172.21.2.137:0/1928121734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065730 0x7fa66c13c2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/1928121734 >> v1:172.21.2.137:6789/0 conn(0x7fa66c065b10 legacy=0x7fa66c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/1928121734 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c066f70 con 0x7fa66c0b00a0 2021-11-15T19:33:57.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- 172.21.2.137:0/1928121734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c05bd20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fa6640032f0 tx=0x7fa66400a370).ready entity=mon.1 client_cookie=3f8d5ec4365cb6ca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66959a700 1 -- 172.21.2.137:0/1928121734 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa66400cba0 con 0x7fa66c0b00a0 2021-11-15T19:33:57.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66959a700 1 -- 172.21.2.137:0/1928121734 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400cd00 con 0x7fa66c0b00a0 2021-11-15T19:33:57.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66959a700 1 -- 172.21.2.137:0/1928121734 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa66400f660 con 0x7fa66c0b00a0 2021-11-15T19:33:57.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/1928121734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 msgr2=0x7fa66c05bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 --2- 172.21.2.137:0/1928121734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c05bd20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fa6640032f0 tx=0x7fa66400a370).stop 2021-11-15T19:33:57.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/1928121734 shutdown_connections 2021-11-15T19:33:57.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 --2- 172.21.2.137:0/1928121734 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c05bd20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 --2- 172.21.2.137:0/1928121734 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065730 0x7fa66c13c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/1928121734 >> 172.21.2.137:0/1928121734 conn(0x7fa66c060290 msgr2=0x7fa66c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/1928121734 shutdown_connections 2021-11-15T19:33:57.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/1928121734 wait complete. 2021-11-15T19:33:57.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 Processor -- start 2021-11-15T19:33:57.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- start start 2021-11-15T19:33:57.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa66c065730 0x7fa66c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065b10 0x7fa66c1419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c0ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c139d50 con 0x7fa66c065730 2021-11-15T19:33:57.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0af7f0 con 0x7fa66c0b00a0 2021-11-15T19:33:57.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0afa90 con 0x7fa66c065b10 2021-11-15T19:33:57.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c0ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c0ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37672/0 (socket says 172.21.2.137:37672) 2021-11-15T19:33:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/2684071635 learned_addr learned my addr 172.21.2.137:0/2684071635 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065b10 msgr2=0x7fa66c1419b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065b10 0x7fa66c1419b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa66c065730 msgr2=0x7fa66c144950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa66c065730 0x7fa66c144950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 -- 172.21.2.137:0/2684071635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66400a610 con 0x7fa66c0b00a0 2021-11-15T19:33:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa66ad9d700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c0ad430 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7fa6640032f0 tx=0x7fa664018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa664017800 con 0x7fa66c0b00a0 2021-11-15T19:33:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664017960 con 0x7fa66c0b00a0 2021-11-15T19:33:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c141510 con 0x7fa66c0b00a0 2021-11-15T19:33:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c141f90 con 0x7fa66c0b00a0 2021-11-15T19:33:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa664017cc0 con 0x7fa66c0b00a0 2021-11-15T19:33:57.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0afe10 con 0x7fa66c0b00a0 2021-11-15T19:33:57.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa664027030 con 0x7fa66c0b00a0 2021-11-15T19:33:57.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.797+0000 7fa6637fe700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa650053660 0x7fa650055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.801+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa66406d320 con 0x7fa66c0b00a0 2021-11-15T19:33:57.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.801+0000 7fa66a59c700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa650053660 0x7fa650055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.801+0000 7fa66a59c700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa650053660 0x7fa650055b20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fa65c002fb0 tx=0x7fa65c006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.801+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6640443b0 con 0x7fa66c0b00a0 2021-11-15T19:33:57.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa66c0b0fb0 con 0x7fa66c0b00a0 2021-11-15T19:33:57.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa6637fe700 1 -- 172.21.2.137:0/2684071635 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa664047990 con 0x7fa66c0b00a0 2021-11-15T19:33:57.895 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa650053660 msgr2=0x7fa650055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa650053660 0x7fa650055b20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fa65c002fb0 tx=0x7fa65c006930).stop 2021-11-15T19:33:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 msgr2=0x7fa66c0ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c0ad430 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7fa6640032f0 tx=0x7fa664018000).stop 2021-11-15T19:33:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 shutdown_connections 2021-11-15T19:33:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa650053660 0x7fa650055b20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa66c0b00a0 0x7fa66c0ad430 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa66c065b10 0x7fa66c1419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 --2- 172.21.2.137:0/2684071635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa66c065730 0x7fa66c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 >> 172.21.2.137:0/2684071635 conn(0x7fa66c060290 msgr2=0x7fa66c0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 shutdown_connections 2021-11-15T19:33:57.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.885+0000 7fa670f67700 1 -- 172.21.2.137:0/2684071635 wait complete. 2021-11-15T19:33:57.903 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:33:57.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 Processor -- start 2021-11-15T19:33:57.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- start start 2021-11-15T19:33:57.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa29c140aa0 0x7fa29c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c05cb50 con 0x7fa29c0b0550 2021-11-15T19:33:57.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c0ad030 con 0x7fa29c05c770 2021-11-15T19:33:57.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0b1650 con 0x7fa29c140aa0 2021-11-15T19:33:57.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29affd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa29c05c770 0x7fa29c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56458/0 (socket says 172.21.2.137:56458) 2021-11-15T19:33:57.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29affd700 1 -- 172.21.2.137:0/1894295353 learned_addr learned my addr 172.21.2.137:0/1894295353 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:57.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29b7fe700 1 --2- 172.21.2.137:0/1894295353 >> v2:172.21.2.137:3300/0 conn(0x7fa29c140aa0 0x7fa29c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa299ffb700 1 -- 172.21.2.137:0/1894295353 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390988553 0 0) 0x7fa29c0ad030 con 0x7fa29c05c770 2021-11-15T19:33:57.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29b7fe700 1 -- 172.21.2.137:0/1894295353 >> v1:172.21.2.137:6789/0 conn(0x7fa29c05c770 legacy=0x7fa29c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29b7fe700 1 -- 172.21.2.137:0/1894295353 >> v1:172.21.2.111:6789/0 conn(0x7fa29c0b0550 legacy=0x7fa29c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:57.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29b7fe700 1 -- 172.21.2.137:0/1894295353 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0ad2d0 con 0x7fa29c140aa0 2021-11-15T19:33:57.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa29b7fe700 1 --2- 172.21.2.137:0/1894295353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c140f10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fa29c0aee10 tx=0x7fa2940091d0).ready entity=mon.1 client_cookie=c35ebcc3f3fe358c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa299ffb700 1 -- 172.21.2.137:0/1894295353 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa294009ea0 con 0x7fa29c140aa0 2021-11-15T19:33:57.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa299ffb700 1 -- 172.21.2.137:0/1894295353 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29400b860 con 0x7fa29c140aa0 2021-11-15T19:33:57.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa299ffb700 1 -- 172.21.2.137:0/1894295353 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29400b9d0 con 0x7fa29c140aa0 2021-11-15T19:33:57.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- 172.21.2.137:0/1894295353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 msgr2=0x7fa29c140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/1894295353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c140f10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fa29c0aee10 tx=0x7fa2940091d0).stop 2021-11-15T19:33:57.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- 172.21.2.137:0/1894295353 shutdown_connections 2021-11-15T19:33:57.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/1894295353 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c140f10 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:57.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- 172.21.2.137:0/1894295353 >> 172.21.2.137:0/1894295353 conn(0x7fa29c0631e0 msgr2=0x7fa29c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:57.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.945+0000 7fa2a16a4700 1 -- 172.21.2.137:0/1894295353 shutdown_connections 2021-11-15T19:33:57.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- 172.21.2.137:0/1894295353 wait complete. 2021-11-15T19:33:57.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 Processor -- start 2021-11-15T19:33:57.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- start start 2021-11-15T19:33:57.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa29c05c770 0x7fa29c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa29c0b0550 0x7fa29c063dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c0642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0667d0 con 0x7fa29c05c770 2021-11-15T19:33:57.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c066220 con 0x7fa29c140aa0 2021-11-15T19:33:57.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c156440 con 0x7fa29c0b0550 2021-11-15T19:33:57.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c0642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c0642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37684/0 (socket says 172.21.2.137:37684) 2021-11-15T19:33:57.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 -- 172.21.2.137:0/4252159319 learned_addr learned my addr 172.21.2.137:0/4252159319 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:57.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 -- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa29c0b0550 msgr2=0x7fa29c063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa29c0b0550 0x7fa29c063dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 -- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa29c05c770 msgr2=0x7fa29c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:57.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa29c05c770 0x7fa29c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:57.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 -- 172.21.2.137:0/4252159319 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009470 con 0x7fa29c140aa0 2021-11-15T19:33:57.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa29b7fe700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c0642b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fa29c0aee10 tx=0x7fa294016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa294009ea0 con 0x7fa29c140aa0 2021-11-15T19:33:57.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29401f5e0 con 0x7fa29c140aa0 2021-11-15T19:33:57.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0b5070 con 0x7fa29c140aa0 2021-11-15T19:33:57.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29401f940 con 0x7fa29c140aa0 2021-11-15T19:33:57.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c066530 con 0x7fa29c140aa0 2021-11-15T19:33:57.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c0ae7f0 con 0x7fa29c140aa0 2021-11-15T19:33:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa294026030 con 0x7fa29c140aa0 2021-11-15T19:33:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa293fff700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa2800536f0 0x7fa280055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.949+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa29406c780 con 0x7fa29c140aa0 2021-11-15T19:33:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.953+0000 7fa29affd700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa2800536f0 0x7fa280055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:57.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.953+0000 7fa29affd700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa2800536f0 0x7fa280055bb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fa28c000ed0 tx=0x7fa28c0078a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:57.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:57.953+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2940438e0 con 0x7fa29c140aa0 2021-11-15T19:33:58.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa29c0573d0 con 0x7fa29c140aa0 2021-11-15T19:33:58.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa293fff700 1 -- 172.21.2.137:0/4252159319 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa294015020 con 0x7fa29c140aa0 2021-11-15T19:33:58.047 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:58.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa2800536f0 msgr2=0x7fa280055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa2800536f0 0x7fa280055bb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fa28c000ed0 tx=0x7fa28c0078a0).stop 2021-11-15T19:33:58.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 msgr2=0x7fa29c0642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c0642b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fa29c0aee10 tx=0x7fa294016000).stop 2021-11-15T19:33:58.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 shutdown_connections 2021-11-15T19:33:58.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa2800536f0 0x7fa280055bb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa29c140aa0 0x7fa29c0642b0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa29c0b0550 0x7fa29c063dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 --2- 172.21.2.137:0/4252159319 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa29c05c770 0x7fa29c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 >> 172.21.2.137:0/4252159319 conn(0x7fa29c0631e0 msgr2=0x7fa29c140000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:58.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 shutdown_connections 2021-11-15T19:33:58.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.037+0000 7fa2a16a4700 1 -- 172.21.2.137:0/4252159319 wait complete. 2021-11-15T19:33:58.054 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:33:58.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 Processor -- start 2021-11-15T19:33:58.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- start start 2021-11-15T19:33:58.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fce200afde0 0x7fce200acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce200aedf0 con 0x7fce2013f5c0 2021-11-15T19:33:58.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce200afbd0 con 0x7fce200b0fe0 2021-11-15T19:33:58.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce200ae070 con 0x7fce200afde0 2021-11-15T19:33:58.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1f7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fce200b0fe0 0x7fce200af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56474/0 (socket says 172.21.2.137:56474) 2021-11-15T19:33:58.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1f7fe700 1 -- 172.21.2.137:0/1809259453 learned_addr learned my addr 172.21.2.137:0/1809259453 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:58.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1effd700 1 --2- 172.21.2.137:0/1809259453 >> v2:172.21.2.137:3300/0 conn(0x7fce200afde0 0x7fce200acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:58.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1effd700 1 -- 172.21.2.137:0/1809259453 >> v1:172.21.2.137:6789/0 conn(0x7fce200b0fe0 legacy=0x7fce200af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1effd700 1 -- 172.21.2.137:0/1809259453 >> v1:172.21.2.111:6789/0 conn(0x7fce2013f5c0 legacy=0x7fce2013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:58.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1effd700 1 -- 172.21.2.137:0/1809259453 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200b13c0 con 0x7fce200afde0 2021-11-15T19:33:58.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1effd700 1 --2- 172.21.2.137:0/1809259453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce200afde0 0x7fce200acff0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fce200aec90 tx=0x7fce10006df0).ready entity=mon.1 client_cookie=c2f8f278c00d18d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:58.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1e7fc700 1 -- 172.21.2.137:0/1809259453 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1000d4a0 con 0x7fce200afde0 2021-11-15T19:33:58.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1e7fc700 1 -- 172.21.2.137:0/1809259453 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce10000e90 con 0x7fce200afde0 2021-11-15T19:33:58.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce1e7fc700 1 -- 172.21.2.137:0/1809259453 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1000d7f0 con 0x7fce200afde0 2021-11-15T19:33:58.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- 172.21.2.137:0/1809259453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce200afde0 msgr2=0x7fce200acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 --2- 172.21.2.137:0/1809259453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce200afde0 0x7fce200acff0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fce200aec90 tx=0x7fce10006df0).stop 2021-11-15T19:33:58.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- 172.21.2.137:0/1809259453 shutdown_connections 2021-11-15T19:33:58.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 --2- 172.21.2.137:0/1809259453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce200afde0 0x7fce200acff0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- 172.21.2.137:0/1809259453 >> 172.21.2.137:0/1809259453 conn(0x7fce200b5f50 msgr2=0x7fce200b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:58.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- 172.21.2.137:0/1809259453 shutdown_connections 2021-11-15T19:33:58.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.097+0000 7fce26092700 1 -- 172.21.2.137:0/1809259453 wait complete. 2021-11-15T19:33:58.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 Processor -- start 2021-11-15T19:33:58.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- start start 2021-11-15T19:33:58.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce200afde0 0x7fce2010f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce200b0fe0 0x7fce20065840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 0x7fce20065d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200674a0 con 0x7fce200b0fe0 2021-11-15T19:33:58.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20150890 con 0x7fce2013f5c0 2021-11-15T19:33:58.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce20150b30 con 0x7fce200afde0 2021-11-15T19:33:58.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 0x7fce20065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:58.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 0x7fce20065d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37700/0 (socket says 172.21.2.137:37700) 2021-11-15T19:33:58.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 -- 172.21.2.137:0/2973926943 learned_addr learned my addr 172.21.2.137:0/2973926943 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:58.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 -- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce200afde0 msgr2=0x7fce2010f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce200afde0 0x7fce2010f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 -- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce200b0fe0 msgr2=0x7fce20065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce200b0fe0 0x7fce20065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 -- 172.21.2.137:0/2973926943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1000b180 con 0x7fce2013f5c0 2021-11-15T19:33:58.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1ffff700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 0x7fce20065d30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fce18003290 tx=0x7fce180090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:58.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1800f510 con 0x7fce2013f5c0 2021-11-15T19:33:58.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1800f670 con 0x7fce2013f5c0 2021-11-15T19:33:58.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2010fe00 con 0x7fce2013f5c0 2021-11-15T19:33:58.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1800f7e0 con 0x7fce2013f5c0 2021-11-15T19:33:58.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce20110090 con 0x7fce2013f5c0 2021-11-15T19:33:58.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce200ad690 con 0x7fce2013f5c0 2021-11-15T19:33:58.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce1800f070 con 0x7fce2013f5c0 2021-11-15T19:33:58.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1cff9700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce040536a0 0x7fce04055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fce1806b4d0 con 0x7fce2013f5c0 2021-11-15T19:33:58.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.101+0000 7fce1f7fe700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce040536a0 0x7fce04055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:58.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.105+0000 7fce1f7fe700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce040536a0 0x7fce04055b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fce080011d0 tx=0x7fce08007790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:58.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.105+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce18042630 con 0x7fce2013f5c0 2021-11-15T19:33:58.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce200573d0 con 0x7fce2013f5c0 2021-11-15T19:33:58.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce1cff9700 1 -- 172.21.2.137:0/2973926943 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+10 (secure 0 0 0) 0x7fce18045c50 con 0x7fce2013f5c0 2021-11-15T19:33:58.199 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:33:58.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce040536a0 msgr2=0x7fce04055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce040536a0 0x7fce04055b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fce080011d0 tx=0x7fce08007790).stop 2021-11-15T19:33:58.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 msgr2=0x7fce20065d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 0x7fce20065d30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fce18003290 tx=0x7fce180090f0).stop 2021-11-15T19:33:58.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 shutdown_connections 2021-11-15T19:33:58.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fce040536a0 0x7fce04055b60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fce2013f5c0 0x7fce20065d30 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fce200b0fe0 0x7fce20065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 --2- 172.21.2.137:0/2973926943 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fce200afde0 0x7fce2010f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 >> 172.21.2.137:0/2973926943 conn(0x7fce200b5f50 msgr2=0x7fce20060900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:58.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 shutdown_connections 2021-11-15T19:33:58.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.189+0000 7fce26092700 1 -- 172.21.2.137:0/2973926943 wait complete. 2021-11-15T19:33:58.206 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:33:58.207 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:33:58.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 Processor -- start 2021-11-15T19:33:58.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- start start 2021-11-15T19:33:58.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f537c0b1340 0x7f537c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f537c143f00 0x7f537c144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c148190 con 0x7f537c0a9f50 2021-11-15T19:33:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c0b1720 con 0x7f537c143f00 2021-11-15T19:33:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c147e70 con 0x7f537c0b1340 2021-11-15T19:33:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537b59e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f537c0a9f50 0x7f537c0aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56486/0 (socket says 172.21.2.137:56486) 2021-11-15T19:33:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537b59e700 1 -- 172.21.2.137:0/748060964 learned_addr learned my addr 172.21.2.137:0/748060964 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:33:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537ad9d700 1 --2- 172.21.2.137:0/748060964 >> v2:172.21.2.137:3300/0 conn(0x7f537c0b1340 0x7f537c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f5379d9b700 1 -- 172.21.2.137:0/748060964 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320938980 0 0) 0x7f5374001490 con 0x7f537c0a9f50 2021-11-15T19:33:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f5379d9b700 1 -- 172.21.2.137:0/748060964 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f535c003260 con 0x7f537c0a9f50 2021-11-15T19:33:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537ad9d700 1 -- 172.21.2.137:0/748060964 >> v2:172.21.2.111:3300/0 conn(0x7f537c143f00 msgr2=0x7f537c144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:33:58.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537ad9d700 1 --2- 172.21.2.137:0/748060964 >> v2:172.21.2.111:3300/0 conn(0x7f537c143f00 0x7f537c144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537ad9d700 1 -- 172.21.2.137:0/748060964 >> v1:172.21.2.137:6789/0 conn(0x7f537c0a9f50 legacy=0x7f537c0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537ad9d700 1 -- 172.21.2.137:0/748060964 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0af800 con 0x7f537c0b1340 2021-11-15T19:33:58.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537ad9d700 1 --2- 172.21.2.137:0/748060964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c0b1340 0x7f537c147980 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f5364002f70 tx=0x7f5364006df0).ready entity=mon.1 client_cookie=1b98ca5fa9b9fdb6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:58.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f5379d9b700 1 -- 172.21.2.137:0/748060964 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536400d570 con 0x7f537c0b1340 2021-11-15T19:33:58.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f5379d9b700 1 -- 172.21.2.137:0/748060964 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364000e90 con 0x7f537c0b1340 2021-11-15T19:33:58.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f5379d9b700 1 -- 172.21.2.137:0/748060964 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f536400d8c0 con 0x7f537c0b1340 2021-11-15T19:33:58.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- 172.21.2.137:0/748060964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c0b1340 msgr2=0x7f537c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- 172.21.2.137:0/748060964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c0b1340 0x7f537c147980 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f5364002f70 tx=0x7f5364006df0).stop 2021-11-15T19:33:58.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- 172.21.2.137:0/748060964 shutdown_connections 2021-11-15T19:33:58.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- 172.21.2.137:0/748060964 >> v2:172.21.2.111:3300/0 conn(0x7f537c143f00 0x7f537c144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- 172.21.2.137:0/748060964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c0b1340 0x7f537c147980 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- 172.21.2.137:0/748060964 >> 172.21.2.137:0/748060964 conn(0x7f537c0b4e60 msgr2=0x7f537c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:58.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- 172.21.2.137:0/748060964 shutdown_connections 2021-11-15T19:33:58.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- 172.21.2.137:0/748060964 wait complete. 2021-11-15T19:33:58.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 Processor -- start 2021-11-15T19:33:58.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- start start 2021-11-15T19:33:58.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f537c0a9f50 0x7f537c0ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f537c0b1340 0x7f537c140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 0x7f537c13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0ae210 con 0x7f537c0a9f50 2021-11-15T19:33:58.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0acab0 con 0x7f537c143f00 2021-11-15T19:33:58.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f53811af700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c14aa50 con 0x7f537c0b1340 2021-11-15T19:33:58.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537b59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 0x7f537c13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:58.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537b59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 0x7f537c13d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37714/0 (socket says 172.21.2.137:37714) 2021-11-15T19:33:58.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.249+0000 7f537b59e700 1 -- 172.21.2.137:0/1446108920 learned_addr learned my addr 172.21.2.137:0/1446108920 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:33:58.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537b59e700 1 -- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f537c0b1340 msgr2=0x7f537c140110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:58.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537b59e700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f537c0b1340 0x7f537c140110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537b59e700 1 -- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f537c0a9f50 msgr2=0x7f537c0ad7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:33:58.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537b59e700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f537c0a9f50 0x7f537c0ad7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537b59e700 1 -- 172.21.2.137:0/1446108920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536400b180 con 0x7f537c143f00 2021-11-15T19:33:58.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537b59e700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 0x7f537c13d7a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f5374001620 tx=0x7f5374007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:58.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5374005ba0 con 0x7f537c143f00 2021-11-15T19:33:58.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374005d00 con 0x7f537c143f00 2021-11-15T19:33:58.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53740072c0 con 0x7f537c143f00 2021-11-15T19:33:58.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0ac810 con 0x7f537c143f00 2021-11-15T19:33:58.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c14ac80 con 0x7f537c143f00 2021-11-15T19:33:58.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c05faf0 con 0x7f537c143f00 2021-11-15T19:33:58.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5374010070 con 0x7f537c143f00 2021-11-15T19:33:58.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f5373fff700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53600534f0 0x7f53600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:33:58.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f537406b380 con 0x7f537c143f00 2021-11-15T19:33:58.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537ad9d700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53600534f0 0x7f53600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:33:58.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.253+0000 7f537ad9d700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53600534f0 0x7f53600559b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5364002f70 tx=0x7f5364014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:33:58.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.257+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53740423d0 con 0x7f537c143f00 2021-11-15T19:33:58.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f537c148190 con 0x7f537c143f00 2021-11-15T19:33:58.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f5373fff700 1 -- 172.21.2.137:0/1446108920 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f537c148190 con 0x7f537c143f00 2021-11-15T19:33:58.375 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:33:58.375 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:33:53.363248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6892":{"gid":6892,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3296577708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3296577708},{"type":"v1","addr":"172.21.2.137:6833","nonce":3296577708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:33:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53600534f0 msgr2=0x7f53600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53600534f0 0x7f53600559b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5364002f70 tx=0x7f5364014000).stop 2021-11-15T19:33:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 msgr2=0x7f537c13d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:33:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 0x7f537c13d7a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f5374001620 tx=0x7f5374007c60).stop 2021-11-15T19:33:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 shutdown_connections 2021-11-15T19:33:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f53600534f0 0x7f53600559b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f537c143f00 0x7f537c13d7a0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:33:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f537c0b1340 0x7f537c140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 --2- 172.21.2.137:0/1446108920 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f537c0a9f50 0x7f537c0ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:33:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 >> 172.21.2.137:0/1446108920 conn(0x7f537c0b4e60 msgr2=0x7f537c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:33:58.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 shutdown_connections 2021-11-15T19:33:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:33:58.365+0000 7f53811af700 1 -- 172.21.2.137:0/1446108920 wait complete. 2021-11-15T19:33:58.379 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 44 2021-11-15T19:33:58.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:33:52.357259+0000', 'modified': '2021-11-15T19:33:53.363248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6892}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6892': {'gid': 6892, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/3296577708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 3296577708}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 3296577708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:33:58.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:33:58.585 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:33:58.650 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":6892,"want_state":"up:active","state":"up:active","rank_uptime":6.2806278449999997,"mdsmap_epoch":44,"osdmap_epoch":93,"osdmap_epoch_barrier":93,"uptime":10.491459989000001} 2021-11-15T19:33:58.651 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 6892, "mdsmap_epoch": 44, "osdmap_epoch": 93, "osdmap_epoch_barrier": 93, "rank_uptime": 6.280627845, "state": "up:active", "uptime": 10.491459989, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:33:58.651 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:33:58.651 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:33:58.652 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:33:58.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:58.653 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:58.663 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:33:58.675 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:58.675 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:58.681 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:58.681 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:58.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:58.683 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:33:58.687 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:33:58.687 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:33:58.731 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:33:58.741 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:58.741 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:58.746 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:58.747 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:58.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:58.748 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:33:58.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14342]: starting ceph client 2021-11-15T19:33:58.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:33:58.771+0000 7fc06e6ad080 -1 init, newargv = 0x55bfa87d0990 newargc=9 2021-11-15T19:33:58.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14342]: starting fuse 2021-11-15T19:33:59.875 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:33:59.888 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:33:59.888 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:33:59.936 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:33:59.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:33:59.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:59.939 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:33:59.944 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:33:59.944 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:33:59.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:33:59.945 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:33:59.945 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:33:59.946 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:33:59.946 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:33:59.947 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:33:59.947 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:59.947 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:33:59.948 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:33:59.948 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:33:59.948 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:59.949 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:33:59.949 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:33:59.950 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:33:59.950 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:33:59.950 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:59.951 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:33:59.951 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:33:59.952 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:33:59.952 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:33:59.952 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:33:59.953 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:33:59.953 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:33:59.953 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:34:00.017 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14342.asok 2021-11-15T19:34:00.019 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14342.asok 2021-11-15T19:34:00.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.020 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14342.asok status 2021-11-15T19:34:00.067 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:34:00.068 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:34:00.068 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:34:00.068 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:34:00.068 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:34:00.069 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:34:00.069 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:34:00.069 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14342", 2021-11-15T19:34:00.069 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:34:00.070 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:00.070 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:34:00.070 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:34:00.070 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 7129, 2021-11-15T19:34:00.071 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:34:00.071 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:34:00.071 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:34:00.071 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 7129 2021-11-15T19:34:00.072 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:00.072 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:34:00.072 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:34:00.072 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:34:00.072 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 272530455 2021-11-15T19:34:00.073 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:34:00.073 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:00.073 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:34:00.073 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:34:00.074 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:34:00.074 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 272530455 2021-11-15T19:34:00.074 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:00.074 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.7129 172.21.2.118:0/272530455", 2021-11-15T19:34:00.075 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/272530455", 2021-11-15T19:34:00.075 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:34:00.075 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 44, 2021-11-15T19:34:00.075 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 93, 2021-11-15T19:34:00.075 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:34:00.076 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:34:00.076 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:34:00.076 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:34:00.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.078 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:00.078 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:00.084 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:00.084 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:00.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.085 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:00.135 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T19:34:00.135 DEBUG:teuthology.orchestra.run.gibba031:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-11-15T19:34:00.158 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:34:00.158 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:34:00.159 DEBUG:teuthology.orchestra.run.gibba031:> import stat 2021-11-15T19:34:00.159 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:00.159 DEBUG:teuthology.orchestra.run.gibba031:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-11-15T19:34:00.160 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:34:00.199 INFO:teuthology.orchestra.run.gibba031.stdout:1099511627776 2021-11-15T19:34:00.408 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:00.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 Processor -- start 2021-11-15T19:34:00.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 -- start start 2021-11-15T19:34:00.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f38940608f0 0x7f389413f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:00.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f389405f730 0x7f389405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:00.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940b1af0 con 0x7f38940b1660 2021-11-15T19:34:00.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940ad6c0 con 0x7f38940608f0 2021-11-15T19:34:00.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389b191700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894060070 con 0x7f389405f730 2021-11-15T19:34:00.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f389972e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f389405f730 0x7f389405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:00.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f3898f2d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f38940608f0 0x7f389413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:00.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f3893fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f38940b1660 0x7f38940b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:48994/0 (socket says 172.21.2.137:48994) 2021-11-15T19:34:00.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.461+0000 7f3893fff700 1 -- 172.21.2.137:0/3245883720 learned_addr learned my addr 172.21.2.137:0/3245883720 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:00.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f389405f730 msgr2=0x7f389405fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:00.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f389405f730 0x7f389405fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3245883720 >> v1:172.21.2.111:6789/0 conn(0x7f38940b1660 legacy=0x7f38940b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:00.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3245883720 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940b0c80 con 0x7f38940608f0 2021-11-15T19:34:00.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940608f0 0x7f389413f890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3884002f70 tx=0x7f3884006e80).ready entity=mon.0 client_cookie=29ce1e260f02d72a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:00.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f38937fe700 1 -- 172.21.2.137:0/3245883720 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388400b8a0 con 0x7f38940608f0 2021-11-15T19:34:00.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f38937fe700 1 -- 172.21.2.137:0/3245883720 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388400ba00 con 0x7f38940608f0 2021-11-15T19:34:00.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f38937fe700 1 -- 172.21.2.137:0/3245883720 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388400bd60 con 0x7f38940608f0 2021-11-15T19:34:00.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940608f0 msgr2=0x7f389413f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:00.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 --2- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940608f0 0x7f389413f890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3884002f70 tx=0x7f3884006e80).stop 2021-11-15T19:34:00.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3245883720 shutdown_connections 2021-11-15T19:34:00.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 --2- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f389405f730 0x7f389405fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 --2- 172.21.2.137:0/3245883720 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940608f0 0x7f389413f890 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3245883720 >> 172.21.2.137:0/3245883720 conn(0x7f3894063980 msgr2=0x7f3894063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:00.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3245883720 shutdown_connections 2021-11-15T19:34:00.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3245883720 wait complete. 2021-11-15T19:34:00.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 Processor -- start 2021-11-15T19:34:00.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- start start 2021-11-15T19:34:00.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 0x7f38940b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:00.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38940608f0 0x7f38940651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:00.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940b1660 0x7f38941433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:00.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894064800 con 0x7f38940b1660 2021-11-15T19:34:00.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894064aa0 con 0x7f389405f730 2021-11-15T19:34:00.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894064d40 con 0x7f38940608f0 2021-11-15T19:34:00.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 0x7f38940b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:00.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 0x7f38940b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37726/0 (socket says 172.21.2.137:37726) 2021-11-15T19:34:00.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3846995886 learned_addr learned my addr 172.21.2.137:0/3846995886 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:00.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389972e700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940b1660 0x7f38941433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:00.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3893fff700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38940608f0 0x7f38940651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:00.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38940608f0 msgr2=0x7f38940651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:00.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38940608f0 0x7f38940651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940b1660 msgr2=0x7f38941433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:00.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940b1660 0x7f38941433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 -- 172.21.2.137:0/3846995886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388400d410 con 0x7f389405f730 2021-11-15T19:34:00.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3898f2d700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 0x7f38940b4090 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f3884002f70 tx=0x7f3884006e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:00.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388400b8a0 con 0x7f389405f730 2021-11-15T19:34:00.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3884000e90 con 0x7f389405f730 2021-11-15T19:34:00.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3894067430 con 0x7f389405f730 2021-11-15T19:34:00.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3894140f00 con 0x7f389405f730 2021-11-15T19:34:00.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3884019a10 con 0x7f389405f730 2021-11-15T19:34:00.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.465+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894145f20 con 0x7f389405f730 2021-11-15T19:34:00.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.469+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3884019b70 con 0x7f389405f730 2021-11-15T19:34:00.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.469+0000 7f3891ffb700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f38780536f0 0x7f3878055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:00.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.469+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f388406d0c0 con 0x7f389405f730 2021-11-15T19:34:00.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.469+0000 7f3893fff700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f38780536f0 0x7f3878055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:00.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.469+0000 7f3893fff700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f38780536f0 0x7f3878055bb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f387c00b000 tx=0x7f387c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:00.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.469+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3894145f20 con 0x7f389405f730 2021-11-15T19:34:00.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3894145f20 con 0x7f389405f730 2021-11-15T19:34:00.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f3891ffb700 1 -- 172.21.2.137:0/3846995886 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f3894145f20 con 0x7f389405f730 2021-11-15T19:34:00.587 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:00.587 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:33:53.363248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6892":{"gid":6892,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3296577708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3296577708},{"type":"v1","addr":"172.21.2.137:6833","nonce":3296577708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:34:00.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f38780536f0 msgr2=0x7f3878055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:00.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f38780536f0 0x7f3878055bb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f387c00b000 tx=0x7f387c009040).stop 2021-11-15T19:34:00.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 msgr2=0x7f38940b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:00.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 0x7f38940b4090 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f3884002f70 tx=0x7f3884006e80).stop 2021-11-15T19:34:00.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 shutdown_connections 2021-11-15T19:34:00.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f38780536f0 0x7f3878055bb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38940b1660 0x7f38941433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38940608f0 0x7f38940651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 --2- 172.21.2.137:0/3846995886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f389405f730 0x7f38940b4090 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:00.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 >> 172.21.2.137:0/3846995886 conn(0x7f3894063980 msgr2=0x7f38940af210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:00.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 shutdown_connections 2021-11-15T19:34:00.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:00.577+0000 7f389b191700 1 -- 172.21.2.137:0/3846995886 wait complete. 2021-11-15T19:34:00.591 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 44 2021-11-15T19:34:00.594 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 0x10000000000 2021-11-15T19:34:00.652 INFO:teuthology.orchestra.run.gibba037.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-11-15T19:34:00.149032+0000","btime":"2021-11-15T19:34:00.149032+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-11-15T19:34:00.149032+0000","atime":"2021-11-15T19:34:00.149032+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4787,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":4787,"want_loner":4787,"mds_caps_wanted":[]} 2021-11-15T19:34:00.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-11-15T19:34:00.149032+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-11-15T19:34:00.149032+0000", "change_attr": 0, "client_caps": [ { "client_id": 4787, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-11-15T19:34:00.149032+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4787, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-11-15T19:34:00.149032+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 4787, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-11-15T19:34:00.654 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:34:00.654 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:00.668 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:00.681 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:00.694 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:00.707 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:00.720 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:34:00.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.721 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:00.722 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:00.726 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:34:00.726 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:00.727 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:34:00.727 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:34:00.728 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:00.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[14931]: fuse finished with error 0 and tester_r 0 2021-11-15T19:34:00.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.735 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:00.736 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:00.785 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:34:00.786 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:34:00.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:00.897 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:00.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.901 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:00.902 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:00.913 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:00.914 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:00.914 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:34:00.915 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:34:00.915 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:00.970 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14342]: fuse finished with error 0 and tester_r 0 2021-11-15T19:34:00.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:00.972 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:00.973 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:00.982 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:34:00.983 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:34:01.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:01.094 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:01.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:01.142 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:01.142 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:34:01.151 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:34:01.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:01.153 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:34:01.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:01.154 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:34:01.163 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:34:01.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:01.164 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:34:01.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d7dbc1700 1 Processor -- start 2021-11-15T19:34:01.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d7dbc1700 1 -- start start 2021-11-15T19:34:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d7dbc1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d780b1270 0x7f7d78063010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d7dbc1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d78067af0 con 0x7f7d780ac8c0 2021-11-15T19:34:01.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d7dbc1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780af790 con 0x7f7d7805efb0 2021-11-15T19:34:01.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d7dbc1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780afa30 con 0x7f7d780b1270 2021-11-15T19:34:01.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d777fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7d7805efb0 0x7f7d781423d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56514/0 (socket says 172.21.2.137:56514) 2021-11-15T19:34:01.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d777fe700 1 -- 172.21.2.137:0/3986900179 learned_addr learned my addr 172.21.2.137:0/3986900179 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:01.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683875936 0 0) 0x7f7d780af790 con 0x7f7d7805efb0 2021-11-15T19:34:01.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.209+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d64003260 con 0x7f7d7805efb0 2021-11-15T19:34:01.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261795805 0 0) 0x7f7d64003260 con 0x7f7d7805efb0 2021-11-15T19:34:01.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d780b1270 msgr2=0x7f7d78063010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d780b1270 0x7f7d78063010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 >> v1:172.21.2.111:6789/0 conn(0x7f7d780ac8c0 legacy=0x7f7d78142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7813e030 con 0x7f7d7805efb0 2021-11-15T19:34:01.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7d6c001660 con 0x7f7d7805efb0 2021-11-15T19:34:01.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 >> v1:172.21.2.137:6789/0 conn(0x7f7d7805efb0 legacy=0x7f7d781423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d780b1270 0x7f7d640037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d64003d10 0x7f7d64004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d640049f0 0x7f7d64004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780afa30 con 0x7f7d640049f0 2021-11-15T19:34:01.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6400fe40 con 0x7f7d64003d10 2021-11-15T19:34:01.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64010000 con 0x7f7d780b1270 2021-11-15T19:34:01.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d64003d10 0x7f7d64004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 -- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d780b1270 msgr2=0x7f7d640037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d780b1270 0x7f7d640037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 -- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d640049f0 msgr2=0x7f7d64004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d640049f0 0x7f7d64004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 -- 172.21.2.137:0/3986900179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64003260 con 0x7f7d64003d10 2021-11-15T19:34:01.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d64003d10 0x7f7d64004500 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f7d68000f70 tx=0x7f7d680079e0).ready entity=mon.1 client_cookie=c4ca834103b78e23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d68001d80 con 0x7f7d64003d10 2021-11-15T19:34:01.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d68014410 con 0x7f7d64003d10 2021-11-15T19:34:01.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d767fc700 1 -- 172.21.2.137:0/3986900179 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d68007cf0 con 0x7f7d64003d10 2021-11-15T19:34:01.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/3986900179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d64003d10 msgr2=0x7f7d64004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/3986900179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d64003d10 0x7f7d64004500 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f7d68000f70 tx=0x7f7d680079e0).stop 2021-11-15T19:34:01.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 -- 172.21.2.137:0/3986900179 reap_dead start 2021-11-15T19:34:01.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/3986900179 shutdown_connections 2021-11-15T19:34:01.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/3986900179 >> 172.21.2.137:0/3986900179 conn(0x7f7d7805bd20 msgr2=0x7f7d7805c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:01.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/3986900179 shutdown_connections 2021-11-15T19:34:01.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/3986900179 wait complete. 2021-11-15T19:34:01.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 Processor -- start 2021-11-15T19:34:01.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- start start 2021-11-15T19:34:01.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d64003d10 0x7f7d78140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d78067090 0x7f7d78064bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 0x7f7d78151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813ba50 con 0x7f7d78067090 2021-11-15T19:34:01.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813bc80 con 0x7f7d780650a0 2021-11-15T19:34:01.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813bf20 con 0x7f7d64003d10 2021-11-15T19:34:01.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 0x7f7d78151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 0x7f7d78151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37748/0 (socket says 172.21.2.137:37748) 2021-11-15T19:34:01.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 -- 172.21.2.137:0/2197935322 learned_addr learned my addr 172.21.2.137:0/2197935322 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:01.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d76ffd700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d78067090 0x7f7d78064bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d777fe700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d64003d10 0x7f7d78140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 -- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d64003d10 msgr2=0x7f7d78140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d64003d10 0x7f7d78140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 -- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d78067090 msgr2=0x7f7d78064bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d78067090 0x7f7d78064bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 -- 172.21.2.137:0/2197935322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7813d1d0 con 0x7f7d780650a0 2021-11-15T19:34:01.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d77fff700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 0x7f7d78151370 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f7d6c001110 tx=0x7f7d7000a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7000cea0 con 0x7f7d780650a0 2021-11-15T19:34:01.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70005c30 con 0x7f7d780650a0 2021-11-15T19:34:01.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d70007070 con 0x7f7d780650a0 2021-11-15T19:34:01.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.213+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d78067510 con 0x7f7d780650a0 2021-11-15T19:34:01.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7813c560 con 0x7f7d780650a0 2021-11-15T19:34:01.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7813c0e0 con 0x7f7d780650a0 2021-11-15T19:34:01.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d7001d070 con 0x7f7d780650a0 2021-11-15T19:34:01.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d74ff9700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d58053520 0x7f7d580559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7d7006aad0 con 0x7f7d780650a0 2021-11-15T19:34:01.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d777fe700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d58053520 0x7f7d580559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d777fe700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d58053520 0x7f7d580559e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f7d6c00b000 tx=0x7f7d6c0017c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.217+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d70041c30 con 0x7f7d780650a0 2021-11-15T19:34:01.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7d780573d0 con 0x7f7d780650a0 2021-11-15T19:34:01.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d74ff9700 1 -- 172.21.2.137:0/2197935322 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v93) v1 ==== 81+0+33648 (secure 0 0 0) 0x7f7d70045250 con 0x7f7d780650a0 2021-11-15T19:34:01.315 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:01.315 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:01.315 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 93, 2021-11-15T19:34:01.316 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:34:01.316 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:34:01.316 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:33:53.361674+0000", 2021-11-15T19:34:01.316 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:01.316 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:01.317 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:34:01.317 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:34:01.317 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:34:01.317 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:34:01.317 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:34:01.318 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:34:01.318 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:34:01.318 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:01.318 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:34:01.318 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:34:01.319 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:34:01.319 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:34:01.319 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:34:01.319 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 18, 2021-11-15T19:34:01.319 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:34:01.320 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:34:01.320 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:34:01.320 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:34:01.320 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:34:01.320 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.321 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:34:01.321 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:34:01.321 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:34:01.321 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:01.322 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:01.322 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:01.322 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:01.322 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:01.323 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:01.323 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:01.323 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:01.323 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:34:01.323 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:34:01.324 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:34:01.324 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:34:01.324 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:34:01.324 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:01.324 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:01.325 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:01.325 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:01.325 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:01.325 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:01.325 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:01.326 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:34:01.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:01.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:01.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:01.327 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:01.327 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:01.327 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:01.327 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:01.327 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:01.328 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:01.328 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:01.328 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:01.328 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:01.328 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:01.329 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:01.329 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:01.329 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:01.329 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:01.329 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:01.330 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:01.330 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:01.330 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:01.330 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:01.330 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:01.331 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:01.331 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:01.331 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:01.331 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.331 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:01.332 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:01.332 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:01.332 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:01.332 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:01.332 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:01.333 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:01.333 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:01.333 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:01.333 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:01.333 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:01.334 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:34:01.334 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:34:01.334 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.334 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:01.335 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:34:01.335 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.335 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.335 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.335 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:34:01.336 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:34:01.336 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:34:01.336 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:01.336 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:01.336 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:01.337 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:01.337 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:01.337 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:01.337 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:01.337 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:01.338 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:01.338 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:01.338 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:01.338 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:01.338 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:01.339 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:01.339 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:01.339 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:01.339 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:01.339 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:01.340 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:01.340 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:01.340 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.340 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:34:01.340 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:01.341 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:01.341 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:01.341 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:01.341 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:01.341 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:01.342 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:01.342 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:01.342 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:01.342 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:01.342 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:01.343 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:01.343 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:01.343 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:01.343 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:01.344 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:01.344 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:01.344 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:01.344 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:01.344 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:01.345 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:01.345 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:01.345 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:01.345 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:01.345 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:01.346 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:01.346 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.346 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:01.346 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:01.346 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:01.347 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:01.347 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:01.347 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:01.347 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:01.347 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:01.348 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:01.348 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:01.348 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:01.348 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:34:01.349 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:01.349 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:34:01.349 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.349 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.349 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.350 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 17, 2021-11-15T19:34:01.350 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:34:01.350 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:33:50.260810+0000", 2021-11-15T19:34:01.350 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:01.350 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:01.351 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:01.351 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:01.351 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:01.351 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:01.351 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:01.352 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:01.352 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:01.352 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:01.352 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:01.353 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:01.353 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:01.353 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:01.353 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:01.353 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:01.354 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:01.354 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:01.354 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:01.354 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:01.354 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.355 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "92", 2021-11-15T19:34:01.355 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:01.355 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:01.355 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:01.356 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:01.356 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:01.356 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:01.356 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:01.356 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:01.357 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:01.357 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:01.357 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:01.357 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:01.357 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:01.358 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:01.358 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:01.358 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:01.358 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:01.359 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:01.359 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:01.359 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:01.359 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:01.359 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:01.360 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:01.360 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:01.360 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:01.360 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:01.360 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.360 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:01.361 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:01.361 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:01.361 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:01.361 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:01.362 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:01.362 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:01.362 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:01.362 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:01.362 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:01.363 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:01.363 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:34:01.363 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:34:01.363 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:34:01.363 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:34:01.364 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.364 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:01.364 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:34:01.364 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:34:01.364 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.365 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.365 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.365 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.365 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 18, 2021-11-15T19:34:01.365 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:34:01.366 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:33:51.357957+0000", 2021-11-15T19:34:01.366 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:01.366 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:01.366 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:01.366 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:01.367 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:01.367 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:01.367 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:01.367 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:01.368 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:01.368 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:01.368 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:01.368 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:01.368 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:01.369 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:01.369 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:01.369 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:01.369 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:01.369 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:01.370 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:01.370 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:01.370 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.370 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "93", 2021-11-15T19:34:01.371 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:01.371 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:01.371 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:01.371 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:01.371 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:01.372 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:01.372 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:01.372 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:01.372 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:01.372 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:01.373 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:01.373 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:01.373 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:01.373 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:01.373 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:01.374 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:01.374 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:01.374 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:01.374 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:01.375 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:01.375 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:01.375 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:01.375 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:01.375 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:01.376 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:01.376 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:01.376 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.376 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:01.376 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:01.377 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:01.377 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:01.377 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:01.377 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:01.377 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:01.378 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:01.378 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:01.378 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:01.378 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:01.378 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:34:01.379 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:01.379 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:34:01.379 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:34:01.379 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.379 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.380 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.380 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:01.380 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:34:01.380 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.380 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:01.381 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:34:01.381 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.381 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.381 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.381 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.382 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.382 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.382 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.382 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:01.383 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.383 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.383 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.383 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.383 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.384 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.384 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:34:01.384 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.384 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.384 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.385 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.385 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:34:01.385 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.385 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.385 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.386 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.386 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.386 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.386 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.386 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.387 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:34:01.387 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.387 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.387 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.387 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.388 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:34:01.388 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.388 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.388 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.389 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.389 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.389 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.389 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.389 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.389 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:34:01.390 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.390 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.390 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.390 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.390 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:34:01.391 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.391 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.391 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.391 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.392 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.392 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.392 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.392 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.392 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:34:01.393 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.393 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.393 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.393 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.393 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:34:01.394 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:01.394 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.394 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.394 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.394 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:34:01.395 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:34:01.395 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:34:01.395 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:34:01.395 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.395 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.396 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.396 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.396 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.396 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.397 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:01.397 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:34:01.397 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.397 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.397 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.398 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.398 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.398 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.398 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.398 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:01.399 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.399 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.399 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.399 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.399 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.399 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.400 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:34:01.400 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.400 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.400 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.401 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.401 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:34:01.401 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.401 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.401 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.402 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.402 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.402 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.402 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.402 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.403 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:34:01.403 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.403 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.403 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.403 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.404 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:34:01.404 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.404 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.404 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.404 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.405 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.405 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.405 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.405 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.405 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:34:01.406 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.406 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.406 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.406 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.406 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:34:01.407 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.407 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.407 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.407 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.408 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.408 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.408 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.408 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.408 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:34:01.409 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.409 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.409 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.409 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.410 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:34:01.410 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:01.410 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.410 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.410 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.411 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:34:01.411 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:34:01.411 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:34:01.411 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:34:01.411 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.412 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.412 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.412 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.412 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.412 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.413 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:01.413 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:34:01.413 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.413 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.413 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.414 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.414 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.414 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.414 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.415 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:01.415 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.415 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.415 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.415 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.416 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.416 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.416 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:34:01.416 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.416 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.417 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.417 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.417 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:34:01.417 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.417 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.418 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.418 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.418 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.418 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.418 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.419 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.419 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:34:01.419 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.419 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.419 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.420 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.420 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:34:01.420 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.420 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.421 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.421 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.421 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.421 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.421 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.421 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.422 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:34:01.422 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.422 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.422 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.423 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.423 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:34:01.423 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.423 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.423 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.424 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.424 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.424 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.424 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.425 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.425 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:34:01.425 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.425 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.425 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.426 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.426 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:34:01.426 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:01.426 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.426 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.427 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.427 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:34:01.427 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:34:01.427 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:34:01.427 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:34:01.428 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.428 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.428 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.428 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.428 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.429 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.429 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:01.429 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:34:01.429 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.429 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.430 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.430 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.430 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.430 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.431 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.431 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:01.431 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.431 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.431 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.432 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.432 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.432 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.432 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:34:01.432 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.433 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.433 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.433 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.433 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:34:01.433 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.434 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.434 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.434 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.434 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.434 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.435 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.435 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.435 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:34:01.435 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.435 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.436 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.436 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.436 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:34:01.436 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.436 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.437 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.437 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.437 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.437 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.438 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.438 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.438 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:34:01.438 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.438 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.439 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.439 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.439 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:34:01.439 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.439 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.440 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.440 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.440 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.440 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.441 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.441 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.441 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:34:01.441 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.441 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.442 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.442 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.442 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:34:01.442 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:01.442 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.443 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.443 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.443 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:34:01.443 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:34:01.443 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:34:01.444 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:34:01.444 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.444 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.444 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.444 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.445 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.445 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.445 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:01.445 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:34:01.445 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.446 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.446 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.446 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.446 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.446 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.447 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.447 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 90, 2021-11-15T19:34:01.447 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.447 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.447 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.448 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.448 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.448 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.448 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:34:01.449 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.449 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.449 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.449 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.449 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:34:01.449 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.450 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.450 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.450 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.450 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.451 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.451 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.451 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.451 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:34:01.451 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.452 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.452 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.452 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.452 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:34:01.452 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.453 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.453 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.453 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.453 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.453 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.454 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.454 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.454 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:34:01.454 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.455 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.455 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.455 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.455 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:34:01.455 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.456 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.456 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.456 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.456 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.456 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.457 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.457 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.457 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:34:01.457 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.457 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.458 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.458 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.458 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:34:01.458 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:01.459 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.459 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.459 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.459 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:34:01.459 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:34:01.460 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:34:01.460 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:34:01.460 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.460 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.460 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.461 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.461 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.461 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.461 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:01.461 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:34:01.462 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.462 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.462 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.462 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.463 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.463 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.463 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.463 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:34:01.463 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.464 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.464 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.464 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.464 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.464 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.465 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:34:01.465 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.465 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.465 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.465 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.466 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:34:01.466 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.466 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.466 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.467 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.467 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.467 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.467 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.467 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.468 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:34:01.468 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.468 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.468 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.468 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.469 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:34:01.469 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.469 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.469 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.469 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.469 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.470 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.470 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.470 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.470 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:34:01.471 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.471 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.471 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.471 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.471 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:34:01.472 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.472 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.472 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.472 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.472 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.473 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.473 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.473 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.473 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:34:01.473 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.474 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.474 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.474 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.474 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:34:01.474 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:01.475 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.475 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.475 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.475 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:34:01.476 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:34:01.476 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:34:01.476 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:34:01.476 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.476 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.476 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.477 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.477 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.477 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.477 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:01.477 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:34:01.478 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.478 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.478 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.478 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.478 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.479 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.479 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.479 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 90, 2021-11-15T19:34:01.479 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.479 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.480 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.480 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.480 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.480 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.480 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:34:01.481 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.481 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.481 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.481 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.481 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:34:01.482 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.482 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.482 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.482 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.482 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.483 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.483 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.483 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.483 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:34:01.483 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.484 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.484 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.484 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.484 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:34:01.484 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.485 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.485 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.485 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.485 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.485 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.486 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.486 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.486 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:34:01.486 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.487 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.487 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.487 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.487 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:34:01.487 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.488 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.488 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.488 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.488 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.488 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.489 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.489 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.489 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:34:01.489 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.489 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.489 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.490 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.490 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:34:01.490 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:01.490 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.491 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.491 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.491 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:34:01.491 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:34:01.491 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:34:01.491 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:34:01.492 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.492 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.492 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.492 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.492 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.493 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.493 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:01.493 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:34:01.493 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:01.493 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:01.494 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:01.494 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:01.494 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:01.494 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:01.494 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:01.495 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:01.495 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:01.495 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:01.495 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:01.495 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.496 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.496 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.496 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:34:01.496 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.496 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.497 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.497 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.497 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:34:01.497 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.497 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.498 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.498 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.498 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:01.498 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.498 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.499 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.499 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:34:01.499 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.499 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.500 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.500 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.500 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:34:01.500 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.500 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.500 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.501 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.501 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:01.501 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.501 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.501 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.502 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:34:01.502 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.502 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.502 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.502 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.503 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:34:01.503 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.503 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.503 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.503 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.504 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:01.504 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:01.504 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.504 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:01.504 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:34:01.505 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.505 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.505 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.505 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:01.505 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:34:01.506 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:01.506 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.506 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.506 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.507 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:34:01.507 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:34:01.507 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:34:01.507 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:34:01.507 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:01.508 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:01.508 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:01.508 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:01.508 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.508 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:01.509 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:34:01.509 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.509 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:01.509 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.509 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.510 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.510 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.510 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.510 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:34:01.511 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.511 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.511 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.511 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:01.511 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.512 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.512 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.512 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.512 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.512 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:34:01.513 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.513 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.513 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.513 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:01.513 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.514 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.514 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.514 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.514 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.515 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:34:01.515 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.515 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.515 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.516 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:01.516 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.516 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.516 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.516 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.517 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.517 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:34:01.517 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.517 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.517 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.518 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:01.518 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.518 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.518 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.519 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.519 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.519 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:34:01.519 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.519 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.520 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.520 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:01.520 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.520 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.521 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.521 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.521 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.521 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:34:01.521 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.522 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.522 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.522 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:01.522 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.523 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.523 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.523 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.523 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.523 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:34:01.524 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.524 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.524 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:01.524 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:01.525 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:01.525 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:01.525 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:01.525 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:01.525 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:01.526 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:34:01.526 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:01.526 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.526 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:01.527 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:34:01.527 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:34:01.527 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:34:01.527 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:34:01.527 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:34:01.528 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:34:01.528 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:34:01.528 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:34:01.528 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:34:01.528 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:34:01.529 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:34:01.529 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:34:01.529 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:34:01.529 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:01.529 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:01.530 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:34:01.530 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:34:01.530 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:34:01.530 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:34:01.531 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:34:01.531 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:01.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d58053520 msgr2=0x7f7d580559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d58053520 0x7f7d580559e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f7d6c00b000 tx=0x7f7d6c0017c0).stop 2021-11-15T19:34:01.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 msgr2=0x7f7d78151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 0x7f7d78151370 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f7d6c001110 tx=0x7f7d7000a060).stop 2021-11-15T19:34:01.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 shutdown_connections 2021-11-15T19:34:01.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d58053520 0x7f7d580559e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d780650a0 0x7f7d78151370 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d78067090 0x7f7d78064bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 --2- 172.21.2.137:0/2197935322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d64003d10 0x7f7d78140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 >> 172.21.2.137:0/2197935322 conn(0x7f7d7805bd20 msgr2=0x7f7d7813e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:01.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 shutdown_connections 2021-11-15T19:34:01.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.305+0000 7f7d7dbc1700 1 -- 172.21.2.137:0/2197935322 wait complete. 2021-11-15T19:34:01.535 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 Processor -- start 2021-11-15T19:34:01.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 -- start start 2021-11-15T19:34:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f99a4144610 0x7f99a4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a40a9f50 0x7f99a40aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a4148190 con 0x7f99a40b1340 2021-11-15T19:34:01.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a40b1720 con 0x7f99a4144610 2021-11-15T19:34:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99aba09700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4147e70 con 0x7f99a40a9f50 2021-11-15T19:34:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a97a5700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f99a40b1340 0x7f99a4143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56534/0 (socket says 172.21.2.137:56534) 2021-11-15T19:34:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a97a5700 1 -- 172.21.2.137:0/1111836313 learned_addr learned my addr 172.21.2.137:0/1111836313 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:01.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265202843 0 0) 0x7f99a0001110 con 0x7f99a40b1340 2021-11-15T19:34:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f998c003260 con 0x7f99a40b1340 2021-11-15T19:34:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1930201884 0 0) 0x7f998c003260 con 0x7f99a40b1340 2021-11-15T19:34:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a40a9f50 msgr2=0x7f99a40aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a40a9f50 0x7f99a40aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 >> v2:172.21.2.111:3300/0 conn(0x7f99a4144610 msgr2=0x7f99a4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 --2- 172.21.2.137:0/1111836313 >> v2:172.21.2.111:3300/0 conn(0x7f99a4144610 0x7f99a4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40af800 con 0x7f99a40b1340 2021-11-15T19:34:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f99a0001810 con 0x7f99a40b1340 2021-11-15T19:34:01.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 >> v1:172.21.2.137:6789/0 conn(0x7f99a40b1340 legacy=0x7f99a4143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c003750 0x7f998c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f998c004500 0x7f998c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a40a9f50 0x7f998c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40b1720 con 0x7f998c003750 2021-11-15T19:34:01.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4147e70 con 0x7f998c004500 2021-11-15T19:34:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c00b9c0 con 0x7f99a40a9f50 2021-11-15T19:34:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f998c004500 0x7f998c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a40a9f50 msgr2=0x7f998c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a40a9f50 0x7f998c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c003750 msgr2=0x7f998c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c003750 0x7f998c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.581+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1111836313 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c003260 con 0x7f998c004500 2021-11-15T19:34:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f998c004500 0x7f998c004980 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f9994002f70 tx=0x7f9994006ca0).ready entity=mon.1 client_cookie=e6bd864b2e84f17f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9994012410 con 0x7f998c004500 2021-11-15T19:34:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994012570 con 0x7f998c004500 2021-11-15T19:34:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f9993fff700 1 -- 172.21.2.137:0/1111836313 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99940128d0 con 0x7f998c004500 2021-11-15T19:34:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1111836313 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f998c004500 msgr2=0x7f998c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 --2- 172.21.2.137:0/1111836313 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f998c004500 0x7f998c004980 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f9994002f70 tx=0x7f9994006ca0).stop 2021-11-15T19:34:01.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a9fa6700 1 -- 172.21.2.137:0/1111836313 reap_dead start 2021-11-15T19:34:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1111836313 shutdown_connections 2021-11-15T19:34:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1111836313 >> 172.21.2.137:0/1111836313 conn(0x7f99a40b4e60 msgr2=0x7f99a40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1111836313 shutdown_connections 2021-11-15T19:34:01.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1111836313 wait complete. 2021-11-15T19:34:01.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 Processor -- start 2021-11-15T19:34:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- start start 2021-11-15T19:34:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c004500 0x7f99a40aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 0x7f99a4098770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a4098130 0x7f99a4140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a409a0d0 con 0x7f998c004500 2021-11-15T19:34:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a409a500 con 0x7f99a40ac590 2021-11-15T19:34:01.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40accc0 con 0x7f99a4098130 2021-11-15T19:34:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 0x7f99a4098770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 0x7f99a4098770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37768/0 (socket says 172.21.2.137:37768) 2021-11-15T19:34:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1296799919 learned_addr learned my addr 172.21.2.137:0/1296799919 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a4098130 msgr2=0x7f99a4140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a4098130 0x7f99a4140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c004500 msgr2=0x7f99a40aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c004500 0x7f99a40aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 -- 172.21.2.137:0/1296799919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4140550 con 0x7f99a40ac590 2021-11-15T19:34:01.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99a8fa4700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 0x7f99a4098770 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f9994002f70 tx=0x7f9994015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9994012410 con 0x7f99a40ac590 2021-11-15T19:34:01.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994011e00 con 0x7f99a40ac590 2021-11-15T19:34:01.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999401d610 con 0x7f99a40ac590 2021-11-15T19:34:01.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a4140740 con 0x7f99a40ac590 2021-11-15T19:34:01.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a4143050 con 0x7f99a40ac590 2021-11-15T19:34:01.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.585+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a405faf0 con 0x7f99a40ac590 2021-11-15T19:34:01.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.589+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f999400f030 con 0x7f99a40ac590 2021-11-15T19:34:01.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.589+0000 7f99927fc700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053640 0x7f9984055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.589+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f999406c7a0 con 0x7f99a40ac590 2021-11-15T19:34:01.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.589+0000 7f99a97a5700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053640 0x7f9984055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.589+0000 7f99a97a5700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053640 0x7f9984055b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f99a0001520 tx=0x7f99a40abfb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.589+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99940438a0 con 0x7f99a40ac590 2021-11-15T19:34:01.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a40573d0 con 0x7f99a40ac590 2021-11-15T19:34:01.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99927fc700 1 -- 172.21.2.137:0/1296799919 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f9994022070 con 0x7f99a40ac590 2021-11-15T19:34:01.708 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:01.708 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:33:53.363248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6892":{"gid":6892,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3296577708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3296577708},{"type":"v1","addr":"172.21.2.137:6833","nonce":3296577708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:34:01.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053640 msgr2=0x7f9984055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053640 0x7f9984055b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f99a0001520 tx=0x7f99a40abfb0).stop 2021-11-15T19:34:01.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 msgr2=0x7f99a4098770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 0x7f99a4098770 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f9994002f70 tx=0x7f9994015000).stop 2021-11-15T19:34:01.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 shutdown_connections 2021-11-15T19:34:01.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053640 0x7f9984055b00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a4098130 0x7f99a4140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a40ac590 0x7f99a4098770 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 --2- 172.21.2.137:0/1296799919 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f998c004500 0x7f99a40aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 >> 172.21.2.137:0/1296799919 conn(0x7f99a40b4e60 msgr2=0x7f99a4143cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:01.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 shutdown_connections 2021-11-15T19:34:01.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.697+0000 7f99aba09700 1 -- 172.21.2.137:0/1296799919 wait complete. 2021-11-15T19:34:01.712 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 44 2021-11-15T19:34:01.715 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:34:01.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 Processor -- start 2021-11-15T19:34:01.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- start start 2021-11-15T19:34:01.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4e0805c770 0x7f4e080aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 0x7f4e0814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0805cb50 con 0x7f4e0814aaa0 2021-11-15T19:34:01.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e080b1650 con 0x7f4e0805c770 2021-11-15T19:34:01.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080ad030 con 0x7f4e080b0550 2021-11-15T19:34:01.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e077fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4e0814aaa0 0x7f4e08140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56556/0 (socket says 172.21.2.137:56556) 2021-11-15T19:34:01.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e077fe700 1 -- 172.21.2.137:0/3318284987 learned_addr learned my addr 172.21.2.137:0/3318284987 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:01.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040974028 0 0) 0x7f4e0805cb50 con 0x7f4e0814aaa0 2021-11-15T19:34:01.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de8003260 con 0x7f4e0814aaa0 2021-11-15T19:34:01.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e06ffd700 1 --2- 172.21.2.137:0/3318284987 >> v2:172.21.2.111:3300/0 conn(0x7f4e0805c770 0x7f4e080aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 0x7f4e0814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121831883 0 0) 0x7f4de8003260 con 0x7f4e0814aaa0 2021-11-15T19:34:01.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 msgr2=0x7f4e0814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 0x7f4e0814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 >> v2:172.21.2.111:3300/0 conn(0x7f4e0805c770 msgr2=0x7f4e080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 --2- 172.21.2.137:0/3318284987 >> v2:172.21.2.111:3300/0 conn(0x7f4e0805c770 0x7f4e080aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:01.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e080ad2d0 con 0x7f4e0814aaa0 2021-11-15T19:34:01.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4e000019e0 con 0x7f4e0814aaa0 2021-11-15T19:34:01.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 >> v1:172.21.2.137:6789/0 conn(0x7f4e0814aaa0 legacy=0x7f4e08140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 0x7f4de80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4de8003e00 0x7f4de8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de80049f0 0x7f4de8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080b1650 con 0x7f4de80049f0 2021-11-15T19:34:01.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080ad030 con 0x7f4de8003e00 2021-11-15T19:34:01.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de800b8e0 con 0x7f4e080b0550 2021-11-15T19:34:01.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4de8003e00 0x7f4de8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 -- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 msgr2=0x7f4de80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e080b0550 0x7f4de80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 -- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de80049f0 msgr2=0x7f4de8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:01.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de80049f0 0x7f4de8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 -- 172.21.2.137:0/3318284987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8003260 con 0x7f4de8003e00 2021-11-15T19:34:01.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e067fc700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4de8003e00 0x7f4de8004500 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f4df000a000 tx=0x7f4df0008040).ready entity=mon.1 client_cookie=7ae900bbc2bc30aa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df0013670 con 0x7f4de8003e00 2021-11-15T19:34:01.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df00137d0 con 0x7f4de8003e00 2021-11-15T19:34:01.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e05ffb700 1 -- 172.21.2.137:0/3318284987 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df0013b30 con 0x7f4de8003e00 2021-11-15T19:34:01.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/3318284987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4de8003e00 msgr2=0x7f4de8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:01.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/3318284987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4de8003e00 0x7f4de8004500 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f4df000a000 tx=0x7f4df0008040).stop 2021-11-15T19:34:01.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e077fe700 1 -- 172.21.2.137:0/3318284987 reap_dead start 2021-11-15T19:34:01.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/3318284987 shutdown_connections 2021-11-15T19:34:01.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.757+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/3318284987 >> 172.21.2.137:0/3318284987 conn(0x7f4e080631e0 msgr2=0x7f4e0805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:01.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/3318284987 shutdown_connections 2021-11-15T19:34:01.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/3318284987 wait complete. 2021-11-15T19:34:01.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 Processor -- start 2021-11-15T19:34:01.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- start start 2021-11-15T19:34:01.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de8003e00 0x7f4e081459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 0x7f4e081431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e08159780 0x7f4e08143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08067cc0 con 0x7f4de8003e00 2021-11-15T19:34:01.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815a680 con 0x7f4e08116800 2021-11-15T19:34:01.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08063cb0 con 0x7f4e08159780 2021-11-15T19:34:01.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 0x7f4e081431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 0x7f4e081431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37784/0 (socket says 172.21.2.137:37784) 2021-11-15T19:34:01.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 -- 172.21.2.137:0/436894202 learned_addr learned my addr 172.21.2.137:0/436894202 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:01.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 -- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e08159780 msgr2=0x7f4e08143690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:01.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e08159780 0x7f4e08143690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 -- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de8003e00 msgr2=0x7f4e081459c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:01.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de8003e00 0x7f4e081459c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:01.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 -- 172.21.2.137:0/436894202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08063f50 con 0x7f4e08116800 2021-11-15T19:34:01.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e067fc700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 0x7f4e081431a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f4df000a000 tx=0x7f4df0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df0012ba0 con 0x7f4e08116800 2021-11-15T19:34:01.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0000e90 con 0x7f4e08116800 2021-11-15T19:34:01.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e08064ea0 con 0x7f4e08116800 2021-11-15T19:34:01.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df001d410 con 0x7f4e08116800 2021-11-15T19:34:01.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e08064b90 con 0x7f4e08116800 2021-11-15T19:34:01.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e080640e0 con 0x7f4e08116800 2021-11-15T19:34:01.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4df001d570 con 0x7f4e08116800 2021-11-15T19:34:01.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4dfffff700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4dec053660 0x7f4dec055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:01.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4df006d180 con 0x7f4e08116800 2021-11-15T19:34:01.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.761+0000 7f4e06ffd700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4dec053660 0x7f4dec055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:01.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.765+0000 7f4e06ffd700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4dec053660 0x7f4dec055b20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f4df800a000 tx=0x7f4df8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:01.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.765+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4df0044170 con 0x7f4e08116800 2021-11-15T19:34:01.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:01.873+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4e080ae7f0 con 0x7f4e08116800 2021-11-15T19:34:02.427 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:34:02.421+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:34:02.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4dfffff700 1 -- 172.21.2.137:0/436894202 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4df0047790 con 0x7f4e08116800 2021-11-15T19:34:02.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4dec053660 msgr2=0x7f4dec055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4dec053660 0x7f4dec055b20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f4df800a000 tx=0x7f4df8008040).stop 2021-11-15T19:34:02.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 msgr2=0x7f4e081431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 0x7f4e081431a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f4df000a000 tx=0x7f4df0008040).stop 2021-11-15T19:34:02.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 shutdown_connections 2021-11-15T19:34:02.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4dec053660 0x7f4dec055b20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:02.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4e08159780 0x7f4e08143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4e08116800 0x7f4e081431a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:02.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 --2- 172.21.2.137:0/436894202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4de8003e00 0x7f4e081459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 >> 172.21.2.137:0/436894202 conn(0x7f4e080631e0 msgr2=0x7f4e081484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:02.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 shutdown_connections 2021-11-15T19:34:02.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.433+0000 7f4e0d3e4700 1 -- 172.21.2.137:0/436894202 wait complete. 2021-11-15T19:34:02.446 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:34:02.450 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:02.453 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:34:02.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 Processor -- start 2021-11-15T19:34:02.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- start start 2021-11-15T19:34:02.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40608f0 0x7fd8d413f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd8d40b1660 0x7fd8d40b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d40b0c80 con 0x7fd8d40b2c00 2021-11-15T19:34:02.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40ad6c0 con 0x7fd8d40b1660 2021-11-15T19:34:02.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40b0f20 con 0x7fd8d40608f0 2021-11-15T19:34:02.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d3fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd8d40b2c00 0x7fd8d405f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56586/0 (socket says 172.21.2.137:56586) 2021-11-15T19:34:02.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d3fff700 1 -- 172.21.2.137:0/1691138012 learned_addr learned my addr 172.21.2.137:0/1691138012 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:02.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d2ffd700 1 --2- 172.21.2.137:0/1691138012 >> v2:172.21.2.137:3300/0 conn(0x7fd8d40b1660 0x7fd8d40b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:02.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/1691138012 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40608f0 msgr2=0x7fd8d413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:02.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d2ffd700 1 --2- 172.21.2.137:0/1691138012 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40608f0 0x7fd8d413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/1691138012 >> v1:172.21.2.137:6789/0 conn(0x7fd8d40b2c00 legacy=0x7fd8d405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/1691138012 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40b11c0 con 0x7fd8d40b1660 2021-11-15T19:34:02.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d2ffd700 1 --2- 172.21.2.137:0/1691138012 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d40b2710 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fd8c4002f70 tx=0x7fd8c4006df0).ready entity=mon.1 client_cookie=17cc9dc095df7535 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:02.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d27fc700 1 -- 172.21.2.137:0/1691138012 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c400d570 con 0x7fd8d40b1660 2021-11-15T19:34:02.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d27fc700 1 -- 172.21.2.137:0/1691138012 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4000e90 con 0x7fd8d40b1660 2021-11-15T19:34:02.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d27fc700 1 -- 172.21.2.137:0/1691138012 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c400d8c0 con 0x7fd8d40b1660 2021-11-15T19:34:02.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- 172.21.2.137:0/1691138012 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 msgr2=0x7fd8d40b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/1691138012 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d40b2710 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fd8c4002f70 tx=0x7fd8c4006df0).stop 2021-11-15T19:34:02.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- 172.21.2.137:0/1691138012 shutdown_connections 2021-11-15T19:34:02.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/1691138012 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d40b2710 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:02.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/1691138012 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40608f0 0x7fd8d413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- 172.21.2.137:0/1691138012 >> 172.21.2.137:0/1691138012 conn(0x7fd8d4063980 msgr2=0x7fd8d4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:02.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- 172.21.2.137:0/1691138012 shutdown_connections 2021-11-15T19:34:02.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.493+0000 7fd8d9b87700 1 -- 172.21.2.137:0/1691138012 wait complete. 2021-11-15T19:34:02.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 Processor -- start 2021-11-15T19:34:02.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- start start 2021-11-15T19:34:02.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8d40608f0 0x7fd8d4128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d4152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40b2c00 0x7fd8d4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d413b660 con 0x7fd8d40608f0 2021-11-15T19:34:02.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4152460 con 0x7fd8d40b1660 2021-11-15T19:34:02.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d413b370 con 0x7fd8d40b2c00 2021-11-15T19:34:02.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d4152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:02.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d4152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37808/0 (socket says 172.21.2.137:37808) 2021-11-15T19:34:02.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/2457345599 learned_addr learned my addr 172.21.2.137:0/2457345599 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:02.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40b2c00 msgr2=0x7fd8d4152df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:02.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40b2c00 0x7fd8d4152df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8d40608f0 msgr2=0x7fd8d4128b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:02.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8d40608f0 0x7fd8d4128b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 -- 172.21.2.137:0/2457345599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c400b180 con 0x7fd8d40b1660 2021-11-15T19:34:02.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d2ffd700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d4152900 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fd8c4002f70 tx=0x7fd8c4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:02.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c400d8f0 con 0x7fd8d40b1660 2021-11-15T19:34:02.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4011ca0 con 0x7fd8d40b1660 2021-11-15T19:34:02.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d4129010 con 0x7fd8d40b1660 2021-11-15T19:34:02.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4064b10 con 0x7fd8d40b1660 2021-11-15T19:34:02.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c401e460 con 0x7fd8d40b1660 2021-11-15T19:34:02.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d4066de0 con 0x7fd8d40b1660 2021-11-15T19:34:02.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8c4025030 con 0x7fd8d40b1660 2021-11-15T19:34:02.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d0ff9700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8b8053540 0x7fd8b8055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fd8c406d230 con 0x7fd8d40b1660 2021-11-15T19:34:02.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.497+0000 7fd8d37fe700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8b8053540 0x7fd8b8055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:02.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.501+0000 7fd8d37fe700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8b8053540 0x7fd8b8055a00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fd8bc002f70 tx=0x7fd8bc006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:02.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.501+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8c4044230 con 0x7fd8d40b1660 2021-11-15T19:34:02.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.609+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8d4066de0 con 0x7fd8d40b1660 2021-11-15T19:34:02.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.609+0000 7fd8d0ff9700 1 -- 172.21.2.137:0/2457345599 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fd8d4066de0 con 0x7fd8d40b1660 2021-11-15T19:34:02.620 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:02.620 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:33:52.357259+0000","modified":"2021-11-15T19:34:02.425515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T19:34:02.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.609+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8b8053540 msgr2=0x7fd8b8055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.609+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8b8053540 0x7fd8b8055a00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fd8bc002f70 tx=0x7fd8bc006a00).stop 2021-11-15T19:34:02.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.609+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 msgr2=0x7fd8d4152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.609+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d4152900 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fd8c4002f70 tx=0x7fd8c4015000).stop 2021-11-15T19:34:02.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 shutdown_connections 2021-11-15T19:34:02.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8b8053540 0x7fd8b8055a00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:02.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8d40b2c00 0x7fd8d4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8d40b1660 0x7fd8d4152900 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:02.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 --2- 172.21.2.137:0/2457345599 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8d40608f0 0x7fd8d4128b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 >> 172.21.2.137:0/2457345599 conn(0x7fd8d4063980 msgr2=0x7fd8d413f330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:02.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 shutdown_connections 2021-11-15T19:34:02.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.613+0000 7fd8d9b87700 1 -- 172.21.2.137:0/2457345599 wait complete. 2021-11-15T19:34:02.624 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 45 2021-11-15T19:34:02.627 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:34:02.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e3d00700 1 Processor -- start 2021-11-15T19:34:02.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e3d00700 1 -- start start 2021-11-15T19:34:02.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e3d00700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa9dc05c770 0x7fa9dc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e3d00700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc05cb50 con 0x7fa9dc140aa0 2021-11-15T19:34:02.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e3d00700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0ad030 con 0x7fa9dc0b0550 2021-11-15T19:34:02.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e3d00700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0b1650 con 0x7fa9dc05c770 2021-11-15T19:34:02.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e1a9c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa9dc05c770 0x7fa9dc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:02.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e129b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa9dc0b0550 0x7fa9dc14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56602/0 (socket says 172.21.2.137:56602) 2021-11-15T19:34:02.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.709+0000 7fa9e129b700 1 -- 172.21.2.137:0/315035393 learned_addr learned my addr 172.21.2.137:0/315035393 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:02.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e1a9c700 1 -- 172.21.2.137:0/315035393 >> v1:172.21.2.137:6789/0 conn(0x7fa9dc0b0550 legacy=0x7fa9dc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e1a9c700 1 -- 172.21.2.137:0/315035393 >> v1:172.21.2.111:6789/0 conn(0x7fa9dc140aa0 legacy=0x7fa9dc140ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:02.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e1a9c700 1 -- 172.21.2.137:0/315035393 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0ad2d0 con 0x7fa9dc05c770 2021-11-15T19:34:02.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e1a9c700 1 --2- 172.21.2.137:0/315035393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc05c770 0x7fa9dc0aef30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fa9dc0aee10 tx=0x7fa9d8006df0).ready entity=mon.1 client_cookie=7f200e19a67d2c29 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:02.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e0a9a700 1 -- 172.21.2.137:0/315035393 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d800d5c0 con 0x7fa9dc05c770 2021-11-15T19:34:02.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e0a9a700 1 -- 172.21.2.137:0/315035393 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8000e90 con 0x7fa9dc05c770 2021-11-15T19:34:02.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e0a9a700 1 -- 172.21.2.137:0/315035393 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d800d910 con 0x7fa9dc05c770 2021-11-15T19:34:02.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/315035393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc05c770 msgr2=0x7fa9dc0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/315035393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc05c770 0x7fa9dc0aef30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fa9dc0aee10 tx=0x7fa9d8006df0).stop 2021-11-15T19:34:02.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/315035393 shutdown_connections 2021-11-15T19:34:02.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/315035393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc05c770 0x7fa9dc0aef30 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:02.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/315035393 >> 172.21.2.137:0/315035393 conn(0x7fa9dc0631e0 msgr2=0x7fa9dc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:02.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/315035393 shutdown_connections 2021-11-15T19:34:02.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/315035393 wait complete. 2021-11-15T19:34:02.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 Processor -- start 2021-11-15T19:34:02.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- start start 2021-11-15T19:34:02.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9dc05c770 0x7fa9dc065d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9dc0b0550 0x7fa9dc1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 0x7fa9dc063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc066730 con 0x7fa9dc05c770 2021-11-15T19:34:02.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0669d0 con 0x7fa9dc140aa0 2021-11-15T19:34:02.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc066c70 con 0x7fa9dc0b0550 2021-11-15T19:34:02.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 0x7fa9dc063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:02.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 0x7fa9dc063760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37826/0 (socket says 172.21.2.137:37826) 2021-11-15T19:34:02.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 -- 172.21.2.137:0/256395111 learned_addr learned my addr 172.21.2.137:0/256395111 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:02.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 -- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9dc0b0550 msgr2=0x7fa9dc1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9dc0b0550 0x7fa9dc1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 -- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9dc05c770 msgr2=0x7fa9dc065d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:02.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9dc05c770 0x7fa9dc065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:02.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 -- 172.21.2.137:0/256395111 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d800b180 con 0x7fa9dc140aa0 2021-11-15T19:34:02.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e229d700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 0x7fa9dc063760 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fa9d4003330 tx=0x7fa9d40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:02.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d4001520 con 0x7fa9dc140aa0 2021-11-15T19:34:02.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4001680 con 0x7fa9dc140aa0 2021-11-15T19:34:02.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d40019e0 con 0x7fa9dc140aa0 2021-11-15T19:34:02.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc067110 con 0x7fa9dc140aa0 2021-11-15T19:34:02.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.713+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1577b0 con 0x7fa9dc140aa0 2021-11-15T19:34:02.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc066e30 con 0x7fa9dc140aa0 2021-11-15T19:34:02.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9d4018030 con 0x7fa9dc140aa0 2021-11-15T19:34:02.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9ceffd700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9bc0535d0 0x7fa9bc055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:02.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fa9d406b4f0 con 0x7fa9dc140aa0 2021-11-15T19:34:02.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9e1a9c700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9bc0535d0 0x7fa9bc055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:02.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9e1a9c700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9bc0535d0 0x7fa9bc055a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa9dc0aee10 tx=0x7fa9d8012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:02.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.717+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9d40425a0 con 0x7fa9dc140aa0 2021-11-15T19:34:02.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:02.825+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa9dc0ae7f0 con 0x7fa9dc140aa0 2021-11-15T19:34:03.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9ceffd700 1 -- 172.21.2.137:0/256395111 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa9d4045bc0 con 0x7fa9dc140aa0 2021-11-15T19:34:03.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9bc0535d0 msgr2=0x7fa9bc055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:03.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9bc0535d0 0x7fa9bc055a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa9dc0aee10 tx=0x7fa9d8012000).stop 2021-11-15T19:34:03.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 msgr2=0x7fa9dc063760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:03.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 0x7fa9dc063760 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fa9d4003330 tx=0x7fa9d40091a0).stop 2021-11-15T19:34:03.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 shutdown_connections 2021-11-15T19:34:03.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9bc0535d0 0x7fa9bc055a90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:03.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9dc140aa0 0x7fa9dc063760 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:03.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9dc0b0550 0x7fa9dc1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:03.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 --2- 172.21.2.137:0/256395111 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9dc05c770 0x7fa9dc065d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:03.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 >> 172.21.2.137:0/256395111 conn(0x7fa9dc0631e0 msgr2=0x7fa9dc147960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:03.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 shutdown_connections 2021-11-15T19:34:03.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.445+0000 7fa9e3d00700 1 -- 172.21.2.137:0/256395111 wait complete. 2021-11-15T19:34:03.462 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:34:03.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.505+0000 7fc2eea3b700 1 Processor -- start 2021-11-15T19:34:03.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.505+0000 7fc2eea3b700 1 -- start start 2021-11-15T19:34:03.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc2e805fd20 0x7fc2e80af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:03.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e8147f70 con 0x7fc2e80b0830 2021-11-15T19:34:03.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e8060100 con 0x7fc2e80b10b0 2021-11-15T19:34:03.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e8147cd0 con 0x7fc2e805fd20 2021-11-15T19:34:03.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc2e805fd20 0x7fc2e80af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:03.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc2e80b10b0 0x7fc2e80b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56612/0 (socket says 172.21.2.137:56612) 2021-11-15T19:34:03.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 -- 172.21.2.137:0/4207983921 learned_addr learned my addr 172.21.2.137:0/4207983921 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:03.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e7fff700 1 -- 172.21.2.137:0/4207983921 >> v1:172.21.2.137:6789/0 conn(0x7fc2e80b10b0 legacy=0x7fc2e80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:03.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e7fff700 1 -- 172.21.2.137:0/4207983921 >> v1:172.21.2.111:6789/0 conn(0x7fc2e80b0830 legacy=0x7fc2e80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:03.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e7fff700 1 -- 172.21.2.137:0/4207983921 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80a9ed0 con 0x7fc2e805fd20 2021-11-15T19:34:03.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e7fff700 1 --2- 172.21.2.137:0/4207983921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e805fd20 0x7fc2e80af800 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fc2e80b4db0 tx=0x7fc2d8006df0).ready entity=mon.1 client_cookie=bf3d091c83514abd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:03.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e6ffd700 1 -- 172.21.2.137:0/4207983921 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2d800d5c0 con 0x7fc2e805fd20 2021-11-15T19:34:03.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e6ffd700 1 -- 172.21.2.137:0/4207983921 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8000e90 con 0x7fc2e805fd20 2021-11-15T19:34:03.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e6ffd700 1 -- 172.21.2.137:0/4207983921 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2d800d910 con 0x7fc2e805fd20 2021-11-15T19:34:03.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/4207983921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e805fd20 msgr2=0x7fc2e80af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:03.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/4207983921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e805fd20 0x7fc2e80af800 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fc2e80b4db0 tx=0x7fc2d8006df0).stop 2021-11-15T19:34:03.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/4207983921 shutdown_connections 2021-11-15T19:34:03.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/4207983921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e805fd20 0x7fc2e80af800 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:03.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/4207983921 >> 172.21.2.137:0/4207983921 conn(0x7fc2e80b4e60 msgr2=0x7fc2e80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:03.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/4207983921 shutdown_connections 2021-11-15T19:34:03.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/4207983921 wait complete. 2021-11-15T19:34:03.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 Processor -- start 2021-11-15T19:34:03.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- start start 2021-11-15T19:34:03.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc2e805fd20 0x7fc2e80990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:03.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 0x7fc2e8065440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:03.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc2e80b10b0 0x7fc2e8159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:03.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8064040 con 0x7fc2e805fd20 2021-11-15T19:34:03.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8064d00 con 0x7fc2e80b0830 2021-11-15T19:34:03.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8064fa0 con 0x7fc2e80b10b0 2021-11-15T19:34:03.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 0x7fc2e8065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:03.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 0x7fc2e8065440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37840/0 (socket says 172.21.2.137:37840) 2021-11-15T19:34:03.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 -- 172.21.2.137:0/802904776 learned_addr learned my addr 172.21.2.137:0/802904776 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:03.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 -- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc2e80b10b0 msgr2=0x7fc2e8159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:03.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc2e80b10b0 0x7fc2e8159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:03.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 -- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc2e805fd20 msgr2=0x7fc2e80990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:03.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc2e805fd20 0x7fc2e80990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:03.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 -- 172.21.2.137:0/802904776 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d800b180 con 0x7fc2e80b0830 2021-11-15T19:34:03.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e77fe700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 0x7fc2e8065440 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fc2e8142eb0 tx=0x7fc2d0007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:03.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2d000ce20 con 0x7fc2e80b0830 2021-11-15T19:34:03.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d00072e0 con 0x7fc2e80b0830 2021-11-15T19:34:03.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e8065930 con 0x7fc2e80b0830 2021-11-15T19:34:03.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2d0005800 con 0x7fc2e80b0830 2021-11-15T19:34:03.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.509+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e8143910 con 0x7fc2e80b0830 2021-11-15T19:34:03.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e8144a00 con 0x7fc2e80b0830 2021-11-15T19:34:03.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc2d0010070 con 0x7fc2e80b0830 2021-11-15T19:34:03.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2e57fa700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2cc053610 0x7fc2cc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:03.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fc2d006b0c0 con 0x7fc2e80b0830 2021-11-15T19:34:03.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2e7fff700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2cc053610 0x7fc2cc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:03.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2e7fff700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2cc053610 0x7fc2cc055ad0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fc2e80b4db0 tx=0x7fc2d8012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:03.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.513+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2e8144a00 con 0x7fc2e80b0830 2021-11-15T19:34:03.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:03.601+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2e8144a00 con 0x7fc2e80b0830 2021-11-15T19:34:04.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2e57fa700 1 -- 172.21.2.137:0/802904776 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc2e8144a00 con 0x7fc2e80b0830 2021-11-15T19:34:04.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2cc053610 msgr2=0x7fc2cc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:04.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2cc053610 0x7fc2cc055ad0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fc2e80b4db0 tx=0x7fc2d8012000).stop 2021-11-15T19:34:04.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 msgr2=0x7fc2e8065440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:04.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 0x7fc2e8065440 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fc2e8142eb0 tx=0x7fc2d0007ca0).stop 2021-11-15T19:34:04.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 shutdown_connections 2021-11-15T19:34:04.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2cc053610 0x7fc2cc055ad0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:04.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc2e80b10b0 0x7fc2e8159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:04.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc2e80b0830 0x7fc2e8065440 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:04.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 --2- 172.21.2.137:0/802904776 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc2e805fd20 0x7fc2e80990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:04.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 >> 172.21.2.137:0/802904776 conn(0x7fc2e80b4e60 msgr2=0x7fc2e80b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:04.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 shutdown_connections 2021-11-15T19:34:04.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.453+0000 7fc2eea3b700 1 -- 172.21.2.137:0/802904776 wait complete. 2021-11-15T19:34:04.466 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:34:04.470 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:34:04.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 Processor -- start 2021-11-15T19:34:04.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 -- start start 2021-11-15T19:34:04.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300608f0 0x7f593013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f59300b1660 0x7f59300b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f59300b2c00 0x7f593005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300ad6c0 con 0x7f59300b2c00 2021-11-15T19:34:04.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300b0c80 con 0x7f59300b1660 2021-11-15T19:34:04.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f59350b2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b0f20 con 0x7f59300608f0 2021-11-15T19:34:04.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f59300b1660 0x7f59300b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:04.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f59300b1660 0x7f59300b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37844/0 (socket says 172.21.2.137:37844) 2021-11-15T19:34:04.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 -- 172.21.2.137:0/2441416695 learned_addr learned my addr 172.21.2.137:0/2441416695 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:04.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 -- 172.21.2.137:0/2441416695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300608f0 msgr2=0x7f593013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:04.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 --2- 172.21.2.137:0/2441416695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300608f0 0x7f593013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:04.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 -- 172.21.2.137:0/2441416695 >> v2:172.21.2.111:3300/0 conn(0x7f59300b2c00 msgr2=0x7f593005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:04.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 --2- 172.21.2.137:0/2441416695 >> v2:172.21.2.111:3300/0 conn(0x7f59300b2c00 0x7f593005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:04.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.513+0000 7f592e59c700 1 -- 172.21.2.137:0/2441416695 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300b11c0 con 0x7f59300b1660 2021-11-15T19:34:04.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592e59c700 1 --2- 172.21.2.137:0/2441416695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b1660 0x7f59300b2710 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f5924002f70 tx=0x7f5924006eb0).ready entity=mon.1 client_cookie=deef4802e307cf08 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:04.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592dd9b700 1 -- 172.21.2.137:0/2441416695 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5924010b60 con 0x7f59300b1660 2021-11-15T19:34:04.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592dd9b700 1 -- 172.21.2.137:0/2441416695 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924000e90 con 0x7f59300b1660 2021-11-15T19:34:04.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592dd9b700 1 -- 172.21.2.137:0/2441416695 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59240183d0 con 0x7f59300b1660 2021-11-15T19:34:04.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/2441416695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b1660 msgr2=0x7f59300b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:04.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- 172.21.2.137:0/2441416695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b1660 0x7f59300b2710 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f5924002f70 tx=0x7f5924006eb0).stop 2021-11-15T19:34:04.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/2441416695 shutdown_connections 2021-11-15T19:34:04.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- 172.21.2.137:0/2441416695 >> v2:172.21.2.111:3300/0 conn(0x7f59300b2c00 0x7f593005f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:04.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- 172.21.2.137:0/2441416695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b1660 0x7f59300b2710 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:04.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- 172.21.2.137:0/2441416695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300608f0 0x7f593013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:04.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/2441416695 >> 172.21.2.137:0/2441416695 conn(0x7f5930063980 msgr2=0x7f5930063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:04.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/2441416695 shutdown_connections 2021-11-15T19:34:04.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/2441416695 wait complete. 2021-11-15T19:34:04.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 Processor -- start 2021-11-15T19:34:04.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- start start 2021-11-15T19:34:04.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59300608f0 0x7f59300af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300b1660 0x7f5930141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 0x7f59301423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930139af0 con 0x7f59300608f0 2021-11-15T19:34:04.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593013e3e0 con 0x7f59300b2c00 2021-11-15T19:34:04.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5930139fa0 con 0x7f59300b1660 2021-11-15T19:34:04.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 0x7f59301423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:04.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 0x7f59301423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37854/0 (socket says 172.21.2.137:37854) 2021-11-15T19:34:04.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 -- 172.21.2.137:0/1893554331 learned_addr learned my addr 172.21.2.137:0/1893554331 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:04.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592ed9d700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59300608f0 0x7f59300af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:04.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592e59c700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300b1660 0x7f5930141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:04.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 -- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300b1660 msgr2=0x7f5930141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:04.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300b1660 0x7f5930141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:04.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 -- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59300608f0 msgr2=0x7f59300af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:04.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59300608f0 0x7f59300af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:04.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 -- 172.21.2.137:0/1893554331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592400b1e0 con 0x7f59300b2c00 2021-11-15T19:34:04.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f592f59e700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 0x7f59301423d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f59280032f0 tx=0x7f5928009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:04.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592800f510 con 0x7f59300b2c00 2021-11-15T19:34:04.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592800f670 con 0x7f59300b2c00 2021-11-15T19:34:04.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592800f7e0 con 0x7f59300b2c00 2021-11-15T19:34:04.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5930143a40 con 0x7f59300b2c00 2021-11-15T19:34:04.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593013a650 con 0x7f59300b2c00 2021-11-15T19:34:04.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.517+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930139c30 con 0x7f59300b2c00 2021-11-15T19:34:04.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.521+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f592800f070 con 0x7f59300b2c00 2021-11-15T19:34:04.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.521+0000 7f591ffff700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f590c0536a0 0x7f590c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:04.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.521+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f592806b5b0 con 0x7f59300b2c00 2021-11-15T19:34:04.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.521+0000 7f592ed9d700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f590c0536a0 0x7f590c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:04.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.521+0000 7f592ed9d700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f590c0536a0 0x7f590c055b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f592000a000 tx=0x7f5920008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:04.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.521+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f59280426e0 con 0x7f59300b2c00 2021-11-15T19:34:04.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:04.605+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59300b1ac0 con 0x7f59300b2c00 2021-11-15T19:34:05.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f591ffff700 1 -- 172.21.2.137:0/1893554331 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5928045d00 con 0x7f59300b2c00 2021-11-15T19:34:05.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f590c0536a0 msgr2=0x7f590c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f590c0536a0 0x7f590c055b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f592000a000 tx=0x7f5920008040).stop 2021-11-15T19:34:05.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 msgr2=0x7f59301423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 0x7f59301423d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f59280032f0 tx=0x7f5928009120).stop 2021-11-15T19:34:05.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 shutdown_connections 2021-11-15T19:34:05.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f590c0536a0 0x7f590c055b60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59300b2c00 0x7f59301423d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f59300b1660 0x7f5930141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 --2- 172.21.2.137:0/1893554331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59300608f0 0x7f59300af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 >> 172.21.2.137:0/1893554331 conn(0x7f5930063980 msgr2=0x7f593005c510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:05.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 shutdown_connections 2021-11-15T19:34:05.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.465+0000 7f59350b2700 1 -- 172.21.2.137:0/1893554331 wait complete. 2021-11-15T19:34:05.479 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:34:05.483 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:34:05.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 Processor -- start 2021-11-15T19:34:05.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 -- start start 2021-11-15T19:34:05.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f632005c770 0x7f63200aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63200b0550 0x7f632014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632005cb50 con 0x7f632014aaa0 2021-11-15T19:34:05.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200b1650 con 0x7f632005c770 2021-11-15T19:34:05.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f6325096700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200ad030 con 0x7f63200b0550 2021-11-15T19:34:05.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f631e59c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63200b0550 0x7f632014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f631f59e700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f632014aaa0 0x7f6320140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:49136/0 (socket says 172.21.2.137:49136) 2021-11-15T19:34:05.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f631f59e700 1 -- 172.21.2.137:0/3444261332 learned_addr learned my addr 172.21.2.137:0/3444261332 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:05.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.525+0000 7f631ed9d700 1 --2- 172.21.2.137:0/3444261332 >> v2:172.21.2.111:3300/0 conn(0x7f632005c770 0x7f63200aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631ed9d700 1 -- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63200b0550 msgr2=0x7f632014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:05.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631ed9d700 1 --2- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63200b0550 0x7f632014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631ed9d700 1 -- 172.21.2.137:0/3444261332 >> v1:172.21.2.111:6789/0 conn(0x7f632014aaa0 legacy=0x7f6320140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631ed9d700 1 -- 172.21.2.137:0/3444261332 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200ad2d0 con 0x7f632005c770 2021-11-15T19:34:05.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631ed9d700 1 --2- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f632005c770 0x7f63200aef30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f63180032f0 tx=0x7f63180091d0).ready entity=mon.0 client_cookie=e86de7756d39c904 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:05.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631dd9b700 1 -- 172.21.2.137:0/3444261332 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631800b6c0 con 0x7f632005c770 2021-11-15T19:34:05.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631dd9b700 1 -- 172.21.2.137:0/3444261332 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800b820 con 0x7f632005c770 2021-11-15T19:34:05.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631dd9b700 1 -- 172.21.2.137:0/3444261332 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631800b990 con 0x7f632005c770 2021-11-15T19:34:05.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f632005c770 msgr2=0x7f63200aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 --2- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f632005c770 0x7f63200aef30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f63180032f0 tx=0x7f63180091d0).stop 2021-11-15T19:34:05.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- 172.21.2.137:0/3444261332 shutdown_connections 2021-11-15T19:34:05.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 --2- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63200b0550 0x7f632014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 --2- 172.21.2.137:0/3444261332 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f632005c770 0x7f63200aef30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- 172.21.2.137:0/3444261332 >> 172.21.2.137:0/3444261332 conn(0x7f63200631e0 msgr2=0x7f632005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:05.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- 172.21.2.137:0/3444261332 shutdown_connections 2021-11-15T19:34:05.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- 172.21.2.137:0/3444261332 wait complete. 2021-11-15T19:34:05.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 Processor -- start 2021-11-15T19:34:05.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- start start 2021-11-15T19:34:05.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f632005c770 0x7f6320063a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63200b0550 0x7f6320066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 0x7f6320067040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320156e20 con 0x7f63200b0550 2021-11-15T19:34:05.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320064520 con 0x7f632014aaa0 2021-11-15T19:34:05.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f6325096700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6320064280 con 0x7f632005c770 2021-11-15T19:34:05.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 0x7f6320067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 0x7f6320067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37868/0 (socket says 172.21.2.137:37868) 2021-11-15T19:34:05.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 -- 172.21.2.137:0/2529941395 learned_addr learned my addr 172.21.2.137:0/2529941395 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:05.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 -- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f632005c770 msgr2=0x7f6320063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f632005c770 0x7f6320063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:05.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 -- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63200b0550 msgr2=0x7f6320066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.529+0000 7f631f59e700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63200b0550 0x7f6320066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:05.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f631f59e700 1 -- 172.21.2.137:0/2529941395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318009470 con 0x7f632014aaa0 2021-11-15T19:34:05.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f631f59e700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 0x7f6320067040 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f63200adfd0 tx=0x7f6310007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:05.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63100070d0 con 0x7f632014aaa0 2021-11-15T19:34:05.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310007230 con 0x7f632014aaa0 2021-11-15T19:34:05.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320157280 con 0x7f632014aaa0 2021-11-15T19:34:05.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6310005610 con 0x7f632014aaa0 2021-11-15T19:34:05.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63201451c0 con 0x7f632014aaa0 2021-11-15T19:34:05.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63200ae7f0 con 0x7f632014aaa0 2021-11-15T19:34:05.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6310010070 con 0x7f632014aaa0 2021-11-15T19:34:05.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62fc053610 0x7f62fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f631006abb0 con 0x7f632014aaa0 2021-11-15T19:34:05.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f631ed9d700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62fc053610 0x7f62fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f631ed9d700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62fc053610 0x7f62fc055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f63180032f0 tx=0x7f6318016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:05.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.533+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6310071080 con 0x7f632014aaa0 2021-11-15T19:34:05.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.621+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f63200573d0 con 0x7f632014aaa0 2021-11-15T19:34:05.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.629+0000 7f630ffff700 1 -- 172.21.2.137:0/2529941395 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6310018070 con 0x7f632014aaa0 2021-11-15T19:34:05.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62fc053610 msgr2=0x7f62fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62fc053610 0x7f62fc055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f63180032f0 tx=0x7f6318016000).stop 2021-11-15T19:34:05.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 msgr2=0x7f6320067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 0x7f6320067040 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f63200adfd0 tx=0x7f6310007be0).stop 2021-11-15T19:34:05.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 shutdown_connections 2021-11-15T19:34:05.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62fc053610 0x7f62fc055ad0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f632014aaa0 0x7f6320067040 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63200b0550 0x7f6320066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:05.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 --2- 172.21.2.137:0/2529941395 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f632005c770 0x7f6320063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:05.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 >> 172.21.2.137:0/2529941395 conn(0x7f63200631e0 msgr2=0x7f632014dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:05.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 shutdown_connections 2021-11-15T19:34:05.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.633+0000 7f6325096700 1 -- 172.21.2.137:0/2529941395 wait complete. 2021-11-15T19:34:05.648 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-11-15T19:34:05.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 Processor -- start 2021-11-15T19:34:05.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- start start 2021-11-15T19:34:05.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f98d80b1340 0x7f98d8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f98d80a9f50 0x7f98d80aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d8148190 con 0x7f98d8143f00 2021-11-15T19:34:05.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80b1720 con 0x7f98d80a9f50 2021-11-15T19:34:05.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d8147e70 con 0x7f98d80b1340 2021-11-15T19:34:05.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98dd728700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f98d8143f00 0x7f98d8144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56656/0 (socket says 172.21.2.137:56656) 2021-11-15T19:34:05.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98dd728700 1 -- 172.21.2.137:0/4102945922 learned_addr learned my addr 172.21.2.137:0/4102945922 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:05.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98ddf29700 1 --2- 172.21.2.137:0/4102945922 >> v2:172.21.2.137:3300/0 conn(0x7f98d80b1340 0x7f98d8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98ddf29700 1 -- 172.21.2.137:0/4102945922 >> v2:172.21.2.111:3300/0 conn(0x7f98d80a9f50 msgr2=0x7f98d80aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:05.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98dcf27700 1 -- 172.21.2.137:0/4102945922 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219384536 0 0) 0x7f98d4001110 con 0x7f98d8143f00 2021-11-15T19:34:05.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98ddf29700 1 --2- 172.21.2.137:0/4102945922 >> v2:172.21.2.111:3300/0 conn(0x7f98d80a9f50 0x7f98d80aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:05.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98ddf29700 1 -- 172.21.2.137:0/4102945922 >> v1:172.21.2.137:6789/0 conn(0x7f98d8143f00 legacy=0x7f98d8144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98ddf29700 1 -- 172.21.2.137:0/4102945922 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80af800 con 0x7f98d80b1340 2021-11-15T19:34:05.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98ddf29700 1 --2- 172.21.2.137:0/4102945922 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d80b1340 0x7f98d8147980 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f98c8002f70 tx=0x7f98c8006df0).ready entity=mon.1 client_cookie=145bfb6a743e82d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:05.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98dcf27700 1 -- 172.21.2.137:0/4102945922 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c800d5c0 con 0x7f98d80b1340 2021-11-15T19:34:05.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98dcf27700 1 -- 172.21.2.137:0/4102945922 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8000e90 con 0x7f98d80b1340 2021-11-15T19:34:05.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98dcf27700 1 -- 172.21.2.137:0/4102945922 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c800d910 con 0x7f98d80b1340 2021-11-15T19:34:05.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- 172.21.2.137:0/4102945922 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d80b1340 msgr2=0x7f98d8147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 --2- 172.21.2.137:0/4102945922 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d80b1340 0x7f98d8147980 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f98c8002f70 tx=0x7f98c8006df0).stop 2021-11-15T19:34:05.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- 172.21.2.137:0/4102945922 shutdown_connections 2021-11-15T19:34:05.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 --2- 172.21.2.137:0/4102945922 >> v2:172.21.2.111:3300/0 conn(0x7f98d80a9f50 0x7f98d80aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:05.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 --2- 172.21.2.137:0/4102945922 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d80b1340 0x7f98d8147980 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- 172.21.2.137:0/4102945922 >> 172.21.2.137:0/4102945922 conn(0x7f98d80b4e60 msgr2=0x7f98d80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:05.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.689+0000 7f98e018d700 1 -- 172.21.2.137:0/4102945922 shutdown_connections 2021-11-15T19:34:05.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- 172.21.2.137:0/4102945922 wait complete. 2021-11-15T19:34:05.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 Processor -- start 2021-11-15T19:34:05.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- start start 2021-11-15T19:34:05.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f98d80a9f50 0x7f98d8146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f98d80b1340 0x7f98d80ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 0x7f98d80aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d814a1c0 con 0x7f98d80b1340 2021-11-15T19:34:05.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d814a8f0 con 0x7f98d8143f00 2021-11-15T19:34:05.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d814a3b0 con 0x7f98d80a9f50 2021-11-15T19:34:05.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 0x7f98d80aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 0x7f98d80aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37880/0 (socket says 172.21.2.137:37880) 2021-11-15T19:34:05.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 -- 172.21.2.137:0/589148834 learned_addr learned my addr 172.21.2.137:0/589148834 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:05.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 -- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f98d80a9f50 msgr2=0x7f98d8146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98dd728700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f98d80b1340 0x7f98d80ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98ddf29700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f98d80a9f50 0x7f98d8146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f98d80a9f50 0x7f98d8146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 -- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f98d80b1340 msgr2=0x7f98d80ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:05.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f98d80b1340 0x7f98d80ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:05.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 -- 172.21.2.137:0/589148834 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c800b180 con 0x7f98d8143f00 2021-11-15T19:34:05.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98dd728700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f98d80b1340 0x7f98d80ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:05.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98ddf29700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f98d80a9f50 0x7f98d8146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:05.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98de72a700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 0x7f98d80aced0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f98d00032f0 tx=0x7f98d00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:05.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d000d4a0 con 0x7f98d8143f00 2021-11-15T19:34:05.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000d600 con 0x7f98d8143f00 2021-11-15T19:34:05.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d814a650 con 0x7f98d8143f00 2021-11-15T19:34:05.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d000d960 con 0x7f98d8143f00 2021-11-15T19:34:05.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d80ad3c0 con 0x7f98d8143f00 2021-11-15T19:34:05.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80af4e0 con 0x7f98d8143f00 2021-11-15T19:34:05.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98d0018030 con 0x7f98d8143f00 2021-11-15T19:34:05.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98c6ffd700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f98b80534f0 0x7f98b80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:05.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f98d006afd0 con 0x7f98d8143f00 2021-11-15T19:34:05.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.693+0000 7f98ddf29700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f98b80534f0 0x7f98b80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:05.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.697+0000 7f98ddf29700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f98b80534f0 0x7f98b80559b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f98c8015000 tx=0x7f98c8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:05.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.697+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98d00424c0 con 0x7f98d8143f00 2021-11-15T19:34:05.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:05.809+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f98d805faf0 con 0x7f98d8143f00 2021-11-15T19:34:06.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98c6ffd700 1 -- 172.21.2.137:0/589148834 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v306) v1 ==== 138+0+0 (secure 0 0 0) 0x7f98d0045ae0 con 0x7f98d8143f00 2021-11-15T19:34:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f98b80534f0 msgr2=0x7f98b80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f98b80534f0 0x7f98b80559b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f98c8015000 tx=0x7f98c8014000).stop 2021-11-15T19:34:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 msgr2=0x7f98d80aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:06.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 0x7f98d80aced0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f98d00032f0 tx=0x7f98d00091a0).stop 2021-11-15T19:34:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 shutdown_connections 2021-11-15T19:34:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f98b80534f0 0x7f98b80559b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f98d8143f00 0x7f98d80aced0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:06.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f98d80b1340 0x7f98d80ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 --2- 172.21.2.137:0/589148834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f98d80a9f50 0x7f98d8146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 >> 172.21.2.137:0/589148834 conn(0x7f98d80b4e60 msgr2=0x7f98d80af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 shutdown_connections 2021-11-15T19:34:06.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.469+0000 7f98e018d700 1 -- 172.21.2.137:0/589148834 wait complete. 2021-11-15T19:34:06.485 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:34:06.486 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:34:06.486 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-11-15T19:34:06.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.525+0000 7f80090a2700 1 Processor -- start 2021-11-15T19:34:06.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.525+0000 7f80090a2700 1 -- start start 2021-11-15T19:34:06.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80040ac3c0 0x7f80040ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:06.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f80040609f0 0x7f80041447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:06.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8004097c50 con 0x7f80040b2d50 2021-11-15T19:34:06.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80040ac120 con 0x7f80040609f0 2021-11-15T19:34:06.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040979b0 con 0x7f80040ac3c0 2021-11-15T19:34:06.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f80040b2d50 0x7f80041440c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56670/0 (socket says 172.21.2.137:56670) 2021-11-15T19:34:06.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 -- 172.21.2.137:0/4031296066 learned_addr learned my addr 172.21.2.137:0/4031296066 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:06.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800359e700 1 --2- 172.21.2.137:0/4031296066 >> v2:172.21.2.137:3300/0 conn(0x7f80040609f0 0x7f80041447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:06.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800359e700 1 -- 172.21.2.137:0/4031296066 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80040ac3c0 msgr2=0x7f80040ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:06.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800359e700 1 --2- 172.21.2.137:0/4031296066 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80040ac3c0 0x7f80040ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:06.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800359e700 1 -- 172.21.2.137:0/4031296066 >> v1:172.21.2.137:6789/0 conn(0x7f80040b2d50 legacy=0x7f80041440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:06.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800359e700 1 -- 172.21.2.137:0/4031296066 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004067c60 con 0x7f80040609f0 2021-11-15T19:34:06.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800359e700 1 --2- 172.21.2.137:0/4031296066 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040609f0 0x7f80041447d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f7ffc0032f0 tx=0x7f7ffc0091d0).ready entity=mon.1 client_cookie=be2b0f19812f3a20 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:06.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f8001d9b700 1 -- 172.21.2.137:0/4031296066 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ffc009ea0 con 0x7f80040609f0 2021-11-15T19:34:06.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f8001d9b700 1 -- 172.21.2.137:0/4031296066 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00b8a0 con 0x7f80040609f0 2021-11-15T19:34:06.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f8001d9b700 1 -- 172.21.2.137:0/4031296066 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ffc00ba10 con 0x7f80040609f0 2021-11-15T19:34:06.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- 172.21.2.137:0/4031296066 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040609f0 msgr2=0x7f80041447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:06.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- 172.21.2.137:0/4031296066 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040609f0 0x7f80041447d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f7ffc0032f0 tx=0x7f7ffc0091d0).stop 2021-11-15T19:34:06.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- 172.21.2.137:0/4031296066 shutdown_connections 2021-11-15T19:34:06.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- 172.21.2.137:0/4031296066 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040609f0 0x7f80041447d0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:06.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- 172.21.2.137:0/4031296066 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f80040ac3c0 0x7f80040ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:06.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- 172.21.2.137:0/4031296066 >> 172.21.2.137:0/4031296066 conn(0x7f80040b7070 msgr2=0x7f80040b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:06.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- 172.21.2.137:0/4031296066 shutdown_connections 2021-11-15T19:34:06.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- 172.21.2.137:0/4031296066 wait complete. 2021-11-15T19:34:06.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 Processor -- start 2021-11-15T19:34:06.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- start start 2021-11-15T19:34:06.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80040609f0 0x7f8004062ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:06.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 0x7f8004142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:06.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f800409cd40 0x7f8004143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:06.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800409ad50 con 0x7f80040609f0 2021-11-15T19:34:06.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800409aff0 con 0x7f80040ac3c0 2021-11-15T19:34:06.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f80090a2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040aec40 con 0x7f800409cd40 2021-11-15T19:34:06.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 0x7f8004142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:06.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 0x7f8004142f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37892/0 (socket says 172.21.2.137:37892) 2021-11-15T19:34:06.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 -- 172.21.2.137:0/3750013409 learned_addr learned my addr 172.21.2.137:0/3750013409 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:06.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 -- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f800409cd40 msgr2=0x7f8004143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:06.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f800409cd40 0x7f8004143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:06.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 -- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80040609f0 msgr2=0x7f8004062ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:06.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80040609f0 0x7f8004062ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:06.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.529+0000 7f800259c700 1 -- 172.21.2.137:0/3750013409 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009470 con 0x7f80040ac3c0 2021-11-15T19:34:06.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f800259c700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 0x7f8004142f50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f80040b4e60 tx=0x7f7ff8007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:06.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff800ce30 con 0x7f80040ac3c0 2021-11-15T19:34:06.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff80072e0 con 0x7f80040ac3c0 2021-11-15T19:34:06.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8005800 con 0x7f80040ac3c0 2021-11-15T19:34:06.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8004144d10 con 0x7f80040ac3c0 2021-11-15T19:34:06.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80040ae6d0 con 0x7f80040ac3c0 2021-11-15T19:34:06.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80040aee00 con 0x7f80040ac3c0 2021-11-15T19:34:06.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ff8010070 con 0x7f80040ac3c0 2021-11-15T19:34:06.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fe0053660 0x7f7fe0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:06.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7ff806ae10 con 0x7f80040ac3c0 2021-11-15T19:34:06.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f8002d9d700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fe0053660 0x7f7fe0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:06.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f8002d9d700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fe0053660 0x7f7fe0055b20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:06.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.533+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ff8042140 con 0x7f80040ac3c0 2021-11-15T19:34:06.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:06.649+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f80040573d0 con 0x7f80040ac3c0 2021-11-15T19:34:07.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.477+0000 7f7ff3fff700 1 -- 172.21.2.137:0/3750013409 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v307) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7ff8045760 con 0x7f80040ac3c0 2021-11-15T19:34:07.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fe0053660 msgr2=0x7f7fe0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fe0053660 0x7f7fe0055b20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4006a80).stop 2021-11-15T19:34:07.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 msgr2=0x7f8004142f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 0x7f8004142f50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f80040b4e60 tx=0x7f7ff8007ca0).stop 2021-11-15T19:34:07.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 shutdown_connections 2021-11-15T19:34:07.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7fe0053660 0x7f7fe0055b20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f800409cd40 0x7f8004143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f80040ac3c0 0x7f8004142f50 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 --2- 172.21.2.137:0/3750013409 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f80040609f0 0x7f8004062ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 >> 172.21.2.137:0/3750013409 conn(0x7f80040b7070 msgr2=0x7f8004141430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:07.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 shutdown_connections 2021-11-15T19:34:07.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.481+0000 7f80090a2700 1 -- 172.21.2.137:0/3750013409 wait complete. 2021-11-15T19:34:07.497 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:34:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 Processor -- start 2021-11-15T19:34:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- start start 2021-11-15T19:34:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f40240afde0 0x7f40240acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f402413f5c0 0x7f402413fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240aedf0 con 0x7f40240b0fe0 2021-11-15T19:34:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240ae070 con 0x7f40240afde0 2021-11-15T19:34:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240afbd0 con 0x7f402413f5c0 2021-11-15T19:34:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f40240b0fe0 0x7f40240af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56682/0 (socket says 172.21.2.137:56682) 2021-11-15T19:34:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 -- 172.21.2.137:0/1804996264 learned_addr learned my addr 172.21.2.137:0/1804996264 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f40237fe700 1 --2- 172.21.2.137:0/1804996264 >> v2:172.21.2.137:3300/0 conn(0x7f402413f5c0 0x7f402413fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f40237fe700 1 -- 172.21.2.137:0/1804996264 >> v2:172.21.2.111:3300/0 conn(0x7f40240afde0 msgr2=0x7f40240acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f40237fe700 1 --2- 172.21.2.137:0/1804996264 >> v2:172.21.2.111:3300/0 conn(0x7f40240afde0 0x7f40240acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f40237fe700 1 -- 172.21.2.137:0/1804996264 >> v1:172.21.2.137:6789/0 conn(0x7f40240b0fe0 legacy=0x7f40240af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f40237fe700 1 -- 172.21.2.137:0/1804996264 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240b13c0 con 0x7f402413f5c0 2021-11-15T19:34:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f40237fe700 1 --2- 172.21.2.137:0/1804996264 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f402413f5c0 0x7f402413fa10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f40240ad960 tx=0x7f401c0091d0).ready entity=mon.1 client_cookie=bd4da992763bcb37 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4021ffb700 1 -- 172.21.2.137:0/1804996264 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f401c009ea0 con 0x7f402413f5c0 2021-11-15T19:34:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4021ffb700 1 -- 172.21.2.137:0/1804996264 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00b860 con 0x7f402413f5c0 2021-11-15T19:34:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4021ffb700 1 -- 172.21.2.137:0/1804996264 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f401c00b9d0 con 0x7f402413f5c0 2021-11-15T19:34:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- 172.21.2.137:0/1804996264 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f402413f5c0 msgr2=0x7f402413fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- 172.21.2.137:0/1804996264 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f402413f5c0 0x7f402413fa10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f40240ad960 tx=0x7f401c0091d0).stop 2021-11-15T19:34:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- 172.21.2.137:0/1804996264 shutdown_connections 2021-11-15T19:34:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- 172.21.2.137:0/1804996264 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f402413f5c0 0x7f402413fa10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- 172.21.2.137:0/1804996264 >> v2:172.21.2.111:3300/0 conn(0x7f40240afde0 0x7f40240acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- 172.21.2.137:0/1804996264 >> 172.21.2.137:0/1804996264 conn(0x7f40240b5f50 msgr2=0x7f40240b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- 172.21.2.137:0/1804996264 shutdown_connections 2021-11-15T19:34:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- 172.21.2.137:0/1804996264 wait complete. 2021-11-15T19:34:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 Processor -- start 2021-11-15T19:34:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- start start 2021-11-15T19:34:07.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 0x7f4024064b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40240b0fe0 0x7f4024065140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f402413f5c0 0x7f40241120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024111c90 con 0x7f40240b0fe0 2021-11-15T19:34:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402410f7b0 con 0x7f40240afde0 2021-11-15T19:34:07.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f402944c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402410fa50 con 0x7f402413f5c0 2021-11-15T19:34:07.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 0x7f4024064b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 0x7f4024064b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37906/0 (socket says 172.21.2.137:37906) 2021-11-15T19:34:07.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 -- 172.21.2.137:0/537143351 learned_addr learned my addr 172.21.2.137:0/537143351 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:07.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 -- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f402413f5c0 msgr2=0x7f40241120f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:07.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f402413f5c0 0x7f40241120f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 -- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40240b0fe0 msgr2=0x7f4024065140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:07.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40240b0fe0 0x7f4024065140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.541+0000 7f4022ffd700 1 -- 172.21.2.137:0/537143351 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009470 con 0x7f40240afde0 2021-11-15T19:34:07.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f4022ffd700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 0x7f4024064b00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f4024111b60 tx=0x7f4014007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:07.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f401400ce20 con 0x7f40240afde0 2021-11-15T19:34:07.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40140072e0 con 0x7f40240afde0 2021-11-15T19:34:07.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4014005800 con 0x7f40240afde0 2021-11-15T19:34:07.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4024110810 con 0x7f40240afde0 2021-11-15T19:34:07.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4024066d30 con 0x7f40240afde0 2021-11-15T19:34:07.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40240ad690 con 0x7f40240afde0 2021-11-15T19:34:07.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4014010070 con 0x7f40240afde0 2021-11-15T19:34:07.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f401bfff700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40080536a0 0x7f4008055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f401406ae00 con 0x7f40240afde0 2021-11-15T19:34:07.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f40227fc700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40080536a0 0x7f4008055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.545+0000 7f40227fc700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40080536a0 0x7f4008055b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f400c002f70 tx=0x7f400c006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:07.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.549+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4014042130 con 0x7f40240afde0 2021-11-15T19:34:07.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.629+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f40240573d0 con 0x7f40240afde0 2021-11-15T19:34:07.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f401bfff700 1 -- 172.21.2.137:0/537143351 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4014018030 con 0x7f40240afde0 2021-11-15T19:34:07.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40080536a0 msgr2=0x7f4008055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40080536a0 0x7f4008055b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f400c002f70 tx=0x7f400c006a00).stop 2021-11-15T19:34:07.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 msgr2=0x7f4024064b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 0x7f4024064b00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f4024111b60 tx=0x7f4014007c40).stop 2021-11-15T19:34:07.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 shutdown_connections 2021-11-15T19:34:07.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f40080536a0 0x7f4008055b60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f402413f5c0 0x7f40241120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40240b0fe0 0x7f4024065140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 --2- 172.21.2.137:0/537143351 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40240afde0 0x7f4024064b00 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 >> 172.21.2.137:0/537143351 conn(0x7f40240b5f50 msgr2=0x7f40240608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:07.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 shutdown_connections 2021-11-15T19:34:07.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.645+0000 7f402944c700 1 -- 172.21.2.137:0/537143351 wait complete. 2021-11-15T19:34:07.658 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:34:07.659 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:07.671 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:07.684 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:07.697 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:07.710 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:07.722 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:34:07.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:07.722 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:07.723 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:07.732 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:34:07.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:07.733 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:07.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:07.734 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:07.735 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:07.739 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:34:07.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:07.740 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:07.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:07.741 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:07.742 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:34:07.747 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:34:07.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:07.748 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:34:07.749 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:34:07.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 Processor -- start 2021-11-15T19:34:07.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 -- start start 2021-11-15T19:34:07.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80acab0 0x7f6ef80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6ef80b1180 0x7f6ef80b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef80aecf0 con 0x7f6ef80af2f0 2021-11-15T19:34:07.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef813f180 con 0x7f6ef80b1180 2021-11-15T19:34:07.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.793+0000 7f6efe13d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80aef20 con 0x7f6ef80acab0 2021-11-15T19:34:07.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6ef80b1180 0x7f6ef80b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6ef80b1180 0x7f6ef80b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:45142/0 (socket says 172.21.2.137:45142) 2021-11-15T19:34:07.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef77fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80acab0 0x7f6ef80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef7fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f6ef80af2f0 0x7f6ef8142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:49188/0 (socket says 172.21.2.137:49188) 2021-11-15T19:34:07.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 -- 172.21.2.137:0/782863687 learned_addr learned my addr 172.21.2.137:0/782863687 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:07.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 -- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80acab0 msgr2=0x7f6ef80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:07.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 --2- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80acab0 0x7f6ef80b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 -- 172.21.2.137:0/782863687 >> v1:172.21.2.111:6789/0 conn(0x7f6ef80af2f0 legacy=0x7f6ef8142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 -- 172.21.2.137:0/782863687 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80ace90 con 0x7f6ef80b1180 2021-11-15T19:34:07.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef6ffd700 1 --2- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80b1180 0x7f6ef80b2550 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6ee0002f70 tx=0x7f6ee0006eb0).ready entity=mon.0 client_cookie=a9a3b888d0c3ec27 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:07.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef67fc700 1 -- 172.21.2.137:0/782863687 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee000d570 con 0x7f6ef80b1180 2021-11-15T19:34:07.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef67fc700 1 -- 172.21.2.137:0/782863687 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0000e90 con 0x7f6ef80b1180 2021-11-15T19:34:07.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.797+0000 7f6ef67fc700 1 -- 172.21.2.137:0/782863687 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee000d900 con 0x7f6ef80b1180 2021-11-15T19:34:07.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80b1180 msgr2=0x7f6ef80b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 --2- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80b1180 0x7f6ef80b2550 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6ee0002f70 tx=0x7f6ee0006eb0).stop 2021-11-15T19:34:07.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/782863687 shutdown_connections 2021-11-15T19:34:07.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 --2- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80b1180 0x7f6ef80b2550 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 --2- 172.21.2.137:0/782863687 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80acab0 0x7f6ef80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:07.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/782863687 >> 172.21.2.137:0/782863687 conn(0x7f6ef80630f0 msgr2=0x7f6ef80634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:07.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/782863687 shutdown_connections 2021-11-15T19:34:07.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/782863687 wait complete. 2021-11-15T19:34:07.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 Processor -- start 2021-11-15T19:34:07.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- start start 2021-11-15T19:34:07.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 0x7f6ef80650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80af2f0 0x7f6ef810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80b1180 0x7f6ef810f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81563a0 con 0x7f6ef80af2f0 2021-11-15T19:34:07.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8110000 con 0x7f6ef80acab0 2021-11-15T19:34:07.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81565c0 con 0x7f6ef80b1180 2021-11-15T19:34:07.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 0x7f6ef80650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 0x7f6ef80650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37918/0 (socket says 172.21.2.137:37918) 2021-11-15T19:34:07.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 -- 172.21.2.137:0/718448839 learned_addr learned my addr 172.21.2.137:0/718448839 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:07.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 -- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80b1180 msgr2=0x7f6ef810f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80b1180 0x7f6ef810f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 -- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80af2f0 msgr2=0x7f6ef810ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:07.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80af2f0 0x7f6ef810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:07.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 -- 172.21.2.137:0/718448839 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee000b1e0 con 0x7f6ef80acab0 2021-11-15T19:34:07.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef77fe700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 0x7f6ef80650d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6ee8007a50 tx=0x7f6ee8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:07.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee800ba90 con 0x7f6ef80acab0 2021-11-15T19:34:07.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee800d020 con 0x7f6ef80acab0 2021-11-15T19:34:07.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef8112410 con 0x7f6ef80acab0 2021-11-15T19:34:07.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee800bde0 con 0x7f6ef80acab0 2021-11-15T19:34:07.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef8156c00 con 0x7f6ef80acab0 2021-11-15T19:34:07.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef8156780 con 0x7f6ef80acab0 2021-11-15T19:34:07.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ee8010430 con 0x7f6ef80acab0 2021-11-15T19:34:07.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef4ff9700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6edc0536a0 0x7f6edc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:07.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6ee806be10 con 0x7f6ef80acab0 2021-11-15T19:34:07.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.801+0000 7f6ef6ffd700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6edc0536a0 0x7f6edc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:07.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.805+0000 7f6ef6ffd700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6edc0536a0 0x7f6edc055b60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f6ee0002f70 tx=0x7f6ee0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:07.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.805+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ee80432a0 con 0x7f6ef80acab0 2021-11-15T19:34:07.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.885+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6ef80b1820 con 0x7f6ef80acab0 2021-11-15T19:34:07.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6ef4ff9700 1 -- 172.21.2.137:0/718448839 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v96) v1 ==== 81+0+28828 (secure 0 0 0) 0x7f6ee802c0b0 con 0x7f6ef80acab0 2021-11-15T19:34:07.898 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:07.898 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:07.899 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 96, 2021-11-15T19:34:07.899 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:34:07.899 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:34:07.899 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:34:05.459449+0000", 2021-11-15T19:34:07.900 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:07.900 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:07.900 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:34:07.900 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:34:07.901 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:34:07.901 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:34:07.901 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:34:07.901 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:34:07.901 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:34:07.902 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:07.902 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:34:07.902 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:34:07.902 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:34:07.903 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:34:07.903 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:34:07.903 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 18, 2021-11-15T19:34:07.903 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:34:07.903 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:34:07.904 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:34:07.904 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:34:07.904 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:34:07.904 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.905 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:34:07.905 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:34:07.905 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:34:07.905 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:07.906 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:07.906 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:07.906 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:07.906 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:07.907 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:07.907 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:07.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:07.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:34:07.907 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:34:07.908 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:34:07.908 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:34:07.908 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:34:07.908 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:07.909 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:07.909 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:07.909 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:07.909 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:07.910 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:07.910 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:07.910 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.910 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:34:07.910 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:07.911 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:07.911 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:07.911 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:07.911 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:07.912 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:07.912 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:07.912 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:07.912 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:07.913 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:07.913 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:07.913 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:07.913 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:07.914 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:07.914 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:07.914 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:07.914 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:07.914 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:07.915 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:07.915 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:07.915 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:07.915 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:07.916 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:07.916 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:07.916 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:07.916 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:07.916 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.917 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:07.917 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:07.917 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:07.917 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:07.918 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:07.918 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:07.918 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:07.918 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:07.918 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:07.919 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:07.919 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:07.919 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:34:07.919 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:34:07.920 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.920 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:07.920 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:34:07.920 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.921 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.921 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.921 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:34:07.921 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:34:07.921 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:34:07.922 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:07.922 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:07.922 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:07.922 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:07.922 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:07.923 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:07.923 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:07.923 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:07.923 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:07.924 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:07.924 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:07.924 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:07.924 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:07.925 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:07.925 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:07.925 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:07.925 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:07.925 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:07.926 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:07.926 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:07.926 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.926 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:34:07.927 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:07.927 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:07.927 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:07.927 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:07.928 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:07.928 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:07.928 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:07.928 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:07.928 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:07.929 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:07.929 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:07.929 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:07.929 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:07.930 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:07.930 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:07.930 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:07.930 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:07.930 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:07.931 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:07.931 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:07.931 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:07.931 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:07.932 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:07.932 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:07.932 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:07.932 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:07.933 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.933 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:07.933 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:07.933 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:07.933 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:07.934 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:07.934 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:07.934 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:07.934 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:07.935 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:07.935 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:07.935 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:07.935 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:34:07.935 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:07.936 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:34:07.936 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.936 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.936 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:07.937 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:34:07.937 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.937 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:07.937 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:34:07.938 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:07.938 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:07.938 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:07.938 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:07.939 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:07.939 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:07.939 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:07.939 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:07.940 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:07.940 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:07.940 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:07.940 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.941 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.941 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.941 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:34:07.941 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.941 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.942 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.942 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.942 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:34:07.942 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.942 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.943 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.943 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.943 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:07.943 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.944 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.944 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.944 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:34:07.944 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.945 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.945 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.945 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.945 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:34:07.945 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.946 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.946 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.946 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.946 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:07.947 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.947 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.947 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.947 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:34:07.947 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.948 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.948 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.948 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.948 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:34:07.948 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.949 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.949 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.949 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.949 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:07.950 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.950 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.950 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.950 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:34:07.950 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.951 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.951 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.951 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.951 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:34:07.952 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:07.952 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.952 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.952 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.952 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:34:07.953 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:34:07.953 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:34:07.953 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:34:07.953 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:07.954 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:07.954 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:07.954 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.954 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.954 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.955 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:07.955 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:34:07.955 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:07.955 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:07.956 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:07.956 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:07.956 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:07.956 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:07.957 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:07.957 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:07.957 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:07.957 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:07.957 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:07.958 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.958 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.958 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.958 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:34:07.959 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.959 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.959 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.959 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.959 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:34:07.960 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.960 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.960 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.960 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.960 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:07.961 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.961 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.961 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.961 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:34:07.962 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.962 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.962 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.962 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.963 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:34:07.963 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.963 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.963 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.964 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.964 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:07.964 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.964 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.964 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.965 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:34:07.965 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.965 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.965 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.966 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.966 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:34:07.966 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.966 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.966 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.967 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.967 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:07.967 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.967 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.968 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.968 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:34:07.968 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.968 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.969 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.969 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.969 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:34:07.969 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:07.969 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.970 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.970 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.970 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:34:07.970 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:34:07.971 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:34:07.971 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:34:07.971 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:07.971 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:07.972 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:07.972 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.972 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.972 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.972 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:07.973 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:34:07.973 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:07.973 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:07.973 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:07.974 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:07.974 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:07.974 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:07.974 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:07.974 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:07.975 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:07.975 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:07.975 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:07.975 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.976 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.976 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.976 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:34:07.976 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.976 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.977 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.977 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.977 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:34:07.977 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.978 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.978 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.978 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.978 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:07.979 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.979 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.979 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.979 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:34:07.979 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.980 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.980 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.980 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.980 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:34:07.981 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.981 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.981 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.981 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.981 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:07.982 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.982 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.982 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.982 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:34:07.983 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.983 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.983 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.983 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.983 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:34:07.984 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.984 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.984 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.984 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.985 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:07.985 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.985 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.985 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.986 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:34:07.986 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.986 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.986 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.986 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.987 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:34:07.987 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:07.987 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.987 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.988 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.988 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:34:07.988 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:34:07.988 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:34:07.989 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:34:07.989 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:07.989 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:07.989 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:07.989 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.990 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.990 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.990 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:07.990 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:34:07.991 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:07.991 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:07.991 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:07.991 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:07.992 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:07.992 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:07.992 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:07.992 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:07.992 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:07.993 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:07.993 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:07.993 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.993 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.994 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.994 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:34:07.994 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:07.994 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.994 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.995 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.995 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:34:07.995 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:07.995 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.996 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.996 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.996 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:07.996 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:07.997 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.997 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:07.997 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:34:07.997 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:07.997 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.998 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:07.998 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:07.998 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:34:07.998 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:07.999 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:07.999 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:07.999 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:07.999 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:08.000 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.000 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.000 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.000 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:34:08.000 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:08.001 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.001 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.001 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.001 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:34:08.002 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:08.002 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.002 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.002 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.003 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:08.003 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.003 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.003 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.003 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:34:08.004 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:08.004 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.004 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.004 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.004 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:34:08.005 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:08.005 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.005 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.005 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.006 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:34:08.006 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:34:08.006 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:34:08.006 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:34:08.007 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:08.007 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:08.007 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:08.007 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.007 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.008 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.008 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:08.008 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:34:08.008 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:08.009 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:08.009 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:08.009 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:08.009 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:08.009 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:08.010 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:08.010 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 90, 2021-11-15T19:34:08.010 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:08.010 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:08.011 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:08.011 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.011 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.011 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.012 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:34:08.012 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.012 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.012 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.012 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.013 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:34:08.013 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.013 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.013 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.014 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.014 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:08.014 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.014 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.015 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.015 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:34:08.015 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.015 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.016 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.016 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.016 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:34:08.016 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.016 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.017 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.017 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.017 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:08.017 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.018 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.018 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.018 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:34:08.018 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.018 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.019 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.019 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.019 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:34:08.019 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.020 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.020 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.020 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.020 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:08.021 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.021 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.021 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.021 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:34:08.021 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.022 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.022 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.022 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.022 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:34:08.023 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:08.023 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.023 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.023 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.023 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:34:08.024 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:34:08.024 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:34:08.024 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:34:08.024 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:08.025 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:08.025 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:08.025 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.025 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.025 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.026 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:08.026 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:34:08.026 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:08.026 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:08.027 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:08.027 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:08.027 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:08.027 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:08.028 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:08.028 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 81, 2021-11-15T19:34:08.028 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:08.028 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:08.028 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:08.029 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.029 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.029 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.029 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:34:08.030 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.030 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.030 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.030 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.030 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:34:08.031 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.031 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.031 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.031 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.032 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:08.032 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.032 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.032 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.033 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:34:08.033 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.033 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.033 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.034 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.034 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:34:08.034 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.034 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.034 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.035 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.035 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:08.035 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.035 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.036 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.036 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:34:08.036 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.036 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.037 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.037 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.037 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:34:08.037 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.037 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.038 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.038 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.038 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:08.038 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.039 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.039 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.039 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:34:08.039 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.040 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.040 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.040 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.040 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:34:08.040 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:08.041 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.041 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.041 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.041 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:34:08.042 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:34:08.042 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:34:08.042 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:34:08.042 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:08.043 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:08.043 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:08.043 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.043 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.043 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.044 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:08.044 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:34:08.044 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:08.044 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:08.045 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:08.045 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:08.045 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:08.045 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:08.045 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:08.046 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 90, 2021-11-15T19:34:08.046 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:08.046 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:08.046 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:08.047 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.047 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.047 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.047 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:34:08.048 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.048 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.048 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.048 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.048 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:34:08.049 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.049 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.049 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.049 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.050 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:08.050 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.050 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.050 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.050 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:34:08.051 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.051 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.051 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.051 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.052 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:34:08.052 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.052 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.052 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.053 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.053 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:08.053 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.053 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.054 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.054 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:34:08.054 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.054 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.054 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.055 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.055 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:34:08.055 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.055 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.056 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.056 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.056 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:08.056 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.056 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.057 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.057 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:34:08.057 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.057 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.058 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.058 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.058 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:34:08.058 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:08.059 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.059 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.059 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.059 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:34:08.059 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:34:08.060 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:34:08.060 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:34:08.060 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:08.060 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:08.061 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:08.061 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.061 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.061 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.061 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:08.062 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:34:08.062 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:08.062 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:08.062 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:08.063 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:08.063 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:08.063 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:08.063 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:08.063 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 91, 2021-11-15T19:34:08.064 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:08.064 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:08.064 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:08.064 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.065 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.065 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.065 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:34:08.065 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.065 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.066 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.066 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.066 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:34:08.066 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.067 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.067 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.067 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.067 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:08.068 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.068 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.068 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.068 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:34:08.068 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.069 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.069 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.069 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.069 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:34:08.070 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.070 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.070 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.070 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.070 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:08.071 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.071 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.071 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.071 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:34:08.072 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.072 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.072 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.072 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.073 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:34:08.073 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.073 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.073 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.073 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.074 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:08.074 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:08.074 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.074 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:08.075 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:34:08.075 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.075 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.075 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.076 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:08.076 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:34:08.076 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:08.076 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.076 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.077 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.077 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:34:08.077 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:34:08.077 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:34:08.078 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:34:08.078 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:08.078 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:08.078 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:08.078 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:08.079 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.079 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:08.079 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:34:08.079 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.080 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:08.080 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.080 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.080 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.081 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.081 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.081 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:34:08.081 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.081 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.082 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.082 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:08.082 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.082 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.083 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.083 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.083 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.083 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:34:08.083 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.084 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.084 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.084 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:08.084 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.085 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.085 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.085 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.085 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.085 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:34:08.086 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.086 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.086 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.086 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:08.087 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.087 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.087 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.087 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.088 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.088 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:34:08.088 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.088 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.088 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.089 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:08.089 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.089 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.089 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.090 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.090 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.090 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:34:08.090 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.091 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.091 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.091 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:08.091 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.091 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.092 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.092 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.092 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.092 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:34:08.093 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.093 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.093 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.093 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:08.093 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.094 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.094 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.094 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.094 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.095 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:34:08.095 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.095 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.095 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:08.095 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:08.096 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:08.096 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:08.096 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:08.096 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:08.097 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:08.097 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:34:08.097 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:08.097 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.097 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:08.098 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:34:08.098 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:34:08.098 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:34:08.098 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:34:08.099 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:34:08.099 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/3296577708": "2021-11-16T19:34:01.883502+0000", 2021-11-15T19:34:08.099 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/3296577708": "2021-11-16T19:34:01.883502+0000" 2021-11-15T19:34:08.099 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.100 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:34:08.100 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:34:08.100 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:34:08.100 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:34:08.100 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:34:08.101 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:34:08.101 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:34:08.101 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:34:08.101 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:08.102 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:08.102 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:34:08.102 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:34:08.102 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:34:08.102 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:34:08.103 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:34:08.103 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:08.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6edc0536a0 msgr2=0x7f6edc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6edc0536a0 0x7f6edc055b60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f6ee0002f70 tx=0x7f6ee0015000).stop 2021-11-15T19:34:08.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 msgr2=0x7f6ef80650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 0x7f6ef80650d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6ee8007a50 tx=0x7f6ee8009040).stop 2021-11-15T19:34:08.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 shutdown_connections 2021-11-15T19:34:08.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6edc0536a0 0x7f6edc055b60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ef80b1180 0x7f6ef810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ef80af2f0 0x7f6ef810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 --2- 172.21.2.137:0/718448839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ef80acab0 0x7f6ef80650d0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 >> 172.21.2.137:0/718448839 conn(0x7f6ef80630f0 msgr2=0x7f6ef8069890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:08.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 shutdown_connections 2021-11-15T19:34:08.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:07.889+0000 7f6efe13d700 1 -- 172.21.2.137:0/718448839 wait complete. 2021-11-15T19:34:08.108 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:08.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbf01c700 1 Processor -- start 2021-11-15T19:34:08.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbf01c700 1 -- start start 2021-11-15T19:34:08.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbf01c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 0x7fddb814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbf01c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb8062820 con 0x7fddb80614f0 2021-11-15T19:34:08.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbf01c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80b2f50 con 0x7fddb80b2b70 2021-11-15T19:34:08.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbf01c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80622c0 con 0x7fddb814b7c0 2021-11-15T19:34:08.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbcdb8700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fddb80b2b70 0x7fddb8146280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56708/0 (socket says 172.21.2.137:56708) 2021-11-15T19:34:08.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbcdb8700 1 -- 172.21.2.137:0/1620395947 learned_addr learned my addr 172.21.2.137:0/1620395947 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:08.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501559357 0 0) 0x7fddb80b2f50 con 0x7fddb80b2b70 2021-11-15T19:34:08.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd98003260 con 0x7fddb80b2b70 2021-11-15T19:34:08.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddbd5b9700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 0x7fddb814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857467260 0 0) 0x7fdd98003260 con 0x7fddb80b2b70 2021-11-15T19:34:08.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 msgr2=0x7fddb814dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:08.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 0x7fddb814dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 >> v1:172.21.2.111:6789/0 conn(0x7fddb80614f0 legacy=0x7fddb8146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:08.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb81470a0 con 0x7fddb80b2b70 2021-11-15T19:34:08.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fdda0001660 con 0x7fddb80b2b70 2021-11-15T19:34:08.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 >> v1:172.21.2.137:6789/0 conn(0x7fddb80b2b70 legacy=0x7fddb8146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd98003780 0x7fdd98003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98004500 0x7fdd98004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.153+0000 7fddb77fe700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 0x7fdd98004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80622c0 con 0x7fdd98004500 2021-11-15T19:34:08.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9800b830 con 0x7fdd98003780 2021-11-15T19:34:08.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9800b9f0 con 0x7fddb814b7c0 2021-11-15T19:34:08.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd98003780 0x7fdd98003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 -- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 msgr2=0x7fdd98004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:08.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb814b7c0 0x7fdd98004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 -- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98004500 msgr2=0x7fdd98004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:08.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98004500 0x7fdd98004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 -- 172.21.2.137:0/1620395947 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98003260 con 0x7fdd98003780 2021-11-15T19:34:08.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbcdb8700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd98003780 0x7fdd98003b80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fddb8063be0 tx=0x7fdda0001e30).ready entity=mon.1 client_cookie=d9bea542ffb07e35 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda00071a0 con 0x7fdd98003780 2021-11-15T19:34:08.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0007300 con 0x7fdd98003780 2021-11-15T19:34:08.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb77fe700 1 -- 172.21.2.137:0/1620395947 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda000c8f0 con 0x7fdd98003780 2021-11-15T19:34:08.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1620395947 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd98003780 msgr2=0x7fdd98003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1620395947 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd98003780 0x7fdd98003b80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fddb8063be0 tx=0x7fdda0001e30).stop 2021-11-15T19:34:08.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbd5b9700 1 -- 172.21.2.137:0/1620395947 reap_dead start 2021-11-15T19:34:08.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1620395947 shutdown_connections 2021-11-15T19:34:08.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1620395947 >> 172.21.2.137:0/1620395947 conn(0x7fddb80b7070 msgr2=0x7fddb80b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:08.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1620395947 shutdown_connections 2021-11-15T19:34:08.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1620395947 wait complete. 2021-11-15T19:34:08.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 Processor -- start 2021-11-15T19:34:08.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- start start 2021-11-15T19:34:08.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98003780 0x7fddb8094bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 0x7fddb8145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb8095ad0 0x7fddb80b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80af5e0 con 0x7fdd98003780 2021-11-15T19:34:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80950e0 con 0x7fddb8096420 2021-11-15T19:34:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80af340 con 0x7fddb8095ad0 2021-11-15T19:34:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 0x7fddb8145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 0x7fddb8145dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37940/0 (socket says 172.21.2.137:37940) 2021-11-15T19:34:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 -- 172.21.2.137:0/1752374766 learned_addr learned my addr 172.21.2.137:0/1752374766 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 -- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb8095ad0 msgr2=0x7fddb80b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb8095ad0 0x7fddb80b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 -- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98003780 msgr2=0x7fddb8094bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98003780 0x7fddb8094bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 -- 172.21.2.137:0/1752374766 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb81462c0 con 0x7fddb8096420 2021-11-15T19:34:08.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb7fff700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 0x7fddb8145dd0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fdda8002320 tx=0x7fdda8003220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda8006aa0 con 0x7fddb8096420 2021-11-15T19:34:08.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8006c00 con 0x7fddb8096420 2021-11-15T19:34:08.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80aedf0 con 0x7fddb8096420 2021-11-15T19:34:08.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb80b0800 con 0x7fddb8096420 2021-11-15T19:34:08.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda8007030 con 0x7fddb8096420 2021-11-15T19:34:08.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.157+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd90003410 con 0x7fddb8096420 2021-11-15T19:34:08.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.161+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdda801a060 con 0x7fddb8096420 2021-11-15T19:34:08.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.161+0000 7fddb5ffb700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536f0 0x7fdd9c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.161+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fdda806b470 con 0x7fddb8096420 2021-11-15T19:34:08.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.161+0000 7fddbcdb8700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536f0 0x7fdd9c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.161+0000 7fddbcdb8700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536f0 0x7fdd9c055bb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fddb8063be0 tx=0x7fdda0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.161+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdda80427a0 con 0x7fddb8096420 2021-11-15T19:34:08.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd90003c40 con 0x7fddb8096420 2021-11-15T19:34:08.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddb5ffb700 1 -- 172.21.2.137:0/1752374766 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fdda8018070 con 0x7fddb8096420 2021-11-15T19:34:08.279 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:08.279 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":7156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2486512308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2486512308},{"type":"v1","addr":"172.21.2.137:6833","nonce":2486512308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[]} 2021-11-15T19:34:08.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536f0 msgr2=0x7fdd9c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536f0 0x7fdd9c055bb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fddb8063be0 tx=0x7fdda0015000).stop 2021-11-15T19:34:08.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 msgr2=0x7fddb8145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 0x7fddb8145dd0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fdda8002320 tx=0x7fdda8003220).stop 2021-11-15T19:34:08.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 shutdown_connections 2021-11-15T19:34:08.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536f0 0x7fdd9c055bb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb8095ad0 0x7fddb80b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb8096420 0x7fddb8145dd0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 --2- 172.21.2.137:0/1752374766 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd98003780 0x7fddb8094bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 >> 172.21.2.137:0/1752374766 conn(0x7fddb80b7070 msgr2=0x7fddb81441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:08.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 shutdown_connections 2021-11-15T19:34:08.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.269+0000 7fddbf01c700 1 -- 172.21.2.137:0/1752374766 wait complete. 2021-11-15T19:34:08.283 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 47 2021-11-15T19:34:08.286 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:08.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 Processor -- start 2021-11-15T19:34:08.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 -- start start 2021-11-15T19:34:08.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb684143270 0x7fb68413f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 0x7fb6840986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb684060990 con 0x7fb6840605b0 2021-11-15T19:34:08.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840abcb0 con 0x7fb684143270 2021-11-15T19:34:08.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb68c2b9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841425f0 con 0x7fb6840b0c60 2021-11-15T19:34:08.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb689854700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb684143270 0x7fb68413f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb689854700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb684143270 0x7fb68413f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37948/0 (socket says 172.21.2.137:37948) 2021-11-15T19:34:08.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.325+0000 7fb689854700 1 -- 172.21.2.137:0/2148714621 learned_addr learned my addr 172.21.2.137:0/2148714621 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:08.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689854700 1 -- 172.21.2.137:0/2148714621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 msgr2=0x7fb6840986c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:08.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689854700 1 --2- 172.21.2.137:0/2148714621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 0x7fb6840986c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689854700 1 -- 172.21.2.137:0/2148714621 >> v1:172.21.2.111:6789/0 conn(0x7fb6840605b0 legacy=0x7fb68413efa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:08.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689854700 1 -- 172.21.2.137:0/2148714621 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684142890 con 0x7fb684143270 2021-11-15T19:34:08.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689854700 1 --2- 172.21.2.137:0/2148714621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb684143270 0x7fb68413f6b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fb684060c80 tx=0x7fb678006e40).ready entity=mon.1 client_cookie=11fe30f2468691b5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689053700 1 -- 172.21.2.137:0/2148714621 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67800bce0 con 0x7fb684143270 2021-11-15T19:34:08.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689053700 1 -- 172.21.2.137:0/2148714621 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678000e90 con 0x7fb684143270 2021-11-15T19:34:08.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb689053700 1 -- 172.21.2.137:0/2148714621 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6780155e0 con 0x7fb684143270 2021-11-15T19:34:08.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/2148714621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb684143270 msgr2=0x7fb68413f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/2148714621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb684143270 0x7fb68413f6b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fb684060c80 tx=0x7fb678006e40).stop 2021-11-15T19:34:08.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/2148714621 shutdown_connections 2021-11-15T19:34:08.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/2148714621 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 0x7fb6840986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/2148714621 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb684143270 0x7fb68413f6b0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/2148714621 >> 172.21.2.137:0/2148714621 conn(0x7fb6840b4e60 msgr2=0x7fb6840b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:08.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/2148714621 shutdown_connections 2021-11-15T19:34:08.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/2148714621 wait complete. 2021-11-15T19:34:08.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 Processor -- start 2021-11-15T19:34:08.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- start start 2021-11-15T19:34:08.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 0x7fb6840aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 0x7fb6840ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb684143270 0x7fb6840b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840ace40 con 0x7fb684143270 2021-11-15T19:34:08.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb684141fa0 con 0x7fb6840605b0 2021-11-15T19:34:08.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840b4be0 con 0x7fb6840b0c60 2021-11-15T19:34:08.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 0x7fb6840aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 0x7fb6840aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37952/0 (socket says 172.21.2.137:37952) 2021-11-15T19:34:08.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 -- 172.21.2.137:0/368946019 learned_addr learned my addr 172.21.2.137:0/368946019 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:08.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 -- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 msgr2=0x7fb6840ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 0x7fb6840ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 -- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb684143270 msgr2=0x7fb6840b41d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:08.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb684143270 0x7fb6840b41d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 -- 172.21.2.137:0/368946019 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67800d4d0 con 0x7fb6840605b0 2021-11-15T19:34:08.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68a055700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 0x7fb6840aee20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb680002fb0 tx=0x7fb680006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb680013460 con 0x7fb6840605b0 2021-11-15T19:34:08.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6800135c0 con 0x7fb6840605b0 2021-11-15T19:34:08.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840ae940 con 0x7fb6840605b0 2021-11-15T19:34:08.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840ac930 con 0x7fb6840605b0 2021-11-15T19:34:08.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb680013920 con 0x7fb6840605b0 2021-11-15T19:34:08.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.329+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb660003410 con 0x7fb6840605b0 2021-11-15T19:34:08.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.333+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb68000f070 con 0x7fb6840605b0 2021-11-15T19:34:08.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.333+0000 7fb6777fe700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6640536f0 0x7fb664055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.333+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb68006b060 con 0x7fb6840605b0 2021-11-15T19:34:08.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.333+0000 7fb689854700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6640536f0 0x7fb664055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.333+0000 7fb689854700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6640536f0 0x7fb664055bb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb684060c80 tx=0x7fb678018000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.333+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb680042390 con 0x7fb6840605b0 2021-11-15T19:34:08.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.441+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb660003c40 con 0x7fb6840605b0 2021-11-15T19:34:08.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.441+0000 7fb6777fe700 1 -- 172.21.2.137:0/368946019 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fb6800459b0 con 0x7fb6840605b0 2021-11-15T19:34:08.453 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:08.453 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1415145214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1415145214},{"type":"v1","addr":"172.21.2.111:6835","nonce":1415145214}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":7156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2486512308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2486512308},{"type":"v1","addr":"172.21.2.137:6833","nonce":2486512308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[]} 2021-11-15T19:34:08.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6640536f0 msgr2=0x7fb664055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6640536f0 0x7fb664055bb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb684060c80 tx=0x7fb678018000).stop 2021-11-15T19:34:08.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 msgr2=0x7fb6840aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 0x7fb6840aee20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb680002fb0 tx=0x7fb680006df0).stop 2021-11-15T19:34:08.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 shutdown_connections 2021-11-15T19:34:08.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb6640536f0 0x7fb664055bb0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb684143270 0x7fb6840b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb6840b0c60 0x7fb6840ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 --2- 172.21.2.137:0/368946019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb6840605b0 0x7fb6840aee20 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 >> 172.21.2.137:0/368946019 conn(0x7fb6840b4e60 msgr2=0x7fb6840af930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:08.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 shutdown_connections 2021-11-15T19:34:08.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.445+0000 7fb68c2b9700 1 -- 172.21.2.137:0/368946019 wait complete. 2021-11-15T19:34:08.457 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 47 2021-11-15T19:34:08.460 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:34:08.460 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:34:08.461 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:34:08.461 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:34:08.461 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:34:08.462 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:34:08.462 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:34:08.462 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:34:08.466 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:34:08.467 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:34:08.469 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:34:08.470 DEBUG:teuthology.parallel:result is None 2021-11-15T19:34:08.474 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:34:08.474 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:34:08.502 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:34:08.518 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:34:08.518 DEBUG:teuthology.parallel:result is None 2021-11-15T19:34:08.519 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:34:08.556 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:34:08.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.565+0000 7f100d5fb700 1 Processor -- start 2021-11-15T19:34:08.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.565+0000 7f100d5fb700 1 -- start start 2021-11-15T19:34:08.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f10080b0550 0x7f100814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100805cb50 con 0x7f100805c770 2021-11-15T19:34:08.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080ad030 con 0x7f100814aaa0 2021-11-15T19:34:08.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10080b1650 con 0x7f10080b0550 2021-11-15T19:34:08.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f10080b0550 0x7f100814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f10080b0550 0x7f100814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37972/0 (socket says 172.21.2.137:37972) 2021-11-15T19:34:08.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/3730070086 learned_addr learned my addr 172.21.2.137:0/3730070086 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:08.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/3730070086 >> v1:172.21.2.137:6789/0 conn(0x7f100814aaa0 legacy=0x7f1008140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/3730070086 >> v1:172.21.2.111:6789/0 conn(0x7f100805c770 legacy=0x7f10080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:08.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/3730070086 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080ad2d0 con 0x7f10080b0550 2021-11-15T19:34:08.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- 172.21.2.137:0/3730070086 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f100814a5b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f10080aee10 tx=0x7f0ffc006eb0).ready entity=mon.1 client_cookie=d052cff2985c99c6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f1005ffb700 1 -- 172.21.2.137:0/3730070086 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc00d610 con 0x7f10080b0550 2021-11-15T19:34:08.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f1005ffb700 1 -- 172.21.2.137:0/3730070086 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc000e90 con 0x7f10080b0550 2021-11-15T19:34:08.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f1005ffb700 1 -- 172.21.2.137:0/3730070086 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc00d960 con 0x7f10080b0550 2021-11-15T19:34:08.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/3730070086 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 msgr2=0x7f100814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 --2- 172.21.2.137:0/3730070086 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f100814a5b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f10080aee10 tx=0x7f0ffc006eb0).stop 2021-11-15T19:34:08.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/3730070086 shutdown_connections 2021-11-15T19:34:08.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 --2- 172.21.2.137:0/3730070086 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f100814a5b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:08.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/3730070086 >> 172.21.2.137:0/3730070086 conn(0x7f10080631e0 msgr2=0x7f100805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:08.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/3730070086 shutdown_connections 2021-11-15T19:34:08.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/3730070086 wait complete. 2021-11-15T19:34:08.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 Processor -- start 2021-11-15T19:34:08.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- start start 2021-11-15T19:34:08.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f100805c770 0x7f1008144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f1008067100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f100814aaa0 0x7f1008147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008145e90 con 0x7f100814aaa0 2021-11-15T19:34:08.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008143dd0 con 0x7f10080b0550 2021-11-15T19:34:08.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1008144070 con 0x7f100805c770 2021-11-15T19:34:08.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f1008067100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f1008067100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37982/0 (socket says 172.21.2.137:37982) 2021-11-15T19:34:08.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/208827163 learned_addr learned my addr 172.21.2.137:0/208827163 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:08.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f100805c770 msgr2=0x7f1008144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f100805c770 0x7f1008144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f100814aaa0 msgr2=0x7f1008147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:08.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f100814aaa0 0x7f1008147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:08.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 -- 172.21.2.137:0/208827163 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc00b1e0 con 0x7f10080b0550 2021-11-15T19:34:08.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f10067fc700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f1008067100 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f1008145fd0 tx=0x7f0ffc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc0118f0 con 0x7f10080b0550 2021-11-15T19:34:08.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc011a50 con 0x7f10080b0550 2021-11-15T19:34:08.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1008144310 con 0x7f10080b0550 2021-11-15T19:34:08.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc011db0 con 0x7f10080b0550 2021-11-15T19:34:08.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.569+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1008159d90 con 0x7f10080b0550 2021-11-15T19:34:08.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10080ae7f0 con 0x7f10080b0550 2021-11-15T19:34:08.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ffc025030 con 0x7f10080b0550 2021-11-15T19:34:08.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f0ff7fff700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0fe4053610 0x7f0fe4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:08.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0ffc06cb60 con 0x7f10080b0550 2021-11-15T19:34:08.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f1006ffd700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0fe4053610 0x7f0fe4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:08.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f1006ffd700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0fe4053610 0x7f0fe4055ad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f1000003270 tx=0x7f1000006c90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:08.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.573+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ffc043e90 con 0x7f10080b0550 2021-11-15T19:34:08.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2021-11-15T19:34:08.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:08.665+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f10080573d0 con 0x7f10080b0550 2021-11-15T19:34:09.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f0ff7fff700 1 -- 172.21.2.137:0/208827163 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0ffc023020 con 0x7f10080b0550 2021-11-15T19:34:09.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0fe4053610 msgr2=0x7f0fe4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0fe4053610 0x7f0fe4055ad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f1000003270 tx=0x7f1000006c90).stop 2021-11-15T19:34:09.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 msgr2=0x7f1008067100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f1008067100 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f1008145fd0 tx=0x7f0ffc015000).stop 2021-11-15T19:34:09.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 shutdown_connections 2021-11-15T19:34:09.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0fe4053610 0x7f0fe4055ad0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f100814aaa0 0x7f1008147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10080b0550 0x7f1008067100 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 --2- 172.21.2.137:0/208827163 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f100805c770 0x7f1008144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 >> 172.21.2.137:0/208827163 conn(0x7f10080631e0 msgr2=0x7f10080b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:09.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 shutdown_connections 2021-11-15T19:34:09.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.489+0000 7f100d5fb700 1 -- 172.21.2.137:0/208827163 wait complete. 2021-11-15T19:34:09.502 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:34:09.506 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:34:09.506 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:34:09.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 Processor -- start 2021-11-15T19:34:09.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 -- start start 2021-11-15T19:34:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdf980b1340 0x7fdf98147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdf98143f00 0x7fdf98144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf98148190 con 0x7fdf980a9f50 2021-11-15T19:34:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980b1720 con 0x7fdf98143f00 2021-11-15T19:34:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdfa060c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf98147e70 con 0x7fdf980b1340 2021-11-15T19:34:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdf9e3a8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdf980b1340 0x7fdf98147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdf9e3a8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdf980b1340 0x7fdf98147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37986/0 (socket says 172.21.2.137:37986) 2021-11-15T19:34:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.545+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/3526305378 learned_addr learned my addr 172.21.2.137:0/3526305378 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/3526305378 >> v2:172.21.2.111:3300/0 conn(0x7fdf98143f00 msgr2=0x7fdf98144390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- 172.21.2.137:0/3526305378 >> v2:172.21.2.111:3300/0 conn(0x7fdf98143f00 0x7fdf98144390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/3526305378 >> v1:172.21.2.111:6789/0 conn(0x7fdf980a9f50 legacy=0x7fdf980aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:09.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/3526305378 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980af800 con 0x7fdf980b1340 2021-11-15T19:34:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- 172.21.2.137:0/3526305378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980b1340 0x7fdf98147980 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fdf98062250 tx=0x7fdf8c006eb0).ready entity=mon.1 client_cookie=762410349ab94e1a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9d3a6700 1 -- 172.21.2.137:0/3526305378 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf8c00d5c0 con 0x7fdf980b1340 2021-11-15T19:34:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9d3a6700 1 -- 172.21.2.137:0/3526305378 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c000e90 con 0x7fdf980b1340 2021-11-15T19:34:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9d3a6700 1 -- 172.21.2.137:0/3526305378 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf8c00d910 con 0x7fdf980b1340 2021-11-15T19:34:09.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/3526305378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980b1340 msgr2=0x7fdf98147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 --2- 172.21.2.137:0/3526305378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980b1340 0x7fdf98147980 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fdf98062250 tx=0x7fdf8c006eb0).stop 2021-11-15T19:34:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/3526305378 shutdown_connections 2021-11-15T19:34:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 --2- 172.21.2.137:0/3526305378 >> v2:172.21.2.111:3300/0 conn(0x7fdf98143f00 0x7fdf98144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 --2- 172.21.2.137:0/3526305378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980b1340 0x7fdf98147980 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/3526305378 >> 172.21.2.137:0/3526305378 conn(0x7fdf980b4e60 msgr2=0x7fdf980b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/3526305378 shutdown_connections 2021-11-15T19:34:09.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/3526305378 wait complete. 2021-11-15T19:34:09.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 Processor -- start 2021-11-15T19:34:09.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- start start 2021-11-15T19:34:09.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 0x7fdf9813f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf980b1340 0x7fdf980aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf98143f00 0x7fdf98159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809a1e0 con 0x7fdf98143f00 2021-11-15T19:34:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809a410 con 0x7fdf980a9f50 2021-11-15T19:34:09.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9813fea0 con 0x7fdf980b1340 2021-11-15T19:34:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 0x7fdf9813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 0x7fdf9813f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:37992/0 (socket says 172.21.2.137:37992) 2021-11-15T19:34:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/2602929023 learned_addr learned my addr 172.21.2.137:0/2602929023 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:09.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf980b1340 msgr2=0x7fdf980aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf980b1340 0x7fdf980aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf98143f00 msgr2=0x7fdf98159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf98143f00 0x7fdf98159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 -- 172.21.2.137:0/2602929023 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c00b1e0 con 0x7fdf980a9f50 2021-11-15T19:34:09.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf9e3a8700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 0x7fdf9813f340 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fdf98062250 tx=0x7fdf8c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf8c002f70 con 0x7fdf980a9f50 2021-11-15T19:34:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c00de70 con 0x7fdf980a9f50 2021-11-15T19:34:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf8c01e460 con 0x7fdf980a9f50 2021-11-15T19:34:09.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf980ad410 con 0x7fdf980a9f50 2021-11-15T19:34:09.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9809ab50 con 0x7fdf980a9f50 2021-11-15T19:34:09.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.549+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98140060 con 0x7fdf980a9f50 2021-11-15T19:34:09.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.553+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf8c01a040 con 0x7fdf980a9f50 2021-11-15T19:34:09.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.553+0000 7fdf8b7fe700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf78053520 0x7fdf780559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.553+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fdf8c06c4e0 con 0x7fdf980a9f50 2021-11-15T19:34:09.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.553+0000 7fdf9dba7700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf78053520 0x7fdf780559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.553+0000 7fdf9dba7700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf78053520 0x7fdf780559e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fdf94002fb0 tx=0x7fdf940069d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.553+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf8c0439f0 con 0x7fdf980a9f50 2021-11-15T19:34:09.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdf98148190 con 0x7fdf980a9f50 2021-11-15T19:34:09.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdf8b7fe700 1 -- 172.21.2.137:0/2602929023 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fdf98148190 con 0x7fdf980a9f50 2021-11-15T19:34:09.676 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:09.676 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:09.676 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:34:09.676 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.676 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:34:09.677 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:34:09.677 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.677 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:09.677 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.678 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.679 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:34:09.679 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:34:09.679 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.679 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:09.680 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.680 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.680 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.680 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.681 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.681 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:34:09.681 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:34:09.681 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.681 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.682 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.682 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.682 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.682 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.682 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.683 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:34:09.683 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:34:09.683 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.683 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.683 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.684 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.684 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.684 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.684 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.685 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:34:09.685 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:34:09.685 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.685 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.685 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.686 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.686 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.686 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.686 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:34:09.687 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:34:09.687 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.687 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.687 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.688 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.688 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.688 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.688 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:34:09.689 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:34:09.689 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.689 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.689 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.690 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.690 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.690 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.690 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.691 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:34:09.691 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:34:09.691 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.691 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.691 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.692 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.692 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.692 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.692 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.692 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:34:09.693 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:34:09.693 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.693 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.693 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.694 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.694 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.694 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.694 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.694 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:34:09.695 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:34:09.695 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.695 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.695 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.696 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.696 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.696 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.696 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.696 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:34:09.697 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:34:09.697 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.697 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:09.697 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:34:09.697 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:34:09.698 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.698 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.698 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.698 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:34:09.699 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:34:09.699 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.699 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:09.699 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:34:09.699 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:34:09.700 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.700 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.700 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.700 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:34:09.700 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:34:09.701 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.701 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:09.701 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:34:09.701 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:34:09.702 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.702 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.702 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:34:09.702 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:34:09.703 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.703 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:34:09.703 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:09.703 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:09.704 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.704 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.704 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:34:09.705 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:34:09.705 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.705 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:34:09.705 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:34:09.706 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.706 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:09.706 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:09.706 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:34:09.707 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:34:09.707 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:09.707 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:34:09.707 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:34:09.708 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:09.708 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.708 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:09.708 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:09.708 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:09.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf78053520 msgr2=0x7fdf780559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf78053520 0x7fdf780559e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fdf94002fb0 tx=0x7fdf940069d0).stop 2021-11-15T19:34:09.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 msgr2=0x7fdf9813f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 0x7fdf9813f340 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fdf98062250 tx=0x7fdf8c015000).stop 2021-11-15T19:34:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 shutdown_connections 2021-11-15T19:34:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf78053520 0x7fdf780559e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf98143f00 0x7fdf98159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf980b1340 0x7fdf980aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 --2- 172.21.2.137:0/2602929023 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf980a9f50 0x7fdf9813f340 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 >> 172.21.2.137:0/2602929023 conn(0x7fdf980b4e60 msgr2=0x7fdf980b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 shutdown_connections 2021-11-15T19:34:09.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.665+0000 7fdfa060c700 1 -- 172.21.2.137:0/2602929023 wait complete. 2021-11-15T19:34:09.713 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:09.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.753+0000 7f1db5e32700 1 Processor -- start 2021-11-15T19:34:09.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.753+0000 7f1db5e32700 1 -- start start 2021-11-15T19:34:09.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1db00b1340 0x7f1db0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 0x7f1db00aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db0148190 con 0x7f1db0143f00 2021-11-15T19:34:09.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db00b1720 con 0x7f1db00b1340 2021-11-15T19:34:09.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0147e70 con 0x7f1db00a9f50 2021-11-15T19:34:09.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daeffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1db0143f00 0x7f1db0144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56786/0 (socket says 172.21.2.137:56786) 2021-11-15T19:34:09.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daeffd700 1 -- 172.21.2.137:0/2558702403 learned_addr learned my addr 172.21.2.137:0/2558702403 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:09.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533494952 0 0) 0x7f1da4001110 con 0x7f1db0143f00 2021-11-15T19:34:09.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d9c003260 con 0x7f1db0143f00 2021-11-15T19:34:09.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daffff700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 0x7f1db00aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2558702403 >> v2:172.21.2.111:3300/0 conn(0x7f1db00b1340 0x7f1db0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 262855299 0 0) 0x7f1d9c003260 con 0x7f1db0143f00 2021-11-15T19:34:09.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 msgr2=0x7f1db00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:09.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 0x7f1db00aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 >> v2:172.21.2.111:3300/0 conn(0x7f1db00b1340 msgr2=0x7f1db0147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:09.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 --2- 172.21.2.137:0/2558702403 >> v2:172.21.2.111:3300/0 conn(0x7f1db00b1340 0x7f1db0147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00af800 con 0x7f1db0143f00 2021-11-15T19:34:09.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1da4001810 con 0x7f1db0143f00 2021-11-15T19:34:09.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 >> v1:172.21.2.137:6789/0 conn(0x7f1db0143f00 legacy=0x7f1db0144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1d9c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d9c004500 0x7f1d9c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 0x7f1d9c004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00b1720 con 0x7f1d9c004500 2021-11-15T19:34:09.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0147e70 con 0x7f1d9c0037d0 2021-11-15T19:34:09.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c00b900 con 0x7f1db00a9f50 2021-11-15T19:34:09.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1d9c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daeffd700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d9c004500 0x7f1d9c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 msgr2=0x7f1d9c004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:09.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daffff700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 0x7f1d9c004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db00a9f50 0x7f1d9c004ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d9c004500 msgr2=0x7f1d9c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:09.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d9c004500 0x7f1d9c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2558702403 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c003260 con 0x7f1d9c0037d0 2021-11-15T19:34:09.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1d9c003bf0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f1da000a000 tx=0x7f1da0008040).ready entity=mon.1 client_cookie=e257f0d06da9c66e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da0013670 con 0x7f1d9c0037d0 2021-11-15T19:34:09.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da00137d0 con 0x7f1d9c0037d0 2021-11-15T19:34:09.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1dae7fc700 1 -- 172.21.2.137:0/2558702403 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da0013b30 con 0x7f1d9c0037d0 2021-11-15T19:34:09.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- 172.21.2.137:0/2558702403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 msgr2=0x7f1d9c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2558702403 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1d9c003bf0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f1da000a000 tx=0x7f1da0008040).stop 2021-11-15T19:34:09.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1daffff700 1 -- 172.21.2.137:0/2558702403 reap_dead start 2021-11-15T19:34:09.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- 172.21.2.137:0/2558702403 shutdown_connections 2021-11-15T19:34:09.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- 172.21.2.137:0/2558702403 >> 172.21.2.137:0/2558702403 conn(0x7f1db00b4e60 msgr2=0x7f1db00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:09.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- 172.21.2.137:0/2558702403 shutdown_connections 2021-11-15T19:34:09.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- 172.21.2.137:0/2558702403 wait complete. 2021-11-15T19:34:09.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 Processor -- start 2021-11-15T19:34:09.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.757+0000 7f1db5e32700 1 -- start start 2021-11-15T19:34:09.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1db0146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db0144b30 0x7f1db00ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1db0098210 0x7f1db0098690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db009a590 con 0x7f1db0098210 2021-11-15T19:34:09.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db009a830 con 0x7f1d9c0037d0 2021-11-15T19:34:09.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db009aad0 con 0x7f1db0144b30 2021-11-15T19:34:09.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1db0146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1db0146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38014/0 (socket says 172.21.2.137:38014) 2021-11-15T19:34:09.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2857835802 learned_addr learned my addr 172.21.2.137:0/2857835802 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:09.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db0144b30 msgr2=0x7f1db00ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db0144b30 0x7f1db00ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1db0098210 msgr2=0x7f1db0098690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1db0098210 0x7f1db0098690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 -- 172.21.2.137:0/2857835802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0097e60 con 0x7f1d9c0037d0 2021-11-15T19:34:09.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daf7fe700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1db0146760 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f1da000a000 tx=0x7f1da0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da0012d00 con 0x7f1d9c0037d0 2021-11-15T19:34:09.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0000e90 con 0x7f1d9c0037d0 2021-11-15T19:34:09.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db0098b80 con 0x7f1d9c0037d0 2021-11-15T19:34:09.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da001d600 con 0x7f1d9c0037d0 2021-11-15T19:34:09.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db009a300 con 0x7f1d9c0037d0 2021-11-15T19:34:09.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0098d40 con 0x7f1d9c0037d0 2021-11-15T19:34:09.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1da001d760 con 0x7f1d9c0037d0 2021-11-15T19:34:09.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1dacff9700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d90053690 0x7f1d90055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1da006ce10 con 0x7f1d9c0037d0 2021-11-15T19:34:09.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daeffd700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d90053690 0x7f1d90055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.761+0000 7f1daeffd700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d90053690 0x7f1d90055b50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f1da4008000 tx=0x7f1da4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.765+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1da0044130 con 0x7f1d9c0037d0 2021-11-15T19:34:09.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.845+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1db009ac90 con 0x7f1d9c0037d0 2021-11-15T19:34:09.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.845+0000 7f1dacff9700 1 -- 172.21.2.137:0/2857835802 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f1da000b120 con 0x7f1d9c0037d0 2021-11-15T19:34:09.857 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:09.857 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":97,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:09.483602+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:09.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d90053690 msgr2=0x7f1d90055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d90053690 0x7f1d90055b50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f1da4008000 tx=0x7f1da4009040).stop 2021-11-15T19:34:09.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 msgr2=0x7f1db0146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1db0146760 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f1da000a000 tx=0x7f1da0008040).stop 2021-11-15T19:34:09.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 shutdown_connections 2021-11-15T19:34:09.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d90053690 0x7f1d90055b50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1db0098210 0x7f1db0098690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1db0144b30 0x7f1db00ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 --2- 172.21.2.137:0/2857835802 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d9c0037d0 0x7f1db0146760 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 >> 172.21.2.137:0/2857835802 conn(0x7f1db00b4e60 msgr2=0x7f1db0149740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:09.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 shutdown_connections 2021-11-15T19:34:09.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.849+0000 7f1db5e32700 1 -- 172.21.2.137:0/2857835802 wait complete. 2021-11-15T19:34:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:34:09.865 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:34:09.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 Processor -- start 2021-11-15T19:34:09.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- start start 2021-11-15T19:34:09.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb38805c770 0x7fb3880aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb3880b0550 0x7fb38814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb38814aaa0 0x7fb388140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880b1650 con 0x7fb3880b0550 2021-11-15T19:34:09.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38805cb50 con 0x7fb38814aaa0 2021-11-15T19:34:09.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880ad030 con 0x7fb38805c770 2021-11-15T19:34:09.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb38814aaa0 0x7fb388140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb38814aaa0 0x7fb388140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38020/0 (socket says 172.21.2.137:38020) 2021-11-15T19:34:09.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 -- 172.21.2.137:0/2133060254 learned_addr learned my addr 172.21.2.137:0/2133060254 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:09.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 -- 172.21.2.137:0/2133060254 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb38805c770 msgr2=0x7fb3880aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:09.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 --2- 172.21.2.137:0/2133060254 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb38805c770 0x7fb3880aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 -- 172.21.2.137:0/2133060254 >> v2:172.21.2.111:3300/0 conn(0x7fb3880b0550 msgr2=0x7fb38814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:09.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 --2- 172.21.2.137:0/2133060254 >> v2:172.21.2.111:3300/0 conn(0x7fb3880b0550 0x7fb38814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 -- 172.21.2.137:0/2133060254 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880ad2d0 con 0x7fb38814aaa0 2021-11-15T19:34:09.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb386d9d700 1 --2- 172.21.2.137:0/2133060254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388140aa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb3800032f0 tx=0x7fb380009290).ready entity=mon.1 client_cookie=d53590770a6c1296 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38559a700 1 -- 172.21.2.137:0/2133060254 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb38000b870 con 0x7fb38814aaa0 2021-11-15T19:34:09.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38559a700 1 -- 172.21.2.137:0/2133060254 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38000b9d0 con 0x7fb38814aaa0 2021-11-15T19:34:09.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38559a700 1 -- 172.21.2.137:0/2133060254 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb38000bb40 con 0x7fb38814aaa0 2021-11-15T19:34:09.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- 172.21.2.137:0/2133060254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 msgr2=0x7fb388140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- 172.21.2.137:0/2133060254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388140aa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb3800032f0 tx=0x7fb380009290).stop 2021-11-15T19:34:09.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- 172.21.2.137:0/2133060254 shutdown_connections 2021-11-15T19:34:09.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- 172.21.2.137:0/2133060254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388140aa0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:09.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- 172.21.2.137:0/2133060254 >> v2:172.21.2.111:3300/0 conn(0x7fb3880b0550 0x7fb38814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 --2- 172.21.2.137:0/2133060254 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb38805c770 0x7fb3880aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- 172.21.2.137:0/2133060254 >> 172.21.2.137:0/2133060254 conn(0x7fb3880631e0 msgr2=0x7fb38805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:09.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- 172.21.2.137:0/2133060254 shutdown_connections 2021-11-15T19:34:09.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- 172.21.2.137:0/2133060254 wait complete. 2021-11-15T19:34:09.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 Processor -- start 2021-11-15T19:34:09.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.909+0000 7fb38ca17700 1 -- start start 2021-11-15T19:34:09.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb38805c770 0x7fb388143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3880b0550 0x7fb388142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388143310 con 0x7fb38805c770 2021-11-15T19:34:09.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388156890 con 0x7fb38814aaa0 2021-11-15T19:34:09.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb388156b30 con 0x7fb3880b0550 2021-11-15T19:34:09.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38030/0 (socket says 172.21.2.137:38030) 2021-11-15T19:34:09.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 -- 172.21.2.137:0/372439965 learned_addr learned my addr 172.21.2.137:0/372439965 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:09.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 -- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3880b0550 msgr2=0x7fb388142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3880b0550 0x7fb388142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 -- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb38805c770 msgr2=0x7fb388143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:09.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb38805c770 0x7fb388143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:09.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 -- 172.21.2.137:0/372439965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380009530 con 0x7fb38814aaa0 2021-11-15T19:34:09.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb386d9d700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388142e20 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fb388143450 tx=0x7fb380016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb38000b870 con 0x7fb38814aaa0 2021-11-15T19:34:09.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380020660 con 0x7fb38814aaa0 2021-11-15T19:34:09.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb388156dd0 con 0x7fb38814aaa0 2021-11-15T19:34:09.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3881564a0 con 0x7fb38814aaa0 2021-11-15T19:34:09.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3800209c0 con 0x7fb38814aaa0 2021-11-15T19:34:09.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb388156f60 con 0x7fb38814aaa0 2021-11-15T19:34:09.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb38000f070 con 0x7fb38814aaa0 2021-11-15T19:34:09.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb37f7fe700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb36c0536f0 0x7fb36c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:09.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb38006c4f0 con 0x7fb38814aaa0 2021-11-15T19:34:09.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38659c700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb36c0536f0 0x7fb36c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:09.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.913+0000 7fb38659c700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb36c0536f0 0x7fb36c055bb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fb370002f70 tx=0x7fb3700069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:09.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:09.917+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb380043920 con 0x7fb38814aaa0 2021-11-15T19:34:10.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb3880ae7f0 con 0x7fb38814aaa0 2021-11-15T19:34:10.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb37f7fe700 1 -- 172.21.2.137:0/372439965 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v97) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb3880ae7f0 con 0x7fb38814aaa0 2021-11-15T19:34:10.010 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:34:10.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb36c0536f0 msgr2=0x7fb36c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb36c0536f0 0x7fb36c055bb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fb370002f70 tx=0x7fb3700069e0).stop 2021-11-15T19:34:10.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 msgr2=0x7fb388142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388142e20 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fb388143450 tx=0x7fb380016000).stop 2021-11-15T19:34:10.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 shutdown_connections 2021-11-15T19:34:10.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb36c0536f0 0x7fb36c055bb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb38814aaa0 0x7fb388142e20 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb3880b0550 0x7fb388142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 --2- 172.21.2.137:0/372439965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb38805c770 0x7fb388143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 >> 172.21.2.137:0/372439965 conn(0x7fb3880631e0 msgr2=0x7fb38805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 shutdown_connections 2021-11-15T19:34:10.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.001+0000 7fb38ca17700 1 -- 172.21.2.137:0/372439965 wait complete. 2021-11-15T19:34:10.017 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:34:10.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 Processor -- start 2021-11-15T19:34:10.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- start start 2021-11-15T19:34:10.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2cc0afde0 0x7fd2cc0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc13f5c0 0x7fd2cc13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc0aedf0 con 0x7fd2cc0b0fe0 2021-11-15T19:34:10.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0ae070 con 0x7fd2cc0afde0 2021-11-15T19:34:10.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0afbd0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2ca7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2cc0afde0 0x7fd2cc0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2caffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd2cc0b0fe0 0x7fd2cc0af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56816/0 (socket says 172.21.2.137:56816) 2021-11-15T19:34:10.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2caffd700 1 -- 172.21.2.137:0/1353164473 learned_addr learned my addr 172.21.2.137:0/1353164473 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:10.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2ca7fc700 1 -- 172.21.2.137:0/1353164473 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc13f5c0 msgr2=0x7fd2cc13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2ca7fc700 1 --2- 172.21.2.137:0/1353164473 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc13f5c0 0x7fd2cc13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2ca7fc700 1 -- 172.21.2.137:0/1353164473 >> v1:172.21.2.137:6789/0 conn(0x7fd2cc0b0fe0 legacy=0x7fd2cc0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2c9ffb700 1 -- 172.21.2.137:0/1353164473 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533921538 0 0) 0x7fd2cc0aedf0 con 0x7fd2cc0b0fe0 2021-11-15T19:34:10.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2ca7fc700 1 -- 172.21.2.137:0/1353164473 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0b13c0 con 0x7fd2cc0afde0 2021-11-15T19:34:10.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2ca7fc700 1 --2- 172.21.2.137:0/1353164473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc0afde0 0x7fd2cc0acff0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fd2bc002f70 tx=0x7fd2bc006df0).ready entity=mon.1 client_cookie=b71027442ec63045 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2c9ffb700 1 -- 172.21.2.137:0/1353164473 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc00d570 con 0x7fd2cc0afde0 2021-11-15T19:34:10.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2c9ffb700 1 -- 172.21.2.137:0/1353164473 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc000e90 con 0x7fd2cc0afde0 2021-11-15T19:34:10.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2c9ffb700 1 -- 172.21.2.137:0/1353164473 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc00d8c0 con 0x7fd2cc0afde0 2021-11-15T19:34:10.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- 172.21.2.137:0/1353164473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc0afde0 msgr2=0x7fd2cc0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 --2- 172.21.2.137:0/1353164473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc0afde0 0x7fd2cc0acff0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fd2bc002f70 tx=0x7fd2bc006df0).stop 2021-11-15T19:34:10.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- 172.21.2.137:0/1353164473 shutdown_connections 2021-11-15T19:34:10.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 --2- 172.21.2.137:0/1353164473 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc0afde0 0x7fd2cc0acff0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 --2- 172.21.2.137:0/1353164473 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc13f5c0 0x7fd2cc13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- 172.21.2.137:0/1353164473 >> 172.21.2.137:0/1353164473 conn(0x7fd2cc0b5f50 msgr2=0x7fd2cc0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- 172.21.2.137:0/1353164473 shutdown_connections 2021-11-15T19:34:10.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- 172.21.2.137:0/1353164473 wait complete. 2021-11-15T19:34:10.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 Processor -- start 2021-11-15T19:34:10.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.061+0000 7fd2d1291700 1 -- start start 2021-11-15T19:34:10.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2cc0afde0 0x7fd2cc112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc0b0fe0 0x7fd2cc13d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 0x7fd2cc14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0667a0 con 0x7fd2cc0afde0 2021-11-15T19:34:10.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc066a40 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc066ce0 con 0x7fd2cc0b0fe0 2021-11-15T19:34:10.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 0x7fd2cc14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 0x7fd2cc14f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38040/0 (socket says 172.21.2.137:38040) 2021-11-15T19:34:10.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 -- 172.21.2.137:0/151194470 learned_addr learned my addr 172.21.2.137:0/151194470 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:10.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 -- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc0b0fe0 msgr2=0x7fd2cc13d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc0b0fe0 0x7fd2cc13d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 -- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2cc0afde0 msgr2=0x7fd2cc112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2cc0afde0 0x7fd2cc112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 -- 172.21.2.137:0/151194470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc00b180 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2cb7fe700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 0x7fd2cc14f0d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fd2c40032f0 tx=0x7fd2c40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c400d4a0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400d600 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c400d960 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc14e990 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc13dfe0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc0677d0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2c4018030 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2c3fff700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2b0053580 0x7fd2b0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd2c406b010 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2caffd700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2b0053580 0x7fd2b0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.065+0000 7fd2caffd700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2b0053580 0x7fd2b0055a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd2b4000ed0 tx=0x7fd2b40076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.069+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2cc0677d0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2cc0677d0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2c3fff700 1 -- 172.21.2.137:0/151194470 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2cc0677d0 con 0x7fd2cc13f5c0 2021-11-15T19:34:10.160 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:10.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2b0053580 msgr2=0x7fd2b0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2b0053580 0x7fd2b0055a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd2b4000ed0 tx=0x7fd2b40076c0).stop 2021-11-15T19:34:10.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 msgr2=0x7fd2cc14f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 0x7fd2cc14f0d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fd2c40032f0 tx=0x7fd2c40091a0).stop 2021-11-15T19:34:10.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 shutdown_connections 2021-11-15T19:34:10.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2b0053580 0x7fd2b0055a40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2cc13f5c0 0x7fd2cc14f0d0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2cc0b0fe0 0x7fd2cc13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 --2- 172.21.2.137:0/151194470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2cc0afde0 0x7fd2cc112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 >> 172.21.2.137:0/151194470 conn(0x7fd2cc0b5f50 msgr2=0x7fd2cc13c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 shutdown_connections 2021-11-15T19:34:10.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.149+0000 7fd2d1291700 1 -- 172.21.2.137:0/151194470 wait complete. 2021-11-15T19:34:10.167 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:34:10.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.205+0000 7fb495c6d700 1 Processor -- start 2021-11-15T19:34:10.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.205+0000 7fb495c6d700 1 -- start start 2021-11-15T19:34:10.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb490147980 0x7fb4900aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb490148190 con 0x7fb490144610 2021-11-15T19:34:10.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4900b1720 con 0x7fb4900b1340 2021-11-15T19:34:10.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4900af800 con 0x7fb490147980 2021-11-15T19:34:10.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb4900b1340 0x7fb490143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56828/0 (socket says 172.21.2.137:56828) 2021-11-15T19:34:10.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 -- 172.21.2.137:0/3354430469 learned_addr learned my addr 172.21.2.137:0/3354430469 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:10.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659247036 0 0) 0x7fb4900b1720 con 0x7fb4900b1340 2021-11-15T19:34:10.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb470003260 con 0x7fb4900b1340 2021-11-15T19:34:10.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625066255 0 0) 0x7fb470003260 con 0x7fb4900b1340 2021-11-15T19:34:10.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 >> v2:172.21.2.111:3300/0 conn(0x7fb490147980 msgr2=0x7fb4900aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 --2- 172.21.2.137:0/3354430469 >> v2:172.21.2.111:3300/0 conn(0x7fb490147980 0x7fb4900aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 >> v1:172.21.2.111:6789/0 conn(0x7fb490144610 legacy=0x7fb4900a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49005faf0 con 0x7fb4900b1340 2021-11-15T19:34:10.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fb478001660 con 0x7fb4900b1340 2021-11-15T19:34:10.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 >> v1:172.21.2.137:6789/0 conn(0x7fb4900b1340 legacy=0x7fb490143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4700037d0 0x7fb470003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb470004500 0x7fb470004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb47000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900af800 con 0x7fb470004500 2021-11-15T19:34:10.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47000bf90 con 0x7fb470005070 2021-11-15T19:34:10.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47000c150 con 0x7fb4700037d0 2021-11-15T19:34:10.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb47000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48effd700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb470004500 0x7fb470004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4700037d0 0x7fb470003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 -- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4700037d0 msgr2=0x7fb470003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4700037d0 0x7fb470003bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 -- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb470004500 msgr2=0x7fb470004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb470004500 0x7fb470004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 -- 172.21.2.137:0/3354430469 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49005faf0 con 0x7fb470005070 2021-11-15T19:34:10.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48effd700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb470004500 0x7fb470004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:10.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 -- 172.21.2.137:0/3354430469 reap_dead start 2021-11-15T19:34:10.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48ffff700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb47000b750 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fb4880032f0 tx=0x7fb488006f90).ready entity=mon.1 client_cookie=cb45cb39792e8c1e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48800b460 con 0x7fb470005070 2021-11-15T19:34:10.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48800b5c0 con 0x7fb470005070 2021-11-15T19:34:10.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48e7fc700 1 -- 172.21.2.137:0/3354430469 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48800b730 con 0x7fb470005070 2021-11-15T19:34:10.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- 172.21.2.137:0/3354430469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 msgr2=0x7fb47000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb47000b750 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fb4880032f0 tx=0x7fb488006f90).stop 2021-11-15T19:34:10.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- 172.21.2.137:0/3354430469 shutdown_connections 2021-11-15T19:34:10.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 --2- 172.21.2.137:0/3354430469 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb47000b750 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- 172.21.2.137:0/3354430469 >> 172.21.2.137:0/3354430469 conn(0x7fb4900b4e60 msgr2=0x7fb4900b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- 172.21.2.137:0/3354430469 shutdown_connections 2021-11-15T19:34:10.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- 172.21.2.137:0/3354430469 wait complete. 2021-11-15T19:34:10.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 Processor -- start 2021-11-15T19:34:10.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- start start 2021-11-15T19:34:10.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb4900ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4900ae010 0x7fb49009a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4900992c0 0x7fb49013c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49014a940 con 0x7fb4900ae010 2021-11-15T19:34:10.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49014abe0 con 0x7fb470005070 2021-11-15T19:34:10.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb495c6d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49009a290 con 0x7fb4900992c0 2021-11-15T19:34:10.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb4900ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb4900ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38058/0 (socket says 172.21.2.137:38058) 2021-11-15T19:34:10.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 -- 172.21.2.137:0/520372992 learned_addr learned my addr 172.21.2.137:0/520372992 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:10.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 -- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4900992c0 msgr2=0x7fb49013c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4900992c0 0x7fb49013c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 -- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4900ae010 msgr2=0x7fb49009a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4900ae010 0x7fb49009a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 -- 172.21.2.137:0/520372992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49009ac90 con 0x7fb470005070 2021-11-15T19:34:10.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.209+0000 7fb48f7fe700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb4900ad180 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fb478001370 tx=0x7fb478009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb478007170 con 0x7fb470005070 2021-11-15T19:34:10.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4900ac3e0 con 0x7fb470005070 2021-11-15T19:34:10.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780072d0 con 0x7fb470005070 2021-11-15T19:34:10.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb478004920 con 0x7fb470005070 2021-11-15T19:34:10.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb490099960 con 0x7fb470005070 2021-11-15T19:34:10.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49009ae80 con 0x7fb470005070 2021-11-15T19:34:10.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb47801b060 con 0x7fb470005070 2021-11-15T19:34:10.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4740535d0 0x7fb474055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb47806b420 con 0x7fb470005070 2021-11-15T19:34:10.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48effd700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4740535d0 0x7fb474055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48effd700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4740535d0 0x7fb474055a90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fb480008000 tx=0x7fb480009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.213+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4780427a0 con 0x7fb470005070 2021-11-15T19:34:10.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.297+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb49005fd90 con 0x7fb470005070 2021-11-15T19:34:10.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.297+0000 7fb48cff9700 1 -- 172.21.2.137:0/520372992 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb478045dc0 con 0x7fb470005070 2021-11-15T19:34:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:10.310 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:34:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:34:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:34:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:34:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:34:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:10.312 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:34:10.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4740535d0 msgr2=0x7fb474055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4740535d0 0x7fb474055a90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fb480008000 tx=0x7fb480009040).stop 2021-11-15T19:34:10.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 msgr2=0x7fb4900ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb4900ad180 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fb478001370 tx=0x7fb478009040).stop 2021-11-15T19:34:10.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 shutdown_connections 2021-11-15T19:34:10.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4740535d0 0x7fb474055a90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4900992c0 0x7fb49013c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4900ae010 0x7fb49009a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 --2- 172.21.2.137:0/520372992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb470005070 0x7fb4900ad180 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 >> 172.21.2.137:0/520372992 conn(0x7fb4900b4e60 msgr2=0x7fb49013d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 shutdown_connections 2021-11-15T19:34:10.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.301+0000 7fb495c6d700 1 -- 172.21.2.137:0/520372992 wait complete. 2021-11-15T19:34:10.316 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:34:10.317 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:34:10.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 Processor -- start 2021-11-15T19:34:10.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- start start 2021-11-15T19:34:10.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac5005c770 0x7fac500aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fac50140aa0 0x7fac50140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5005cb50 con 0x7fac500b0550 2021-11-15T19:34:10.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500b1650 con 0x7fac50140aa0 2021-11-15T19:34:10.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500ad030 con 0x7fac5005c770 2021-11-15T19:34:10.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac5005c770 0x7fac500aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fac5005c770 0x7fac500aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38066/0 (socket says 172.21.2.137:38066) 2021-11-15T19:34:10.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 -- 172.21.2.137:0/328658379 learned_addr learned my addr 172.21.2.137:0/328658379 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:10.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 -- 172.21.2.137:0/328658379 >> v2:172.21.2.111:3300/0 conn(0x7fac50140aa0 msgr2=0x7fac50140ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:10.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 --2- 172.21.2.137:0/328658379 >> v2:172.21.2.111:3300/0 conn(0x7fac50140aa0 0x7fac50140ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 -- 172.21.2.137:0/328658379 >> v1:172.21.2.111:6789/0 conn(0x7fac500b0550 legacy=0x7fac5014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 -- 172.21.2.137:0/328658379 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac500ad2d0 con 0x7fac5005c770 2021-11-15T19:34:10.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac54a71700 1 --2- 172.21.2.137:0/328658379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac5005c770 0x7fac500aef30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fac500aee10 tx=0x7fac40006eb0).ready entity=mon.1 client_cookie=49649823b0ef76a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4f7fe700 1 -- 172.21.2.137:0/328658379 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac4000d5c0 con 0x7fac5005c770 2021-11-15T19:34:10.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4f7fe700 1 -- 172.21.2.137:0/328658379 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40000e90 con 0x7fac5005c770 2021-11-15T19:34:10.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4f7fe700 1 -- 172.21.2.137:0/328658379 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac4000d910 con 0x7fac5005c770 2021-11-15T19:34:10.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- 172.21.2.137:0/328658379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac5005c770 msgr2=0x7fac500aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- 172.21.2.137:0/328658379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac5005c770 0x7fac500aef30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fac500aee10 tx=0x7fac40006eb0).stop 2021-11-15T19:34:10.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- 172.21.2.137:0/328658379 shutdown_connections 2021-11-15T19:34:10.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- 172.21.2.137:0/328658379 >> v2:172.21.2.111:3300/0 conn(0x7fac50140aa0 0x7fac50140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- 172.21.2.137:0/328658379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac5005c770 0x7fac500aef30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- 172.21.2.137:0/328658379 >> 172.21.2.137:0/328658379 conn(0x7fac500631e0 msgr2=0x7fac5005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- 172.21.2.137:0/328658379 shutdown_connections 2021-11-15T19:34:10.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- 172.21.2.137:0/328658379 wait complete. 2021-11-15T19:34:10.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 Processor -- start 2021-11-15T19:34:10.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- start start 2021-11-15T19:34:10.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac5005c770 0x7fac50141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 0x7fac50141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac50140aa0 0x7fac50142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac50142270 con 0x7fac5005c770 2021-11-15T19:34:10.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac501567a0 con 0x7fac500b0550 2021-11-15T19:34:10.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac56cd5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac50156a40 con 0x7fac50140aa0 2021-11-15T19:34:10.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 0x7fac50141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 0x7fac50141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38074/0 (socket says 172.21.2.137:38074) 2021-11-15T19:34:10.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 -- 172.21.2.137:0/3293215906 learned_addr learned my addr 172.21.2.137:0/3293215906 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:10.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 -- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac50140aa0 msgr2=0x7fac50142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac50140aa0 0x7fac50142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 -- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac5005c770 msgr2=0x7fac50141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac5005c770 0x7fac50141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.361+0000 7fac4ffff700 1 -- 172.21.2.137:0/3293215906 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4000b1e0 con 0x7fac500b0550 2021-11-15T19:34:10.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4ffff700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 0x7fac50141d80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fac38002f90 tx=0x7fac38006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac38013460 con 0x7fac500b0550 2021-11-15T19:34:10.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac380135c0 con 0x7fac500b0550 2021-11-15T19:34:10.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac38013920 con 0x7fac500b0550 2021-11-15T19:34:10.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac50156ce0 con 0x7fac500b0550 2021-11-15T19:34:10.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac50157400 con 0x7fac500b0550 2021-11-15T19:34:10.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac50156e70 con 0x7fac500b0550 2021-11-15T19:34:10.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac3800f070 con 0x7fac500b0550 2021-11-15T19:34:10.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac34053580 0x7fac34055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fac3806abf0 con 0x7fac500b0550 2021-11-15T19:34:10.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac54a71700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac34053580 0x7fac34055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac54a71700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac34053580 0x7fac34055a40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fac500aee10 tx=0x7fac40015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.365+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac38042080 con 0x7fac500b0550 2021-11-15T19:34:10.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.449+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fac50157400 con 0x7fac500b0550 2021-11-15T19:34:10.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.493+0000 7fac4dffb700 1 -- 172.21.2.137:0/3293215906 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v98) v1 ==== 133+0+0 (secure 0 0 0) 0x7fac50157400 con 0x7fac500b0550 2021-11-15T19:34:10.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac34053580 msgr2=0x7fac34055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac34053580 0x7fac34055a40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fac500aee10 tx=0x7fac40015000).stop 2021-11-15T19:34:10.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 msgr2=0x7fac50141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 0x7fac50141d80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fac38002f90 tx=0x7fac38006df0).stop 2021-11-15T19:34:10.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 shutdown_connections 2021-11-15T19:34:10.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fac34053580 0x7fac34055a40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fac50140aa0 0x7fac50142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fac500b0550 0x7fac50141d80 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 --2- 172.21.2.137:0/3293215906 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fac5005c770 0x7fac50141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 >> 172.21.2.137:0/3293215906 conn(0x7fac500631e0 msgr2=0x7fac50148f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 shutdown_connections 2021-11-15T19:34:10.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.497+0000 7fac56cd5700 1 -- 172.21.2.137:0/3293215906 wait complete. 2021-11-15T19:34:10.508 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:34:10.513 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:34:10.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 Processor -- start 2021-11-15T19:34:10.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 -- start start 2021-11-15T19:34:10.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4fdc05c770 0x7f4fdc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4fdc140aa0 0x7f4fdc140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc05cb50 con 0x7f4fdc0b0550 2021-11-15T19:34:10.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc0b1650 con 0x7f4fdc140aa0 2021-11-15T19:34:10.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fe08e5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc0ad030 con 0x7f4fdc05c770 2021-11-15T19:34:10.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4fdc05c770 0x7f4fdc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4fdc05c770 0x7f4fdc0aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38078/0 (socket says 172.21.2.137:38078) 2021-11-15T19:34:10.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 -- 172.21.2.137:0/1459616289 learned_addr learned my addr 172.21.2.137:0/1459616289 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:10.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fd9d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4fdc0b0550 0x7f4fdc14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56862/0 (socket says 172.21.2.137:56862) 2021-11-15T19:34:10.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 -- 172.21.2.137:0/1459616289 >> v2:172.21.2.111:3300/0 conn(0x7f4fdc140aa0 msgr2=0x7f4fdc140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:10.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 --2- 172.21.2.137:0/1459616289 >> v2:172.21.2.111:3300/0 conn(0x7f4fdc140aa0 0x7f4fdc140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 -- 172.21.2.137:0/1459616289 >> v1:172.21.2.137:6789/0 conn(0x7f4fdc0b0550 legacy=0x7f4fdc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 -- 172.21.2.137:0/1459616289 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc0ad2d0 con 0x7f4fdc05c770 2021-11-15T19:34:10.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fda59c700 1 --2- 172.21.2.137:0/1459616289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc0aef30 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f4fc4002f70 tx=0x7f4fc4006eb0).ready entity=mon.1 client_cookie=ced4f2c4c1cc1ef2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fd959a700 1 -- 172.21.2.137:0/1459616289 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc400d610 con 0x7f4fdc05c770 2021-11-15T19:34:10.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fd959a700 1 -- 172.21.2.137:0/1459616289 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4000e90 con 0x7f4fdc05c770 2021-11-15T19:34:10.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.557+0000 7f4fd959a700 1 -- 172.21.2.137:0/1459616289 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc400d9a0 con 0x7f4fdc05c770 2021-11-15T19:34:10.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1459616289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 msgr2=0x7f4fdc0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1459616289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc0aef30 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f4fc4002f70 tx=0x7f4fc4006eb0).stop 2021-11-15T19:34:10.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1459616289 shutdown_connections 2021-11-15T19:34:10.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1459616289 >> v2:172.21.2.111:3300/0 conn(0x7f4fdc140aa0 0x7f4fdc140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1459616289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc0aef30 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:10.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1459616289 >> 172.21.2.137:0/1459616289 conn(0x7f4fdc0631e0 msgr2=0x7f4fdc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:10.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1459616289 shutdown_connections 2021-11-15T19:34:10.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1459616289 wait complete. 2021-11-15T19:34:10.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 Processor -- start 2021-11-15T19:34:10.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- start start 2021-11-15T19:34:10.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc13f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4fdc0b0550 0x7f4fdc156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4fdc140aa0 0x7f4fdc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc065460 con 0x7f4fdc0b0550 2021-11-15T19:34:10.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc13f980 con 0x7f4fdc05c770 2021-11-15T19:34:10.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc1562e0 con 0x7f4fdc140aa0 2021-11-15T19:34:10.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc13f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38084/0 (socket says 172.21.2.137:38084) 2021-11-15T19:34:10.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 -- 172.21.2.137:0/1664107657 learned_addr learned my addr 172.21.2.137:0/1664107657 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:10.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 -- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4fdc140aa0 msgr2=0x7f4fdc156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4fdc140aa0 0x7f4fdc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 -- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4fdc0b0550 msgr2=0x7f4fdc156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:10.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4fdc0b0550 0x7f4fdc156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:10.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 -- 172.21.2.137:0/1664107657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc400b1e0 con 0x7f4fdc05c770 2021-11-15T19:34:10.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fda59c700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc13f130 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f4fc4002f70 tx=0x7f4fc4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc4011950 con 0x7f4fdc05c770 2021-11-15T19:34:10.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4011ab0 con 0x7f4fdc05c770 2021-11-15T19:34:10.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc063f60 con 0x7f4fdc05c770 2021-11-15T19:34:10.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc4011e10 con 0x7f4fdc05c770 2021-11-15T19:34:10.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc1572f0 con 0x7f4fdc05c770 2021-11-15T19:34:10.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc0ae7f0 con 0x7f4fdc05c770 2021-11-15T19:34:10.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4fc401a040 con 0x7f4fdc05c770 2021-11-15T19:34:10.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fd37fe700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fc00536a0 0x7f4fc0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:10.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.561+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f4fc406c850 con 0x7f4fdc05c770 2021-11-15T19:34:10.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.565+0000 7f4fd9d9b700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fc00536a0 0x7f4fc0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:10.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.565+0000 7f4fd9d9b700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fc00536a0 0x7f4fc0055b60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4fdc0aee10 tx=0x7f4fcc007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:10.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.565+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4fc4043b80 con 0x7f4fdc05c770 2021-11-15T19:34:10.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:10.649+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4fdc0573d0 con 0x7f4fdc05c770 2021-11-15T19:34:11.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fd37fe700 1 -- 172.21.2.137:0/1664107657 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v99) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4fc4023020 con 0x7f4fdc05c770 2021-11-15T19:34:11.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fc00536a0 msgr2=0x7f4fc0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fc00536a0 0x7f4fc0055b60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4fdc0aee10 tx=0x7f4fcc007800).stop 2021-11-15T19:34:11.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 msgr2=0x7f4fdc13f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc13f130 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f4fc4002f70 tx=0x7f4fc4015000).stop 2021-11-15T19:34:11.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 shutdown_connections 2021-11-15T19:34:11.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fc00536a0 0x7f4fc0055b60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4fdc140aa0 0x7f4fdc156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4fdc0b0550 0x7f4fdc156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 --2- 172.21.2.137:0/1664107657 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4fdc05c770 0x7f4fdc13f130 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 >> 172.21.2.137:0/1664107657 conn(0x7f4fdc0631e0 msgr2=0x7f4fdc0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:11.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 shutdown_connections 2021-11-15T19:34:11.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.509+0000 7f4fe08e5700 1 -- 172.21.2.137:0/1664107657 wait complete. 2021-11-15T19:34:11.523 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:34:11.527 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:34:11.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 Processor -- start 2021-11-15T19:34:11.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 -- start start 2021-11-15T19:34:11.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea405fd20 0x7f3ea40af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3ea40b10b0 0x7f3ea40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea4147f70 con 0x7f3ea40b0610 2021-11-15T19:34:11.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea4060100 con 0x7f3ea40b10b0 2021-11-15T19:34:11.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3eabe57700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4147cd0 con 0x7f3ea405fd20 2021-11-15T19:34:11.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.569+0000 7f3ea93f2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3ea40b10b0 0x7f3ea40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3ea40b10b0 0x7f3ea40b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38096/0 (socket says 172.21.2.137:38096) 2021-11-15T19:34:11.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 -- 172.21.2.137:0/3670668553 learned_addr learned my addr 172.21.2.137:0/3670668553 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:11.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 -- 172.21.2.137:0/3670668553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea405fd20 msgr2=0x7f3ea40af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:11.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 --2- 172.21.2.137:0/3670668553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea405fd20 0x7f3ea40af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 -- 172.21.2.137:0/3670668553 >> v1:172.21.2.111:6789/0 conn(0x7f3ea40b0610 legacy=0x7f3ea40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:11.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 -- 172.21.2.137:0/3670668553 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea40a9ed0 con 0x7f3ea40b10b0 2021-11-15T19:34:11.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea93f2700 1 --2- 172.21.2.137:0/3670668553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea40b10b0 0x7f3ea40b0120 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f3ea40aa250 tx=0x7f3e98006eb0).ready entity=mon.1 client_cookie=28ee395e3c385c74 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea8bf1700 1 -- 172.21.2.137:0/3670668553 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9800d570 con 0x7f3ea40b10b0 2021-11-15T19:34:11.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea8bf1700 1 -- 172.21.2.137:0/3670668553 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e98000e90 con 0x7f3ea40b10b0 2021-11-15T19:34:11.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea8bf1700 1 -- 172.21.2.137:0/3670668553 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9800d8c0 con 0x7f3ea40b10b0 2021-11-15T19:34:11.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3670668553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea40b10b0 msgr2=0x7f3ea40b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3670668553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea40b10b0 0x7f3ea40b0120 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f3ea40aa250 tx=0x7f3e98006eb0).stop 2021-11-15T19:34:11.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3670668553 shutdown_connections 2021-11-15T19:34:11.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3670668553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea40b10b0 0x7f3ea40b0120 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3670668553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea405fd20 0x7f3ea40af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3670668553 >> 172.21.2.137:0/3670668553 conn(0x7f3ea40b4e60 msgr2=0x7f3ea40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:11.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3670668553 shutdown_connections 2021-11-15T19:34:11.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3670668553 wait complete. 2021-11-15T19:34:11.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 Processor -- start 2021-11-15T19:34:11.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- start start 2021-11-15T19:34:11.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 0x7f3ea41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ea40b0610 0x7f3ea4148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea40b10b0 0x7f3ea409a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea41577d0 con 0x7f3ea40b0610 2021-11-15T19:34:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4099f70 con 0x7f3ea405fd20 2021-11-15T19:34:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea409a210 con 0x7f3ea40b10b0 2021-11-15T19:34:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 0x7f3ea41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 0x7f3ea41572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38098/0 (socket says 172.21.2.137:38098) 2021-11-15T19:34:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 -- 172.21.2.137:0/3373817610 learned_addr learned my addr 172.21.2.137:0/3373817610 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 -- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea40b10b0 msgr2=0x7f3ea409a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea40b10b0 0x7f3ea409a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 -- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ea40b0610 msgr2=0x7f3ea4148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ea40b0610 0x7f3ea4148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 -- 172.21.2.137:0/3373817610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9800b1e0 con 0x7f3ea405fd20 2021-11-15T19:34:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3ea9bf3700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 0x7f3ea41572e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f3ea0002f70 tx=0x7f3ea0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea0013460 con 0x7f3ea405fd20 2021-11-15T19:34:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00135c0 con 0x7f3ea405fd20 2021-11-15T19:34:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea0013920 con 0x7f3ea405fd20 2021-11-15T19:34:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea4148970 con 0x7f3ea405fd20 2021-11-15T19:34:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea409ad40 con 0x7f3ea405fd20 2021-11-15T19:34:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.573+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea4099dd0 con 0x7f3ea405fd20 2021-11-15T19:34:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.577+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ea001a060 con 0x7f3ea405fd20 2021-11-15T19:34:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.577+0000 7f3e96ffd700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e84053690 0x7f3e84055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.577+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f3ea006b330 con 0x7f3ea405fd20 2021-11-15T19:34:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.577+0000 7f3ea93f2700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e84053690 0x7f3e84055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.577+0000 7f3ea93f2700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e84053690 0x7f3e84055b50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f3ea40aa250 tx=0x7f3e98015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.577+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ea4099dd0 con 0x7f3ea405fd20 2021-11-15T19:34:11.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.689+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f3ea4099dd0 con 0x7f3ea405fd20 2021-11-15T19:34:11.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.701+0000 7f3e96ffd700 1 -- 172.21.2.137:0/3373817610 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v48) v1 ==== 189+0+0 (secure 0 0 0) 0x7f3ea4099dd0 con 0x7f3ea405fd20 2021-11-15T19:34:11.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e84053690 msgr2=0x7f3e84055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e84053690 0x7f3e84055b50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f3ea40aa250 tx=0x7f3e98015000).stop 2021-11-15T19:34:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 msgr2=0x7f3ea41572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 0x7f3ea41572e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f3ea0002f70 tx=0x7f3ea0006ec0).stop 2021-11-15T19:34:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 shutdown_connections 2021-11-15T19:34:11.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3e84053690 0x7f3e84055b50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ea40b10b0 0x7f3ea409a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ea40b0610 0x7f3ea4148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 --2- 172.21.2.137:0/3373817610 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ea405fd20 0x7f3ea41572e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 >> 172.21.2.137:0/3373817610 conn(0x7f3ea40b4e60 msgr2=0x7f3ea40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:11.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 shutdown_connections 2021-11-15T19:34:11.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.705+0000 7f3eabe57700 1 -- 172.21.2.137:0/3373817610 wait complete. 2021-11-15T19:34:11.717 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 19 and data pool 20 2021-11-15T19:34:11.720 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:11.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 Processor -- start 2021-11-15T19:34:11.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 -- start start 2021-11-15T19:34:11.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a40b2d50 0x7fa0a405f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa0a405fed0 0x7fa0a4060360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a4097c50 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a40ac120 con 0x7fa0a405fed0 2021-11-15T19:34:11.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0ac16d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40979b0 con 0x7fa0a40b2d50 2021-11-15T19:34:11.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0a9708700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a40b2d50 0x7fa0a405f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0a9f09700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fa0a40ac3c0 0x7fa0a40ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:49380/0 (socket says 172.21.2.137:49380) 2021-11-15T19:34:11.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0a9f09700 1 -- 172.21.2.137:0/3051732759 learned_addr learned my addr 172.21.2.137:0/3051732759 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:11.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.761+0000 7fa0aa70a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa0a405fed0 0x7fa0a4060360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a8f07700 1 -- 172.21.2.137:0/3051732759 <== mon.0 v1:172.21.2.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151003804 0 0) 0x7fa0a4097c50 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a8f07700 1 -- 172.21.2.137:0/3051732759 --> v1:172.21.2.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa08c003260 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a9708700 1 -- 172.21.2.137:0/3051732759 >> v2:172.21.2.111:3300/0 conn(0x7fa0a405fed0 msgr2=0x7fa0a4060360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:11.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a9708700 1 --2- 172.21.2.137:0/3051732759 >> v2:172.21.2.111:3300/0 conn(0x7fa0a405fed0 0x7fa0a4060360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a9708700 1 -- 172.21.2.137:0/3051732759 >> v1:172.21.2.111:6789/0 conn(0x7fa0a40ac3c0 legacy=0x7fa0a40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a9708700 1 -- 172.21.2.137:0/3051732759 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40aceb0 con 0x7fa0a40b2d50 2021-11-15T19:34:11.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0aa70a700 1 --2- 172.21.2.137:0/3051732759 >> v2:172.21.2.111:3300/0 conn(0x7fa0a405fed0 0x7fa0a4060360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:11.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a9708700 1 --2- 172.21.2.137:0/3051732759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a40b2d50 0x7fa0a405f9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa0a0002f70 tx=0x7fa0a0006df0).ready entity=mon.2 client_cookie=ad2efdad1b6799d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a8f07700 1 -- 172.21.2.137:0/3051732759 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a000d4a0 con 0x7fa0a40b2d50 2021-11-15T19:34:11.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a8f07700 1 -- 172.21.2.137:0/3051732759 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0000e90 con 0x7fa0a40b2d50 2021-11-15T19:34:11.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.765+0000 7fa0a8f07700 1 -- 172.21.2.137:0/3051732759 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a000d7f0 con 0x7fa0a40b2d50 2021-11-15T19:34:11.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 -- 172.21.2.137:0/3051732759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a40b2d50 msgr2=0x7fa0a405f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/3051732759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a40b2d50 0x7fa0a405f9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa0a0002f70 tx=0x7fa0a0006df0).stop 2021-11-15T19:34:11.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 -- 172.21.2.137:0/3051732759 shutdown_connections 2021-11-15T19:34:11.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/3051732759 >> v2:172.21.2.111:3300/0 conn(0x7fa0a405fed0 0x7fa0a4060360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/3051732759 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a40b2d50 0x7fa0a405f9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 -- 172.21.2.137:0/3051732759 >> 172.21.2.137:0/3051732759 conn(0x7fa0a40b7070 msgr2=0x7fa0a40b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:11.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 -- 172.21.2.137:0/3051732759 shutdown_connections 2021-11-15T19:34:11.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.769+0000 7fa0ac16d700 1 -- 172.21.2.137:0/3051732759 wait complete. 2021-11-15T19:34:11.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 Processor -- start 2021-11-15T19:34:11.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- start start 2021-11-15T19:34:11.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0a405fed0 0x7fa0a409a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 0x7fa0a4064d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a4142da0 0x7fa0a4143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4142970 con 0x7fa0a405fed0 2021-11-15T19:34:11.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4142340 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4065240 con 0x7fa0a4142da0 2021-11-15T19:34:11.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 0x7fa0a4064d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 0x7fa0a4064d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38116/0 (socket says 172.21.2.137:38116) 2021-11-15T19:34:11.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 -- 172.21.2.137:0/2279080306 learned_addr learned my addr 172.21.2.137:0/2279080306 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:11.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9f09700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0a405fed0 0x7fa0a409a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 -- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a4142da0 msgr2=0x7fa0a4143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a4142da0 0x7fa0a4143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 -- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0a405fed0 msgr2=0x7fa0a409a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0a405fed0 0x7fa0a409a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 -- 172.21.2.137:0/2279080306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009470 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0a9708700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 0x7fa0a4064d50 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fa0a409c840 tx=0x7fa0a0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a0016070 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a00139c0 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a000b180 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a0013d20 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a41425e0 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.773+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4142160 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.777+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0a0025030 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.777+0000 7fa092ffd700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa084053580 0x7fa084055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.777+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa0a006ca40 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.777+0000 7fa0a9f09700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa084053580 0x7fa084055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.777+0000 7fa0a9f09700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa084053580 0x7fa084055a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa094008000 tx=0x7fa094009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.777+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0a0043a90 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.861+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0a4142ab0 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.861+0000 7fa092ffd700 1 -- 172.21.2.137:0/2279080306 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16057 (secure 0 0 0) 0x7fa0a0023020 con 0x7fa0a40ac3c0 2021-11-15T19:34:11.873 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:11.873 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":100,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:11.698134+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:10.473721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:10.694997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:11.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa084053580 msgr2=0x7fa084055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa084053580 0x7fa084055a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa094008000 tx=0x7fa094009040).stop 2021-11-15T19:34:11.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 msgr2=0x7fa0a4064d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 0x7fa0a4064d50 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fa0a409c840 tx=0x7fa0a0014000).stop 2021-11-15T19:34:11.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 shutdown_connections 2021-11-15T19:34:11.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa084053580 0x7fa084055a40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0a4142da0 0x7fa0a4143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:11.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0a40ac3c0 0x7fa0a4064d50 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 --2- 172.21.2.137:0/2279080306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0a405fed0 0x7fa0a409a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 >> 172.21.2.137:0/2279080306 conn(0x7fa0a40b7070 msgr2=0x7fa0a40b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:11.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 shutdown_connections 2021-11-15T19:34:11.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.865+0000 7fa0ac16d700 1 -- 172.21.2.137:0/2279080306 wait complete. 2021-11-15T19:34:11.880 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:11.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 Processor -- start 2021-11-15T19:34:11.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 -- start start 2021-11-15T19:34:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 0x7f1420147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f14200a9f50 0x7f14200aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1420148190 con 0x7f14200b1340 2021-11-15T19:34:11.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200b1720 con 0x7f14200a9f50 2021-11-15T19:34:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.921+0000 7f1426a62700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420147e70 con 0x7f1420144610 2021-11-15T19:34:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 0x7f1420147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1424fff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f14200a9f50 0x7f14200aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 0x7f1420147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:39694/0 (socket says 172.21.2.137:39694) 2021-11-15T19:34:11.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 -- 172.21.2.137:0/783375613 learned_addr learned my addr 172.21.2.137:0/783375613 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:11.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 -- 172.21.2.137:0/783375613 >> v2:172.21.2.111:3300/0 conn(0x7f14200a9f50 msgr2=0x7f14200aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:11.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 --2- 172.21.2.137:0/783375613 >> v2:172.21.2.111:3300/0 conn(0x7f14200a9f50 0x7f14200aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 -- 172.21.2.137:0/783375613 >> v1:172.21.2.111:6789/0 conn(0x7f14200b1340 legacy=0x7f1420143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 -- 172.21.2.137:0/783375613 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200af800 con 0x7f1420144610 2021-11-15T19:34:11.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1424fff700 1 --2- 172.21.2.137:0/783375613 >> v2:172.21.2.111:3300/0 conn(0x7f14200a9f50 0x7f14200aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:11.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141f7fe700 1 --2- 172.21.2.137:0/783375613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 0x7f1420147980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1410002f70 tx=0x7f1410006eb0).ready entity=mon.2 client_cookie=fcfad2267a0e4842 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141effd700 1 -- 172.21.2.137:0/783375613 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141000d570 con 0x7f1420144610 2021-11-15T19:34:11.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141effd700 1 -- 172.21.2.137:0/783375613 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410000e90 con 0x7f1420144610 2021-11-15T19:34:11.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f141effd700 1 -- 172.21.2.137:0/783375613 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141000d900 con 0x7f1420144610 2021-11-15T19:34:11.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- 172.21.2.137:0/783375613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 msgr2=0x7f1420147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 --2- 172.21.2.137:0/783375613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 0x7f1420147980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1410002f70 tx=0x7f1410006eb0).stop 2021-11-15T19:34:11.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- 172.21.2.137:0/783375613 shutdown_connections 2021-11-15T19:34:11.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 --2- 172.21.2.137:0/783375613 >> v2:172.21.2.111:3300/0 conn(0x7f14200a9f50 0x7f14200aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 --2- 172.21.2.137:0/783375613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1420144610 0x7f1420147980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- 172.21.2.137:0/783375613 >> 172.21.2.137:0/783375613 conn(0x7f14200b4e60 msgr2=0x7f14200b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:11.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- 172.21.2.137:0/783375613 shutdown_connections 2021-11-15T19:34:11.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- 172.21.2.137:0/783375613 wait complete. 2021-11-15T19:34:11.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 Processor -- start 2021-11-15T19:34:11.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- start start 2021-11-15T19:34:11.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14200a9f50 0x7f142009a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14200b1340 0x7f1420140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 0x7f1420140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201422a0 con 0x7f14200b1340 2021-11-15T19:34:11.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200ad000 con 0x7f1420144610 2021-11-15T19:34:11.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.925+0000 7f1426a62700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420099af0 con 0x7f14200a9f50 2021-11-15T19:34:11.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 0x7f1420140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 0x7f1420140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38130/0 (socket says 172.21.2.137:38130) 2021-11-15T19:34:11.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 -- 172.21.2.137:0/4041826541 learned_addr learned my addr 172.21.2.137:0/4041826541 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:11.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141f7fe700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14200b1340 0x7f1420140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141ffff700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14200a9f50 0x7f142009a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 -- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14200a9f50 msgr2=0x7f142009a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14200a9f50 0x7f142009a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 -- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14200b1340 msgr2=0x7f1420140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:11.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14200b1340 0x7f1420140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:11.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 -- 172.21.2.137:0/4041826541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418009470 con 0x7f1420144610 2021-11-15T19:34:11.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1424fff700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 0x7f1420140c20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f141800c000 tx=0x7f14180091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141800c850 con 0x7f1420144610 2021-11-15T19:34:11.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800c9b0 con 0x7f1420144610 2021-11-15T19:34:11.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141000b1e0 con 0x7f1420144610 2021-11-15T19:34:11.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14200ac2a0 con 0x7f1420144610 2021-11-15T19:34:11.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f141800cd10 con 0x7f1420144610 2021-11-15T19:34:11.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f8003410 con 0x7f1420144610 2021-11-15T19:34:11.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1418022070 con 0x7f1420144610 2021-11-15T19:34:11.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141d7fa700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1404053600 0x7f1404055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:11.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f141806c210 con 0x7f1420144610 2021-11-15T19:34:11.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141ffff700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1404053600 0x7f1404055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:11.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.929+0000 7f141ffff700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1404053600 0x7f1404055ac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f140800b000 tx=0x7f1408009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:11.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:11.933+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1418043260 con 0x7f1420144610 2021-11-15T19:34:12.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13f80036c0 con 0x7f1420144610 2021-11-15T19:34:12.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f141d7fa700 1 -- 172.21.2.137:0/4041826541 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16057 (secure 0 0 0) 0x7f1418046880 con 0x7f1420144610 2021-11-15T19:34:12.027 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:12.028 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":100,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:11.698134+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:10.473721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:10.694997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:12.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1404053600 msgr2=0x7f1404055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1404053600 0x7f1404055ac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f140800b000 tx=0x7f1408009040).stop 2021-11-15T19:34:12.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 msgr2=0x7f1420140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 0x7f1420140c20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f141800c000 tx=0x7f14180091d0).stop 2021-11-15T19:34:12.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 shutdown_connections 2021-11-15T19:34:12.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1404053600 0x7f1404055ac0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1420144610 0x7f1420140c20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14200b1340 0x7f1420140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 --2- 172.21.2.137:0/4041826541 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14200a9f50 0x7f142009a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 >> 172.21.2.137:0/4041826541 conn(0x7f14200b4e60 msgr2=0x7f14200afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:12.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 shutdown_connections 2021-11-15T19:34:12.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.017+0000 7f1426a62700 1 -- 172.21.2.137:0/4041826541 wait complete. 2021-11-15T19:34:12.035 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:34:12.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 Processor -- start 2021-11-15T19:34:12.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- start start 2021-11-15T19:34:12.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6ee8065b10 0x7f6ee813c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee8066270 con 0x7f6ee8065730 2021-11-15T19:34:12.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee8065fd0 con 0x7f6ee80b00a0 2021-11-15T19:34:12.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee8067410 con 0x7f6ee8065b10 2021-11-15T19:34:12.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eed027700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6ee8065b10 0x7f6ee813c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eee029700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6ee80b00a0 0x7f6ee805bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56920/0 (socket says 172.21.2.137:56920) 2021-11-15T19:34:12.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eee029700 1 -- 172.21.2.137:0/1924393998 learned_addr learned my addr 172.21.2.137:0/1924393998 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:12.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eed027700 1 -- 172.21.2.137:0/1924393998 >> v1:172.21.2.137:6789/0 conn(0x7f6ee80b00a0 legacy=0x7f6ee805bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eed027700 1 -- 172.21.2.137:0/1924393998 >> v1:172.21.2.111:6789/0 conn(0x7f6ee8065730 legacy=0x7f6ee813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:12.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eed027700 1 -- 172.21.2.137:0/1924393998 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8066f70 con 0x7f6ee8065b10 2021-11-15T19:34:12.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eed027700 1 --2- 172.21.2.137:0/1924393998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee8065b10 0x7f6ee813c9c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f6ee80612c0 tx=0x7f6edc006e80).ready entity=mon.1 client_cookie=bc193cd4c96f62b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eec826700 1 -- 172.21.2.137:0/1924393998 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6edc00a820 con 0x7f6ee8065b10 2021-11-15T19:34:12.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eec826700 1 -- 172.21.2.137:0/1924393998 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc000e90 con 0x7f6ee8065b10 2021-11-15T19:34:12.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eec826700 1 -- 172.21.2.137:0/1924393998 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6edc00ab70 con 0x7f6ee8065b10 2021-11-15T19:34:12.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- 172.21.2.137:0/1924393998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee8065b10 msgr2=0x7f6ee813c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/1924393998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee8065b10 0x7f6ee813c9c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f6ee80612c0 tx=0x7f6edc006e80).stop 2021-11-15T19:34:12.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- 172.21.2.137:0/1924393998 shutdown_connections 2021-11-15T19:34:12.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/1924393998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee8065b10 0x7f6ee813c9c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- 172.21.2.137:0/1924393998 >> 172.21.2.137:0/1924393998 conn(0x7f6ee8060290 msgr2=0x7f6ee8060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:12.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- 172.21.2.137:0/1924393998 shutdown_connections 2021-11-15T19:34:12.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.077+0000 7f6eefa8c700 1 -- 172.21.2.137:0/1924393998 wait complete. 2021-11-15T19:34:12.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 Processor -- start 2021-11-15T19:34:12.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- start start 2021-11-15T19:34:12.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ee8065730 0x7f6ee814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ee8065b10 0x7f6ee813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 0x7f6ee8137b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee814f040 con 0x7f6ee8065730 2021-11-15T19:34:12.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8143120 con 0x7f6ee80b00a0 2021-11-15T19:34:12.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee814e2d0 con 0x7f6ee8065b10 2021-11-15T19:34:12.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 0x7f6ee8137b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 0x7f6ee8137b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38142/0 (socket says 172.21.2.137:38142) 2021-11-15T19:34:12.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 -- 172.21.2.137:0/2814285089 learned_addr learned my addr 172.21.2.137:0/2814285089 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:12.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 -- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ee8065b10 msgr2=0x7f6ee813d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ee8065b10 0x7f6ee813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 -- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ee8065730 msgr2=0x7f6ee814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ee8065730 0x7f6ee814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 -- 172.21.2.137:0/2814285089 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc00c310 con 0x7f6ee80b00a0 2021-11-15T19:34:12.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eee029700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 0x7f6ee8137b80 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f6ee8060dc0 tx=0x7f6ee0007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee0005ba0 con 0x7f6ee80b00a0 2021-11-15T19:34:12.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0005d00 con 0x7f6ee80b00a0 2021-11-15T19:34:12.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee8142e80 con 0x7f6ee80b00a0 2021-11-15T19:34:12.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee00072c0 con 0x7f6ee80b00a0 2021-11-15T19:34:12.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee813eb00 con 0x7f6ee80b00a0 2021-11-15T19:34:12.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee813e0a0 con 0x7f6ee80b00a0 2021-11-15T19:34:12.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ee0010070 con 0x7f6ee80b00a0 2021-11-15T19:34:12.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6edaffd700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ec80536d0 0x7f6ec8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6ee006b0f0 con 0x7f6ee80b00a0 2021-11-15T19:34:12.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.081+0000 7f6eed828700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ec80536d0 0x7f6ec8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.085+0000 7f6eed828700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ec80536d0 0x7f6ec8055b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f6ee4002f90 tx=0x7f6ee40069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.085+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ee0042250 con 0x7f6ee80b00a0 2021-11-15T19:34:12.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.193+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6ee80b0fb0 con 0x7f6ee80b00a0 2021-11-15T19:34:12.705 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:34:12.701+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:34:12.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6edaffd700 1 -- 172.21.2.137:0/2814285089 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ee0045870 con 0x7f6ee80b00a0 2021-11-15T19:34:12.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ec80536d0 msgr2=0x7f6ec8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ec80536d0 0x7f6ec8055b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f6ee4002f90 tx=0x7f6ee40069b0).stop 2021-11-15T19:34:12.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 msgr2=0x7f6ee8137b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 0x7f6ee8137b80 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f6ee8060dc0 tx=0x7f6ee0007f60).stop 2021-11-15T19:34:12.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 shutdown_connections 2021-11-15T19:34:12.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6ec80536d0 0x7f6ec8055b90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ee80b00a0 0x7f6ee8137b80 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ee8065b10 0x7f6ee813d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 --2- 172.21.2.137:0/2814285089 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ee8065730 0x7f6ee814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 >> 172.21.2.137:0/2814285089 conn(0x7f6ee8060290 msgr2=0x7f6ee813f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:12.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 shutdown_connections 2021-11-15T19:34:12.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.709+0000 7f6eefa8c700 1 -- 172.21.2.137:0/2814285089 wait complete. 2021-11-15T19:34:12.727 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:12.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4b7ae700 1 Processor -- start 2021-11-15T19:34:12.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4b7ae700 1 -- start start 2021-11-15T19:34:12.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4b7ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 0x7fcc44147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4b7ae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc44148190 con 0x7fcc440a9f50 2021-11-15T19:34:12.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4b7ae700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440b1720 con 0x7fcc440b1340 2021-11-15T19:34:12.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4b7ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44147e70 con 0x7fcc44144610 2021-11-15T19:34:12.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4954a700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fcc440b1340 0x7fcc44143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56932/0 (socket says 172.21.2.137:56932) 2021-11-15T19:34:12.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc4954a700 1 -- 172.21.2.137:0/118563684 learned_addr learned my addr 172.21.2.137:0/118563684 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:12.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162481167 0 0) 0x7fcc440b1720 con 0x7fcc440b1340 2021-11-15T19:34:12.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc2c003260 con 0x7fcc440b1340 2021-11-15T19:34:12.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 0x7fcc44147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4005692644 0 0) 0x7fcc2c003260 con 0x7fcc440b1340 2021-11-15T19:34:12.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 msgr2=0x7fcc44147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:12.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 0x7fcc44147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 >> v1:172.21.2.111:6789/0 conn(0x7fcc440a9f50 legacy=0x7fcc440aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:12.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440af800 con 0x7fcc440b1340 2021-11-15T19:34:12.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fcc40001660 con 0x7fcc440b1340 2021-11-15T19:34:12.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 >> v1:172.21.2.137:6789/0 conn(0x7fcc440b1340 legacy=0x7fcc44143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc2c0037d0 0x7fcc2c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc2c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 0x7fcc2c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44147e70 con 0x7fcc2c0037d0 2021-11-15T19:34:12.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0052e0 con 0x7fcc2c004500 2021-11-15T19:34:12.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c00bc40 con 0x7fcc44144610 2021-11-15T19:34:12.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc2c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 -- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 msgr2=0x7fcc2c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:12.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc44144610 0x7fcc2c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 -- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc2c0037d0 msgr2=0x7fcc2c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:12.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc2c0037d0 0x7fcc2c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 -- 172.21.2.137:0/118563684 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c003260 con 0x7fcc2c004500 2021-11-15T19:34:12.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc48d49700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc2c004980 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fcc34007000 tx=0x7fcc34008040).ready entity=mon.1 client_cookie=3ec1d91b5622981f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc34012470 con 0x7fcc2c004500 2021-11-15T19:34:12.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3400c030 con 0x7fcc2c004500 2021-11-15T19:34:12.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.781+0000 7fcc33fff700 1 -- 172.21.2.137:0/118563684 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc340127c0 con 0x7fcc2c004500 2021-11-15T19:34:12.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/118563684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 msgr2=0x7fcc2c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/118563684 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc2c004980 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fcc34007000 tx=0x7fcc34008040).stop 2021-11-15T19:34:12.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc49d4b700 1 -- 172.21.2.137:0/118563684 reap_dead start 2021-11-15T19:34:12.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/118563684 shutdown_connections 2021-11-15T19:34:12.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/118563684 >> 172.21.2.137:0/118563684 conn(0x7fcc440b4e60 msgr2=0x7fcc440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:12.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/118563684 shutdown_connections 2021-11-15T19:34:12.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/118563684 wait complete. 2021-11-15T19:34:12.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 Processor -- start 2021-11-15T19:34:12.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- start start 2021-11-15T19:34:12.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc441465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc44145ae0 0x7fcc44146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc4413e840 0x7fcc4413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44145140 con 0x7fcc44145ae0 2021-11-15T19:34:12.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44144a70 con 0x7fcc2c004500 2021-11-15T19:34:12.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44140db0 con 0x7fcc4413e840 2021-11-15T19:34:12.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc441465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc441465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38166/0 (socket says 172.21.2.137:38166) 2021-11-15T19:34:12.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 -- 172.21.2.137:0/2770855622 learned_addr learned my addr 172.21.2.137:0/2770855622 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:12.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 -- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc4413e840 msgr2=0x7fcc4413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc4413e840 0x7fcc4413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 -- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc44145ae0 msgr2=0x7fcc44146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc44145ae0 0x7fcc44146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 -- 172.21.2.137:0/2770855622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc44144ca0 con 0x7fcc2c004500 2021-11-15T19:34:12.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4954a700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc441465a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fcc44145280 tx=0x7fcc440abfb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc40007170 con 0x7fcc2c004500 2021-11-15T19:34:12.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc400072d0 con 0x7fcc2c004500 2021-11-15T19:34:12.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc44140ad0 con 0x7fcc2c004500 2021-11-15T19:34:12.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4413f380 con 0x7fcc2c004500 2021-11-15T19:34:12.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc40004920 con 0x7fcc2c004500 2021-11-15T19:34:12.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc44144e30 con 0x7fcc2c004500 2021-11-15T19:34:12.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.785+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc4001b070 con 0x7fcc2c004500 2021-11-15T19:34:12.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.789+0000 7fcc327fc700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcc24053570 0x7fcc24055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.789+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fcc4006b2a0 con 0x7fcc2c004500 2021-11-15T19:34:12.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.789+0000 7fcc48d49700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcc24053570 0x7fcc24055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.789+0000 7fcc48d49700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcc24053570 0x7fcc24055a30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fcc34007000 tx=0x7fcc34008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.789+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc400422a0 con 0x7fcc2c004500 2021-11-15T19:34:12.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.897+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc4405faf0 con 0x7fcc2c004500 2021-11-15T19:34:12.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.897+0000 7fcc327fc700 1 -- 172.21.2.137:0/2770855622 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2144 (secure 0 0 0) 0x7fcc400458c0 con 0x7fcc2c004500 2021-11-15T19:34:12.909 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:12.909 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:11.698625+0000","modified":"2021-11-15T19:34:12.713024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5163},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5163":{"gid":5163,"name":"b","rank":0,"incarnation":50,"state":"up:creating","state_seq":2,"addr":"172.21.2.111:6835/1523710751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1523710751},{"type":"v1","addr":"172.21.2.111:6835","nonce":1523710751}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T19:34:12.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcc24053570 msgr2=0x7fcc24055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcc24053570 0x7fcc24055a30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fcc34007000 tx=0x7fcc34008040).stop 2021-11-15T19:34:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 msgr2=0x7fcc441465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc441465a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fcc44145280 tx=0x7fcc440abfb0).stop 2021-11-15T19:34:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 shutdown_connections 2021-11-15T19:34:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fcc24053570 0x7fcc24055a30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcc4413e840 0x7fcc4413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcc44145ae0 0x7fcc44146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 --2- 172.21.2.137:0/2770855622 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcc2c004500 0x7fcc441465a0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 >> 172.21.2.137:0/2770855622 conn(0x7fcc440b4e60 msgr2=0x7fcc441495f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 shutdown_connections 2021-11-15T19:34:12.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.901+0000 7fcc4b7ae700 1 -- 172.21.2.137:0/2770855622 wait complete. 2021-11-15T19:34:12.913 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 50 2021-11-15T19:34:12.916 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:12.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 Processor -- start 2021-11-15T19:34:12.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- start start 2021-11-15T19:34:12.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f87680b1340 0x7f8768147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8768148190 con 0x7f8768143f00 2021-11-15T19:34:12.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87680b1720 con 0x7f87680a9f50 2021-11-15T19:34:12.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8768147e70 con 0x7f87680b1340 2021-11-15T19:34:12.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8766d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f87680b1340 0x7f8768147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876759e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f87680a9f50 0x7f87680aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56956/0 (socket says 172.21.2.137:56956) 2021-11-15T19:34:12.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876759e700 1 -- 172.21.2.137:0/219659256 learned_addr learned my addr 172.21.2.137:0/219659256 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:12.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8766d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f87680b1340 0x7f8768147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38170/0 (socket says 172.21.2.137:38170) 2021-11-15T19:34:12.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8766d9d700 1 -- 172.21.2.137:0/219659256 >> v1:172.21.2.137:6789/0 conn(0x7f87680a9f50 legacy=0x7f87680aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8766d9d700 1 -- 172.21.2.137:0/219659256 >> v1:172.21.2.111:6789/0 conn(0x7f8768143f00 legacy=0x7f8768144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:12.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8766d9d700 1 -- 172.21.2.137:0/219659256 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680af800 con 0x7f87680b1340 2021-11-15T19:34:12.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8766d9d700 1 --2- 172.21.2.137:0/219659256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87680b1340 0x7f8768147980 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f8768062250 tx=0x7f8750006df0).ready entity=mon.1 client_cookie=a15b9bda853e8f5d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8765d9b700 1 -- 172.21.2.137:0/219659256 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875000d5c0 con 0x7f87680b1340 2021-11-15T19:34:12.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8765d9b700 1 -- 172.21.2.137:0/219659256 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750000e90 con 0x7f87680b1340 2021-11-15T19:34:12.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f8765d9b700 1 -- 172.21.2.137:0/219659256 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875000d910 con 0x7f87680b1340 2021-11-15T19:34:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- 172.21.2.137:0/219659256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87680b1340 msgr2=0x7f8768147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 --2- 172.21.2.137:0/219659256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87680b1340 0x7f8768147980 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f8768062250 tx=0x7f8750006df0).stop 2021-11-15T19:34:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- 172.21.2.137:0/219659256 shutdown_connections 2021-11-15T19:34:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 --2- 172.21.2.137:0/219659256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87680b1340 0x7f8768147980 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:12.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- 172.21.2.137:0/219659256 >> 172.21.2.137:0/219659256 conn(0x7f87680b4e60 msgr2=0x7f87680b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:12.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- 172.21.2.137:0/219659256 shutdown_connections 2021-11-15T19:34:12.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.957+0000 7f876d0ba700 1 -- 172.21.2.137:0/219659256 wait complete. 2021-11-15T19:34:12.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 Processor -- start 2021-11-15T19:34:12.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- start start 2021-11-15T19:34:12.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87680a9f50 0x7f8768142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f87680b1340 0x7f8768145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 0x7f876809a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768141ac0 con 0x7f87680a9f50 2021-11-15T19:34:12.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87681473e0 con 0x7f8768143f00 2021-11-15T19:34:12.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87680ac350 con 0x7f87680b1340 2021-11-15T19:34:12.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 0x7f876809a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 0x7f876809a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38178/0 (socket says 172.21.2.137:38178) 2021-11-15T19:34:12.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 -- 172.21.2.137:0/172082381 learned_addr learned my addr 172.21.2.137:0/172082381 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:12.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 -- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f87680b1340 msgr2=0x7f8768145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f87680b1340 0x7f8768145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 -- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87680a9f50 msgr2=0x7f8768142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:12.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87680a9f50 0x7f8768142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:12.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 -- 172.21.2.137:0/172082381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875000b180 con 0x7f8768143f00 2021-11-15T19:34:12.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876759e700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 0x7f876809a430 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f876805cfa0 tx=0x7f8760007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8760005ba0 con 0x7f8768143f00 2021-11-15T19:34:12.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760005d00 con 0x7f8768143f00 2021-11-15T19:34:12.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8768141410 con 0x7f8768143f00 2021-11-15T19:34:12.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87600072c0 con 0x7f8768143f00 2021-11-15T19:34:12.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681402e0 con 0x7f8768143f00 2021-11-15T19:34:12.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8768147200 con 0x7f8768143f00 2021-11-15T19:34:12.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f876001a060 con 0x7f8768143f00 2021-11-15T19:34:12.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f875ffff700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f874c0536d0 0x7f874c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:12.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f876006b4a0 con 0x7f8768143f00 2021-11-15T19:34:12.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.961+0000 7f8766d9d700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f874c0536d0 0x7f874c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:12.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.965+0000 7f8766d9d700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f874c0536d0 0x7f874c055b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f8768062250 tx=0x7f8750012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:12.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:12.965+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f87600425b0 con 0x7f8768143f00 2021-11-15T19:34:13.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.045+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f876805faf0 con 0x7f8768143f00 2021-11-15T19:34:13.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.045+0000 7f875ffff700 1 -- 172.21.2.137:0/172082381 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f8760018020 con 0x7f8768143f00 2021-11-15T19:34:13.057 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:13.058 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":102,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:12.576072+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:10.473721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:10.694997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.137:6833/2486512308":"2021-11-16T19:34:12.506218+0000","172.21.2.137:6832/2486512308":"2021-11-16T19:34:12.506218+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:13.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f874c0536d0 msgr2=0x7f874c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f874c0536d0 0x7f874c055b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f8768062250 tx=0x7f8750012000).stop 2021-11-15T19:34:13.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 msgr2=0x7f876809a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 0x7f876809a430 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f876805cfa0 tx=0x7f8760007f40).stop 2021-11-15T19:34:13.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 shutdown_connections 2021-11-15T19:34:13.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f874c0536d0 0x7f874c055b90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8768143f00 0x7f876809a430 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f87680b1340 0x7f8768145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 --2- 172.21.2.137:0/172082381 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87680a9f50 0x7f8768142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 >> 172.21.2.137:0/172082381 conn(0x7f87680b4e60 msgr2=0x7f87680af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 shutdown_connections 2021-11-15T19:34:13.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.049+0000 7f876d0ba700 1 -- 172.21.2.137:0/172082381 wait complete. 2021-11-15T19:34:13.065 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:34:13.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 Processor -- start 2021-11-15T19:34:13.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 -- start start 2021-11-15T19:34:13.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f52500608f0 0x7f525013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525005fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500b1af0 con 0x7f52500b1660 2021-11-15T19:34:13.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500ad6c0 con 0x7f52500608f0 2021-11-15T19:34:13.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.109+0000 7f5255a62700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250060070 con 0x7f525005f730 2021-11-15T19:34:13.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525005fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524f7fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f52500608f0 0x7f525013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525005fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:39758/0 (socket says 172.21.2.137:39758) 2021-11-15T19:34:13.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 -- 172.21.2.137:0/2848840941 learned_addr learned my addr 172.21.2.137:0/2848840941 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 -- 172.21.2.137:0/2848840941 >> v2:172.21.2.111:3300/0 conn(0x7f52500608f0 msgr2=0x7f525013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:13.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 --2- 172.21.2.137:0/2848840941 >> v2:172.21.2.111:3300/0 conn(0x7f52500608f0 0x7f525013f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 -- 172.21.2.137:0/2848840941 >> v1:172.21.2.111:6789/0 conn(0x7f52500b1660 legacy=0x7f52500b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 -- 172.21.2.137:0/2848840941 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500b0c80 con 0x7f525005f730 2021-11-15T19:34:13.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524f7fe700 1 --2- 172.21.2.137:0/2848840941 >> v2:172.21.2.111:3300/0 conn(0x7f52500608f0 0x7f525013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:13.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524ffff700 1 --2- 172.21.2.137:0/2848840941 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525005fb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f52480032f0 tx=0x7f52480090f0).ready entity=mon.2 client_cookie=4573f850eb988841 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524e7fc700 1 -- 172.21.2.137:0/2848840941 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f524800cc90 con 0x7f525005f730 2021-11-15T19:34:13.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524e7fc700 1 -- 172.21.2.137:0/2848840941 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524800cdf0 con 0x7f525005f730 2021-11-15T19:34:13.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f524e7fc700 1 -- 172.21.2.137:0/2848840941 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f524800f650 con 0x7f525005f730 2021-11-15T19:34:13.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 -- 172.21.2.137:0/2848840941 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 msgr2=0x7f525005fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 --2- 172.21.2.137:0/2848840941 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525005fb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f52480032f0 tx=0x7f52480090f0).stop 2021-11-15T19:34:13.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 -- 172.21.2.137:0/2848840941 shutdown_connections 2021-11-15T19:34:13.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 --2- 172.21.2.137:0/2848840941 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525005fb80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 --2- 172.21.2.137:0/2848840941 >> v2:172.21.2.111:3300/0 conn(0x7f52500608f0 0x7f525013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 -- 172.21.2.137:0/2848840941 >> 172.21.2.137:0/2848840941 conn(0x7f5250063980 msgr2=0x7f5250063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 -- 172.21.2.137:0/2848840941 shutdown_connections 2021-11-15T19:34:13.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 -- 172.21.2.137:0/2848840941 wait complete. 2021-11-15T19:34:13.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 Processor -- start 2021-11-15T19:34:13.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.113+0000 7f5255a62700 1 -- start start 2021-11-15T19:34:13.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525013a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52500608f0 0x7f5250127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 0x7f525013c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52501397e0 con 0x7f52500608f0 2021-11-15T19:34:13.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250139a10 con 0x7f52500b1660 2021-11-15T19:34:13.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525013eb10 con 0x7f525005f730 2021-11-15T19:34:13.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 0x7f525013c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 0x7f525013c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38194/0 (socket says 172.21.2.137:38194) 2021-11-15T19:34:13.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 -- 172.21.2.137:0/1659203445 learned_addr learned my addr 172.21.2.137:0/1659203445 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 -- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 msgr2=0x7f525013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 -- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52500608f0 msgr2=0x7f5250127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52500608f0 0x7f5250127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 -- 172.21.2.137:0/1659203445 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523800d590 con 0x7f52500b1660 2021-11-15T19:34:13.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524ffff700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 0x7f525013c350 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f5250142530 tx=0x7f5248016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f524801e070 con 0x7f52500b1660 2021-11-15T19:34:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524800f680 con 0x7f52500b1660 2021-11-15T19:34:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5248018aa0 con 0x7f52500b1660 2021-11-15T19:34:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524800b5e0 con 0x7f52500b1660 2021-11-15T19:34:13.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525013c840 con 0x7f52500b1660 2021-11-15T19:34:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52500b0f20 con 0x7f52500b1660 2021-11-15T19:34:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f524802a070 con 0x7f52500b1660 2021-11-15T19:34:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524cff9700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52340536a0 0x7f5234055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f524806d860 con 0x7f52500b1660 2021-11-15T19:34:13.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524f7fe700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52340536a0 0x7f5234055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.117+0000 7f524f7fe700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52340536a0 0x7f5234055b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5238010000 tx=0x7f523800f040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.121+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5248044970 con 0x7f52500b1660 2021-11-15T19:34:13.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.229+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5250143c70 con 0x7f52500b1660 2021-11-15T19:34:13.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f524cff9700 1 -- 172.21.2.137:0/1659203445 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5248047f90 con 0x7f52500b1660 2021-11-15T19:34:13.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52340536a0 msgr2=0x7f5234055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52340536a0 0x7f5234055b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5238010000 tx=0x7f523800f040).stop 2021-11-15T19:34:13.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 msgr2=0x7f525013c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 0x7f525013c350 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f5250142530 tx=0x7f5248016000).stop 2021-11-15T19:34:13.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 shutdown_connections 2021-11-15T19:34:13.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f52340536a0 0x7f5234055b60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f52500b1660 0x7f525013c350 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f52500608f0 0x7f5250127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 --2- 172.21.2.137:0/1659203445 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f525005f730 0x7f525013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 >> 172.21.2.137:0/1659203445 conn(0x7f5250063980 msgr2=0x7f5250063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 shutdown_connections 2021-11-15T19:34:13.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.245+0000 7f5255a62700 1 -- 172.21.2.137:0/1659203445 wait complete. 2021-11-15T19:34:13.257 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:34:13.260 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:34:13.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 Processor -- start 2021-11-15T19:34:13.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- start start 2021-11-15T19:34:13.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff068061690 0x7ff068142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff06813f8f0 0x7ff06813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068143470 con 0x7ff0680ac0c0 2021-11-15T19:34:13.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680b28b0 con 0x7ff068061690 2021-11-15T19:34:13.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068143250 con 0x7ff06813f8f0 2021-11-15T19:34:13.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff06813f8f0 0x7ff06813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff06813f8f0 0x7ff06813fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38200/0 (socket says 172.21.2.137:38200) 2021-11-15T19:34:13.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 -- 172.21.2.137:0/115269515 learned_addr learned my addr 172.21.2.137:0/115269515 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff067fff700 1 --1- 172.21.2.137:0/115269515 >> v1:172.21.2.137:6789/0 conn(0x7ff0680ac0c0 0x7ff06813edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:56984/0 (socket says 172.21.2.137:56984) 2021-11-15T19:34:13.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 -- 172.21.2.137:0/115269515 >> v2:172.21.2.111:3300/0 conn(0x7ff068061690 msgr2=0x7ff068142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:13.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 --2- 172.21.2.137:0/115269515 >> v2:172.21.2.111:3300/0 conn(0x7ff068061690 0x7ff068142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 -- 172.21.2.137:0/115269515 >> v1:172.21.2.137:6789/0 conn(0x7ff0680ac0c0 legacy=0x7ff06813edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 -- 172.21.2.137:0/115269515 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068143710 con 0x7ff06813f8f0 2021-11-15T19:34:13.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06d5b1700 1 --2- 172.21.2.137:0/115269515 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813fcd0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7ff0600032f0 tx=0x7ff06000b530).ready entity=mon.1 client_cookie=3de6e92f0e137907 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff0677fe700 1 -- 172.21.2.137:0/115269515 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06000be70 con 0x7ff06813f8f0 2021-11-15T19:34:13.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff0677fe700 1 -- 172.21.2.137:0/115269515 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff060010470 con 0x7ff06813f8f0 2021-11-15T19:34:13.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff0677fe700 1 -- 172.21.2.137:0/115269515 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0600107d0 con 0x7ff06813f8f0 2021-11-15T19:34:13.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- 172.21.2.137:0/115269515 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 msgr2=0x7ff06813fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 --2- 172.21.2.137:0/115269515 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813fcd0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7ff0600032f0 tx=0x7ff06000b530).stop 2021-11-15T19:34:13.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- 172.21.2.137:0/115269515 shutdown_connections 2021-11-15T19:34:13.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 --2- 172.21.2.137:0/115269515 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813fcd0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 --2- 172.21.2.137:0/115269515 >> v2:172.21.2.111:3300/0 conn(0x7ff068061690 0x7ff068142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- 172.21.2.137:0/115269515 >> 172.21.2.137:0/115269515 conn(0x7ff068064500 msgr2=0x7ff0680b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- 172.21.2.137:0/115269515 shutdown_connections 2021-11-15T19:34:13.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- 172.21.2.137:0/115269515 wait complete. 2021-11-15T19:34:13.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 Processor -- start 2021-11-15T19:34:13.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.305+0000 7ff06f014700 1 -- start start 2021-11-15T19:34:13.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff068061690 0x7ff068142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0680ac0c0 0x7ff06809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068142d00 con 0x7ff0680ac0c0 2021-11-15T19:34:13.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068142ef0 con 0x7ff06813f8f0 2021-11-15T19:34:13.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06809bc70 con 0x7ff068061690 2021-11-15T19:34:13.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38208/0 (socket says 172.21.2.137:38208) 2021-11-15T19:34:13.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 -- 172.21.2.137:0/521438250 learned_addr learned my addr 172.21.2.137:0/521438250 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 -- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff068061690 msgr2=0x7ff068142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff068061690 0x7ff068142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 -- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0680ac0c0 msgr2=0x7ff06809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0680ac0c0 0x7ff06809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 -- 172.21.2.137:0/521438250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06000b7d0 con 0x7ff06813f8f0 2021-11-15T19:34:13.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06d5b1700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813e110 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7ff06809a0f0 tx=0x7ff0680abf30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06001d070 con 0x7ff06813f8f0 2021-11-15T19:34:13.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0600188d0 con 0x7ff06813f8f0 2021-11-15T19:34:13.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06809b9c0 con 0x7ff06813f8f0 2021-11-15T19:34:13.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff060018c30 con 0x7ff06813f8f0 2021-11-15T19:34:13.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0681411c0 con 0x7ff06813f8f0 2021-11-15T19:34:13.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06809be70 con 0x7ff06813f8f0 2021-11-15T19:34:13.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff060029070 con 0x7ff06813f8f0 2021-11-15T19:34:13.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff065ffb700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff04c053610 0x7ff04c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7ff06006d230 con 0x7ff06813f8f0 2021-11-15T19:34:13.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06cdb0700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff04c053610 0x7ff04c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.309+0000 7ff06cdb0700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff04c053610 0x7ff04c055ad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7ff050002f70 tx=0x7ff050006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.313+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff06809be70 con 0x7ff06813f8f0 2021-11-15T19:34:13.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.425+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff06809be70 con 0x7ff06813f8f0 2021-11-15T19:34:13.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff065ffb700 1 -- 172.21.2.137:0/521438250 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff06809be70 con 0x7ff06813f8f0 2021-11-15T19:34:13.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff04c053610 msgr2=0x7ff04c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff04c053610 0x7ff04c055ad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7ff050002f70 tx=0x7ff050006a80).stop 2021-11-15T19:34:13.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 msgr2=0x7ff06813e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813e110 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7ff06809a0f0 tx=0x7ff0680abf30).stop 2021-11-15T19:34:13.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 shutdown_connections 2021-11-15T19:34:13.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff04c053610 0x7ff04c055ad0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff06813f8f0 0x7ff06813e110 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff0680ac0c0 0x7ff06809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 --2- 172.21.2.137:0/521438250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff068061690 0x7ff068142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 >> 172.21.2.137:0/521438250 conn(0x7ff068064500 msgr2=0x7ff06813fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 shutdown_connections 2021-11-15T19:34:13.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.437+0000 7ff06f014700 1 -- 172.21.2.137:0/521438250 wait complete. 2021-11-15T19:34:13.451 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:34:13.455 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:34:13.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.497+0000 7fa0a1aae700 1 Processor -- start 2021-11-15T19:34:13.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.497+0000 7fa0a1aae700 1 -- start start 2021-11-15T19:34:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.497+0000 7fa0a1aae700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa09c0b0830 0x7fa09c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.497+0000 7fa0a1aae700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa09c0b10b0 0x7fa09c0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.497+0000 7fa0a1aae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c147f70 con 0x7fa09c05fd20 2021-11-15T19:34:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.497+0000 7fa0a1aae700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c060100 con 0x7fa09c0b10b0 2021-11-15T19:34:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c147cd0 con 0x7fa09c0b0830 2021-11-15T19:34:13.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa09c0b0830 0x7fa09c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa09c0b0830 0x7fa09c0af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38214/0 (socket says 172.21.2.137:38214) 2021-11-15T19:34:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/289635075 learned_addr learned my addr 172.21.2.137:0/289635075 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/289635075 >> v2:172.21.2.111:3300/0 conn(0x7fa09c0b10b0 msgr2=0x7fa09c0aa370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- 172.21.2.137:0/289635075 >> v2:172.21.2.111:3300/0 conn(0x7fa09c0b10b0 0x7fa09c0aa370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/289635075 >> v1:172.21.2.111:6789/0 conn(0x7fa09c05fd20 legacy=0x7fa09c0b0120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:13.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/289635075 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0a9ed0 con 0x7fa09c0b0830 2021-11-15T19:34:13.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- 172.21.2.137:0/289635075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c0af800 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa09c0b4db0 tx=0x7fa08c006eb0).ready entity=mon.1 client_cookie=cae604f9db0cbee1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09a7fc700 1 -- 172.21.2.137:0/289635075 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c00d5c0 con 0x7fa09c0b0830 2021-11-15T19:34:13.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09a7fc700 1 -- 172.21.2.137:0/289635075 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c000e90 con 0x7fa09c0b0830 2021-11-15T19:34:13.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09a7fc700 1 -- 172.21.2.137:0/289635075 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c00d910 con 0x7fa09c0b0830 2021-11-15T19:34:13.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/289635075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 msgr2=0x7fa09c0af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/289635075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c0af800 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa09c0b4db0 tx=0x7fa08c006eb0).stop 2021-11-15T19:34:13.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/289635075 shutdown_connections 2021-11-15T19:34:13.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/289635075 >> v2:172.21.2.111:3300/0 conn(0x7fa09c0b10b0 0x7fa09c0aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/289635075 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c0af800 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/289635075 >> 172.21.2.137:0/289635075 conn(0x7fa09c0b4e60 msgr2=0x7fa09c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/289635075 shutdown_connections 2021-11-15T19:34:13.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/289635075 wait complete. 2021-11-15T19:34:13.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 Processor -- start 2021-11-15T19:34:13.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- start start 2021-11-15T19:34:13.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa09c05fd20 0x7fa09c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c13ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa09c0b10b0 0x7fa09c140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c064ea0 con 0x7fa09c0b10b0 2021-11-15T19:34:13.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0627b0 con 0x7fa09c0b0830 2021-11-15T19:34:13.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c062a50 con 0x7fa09c05fd20 2021-11-15T19:34:13.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c13ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c13ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38222/0 (socket says 172.21.2.137:38222) 2021-11-15T19:34:13.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/77407724 learned_addr learned my addr 172.21.2.137:0/77407724 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09bfff700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa09c0b10b0 0x7fa09c140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09b7fe700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa09c05fd20 0x7fa09c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa09c05fd20 msgr2=0x7fa09c0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa09c05fd20 0x7fa09c0ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa09c0b10b0 msgr2=0x7fa09c140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa09c0b10b0 0x7fa09c140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 -- 172.21.2.137:0/77407724 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c00b1e0 con 0x7fa09c0b0830 2021-11-15T19:34:13.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09bfff700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa09c0b10b0 0x7fa09c140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:13.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09b7fe700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa09c05fd20 0x7fa09c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:13.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa09affd700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c13ff90 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fa09c0b4db0 tx=0x7fa08c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c002f70 con 0x7fa09c0b0830 2021-11-15T19:34:13.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c00de70 con 0x7fa09c0b0830 2021-11-15T19:34:13.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c140970 con 0x7fa09c0b0830 2021-11-15T19:34:13.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c01e460 con 0x7fa09c0b0830 2021-11-15T19:34:13.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.501+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c062ef0 con 0x7fa09c0b0830 2021-11-15T19:34:13.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c062c10 con 0x7fa09c0b0830 2021-11-15T19:34:13.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa08c025030 con 0x7fa09c0b0830 2021-11-15T19:34:13.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa098ff9700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa080053580 0x7fa080055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fa08c06cc70 con 0x7fa09c0b0830 2021-11-15T19:34:13.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa09b7fe700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa080053580 0x7fa080055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa09b7fe700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa080053580 0x7fa080055a40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa084007000 tx=0x7fa084008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.505+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa08c043d80 con 0x7fa09c0b0830 2021-11-15T19:34:13.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.617+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa09c1479f0 con 0x7fa09c0b0830 2021-11-15T19:34:13.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa098ff9700 1 -- 172.21.2.137:0/77407724 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa08c023020 con 0x7fa09c0b0830 2021-11-15T19:34:13.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa080053580 msgr2=0x7fa080055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa080053580 0x7fa080055a40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa084007000 tx=0x7fa084008040).stop 2021-11-15T19:34:13.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 msgr2=0x7fa09c13ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c13ff90 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fa09c0b4db0 tx=0x7fa08c015000).stop 2021-11-15T19:34:13.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 shutdown_connections 2021-11-15T19:34:13.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa080053580 0x7fa080055a40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa09c0b10b0 0x7fa09c140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa09c0b0830 0x7fa09c13ff90 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 --2- 172.21.2.137:0/77407724 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa09c05fd20 0x7fa09c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 >> 172.21.2.137:0/77407724 conn(0x7fa09c0b4e60 msgr2=0x7fa09c0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 shutdown_connections 2021-11-15T19:34:13.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.633+0000 7fa0a1aae700 1 -- 172.21.2.137:0/77407724 wait complete. 2021-11-15T19:34:13.642 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:34:13.646 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:13.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 Processor -- start 2021-11-15T19:34:13.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 -- start start 2021-11-15T19:34:13.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffb50144610 0x7ffb50147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ffb500a9f50 0x7ffb500aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb50148190 con 0x7ffb500b1340 2021-11-15T19:34:13.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb500b1720 con 0x7ffb500a9f50 2021-11-15T19:34:13.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb57509700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb50147e70 con 0x7ffb50144610 2021-11-15T19:34:13.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffb50144610 0x7ffb50147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffb50144610 0x7ffb50147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38228/0 (socket says 172.21.2.137:38228) 2021-11-15T19:34:13.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 -- 172.21.2.137:0/773955080 learned_addr learned my addr 172.21.2.137:0/773955080 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb55aa6700 1 --2- 172.21.2.137:0/773955080 >> v2:172.21.2.111:3300/0 conn(0x7ffb500a9f50 0x7ffb500aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 -- 172.21.2.137:0/773955080 >> v2:172.21.2.111:3300/0 conn(0x7ffb500a9f50 msgr2=0x7ffb500aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:13.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 --2- 172.21.2.137:0/773955080 >> v2:172.21.2.111:3300/0 conn(0x7ffb500a9f50 0x7ffb500aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 -- 172.21.2.137:0/773955080 >> v1:172.21.2.111:6789/0 conn(0x7ffb500b1340 legacy=0x7ffb50143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:13.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 -- 172.21.2.137:0/773955080 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500af800 con 0x7ffb50144610 2021-11-15T19:34:13.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb55aa6700 1 --2- 172.21.2.137:0/773955080 >> v2:172.21.2.111:3300/0 conn(0x7ffb500a9f50 0x7ffb500aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:13.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb54aa4700 1 --2- 172.21.2.137:0/773955080 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50147980 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7ffb50062250 tx=0x7ffb44006eb0).ready entity=mon.1 client_cookie=ee447f036ccf480d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.685+0000 7ffb43fff700 1 -- 172.21.2.137:0/773955080 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4400d5c0 con 0x7ffb50144610 2021-11-15T19:34:13.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb43fff700 1 -- 172.21.2.137:0/773955080 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb44000e90 con 0x7ffb50144610 2021-11-15T19:34:13.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb43fff700 1 -- 172.21.2.137:0/773955080 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4400d910 con 0x7ffb50144610 2021-11-15T19:34:13.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/773955080 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 msgr2=0x7ffb50147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 --2- 172.21.2.137:0/773955080 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50147980 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7ffb50062250 tx=0x7ffb44006eb0).stop 2021-11-15T19:34:13.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/773955080 shutdown_connections 2021-11-15T19:34:13.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 --2- 172.21.2.137:0/773955080 >> v2:172.21.2.111:3300/0 conn(0x7ffb500a9f50 0x7ffb500aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 --2- 172.21.2.137:0/773955080 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50147980 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/773955080 >> 172.21.2.137:0/773955080 conn(0x7ffb500b4e60 msgr2=0x7ffb500b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/773955080 shutdown_connections 2021-11-15T19:34:13.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/773955080 wait complete. 2021-11-15T19:34:13.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 Processor -- start 2021-11-15T19:34:13.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- start start 2021-11-15T19:34:13.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffb500a9f50 0x7ffb5013f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffb500b1340 0x7ffb5009a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50098e80 con 0x7ffb500a9f50 2021-11-15T19:34:13.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50099120 con 0x7ffb50144610 2021-11-15T19:34:13.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500993c0 con 0x7ffb500b1340 2021-11-15T19:34:13.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38236/0 (socket says 172.21.2.137:38236) 2021-11-15T19:34:13.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 -- 172.21.2.137:0/3790337693 learned_addr learned my addr 172.21.2.137:0/3790337693 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:13.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 -- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffb500b1340 msgr2=0x7ffb5009a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffb500b1340 0x7ffb5009a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 -- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffb500a9f50 msgr2=0x7ffb5013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffb500a9f50 0x7ffb5013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 -- 172.21.2.137:0/3790337693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4400b1e0 con 0x7ffb50144610 2021-11-15T19:34:13.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb55aa6700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50149e30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7ffb48007000 tx=0x7ffb48008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb48007540 con 0x7ffb50144610 2021-11-15T19:34:13.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480076a0 con 0x7ffb50144610 2021-11-15T19:34:13.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb50099710 con 0x7ffb50144610 2021-11-15T19:34:13.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb48007a00 con 0x7ffb50144610 2021-11-15T19:34:13.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb50143400 con 0x7ffb50144610 2021-11-15T19:34:13.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5009a730 con 0x7ffb50144610 2021-11-15T19:34:13.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.689+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb48019030 con 0x7ffb50144610 2021-11-15T19:34:13.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.693+0000 7ffb427fc700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb30053690 0x7ffb30055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:13.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.693+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7ffb4806baa0 con 0x7ffb50144610 2021-11-15T19:34:13.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.693+0000 7ffb552a5700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb30053690 0x7ffb30055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:13.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.693+0000 7ffb552a5700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb30053690 0x7ffb30055b50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ffb4c002f30 tx=0x7ffb4c006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:13.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.693+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb48042aa0 con 0x7ffb50144610 2021-11-15T19:34:13.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.801+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb5009ac20 con 0x7ffb50144610 2021-11-15T19:34:13.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.801+0000 7ffb427fc700 1 -- 172.21.2.137:0/3790337693 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2142 (secure 0 0 0) 0x7ffb480460c0 con 0x7ffb50144610 2021-11-15T19:34:13.813 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:13.813 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:11.698625+0000","modified":"2021-11-15T19:34:13.716867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5163},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5163":{"gid":5163,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.2.111:6835/1523710751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1523710751},{"type":"v1","addr":"172.21.2.111:6835","nonce":1523710751}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T19:34:13.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb30053690 msgr2=0x7ffb30055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb30053690 0x7ffb30055b50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ffb4c002f30 tx=0x7ffb4c006930).stop 2021-11-15T19:34:13.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 msgr2=0x7ffb50149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:13.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50149e30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7ffb48007000 tx=0x7ffb48008040).stop 2021-11-15T19:34:13.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 shutdown_connections 2021-11-15T19:34:13.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb30053690 0x7ffb30055b50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffb50144610 0x7ffb50149e30 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:13.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffb500b1340 0x7ffb5009a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 --2- 172.21.2.137:0/3790337693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffb500a9f50 0x7ffb5013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:13.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 >> 172.21.2.137:0/3790337693 conn(0x7ffb500b4e60 msgr2=0x7ffb500af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:13.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 shutdown_connections 2021-11-15T19:34:13.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:13.805+0000 7ffb57509700 1 -- 172.21.2.137:0/3790337693 wait complete. 2021-11-15T19:34:13.817 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 51 2021-11-15T19:34:14.022 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:34:11.698625+0000', 'modified': '2021-11-15T19:34:13.716867+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5163}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5163': {'gid': 5163, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.111:6835/1523710751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 1523710751}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 1523710751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:34:14.022 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:34:14.023 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:34:14.087 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5163,"want_state":"up:active","state":"up:active","rank_uptime":1.363968783,"mdsmap_epoch":51,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":5.5256012720000003} 2021-11-15T19:34:14.088 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5163, "mdsmap_epoch": 51, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 1.363968783, "state": "up:active", "uptime": 5.525601272, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:34:14.088 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:14.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c28b6b700 1 Processor -- start 2021-11-15T19:34:14.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c28b6b700 1 -- start start 2021-11-15T19:34:14.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c28b6b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1c241401a0 0x7f1c24146870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c28b6b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c240b1720 con 0x7f1c24066f40 2021-11-15T19:34:14.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c28b6b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c240abfe0 con 0x7f1c240af800 2021-11-15T19:34:14.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c28b6b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240aa230 con 0x7f1c241401a0 2021-11-15T19:34:14.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c21d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1c240af800 0x7f1c24146160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57024/0 (socket says 172.21.2.137:57024) 2021-11-15T19:34:14.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c21d9b700 1 -- 172.21.2.137:0/941411704 learned_addr learned my addr 172.21.2.137:0/941411704 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:14.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c22d9d700 1 --2- 172.21.2.137:0/941411704 >> v2:172.21.2.111:3300/0 conn(0x7f1c241401a0 0x7f1c24146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c2159a700 1 -- 172.21.2.137:0/941411704 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949896404 0 0) 0x7f1c240abfe0 con 0x7f1c240af800 2021-11-15T19:34:14.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.133+0000 7f1c2159a700 1 -- 172.21.2.137:0/941411704 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c08003260 con 0x7f1c240af800 2021-11-15T19:34:14.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2159a700 1 -- 172.21.2.137:0/941411704 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2274252653 0 0) 0x7f1c08003260 con 0x7f1c240af800 2021-11-15T19:34:14.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c22d9d700 1 -- 172.21.2.137:0/941411704 >> v1:172.21.2.137:6789/0 conn(0x7f1c240af800 legacy=0x7f1c24146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c22d9d700 1 -- 172.21.2.137:0/941411704 >> v1:172.21.2.111:6789/0 conn(0x7f1c24066f40 legacy=0x7f1c2413fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c22d9d700 1 -- 172.21.2.137:0/941411704 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24060d50 con 0x7f1c241401a0 2021-11-15T19:34:14.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c22d9d700 1 --2- 172.21.2.137:0/941411704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c24146870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1c14001800 tx=0x7f1c1c0091d0).ready entity=mon.0 client_cookie=fbd769030704b854 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2159a700 1 -- 172.21.2.137:0/941411704 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c14001660 con 0x7f1c241401a0 2021-11-15T19:34:14.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2159a700 1 -- 172.21.2.137:0/941411704 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00b580 con 0x7f1c241401a0 2021-11-15T19:34:14.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2159a700 1 -- 172.21.2.137:0/941411704 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c00b6f0 con 0x7f1c241401a0 2021-11-15T19:34:14.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/941411704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 msgr2=0x7f1c24146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/941411704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c24146870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1c14001800 tx=0x7f1c1c0091d0).stop 2021-11-15T19:34:14.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/941411704 shutdown_connections 2021-11-15T19:34:14.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/941411704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c24146870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/941411704 >> 172.21.2.137:0/941411704 conn(0x7f1c240b4e60 msgr2=0x7f1c240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/941411704 shutdown_connections 2021-11-15T19:34:14.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/941411704 wait complete. 2021-11-15T19:34:14.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 Processor -- start 2021-11-15T19:34:14.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- start start 2021-11-15T19:34:14.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 0x7f1c2409a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1c240af800 0x7f1c24147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c2413b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24145740 con 0x7f1c241401a0 2021-11-15T19:34:14.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24099710 con 0x7f1c24066f40 2021-11-15T19:34:14.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24147820 con 0x7f1c240af800 2021-11-15T19:34:14.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 0x7f1c2409a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 0x7f1c2409a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38246/0 (socket says 172.21.2.137:38246) 2021-11-15T19:34:14.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 -- 172.21.2.137:0/779626826 learned_addr learned my addr 172.21.2.137:0/779626826 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c21d9b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1c240af800 0x7f1c24147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c22d9d700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c2413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 -- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1c240af800 msgr2=0x7f1c24147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1c240af800 0x7f1c24147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 -- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 msgr2=0x7f1c2413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c2413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 -- 172.21.2.137:0/779626826 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009470 con 0x7f1c24066f40 2021-11-15T19:34:14.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c2259c700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 0x7f1c2409a700 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f1c2409b040 tx=0x7f1c18007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1800ce30 con 0x7f1c24066f40 2021-11-15T19:34:14.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18007240 con 0x7f1c24066f40 2021-11-15T19:34:14.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24147ac0 con 0x7f1c24066f40 2021-11-15T19:34:14.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c18006700 con 0x7f1c24066f40 2021-11-15T19:34:14.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c24144280 con 0x7f1c24066f40 2021-11-15T19:34:14.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.137+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c240573d0 con 0x7f1c24066f40 2021-11-15T19:34:14.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.141+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c18010030 con 0x7f1c24066f40 2021-11-15T19:34:14.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.141+0000 7f1c137fe700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1c000535b0 0x7f1c00055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.141+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f1c1806b5e0 con 0x7f1c24066f40 2021-11-15T19:34:14.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.141+0000 7f1c21d9b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1c000535b0 0x7f1c00055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.141+0000 7f1c21d9b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1c000535b0 0x7f1c00055a70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1c1400b000 tx=0x7f1c14001920).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.141+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c180426f0 con 0x7f1c24066f40 2021-11-15T19:34:14.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c2405db70 con 0x7f1c24066f40 2021-11-15T19:34:14.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c137fe700 1 -- 172.21.2.137:0/779626826 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f1c18045d10 con 0x7f1c24066f40 2021-11-15T19:34:14.234 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:14.235 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":102,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:12.576072+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:10.473721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:10.694997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.137:6833/2486512308":"2021-11-16T19:34:12.506218+0000","172.21.2.137:6832/2486512308":"2021-11-16T19:34:12.506218+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:14.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1c000535b0 msgr2=0x7f1c00055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1c000535b0 0x7f1c00055a70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1c1400b000 tx=0x7f1c14001920).stop 2021-11-15T19:34:14.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 msgr2=0x7f1c2409a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 0x7f1c2409a700 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f1c2409b040 tx=0x7f1c18007c10).stop 2021-11-15T19:34:14.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 shutdown_connections 2021-11-15T19:34:14.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1c000535b0 0x7f1c00055a70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1c241401a0 0x7f1c2413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1c240af800 0x7f1c24147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 --2- 172.21.2.137:0/779626826 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1c24066f40 0x7f1c2409a700 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 >> 172.21.2.137:0/779626826 conn(0x7f1c240b4e60 msgr2=0x7f1c240aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 shutdown_connections 2021-11-15T19:34:14.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.225+0000 7f1c28b6b700 1 -- 172.21.2.137:0/779626826 wait complete. 2021-11-15T19:34:14.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:34:10.473721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:34:10.694997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:34:14.243 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:34:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b1b119700 1 Processor -- start 2021-11-15T19:34:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b1b119700 1 -- start start 2021-11-15T19:34:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b1b119700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9b1405c770 0x7f9b140aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b1b119700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1405cb50 con 0x7f9b140b0550 2021-11-15T19:34:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b1b119700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b140ad030 con 0x7f9b14140aa0 2021-11-15T19:34:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b1b119700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b140b1650 con 0x7f9b1405c770 2021-11-15T19:34:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b18eb5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9b1405c770 0x7f9b140aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b196b6700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9b14140aa0 0x7f9b14140ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57038/0 (socket says 172.21.2.137:57038) 2021-11-15T19:34:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b18eb5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9b1405c770 0x7f9b140aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38254/0 (socket says 172.21.2.137:38254) 2021-11-15T19:34:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b196b6700 1 -- 172.21.2.137:0/500443838 learned_addr learned my addr 172.21.2.137:0/500443838 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b18eb5700 1 -- 172.21.2.137:0/500443838 >> v1:172.21.2.137:6789/0 conn(0x7f9b14140aa0 legacy=0x7f9b14140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b18eb5700 1 -- 172.21.2.137:0/500443838 >> v1:172.21.2.111:6789/0 conn(0x7f9b140b0550 legacy=0x7f9b1414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b18eb5700 1 -- 172.21.2.137:0/500443838 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140ad2d0 con 0x7f9b1405c770 2021-11-15T19:34:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b18eb5700 1 --2- 172.21.2.137:0/500443838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b1405c770 0x7f9b140aef30 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f9b140aee10 tx=0x7f9b04006df0).ready entity=mon.1 client_cookie=d896ffc26089e461 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b137fe700 1 -- 172.21.2.137:0/500443838 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b0400d5c0 con 0x7f9b1405c770 2021-11-15T19:34:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b137fe700 1 -- 172.21.2.137:0/500443838 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04000e90 con 0x7f9b1405c770 2021-11-15T19:34:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.285+0000 7f9b137fe700 1 -- 172.21.2.137:0/500443838 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b0400d910 con 0x7f9b1405c770 2021-11-15T19:34:14.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/500443838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b1405c770 msgr2=0x7f9b140aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 --2- 172.21.2.137:0/500443838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b1405c770 0x7f9b140aef30 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f9b140aee10 tx=0x7f9b04006df0).stop 2021-11-15T19:34:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/500443838 shutdown_connections 2021-11-15T19:34:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 --2- 172.21.2.137:0/500443838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b1405c770 0x7f9b140aef30 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/500443838 >> 172.21.2.137:0/500443838 conn(0x7f9b140631e0 msgr2=0x7f9b1405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/500443838 shutdown_connections 2021-11-15T19:34:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/500443838 wait complete. 2021-11-15T19:34:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 Processor -- start 2021-11-15T19:34:14.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- start start 2021-11-15T19:34:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b1405c770 0x7f9b14147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b140b0550 0x7f9b14144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 0x7f9b14141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14159a00 con 0x7f9b140b0550 2021-11-15T19:34:14.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14066470 con 0x7f9b14140aa0 2021-11-15T19:34:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14066710 con 0x7f9b1405c770 2021-11-15T19:34:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 0x7f9b14141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 0x7f9b14141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38262/0 (socket says 172.21.2.137:38262) 2021-11-15T19:34:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 -- 172.21.2.137:0/1352141227 learned_addr learned my addr 172.21.2.137:0/1352141227 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 -- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b1405c770 msgr2=0x7f9b14147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b1405c770 0x7f9b14147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 -- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b140b0550 msgr2=0x7f9b14144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b140b0550 0x7f9b14144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 -- 172.21.2.137:0/1352141227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0400b180 con 0x7f9b14140aa0 2021-11-15T19:34:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b196b6700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 0x7f9b14141d50 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f9b140620e0 tx=0x7f9b0c007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b0c005ba0 con 0x7f9b14140aa0 2021-11-15T19:34:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c005d00 con 0x7f9b14140aa0 2021-11-15T19:34:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b140669b0 con 0x7f9b14140aa0 2021-11-15T19:34:14.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1414a1d0 con 0x7f9b14140aa0 2021-11-15T19:34:14.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b0c0072c0 con 0x7f9b14140aa0 2021-11-15T19:34:14.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b140ae7f0 con 0x7f9b14140aa0 2021-11-15T19:34:14.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b0c010070 con 0x7f9b14140aa0 2021-11-15T19:34:14.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b11ffb700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9af80536a0 0x7f9af8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.289+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f9b0c06b2b0 con 0x7f9b14140aa0 2021-11-15T19:34:14.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.293+0000 7f9b18eb5700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9af80536a0 0x7f9af8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.293+0000 7f9b18eb5700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9af80536a0 0x7f9af8055b60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9b140aee10 tx=0x7f9b04012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.293+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b0c0423c0 con 0x7f9b14140aa0 2021-11-15T19:34:14.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9b140573d0 con 0x7f9b14140aa0 2021-11-15T19:34:14.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b11ffb700 1 -- 172.21.2.137:0/1352141227 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9b0c0459e0 con 0x7f9b14140aa0 2021-11-15T19:34:14.387 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:34:14.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9af80536a0 msgr2=0x7f9af8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9af80536a0 0x7f9af8055b60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9b140aee10 tx=0x7f9b04012000).stop 2021-11-15T19:34:14.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 msgr2=0x7f9b14141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 0x7f9b14141d50 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f9b140620e0 tx=0x7f9b0c007f00).stop 2021-11-15T19:34:14.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 shutdown_connections 2021-11-15T19:34:14.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9af80536a0 0x7f9af8055b60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9b14140aa0 0x7f9b14141d50 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9b140b0550 0x7f9b14144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 --2- 172.21.2.137:0/1352141227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9b1405c770 0x7f9b14147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 >> 172.21.2.137:0/1352141227 conn(0x7f9b140631e0 msgr2=0x7f9b1414c990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 shutdown_connections 2021-11-15T19:34:14.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.377+0000 7f9b1b119700 1 -- 172.21.2.137:0/1352141227 wait complete. 2021-11-15T19:34:14.395 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:34:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 Processor -- start 2021-11-15T19:34:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 -- start start 2021-11-15T19:34:14.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe09c05c770 0x7fe09c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c140aa0 0x7fe09c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c05cb50 con 0x7fe09c0b0550 2021-11-15T19:34:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0b1650 con 0x7fe09c05c770 2021-11-15T19:34:14.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a303f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0ad030 con 0x7fe09c140aa0 2021-11-15T19:34:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a15dc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c140aa0 0x7fe09c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe09bfff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fe09c0b0550 0x7fe09c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:49542/0 (socket says 172.21.2.137:49542) 2021-11-15T19:34:14.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe09bfff700 1 -- 172.21.2.137:0/1836884267 learned_addr learned my addr 172.21.2.137:0/1836884267 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:14.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.437+0000 7fe0a0ddb700 1 --2- 172.21.2.137:0/1836884267 >> v2:172.21.2.111:3300/0 conn(0x7fe09c05c770 0x7fe09c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a0ddb700 1 -- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c140aa0 msgr2=0x7fe09c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a0ddb700 1 --2- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c140aa0 0x7fe09c140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a0ddb700 1 -- 172.21.2.137:0/1836884267 >> v1:172.21.2.111:6789/0 conn(0x7fe09c0b0550 legacy=0x7fe09c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a0ddb700 1 -- 172.21.2.137:0/1836884267 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0ad2d0 con 0x7fe09c05c770 2021-11-15T19:34:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a0ddb700 1 --2- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c05c770 0x7fe09c0aef30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe08c002f70 tx=0x7fe08c006df0).ready entity=mon.0 client_cookie=f6aced6b4b7e72bd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe09b7fe700 1 -- 172.21.2.137:0/1836884267 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe08c00d570 con 0x7fe09c05c770 2021-11-15T19:34:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe09b7fe700 1 -- 172.21.2.137:0/1836884267 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c000e90 con 0x7fe09c05c770 2021-11-15T19:34:14.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe09b7fe700 1 -- 172.21.2.137:0/1836884267 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe08c00d8c0 con 0x7fe09c05c770 2021-11-15T19:34:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c05c770 msgr2=0x7fe09c0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 --2- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c05c770 0x7fe09c0aef30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe08c002f70 tx=0x7fe08c006df0).stop 2021-11-15T19:34:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- 172.21.2.137:0/1836884267 shutdown_connections 2021-11-15T19:34:14.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 --2- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c140aa0 0x7fe09c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 --2- 172.21.2.137:0/1836884267 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c05c770 0x7fe09c0aef30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- 172.21.2.137:0/1836884267 >> 172.21.2.137:0/1836884267 conn(0x7fe09c0631e0 msgr2=0x7fe09c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- 172.21.2.137:0/1836884267 shutdown_connections 2021-11-15T19:34:14.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- 172.21.2.137:0/1836884267 wait complete. 2021-11-15T19:34:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 Processor -- start 2021-11-15T19:34:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- start start 2021-11-15T19:34:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c05c770 0x7fe09c064870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c0b0550 0x7fe09c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 0x7fe09c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c1420a0 con 0x7fe09c0b0550 2021-11-15T19:34:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c142340 con 0x7fe09c140aa0 2021-11-15T19:34:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a303f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c1425e0 con 0x7fe09c05c770 2021-11-15T19:34:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.441+0000 7fe0a15dc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 0x7fe09c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 0x7fe09c15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38272/0 (socket says 172.21.2.137:38272) 2021-11-15T19:34:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 -- 172.21.2.137:0/4011264331 learned_addr learned my addr 172.21.2.137:0/4011264331 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 -- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c05c770 msgr2=0x7fe09c064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c05c770 0x7fe09c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 -- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c0b0550 msgr2=0x7fe09c159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c0b0550 0x7fe09c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 -- 172.21.2.137:0/4011264331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c00b180 con 0x7fe09c140aa0 2021-11-15T19:34:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a15dc700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 0x7fe09c15a320 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fe094006e00 tx=0x7fe0940091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09400c7f0 con 0x7fe09c140aa0 2021-11-15T19:34:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400c950 con 0x7fe09c140aa0 2021-11-15T19:34:14.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c159960 con 0x7fe09c140aa0 2021-11-15T19:34:14.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09400ccb0 con 0x7fe09c140aa0 2021-11-15T19:34:14.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c141c00 con 0x7fe09c140aa0 2021-11-15T19:34:14.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c1427a0 con 0x7fe09c140aa0 2021-11-15T19:34:14.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe094022070 con 0x7fe09c140aa0 2021-11-15T19:34:14.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe099ffb700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe0800534f0 0x7fe0800559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fe09406c140 con 0x7fe09c140aa0 2021-11-15T19:34:14.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a0ddb700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe0800534f0 0x7fe0800559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.445+0000 7fe0a0ddb700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe0800534f0 0x7fe0800559b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fe08c002f70 tx=0x7fe08c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.449+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe094043140 con 0x7fe09c140aa0 2021-11-15T19:34:14.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.529+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe09c0ae7f0 con 0x7fe09c140aa0 2021-11-15T19:34:14.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe099ffb700 1 -- 172.21.2.137:0/4011264331 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0940160a0 con 0x7fe09c140aa0 2021-11-15T19:34:14.543 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:14.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe0800534f0 msgr2=0x7fe0800559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe0800534f0 0x7fe0800559b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fe08c002f70 tx=0x7fe08c014000).stop 2021-11-15T19:34:14.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 msgr2=0x7fe09c15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 0x7fe09c15a320 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fe094006e00 tx=0x7fe0940091d0).stop 2021-11-15T19:34:14.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 shutdown_connections 2021-11-15T19:34:14.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe0800534f0 0x7fe0800559b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe09c140aa0 0x7fe09c15a320 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe09c0b0550 0x7fe09c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 --2- 172.21.2.137:0/4011264331 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe09c05c770 0x7fe09c064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 >> 172.21.2.137:0/4011264331 conn(0x7fe09c0631e0 msgr2=0x7fe09c13df80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 shutdown_connections 2021-11-15T19:34:14.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.533+0000 7fe0a303f700 1 -- 172.21.2.137:0/4011264331 wait complete. 2021-11-15T19:34:14.550 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:34:14.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 Processor -- start 2021-11-15T19:34:14.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- start start 2021-11-15T19:34:14.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f261c0b0550 0x7f261c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f261c14aaa0 0x7f261c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c05cb50 con 0x7f261c05c770 2021-11-15T19:34:14.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0b1650 con 0x7f261c14aaa0 2021-11-15T19:34:14.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0ad030 con 0x7f261c0b0550 2021-11-15T19:34:14.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f261c0b0550 0x7f261c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f261c0b0550 0x7f261c14a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38284/0 (socket says 172.21.2.137:38284) 2021-11-15T19:34:14.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 -- 172.21.2.137:0/2550250742 learned_addr learned my addr 172.21.2.137:0/2550250742 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 -- 172.21.2.137:0/2550250742 >> v2:172.21.2.111:3300/0 conn(0x7f261c14aaa0 msgr2=0x7f261c140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:14.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 --2- 172.21.2.137:0/2550250742 >> v2:172.21.2.111:3300/0 conn(0x7f261c14aaa0 0x7f261c140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 -- 172.21.2.137:0/2550250742 >> v1:172.21.2.111:6789/0 conn(0x7f261c05c770 legacy=0x7f261c0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:14.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 -- 172.21.2.137:0/2550250742 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0ad2d0 con 0x7f261c0b0550 2021-11-15T19:34:14.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f2620b99700 1 --2- 172.21.2.137:0/2550250742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c0b0550 0x7f261c14a5b0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f261c0aee10 tx=0x7f2618006eb0).ready entity=mon.1 client_cookie=e8c666aecfe8bad8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f260bfff700 1 -- 172.21.2.137:0/2550250742 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800d5c0 con 0x7f261c0b0550 2021-11-15T19:34:14.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f260bfff700 1 -- 172.21.2.137:0/2550250742 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618000e90 con 0x7f261c0b0550 2021-11-15T19:34:14.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f260bfff700 1 -- 172.21.2.137:0/2550250742 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800d910 con 0x7f261c0b0550 2021-11-15T19:34:14.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- 172.21.2.137:0/2550250742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c0b0550 msgr2=0x7f261c14a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 --2- 172.21.2.137:0/2550250742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c0b0550 0x7f261c14a5b0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f261c0aee10 tx=0x7f2618006eb0).stop 2021-11-15T19:34:14.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- 172.21.2.137:0/2550250742 shutdown_connections 2021-11-15T19:34:14.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 --2- 172.21.2.137:0/2550250742 >> v2:172.21.2.111:3300/0 conn(0x7f261c14aaa0 0x7f261c140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 --2- 172.21.2.137:0/2550250742 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c0b0550 0x7f261c14a5b0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- 172.21.2.137:0/2550250742 >> 172.21.2.137:0/2550250742 conn(0x7f261c0631e0 msgr2=0x7f261c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- 172.21.2.137:0/2550250742 shutdown_connections 2021-11-15T19:34:14.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- 172.21.2.137:0/2550250742 wait complete. 2021-11-15T19:34:14.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 Processor -- start 2021-11-15T19:34:14.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.593+0000 7f26235fe700 1 -- start start 2021-11-15T19:34:14.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 0x7f261c1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f261c0b0550 0x7f261c1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f261c14aaa0 0x7f261c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c141ab0 con 0x7f261c14aaa0 2021-11-15T19:34:14.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c144b20 con 0x7f261c05c770 2021-11-15T19:34:14.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c144830 con 0x7f261c0b0550 2021-11-15T19:34:14.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 0x7f261c1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 0x7f261c1420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38288/0 (socket says 172.21.2.137:38288) 2021-11-15T19:34:14.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 -- 172.21.2.137:0/2690695498 learned_addr learned my addr 172.21.2.137:0/2690695498 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f2621b9b700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f261c14aaa0 0x7f261c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f2620b99700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f261c0b0550 0x7f261c1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 -- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f261c0b0550 msgr2=0x7f261c1425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f261c0b0550 0x7f261c1425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 -- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f261c14aaa0 msgr2=0x7f261c146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f261c14aaa0 0x7f261c146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 -- 172.21.2.137:0/2690695498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261800b1e0 con 0x7f261c05c770 2021-11-15T19:34:14.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f2621b9b700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f261c14aaa0 0x7f261c146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:34:14.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f262139a700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 0x7f261c1420e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f260c002ef0 tx=0x7f260c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260c012410 con 0x7f261c05c770 2021-11-15T19:34:14.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c012570 con 0x7f261c05c770 2021-11-15T19:34:14.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260c0128d0 con 0x7f261c05c770 2021-11-15T19:34:14.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c067540 con 0x7f261c05c770 2021-11-15T19:34:14.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c066a70 con 0x7f261c05c770 2021-11-15T19:34:14.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c0ae7f0 con 0x7f261c05c770 2021-11-15T19:34:14.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f260c00f030 con 0x7f261c05c770 2021-11-15T19:34:14.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f260a7fc700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25fc0536d0 0x7f25fc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f260c06b600 con 0x7f261c05c770 2021-11-15T19:34:14.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f2620b99700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25fc0536d0 0x7f25fc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.597+0000 7f2620b99700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25fc0536d0 0x7f25fc055b90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f261801a000 tx=0x7f2618015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.601+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f260c042710 con 0x7f261c05c770 2021-11-15T19:34:14.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.681+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f261c0573d0 con 0x7f261c05c770 2021-11-15T19:34:14.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f260a7fc700 1 -- 172.21.2.137:0/2690695498 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f260c045d30 con 0x7f261c05c770 2021-11-15T19:34:14.693 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:14.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25fc0536d0 msgr2=0x7f25fc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25fc0536d0 0x7f25fc055b90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f261801a000 tx=0x7f2618015000).stop 2021-11-15T19:34:14.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 msgr2=0x7f261c1420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 0x7f261c1420e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f260c002ef0 tx=0x7f260c006d50).stop 2021-11-15T19:34:14.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 shutdown_connections 2021-11-15T19:34:14.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25fc0536d0 0x7f25fc055b90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f261c14aaa0 0x7f261c146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f261c0b0550 0x7f261c1425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 --2- 172.21.2.137:0/2690695498 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f261c05c770 0x7f261c1420e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 >> 172.21.2.137:0/2690695498 conn(0x7f261c0631e0 msgr2=0x7f261c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 shutdown_connections 2021-11-15T19:34:14.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.685+0000 7f26235fe700 1 -- 172.21.2.137:0/2690695498 wait complete. 2021-11-15T19:34:14.701 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:34:14.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 Processor -- start 2021-11-15T19:34:14.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- start start 2021-11-15T19:34:14.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b0550 0x7f61cc14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f61cc14aaa0 0x7f61cc140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc05cb50 con 0x7f61cc05c770 2021-11-15T19:34:14.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0b1650 con 0x7f61cc14aaa0 2021-11-15T19:34:14.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0ad030 con 0x7f61cc0b0550 2021-11-15T19:34:14.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f61cc14aaa0 0x7f61cc140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f61cc14aaa0 0x7f61cc140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38296/0 (socket says 172.21.2.137:38296) 2021-11-15T19:34:14.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 -- 172.21.2.137:0/1101267000 learned_addr learned my addr 172.21.2.137:0/1101267000 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 -- 172.21.2.137:0/1101267000 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b0550 msgr2=0x7f61cc14a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:14.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 --2- 172.21.2.137:0/1101267000 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b0550 0x7f61cc14a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 -- 172.21.2.137:0/1101267000 >> v1:172.21.2.111:6789/0 conn(0x7f61cc05c770 legacy=0x7f61cc0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:14.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 -- 172.21.2.137:0/1101267000 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0ad2d0 con 0x7f61cc14aaa0 2021-11-15T19:34:14.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d0bb5700 1 --2- 172.21.2.137:0/1101267000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc14aaa0 0x7f61cc140aa0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f61cc0adfd0 tx=0x7f61c4009290).ready entity=mon.1 client_cookie=f80eec4ed7408c6b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61caffd700 1 -- 172.21.2.137:0/1101267000 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c400b860 con 0x7f61cc14aaa0 2021-11-15T19:34:14.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61caffd700 1 -- 172.21.2.137:0/1101267000 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c400b9c0 con 0x7f61cc14aaa0 2021-11-15T19:34:14.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61caffd700 1 -- 172.21.2.137:0/1101267000 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c400bb70 con 0x7f61cc14aaa0 2021-11-15T19:34:14.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- 172.21.2.137:0/1101267000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc14aaa0 msgr2=0x7f61cc140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- 172.21.2.137:0/1101267000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc14aaa0 0x7f61cc140aa0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f61cc0adfd0 tx=0x7f61c4009290).stop 2021-11-15T19:34:14.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- 172.21.2.137:0/1101267000 shutdown_connections 2021-11-15T19:34:14.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- 172.21.2.137:0/1101267000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc14aaa0 0x7f61cc140aa0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- 172.21.2.137:0/1101267000 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc0b0550 0x7f61cc14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- 172.21.2.137:0/1101267000 >> 172.21.2.137:0/1101267000 conn(0x7f61cc0631e0 msgr2=0x7f61cc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- 172.21.2.137:0/1101267000 shutdown_connections 2021-11-15T19:34:14.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- 172.21.2.137:0/1101267000 wait complete. 2021-11-15T19:34:14.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 Processor -- start 2021-11-15T19:34:14.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- start start 2021-11-15T19:34:14.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 0x7f61cc064c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc0b0550 0x7f61cc14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc14aaa0 0x7f61cc0664f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc067650 con 0x7f61cc0b0550 2021-11-15T19:34:14.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc147600 con 0x7f61cc05c770 2021-11-15T19:34:14.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61d2618700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1478a0 con 0x7f61cc14aaa0 2021-11-15T19:34:14.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 0x7f61cc064c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 0x7f61cc064c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38300/0 (socket says 172.21.2.137:38300) 2021-11-15T19:34:14.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 -- 172.21.2.137:0/1769796529 learned_addr learned my addr 172.21.2.137:0/1769796529 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 -- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc14aaa0 msgr2=0x7f61cc0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc14aaa0 0x7f61cc0664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 -- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc0b0550 msgr2=0x7f61cc14a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc0b0550 0x7f61cc14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.745+0000 7f61cbfff700 1 -- 172.21.2.137:0/1769796529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4009530 con 0x7f61cc05c770 2021-11-15T19:34:14.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61cbfff700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 0x7f61cc064c80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f61bc002ef0 tx=0x7f61bc006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc012410 con 0x7f61cc05c770 2021-11-15T19:34:14.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc012570 con 0x7f61cc05c770 2021-11-15T19:34:14.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc147b40 con 0x7f61cc05c770 2021-11-15T19:34:14.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc063d30 con 0x7f61cc05c770 2021-11-15T19:34:14.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc0128d0 con 0x7f61cc05c770 2021-11-15T19:34:14.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc147cd0 con 0x7f61cc05c770 2021-11-15T19:34:14.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61bc00f030 con 0x7f61cc05c770 2021-11-15T19:34:14.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61c97fa700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b00535d0 0x7f61b0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f61bc06b7b0 con 0x7f61cc05c770 2021-11-15T19:34:14.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61cb7fe700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b00535d0 0x7f61b0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.749+0000 7f61cb7fe700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b00535d0 0x7f61b0055a90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f61b4002fb0 tx=0x7f61b40069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.753+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61bc0427b0 con 0x7f61cc05c770 2021-11-15T19:34:14.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.833+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61cc0573d0 con 0x7f61cc05c770 2021-11-15T19:34:14.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.833+0000 7f61c97fa700 1 -- 172.21.2.137:0/1769796529 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7f61bc045dd0 con 0x7f61cc05c770 2021-11-15T19:34:14.844 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:14.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b00535d0 msgr2=0x7f61b0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b00535d0 0x7f61b0055a90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f61b4002fb0 tx=0x7f61b40069b0).stop 2021-11-15T19:34:14.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 msgr2=0x7f61cc064c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 0x7f61cc064c80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f61bc002ef0 tx=0x7f61bc006d50).stop 2021-11-15T19:34:14.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 shutdown_connections 2021-11-15T19:34:14.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f61b00535d0 0x7f61b0055a90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f61cc14aaa0 0x7f61cc0664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f61cc0b0550 0x7f61cc14a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 --2- 172.21.2.137:0/1769796529 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f61cc05c770 0x7f61cc064c80 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 >> 172.21.2.137:0/1769796529 conn(0x7f61cc0631e0 msgr2=0x7f61cc1484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 shutdown_connections 2021-11-15T19:34:14.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.837+0000 7f61d2618700 1 -- 172.21.2.137:0/1769796529 wait complete. 2021-11-15T19:34:14.852 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:34:14.853 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:14.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c07fff700 1 Processor -- start 2021-11-15T19:34:14.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c07fff700 1 -- start start 2021-11-15T19:34:14.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c07fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 0x7f3c080aa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c07fff700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080aa0a0 con 0x7f3c081473c0 2021-11-15T19:34:14.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c07fff700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080aa340 con 0x7f3c08098370 2021-11-15T19:34:14.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c07fff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080aa5e0 con 0x7f3c080b1060 2021-11-15T19:34:14.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c067fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3c08098370 0x7f3c080987b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57094/0 (socket says 172.21.2.137:57094) 2021-11-15T19:34:14.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c067fc700 1 -- 172.21.2.137:0/2672838475 learned_addr learned my addr 172.21.2.137:0/2672838475 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:14.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942209872 0 0) 0x7f3c080aa340 con 0x7f3c08098370 2021-11-15T19:34:14.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be8003260 con 0x7f3c08098370 2021-11-15T19:34:14.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381647723 0 0) 0x7f3be8003260 con 0x7f3c08098370 2021-11-15T19:34:14.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 msgr2=0x7f3c080aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:14.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 0x7f3c080aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 >> v1:172.21.2.111:6789/0 conn(0x7f3c081473c0 legacy=0x7f3c08147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:14.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08098ec0 con 0x7f3c08098370 2021-11-15T19:34:14.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3bf0001660 con 0x7f3c08098370 2021-11-15T19:34:14.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 >> v1:172.21.2.137:6789/0 conn(0x7f3c08098370 legacy=0x7f3c080987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3be8003750 0x7f3be8003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 0x7f3be8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3be8004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080aa5e0 con 0x7f3be8003750 2021-11-15T19:34:14.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be800b8e0 con 0x7f3be8004b10 2021-11-15T19:34:14.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be800baa0 con 0x7f3c080b1060 2021-11-15T19:34:14.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3be8004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c067fc700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 0x7f3be8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 -- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 msgr2=0x7f3be8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:14.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080b1060 0x7f3be8004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:14.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 -- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3be8003750 msgr2=0x7f3be8003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:14.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3be8003750 0x7f3be8003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 -- 172.21.2.137:0/2672838475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8003260 con 0x7f3be8004b10 2021-11-15T19:34:14.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c077fe700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3be8004f90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f3c000012f0 tx=0x7f3c00007d60).ready entity=mon.1 client_cookie=9fff7ac57baefd40 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c000014c0 con 0x7f3be8004b10 2021-11-15T19:34:14.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00006870 con 0x7f3be8004b10 2021-11-15T19:34:14.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.893+0000 7f3c05ffb700 1 -- 172.21.2.137:0/2672838475 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c00006bd0 con 0x7f3be8004b10 2021-11-15T19:34:14.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/2672838475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 msgr2=0x7f3be8004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 --2- 172.21.2.137:0/2672838475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3be8004f90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f3c000012f0 tx=0x7f3c00007d60).stop 2021-11-15T19:34:14.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c077fe700 1 -- 172.21.2.137:0/2672838475 reap_dead start 2021-11-15T19:34:14.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/2672838475 shutdown_connections 2021-11-15T19:34:14.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/2672838475 >> 172.21.2.137:0/2672838475 conn(0x7f3c080b22b0 msgr2=0x7f3c0805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:14.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/2672838475 shutdown_connections 2021-11-15T19:34:14.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/2672838475 wait complete. 2021-11-15T19:34:14.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 Processor -- start 2021-11-15T19:34:14.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- start start 2021-11-15T19:34:14.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3c0814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080ad030 0x7f3c08156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c08159d50 0x7f3c0815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080ac260 con 0x7f3c08159d50 2021-11-15T19:34:14.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08159650 con 0x7f3be8004b10 2021-11-15T19:34:14.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08063af0 con 0x7f3c080ad030 2021-11-15T19:34:14.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3c0814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3c0814b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38324/0 (socket says 172.21.2.137:38324) 2021-11-15T19:34:14.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 -- 172.21.2.137:0/3814797723 learned_addr learned my addr 172.21.2.137:0/3814797723 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:14.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 -- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080ad030 msgr2=0x7f3c08156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080ad030 0x7f3c08156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 -- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c08159d50 msgr2=0x7f3c0815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:14.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c08159d50 0x7f3c0815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:14.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 -- 172.21.2.137:0/3814797723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08063d70 con 0x7f3be8004b10 2021-11-15T19:34:14.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c06ffd700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3c0814b8b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f3c080aca20 tx=0x7f3bf8006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf8013460 con 0x7f3be8004b10 2021-11-15T19:34:14.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf80135c0 con 0x7f3be8004b10 2021-11-15T19:34:14.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c081598b0 con 0x7f3be8004b10 2021-11-15T19:34:14.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf8013920 con 0x7f3be8004b10 2021-11-15T19:34:14.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c080acc60 con 0x7f3be8004b10 2021-11-15T19:34:14.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c08159a40 con 0x7f3be8004b10 2021-11-15T19:34:14.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3bf801a060 con 0x7f3be8004b10 2021-11-15T19:34:14.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3bfffff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3bec053540 0x7f3bec055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:14.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.897+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f3bf806b4b0 con 0x7f3be8004b10 2021-11-15T19:34:14.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.901+0000 7f3c067fc700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3bec053540 0x7f3bec055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:14.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.901+0000 7f3c067fc700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3bec053540 0x7f3bec055a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3bf0008000 tx=0x7f3bf0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:14.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:14.901+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3bf80424b0 con 0x7f3be8004b10 2021-11-15T19:34:15.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.009+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c080a9d20 con 0x7f3be8004b10 2021-11-15T19:34:15.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.009+0000 7f3bfffff700 1 -- 172.21.2.137:0/3814797723 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f3bf8018020 con 0x7f3be8004b10 2021-11-15T19:34:15.021 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:15.021 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:11.698625+0000","modified":"2021-11-15T19:34:13.716867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5163},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5163":{"gid":5163,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.2.111:6835/1523710751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1523710751},{"type":"v1","addr":"172.21.2.111:6835","nonce":1523710751}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T19:34:15.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3bec053540 msgr2=0x7f3bec055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:15.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3bec053540 0x7f3bec055a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3bf0008000 tx=0x7f3bf0009040).stop 2021-11-15T19:34:15.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 msgr2=0x7f3c0814b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:15.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3c0814b8b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f3c080aca20 tx=0x7f3bf8006e40).stop 2021-11-15T19:34:15.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 shutdown_connections 2021-11-15T19:34:15.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3bec053540 0x7f3bec055a00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:15.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c08159d50 0x7f3c0815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:15.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c080ad030 0x7f3c08156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:15.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 --2- 172.21.2.137:0/3814797723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3be8004b10 0x7f3c0814b8b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:15.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 >> 172.21.2.137:0/3814797723 conn(0x7f3c080b22b0 msgr2=0x7f3c080afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:15.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 shutdown_connections 2021-11-15T19:34:15.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:15.013+0000 7f3c07fff700 1 -- 172.21.2.137:0/3814797723 wait complete. 2021-11-15T19:34:15.025 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 51 2021-11-15T19:34:15.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2021-11-15T19:34:15.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:34:11.698625+0000', 'modified': '2021-11-15T19:34:13.716867+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5163}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5163': {'gid': 5163, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.111:6835/1523710751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 1523710751}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 1523710751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:34:15.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:34:15.230 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:34:15.294 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5163,"want_state":"up:active","state":"up:active","rank_uptime":2.5706972640000001,"mdsmap_epoch":51,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":6.732329923} 2021-11-15T19:34:15.294 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5163, "mdsmap_epoch": 51, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 2.570697264, "state": "up:active", "uptime": 6.732329923, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:34:15.295 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:34:15.295 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:34:15.296 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:34:15.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:15.296 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:15.307 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:34:15.360 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:15.360 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:15.366 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:15.366 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:15.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:15.368 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:34:15.372 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:34:15.372 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:15.416 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:34:15.425 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:15.425 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:15.430 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:15.431 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:15.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:15.432 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:34:15.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15021]: starting ceph client 2021-11-15T19:34:15.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:34:15.450+0000 7f8153242080 -1 init, newargv = 0x55c2f16a3bc0 newargc=9 2021-11-15T19:34:15.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15021]: starting fuse 2021-11-15T19:34:16.537 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:34:16.549 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:16.549 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:16.601 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:16.601 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:16.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:16.603 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:34:16.608 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:34:16.608 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:34:16.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:16.609 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:34:16.610 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:34:16.610 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:34:16.610 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:34:16.611 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:34:16.611 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:16.611 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:34:16.612 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:34:16.612 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:34:16.612 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:16.613 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:34:16.613 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:34:16.614 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:34:16.614 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:34:16.614 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:16.615 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:34:16.615 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:34:16.616 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:34:16.616 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:34:16.616 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:34:16.617 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:16.617 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:34:16.618 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:34:16.648 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.15021.asok 2021-11-15T19:34:16.650 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15021.asok 2021-11-15T19:34:16.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:16.651 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15021.asok status 2021-11-15T19:34:16.753 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:34:16.753 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:34:16.754 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:34:16.754 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:34:16.754 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:34:16.754 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:34:16.755 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:34:16.755 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "15021", 2021-11-15T19:34:16.755 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:34:16.755 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:16.755 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:34:16.756 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:34:16.756 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4856, 2021-11-15T19:34:16.756 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:34:16.756 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:34:16.756 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:34:16.757 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4856 2021-11-15T19:34:16.757 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:16.757 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:34:16.757 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:34:16.758 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:34:16.758 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1189680909 2021-11-15T19:34:16.758 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:34:16.758 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:16.758 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:34:16.759 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:34:16.759 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:34:16.759 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1189680909 2021-11-15T19:34:16.759 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:16.759 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4856 172.21.2.131:0/1189680909", 2021-11-15T19:34:16.760 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/1189680909", 2021-11-15T19:34:16.760 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:34:16.760 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 51, 2021-11-15T19:34:16.760 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 102, 2021-11-15T19:34:16.760 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:34:16.761 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:34:16.761 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:34:16.761 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:34:16.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:16.762 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:16.763 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:16.768 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:34:16.768 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:16.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:16.769 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:16.818 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:16.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 Processor -- start 2021-11-15T19:34:16.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- start start 2021-11-15T19:34:16.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 0x7f89f409cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f89f40b3140 0x7f89f405f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89f409ab00 0x7f89f4143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f409d190 con 0x7f89f40b3140 2021-11-15T19:34:16.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f4099790 con 0x7f89f409ab00 2021-11-15T19:34:16.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40b2940 con 0x7f89f409c8c0 2021-11-15T19:34:16.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89f409ab00 0x7f89f4143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:16.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f89f409ab00 0x7f89f4143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38328/0 (socket says 172.21.2.137:38328) 2021-11-15T19:34:16.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 -- 172.21.2.137:0/88404811 learned_addr learned my addr 172.21.2.137:0/88404811 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:16.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 -- 172.21.2.137:0/88404811 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 msgr2=0x7f89f409cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:16.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 --2- 172.21.2.137:0/88404811 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 0x7f89f409cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 -- 172.21.2.137:0/88404811 >> v2:172.21.2.111:3300/0 conn(0x7f89f40b3140 msgr2=0x7f89f405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:16.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 --2- 172.21.2.137:0/88404811 >> v2:172.21.2.111:3300/0 conn(0x7f89f40b3140 0x7f89f405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 -- 172.21.2.137:0/88404811 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4099a30 con 0x7f89f409ab00 2021-11-15T19:34:16.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f2d9d700 1 --2- 172.21.2.137:0/88404811 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4143260 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f89ec0032f0 tx=0x7f89ec009290).ready entity=mon.1 client_cookie=a7e33c19cf746d9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:16.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f159a700 1 -- 172.21.2.137:0/88404811 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89ec00b870 con 0x7f89f409ab00 2021-11-15T19:34:16.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f159a700 1 -- 172.21.2.137:0/88404811 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00b9d0 con 0x7f89f409ab00 2021-11-15T19:34:16.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f159a700 1 -- 172.21.2.137:0/88404811 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89ec00bb40 con 0x7f89f409ab00 2021-11-15T19:34:16.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- 172.21.2.137:0/88404811 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 msgr2=0x7f89f4143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:16.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- 172.21.2.137:0/88404811 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4143260 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f89ec0032f0 tx=0x7f89ec009290).stop 2021-11-15T19:34:16.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- 172.21.2.137:0/88404811 shutdown_connections 2021-11-15T19:34:16.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- 172.21.2.137:0/88404811 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4143260 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:16.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- 172.21.2.137:0/88404811 >> v2:172.21.2.111:3300/0 conn(0x7f89f40b3140 0x7f89f405f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 --2- 172.21.2.137:0/88404811 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 0x7f89f409cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- 172.21.2.137:0/88404811 >> 172.21.2.137:0/88404811 conn(0x7f89f40b45b0 msgr2=0x7f89f405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:16.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- 172.21.2.137:0/88404811 shutdown_connections 2021-11-15T19:34:16.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.865+0000 7f89f8a03700 1 -- 172.21.2.137:0/88404811 wait complete. 2021-11-15T19:34:16.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 Processor -- start 2021-11-15T19:34:16.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- start start 2021-11-15T19:34:16.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 0x7f89f4156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89f40b3140 0x7f89f4064d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4156530 con 0x7f89f40b3140 2021-11-15T19:34:16.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f41567d0 con 0x7f89f409ab00 2021-11-15T19:34:16.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4156260 con 0x7f89f409c8c0 2021-11-15T19:34:16.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4097df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:16.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4097df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38334/0 (socket says 172.21.2.137:38334) 2021-11-15T19:34:16.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 -- 172.21.2.137:0/2454987848 learned_addr learned my addr 172.21.2.137:0/2454987848 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:16.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 -- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 msgr2=0x7f89f4156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:16.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 0x7f89f4156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 -- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89f40b3140 msgr2=0x7f89f4064d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:16.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89f40b3140 0x7f89f4064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 -- 172.21.2.137:0/2454987848 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009530 con 0x7f89f409ab00 2021-11-15T19:34:16.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f259c700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4097df0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f89e4002f70 tx=0x7f89e4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:16.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e4013460 con 0x7f89f409ab00 2021-11-15T19:34:16.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40135c0 con 0x7f89f409ab00 2021-11-15T19:34:16.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f40982e0 con 0x7f89f409ab00 2021-11-15T19:34:16.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e4013920 con 0x7f89f409ab00 2021-11-15T19:34:16.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f40991e0 con 0x7f89f409ab00 2021-11-15T19:34:16.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f40573d0 con 0x7f89f409ab00 2021-11-15T19:34:16.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89e400f070 con 0x7f89f409ab00 2021-11-15T19:34:16.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89e37fe700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d0053640 0x7f89d0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:16.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f89e406b2b0 con 0x7f89f409ab00 2021-11-15T19:34:16.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.869+0000 7f89f1d9b700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d0053640 0x7f89d0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:16.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.873+0000 7f89f1d9b700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d0053640 0x7f89d0055b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f89e8002f70 tx=0x7f89e8006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:16.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.873+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89e40423c0 con 0x7f89f409ab00 2021-11-15T19:34:16.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.953+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f4156960 con 0x7f89f409ab00 2021-11-15T19:34:16.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.953+0000 7f89e37fe700 1 -- 172.21.2.137:0/2454987848 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f89e40459e0 con 0x7f89f409ab00 2021-11-15T19:34:16.965 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:16.965 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":102,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:12.576072+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:10.473721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:10.694997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.137:6833/2486512308":"2021-11-16T19:34:12.506218+0000","172.21.2.137:6832/2486512308":"2021-11-16T19:34:12.506218+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:16.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.953+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d0053640 msgr2=0x7f89d0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:16.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.953+0000 7f89f8a03700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d0053640 0x7f89d0055b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f89e8002f70 tx=0x7f89e8006960).stop 2021-11-15T19:34:16.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.953+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 msgr2=0x7f89f4097df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:16.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.953+0000 7f89f8a03700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4097df0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f89e4002f70 tx=0x7f89e4006ec0).stop 2021-11-15T19:34:16.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 shutdown_connections 2021-11-15T19:34:16.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f89d0053640 0x7f89d0055b00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:16.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f89f40b3140 0x7f89f4064d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f89f409c8c0 0x7f89f4156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:16.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 --2- 172.21.2.137:0/2454987848 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f89f409ab00 0x7f89f4097df0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:16.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 >> 172.21.2.137:0/2454987848 conn(0x7f89f40b45b0 msgr2=0x7f89f41383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:16.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 shutdown_connections 2021-11-15T19:34:16.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:16.957+0000 7f89f8a03700 1 -- 172.21.2.137:0/2454987848 wait complete. 2021-11-15T19:34:16.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:34:10.473721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:34:10.694997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:34:16.973 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:34:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.013+0000 7fbee7edf700 1 Processor -- start 2021-11-15T19:34:17.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.013+0000 7fbee7edf700 1 -- start start 2021-11-15T19:34:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 0x7fbee014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee005cb50 con 0x7fbee005c770 2021-11-15T19:34:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee00ad030 con 0x7fbee014aaa0 2021-11-15T19:34:17.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00b1650 con 0x7fbee00b0550 2021-11-15T19:34:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbee014aaa0 0x7fbee0140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57128/0 (socket says 172.21.2.137:57128) 2021-11-15T19:34:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 -- 172.21.2.137:0/4257750209 learned_addr learned my addr 172.21.2.137:0/4257750209 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472152245 0 0) 0x7fbee00ad030 con 0x7fbee014aaa0 2021-11-15T19:34:17.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8003260 con 0x7fbee014aaa0 2021-11-15T19:34:17.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1289111834 0 0) 0x7fbec8003260 con 0x7fbee014aaa0 2021-11-15T19:34:17.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 msgr2=0x7fbee014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee547a700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 0x7fbee014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 0x7fbee014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 >> v1:172.21.2.111:6789/0 conn(0x7fbee005c770 legacy=0x7fbee00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee00ad2d0 con 0x7fbee014aaa0 2021-11-15T19:34:17.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fbed80019e0 con 0x7fbee014aaa0 2021-11-15T19:34:17.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 >> v1:172.21.2.137:6789/0 conn(0x7fbee014aaa0 legacy=0x7fbee0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 0x7fbec80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbec8003ec0 0x7fbec8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbec8004b40 0x7fbec8004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00b1650 con 0x7fbec8003ec0 2021-11-15T19:34:17.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec800ba00 con 0x7fbec8004b40 2021-11-15T19:34:17.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec800bbc0 con 0x7fbee00b0550 2021-11-15T19:34:17.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbec8004b40 0x7fbec8004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee5c7b700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 0x7fbec80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 -- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 msgr2=0x7fbec80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbee00b0550 0x7fbec80037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 -- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbec8003ec0 msgr2=0x7fbec8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbec8003ec0 0x7fbec8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 -- 172.21.2.137:0/4257750209 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8003260 con 0x7fbec8004b40 2021-11-15T19:34:17.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbec8004b40 0x7fbec8004fc0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fbee00adfd0 tx=0x7fbed80020e0).ready entity=mon.1 client_cookie=61b7abe03c0cfb3a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed800cc00 con 0x7fbec8004b40 2021-11-15T19:34:17.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed800cd60 con 0x7fbec8004b40 2021-11-15T19:34:17.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee4c79700 1 -- 172.21.2.137:0/4257750209 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed8005b80 con 0x7fbec8004b40 2021-11-15T19:34:17.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- 172.21.2.137:0/4257750209 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbec8004b40 msgr2=0x7fbec8004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 --2- 172.21.2.137:0/4257750209 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbec8004b40 0x7fbec8004fc0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fbee00adfd0 tx=0x7fbed80020e0).stop 2021-11-15T19:34:17.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee647c700 1 -- 172.21.2.137:0/4257750209 reap_dead start 2021-11-15T19:34:17.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- 172.21.2.137:0/4257750209 shutdown_connections 2021-11-15T19:34:17.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- 172.21.2.137:0/4257750209 >> 172.21.2.137:0/4257750209 conn(0x7fbee00631e0 msgr2=0x7fbee005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- 172.21.2.137:0/4257750209 shutdown_connections 2021-11-15T19:34:17.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- 172.21.2.137:0/4257750209 wait complete. 2021-11-15T19:34:17.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 Processor -- start 2021-11-15T19:34:17.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.017+0000 7fbee7edf700 1 -- start start 2021-11-15T19:34:17.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbec8004b40 0x7fbee0156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 0x7fbee0142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbee00667e0 0x7fbee00646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0141b90 con 0x7fbee00667e0 2021-11-15T19:34:17.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0141e30 con 0x7fbee01416f0 2021-11-15T19:34:17.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01420d0 con 0x7fbec8004b40 2021-11-15T19:34:17.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 0x7fbee0142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 0x7fbee0142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38356/0 (socket says 172.21.2.137:38356) 2021-11-15T19:34:17.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 -- 172.21.2.137:0/3167525017 learned_addr learned my addr 172.21.2.137:0/3167525017 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:17.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 -- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbec8004b40 msgr2=0x7fbee0156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbec8004b40 0x7fbee0156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 -- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbee00667e0 msgr2=0x7fbee00646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbee00667e0 0x7fbee00646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 -- 172.21.2.137:0/3167525017 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0157170 con 0x7fbee01416f0 2021-11-15T19:34:17.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee547a700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 0x7fbee0142570 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fbedc007000 tx=0x7fbedc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbedc015070 con 0x7fbee01416f0 2021-11-15T19:34:17.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc000e90 con 0x7fbee01416f0 2021-11-15T19:34:17.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbedc010770 con 0x7fbee01416f0 2021-11-15T19:34:17.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee0064be0 con 0x7fbee01416f0 2021-11-15T19:34:17.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee0065090 con 0x7fbee01416f0 2021-11-15T19:34:17.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee0142290 con 0x7fbee01416f0 2021-11-15T19:34:17.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbedc0108d0 con 0x7fbee01416f0 2021-11-15T19:34:17.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbed2ffd700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbec0053720 0x7fbec0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fbedc06b760 con 0x7fbee01416f0 2021-11-15T19:34:17.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee5c7b700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbec0053720 0x7fbec0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.021+0000 7fbee5c7b700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbec0053720 0x7fbec0055be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fbed4008000 tx=0x7fbed4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.025+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbedc042760 con 0x7fbee01416f0 2021-11-15T19:34:17.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbee00ae7f0 con 0x7fbee01416f0 2021-11-15T19:34:17.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbed2ffd700 1 -- 172.21.2.137:0/3167525017 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbedc045d80 con 0x7fbee01416f0 2021-11-15T19:34:17.118 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:34:17.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbec0053720 msgr2=0x7fbec0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbec0053720 0x7fbec0055be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fbed4008000 tx=0x7fbed4009040).stop 2021-11-15T19:34:17.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 msgr2=0x7fbee0142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 0x7fbee0142570 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fbedc007000 tx=0x7fbedc008040).stop 2021-11-15T19:34:17.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 shutdown_connections 2021-11-15T19:34:17.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbec0053720 0x7fbec0055be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbee00667e0 0x7fbee00646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbee01416f0 0x7fbee0142570 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 --2- 172.21.2.137:0/3167525017 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbec8004b40 0x7fbee0156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 >> 172.21.2.137:0/3167525017 conn(0x7fbee00631e0 msgr2=0x7fbee00b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 shutdown_connections 2021-11-15T19:34:17.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.109+0000 7fbee7edf700 1 -- 172.21.2.137:0/3167525017 wait complete. 2021-11-15T19:34:17.125 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:34:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 Processor -- start 2021-11-15T19:34:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- start start 2021-11-15T19:34:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb68c0b6290 0x7fb68c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c0b6670 con 0x7fb68c0b2240 2021-11-15T19:34:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c1438e0 con 0x7fb68c064180 2021-11-15T19:34:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c143b80 con 0x7fb68c0b6290 2021-11-15T19:34:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb6923fb700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb68c064180 0x7fb68c13fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57146/0 (socket says 172.21.2.137:57146) 2021-11-15T19:34:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb6923fb700 1 -- 172.21.2.137:0/171938924 learned_addr learned my addr 172.21.2.137:0/171938924 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:17.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- 172.21.2.137:0/171938924 >> v2:172.21.2.137:3300/0 conn(0x7fb68c0b6290 0x7fb68c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/171938924 >> v1:172.21.2.137:6789/0 conn(0x7fb68c064180 legacy=0x7fb68c13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/171938924 >> v1:172.21.2.111:6789/0 conn(0x7fb68c0b2240 legacy=0x7fb68c1288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/171938924 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c13f830 con 0x7fb68c0b6290 2021-11-15T19:34:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- 172.21.2.137:0/171938924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c0b6290 0x7fb68c0b28a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fb68c060ac0 tx=0x7fb688006df0).ready entity=mon.1 client_cookie=b5070fdaf12a6d2f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb690bf8700 1 -- 172.21.2.137:0/171938924 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb68800d5c0 con 0x7fb68c0b6290 2021-11-15T19:34:17.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb690bf8700 1 -- 172.21.2.137:0/171938924 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688000e90 con 0x7fb68c0b6290 2021-11-15T19:34:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb690bf8700 1 -- 172.21.2.137:0/171938924 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb68800d910 con 0x7fb68c0b6290 2021-11-15T19:34:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- 172.21.2.137:0/171938924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c0b6290 msgr2=0x7fb68c0b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 --2- 172.21.2.137:0/171938924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c0b6290 0x7fb68c0b28a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fb68c060ac0 tx=0x7fb688006df0).stop 2021-11-15T19:34:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- 172.21.2.137:0/171938924 shutdown_connections 2021-11-15T19:34:17.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 --2- 172.21.2.137:0/171938924 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c0b6290 0x7fb68c0b28a0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- 172.21.2.137:0/171938924 >> 172.21.2.137:0/171938924 conn(0x7fb68c069e70 msgr2=0x7fb68c0639e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- 172.21.2.137:0/171938924 shutdown_connections 2021-11-15T19:34:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- 172.21.2.137:0/171938924 wait complete. 2021-11-15T19:34:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 Processor -- start 2021-11-15T19:34:17.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- start start 2021-11-15T19:34:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 0x7fb68c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb68c0b2240 0x7fb68c126840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb68c0b6290 0x7fb68c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c142120 con 0x7fb68c0b2240 2021-11-15T19:34:17.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c067b40 con 0x7fb68c064180 2021-11-15T19:34:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb693e5e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c141be0 con 0x7fb68c0b6290 2021-11-15T19:34:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 0x7fb68c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 0x7fb68c1462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38368/0 (socket says 172.21.2.137:38368) 2021-11-15T19:34:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/524024972 learned_addr learned my addr 172.21.2.137:0/524024972 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:17.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb68c0b6290 msgr2=0x7fb68c13ea80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb68c0b6290 0x7fb68c13ea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb68c0b2240 msgr2=0x7fb68c126840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb68c0b2240 0x7fb68c126840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 -- 172.21.2.137:0/524024972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68800b180 con 0x7fb68c064180 2021-11-15T19:34:17.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb691bfa700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 0x7fb68c1462e0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fb68c060ac0 tx=0x7fb688012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb688016070 con 0x7fb68c064180 2021-11-15T19:34:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.169+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688002f70 con 0x7fb68c064180 2021-11-15T19:34:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c141e80 con 0x7fb68c064180 2021-11-15T19:34:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb688013f00 con 0x7fb68c064180 2021-11-15T19:34:17.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c129560 con 0x7fb68c064180 2021-11-15T19:34:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c1428c0 con 0x7fb68c064180 2021-11-15T19:34:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb688025030 con 0x7fb68c064180 2021-11-15T19:34:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb67effd700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb66c053610 0x7fb66c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fb68806cad0 con 0x7fb68c064180 2021-11-15T19:34:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb6913f9700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb66c053610 0x7fb66c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb6913f9700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb66c053610 0x7fb66c055ad0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fb680002f90 tx=0x7fb680006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.173+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb68c1428c0 con 0x7fb68c064180 2021-11-15T19:34:17.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.257+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb68c1428c0 con 0x7fb68c064180 2021-11-15T19:34:17.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.257+0000 7fb67effd700 1 -- 172.21.2.137:0/524024972 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb68c1428c0 con 0x7fb68c064180 2021-11-15T19:34:17.269 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:17.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb66c053610 msgr2=0x7fb66c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb66c053610 0x7fb66c055ad0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fb680002f90 tx=0x7fb680006930).stop 2021-11-15T19:34:17.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 msgr2=0x7fb68c1462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 0x7fb68c1462e0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fb68c060ac0 tx=0x7fb688012000).stop 2021-11-15T19:34:17.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 shutdown_connections 2021-11-15T19:34:17.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb66c053610 0x7fb66c055ad0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb68c0b6290 0x7fb68c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb68c0b2240 0x7fb68c126840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 --2- 172.21.2.137:0/524024972 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb68c064180 0x7fb68c1462e0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 >> 172.21.2.137:0/524024972 conn(0x7fb68c069e70 msgr2=0x7fb68c1286a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 shutdown_connections 2021-11-15T19:34:17.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.261+0000 7fb693e5e700 1 -- 172.21.2.137:0/524024972 wait complete. 2021-11-15T19:34:17.276 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:34:17.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 Processor -- start 2021-11-15T19:34:17.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- start start 2021-11-15T19:34:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f940b0550 0x7f9f9414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9f9414aaa0 0x7f9f94140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9405cb50 con 0x7f9f9405c770 2021-11-15T19:34:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940b1650 con 0x7f9f9414aaa0 2021-11-15T19:34:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940ad030 con 0x7f9f940b0550 2021-11-15T19:34:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f98e14700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9f9405c770 0x7f9f940aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57158/0 (socket says 172.21.2.137:57158) 2021-11-15T19:34:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f98e14700 1 -- 172.21.2.137:0/3672177340 learned_addr learned my addr 172.21.2.137:0/3672177340 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:17.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083524548 0 0) 0x7f9f9405cb50 con 0x7f9f9405c770 2021-11-15T19:34:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f80003260 con 0x7f9f9405c770 2021-11-15T19:34:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222023837 0 0) 0x7f9f80003260 con 0x7f9f9405c770 2021-11-15T19:34:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f940b0550 msgr2=0x7f9f9414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f940b0550 0x7f9f9414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 >> v2:172.21.2.111:3300/0 conn(0x7f9f9414aaa0 msgr2=0x7f9f94140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 --2- 172.21.2.137:0/3672177340 >> v2:172.21.2.111:3300/0 conn(0x7f9f9414aaa0 0x7f9f94140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940ad2d0 con 0x7f9f9405c770 2021-11-15T19:34:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9f88001660 con 0x7f9f9405c770 2021-11-15T19:34:17.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 >> v1:172.21.2.137:6789/0 conn(0x7f9f9405c770 legacy=0x7f9f940aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f940b0550 0x7f9f800037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f80003ee0 0x7f9f80004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f80004bf0 0x7f9f8000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b1650 con 0x7f9f80003ee0 2021-11-15T19:34:17.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940ad030 con 0x7f9f80004bf0 2021-11-15T19:34:17.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800053a0 con 0x7f9f940b0550 2021-11-15T19:34:17.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f80004bf0 0x7f9f8000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 -- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f940b0550 msgr2=0x7f9f800037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f940b0550 0x7f9f800037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 -- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f80003ee0 msgr2=0x7f9f80004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f80003ee0 0x7f9f80004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 -- 172.21.2.137:0/3672177340 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80003260 con 0x7f9f80004bf0 2021-11-15T19:34:17.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f80004bf0 0x7f9f8000b750 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f9f8c0032f0 tx=0x7f9f8c006f90).ready entity=mon.1 client_cookie=27dfde19955dec12 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c00b460 con 0x7f9f80004bf0 2021-11-15T19:34:17.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c00b5c0 con 0x7f9f80004bf0 2021-11-15T19:34:17.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f937fe700 1 -- 172.21.2.137:0/3672177340 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c00b730 con 0x7f9f80004bf0 2021-11-15T19:34:17.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- 172.21.2.137:0/3672177340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f80004bf0 msgr2=0x7f9f8000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 --2- 172.21.2.137:0/3672177340 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f80004bf0 0x7f9f8000b750 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f9f8c0032f0 tx=0x7f9f8c006f90).stop 2021-11-15T19:34:17.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f99615700 1 -- 172.21.2.137:0/3672177340 reap_dead start 2021-11-15T19:34:17.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- 172.21.2.137:0/3672177340 shutdown_connections 2021-11-15T19:34:17.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- 172.21.2.137:0/3672177340 >> 172.21.2.137:0/3672177340 conn(0x7f9f940631e0 msgr2=0x7f9f9405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- 172.21.2.137:0/3672177340 shutdown_connections 2021-11-15T19:34:17.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- 172.21.2.137:0/3672177340 wait complete. 2021-11-15T19:34:17.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 Processor -- start 2021-11-15T19:34:17.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.321+0000 7f9f9b078700 1 -- start start 2021-11-15T19:34:17.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f80004bf0 0x7f9f9414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f94063810 0x7f9f941561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 0x7f9f94159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94063cb0 con 0x7f9f94063810 2021-11-15T19:34:17.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f941597c0 con 0x7f9f941566b0 2021-11-15T19:34:17.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94159a60 con 0x7f9f80004bf0 2021-11-15T19:34:17.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 0x7f9f94159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 0x7f9f94159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38392/0 (socket says 172.21.2.137:38392) 2021-11-15T19:34:17.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 -- 172.21.2.137:0/1892328478 learned_addr learned my addr 172.21.2.137:0/1892328478 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:17.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 -- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f80004bf0 msgr2=0x7f9f9414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f80004bf0 0x7f9f9414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 -- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f94063810 msgr2=0x7f9f941561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f94063810 0x7f9f941561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 -- 172.21.2.137:0/1892328478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94067550 con 0x7f9f941566b0 2021-11-15T19:34:17.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f99615700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 0x7f9f94159f00 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f9f880017c0 tx=0x7f9f8c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c01b620 con 0x7f9f941566b0 2021-11-15T19:34:17.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c01b780 con 0x7f9f941566b0 2021-11-15T19:34:17.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9415a3f0 con 0x7f9f941566b0 2021-11-15T19:34:17.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c01bae0 con 0x7f9f941566b0 2021-11-15T19:34:17.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f94147b40 con 0x7f9f941566b0 2021-11-15T19:34:17.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f94159c20 con 0x7f9f941566b0 2021-11-15T19:34:17.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f8c00f070 con 0x7f9f941566b0 2021-11-15T19:34:17.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f91ffb700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f74053660 0x7f9f74055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f9f8c06cec0 con 0x7f9f941566b0 2021-11-15T19:34:17.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f98e14700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f74053660 0x7f9f74055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.325+0000 7f9f98e14700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f74053660 0x7f9f74055b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9f88001370 tx=0x7f9f88001590).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.329+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f8c043fd0 con 0x7f9f941566b0 2021-11-15T19:34:17.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f940ae7f0 con 0x7f9f941566b0 2021-11-15T19:34:17.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f91ffb700 1 -- 172.21.2.137:0/1892328478 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9f8c0475f0 con 0x7f9f941566b0 2021-11-15T19:34:17.421 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:17.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f74053660 msgr2=0x7f9f74055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f74053660 0x7f9f74055b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9f88001370 tx=0x7f9f88001590).stop 2021-11-15T19:34:17.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 msgr2=0x7f9f94159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 0x7f9f94159f00 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f9f880017c0 tx=0x7f9f8c017000).stop 2021-11-15T19:34:17.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 shutdown_connections 2021-11-15T19:34:17.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9f74053660 0x7f9f74055b20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9f941566b0 0x7f9f94159f00 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9f94063810 0x7f9f941561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 --2- 172.21.2.137:0/1892328478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9f80004bf0 0x7f9f9414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.409+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 >> 172.21.2.137:0/1892328478 conn(0x7f9f940631e0 msgr2=0x7f9f941484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.413+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 shutdown_connections 2021-11-15T19:34:17.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.413+0000 7f9f9b078700 1 -- 172.21.2.137:0/1892328478 wait complete. 2021-11-15T19:34:17.428 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:34:17.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6114757700 1 Processor -- start 2021-11-15T19:34:17.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6114757700 1 -- start start 2021-11-15T19:34:17.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6114757700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f610c0b72e0 0x7f610c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6114757700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0b76c0 con 0x7f610c0acd60 2021-11-15T19:34:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6114757700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c12a170 con 0x7f610c0ad320 2021-11-15T19:34:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6114757700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0b3100 con 0x7f610c0b72e0 2021-11-15T19:34:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6112cf4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f610c0ad320 0x7f610c1290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57182/0 (socket says 172.21.2.137:57182) 2021-11-15T19:34:17.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f6112cf4700 1 -- 172.21.2.137:0/3120286064 learned_addr learned my addr 172.21.2.137:0/3120286064 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821085007 0 0) 0x7f610c12a170 con 0x7f610c0ad320 2021-11-15T19:34:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f4003260 con 0x7f610c0ad320 2021-11-15T19:34:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3741410917 0 0) 0x7f60f4003260 con 0x7f610c0ad320 2021-11-15T19:34:17.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.469+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 >> v2:172.21.2.111:3300/0 conn(0x7f610c0b72e0 msgr2=0x7f610c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 --2- 172.21.2.137:0/3120286064 >> v2:172.21.2.111:3300/0 conn(0x7f610c0b72e0 0x7f610c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 >> v1:172.21.2.111:6789/0 conn(0x7f610c0acd60 legacy=0x7f610c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0ad8a0 con 0x7f610c0ad320 2021-11-15T19:34:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f61040019e0 con 0x7f610c0ad320 2021-11-15T19:34:17.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 >> v1:172.21.2.137:6789/0 conn(0x7f610c0ad320 legacy=0x7f610c1290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60f4003750 0x7f60f4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4004500 0x7f60f4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f60f4004f90 0x7f60f400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b3100 con 0x7f60f4004500 2021-11-15T19:34:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400be30 con 0x7f60f4003750 2021-11-15T19:34:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400bff0 con 0x7f60f4004f90 2021-11-15T19:34:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60f4003750 0x7f60f4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 -- 172.21.2.137:0/3120286064 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f60f4004f90 msgr2=0x7f60f400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f60f4004f90 0x7f60f400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 -- 172.21.2.137:0/3120286064 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4004500 msgr2=0x7f60f4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4004500 0x7f60f4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 -- 172.21.2.137:0/3120286064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0ad8a0 con 0x7f60f4003750 2021-11-15T19:34:17.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 -- 172.21.2.137:0/3120286064 reap_dead start 2021-11-15T19:34:17.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61124f3700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60f4003750 0x7f60f4003b50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6100002f70 tx=0x7f6100006ca0).ready entity=mon.1 client_cookie=bd2c8523f702b7a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6100012460 con 0x7f60f4003750 2021-11-15T19:34:17.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000125c0 con 0x7f60f4003750 2021-11-15T19:34:17.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f61114f1700 1 -- 172.21.2.137:0/3120286064 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6100012940 con 0x7f60f4003750 2021-11-15T19:34:17.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/3120286064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60f4003750 msgr2=0x7f60f4003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60f4003750 0x7f60f4003b50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6100002f70 tx=0x7f6100006ca0).stop 2021-11-15T19:34:17.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/3120286064 shutdown_connections 2021-11-15T19:34:17.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 --2- 172.21.2.137:0/3120286064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f60f4003750 0x7f60f4003b50 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/3120286064 >> 172.21.2.137:0/3120286064 conn(0x7f610c064960 msgr2=0x7f610c064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/3120286064 shutdown_connections 2021-11-15T19:34:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/3120286064 wait complete. 2021-11-15T19:34:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 Processor -- start 2021-11-15T19:34:17.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- start start 2021-11-15T19:34:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4003750 0x7f610c128560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f610c13fb40 0x7f610c13ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 0x7f610c142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c126f80 con 0x7f60f4003750 2021-11-15T19:34:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c1231c0 con 0x7f610c1427e0 2021-11-15T19:34:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c122780 con 0x7f610c13fb40 2021-11-15T19:34:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 0x7f610c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 0x7f610c142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38408/0 (socket says 172.21.2.137:38408) 2021-11-15T19:34:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 -- 172.21.2.137:0/2996410217 learned_addr learned my addr 172.21.2.137:0/2996410217 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 -- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f610c13fb40 msgr2=0x7f610c13ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f610c13fb40 0x7f610c13ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 -- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4003750 msgr2=0x7f610c128560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4003750 0x7f610c128560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 -- 172.21.2.137:0/2996410217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c144410 con 0x7f610c1427e0 2021-11-15T19:34:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6112cf4700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 0x7f610c142c60 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f610c143ad0 tx=0x7f6104001e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61040048a0 con 0x7f610c1427e0 2021-11-15T19:34:17.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104004a00 con 0x7f610c1427e0 2021-11-15T19:34:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6104004da0 con 0x7f610c1427e0 2021-11-15T19:34:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c1233f0 con 0x7f610c1427e0 2021-11-15T19:34:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.473+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c0b21a0 con 0x7f610c1427e0 2021-11-15T19:34:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c0b3a50 con 0x7f610c1427e0 2021-11-15T19:34:17.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f610401c070 con 0x7f610c1427e0 2021-11-15T19:34:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f60ff7fe700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f60ec0536d0 0x7f60ec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f610406b040 con 0x7f610c1427e0 2021-11-15T19:34:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f61124f3700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f60ec0536d0 0x7f60ec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f61124f3700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f60ec0536d0 0x7f60ec055b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f6100002f70 tx=0x7f6100014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.477+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6104042040 con 0x7f610c1427e0 2021-11-15T19:34:17.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f610c0ae130 con 0x7f610c1427e0 2021-11-15T19:34:17.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f60ff7fe700 1 -- 172.21.2.137:0/2996410217 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6104045660 con 0x7f610c1427e0 2021-11-15T19:34:17.572 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:17.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f60ec0536d0 msgr2=0x7f60ec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f60ec0536d0 0x7f60ec055b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f6100002f70 tx=0x7f6100014000).stop 2021-11-15T19:34:17.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 msgr2=0x7f610c142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 0x7f610c142c60 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f610c143ad0 tx=0x7f6104001e00).stop 2021-11-15T19:34:17.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 shutdown_connections 2021-11-15T19:34:17.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f60ec0536d0 0x7f60ec055b90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f610c1427e0 0x7f610c142c60 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f610c13fb40 0x7f610c13ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 --2- 172.21.2.137:0/2996410217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f60f4003750 0x7f610c128560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 >> 172.21.2.137:0/2996410217 conn(0x7f610c064960 msgr2=0x7f610c066000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 shutdown_connections 2021-11-15T19:34:17.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.561+0000 7f6114757700 1 -- 172.21.2.137:0/2996410217 wait complete. 2021-11-15T19:34:17.579 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:34:17.580 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 Processor -- start 2021-11-15T19:34:17.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- start start 2021-11-15T19:34:17.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3db809cca0 0x7f3db8143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db805fe40 con 0x7f3db809c8c0 2021-11-15T19:34:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db809d150 con 0x7f3db80b3140 2021-11-15T19:34:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db8099790 con 0x7f3db809cca0 2021-11-15T19:34:17.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3db80b3140 0x7f3db809ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57202/0 (socket says 172.21.2.137:57202) 2021-11-15T19:34:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/990103744 learned_addr learned my addr 172.21.2.137:0/990103744 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731801372 0 0) 0x7f3db809d150 con 0x7f3db80b3140 2021-11-15T19:34:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0003260 con 0x7f3db80b3140 2021-11-15T19:34:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1346023834 0 0) 0x7f3da0003260 con 0x7f3db80b3140 2021-11-15T19:34:17.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 >> v2:172.21.2.111:3300/0 conn(0x7f3db809cca0 msgr2=0x7f3db8143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 --2- 172.21.2.137:0/990103744 >> v2:172.21.2.111:3300/0 conn(0x7f3db809cca0 0x7f3db8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 >> v1:172.21.2.111:6789/0 conn(0x7f3db809c8c0 legacy=0x7f3db805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80b2940 con 0x7f3db80b3140 2021-11-15T19:34:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3db4001660 con 0x7f3db80b3140 2021-11-15T19:34:17.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 >> v1:172.21.2.137:6789/0 conn(0x7f3db80b3140 legacy=0x7f3db809ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3da0003820 0x7f3da0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3da0004500 0x7f3da0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0005050 0x7f3da000fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8099790 con 0x7f3da0003820 2021-11-15T19:34:17.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da0010350 con 0x7f3da0004500 2021-11-15T19:34:17.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da0010510 con 0x7f3da0005050 2021-11-15T19:34:17.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3da0004500 0x7f3da0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/990103744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0005050 msgr2=0x7f3da000fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0005050 0x7f3da000fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/990103744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3da0003820 msgr2=0x7f3da0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:17.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3da0003820 0x7f3da0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/990103744 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da0003260 con 0x7f3da0004500 2021-11-15T19:34:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbec8e700 1 -- 172.21.2.137:0/990103744 reap_dead start 2021-11-15T19:34:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3da0004500 0x7f3da0004980 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f3db805d5e0 tx=0x7f3db80b2ad0).ready entity=mon.1 client_cookie=228e5d78d6ffaa9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db40070d0 con 0x7f3da0004500 2021-11-15T19:34:17.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4007230 con 0x7f3da0004500 2021-11-15T19:34:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dbd48b700 1 -- 172.21.2.137:0/990103744 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db400c8f0 con 0x7f3da0004500 2021-11-15T19:34:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- 172.21.2.137:0/990103744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3da0004500 msgr2=0x7f3da0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3da0004500 0x7f3da0004980 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f3db805d5e0 tx=0x7f3db80b2ad0).stop 2021-11-15T19:34:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- 172.21.2.137:0/990103744 shutdown_connections 2021-11-15T19:34:17.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/990103744 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3da0004500 0x7f3da0004980 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- 172.21.2.137:0/990103744 >> 172.21.2.137:0/990103744 conn(0x7f3db80b45b0 msgr2=0x7f3db805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- 172.21.2.137:0/990103744 shutdown_connections 2021-11-15T19:34:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.621+0000 7f3dc06f1700 1 -- 172.21.2.137:0/990103744 wait complete. 2021-11-15T19:34:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 Processor -- start 2021-11-15T19:34:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- start start 2021-11-15T19:34:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0004500 0x7f3db8065550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 0x7f3db80b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3db80ad3f0 0x7f3db80b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8151310 con 0x7f3db80ad3f0 2021-11-15T19:34:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db81515b0 con 0x7f3db8150e70 2021-11-15T19:34:17.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8151850 con 0x7f3da0004500 2021-11-15T19:34:17.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 0x7f3db80b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 0x7f3db80b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38432/0 (socket says 172.21.2.137:38432) 2021-11-15T19:34:17.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/4252915389 learned_addr learned my addr 172.21.2.137:0/4252915389 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:17.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0004500 msgr2=0x7f3db8065550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0004500 0x7f3db8065550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3db80ad3f0 msgr2=0x7f3db80b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3db80ad3f0 0x7f3db80b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 -- 172.21.2.137:0/4252915389 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8151cf0 con 0x7f3db8150e70 2021-11-15T19:34:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbdc8c700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 0x7f3db80b06f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f3db805d5e0 tx=0x7f3db4013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db401a070 con 0x7f3db8150e70 2021-11-15T19:34:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4004920 con 0x7f3db8150e70 2021-11-15T19:34:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db40070d0 con 0x7f3db8150e70 2021-11-15T19:34:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db8064f30 con 0x7f3db8150e70 2021-11-15T19:34:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db814d8c0 con 0x7f3db8150e70 2021-11-15T19:34:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db8151a10 con 0x7f3db8150e70 2021-11-15T19:34:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3db4010070 con 0x7f3db8150e70 2021-11-15T19:34:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3da77fe700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d98053720 0x7f3d98055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f3db406b970 con 0x7f3db8150e70 2021-11-15T19:34:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.625+0000 7f3dbe48d700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d98053720 0x7f3d98055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:17.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.629+0000 7f3dbe48d700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d98053720 0x7f3d98055be0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3da8000f70 tx=0x7f3da80069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:17.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.629+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3db4042970 con 0x7f3db8150e70 2021-11-15T19:34:17.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3db8099a30 con 0x7f3db8150e70 2021-11-15T19:34:17.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3da77fe700 1 -- 172.21.2.137:0/4252915389 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f3db4045f90 con 0x7f3db8150e70 2021-11-15T19:34:17.746 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:17.746 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:11.698625+0000","modified":"2021-11-15T19:34:13.716867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5163},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5163":{"gid":5163,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.2.111:6835/1523710751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1523710751},{"type":"v1","addr":"172.21.2.111:6835","nonce":1523710751}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T19:34:17.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d98053720 msgr2=0x7f3d98055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d98053720 0x7f3d98055be0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3da8000f70 tx=0x7f3da80069b0).stop 2021-11-15T19:34:17.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 msgr2=0x7f3db80b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:17.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 0x7f3db80b06f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f3db805d5e0 tx=0x7f3db4013000).stop 2021-11-15T19:34:17.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 shutdown_connections 2021-11-15T19:34:17.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d98053720 0x7f3d98055be0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3db80ad3f0 0x7f3db80b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3db8150e70 0x7f3db80b06f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:17.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 --2- 172.21.2.137:0/4252915389 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3da0004500 0x7f3db8065550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:17.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 >> 172.21.2.137:0/4252915389 conn(0x7f3db80b45b0 msgr2=0x7f3db8141cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:17.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 shutdown_connections 2021-11-15T19:34:17.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:17.737+0000 7f3dc06f1700 1 -- 172.21.2.137:0/4252915389 wait complete. 2021-11-15T19:34:17.750 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 51 2021-11-15T19:34:17.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:34:11.698625+0000', 'modified': '2021-11-15T19:34:13.716867+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5163}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5163': {'gid': 5163, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.111:6835/1523710751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.111:6834', 'nonce': 1523710751}, {'type': 'v1', 'addr': '172.21.2.111:6835', 'nonce': 1523710751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:34:17.956 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:34:17.956 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T19:34:18.019 INFO:teuthology.orchestra.run.gibba011.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":5163,"want_state":"up:active","state":"up:active","rank_uptime":5.2962686769999996,"mdsmap_epoch":51,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":9.4579174080000001} 2021-11-15T19:34:18.020 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 5163, "mdsmap_epoch": 51, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 5.296268677, "state": "up:active", "uptime": 9.457917408, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:34:18.020 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:34:18.021 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:34:18.021 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:34:18.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:18.022 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:18.033 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:34:18.045 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:18.045 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:18.051 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:18.052 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:18.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:18.053 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:34:18.097 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:34:18.097 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:18.100 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:34:18.109 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:18.109 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:18.114 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:18.115 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:18.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:18.116 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:34:18.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:34:18.136+0000 7fa553ff4080 -1 init, newargv = 0x555e078de160 newargc=9ceph-fuse[14425]: starting ceph client 2021-11-15T19:34:18.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr: 2021-11-15T19:34:18.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14425]: starting fuse 2021-11-15T19:34:19.244 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:34:19.256 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:19.256 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:19.304 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:19.305 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:19.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.306 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:34:19.311 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:34:19.312 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:34:19.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.312 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:34:19.313 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:34:19.313 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:34:19.314 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:34:19.314 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:34:19.314 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:19.315 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:34:19.315 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:34:19.316 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:34:19.316 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:19.316 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:34:19.317 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:34:19.317 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:34:19.317 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:34:19.318 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:19.318 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:34:19.319 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:34:19.319 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:34:19.319 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:34:19.320 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:34:19.320 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:19.321 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:34:19.321 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:34:19.377 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14425.asok 2021-11-15T19:34:19.379 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14425.asok 2021-11-15T19:34:19.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.380 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14425.asok status 2021-11-15T19:34:19.429 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:34:19.429 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:34:19.430 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:34:19.430 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:34:19.430 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:34:19.430 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:34:19.431 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:34:19.431 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14425", 2021-11-15T19:34:19.431 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:34:19.431 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:19.431 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:34:19.432 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:34:19.432 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 7447, 2021-11-15T19:34:19.432 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:34:19.432 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:34:19.432 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:34:19.433 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 7447 2021-11-15T19:34:19.433 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:19.433 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:34:19.433 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:34:19.434 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:34:19.434 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 1354185620 2021-11-15T19:34:19.434 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:34:19.434 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:19.434 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:34:19.435 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:34:19.435 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:34:19.435 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 1354185620 2021-11-15T19:34:19.435 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:19.435 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.7447 172.21.2.118:0/1354185620", 2021-11-15T19:34:19.436 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/1354185620", 2021-11-15T19:34:19.436 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:34:19.436 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 51, 2021-11-15T19:34:19.436 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 102, 2021-11-15T19:34:19.436 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:34:19.437 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:34:19.437 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:34:19.437 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:34:19.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.439 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:19.439 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:19.445 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:19.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:19.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.446 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:19.494 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-15T19:34:19.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 Processor -- start 2021-11-15T19:34:19.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 -- start start 2021-11-15T19:34:19.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0134144610 0x7f0134147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f01340a9f50 0x7f01340aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0134148190 con 0x7f01340b1340 2021-11-15T19:34:19.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01340b1720 con 0x7f01340a9f50 2021-11-15T19:34:19.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f013a357700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0134147e70 con 0x7f0134144610 2021-11-15T19:34:19.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01337fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0134144610 0x7f0134147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01388f4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f01340a9f50 0x7f01340aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f0133fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f01340b1340 0x7f0134143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:49710/0 (socket says 172.21.2.137:49710) 2021-11-15T19:34:19.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f0133fff700 1 -- 172.21.2.137:0/1948279772 learned_addr learned my addr 172.21.2.137:0/1948279772 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:19.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01388f4700 1 -- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0134144610 msgr2=0x7f0134147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:19.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01388f4700 1 --2- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0134144610 0x7f0134147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01388f4700 1 -- 172.21.2.137:0/1948279772 >> v1:172.21.2.111:6789/0 conn(0x7f01340b1340 legacy=0x7f0134143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01388f4700 1 -- 172.21.2.137:0/1948279772 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01340af800 con 0x7f01340a9f50 2021-11-15T19:34:19.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f01388f4700 1 --2- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 0x7f01340aa370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f012c0032f0 tx=0x7f012c0091d0).ready entity=mon.0 client_cookie=3fad25e102701c4d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:19.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f0132ffd700 1 -- 172.21.2.137:0/1948279772 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f012c00b6c0 con 0x7f01340a9f50 2021-11-15T19:34:19.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f0132ffd700 1 -- 172.21.2.137:0/1948279772 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c00b820 con 0x7f01340a9f50 2021-11-15T19:34:19.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.541+0000 7f0132ffd700 1 -- 172.21.2.137:0/1948279772 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f012c00b990 con 0x7f01340a9f50 2021-11-15T19:34:19.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 msgr2=0x7f01340aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 --2- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 0x7f01340aa370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f012c0032f0 tx=0x7f012c0091d0).stop 2021-11-15T19:34:19.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/1948279772 shutdown_connections 2021-11-15T19:34:19.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 --2- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 0x7f01340aa370 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 --2- 172.21.2.137:0/1948279772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0134144610 0x7f0134147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/1948279772 >> 172.21.2.137:0/1948279772 conn(0x7f01340b4e60 msgr2=0x7f01340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:19.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/1948279772 shutdown_connections 2021-11-15T19:34:19.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/1948279772 wait complete. 2021-11-15T19:34:19.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 Processor -- start 2021-11-15T19:34:19.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- start start 2021-11-15T19:34:19.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 0x7f013414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01340b1340 0x7f013409a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 0x7f0134159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0134159ab0 con 0x7f01340a9f50 2021-11-15T19:34:19.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0134140b60 con 0x7f0134144610 2021-11-15T19:34:19.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0134149e00 con 0x7f01340b1340 2021-11-15T19:34:19.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 0x7f0134159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 0x7f0134159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38444/0 (socket says 172.21.2.137:38444) 2021-11-15T19:34:19.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 -- 172.21.2.137:0/675370599 learned_addr learned my addr 172.21.2.137:0/675370599 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:19.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 -- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01340b1340 msgr2=0x7f013409a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01340b1340 0x7f013409a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 -- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 msgr2=0x7f013414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 0x7f013414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 -- 172.21.2.137:0/675370599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c009470 con 0x7f0134144610 2021-11-15T19:34:19.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01388f4700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 0x7f0134159ed0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f0134141870 tx=0x7f012c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:19.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f012c00b6c0 con 0x7f0134144610 2021-11-15T19:34:19.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c011e40 con 0x7f0134144610 2021-11-15T19:34:19.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013414a0a0 con 0x7f0134144610 2021-11-15T19:34:19.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f012c0107a0 con 0x7f0134144610 2021-11-15T19:34:19.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013409ac80 con 0x7f0134144610 2021-11-15T19:34:19.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01341409d0 con 0x7f0134144610 2021-11-15T19:34:19.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f012c027020 con 0x7f0134144610 2021-11-15T19:34:19.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01317fa700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01180534f0 0x7f01180559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f012c06cdd0 con 0x7f0134144610 2021-11-15T19:34:19.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.545+0000 7f0133fff700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01180534f0 0x7f01180559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.549+0000 7f0133fff700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01180534f0 0x7f01180559b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f013405cfa0 tx=0x7f0124007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:19.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.549+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f012c043ee0 con 0x7f0134144610 2021-11-15T19:34:19.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f013414a230 con 0x7f0134144610 2021-11-15T19:34:19.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f01317fa700 1 -- 172.21.2.137:0/675370599 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1940 (secure 0 0 0) 0x7f012c015090 con 0x7f0134144610 2021-11-15T19:34:19.672 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:19.672 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:19.673 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:19.673 INFO:teuthology.orchestra.run.gibba037.stdout: "total_bytes": 721202184192, 2021-11-15T19:34:19.673 INFO:teuthology.orchestra.run.gibba037.stdout: "total_avail_bytes": 714959745024, 2021-11-15T19:34:19.673 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_bytes": 6242430976, 2021-11-15T19:34:19.673 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_bytes": 6242439168, 2021-11-15T19:34:19.674 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_ratio": 0.0086556021124124527, 2021-11-15T19:34:19.674 INFO:teuthology.orchestra.run.gibba037.stdout: "num_osds": 8, 2021-11-15T19:34:19.674 INFO:teuthology.orchestra.run.gibba037.stdout: "num_per_pool_osds": 0, 2021-11-15T19:34:19.674 INFO:teuthology.orchestra.run.gibba037.stdout: "num_per_pool_omap_osds": 0 2021-11-15T19:34:19.675 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:19.675 INFO:teuthology.orchestra.run.gibba037.stdout: "stats_by_class": { 2021-11-15T19:34:19.675 INFO:teuthology.orchestra.run.gibba037.stdout: "ssd": { 2021-11-15T19:34:19.675 INFO:teuthology.orchestra.run.gibba037.stdout: "total_bytes": 721202184192, 2021-11-15T19:34:19.675 INFO:teuthology.orchestra.run.gibba037.stdout: "total_avail_bytes": 714959745024, 2021-11-15T19:34:19.676 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_bytes": 6242430976, 2021-11-15T19:34:19.676 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_bytes": 6242439168, 2021-11-15T19:34:19.676 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_ratio": 0.0086556021124124527 2021-11-15T19:34:19.676 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:19.676 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:19.677 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:34:19.677 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:19.677 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "device_health_metrics", 2021-11-15T19:34:19.677 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 1, 2021-11-15T19:34:19.677 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:19.678 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:19.678 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 2, 2021-11-15T19:34:19.678 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:19.678 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:19.678 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:19.679 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449774080 2021-11-15T19:34:19.679 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:19.679 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:19.679 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:19.680 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rbd", 2021-11-15T19:34:19.680 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 2, 2021-11-15T19:34:19.680 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:19.680 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:19.680 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:34:19.681 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:19.681 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:19.681 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:19.681 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449774080 2021-11-15T19:34:19.681 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:19.682 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:19.682 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:19.682 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "cephfs_metadata", 2021-11-15T19:34:19.682 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 19, 2021-11-15T19:34:19.682 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:19.683 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 2740, 2021-11-15T19:34:19.683 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 21, 2021-11-15T19:34:19.683 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 3, 2021-11-15T19:34:19.683 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 2740, 2021-11-15T19:34:19.683 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 4.0359431352499087e-09, 2021-11-15T19:34:19.684 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449774080 2021-11-15T19:34:19.684 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:19.684 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:19.684 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:19.685 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "cephfs_data", 2021-11-15T19:34:19.685 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 20, 2021-11-15T19:34:19.685 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:19.685 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:19.685 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:34:19.686 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:19.686 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:19.686 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:19.686 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449774080 2021-11-15T19:34:19.686 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:19.687 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:19.687 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:19.687 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:19.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01180534f0 msgr2=0x7f01180559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01180534f0 0x7f01180559b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f013405cfa0 tx=0x7f0124007860).stop 2021-11-15T19:34:19.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 msgr2=0x7f0134159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 0x7f0134159ed0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f0134141870 tx=0x7f012c016000).stop 2021-11-15T19:34:19.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 shutdown_connections 2021-11-15T19:34:19.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01180534f0 0x7f01180559b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0134144610 0x7f0134159ed0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01340b1340 0x7f013409a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 --2- 172.21.2.137:0/675370599 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01340a9f50 0x7f013414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 >> 172.21.2.137:0/675370599 conn(0x7f01340b4e60 msgr2=0x7f01340b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:19.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 shutdown_connections 2021-11-15T19:34:19.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.661+0000 7f013a357700 1 -- 172.21.2.137:0/675370599 wait complete. 2021-11-15T19:34:19.692 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-11-15T19:34:19.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 Processor -- start 2021-11-15T19:34:19.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- start start 2021-11-15T19:34:19.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f185c05c770 0x7f185c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c05cb50 con 0x7f185c0b2840 2021-11-15T19:34:19.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c14b320 con 0x7f185c0aace0 2021-11-15T19:34:19.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0b0fe0 con 0x7f185c05c770 2021-11-15T19:34:19.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1860f13700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f185c0aace0 0x7f185c14a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57232/0 (socket says 172.21.2.137:57232) 2021-11-15T19:34:19.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1860f13700 1 -- 172.21.2.137:0/2972525943 learned_addr learned my addr 172.21.2.137:0/2972525943 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:19.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988977585 0 0) 0x7f185c14b320 con 0x7f185c0aace0 2021-11-15T19:34:19.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1844003260 con 0x7f185c0aace0 2021-11-15T19:34:19.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861714700 1 --2- 172.21.2.137:0/2972525943 >> v2:172.21.2.111:3300/0 conn(0x7f185c05c770 0x7f185c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3681685163 0 0) 0x7f1844003260 con 0x7f185c0aace0 2021-11-15T19:34:19.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 >> v2:172.21.2.111:3300/0 conn(0x7f185c05c770 msgr2=0x7f185c0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:19.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 --2- 172.21.2.137:0/2972525943 >> v2:172.21.2.111:3300/0 conn(0x7f185c05c770 0x7f185c0b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 >> v1:172.21.2.111:6789/0 conn(0x7f185c0b2840 legacy=0x7f185c14ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:19.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0b1c10 con 0x7f185c0aace0 2021-11-15T19:34:19.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1858001660 con 0x7f185c0aace0 2021-11-15T19:34:19.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 >> v1:172.21.2.137:6789/0 conn(0x7f185c0aace0 legacy=0x7f185c14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1844003750 0x7f1844003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004500 0x7f1844004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1844004ec0 0x7f184400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0b0fe0 con 0x7f1844003750 2021-11-15T19:34:19.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184400be30 con 0x7f1844004ec0 2021-11-15T19:34:19.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184400bff0 con 0x7f1844004500 2021-11-15T19:34:19.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1844004ec0 0x7f184400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 -- 172.21.2.137:0/2972525943 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004500 msgr2=0x7f1844004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:19.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004500 0x7f1844004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 -- 172.21.2.137:0/2972525943 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1844003750 msgr2=0x7f1844003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:19.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1844003750 0x7f1844003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 -- 172.21.2.137:0/2972525943 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844003260 con 0x7f1844004ec0 2021-11-15T19:34:19.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 -- 172.21.2.137:0/2972525943 reap_dead start 2021-11-15T19:34:19.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1861f15700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1844004ec0 0x7f184400b750 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f18540012f0 tx=0x7f1854007d60).ready entity=mon.1 client_cookie=89945a4aaf1891b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:19.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1854006870 con 0x7f1844004ec0 2021-11-15T19:34:19.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18540069d0 con 0x7f1844004ec0 2021-11-15T19:34:19.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f184ffff700 1 -- 172.21.2.137:0/2972525943 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1854006d30 con 0x7f1844004ec0 2021-11-15T19:34:19.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- 172.21.2.137:0/2972525943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1844004ec0 msgr2=0x7f184400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1844004ec0 0x7f184400b750 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f18540012f0 tx=0x7f1854007d60).stop 2021-11-15T19:34:19.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- 172.21.2.137:0/2972525943 shutdown_connections 2021-11-15T19:34:19.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 --2- 172.21.2.137:0/2972525943 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1844004ec0 0x7f184400b750 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- 172.21.2.137:0/2972525943 >> 172.21.2.137:0/2972525943 conn(0x7f185c063780 msgr2=0x7f185c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:19.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- 172.21.2.137:0/2972525943 shutdown_connections 2021-11-15T19:34:19.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.745+0000 7f1863978700 1 -- 172.21.2.137:0/2972525943 wait complete. 2021-11-15T19:34:19.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 Processor -- start 2021-11-15T19:34:19.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- start start 2021-11-15T19:34:19.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004ec0 0x7f185c159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f185c0a1c10 0x7f185c0674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 0x7f185c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0669d0 con 0x7f185c0a1c10 2021-11-15T19:34:19.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c159cb0 con 0x7f185c063cd0 2021-11-15T19:34:19.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c159f50 con 0x7f1844004ec0 2021-11-15T19:34:19.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 0x7f185c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 0x7f185c1443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38464/0 (socket says 172.21.2.137:38464) 2021-11-15T19:34:19.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 -- 172.21.2.137:0/773046964 learned_addr learned my addr 172.21.2.137:0/773046964 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:19.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 -- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004ec0 msgr2=0x7f185c159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004ec0 0x7f185c159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 -- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f185c0a1c10 msgr2=0x7f185c0674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f185c0a1c10 0x7f185c0674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 -- 172.21.2.137:0/773046964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c09e2e0 con 0x7f185c063cd0 2021-11-15T19:34:19.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861f15700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 0x7f185c1443f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f18540012f0 tx=0x7f1854014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:19.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18540014e0 con 0x7f185c063cd0 2021-11-15T19:34:19.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854014670 con 0x7f185c063cd0 2021-11-15T19:34:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18540149d0 con 0x7f185c063cd0 2021-11-15T19:34:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c0af4b0 con 0x7f185c063cd0 2021-11-15T19:34:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c09e050 con 0x7f185c063cd0 2021-11-15T19:34:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c15a110 con 0x7f185c063cd0 2021-11-15T19:34:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1854028070 con 0x7f185c063cd0 2021-11-15T19:34:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f184e7fc700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f183c053580 0x7f183c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f185406c4e0 con 0x7f185c063cd0 2021-11-15T19:34:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.749+0000 7f1861714700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f183c053580 0x7f183c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.753+0000 7f1861714700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f183c053580 0x7f183c055a40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f185000a000 tx=0x7f1850008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.753+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f18540435f0 con 0x7f185c063cd0 2021-11-15T19:34:19.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.833+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7f185c0b1eb0 con 0x7f185c063cd0 2021-11-15T19:34:19.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.833+0000 7f184e7fc700 1 -- 172.21.2.137:0/773046964 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v102) v1 ==== 123+0+64 (secure 0 0 0) 0x7f1854046c10 con 0x7f185c063cd0 2021-11-15T19:34:19.845 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:19.846 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:19.846 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": "cephfs_data", 2021-11-15T19:34:19.846 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_id": 20, 2021-11-15T19:34:19.846 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2 2021-11-15T19:34:19.847 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:19.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f183c053580 msgr2=0x7f183c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f183c053580 0x7f183c055a40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f185000a000 tx=0x7f1850008040).stop 2021-11-15T19:34:19.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 msgr2=0x7f185c1443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:19.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 0x7f185c1443f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f18540012f0 tx=0x7f1854014000).stop 2021-11-15T19:34:19.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 shutdown_connections 2021-11-15T19:34:19.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f183c053580 0x7f183c055a40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f185c063cd0 0x7f185c1443f0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:19.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f185c0a1c10 0x7f185c0674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 --2- 172.21.2.137:0/773046964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1844004ec0 0x7f185c159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:19.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 >> 172.21.2.137:0/773046964 conn(0x7f185c063780 msgr2=0x7f185c146d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:19.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 shutdown_connections 2021-11-15T19:34:19.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:19.837+0000 7f1863978700 1 -- 172.21.2.137:0/773046964 wait complete. 2021-11-15T19:34:19.853 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T19:34:19.853 DEBUG:teuthology.orchestra.run.gibba031:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-11-15T19:34:19.890 INFO:teuthology.orchestra.run.gibba031.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-11-15T19:34:19.890 INFO:teuthology.orchestra.run.gibba031.stdout:ceph-fuse 331493376 0 331493376 0% /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:19.891 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:34:19.892 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:19.905 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:19.918 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:19.931 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:19.944 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:19.957 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:34:19.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.958 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:19.958 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:19.964 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:34:19.964 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:19.964 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:34:19.965 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:34:19.965 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:19.972 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15021]: fuse finished with error 0 and tester_r 0 2021-11-15T19:34:19.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:19.974 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:19.974 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:20.021 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:34:20.022 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:34:20.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:20.064 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:20.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:20.068 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:20.068 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:20.075 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:20.076 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:20.076 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:34:20.076 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:34:20.077 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:20.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14425]: fuse finished with error 0 and tester_r 0 2021-11-15T19:34:20.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:20.132 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:20.132 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:20.136 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:34:20.136 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:34:20.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:20.247 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:20.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:20.252 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:20.252 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:34:20.262 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:34:20.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:20.263 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:34:20.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:20.264 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:34:20.315 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:34:20.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:20.317 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:34:20.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.377+0000 7f9ee2c48700 1 Processor -- start 2021-11-15T19:34:20.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.377+0000 7f9ee2c48700 1 -- start start 2021-11-15T19:34:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9edc147980 0x7f9edc0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc148190 con 0x7f9edc0b1340 2021-11-15T19:34:20.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0b1720 con 0x7f9edc144610 2021-11-15T19:34:20.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0af800 con 0x7f9edc147980 2021-11-15T19:34:20.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9edc147980 0x7f9edc0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9edbfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9edc144610 0x7f9edc0a9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57254/0 (socket says 172.21.2.137:57254) 2021-11-15T19:34:20.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9edbfff700 1 -- 172.21.2.137:0/1102004638 learned_addr learned my addr 172.21.2.137:0/1102004638 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:20.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1102004638 >> v1:172.21.2.137:6789/0 conn(0x7f9edc144610 legacy=0x7f9edc0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1102004638 >> v1:172.21.2.111:6789/0 conn(0x7f9edc0b1340 legacy=0x7f9edc143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:20.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1102004638 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc05faf0 con 0x7f9edc147980 2021-11-15T19:34:20.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- 172.21.2.137:0/1102004638 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc0aa660 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f9edc062250 tx=0x7f9ed40091d0).ready entity=mon.1 client_cookie=77d47817dce0c219 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9edb7fe700 1 -- 172.21.2.137:0/1102004638 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed4009ea0 con 0x7f9edc147980 2021-11-15T19:34:20.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9edb7fe700 1 -- 172.21.2.137:0/1102004638 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed400b860 con 0x7f9edc147980 2021-11-15T19:34:20.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9edb7fe700 1 -- 172.21.2.137:0/1102004638 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed400b9d0 con 0x7f9edc147980 2021-11-15T19:34:20.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1102004638 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 msgr2=0x7f9edc0aa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1102004638 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc0aa660 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f9edc062250 tx=0x7f9ed40091d0).stop 2021-11-15T19:34:20.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1102004638 shutdown_connections 2021-11-15T19:34:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1102004638 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc0aa660 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1102004638 >> 172.21.2.137:0/1102004638 conn(0x7f9edc0b4e60 msgr2=0x7f9edc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1102004638 shutdown_connections 2021-11-15T19:34:20.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1102004638 wait complete. 2021-11-15T19:34:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 Processor -- start 2021-11-15T19:34:20.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- start start 2021-11-15T19:34:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc0b1340 0x7f9edc142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc144610 0x7f9edc13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0aead0 con 0x7f9edc0b1340 2021-11-15T19:34:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0aed70 con 0x7f9edc147980 2021-11-15T19:34:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0af010 con 0x7f9edc144610 2021-11-15T19:34:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc13dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38478/0 (socket says 172.21.2.137:38478) 2021-11-15T19:34:20.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1575268958 learned_addr learned my addr 172.21.2.137:0/1575268958 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:20.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc144610 msgr2=0x7f9edc13d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc144610 0x7f9edc13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc0b1340 msgr2=0x7f9edc142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc0b1340 0x7f9edc142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 -- 172.21.2.137:0/1575268958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009470 con 0x7f9edc147980 2021-11-15T19:34:20.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee11e5700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc13dc00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f9edc062250 tx=0x7f9ed4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed401f5e0 con 0x7f9edc147980 2021-11-15T19:34:20.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed401f740 con 0x7f9edc147980 2021-11-15T19:34:20.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc159bf0 con 0x7f9edc147980 2021-11-15T19:34:20.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed401faa0 con 0x7f9edc147980 2021-11-15T19:34:20.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.381+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc13e0f0 con 0x7f9edc147980 2021-11-15T19:34:20.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc0af1d0 con 0x7f9edc147980 2021-11-15T19:34:20.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ed4026030 con 0x7f9edc147980 2021-11-15T19:34:20.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ed9ffb700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ec00536d0 0x7f9ec0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f9ed406c8d0 con 0x7f9edc147980 2021-11-15T19:34:20.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ee09e4700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ec00536d0 0x7f9ec0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ee09e4700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ec00536d0 0x7f9ec0055b90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f9ec4002f90 tx=0x7f9ec40069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.385+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ed40439e0 con 0x7f9edc147980 2021-11-15T19:34:20.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.465+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9edc148190 con 0x7f9edc147980 2021-11-15T19:34:20.477 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ed9ffb700 1 -- 172.21.2.137:0/1575268958 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+33805 (secure 0 0 0) 0x7f9edc148190 con 0x7f9edc147980 2021-11-15T19:34:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:20.478 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 102, 2021-11-15T19:34:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:34:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:34:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:34:12.576072+0000", 2021-11-15T19:34:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:34:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:34:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:34:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:34:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:34:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:34:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:34:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:34:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:34:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:34:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:34:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:34:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 20, 2021-11-15T19:34:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:34:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:34:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:34:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:34:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:34:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:34:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:34:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:34:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:34:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:34:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:34:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:34:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:34:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:34:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:34:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:34:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:34:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:34:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:34:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:34:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:34:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:34:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:34:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 19, 2021-11-15T19:34:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:34:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:34:10.473721+0000", 2021-11-15T19:34:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "100", 2021-11-15T19:34:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:34:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:34:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:34:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:34:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:34:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:34:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 20, 2021-11-15T19:34:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:34:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:34:10.694997+0000", 2021-11-15T19:34:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "101", 2021-11-15T19:34:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:34:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:34:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:34:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:34:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:34:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:34:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.553 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:34:20.553 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.553 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.553 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.554 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.554 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.554 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.554 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.555 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.555 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:34:20.555 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.555 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.555 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.556 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.556 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:34:20.556 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.556 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.556 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.557 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.557 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.557 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.557 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.557 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.558 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:34:20.558 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.558 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.558 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.558 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.559 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:34:20.559 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.559 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.559 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.560 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.560 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.560 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.561 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.561 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.561 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:34:20.562 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.562 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.562 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.563 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.563 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:34:20.563 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:20.564 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.564 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.565 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.565 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:34:20.565 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:34:20.566 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:34:20.566 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:34:20.567 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.567 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.568 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.568 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.568 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.569 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.569 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:20.569 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:34:20.570 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.570 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.571 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.571 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.571 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.572 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.572 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.572 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:20.572 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.573 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.573 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.573 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.573 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.573 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.574 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:34:20.574 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.574 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.574 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.575 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.575 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:34:20.575 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.575 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.575 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.576 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.576 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.576 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.576 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.576 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.577 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:34:20.577 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.577 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.577 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.577 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.578 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:34:20.578 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.578 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.578 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.579 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.579 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.579 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.579 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.579 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.580 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:34:20.580 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.580 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.580 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.580 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.581 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:34:20.581 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.581 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.581 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.581 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.582 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.582 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.582 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.582 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.583 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:34:20.583 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.583 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.583 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.583 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.584 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:34:20.584 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:20.584 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.584 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.585 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.585 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:34:20.585 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:34:20.585 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:34:20.585 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:34:20.586 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.586 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.586 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.586 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.586 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.587 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.587 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:20.587 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:34:20.587 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.588 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.588 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.588 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.588 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.589 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.589 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.589 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 98, 2021-11-15T19:34:20.589 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.589 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.590 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.590 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.590 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.590 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.591 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:34:20.591 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.591 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.591 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.591 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.592 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:34:20.592 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.592 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.593 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.593 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.593 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.593 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.594 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.594 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.594 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:34:20.594 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.594 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.595 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.595 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.595 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:34:20.595 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.596 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.596 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.596 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.596 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.596 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.597 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.597 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.597 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:34:20.597 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.597 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.598 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.598 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.598 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:34:20.598 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.599 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.599 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.599 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.599 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.599 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.600 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.600 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.600 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:34:20.600 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.600 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.601 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.601 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.601 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:34:20.601 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:20.602 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.602 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.602 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.602 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:34:20.602 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:34:20.603 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:34:20.603 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:34:20.603 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.603 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.603 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.604 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.604 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.604 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.604 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:20.604 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:34:20.605 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.605 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.605 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.605 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.606 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.606 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.606 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.606 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:20.606 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.607 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.607 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.607 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.607 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.607 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.608 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:34:20.608 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.608 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.608 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.609 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.609 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:34:20.609 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.609 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.609 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.610 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.610 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.610 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.610 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.611 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.611 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:34:20.611 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.611 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.611 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.612 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.612 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:34:20.612 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.612 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.613 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.613 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.613 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.613 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.613 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.614 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.614 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:34:20.614 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.614 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.614 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.615 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.615 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:34:20.615 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.615 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.616 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.616 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.616 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.616 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.616 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.617 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.617 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:34:20.617 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.617 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.618 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.618 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.618 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:34:20.618 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:20.618 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.619 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.619 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.619 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:34:20.619 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:34:20.620 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:34:20.620 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:34:20.620 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.620 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.620 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.621 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.621 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.621 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.621 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:20.622 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:34:20.622 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.622 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.622 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.622 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.623 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.623 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.623 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.623 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 98, 2021-11-15T19:34:20.624 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.624 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.624 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.624 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.624 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.625 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.625 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:34:20.625 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.625 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.626 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.626 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.626 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:34:20.626 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.626 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.627 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.627 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.627 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.628 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.628 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.628 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.628 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:34:20.629 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.629 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.629 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.629 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.630 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:34:20.630 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.630 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.630 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.630 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.631 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.631 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.631 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.631 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.632 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:34:20.632 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.632 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.632 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.633 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.633 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:34:20.633 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.633 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.634 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.634 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.634 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.634 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.635 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.635 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.635 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:34:20.635 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.636 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.636 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.636 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.636 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:34:20.637 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:20.637 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.637 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.637 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.637 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:34:20.638 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:34:20.638 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:34:20.638 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:34:20.639 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.639 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.639 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.639 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.640 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.640 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.640 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:20.641 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:34:20.641 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.641 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.641 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.641 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.642 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.642 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.642 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.642 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 98, 2021-11-15T19:34:20.643 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.643 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.643 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.643 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.644 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.644 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.644 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:34:20.644 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.645 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.645 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.645 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.645 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:34:20.645 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.646 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.646 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.646 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.646 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.647 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.647 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.647 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.647 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:34:20.648 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.648 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.648 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.648 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.649 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:34:20.649 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.649 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.649 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.649 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.650 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.650 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.650 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.651 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.651 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:34:20.651 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.651 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.652 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.652 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.652 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:34:20.653 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.653 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.653 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.654 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.654 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.654 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.654 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.655 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.655 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:34:20.655 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.655 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.656 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.656 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.656 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:34:20.657 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:20.657 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.658 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.658 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.658 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:34:20.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:34:20.659 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:34:20.659 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:34:20.659 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.659 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.660 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.660 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.660 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.661 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.661 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:20.661 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:34:20.662 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.662 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.662 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.662 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.663 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.663 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.663 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.663 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:20.664 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.664 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.664 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.665 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.665 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.665 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.665 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:34:20.666 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.666 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.666 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.666 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.667 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:34:20.667 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.667 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.667 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.667 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.668 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.668 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.668 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.668 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.669 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:34:20.669 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.669 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.669 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.670 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.670 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:34:20.670 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.671 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.671 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.671 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.671 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.671 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.672 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.672 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.672 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:34:20.673 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.673 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.673 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.673 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.674 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:34:20.674 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.674 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.674 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.674 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.675 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.675 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.675 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.675 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.676 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:34:20.676 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.676 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.676 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.677 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.677 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:34:20.677 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:20.677 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.678 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.678 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.678 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:34:20.678 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:34:20.679 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:34:20.679 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:34:20.679 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.679 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.679 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.680 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.680 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.680 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:20.681 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:34:20.681 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:20.682 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:20.682 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:20.682 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:20.682 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:20.683 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:20.683 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:20.683 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:20.684 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:20.684 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:20.684 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:20.684 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.685 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:34:20.685 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.686 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.686 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.686 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:34:20.687 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.687 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.687 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.687 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.687 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:20.688 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.688 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.688 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:34:20.689 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.689 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.689 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.690 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.690 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:34:20.690 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.690 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.691 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.691 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.691 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:20.691 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.692 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.692 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.692 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:34:20.692 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.693 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.693 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.693 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.694 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:34:20.694 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.694 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.694 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.695 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.695 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:20.695 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:20.695 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.695 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:20.696 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:34:20.696 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.696 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.696 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.697 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:20.697 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:34:20.697 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:20.697 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.698 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.698 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.698 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:34:20.698 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:34:20.699 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:34:20.699 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:34:20.699 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:20.699 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:20.699 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:20.700 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:20.700 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.700 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:20.701 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:34:20.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.701 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:20.702 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.702 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.702 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.703 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.703 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.703 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:34:20.703 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.704 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:20.705 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.705 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.705 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.705 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.706 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.706 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:34:20.706 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.707 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.707 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.707 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:20.707 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.708 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.708 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.708 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.708 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.709 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:34:20.709 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.709 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.709 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.710 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:20.710 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.710 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.711 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.711 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.711 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.711 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:34:20.712 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.712 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.712 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:20.713 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.713 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.713 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.713 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.714 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.714 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:34:20.714 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.715 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.715 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.715 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:20.715 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.715 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.716 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.716 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.716 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.716 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:34:20.717 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.717 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.717 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.718 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:20.718 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.718 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.718 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.718 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.719 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.719 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:34:20.719 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.719 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:20.720 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:20.720 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:20.720 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:20.721 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:20.721 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:20.721 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:20.722 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:34:20.722 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:20.722 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.723 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:20.723 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:34:20.723 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:34:20.723 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:34:20.724 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:34:20.724 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:34:20.724 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/2486512308": "2021-11-16T19:34:12.506218+0000", 2021-11-15T19:34:20.724 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/2486512308": "2021-11-16T19:34:12.506218+0000" 2021-11-15T19:34:20.725 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.725 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:34:20.725 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:34:20.725 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:34:20.725 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:34:20.726 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:34:20.726 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:34:20.726 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:34:20.726 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:34:20.727 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:20.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:20.727 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:34:20.727 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:34:20.727 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:34:20.728 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:34:20.728 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:34:20.728 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:20.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ec00536d0 msgr2=0x7f9ec0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ec00536d0 0x7f9ec0055b90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f9ec4002f90 tx=0x7f9ec40069b0).stop 2021-11-15T19:34:20.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 msgr2=0x7f9edc13dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc13dc00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f9edc062250 tx=0x7f9ed4016000).stop 2021-11-15T19:34:20.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 shutdown_connections 2021-11-15T19:34:20.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ec00536d0 0x7f9ec0055b90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9edc147980 0x7f9edc13dc00 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc144610 0x7f9edc13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 --2- 172.21.2.137:0/1575268958 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc0b1340 0x7f9edc142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 >> 172.21.2.137:0/1575268958 conn(0x7f9edc0b4e60 msgr2=0x7f9edc0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:20.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 shutdown_connections 2021-11-15T19:34:20.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.469+0000 7f9ee2c48700 1 -- 172.21.2.137:0/1575268958 wait complete. 2021-11-15T19:34:20.733 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:20.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 Processor -- start 2021-11-15T19:34:20.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 -- start start 2021-11-15T19:34:20.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff6180b1180 0x7ff618142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180af2f0 0x7ff618143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6180aecf0 con 0x7ff6180acab0 2021-11-15T19:34:20.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61813f180 con 0x7ff6180b1180 2021-11-15T19:34:20.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff61dee2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180aef20 con 0x7ff6180af2f0 2021-11-15T19:34:20.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff6180b1180 0x7ff618142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff6180b1180 0x7ff618142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38486/0 (socket says 172.21.2.137:38486) 2021-11-15T19:34:20.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 -- 172.21.2.137:0/1061317980 learned_addr learned my addr 172.21.2.137:0/1061317980 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:20.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 -- 172.21.2.137:0/1061317980 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180af2f0 msgr2=0x7ff618143070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:20.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 --2- 172.21.2.137:0/1061317980 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180af2f0 0x7ff618143070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 -- 172.21.2.137:0/1061317980 >> v1:172.21.2.111:6789/0 conn(0x7ff6180acab0 legacy=0x7ff6180b2060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:20.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 -- 172.21.2.137:0/1061317980 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6180b2770 con 0x7ff6180b1180 2021-11-15T19:34:20.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff616ffd700 1 --2- 172.21.2.137:0/1061317980 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618142b80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7ff6180b2bd0 tx=0x7ff610006eb0).ready entity=mon.1 client_cookie=bffd1dd805733c35 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff6167fc700 1 -- 172.21.2.137:0/1061317980 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff610010810 con 0x7ff6180b1180 2021-11-15T19:34:20.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff6167fc700 1 -- 172.21.2.137:0/1061317980 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610000e90 con 0x7ff6180b1180 2021-11-15T19:34:20.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.777+0000 7ff6167fc700 1 -- 172.21.2.137:0/1061317980 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff610010ba0 con 0x7ff6180b1180 2021-11-15T19:34:20.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/1061317980 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 msgr2=0x7ff618142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 --2- 172.21.2.137:0/1061317980 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618142b80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7ff6180b2bd0 tx=0x7ff610006eb0).stop 2021-11-15T19:34:20.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/1061317980 shutdown_connections 2021-11-15T19:34:20.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 --2- 172.21.2.137:0/1061317980 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180af2f0 0x7ff618143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 --2- 172.21.2.137:0/1061317980 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618142b80 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/1061317980 >> 172.21.2.137:0/1061317980 conn(0x7ff6180630f0 msgr2=0x7ff6180634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:20.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/1061317980 shutdown_connections 2021-11-15T19:34:20.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/1061317980 wait complete. 2021-11-15T19:34:20.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 Processor -- start 2021-11-15T19:34:20.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- start start 2021-11-15T19:34:20.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180acab0 0x7ff61811ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6180af2f0 0x7ff618140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618110610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61813c610 con 0x7ff6180af2f0 2021-11-15T19:34:20.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61813c840 con 0x7ff6180b1180 2021-11-15T19:34:20.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61811b5b0 con 0x7ff6180acab0 2021-11-15T19:34:20.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618110610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618110610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38492/0 (socket says 172.21.2.137:38492) 2021-11-15T19:34:20.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 -- 172.21.2.137:0/2920629858 learned_addr learned my addr 172.21.2.137:0/2920629858 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:20.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 -- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180acab0 msgr2=0x7ff61811ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180acab0 0x7ff61811ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 -- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6180af2f0 msgr2=0x7ff618140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6180af2f0 0x7ff618140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 -- 172.21.2.137:0/2920629858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61000c2f0 con 0x7ff6180b1180 2021-11-15T19:34:20.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff617fff700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618110610 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7ff618111ef0 tx=0x7ff6080091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff608001520 con 0x7ff6180b1180 2021-11-15T19:34:20.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608001680 con 0x7ff6180b1180 2021-11-15T19:34:20.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6080019e0 con 0x7ff6180b1180 2021-11-15T19:34:20.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff618141430 con 0x7ff6180b1180 2021-11-15T19:34:20.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6181129c0 con 0x7ff6180b1180 2021-11-15T19:34:20.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff618110450 con 0x7ff6180b1180 2021-11-15T19:34:20.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.781+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff608018030 con 0x7ff6180b1180 2021-11-15T19:34:20.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.785+0000 7ff614ff9700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5fc053610 0x7ff5fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.785+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7ff60806b4f0 con 0x7ff6180b1180 2021-11-15T19:34:20.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.785+0000 7ff6177fe700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5fc053610 0x7ff5fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.785+0000 7ff6177fe700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5fc053610 0x7ff5fc055ad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff600002fb0 tx=0x7ff6000069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.785+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff618110450 con 0x7ff6180b1180 2021-11-15T19:34:20.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff618110450 con 0x7ff6180b1180 2021-11-15T19:34:20.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff614ff9700 1 -- 172.21.2.137:0/2920629858 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2142 (secure 0 0 0) 0x7ff618110450 con 0x7ff6180b1180 2021-11-15T19:34:20.904 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:20.904 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:11.698625+0000","modified":"2021-11-15T19:34:13.716867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5163},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5163":{"gid":5163,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.2.111:6835/1523710751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1523710751},{"type":"v1","addr":"172.21.2.111:6835","nonce":1523710751}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T19:34:20.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5fc053610 msgr2=0x7ff5fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5fc053610 0x7ff5fc055ad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff600002fb0 tx=0x7ff6000069b0).stop 2021-11-15T19:34:20.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 msgr2=0x7ff618110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618110610 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7ff618111ef0 tx=0x7ff6080091a0).stop 2021-11-15T19:34:20.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 shutdown_connections 2021-11-15T19:34:20.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff5fc053610 0x7ff5fc055ad0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff6180b1180 0x7ff618110610 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6180af2f0 0x7ff618140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 --2- 172.21.2.137:0/2920629858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff6180acab0 0x7ff61811ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 >> 172.21.2.137:0/2920629858 conn(0x7ff6180630f0 msgr2=0x7ff618141a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:20.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 shutdown_connections 2021-11-15T19:34:20.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.893+0000 7ff61dee2700 1 -- 172.21.2.137:0/2920629858 wait complete. 2021-11-15T19:34:20.908 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 51 2021-11-15T19:34:20.911 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:34:20.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 Processor -- start 2021-11-15T19:34:20.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- start start 2021-11-15T19:34:20.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcaac0b1030 0x7fcaac140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0ad020 0x7fcaac143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac05cb50 con 0x7fcaac05c770 2021-11-15T19:34:20.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac13f910 con 0x7fcaac0b1030 2021-11-15T19:34:20.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac13fbb0 con 0x7fcaac0ad020 2021-11-15T19:34:20.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcaac0b1030 0x7fcaac140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fcaac0b1030 0x7fcaac140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38500/0 (socket says 172.21.2.137:38500) 2021-11-15T19:34:20.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/292139690 learned_addr learned my addr 172.21.2.137:0/292139690 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:20.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab19ef700 1 --2- 172.21.2.137:0/292139690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0ad020 0x7fcaac143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/292139690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0ad020 msgr2=0x7fcaac143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:20.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- 172.21.2.137:0/292139690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0ad020 0x7fcaac143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/292139690 >> v1:172.21.2.111:6789/0 conn(0x7fcaac05c770 legacy=0x7fcaac0ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:20.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/292139690 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac13fe50 con 0x7fcaac0b1030 2021-11-15T19:34:20.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- 172.21.2.137:0/292139690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0b1030 0x7fcaac140590 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcaac140470 tx=0x7fcaa400b530).ready entity=mon.1 client_cookie=c43e1e4683762daa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcaabfff700 1 -- 172.21.2.137:0/292139690 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa400be70 con 0x7fcaac0b1030 2021-11-15T19:34:20.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcaabfff700 1 -- 172.21.2.137:0/292139690 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4010470 con 0x7fcaac0b1030 2021-11-15T19:34:20.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcaabfff700 1 -- 172.21.2.137:0/292139690 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa4010810 con 0x7fcaac0b1030 2021-11-15T19:34:20.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- 172.21.2.137:0/292139690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0b1030 msgr2=0x7fcaac140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- 172.21.2.137:0/292139690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0b1030 0x7fcaac140590 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcaac140470 tx=0x7fcaa400b530).stop 2021-11-15T19:34:20.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- 172.21.2.137:0/292139690 shutdown_connections 2021-11-15T19:34:20.971 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- 172.21.2.137:0/292139690 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0ad020 0x7fcaac143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- 172.21.2.137:0/292139690 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0b1030 0x7fcaac140590 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:20.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- 172.21.2.137:0/292139690 >> 172.21.2.137:0/292139690 conn(0x7fcaac0631e0 msgr2=0x7fcaac05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:20.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- 172.21.2.137:0/292139690 shutdown_connections 2021-11-15T19:34:20.972 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- 172.21.2.137:0/292139690 wait complete. 2021-11-15T19:34:20.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 Processor -- start 2021-11-15T19:34:20.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- start start 2021-11-15T19:34:20.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaac05c770 0x7fcaac0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 0x7fcaac12aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0b1030 0x7fcaac12b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac067000 con 0x7fcaac05c770 2021-11-15T19:34:20.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0672a0 con 0x7fcaac0ad020 2021-11-15T19:34:20.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac1296e0 con 0x7fcaac0b1030 2021-11-15T19:34:20.974 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 0x7fcaac12aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 0x7fcaac12aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38506/0 (socket says 172.21.2.137:38506) 2021-11-15T19:34:20.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/3791463858 learned_addr learned my addr 172.21.2.137:0/3791463858 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:20.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0b1030 msgr2=0x7fcaac12b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.975 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0b1030 0x7fcaac12b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaac05c770 msgr2=0x7fcaac0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:20.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaac05c770 0x7fcaac0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:20.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 -- 172.21.2.137:0/3791463858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa400b7d0 con 0x7fcaac0ad020 2021-11-15T19:34:20.976 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab09ed700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 0x7fcaac12aee0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fcaac140470 tx=0x7fcaac0623f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa401d070 con 0x7fcaac0ad020 2021-11-15T19:34:20.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40188d0 con 0x7fcaac0ad020 2021-11-15T19:34:20.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.953+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac129b80 con 0x7fcaac0ad020 2021-11-15T19:34:20.977 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa4018c30 con 0x7fcaac0ad020 2021-11-15T19:34:20.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac067540 con 0x7fcaac0ad020 2021-11-15T19:34:20.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac1298a0 con 0x7fcaac0ad020 2021-11-15T19:34:20.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcaa4029070 con 0x7fcaac0ad020 2021-11-15T19:34:20.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcaaa7fc700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fca8c053580 0x7fca8c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:20.978 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fcaa406d490 con 0x7fcaac0ad020 2021-11-15T19:34:20.979 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcab11ee700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fca8c053580 0x7fca8c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:20.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcab11ee700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fca8c053580 0x7fca8c055a40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fcaa0001fa0 tx=0x7fcaa00077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:20.980 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:20.957+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcaa4044410 con 0x7fcaac0ad020 2021-11-15T19:34:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:21.069+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcaac0573d0 con 0x7fcaac0ad020 2021-11-15T19:34:22.078 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:34:22.073+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:34:22.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcaaa7fc700 1 -- 172.21.2.137:0/3791463858 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcaa4047a30 con 0x7fcaac0ad020 2021-11-15T19:34:22.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fca8c053580 msgr2=0x7fca8c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fca8c053580 0x7fca8c055a40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fcaa0001fa0 tx=0x7fcaa00077f0).stop 2021-11-15T19:34:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 msgr2=0x7fcaac12aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 0x7fcaac12aee0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fcaac140470 tx=0x7fcaac0623f0).stop 2021-11-15T19:34:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 shutdown_connections 2021-11-15T19:34:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fca8c053580 0x7fca8c055a40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fcaac0b1030 0x7fcaac12b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fcaac0ad020 0x7fcaac12aee0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 --2- 172.21.2.137:0/3791463858 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fcaac05c770 0x7fcaac0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 >> 172.21.2.137:0/3791463858 conn(0x7fcaac0631e0 msgr2=0x7fcaac13edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 shutdown_connections 2021-11-15T19:34:22.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.081+0000 7fcab3452700 1 -- 172.21.2.137:0/3791463858 wait complete. 2021-11-15T19:34:22.094 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:34:22.098 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:22.100 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:34:22.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 Processor -- start 2021-11-15T19:34:22.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- start start 2021-11-15T19:34:22.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9edc147980 0x7f9edc0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc148190 con 0x7f9edc144610 2021-11-15T19:34:22.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0b1720 con 0x7f9edc0b1340 2021-11-15T19:34:22.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0af800 con 0x7f9edc147980 2021-11-15T19:34:22.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9edc0b1340 0x7f9edc143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57294/0 (socket says 172.21.2.137:57294) 2021-11-15T19:34:22.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 -- 172.21.2.137:0/1407260743 learned_addr learned my addr 172.21.2.137:0/1407260743 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:22.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1d23700 1 --2- 172.21.2.137:0/1407260743 >> v2:172.21.2.111:3300/0 conn(0x7f9edc147980 0x7f9edc0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197402082 0 0) 0x7f9edc0b1720 con 0x7f9edc0b1340 2021-11-15T19:34:22.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec4003260 con 0x7f9edc0b1340 2021-11-15T19:34:22.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728688461 0 0) 0x7f9ec4003260 con 0x7f9edc0b1340 2021-11-15T19:34:22.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 >> v2:172.21.2.111:3300/0 conn(0x7f9edc147980 msgr2=0x7f9edc0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 --2- 172.21.2.137:0/1407260743 >> v2:172.21.2.111:3300/0 conn(0x7f9edc147980 0x7f9edc0aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 >> v1:172.21.2.111:6789/0 conn(0x7f9edc144610 legacy=0x7f9edc0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc05faf0 con 0x7f9edc0b1340 2021-11-15T19:34:22.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9ed8001660 con 0x7f9edc0b1340 2021-11-15T19:34:22.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 >> v1:172.21.2.137:6789/0 conn(0x7f9edc0b1340 legacy=0x7f9edc143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9ec4003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ec4004500 0x7f9ec4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ec4004e70 0x7f9ec400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0af800 con 0x7f9ec4004e70 2021-11-15T19:34:22.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400be50 con 0x7f9ec40037a0 2021-11-15T19:34:22.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400c010 con 0x7f9ec4004500 2021-11-15T19:34:22.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9ec4003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1d23700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ec4004e70 0x7f9ec400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 -- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ec4004500 msgr2=0x7f9ec4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9ec4004500 0x7f9ec4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 -- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ec4004e70 msgr2=0x7f9ec400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9ec4004e70 0x7f9ec400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 -- 172.21.2.137:0/1407260743 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4003260 con 0x7f9ec40037a0 2021-11-15T19:34:22.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1d23700 1 -- 172.21.2.137:0/1407260743 reap_dead start 2021-11-15T19:34:22.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee1522700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9ec4003bc0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f9ed8001370 tx=0x7f9edc05f9e0).ready entity=mon.1 client_cookie=5c671f5c7adccb9e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:22.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed80070d0 con 0x7f9ec40037a0 2021-11-15T19:34:22.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8007230 con 0x7f9ec40037a0 2021-11-15T19:34:22.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ecffff700 1 -- 172.21.2.137:0/1407260743 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed800c8b0 con 0x7f9ec40037a0 2021-11-15T19:34:22.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- 172.21.2.137:0/1407260743 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 msgr2=0x7f9ec4003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9ec4003bc0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f9ed8001370 tx=0x7f9edc05f9e0).stop 2021-11-15T19:34:22.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- 172.21.2.137:0/1407260743 shutdown_connections 2021-11-15T19:34:22.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 --2- 172.21.2.137:0/1407260743 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9ec4003bc0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- 172.21.2.137:0/1407260743 >> 172.21.2.137:0/1407260743 conn(0x7f9edc0b4e60 msgr2=0x7f9edc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:22.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- 172.21.2.137:0/1407260743 shutdown_connections 2021-11-15T19:34:22.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.141+0000 7f9ee3786700 1 -- 172.21.2.137:0/1407260743 wait complete. 2021-11-15T19:34:22.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 Processor -- start 2021-11-15T19:34:22.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- start start 2021-11-15T19:34:22.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9edc13ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc14b140 0x7f9edc142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc14a140 0x7f9edc142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc14aed0 con 0x7f9edc14b140 2021-11-15T19:34:22.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc140740 con 0x7f9ec40037a0 2021-11-15T19:34:22.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc14ac00 con 0x7f9edc14a140 2021-11-15T19:34:22.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9edc13ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9edc13ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38524/0 (socket says 172.21.2.137:38524) 2021-11-15T19:34:22.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 -- 172.21.2.137:0/3469745620 learned_addr learned my addr 172.21.2.137:0/3469745620 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:22.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee0d21700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc14b140 0x7f9edc142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1d23700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc14a140 0x7f9edc142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 -- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc14a140 msgr2=0x7f9edc142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc14a140 0x7f9edc142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 -- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc14b140 msgr2=0x7f9edc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc14b140 0x7f9edc142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 -- 172.21.2.137:0/3469745620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc1409e0 con 0x7f9ec40037a0 2021-11-15T19:34:22.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee1522700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9edc13ebd0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f9ed8001370 tx=0x7f9ed8013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:22.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed801b070 con 0x7f9ec40037a0 2021-11-15T19:34:22.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8004920 con 0x7f9ec40037a0 2021-11-15T19:34:22.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc159c70 con 0x7f9ec40037a0 2021-11-15T19:34:22.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed80070d0 con 0x7f9ec40037a0 2021-11-15T19:34:22.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc13d440 con 0x7f9ec40037a0 2021-11-15T19:34:22.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc05fd90 con 0x7f9ec40037a0 2021-11-15T19:34:22.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ed8010070 con 0x7f9ec40037a0 2021-11-15T19:34:22.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ece7fc700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ebc0536a0 0x7f9ebc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f9ed806b480 con 0x7f9ec40037a0 2021-11-15T19:34:22.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee0d21700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ebc0536a0 0x7f9ebc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.145+0000 7f9ee0d21700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ebc0536a0 0x7f9ebc055b60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f9ed000b000 tx=0x7f9ed0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:22.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.149+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ed8042530 con 0x7f9ec40037a0 2021-11-15T19:34:22.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9edc159e00 con 0x7f9ec40037a0 2021-11-15T19:34:22.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ece7fc700 1 -- 172.21.2.137:0/3469745620 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1780 (secure 0 0 0) 0x7f9ed8045b50 con 0x7f9ec40037a0 2021-11-15T19:34:22.267 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:22.268 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:11.698625+0000","modified":"2021-11-15T19:34:22.075947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T19:34:22.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ebc0536a0 msgr2=0x7f9ebc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ebc0536a0 0x7f9ebc055b60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f9ed000b000 tx=0x7f9ed0009040).stop 2021-11-15T19:34:22.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 msgr2=0x7f9edc13ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9edc13ebd0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f9ed8001370 tx=0x7f9ed8013000).stop 2021-11-15T19:34:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 shutdown_connections 2021-11-15T19:34:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9ebc0536a0 0x7f9ebc055b60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9edc14a140 0x7f9edc142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9edc14b140 0x7f9edc142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 --2- 172.21.2.137:0/3469745620 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9ec40037a0 0x7f9edc13ebd0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 >> 172.21.2.137:0/3469745620 conn(0x7f9edc0b4e60 msgr2=0x7f9edc146730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 shutdown_connections 2021-11-15T19:34:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.257+0000 7f9ee3786700 1 -- 172.21.2.137:0/3469745620 wait complete. 2021-11-15T19:34:22.271 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 52 2021-11-15T19:34:22.275 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:34:22.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 Processor -- start 2021-11-15T19:34:22.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- start start 2021-11-15T19:34:22.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d40acd60 0x7f25d40b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d40b76c0 con 0x7f25d40b72e0 2021-11-15T19:34:22.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d412a170 con 0x7f25d40b4680 2021-11-15T19:34:22.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40b3100 con 0x7f25d40acd60 2021-11-15T19:34:22.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d3fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f25d40b4680 0x7f25d41290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57316/0 (socket says 172.21.2.137:57316) 2021-11-15T19:34:22.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d3fff700 1 -- 172.21.2.137:0/2764703021 learned_addr learned my addr 172.21.2.137:0/2764703021 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:22.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202599568 0 0) 0x7f25d412a170 con 0x7f25d40b4680 2021-11-15T19:34:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b4003260 con 0x7f25d40b4680 2021-11-15T19:34:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3949056841 0 0) 0x7f25b4003260 con 0x7f25d40b4680 2021-11-15T19:34:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d40acd60 msgr2=0x7f25d40b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d40acd60 0x7f25d40b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 >> v1:172.21.2.111:6789/0 conn(0x7f25d40b72e0 legacy=0x7f25d40b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40ad8a0 con 0x7f25d40b4680 2021-11-15T19:34:22.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f25cc0019e0 con 0x7f25d40b4680 2021-11-15T19:34:22.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 >> v1:172.21.2.137:6789/0 conn(0x7f25d40b4680 legacy=0x7f25d41290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25b4003750 0x7f25b4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25b4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d40acd60 0x7f25b4005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40b3100 con 0x7f25b4003750 2021-11-15T19:34:22.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b400b940 con 0x7f25b4004500 2021-11-15T19:34:22.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b400bb00 con 0x7f25d40acd60 2021-11-15T19:34:22.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25b4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d37fe700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25b4003750 0x7f25b4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 -- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d40acd60 msgr2=0x7f25b4005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d40acd60 0x7f25b4005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 -- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25b4003750 msgr2=0x7f25b4003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:22.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25b4003750 0x7f25b4003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:22.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 -- 172.21.2.137:0/2764703021 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4003260 con 0x7f25b4004500 2021-11-15T19:34:22.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d2ffd700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25b4004980 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f25c4002f70 tx=0x7f25c4006ca0).ready entity=mon.1 client_cookie=518ddc0e2a9e204c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:22.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c4012410 con 0x7f25b4004500 2021-11-15T19:34:22.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4012570 con 0x7f25b4004500 2021-11-15T19:34:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d27fc700 1 -- 172.21.2.137:0/2764703021 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c40128d0 con 0x7f25b4004500 2021-11-15T19:34:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- 172.21.2.137:0/2764703021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 msgr2=0x7f25b4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 --2- 172.21.2.137:0/2764703021 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25b4004980 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f25c4002f70 tx=0x7f25c4006ca0).stop 2021-11-15T19:34:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d3fff700 1 -- 172.21.2.137:0/2764703021 reap_dead start 2021-11-15T19:34:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- 172.21.2.137:0/2764703021 shutdown_connections 2021-11-15T19:34:22.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- 172.21.2.137:0/2764703021 >> 172.21.2.137:0/2764703021 conn(0x7f25d4064960 msgr2=0x7f25d4064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:22.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- 172.21.2.137:0/2764703021 shutdown_connections 2021-11-15T19:34:22.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.317+0000 7f25d9afc700 1 -- 172.21.2.137:0/2764703021 wait complete. 2021-11-15T19:34:22.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 Processor -- start 2021-11-15T19:34:22.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- start start 2021-11-15T19:34:22.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25d41270b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d41430a0 0x7f25d41276b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25d4127ba0 0x7f25d4128020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40b20c0 con 0x7f25d4127ba0 2021-11-15T19:34:22.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40b0190 con 0x7f25b4004500 2021-11-15T19:34:22.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40af7b0 con 0x7f25d41430a0 2021-11-15T19:34:22.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25d41270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25d41270b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38544/0 (socket says 172.21.2.137:38544) 2021-11-15T19:34:22.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 -- 172.21.2.137:0/811345539 learned_addr learned my addr 172.21.2.137:0/811345539 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:22.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 -- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d41430a0 msgr2=0x7f25d41276b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:22.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d41430a0 0x7f25d41276b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 -- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25d4127ba0 msgr2=0x7f25d4128020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:22.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25d4127ba0 0x7f25d4128020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:22.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 -- 172.21.2.137:0/811345539 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40afa50 con 0x7f25b4004500 2021-11-15T19:34:22.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d37fe700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25d41270b0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f25bc007560 tx=0x7f25bc009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:22.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25bc010640 con 0x7f25b4004500 2021-11-15T19:34:22.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc0107a0 con 0x7f25b4004500 2021-11-15T19:34:22.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d40afcf0 con 0x7f25b4004500 2021-11-15T19:34:22.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d40af400 con 0x7f25b4004500 2021-11-15T19:34:22.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25bc010b00 con 0x7f25b4004500 2021-11-15T19:34:22.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d41434c0 con 0x7f25b4004500 2021-11-15T19:34:22.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f25bc010c60 con 0x7f25b4004500 2021-11-15T19:34:22.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d0ff9700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25b8053540 0x7f25b8055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:22.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f25bc06b950 con 0x7f25b4004500 2021-11-15T19:34:22.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.321+0000 7f25d2ffd700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25b8053540 0x7f25b8055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:22.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.325+0000 7f25d2ffd700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25b8053540 0x7f25b8055a00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f25c4002f70 tx=0x7f25c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:22.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.325+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25bc0428f0 con 0x7f25b4004500 2021-11-15T19:34:22.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:22.433+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f25d40b02d0 con 0x7f25b4004500 2021-11-15T19:34:23.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d0ff9700 1 -- 172.21.2.137:0/811345539 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f25bc045f10 con 0x7f25b4004500 2021-11-15T19:34:23.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25b8053540 msgr2=0x7f25b8055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:23.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25b8053540 0x7f25b8055a00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f25c4002f70 tx=0x7f25c4015000).stop 2021-11-15T19:34:23.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 msgr2=0x7f25d41270b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:23.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25d41270b0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f25bc007560 tx=0x7f25bc009040).stop 2021-11-15T19:34:23.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 shutdown_connections 2021-11-15T19:34:23.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f25b8053540 0x7f25b8055a00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:23.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25d4127ba0 0x7f25d4128020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:23.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f25d41430a0 0x7f25d41276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:23.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 --2- 172.21.2.137:0/811345539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f25b4004500 0x7f25d41270b0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:23.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 >> 172.21.2.137:0/811345539 conn(0x7f25d4064960 msgr2=0x7f25d40b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:23.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 shutdown_connections 2021-11-15T19:34:23.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.125+0000 7f25d9afc700 1 -- 172.21.2.137:0/811345539 wait complete. 2021-11-15T19:34:23.143 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:34:23.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfc52f700 1 Processor -- start 2021-11-15T19:34:23.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfc52f700 1 -- start start 2021-11-15T19:34:23.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfc52f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbdf40b0c50 0x7fbdf40aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:23.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfc52f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf413faa0 con 0x7fbdf4140390 2021-11-15T19:34:23.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfc52f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf40b1030 con 0x7fbdf413ff00 2021-11-15T19:34:23.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfc52f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf4143210 con 0x7fbdf40b0c50 2021-11-15T19:34:23.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdf9aca700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbdf413ff00 0x7fbdf405f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57338/0 (socket says 172.21.2.137:57338) 2021-11-15T19:34:23.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdf9aca700 1 -- 172.21.2.137:0/2532741939 learned_addr learned my addr 172.21.2.137:0/2532741939 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:23.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfa2cb700 1 --2- 172.21.2.137:0/2532741939 >> v2:172.21.2.137:3300/0 conn(0x7fbdf40b0c50 0x7fbdf40aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:23.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfa2cb700 1 -- 172.21.2.137:0/2532741939 >> v1:172.21.2.137:6789/0 conn(0x7fbdf413ff00 legacy=0x7fbdf405f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:23.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfa2cb700 1 -- 172.21.2.137:0/2532741939 >> v1:172.21.2.111:6789/0 conn(0x7fbdf4140390 legacy=0x7fbdf40600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:23.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.185+0000 7fbdfa2cb700 1 -- 172.21.2.137:0/2532741939 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4060800 con 0x7fbdf40b0c50 2021-11-15T19:34:23.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfa2cb700 1 --2- 172.21.2.137:0/2532741939 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf40b0c50 0x7fbdf40aa4e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fbdf40b5d50 tx=0x7fbdf0006df0).ready entity=mon.1 client_cookie=37136e6a5d1f2614 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:23.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf92c9700 1 -- 172.21.2.137:0/2532741939 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf000d5c0 con 0x7fbdf40b0c50 2021-11-15T19:34:23.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf92c9700 1 -- 172.21.2.137:0/2532741939 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0000e90 con 0x7fbdf40b0c50 2021-11-15T19:34:23.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf92c9700 1 -- 172.21.2.137:0/2532741939 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf000d910 con 0x7fbdf40b0c50 2021-11-15T19:34:23.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/2532741939 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf40b0c50 msgr2=0x7fbdf40aa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:23.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/2532741939 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf40b0c50 0x7fbdf40aa4e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fbdf40b5d50 tx=0x7fbdf0006df0).stop 2021-11-15T19:34:23.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/2532741939 shutdown_connections 2021-11-15T19:34:23.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/2532741939 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf40b0c50 0x7fbdf40aa4e0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:23.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/2532741939 >> 172.21.2.137:0/2532741939 conn(0x7fbdf40b4e60 msgr2=0x7fbdf40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:23.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/2532741939 shutdown_connections 2021-11-15T19:34:23.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/2532741939 wait complete. 2021-11-15T19:34:23.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 Processor -- start 2021-11-15T19:34:23.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- start start 2021-11-15T19:34:23.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdf40b0c50 0x7fbdf409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:23.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 0x7fbdf40ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:23.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdf4140390 0x7fbdf413d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:23.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40ae360 con 0x7fbdf4140390 2021-11-15T19:34:23.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40ae0c0 con 0x7fbdf413ff00 2021-11-15T19:34:23.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf413cfe0 con 0x7fbdf40b0c50 2021-11-15T19:34:23.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 0x7fbdf40ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:23.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 0x7fbdf40ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38560/0 (socket says 172.21.2.137:38560) 2021-11-15T19:34:23.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 -- 172.21.2.137:0/3266082884 learned_addr learned my addr 172.21.2.137:0/3266082884 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:23.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 -- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdf40b0c50 msgr2=0x7fbdf409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:23.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdf40b0c50 0x7fbdf409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:23.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 -- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdf4140390 msgr2=0x7fbdf413d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:23.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdf4140390 0x7fbdf413d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:23.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 -- 172.21.2.137:0/3266082884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf000b180 con 0x7fbdf413ff00 2021-11-15T19:34:23.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdf9aca700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 0x7fbdf40ac2a0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fbdf40ae280 tx=0x7fbde8007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:23.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde800ce20 con 0x7fbdf413ff00 2021-11-15T19:34:23.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde80072e0 con 0x7fbdf413ff00 2021-11-15T19:34:23.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde8005800 con 0x7fbdf413ff00 2021-11-15T19:34:23.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf40ac790 con 0x7fbdf413ff00 2021-11-15T19:34:23.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf413baf0 con 0x7fbdf413ff00 2021-11-15T19:34:23.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.189+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf4142f70 con 0x7fbdf413ff00 2021-11-15T19:34:23.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.193+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbde8010070 con 0x7fbdf413ff00 2021-11-15T19:34:23.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.193+0000 7fbde77fe700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbdd40535d0 0x7fbdd4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:23.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.193+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fbde806b0a0 con 0x7fbdf413ff00 2021-11-15T19:34:23.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.193+0000 7fbdfa2cb700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbdd40535d0 0x7fbdd4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:23.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.193+0000 7fbdfa2cb700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbdd40535d0 0x7fbdd4055a90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fbdf40b5d50 tx=0x7fbdf0012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:23.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.193+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbde8042150 con 0x7fbdf413ff00 2021-11-15T19:34:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:23.277+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbdf40573d0 con 0x7fbdf413ff00 2021-11-15T19:34:24.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.141+0000 7fbde77fe700 1 -- 172.21.2.137:0/3266082884 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbde8045770 con 0x7fbdf413ff00 2021-11-15T19:34:24.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbdd40535d0 msgr2=0x7fbdd4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:24.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbdd40535d0 0x7fbdd4055a90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fbdf40b5d50 tx=0x7fbdf0012000).stop 2021-11-15T19:34:24.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 msgr2=0x7fbdf40ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:24.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 0x7fbdf40ac2a0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fbdf40ae280 tx=0x7fbde8007c40).stop 2021-11-15T19:34:24.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 shutdown_connections 2021-11-15T19:34:24.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbdd40535d0 0x7fbdd4055a90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:24.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbdf4140390 0x7fbdf413d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:24.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbdf413ff00 0x7fbdf40ac2a0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:24.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 --2- 172.21.2.137:0/3266082884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbdf40b0c50 0x7fbdf409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:24.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 >> 172.21.2.137:0/3266082884 conn(0x7fbdf40b4e60 msgr2=0x7fbdf413a560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:24.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 shutdown_connections 2021-11-15T19:34:24.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.145+0000 7fbdfc52f700 1 -- 172.21.2.137:0/3266082884 wait complete. 2021-11-15T19:34:24.157 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:34:24.161 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:34:24.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 Processor -- start 2021-11-15T19:34:24.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- start start 2021-11-15T19:34:24.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f66dc05fd20 0x7f66dc0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:24.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f66dc0b0830 0x7f66dc0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:24.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc147f70 con 0x7f66dc0b10b0 2021-11-15T19:34:24.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc060100 con 0x7f66dc05fd20 2021-11-15T19:34:24.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc147cd0 con 0x7f66dc0b0830 2021-11-15T19:34:24.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d9d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f66dc0b10b0 0x7f66dc0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57352/0 (socket says 172.21.2.137:57352) 2021-11-15T19:34:24.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d9d9b700 1 -- 172.21.2.137:0/1842197777 learned_addr learned my addr 172.21.2.137:0/1842197777 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:24.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66dad9d700 1 --2- 172.21.2.137:0/1842197777 >> v2:172.21.2.137:3300/0 conn(0x7f66dc0b0830 0x7f66dc0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:24.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d959a700 1 -- 172.21.2.137:0/1842197777 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208742287 0 0) 0x7f66dc147f70 con 0x7f66dc0b10b0 2021-11-15T19:34:24.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d959a700 1 -- 172.21.2.137:0/1842197777 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c0003260 con 0x7f66dc0b10b0 2021-11-15T19:34:24.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66dad9d700 1 -- 172.21.2.137:0/1842197777 >> v2:172.21.2.111:3300/0 conn(0x7f66dc05fd20 msgr2=0x7f66dc0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:24.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66dad9d700 1 --2- 172.21.2.137:0/1842197777 >> v2:172.21.2.111:3300/0 conn(0x7f66dc05fd20 0x7f66dc0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:24.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66dad9d700 1 -- 172.21.2.137:0/1842197777 >> v1:172.21.2.137:6789/0 conn(0x7f66dc0b10b0 legacy=0x7f66dc0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:24.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66dad9d700 1 -- 172.21.2.137:0/1842197777 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0a9ed0 con 0x7f66dc0b0830 2021-11-15T19:34:24.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66dad9d700 1 --2- 172.21.2.137:0/1842197777 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc0aa370 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f66d40032f0 tx=0x7f66d40091d0).ready entity=mon.1 client_cookie=8f60bf8073f87b42 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:24.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d959a700 1 -- 172.21.2.137:0/1842197777 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d400b680 con 0x7f66dc0b0830 2021-11-15T19:34:24.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d959a700 1 -- 172.21.2.137:0/1842197777 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d400b7e0 con 0x7f66dc0b0830 2021-11-15T19:34:24.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66d959a700 1 -- 172.21.2.137:0/1842197777 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d400b950 con 0x7f66dc0b0830 2021-11-15T19:34:24.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- 172.21.2.137:0/1842197777 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 msgr2=0x7f66dc0aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:24.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/1842197777 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc0aa370 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f66d40032f0 tx=0x7f66d40091d0).stop 2021-11-15T19:34:24.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- 172.21.2.137:0/1842197777 shutdown_connections 2021-11-15T19:34:24.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/1842197777 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc0aa370 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:24.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/1842197777 >> v2:172.21.2.111:3300/0 conn(0x7f66dc05fd20 0x7f66dc0af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:24.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- 172.21.2.137:0/1842197777 >> 172.21.2.137:0/1842197777 conn(0x7f66dc0b4e60 msgr2=0x7f66dc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:24.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- 172.21.2.137:0/1842197777 shutdown_connections 2021-11-15T19:34:24.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.205+0000 7f66e0e4a700 1 -- 172.21.2.137:0/1842197777 wait complete. 2021-11-15T19:34:24.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 Processor -- start 2021-11-15T19:34:24.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- start start 2021-11-15T19:34:24.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66dc05fd20 0x7f66dc1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:24.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:24.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66dc0b10b0 0x7f66dc13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:24.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc142880 con 0x7f66dc05fd20 2021-11-15T19:34:24.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc142b20 con 0x7f66dc0b0830 2021-11-15T19:34:24.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc142dc0 con 0x7f66dc0b10b0 2021-11-15T19:34:24.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:24.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc13e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38574/0 (socket says 172.21.2.137:38574) 2021-11-15T19:34:24.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 -- 172.21.2.137:0/2322404038 learned_addr learned my addr 172.21.2.137:0/2322404038 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:24.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 -- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66dc0b10b0 msgr2=0x7f66dc13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:24.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66dc0b10b0 0x7f66dc13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:24.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 -- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66dc05fd20 msgr2=0x7f66dc1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:24.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66dc05fd20 0x7f66dc1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:24.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 -- 172.21.2.137:0/2322404038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4009470 con 0x7f66dc0b0830 2021-11-15T19:34:24.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66d9d9b700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc13e820 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f66d0001110 tx=0x7f66d0007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:24.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d0007e10 con 0x7f66dc0b0830 2021-11-15T19:34:24.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d00072e0 con 0x7f66dc0b0830 2021-11-15T19:34:24.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc13f200 con 0x7f66dc0b0830 2021-11-15T19:34:24.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc143e20 con 0x7f66dc0b0830 2021-11-15T19:34:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d0005800 con 0x7f66dc0b0830 2021-11-15T19:34:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc1426a0 con 0x7f66dc0b0830 2021-11-15T19:34:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66d001a060 con 0x7f66dc0b0830 2021-11-15T19:34:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66cb7fe700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66b8053540 0x7f66b8055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:24.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5803+0+0 (secure 0 0 0) 0x7f66d006b0f0 con 0x7f66dc0b0830 2021-11-15T19:34:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.209+0000 7f66da59c700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66b8053540 0x7f66b8055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.213+0000 7f66da59c700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66b8053540 0x7f66b8055a00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f66cc002f70 tx=0x7f66cc006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:24.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.213+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66d0042250 con 0x7f66dc0b0830 2021-11-15T19:34:24.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:24.297+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66dc1479f0 con 0x7f66dc0b0830 2021-11-15T19:34:24.461 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:24.464 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:24.467 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:24.471 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:24.474 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:25.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.153+0000 7f66cb7fe700 1 -- 172.21.2.137:0/2322404038 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 173+0+0 (secure 0 0 0) 0x7f66d0018070 con 0x7f66dc0b0830 2021-11-15T19:34:25.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66b8053540 msgr2=0x7f66b8055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66b8053540 0x7f66b8055a00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f66cc002f70 tx=0x7f66cc006a80).stop 2021-11-15T19:34:25.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 msgr2=0x7f66dc13e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc13e820 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f66d0001110 tx=0x7f66d0007ad0).stop 2021-11-15T19:34:25.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 shutdown_connections 2021-11-15T19:34:25.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f66b8053540 0x7f66b8055a00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66dc0b10b0 0x7f66dc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:25.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66dc0b0830 0x7f66dc13e820 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 --2- 172.21.2.137:0/2322404038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66dc05fd20 0x7f66dc1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:25.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 >> 172.21.2.137:0/2322404038 conn(0x7f66dc0b4e60 msgr2=0x7f66dc140980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:25.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 shutdown_connections 2021-11-15T19:34:25.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.157+0000 7f66e0e4a700 1 -- 172.21.2.137:0/2322404038 wait complete. 2021-11-15T19:34:25.170 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:34:25.173 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:34:25.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 Processor -- start 2021-11-15T19:34:25.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 -- start start 2021-11-15T19:34:25.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 0x7fe95c13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 0x7fe95c13c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c066270 con 0x7fe95c0b00a0 2021-11-15T19:34:25.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c067410 con 0x7fe95c065b10 2021-11-15T19:34:25.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe9638b4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c06a580 con 0x7fe95c065730 2021-11-15T19:34:25.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe961650700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 0x7fe95c13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe960e4f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 0x7fe95c13c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe960e4f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 0x7fe95c13c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:45808/0 (socket says 172.21.2.137:45808) 2021-11-15T19:34:25.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe961650700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 0x7fe95c13c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:40150/0 (socket says 172.21.2.137:40150) 2021-11-15T19:34:25.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.217+0000 7fe960e4f700 1 -- 172.21.2.137:0/1570113140 learned_addr learned my addr 172.21.2.137:0/1570113140 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:25.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961650700 1 -- 172.21.2.137:0/1570113140 >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 msgr2=0x7fe95c13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:25.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961650700 1 --2- 172.21.2.137:0/1570113140 >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 0x7fe95c13c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961650700 1 -- 172.21.2.137:0/1570113140 >> v1:172.21.2.111:6789/0 conn(0x7fe95c0b00a0 legacy=0x7fe95c069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961650700 1 -- 172.21.2.137:0/1570113140 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c065fd0 con 0x7fe95c065730 2021-11-15T19:34:25.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe960e4f700 1 --2- 172.21.2.137:0/1570113140 >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 0x7fe95c13c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:25.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961650700 1 --2- 172.21.2.137:0/1570113140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 0x7fe95c13c2b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe958002f70 tx=0x7fe958006df0).ready entity=mon.2 client_cookie=6aee51645c8baa7b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:25.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe94bfff700 1 -- 172.21.2.137:0/1570113140 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe95800d570 con 0x7fe95c065730 2021-11-15T19:34:25.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe94bfff700 1 -- 172.21.2.137:0/1570113140 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe958000e90 con 0x7fe95c065730 2021-11-15T19:34:25.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe94bfff700 1 -- 172.21.2.137:0/1570113140 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe95800d8c0 con 0x7fe95c065730 2021-11-15T19:34:25.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1570113140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 msgr2=0x7fe95c13c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1570113140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 0x7fe95c13c2b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe958002f70 tx=0x7fe958006df0).stop 2021-11-15T19:34:25.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1570113140 shutdown_connections 2021-11-15T19:34:25.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1570113140 >> v2:172.21.2.111:3300/0 conn(0x7fe95c065b10 0x7fe95c13c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1570113140 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065730 0x7fe95c13c2b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1570113140 >> 172.21.2.137:0/1570113140 conn(0x7fe95c060290 msgr2=0x7fe95c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:25.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1570113140 shutdown_connections 2021-11-15T19:34:25.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1570113140 wait complete. 2021-11-15T19:34:25.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 Processor -- start 2021-11-15T19:34:25.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- start start 2021-11-15T19:34:25.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe95c065730 0x7fe95c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065b10 0x7fe95c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 0x7fe95c0acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0b3cc0 con 0x7fe95c065730 2021-11-15T19:34:25.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0b4cc0 con 0x7fe95c0b00a0 2021-11-15T19:34:25.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0b4f60 con 0x7fe95c065b10 2021-11-15T19:34:25.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 0x7fe95c0acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 0x7fe95c0acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38590/0 (socket says 172.21.2.137:38590) 2021-11-15T19:34:25.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 -- 172.21.2.137:0/1595833886 learned_addr learned my addr 172.21.2.137:0/1595833886 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:25.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 -- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065b10 msgr2=0x7fe95c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065b10 0x7fe95c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:25.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 -- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe95c065730 msgr2=0x7fe95c14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe95c065730 0x7fe95c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:25.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 -- 172.21.2.137:0/1595833886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c00b1e0 con 0x7fe95c0b00a0 2021-11-15T19:34:25.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe961e51700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 0x7fe95c0acec0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7fe95c142fa0 tx=0x7fe954007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:25.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe954006aa0 con 0x7fe95c0b00a0 2021-11-15T19:34:25.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954006c00 con 0x7fe95c0b00a0 2021-11-15T19:34:25.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95800b180 con 0x7fe95c0b00a0 2021-11-15T19:34:25.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe954007030 con 0x7fe95c0b00a0 2021-11-15T19:34:25.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.221+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c142690 con 0x7fe95c0b00a0 2021-11-15T19:34:25.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c066f70 con 0x7fe95c0b00a0 2021-11-15T19:34:25.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe95401b060 con 0x7fe95c0b00a0 2021-11-15T19:34:25.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe94a7fc700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe93c0536a0 0x7fe93c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fe95406b400 con 0x7fe95c0b00a0 2021-11-15T19:34:25.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe961650700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe93c0536a0 0x7fe93c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe961650700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe93c0536a0 0x7fe93c055b60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fe958002f70 tx=0x7fe958014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:25.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.225+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe954042680 con 0x7fe95c0b00a0 2021-11-15T19:34:25.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.309+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe95c0573d0 con 0x7fe95c0b00a0 2021-11-15T19:34:25.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.321+0000 7fe94a7fc700 1 -- 172.21.2.137:0/1595833886 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe954019020 con 0x7fe95c0b00a0 2021-11-15T19:34:25.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe93c0536a0 msgr2=0x7fe93c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe93c0536a0 0x7fe93c055b60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fe958002f70 tx=0x7fe958014000).stop 2021-11-15T19:34:25.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 msgr2=0x7fe95c0acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 0x7fe95c0acec0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7fe95c142fa0 tx=0x7fe954007f40).stop 2021-11-15T19:34:25.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 shutdown_connections 2021-11-15T19:34:25.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe93c0536a0 0x7fe93c055b60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe95c0b00a0 0x7fe95c0acec0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe95c065b10 0x7fe95c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:25.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 --2- 172.21.2.137:0/1595833886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe95c065730 0x7fe95c14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:25.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 >> 172.21.2.137:0/1595833886 conn(0x7fe95c060290 msgr2=0x7fe95c13f890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:25.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 shutdown_connections 2021-11-15T19:34:25.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.325+0000 7fe9638b4700 1 -- 172.21.2.137:0/1595833886 wait complete. 2021-11-15T19:34:25.341 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-11-15T19:34:25.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 Processor -- start 2021-11-15T19:34:25.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- start start 2021-11-15T19:34:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 0x7f3d2c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c148190 con 0x7f3d2c0a9f50 2021-11-15T19:34:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0b1720 con 0x7f3d2c0b1340 2021-11-15T19:34:25.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c147e70 con 0x7f3d2c144610 2021-11-15T19:34:25.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3d2c0b1340 0x7f3d2c143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57376/0 (socket says 172.21.2.137:57376) 2021-11-15T19:34:25.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2b7fe700 1 -- 172.21.2.137:0/300137365 learned_addr learned my addr 172.21.2.137:0/300137365 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:25.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295358913 0 0) 0x7f3d2c0b1720 con 0x7f3d2c0b1340 2021-11-15T19:34:25.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d0c003260 con 0x7f3d2c0b1340 2021-11-15T19:34:25.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2affd700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 0x7f3d2c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 931752357 0 0) 0x7f3d0c003260 con 0x7f3d2c0b1340 2021-11-15T19:34:25.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 msgr2=0x7f3d2c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:25.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 0x7f3d2c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 >> v1:172.21.2.111:6789/0 conn(0x7f3d2c0a9f50 legacy=0x7f3d2c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:25.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0af800 con 0x7f3d2c0b1340 2021-11-15T19:34:25.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3d14001660 con 0x7f3d2c0b1340 2021-11-15T19:34:25.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 >> v1:172.21.2.137:6789/0 conn(0x7f3d2c0b1340 legacy=0x7f3d2c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d0c003750 0x7f3d0c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 0x7f3d0c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d0c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c147e70 con 0x7f3d0c003750 2021-11-15T19:34:25.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c00b830 con 0x7f3d0c0049f0 2021-11-15T19:34:25.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c00b9f0 con 0x7f3d2c144610 2021-11-15T19:34:25.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d0c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2affd700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 0x7f3d0c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2b7fe700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d0c003750 0x7f3d0c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 -- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 msgr2=0x7f3d0c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:25.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c144610 0x7f3d0c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 -- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d0c003750 msgr2=0x7f3d0c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:25.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d0c003750 0x7f3d0c003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 -- 172.21.2.137:0/300137365 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c003260 con 0x7f3d0c0049f0 2021-11-15T19:34:25.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d0c004e70 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f3d24002320 tx=0x7f3d24007d80).ready entity=mon.1 client_cookie=f87c0a0f4d04a800 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:25.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d24006890 con 0x7f3d0c0049f0 2021-11-15T19:34:25.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d240069f0 con 0x7f3d0c0049f0 2021-11-15T19:34:25.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2a7fc700 1 -- 172.21.2.137:0/300137365 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d24006d50 con 0x7f3d0c0049f0 2021-11-15T19:34:25.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- 172.21.2.137:0/300137365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 msgr2=0x7f3d0c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 --2- 172.21.2.137:0/300137365 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d0c004e70 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f3d24002320 tx=0x7f3d24007d80).stop 2021-11-15T19:34:25.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d2bfff700 1 -- 172.21.2.137:0/300137365 reap_dead start 2021-11-15T19:34:25.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- 172.21.2.137:0/300137365 shutdown_connections 2021-11-15T19:34:25.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- 172.21.2.137:0/300137365 >> 172.21.2.137:0/300137365 conn(0x7f3d2c0b4e60 msgr2=0x7f3d2c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:25.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- 172.21.2.137:0/300137365 shutdown_connections 2021-11-15T19:34:25.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.397+0000 7f3d32142700 1 -- 172.21.2.137:0/300137365 wait complete. 2021-11-15T19:34:25.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 Processor -- start 2021-11-15T19:34:25.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- start start 2021-11-15T19:34:25.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d2c157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d2c0987b0 0x7f3d2c099270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c099760 0x7f3d2c148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c14a1e0 con 0x7f3d2c0987b0 2021-11-15T19:34:25.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c14ab70 con 0x7f3d0c0049f0 2021-11-15T19:34:25.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c14ada0 con 0x7f3d2c099760 2021-11-15T19:34:25.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d2c157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d2c157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38608/0 (socket says 172.21.2.137:38608) 2021-11-15T19:34:25.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 -- 172.21.2.137:0/2148155279 learned_addr learned my addr 172.21.2.137:0/2148155279 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:25.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2affd700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d2c0987b0 0x7f3d2c099270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2bfff700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c099760 0x7f3d2c148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 -- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c099760 msgr2=0x7f3d2c148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c099760 0x7f3d2c148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 -- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d2c0987b0 msgr2=0x7f3d2c099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:25.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d2c0987b0 0x7f3d2c099270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:25.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 -- 172.21.2.137:0/2148155279 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c14b040 con 0x7f3d0c0049f0 2021-11-15T19:34:25.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2bfff700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c099760 0x7f3d2c148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:25.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2b7fe700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d2c157310 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f3d1400b000 tx=0x7f3d2c0abfb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:25.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d14010680 con 0x7f3d0c0049f0 2021-11-15T19:34:25.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14010040 con 0x7f3d0c0049f0 2021-11-15T19:34:25.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c148920 con 0x7f3d0c0049f0 2021-11-15T19:34:25.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d140109d0 con 0x7f3d0c0049f0 2021-11-15T19:34:25.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c148e70 con 0x7f3d0c0049f0 2021-11-15T19:34:25.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c05faf0 con 0x7f3d0c0049f0 2021-11-15T19:34:25.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3d14010b30 con 0x7f3d0c0049f0 2021-11-15T19:34:25.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d28ff9700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d10053610 0x7f3d10055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:25.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f3d1406b1e0 con 0x7f3d0c0049f0 2021-11-15T19:34:25.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.401+0000 7f3d2affd700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d10053610 0x7f3d10055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:25.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.405+0000 7f3d2affd700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d10053610 0x7f3d10055ad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3d1c00c000 tx=0x7f3d1c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:25.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.405+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d140425d0 con 0x7f3d0c0049f0 2021-11-15T19:34:25.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:25.517+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f3d2c0573d0 con 0x7f3d0c0049f0 2021-11-15T19:34:26.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.161+0000 7f3d28ff9700 1 -- 172.21.2.137:0/2148155279 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v325) v1 ==== 127+0+0 (secure 0 0 0) 0x7f3d14045bf0 con 0x7f3d0c0049f0 2021-11-15T19:34:26.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d10053610 msgr2=0x7f3d10055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:26.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d10053610 0x7f3d10055ad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3d1c00c000 tx=0x7f3d1c008040).stop 2021-11-15T19:34:26.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 msgr2=0x7f3d2c157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:26.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d2c157310 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f3d1400b000 tx=0x7f3d2c0abfb0).stop 2021-11-15T19:34:26.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 shutdown_connections 2021-11-15T19:34:26.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3d10053610 0x7f3d10055ad0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3d2c099760 0x7f3d2c148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3d2c0987b0 0x7f3d2c099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 --2- 172.21.2.137:0/2148155279 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3d0c0049f0 0x7f3d2c157310 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 >> 172.21.2.137:0/2148155279 conn(0x7f3d2c0b4e60 msgr2=0x7f3d2c0b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:26.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 shutdown_connections 2021-11-15T19:34:26.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.165+0000 7f3d32142700 1 -- 172.21.2.137:0/2148155279 wait complete. 2021-11-15T19:34:26.188 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:34:26.188 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:34:26.189 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-11-15T19:34:26.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 Processor -- start 2021-11-15T19:34:26.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 -- start start 2021-11-15T19:34:26.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa470144610 0x7fa470147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 0x7fa4700aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa470148190 con 0x7fa4700b1340 2021-11-15T19:34:26.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4700b1720 con 0x7fa470144610 2021-11-15T19:34:26.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa477bf1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa470147e70 con 0x7fa4700a9f50 2021-11-15T19:34:26.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa47598d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa4700b1340 0x7fa470143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57396/0 (socket says 172.21.2.137:57396) 2021-11-15T19:34:26.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa47598d700 1 -- 172.21.2.137:0/4139996260 learned_addr learned my addr 172.21.2.137:0/4139996260 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:26.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198952422 0 0) 0x7fa464001110 con 0x7fa4700b1340 2021-11-15T19:34:26.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.229+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa458003260 con 0x7fa4700b1340 2021-11-15T19:34:26.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 0x7fa4700aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47518c700 1 --2- 172.21.2.137:0/4139996260 >> v2:172.21.2.111:3300/0 conn(0x7fa470144610 0x7fa470147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544220831 0 0) 0x7fa458003260 con 0x7fa4700b1340 2021-11-15T19:34:26.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 msgr2=0x7fa4700aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:26.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 0x7fa4700aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 >> v2:172.21.2.111:3300/0 conn(0x7fa470144610 msgr2=0x7fa470147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:26.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 --2- 172.21.2.137:0/4139996260 >> v2:172.21.2.111:3300/0 conn(0x7fa470144610 0x7fa470147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700af800 con 0x7fa4700b1340 2021-11-15T19:34:26.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa464001810 con 0x7fa4700b1340 2021-11-15T19:34:26.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 >> v1:172.21.2.137:6789/0 conn(0x7fa4700b1340 legacy=0x7fa470143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:26.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4580037d0 0x7fa458003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa458004500 0x7fa458004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 0x7fa458004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700b1720 con 0x7fa458004500 2021-11-15T19:34:26.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470147e70 con 0x7fa4580037d0 2021-11-15T19:34:26.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45800b900 con 0x7fa4700a9f50 2021-11-15T19:34:26.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4580037d0 0x7fa458003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47518c700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa458004500 0x7fa458004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 0x7fa458004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 -- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 msgr2=0x7fa458004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:26.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa4700a9f50 0x7fa458004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 -- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa458004500 msgr2=0x7fa458004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:26.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa458004500 0x7fa458004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:26.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 -- 172.21.2.137:0/4139996260 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458003260 con 0x7fa4580037d0 2021-11-15T19:34:26.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47598d700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4580037d0 0x7fa458003bf0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fa464001520 tx=0x7fa4700abfb0).ready entity=mon.1 client_cookie=8902f4851dfd1587 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:26.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa464007170 con 0x7fa4580037d0 2021-11-15T19:34:26.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4640072d0 con 0x7fa4580037d0 2021-11-15T19:34:26.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47498b700 1 -- 172.21.2.137:0/4139996260 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa46400ca20 con 0x7fa4580037d0 2021-11-15T19:34:26.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/4139996260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4580037d0 msgr2=0x7fa458003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:26.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 --2- 172.21.2.137:0/4139996260 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa4580037d0 0x7fa458003bf0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fa464001520 tx=0x7fa4700abfb0).stop 2021-11-15T19:34:26.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 -- 172.21.2.137:0/4139996260 reap_dead start 2021-11-15T19:34:26.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/4139996260 shutdown_connections 2021-11-15T19:34:26.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/4139996260 >> 172.21.2.137:0/4139996260 conn(0x7fa4700b4e60 msgr2=0x7fa4700b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:26.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/4139996260 shutdown_connections 2021-11-15T19:34:26.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/4139996260 wait complete. 2021-11-15T19:34:26.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 Processor -- start 2021-11-15T19:34:26.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- start start 2021-11-15T19:34:26.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4580037d0 0x7fa4700ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa47009a5d0 0x7fa4701573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 0x7fa470098270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700ae280 con 0x7fa4580037d0 2021-11-15T19:34:26.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700acc60 con 0x7fa470097df0 2021-11-15T19:34:26.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700af150 con 0x7fa47009a5d0 2021-11-15T19:34:26.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 0x7fa470098270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 0x7fa470098270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38626/0 (socket says 172.21.2.137:38626) 2021-11-15T19:34:26.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 -- 172.21.2.137:0/1886972355 learned_addr learned my addr 172.21.2.137:0/1886972355 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:26.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 -- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa47009a5d0 msgr2=0x7fa4701573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:26.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa47009a5d0 0x7fa4701573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:26.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 -- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4580037d0 msgr2=0x7fa4700ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:26.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4580037d0 0x7fa4700ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:26.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 -- 172.21.2.137:0/1886972355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700af3f0 con 0x7fa470097df0 2021-11-15T19:34:26.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa47618e700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 0x7fa470098270 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fa46800d000 tx=0x7fa468008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:26.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4680126d0 con 0x7fa470097df0 2021-11-15T19:34:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800c070 con 0x7fa470097df0 2021-11-15T19:34:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa470157890 con 0x7fa470097df0 2021-11-15T19:34:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa468012a20 con 0x7fa470097df0 2021-11-15T19:34:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.233+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47009ab50 con 0x7fa470097df0 2021-11-15T19:34:26.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4700aca80 con 0x7fa470097df0 2021-11-15T19:34:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa468012040 con 0x7fa470097df0 2021-11-15T19:34:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa462ffd700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa450053520 0x7fa4500559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fa46806b760 con 0x7fa470097df0 2021-11-15T19:34:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa47598d700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa450053520 0x7fa4500559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:26.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa47598d700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa450053520 0x7fa4500559e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fa464001520 tx=0x7fa464013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:26.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.237+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa468042a40 con 0x7fa470097df0 2021-11-15T19:34:26.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:26.349+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fa4700573d0 con 0x7fa470097df0 2021-11-15T19:34:27.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.169+0000 7fa462ffd700 1 -- 172.21.2.137:0/1886972355 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v326) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa468046060 con 0x7fa470097df0 2021-11-15T19:34:27.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa450053520 msgr2=0x7fa4500559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa450053520 0x7fa4500559e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fa464001520 tx=0x7fa464013000).stop 2021-11-15T19:34:27.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 msgr2=0x7fa470098270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 0x7fa470098270 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fa46800d000 tx=0x7fa468008040).stop 2021-11-15T19:34:27.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 shutdown_connections 2021-11-15T19:34:27.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa450053520 0x7fa4500559e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa470097df0 0x7fa470098270 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa47009a5d0 0x7fa4701573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 --2- 172.21.2.137:0/1886972355 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa4580037d0 0x7fa4700ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 >> 172.21.2.137:0/1886972355 conn(0x7fa4700b4e60 msgr2=0x7fa4700af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 shutdown_connections 2021-11-15T19:34:27.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.173+0000 7fa477bf1700 1 -- 172.21.2.137:0/1886972355 wait complete. 2021-11-15T19:34:27.189 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:34:27.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 Processor -- start 2021-11-15T19:34:27.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- start start 2021-11-15T19:34:27.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3ac40b0fe0 0x7f3ac40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3ac40acff0 0x7f3ac40af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40aedf0 con 0x7f3ac413f5c0 2021-11-15T19:34:27.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40ad4a0 con 0x7f3ac40acff0 2021-11-15T19:34:27.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40ae070 con 0x7f3ac40b0fe0 2021-11-15T19:34:27.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3ac40b0fe0 0x7f3ac40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3ac40b0fe0 0x7f3ac40afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38634/0 (socket says 172.21.2.137:38634) 2021-11-15T19:34:27.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 -- 172.21.2.137:0/4214407902 learned_addr learned my addr 172.21.2.137:0/4214407902 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:27.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac37fe700 1 --2- 172.21.2.137:0/4214407902 >> v2:172.21.2.111:3300/0 conn(0x7f3ac40acff0 0x7f3ac40af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 -- 172.21.2.137:0/4214407902 >> v2:172.21.2.111:3300/0 conn(0x7f3ac40acff0 msgr2=0x7f3ac40af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:27.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 --2- 172.21.2.137:0/4214407902 >> v2:172.21.2.111:3300/0 conn(0x7f3ac40acff0 0x7f3ac40af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 -- 172.21.2.137:0/4214407902 >> v1:172.21.2.111:6789/0 conn(0x7f3ac413f5c0 legacy=0x7f3ac413c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:27.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 -- 172.21.2.137:0/4214407902 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40b13c0 con 0x7f3ac40b0fe0 2021-11-15T19:34:27.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac3fff700 1 --2- 172.21.2.137:0/4214407902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac40b0fe0 0x7f3ac40afde0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f3ac40aec90 tx=0x7f3ab4006eb0).ready entity=mon.1 client_cookie=85b366a97368482 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac2ffd700 1 -- 172.21.2.137:0/4214407902 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab400d5c0 con 0x7f3ac40b0fe0 2021-11-15T19:34:27.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac2ffd700 1 -- 172.21.2.137:0/4214407902 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4000e90 con 0x7f3ac40b0fe0 2021-11-15T19:34:27.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3ac2ffd700 1 -- 172.21.2.137:0/4214407902 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab400d910 con 0x7f3ac40b0fe0 2021-11-15T19:34:27.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- 172.21.2.137:0/4214407902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac40b0fe0 msgr2=0x7f3ac40afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 --2- 172.21.2.137:0/4214407902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac40b0fe0 0x7f3ac40afde0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f3ac40aec90 tx=0x7f3ab4006eb0).stop 2021-11-15T19:34:27.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- 172.21.2.137:0/4214407902 shutdown_connections 2021-11-15T19:34:27.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 --2- 172.21.2.137:0/4214407902 >> v2:172.21.2.111:3300/0 conn(0x7f3ac40acff0 0x7f3ac40af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 --2- 172.21.2.137:0/4214407902 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac40b0fe0 0x7f3ac40afde0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- 172.21.2.137:0/4214407902 >> 172.21.2.137:0/4214407902 conn(0x7f3ac40b5f50 msgr2=0x7f3ac40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- 172.21.2.137:0/4214407902 shutdown_connections 2021-11-15T19:34:27.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- 172.21.2.137:0/4214407902 wait complete. 2021-11-15T19:34:27.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 Processor -- start 2021-11-15T19:34:27.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.233+0000 7f3aca866700 1 -- start start 2021-11-15T19:34:27.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ac40acff0 0x7f3ac4156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ac40b0fe0 0x7f3ac413c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 0x7f3ac4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4137d10 con 0x7f3ac40acff0 2021-11-15T19:34:27.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac41394f0 con 0x7f3ac413f5c0 2021-11-15T19:34:27.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac413d0e0 con 0x7f3ac40b0fe0 2021-11-15T19:34:27.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 0x7f3ac4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 0x7f3ac4156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38642/0 (socket says 172.21.2.137:38642) 2021-11-15T19:34:27.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 -- 172.21.2.137:0/779035693 learned_addr learned my addr 172.21.2.137:0/779035693 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:27.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac3fff700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ac40acff0 0x7f3ac4156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac37fe700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ac40b0fe0 0x7f3ac413c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 -- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ac40b0fe0 msgr2=0x7f3ac413c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ac40b0fe0 0x7f3ac413c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 -- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ac40acff0 msgr2=0x7f3ac4156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ac40acff0 0x7f3ac4156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 -- 172.21.2.137:0/779035693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab400b1e0 con 0x7f3ac413f5c0 2021-11-15T19:34:27.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac8e03700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 0x7f3ac4156430 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f3ac4137e50 tx=0x7f3abc0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3abc00e470 con 0x7f3ac413f5c0 2021-11-15T19:34:27.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00e5d0 con 0x7f3ac413f5c0 2021-11-15T19:34:27.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3abc00e930 con 0x7f3ac413f5c0 2021-11-15T19:34:27.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac413d380 con 0x7f3ac413f5c0 2021-11-15T19:34:27.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac4138dc0 con 0x7f3ac413f5c0 2021-11-15T19:34:27.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40ad690 con 0x7f3ac413f5c0 2021-11-15T19:34:27.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3abc018030 con 0x7f3ac413f5c0 2021-11-15T19:34:27.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac17fa700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3aa4053640 0x7f3aa4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f3abc06ae30 con 0x7f3ac413f5c0 2021-11-15T19:34:27.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.237+0000 7f3ac3fff700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3aa4053640 0x7f3aa4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.241+0000 7f3ac3fff700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3aa4053640 0x7f3aa4055b00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f3ab401c000 tx=0x7f3ab4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.241+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3abc042160 con 0x7f3ac413f5c0 2021-11-15T19:34:27.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.325+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3ac40573d0 con 0x7f3ac413f5c0 2021-11-15T19:34:27.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3ac17fa700 1 -- 172.21.2.137:0/779035693 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3abc045780 con 0x7f3ac413f5c0 2021-11-15T19:34:27.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3aa4053640 msgr2=0x7f3aa4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3aa4053640 0x7f3aa4055b00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f3ab401c000 tx=0x7f3ab4015000).stop 2021-11-15T19:34:27.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 msgr2=0x7f3ac4156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 0x7f3ac4156430 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f3ac4137e50 tx=0x7f3abc0090f0).stop 2021-11-15T19:34:27.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 shutdown_connections 2021-11-15T19:34:27.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3aa4053640 0x7f3aa4055b00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3ac413f5c0 0x7f3ac4156430 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3ac40b0fe0 0x7f3ac413c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 --2- 172.21.2.137:0/779035693 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3ac40acff0 0x7f3ac4156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 >> 172.21.2.137:0/779035693 conn(0x7f3ac40b5f50 msgr2=0x7f3ac405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 shutdown_connections 2021-11-15T19:34:27.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.341+0000 7f3aca866700 1 -- 172.21.2.137:0/779035693 wait complete. 2021-11-15T19:34:27.355 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:34:27.356 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:27.365 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:27.378 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:27.392 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:27.405 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:34:27.415 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:34:27.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:27.416 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:27.416 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:27.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:27.421 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:34:27.421 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:27.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:27.422 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:27.423 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:27.427 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:34:27.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:27.428 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:27.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:27.429 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:27.429 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:34:27.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:34:27.435 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:34:27.436 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:34:27.436 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:34:27.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.481+0000 7fd403d08700 1 Processor -- start 2021-11-15T19:34:27.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.481+0000 7fd403d08700 1 -- start start 2021-11-15T19:34:27.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3fc0adda0 0x7fd3fc05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc0b00a0 0x7fd3fc05c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd3fc05d220 0x7fd3fc05c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc05cbf0 con 0x7fd3fc05d220 2021-11-15T19:34:27.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc0ae730 con 0x7fd3fc0adda0 2021-11-15T19:34:27.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc067b90 con 0x7fd3fc0b00a0 2021-11-15T19:34:27.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3fc0adda0 0x7fd3fc05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd3fc0adda0 0x7fd3fc05bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38646/0 (socket says 172.21.2.137:38646) 2021-11-15T19:34:27.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 -- 172.21.2.137:0/3743779194 learned_addr learned my addr 172.21.2.137:0/3743779194 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:27.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 -- 172.21.2.137:0/3743779194 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc0b00a0 msgr2=0x7fd3fc05c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:27.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 --2- 172.21.2.137:0/3743779194 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc0b00a0 0x7fd3fc05c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 -- 172.21.2.137:0/3743779194 >> v2:172.21.2.111:3300/0 conn(0x7fd3fc05d220 msgr2=0x7fd3fc05c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 --2- 172.21.2.137:0/3743779194 >> v2:172.21.2.111:3300/0 conn(0x7fd3fc05d220 0x7fd3fc05c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 -- 172.21.2.137:0/3743779194 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0b0880 con 0x7fd3fc0adda0 2021-11-15T19:34:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd401aa4700 1 --2- 172.21.2.137:0/3743779194 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc05bd20 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fd3f8002f70 tx=0x7fd3f8006eb0).ready entity=mon.1 client_cookie=68a70dcbbc5ad2ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd400aa2700 1 -- 172.21.2.137:0/3743779194 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f800d570 con 0x7fd3fc0adda0 2021-11-15T19:34:27.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd400aa2700 1 -- 172.21.2.137:0/3743779194 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8000e90 con 0x7fd3fc0adda0 2021-11-15T19:34:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd400aa2700 1 -- 172.21.2.137:0/3743779194 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f800d8c0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3743779194 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 msgr2=0x7fd3fc05bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- 172.21.2.137:0/3743779194 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc05bd20 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fd3f8002f70 tx=0x7fd3f8006eb0).stop 2021-11-15T19:34:27.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3743779194 shutdown_connections 2021-11-15T19:34:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- 172.21.2.137:0/3743779194 >> v2:172.21.2.111:3300/0 conn(0x7fd3fc05d220 0x7fd3fc05c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- 172.21.2.137:0/3743779194 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc0b00a0 0x7fd3fc05c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- 172.21.2.137:0/3743779194 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc05bd20 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3743779194 >> 172.21.2.137:0/3743779194 conn(0x7fd3fc0630f0 msgr2=0x7fd3fc0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3743779194 shutdown_connections 2021-11-15T19:34:27.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3743779194 wait complete. 2021-11-15T19:34:27.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 Processor -- start 2021-11-15T19:34:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- start start 2021-11-15T19:34:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc05d220 0x7fd3fc066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc112d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3fc0b00a0 0x7fd3fc1182f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1147c0 con 0x7fd3fc0b00a0 2021-11-15T19:34:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1149f0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc114c90 con 0x7fd3fc05d220 2021-11-15T19:34:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc112d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc112d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38654/0 (socket says 172.21.2.137:38654) 2021-11-15T19:34:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 -- 172.21.2.137:0/3908838039 learned_addr learned my addr 172.21.2.137:0/3908838039 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 -- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc05d220 msgr2=0x7fd3fc066410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc05d220 0x7fd3fc066410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 -- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3fc0b00a0 msgr2=0x7fd3fc1182f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:27.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3fc0b00a0 0x7fd3fc1182f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 -- 172.21.2.137:0/3908838039 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f800b1e0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd4012a3700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc112d00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fd3ec002f70 tx=0x7fd3ec006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec00e470 con 0x7fd3fc0adda0 2021-11-15T19:34:27.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00e5d0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc117e50 con 0x7fd3fc0adda0 2021-11-15T19:34:27.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec00e930 con 0x7fd3fc0adda0 2021-11-15T19:34:27.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.485+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc116940 con 0x7fd3fc0adda0 2021-11-15T19:34:27.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc115aa0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd3ec018030 con 0x7fd3fc0adda0 2021-11-15T19:34:27.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd3eaffd700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3dc053580 0x7fd3dc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fd3ec06adf0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd401aa4700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3dc053580 0x7fd3dc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd401aa4700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3dc053580 0x7fd3dc055a40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fd3f8002f70 tx=0x7fd3f8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.489+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3fc115aa0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd3fc117fe0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd3eaffd700 1 -- 172.21.2.137:0/3908838039 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+28979 (secure 0 0 0) 0x7fd3ec0420d0 con 0x7fd3fc0adda0 2021-11-15T19:34:27.585 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:27.585 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:27.585 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 105, 2021-11-15T19:34:27.586 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:34:27.586 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:34:27.586 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:34:25.149087+0000", 2021-11-15T19:34:27.586 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:27.586 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:34:27.587 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:34:27.587 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:34:27.587 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:34:27.587 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:34:27.588 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:34:27.588 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:34:27.588 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:34:27.588 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:27.588 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:34:27.589 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:34:27.589 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:34:27.589 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:34:27.589 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:34:27.589 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 20, 2021-11-15T19:34:27.590 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:34:27.590 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:34:27.590 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:34:27.590 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:34:27.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:34:27.591 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:34:27.591 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:34:27.591 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:34:27.592 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:27.592 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:27.592 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:27.592 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:27.592 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:27.593 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:27.593 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:27.593 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:27.593 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:34:27.594 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:34:27.594 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:34:27.594 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:34:27.595 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:34:27.595 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:27.595 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:27.595 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:27.596 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:27.596 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:27.596 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:27.596 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:27.597 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.597 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:34:27.597 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:27.597 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:27.598 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:27.598 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:27.598 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:27.598 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:27.598 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:27.599 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:27.599 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:27.599 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:27.599 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:27.599 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:27.600 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:27.600 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:27.600 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:27.600 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:27.601 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:27.601 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:27.601 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:27.601 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:27.601 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:27.602 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:27.602 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:27.602 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:27.602 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:27.603 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:27.603 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.603 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:27.603 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:27.603 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:27.604 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:27.604 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:27.604 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:27.604 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:27.604 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:27.605 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:27.605 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:27.605 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:27.605 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:34:27.605 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:34:27.606 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.606 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:27.606 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:34:27.606 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.607 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.607 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.607 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:34:27.607 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:34:27.607 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:34:27.608 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:34:27.608 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:34:27.608 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:34:27.608 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:34:27.608 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:34:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:34:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:34:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:34:27.609 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:34:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:34:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:34:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:34:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:34:27.610 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:34:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:34:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:34:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:34:27.611 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:34:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:34:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:34:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:34:27.612 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:34:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:34:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:34:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:34:27.613 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:34:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:34:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:34:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:34:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:34:27.614 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:34:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:34:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:34:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:34:27.615 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:34:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:34:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:34:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:34:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:34:27.616 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:34:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:34:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:34:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:34:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:34:27.617 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:34:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:34:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:34:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.618 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:34:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:34:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:34:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:34:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:34:27.619 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:34:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:34:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:34:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:34:27.620 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:34:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:34:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:34:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:34:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:34:27.621 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:34:27.622 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:34:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.623 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.624 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.625 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:34:27.626 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:34:27.627 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.628 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:34:27.629 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.630 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:34:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.631 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:34:27.632 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:34:27.633 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.634 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:34:27.635 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.636 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:34:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:34:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.637 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:34:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:34:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:34:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:34:27.638 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.639 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:34:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.640 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.641 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.642 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.643 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.643 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.643 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:34:27.643 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.644 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.644 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.644 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.644 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:34:27.644 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.645 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.645 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.645 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.645 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.645 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.646 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.646 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.646 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:34:27.646 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.646 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.647 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.647 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.647 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:34:27.647 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.648 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.648 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.648 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.648 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.648 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.649 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.649 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.649 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:34:27.649 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.649 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.650 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.650 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.650 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:34:27.650 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.650 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.651 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.651 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.651 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.651 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.651 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.652 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.652 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:34:27.652 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.652 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.652 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.653 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.653 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:34:27.653 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:34:27.653 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.653 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.654 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.654 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:34:27.654 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:34:27.654 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:34:27.655 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:34:27.655 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.655 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.655 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.655 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.656 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.656 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.656 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:27.656 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:34:27.656 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.657 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.657 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.657 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.657 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.657 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.658 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.658 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 98, 2021-11-15T19:34:27.658 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.658 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.659 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.659 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.659 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.659 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.659 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:34:27.660 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.660 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.660 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.660 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.660 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:34:27.661 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.661 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.661 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.661 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.662 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.662 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.662 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.662 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.662 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:34:27.663 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.663 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.663 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.663 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.664 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:34:27.664 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.664 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.664 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.664 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.665 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.665 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.665 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.665 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.665 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:34:27.666 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.666 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.666 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.666 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.667 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:34:27.667 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.667 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.667 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.667 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.668 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.668 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.668 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.668 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.668 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:34:27.669 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.669 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.669 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.669 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.670 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:34:27.670 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:34:27.670 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.670 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.670 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.671 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:34:27.671 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:34:27.671 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:34:27.671 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:34:27.671 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.672 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.672 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.672 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.672 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.672 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.673 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:27.673 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:34:27.673 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.673 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.673 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.674 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.674 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.674 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.674 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.674 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:27.675 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.675 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.675 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.675 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.676 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.676 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.676 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:34:27.676 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.677 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.677 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.677 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.677 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:34:27.678 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.678 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.678 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.678 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.678 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.679 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.679 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.679 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.679 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:34:27.679 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.680 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.680 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.680 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:34:27.680 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.681 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.681 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.681 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.681 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.681 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.682 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.682 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.682 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:34:27.682 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.683 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.683 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.683 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.683 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:34:27.683 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.684 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.684 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.684 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.684 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.685 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:34:27.685 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.686 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.686 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.686 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:34:27.687 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:34:27.687 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.687 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.687 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.687 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:34:27.688 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:34:27.688 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:34:27.688 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:34:27.688 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.688 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.689 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.689 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.689 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.689 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.689 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:27.690 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:34:27.690 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.690 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.690 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.691 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.691 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.691 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.691 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.691 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 98, 2021-11-15T19:34:27.692 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.692 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.692 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.692 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.692 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.693 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:34:27.693 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.693 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.694 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.694 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.694 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:34:27.694 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.694 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.695 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.695 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.695 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.695 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.696 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.696 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.696 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:34:27.696 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.696 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.697 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.697 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.697 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:34:27.697 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.698 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.698 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.698 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.698 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.698 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.699 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.699 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.699 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:34:27.699 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.700 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.700 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.700 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.700 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:34:27.700 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.701 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.701 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.701 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.701 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.702 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:34:27.702 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.703 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.703 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.703 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.703 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:34:27.703 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:34:27.704 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.704 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.704 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:34:27.704 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:34:27.705 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:34:27.705 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:34:27.705 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.705 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.705 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.706 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.706 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.706 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.706 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:27.707 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:34:27.707 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.707 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.707 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.707 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.708 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.708 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.708 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.708 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 98, 2021-11-15T19:34:27.708 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.709 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.709 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.709 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.709 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.709 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.710 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:34:27.710 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.710 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.710 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.711 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:34:27.711 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.711 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.711 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.712 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.712 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.712 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.713 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.713 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:34:27.713 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.713 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.713 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.714 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.714 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:34:27.714 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.714 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.715 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.715 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.715 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.715 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.715 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.716 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.716 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:34:27.716 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.716 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.717 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.717 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.717 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:34:27.717 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.717 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.718 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.718 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.718 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.718 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.719 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.719 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.719 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:34:27.719 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.720 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.720 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:34:27.720 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:34:27.721 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.721 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.721 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.721 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:34:27.722 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:34:27.722 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:34:27.722 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:34:27.722 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.722 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.723 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.723 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.723 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.723 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:27.724 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:34:27.724 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.724 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.724 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.724 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.725 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.725 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.725 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.725 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:27.726 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.726 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.726 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.726 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.726 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.727 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.727 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:34:27.727 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.728 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.728 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:34:27.728 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.728 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.729 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.729 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.729 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.729 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.730 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.730 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:34:27.730 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.730 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.730 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.731 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.731 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:34:27.731 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.731 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.731 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.732 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.732 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.732 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.732 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.732 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.733 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:34:27.733 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.733 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.733 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.733 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.734 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:34:27.734 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.734 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.734 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.734 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.735 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.735 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.735 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.735 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.736 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:34:27.736 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.736 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.736 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.737 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.737 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:34:27.737 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:34:27.737 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.737 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.738 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.738 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:34:27.738 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:34:27.738 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:34:27.739 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:34:27.739 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.739 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.740 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.740 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.740 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.740 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.741 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:27.741 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:34:27.741 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:34:27.741 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:34:27.741 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:34:27.742 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:34:27.742 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:34:27.742 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:34:27.742 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:34:27.743 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 99, 2021-11-15T19:34:27.743 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:34:27.743 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:34:27.744 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:34:27.744 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.744 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.744 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.745 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:34:27.745 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.745 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.745 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.746 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.746 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:34:27.746 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.746 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.746 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.747 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.747 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:34:27.747 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.747 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.747 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.748 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:34:27.748 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.748 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.748 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.748 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.749 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:34:27.749 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.749 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.749 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.750 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.750 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:34:27.750 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.750 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.750 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.751 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:34:27.751 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.751 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.751 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.752 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.752 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:34:27.752 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.752 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.752 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.753 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.753 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:34:27.753 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:34:27.753 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.753 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:34:27.754 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:34:27.754 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.754 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.754 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.754 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:34:27.755 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:34:27.755 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:34:27.755 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.755 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.756 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.756 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:34:27.756 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:34:27.756 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:34:27.756 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:34:27.757 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:34:27.757 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:34:27.757 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:34:27.757 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:27.757 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.758 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:27.758 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:34:27.758 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.758 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:34:27.759 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.759 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.759 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.759 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.759 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.760 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:34:27.760 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.760 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.760 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.761 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:34:27.761 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.761 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.761 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.761 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.762 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.762 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:34:27.762 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.762 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.762 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.763 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:34:27.763 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.763 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.763 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.764 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.764 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.764 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:34:27.764 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.764 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.765 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.765 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:34:27.765 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.765 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.766 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.766 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.766 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.766 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:34:27.766 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.767 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.767 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.767 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:34:27.767 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.768 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.768 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.768 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.768 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.768 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:34:27.769 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.769 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.769 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.769 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:34:27.769 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.770 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.770 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.770 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.770 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.771 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:34:27.771 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.771 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.771 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.771 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:34:27.772 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.772 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.772 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.772 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.773 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.773 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:34:27.773 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.773 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.773 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:27.774 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:34:27.774 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:34:27.774 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:34:27.774 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:34:27.775 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:34:27.775 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:34:27.775 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:34:27.775 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:34:27.775 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.776 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:34:27.776 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:34:27.776 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:34:27.776 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:34:27.777 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:34:27.777 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:34:27.777 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.111:6835/1523710751": "2021-11-16T19:34:21.081358+0000", 2021-11-15T19:34:27.777 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.111:6834/1523710751": "2021-11-16T19:34:21.081358+0000", 2021-11-15T19:34:27.777 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/2486512308": "2021-11-16T19:34:12.506218+0000", 2021-11-15T19:34:27.778 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/2486512308": "2021-11-16T19:34:12.506218+0000" 2021-11-15T19:34:27.778 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.778 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:34:27.778 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:34:27.779 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:34:27.779 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:34:27.779 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:34:27.779 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:34:27.779 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:34:27.780 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:34:27.780 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:27.780 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:27.780 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:34:27.780 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:34:27.781 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:34:27.781 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:34:27.781 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:34:27.781 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:27.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3dc053580 msgr2=0x7fd3dc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3dc053580 0x7fd3dc055a40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fd3f8002f70 tx=0x7fd3f8015000).stop 2021-11-15T19:34:27.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 msgr2=0x7fd3fc112d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc112d00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fd3ec002f70 tx=0x7fd3ec006db0).stop 2021-11-15T19:34:27.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 shutdown_connections 2021-11-15T19:34:27.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd3dc053580 0x7fd3dc055a40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd3fc0b00a0 0x7fd3fc1182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd3fc0adda0 0x7fd3fc112d00 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 --2- 172.21.2.137:0/3908838039 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd3fc05d220 0x7fd3fc066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 >> 172.21.2.137:0/3908838039 conn(0x7fd3fc0630f0 msgr2=0x7fd3fc0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 shutdown_connections 2021-11-15T19:34:27.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.573+0000 7fd403d08700 1 -- 172.21.2.137:0/3908838039 wait complete. 2021-11-15T19:34:27.786 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:27.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.829+0000 7f46c88e5700 1 Processor -- start 2021-11-15T19:34:27.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.829+0000 7f46c88e5700 1 -- start start 2021-11-15T19:34:27.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f46c40af2f0 0x7f46c4143290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40aecf0 con 0x7f46c40b1180 2021-11-15T19:34:27.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c413f180 con 0x7f46c40acab0 2021-11-15T19:34:27.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c4143780 con 0x7f46c40af2f0 2021-11-15T19:34:27.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f46c40af2f0 0x7f46c4143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c259c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f46c40acab0 0x7f46c40b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57442/0 (socket says 172.21.2.137:57442) 2021-11-15T19:34:27.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c259c700 1 -- 172.21.2.137:0/1993750821 learned_addr learned my addr 172.21.2.137:0/1993750821 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:27.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c2d9d700 1 -- 172.21.2.137:0/1993750821 >> v1:172.21.2.137:6789/0 conn(0x7f46c40acab0 legacy=0x7f46c40b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c2d9d700 1 -- 172.21.2.137:0/1993750821 >> v1:172.21.2.111:6789/0 conn(0x7f46c40b1180 legacy=0x7f46c4142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:27.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c2d9d700 1 -- 172.21.2.137:0/1993750821 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40aef20 con 0x7f46c40af2f0 2021-11-15T19:34:27.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c2d9d700 1 --2- 172.21.2.137:0/1993750821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c4143290 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f46c40b2bd0 tx=0x7f46b40091d0).ready entity=mon.1 client_cookie=2e82472f1c165397 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c159a700 1 -- 172.21.2.137:0/1993750821 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b4009ea0 con 0x7f46c40af2f0 2021-11-15T19:34:27.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c159a700 1 -- 172.21.2.137:0/1993750821 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400b860 con 0x7f46c40af2f0 2021-11-15T19:34:27.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c159a700 1 -- 172.21.2.137:0/1993750821 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b400b9d0 con 0x7f46c40af2f0 2021-11-15T19:34:27.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/1993750821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 msgr2=0x7f46c4143290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 --2- 172.21.2.137:0/1993750821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c4143290 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f46c40b2bd0 tx=0x7f46b40091d0).stop 2021-11-15T19:34:27.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/1993750821 shutdown_connections 2021-11-15T19:34:27.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 --2- 172.21.2.137:0/1993750821 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c4143290 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/1993750821 >> 172.21.2.137:0/1993750821 conn(0x7f46c40630f0 msgr2=0x7f46c40634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/1993750821 shutdown_connections 2021-11-15T19:34:27.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/1993750821 wait complete. 2021-11-15T19:34:27.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 Processor -- start 2021-11-15T19:34:27.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- start start 2021-11-15T19:34:27.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46c40acab0 0x7f46c4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c413df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c40b1180 0x7f46c410f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4065e40 con 0x7f46c40b1180 2021-11-15T19:34:27.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4063f50 con 0x7f46c40af2f0 2021-11-15T19:34:27.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c414a8e0 con 0x7f46c40acab0 2021-11-15T19:34:27.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c413df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c413df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38668/0 (socket says 172.21.2.137:38668) 2021-11-15T19:34:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 -- 172.21.2.137:0/4137942920 learned_addr learned my addr 172.21.2.137:0/4137942920 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 -- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46c40acab0 msgr2=0x7f46c4155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46c40acab0 0x7f46c4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 -- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c40b1180 msgr2=0x7f46c410f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c40b1180 0x7f46c410f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 -- 172.21.2.137:0/4137942920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009470 con 0x7f46c40af2f0 2021-11-15T19:34:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c1d9b700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c413df00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f46bc002ef0 tx=0x7f46bc006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46bc012410 con 0x7f46c40af2f0 2021-11-15T19:34:27.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc012570 con 0x7f46c40af2f0 2021-11-15T19:34:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c4064460 con 0x7f46c40af2f0 2021-11-15T19:34:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46bc0128d0 con 0x7f46c40af2f0 2021-11-15T19:34:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.833+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c410f9d0 con 0x7f46c40af2f0 2021-11-15T19:34:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c4065fb0 con 0x7f46c40af2f0 2021-11-15T19:34:27.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46bc00f030 con 0x7f46c40af2f0 2021-11-15T19:34:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46bb7fe700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a8053610 0x7f46a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f46bc06b4f0 con 0x7f46c40af2f0 2021-11-15T19:34:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46c259c700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a8053610 0x7f46a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:27.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46c259c700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a8053610 0x7f46a8055ad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f46c40b2c70 tx=0x7f46ac0077d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:27.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.837+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46c4065fb0 con 0x7f46c40af2f0 2021-11-15T19:34:27.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.945+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46c4065fb0 con 0x7f46c40af2f0 2021-11-15T19:34:27.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.945+0000 7f46bb7fe700 1 -- 172.21.2.137:0/4137942920 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f46c4065fb0 con 0x7f46c40af2f0 2021-11-15T19:34:27.957 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:27.957 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/381070964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":381070964},{"type":"v1","addr":"172.21.2.111:6835","nonce":381070964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[]} 2021-11-15T19:34:27.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.945+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a8053610 msgr2=0x7f46a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.945+0000 7f46c88e5700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a8053610 0x7f46a8055ad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f46c40b2c70 tx=0x7f46ac0077d0).stop 2021-11-15T19:34:27.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.945+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 msgr2=0x7f46c413df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:27.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.945+0000 7f46c88e5700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c413df00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f46bc002ef0 tx=0x7f46bc006d50).stop 2021-11-15T19:34:27.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 shutdown_connections 2021-11-15T19:34:27.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a8053610 0x7f46a8055ad0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c40b1180 0x7f46c410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c40af2f0 0x7f46c413df00 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:27.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 --2- 172.21.2.137:0/4137942920 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46c40acab0 0x7f46c4155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:27.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 >> 172.21.2.137:0/4137942920 conn(0x7f46c40630f0 msgr2=0x7f46c4069680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:27.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 shutdown_connections 2021-11-15T19:34:27.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:27.949+0000 7f46c88e5700 1 -- 172.21.2.137:0/4137942920 wait complete. 2021-11-15T19:34:27.962 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 54 2021-11-15T19:34:27.964 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 Processor -- start 2021-11-15T19:34:28.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- start start 2021-11-15T19:34:28.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300b1340 0x7fee30147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fee30143f00 0x7fee30144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee30148190 con 0x7fee300a9f50 2021-11-15T19:34:28.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300b1720 con 0x7fee30143f00 2021-11-15T19:34:28.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee30147e70 con 0x7fee300b1340 2021-11-15T19:34:28.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fee30143f00 0x7fee30144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fee30143f00 0x7fee30144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38678/0 (socket says 172.21.2.137:38678) 2021-11-15T19:34:28.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 -- 172.21.2.137:0/274929440 learned_addr learned my addr 172.21.2.137:0/274929440 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:28.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 -- 172.21.2.137:0/274929440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300b1340 msgr2=0x7fee30147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:28.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 --2- 172.21.2.137:0/274929440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300b1340 0x7fee30147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:28.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 -- 172.21.2.137:0/274929440 >> v1:172.21.2.111:6789/0 conn(0x7fee300a9f50 legacy=0x7fee300aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:28.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 -- 172.21.2.137:0/274929440 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300af800 con 0x7fee30143f00 2021-11-15T19:34:28.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2e59c700 1 --2- 172.21.2.137:0/274929440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee30144360 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fee3005cfa0 tx=0x7fee20006eb0).ready entity=mon.1 client_cookie=97d31f8bec2e29bf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:28.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2dd9b700 1 -- 172.21.2.137:0/274929440 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2000d570 con 0x7fee30143f00 2021-11-15T19:34:28.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2dd9b700 1 -- 172.21.2.137:0/274929440 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee20000e90 con 0x7fee30143f00 2021-11-15T19:34:28.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee2dd9b700 1 -- 172.21.2.137:0/274929440 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2000d8c0 con 0x7fee30143f00 2021-11-15T19:34:28.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- 172.21.2.137:0/274929440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 msgr2=0x7fee30144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- 172.21.2.137:0/274929440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee30144360 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fee3005cfa0 tx=0x7fee20006eb0).stop 2021-11-15T19:34:28.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- 172.21.2.137:0/274929440 shutdown_connections 2021-11-15T19:34:28.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- 172.21.2.137:0/274929440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee30144360 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- 172.21.2.137:0/274929440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300b1340 0x7fee30147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:28.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- 172.21.2.137:0/274929440 >> 172.21.2.137:0/274929440 conn(0x7fee300b4e60 msgr2=0x7fee300b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:28.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- 172.21.2.137:0/274929440 shutdown_connections 2021-11-15T19:34:28.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- 172.21.2.137:0/274929440 wait complete. 2021-11-15T19:34:28.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 Processor -- start 2021-11-15T19:34:28.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- start start 2021-11-15T19:34:28.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300a9f50 0x7fee300b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee300b1340 0x7fee30148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee301567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.005+0000 7fee35097700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee301485b0 con 0x7fee300b1340 2021-11-15T19:34:28.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee35097700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee30148850 con 0x7fee30143f00 2021-11-15T19:34:28.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee35097700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3014b280 con 0x7fee300a9f50 2021-11-15T19:34:28.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee301567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee301567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38682/0 (socket says 172.21.2.137:38682) 2021-11-15T19:34:28.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 -- 172.21.2.137:0/3367766648 learned_addr learned my addr 172.21.2.137:0/3367766648 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:28.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 -- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300a9f50 msgr2=0x7fee300b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300a9f50 0x7fee300b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:28.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 -- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee300b1340 msgr2=0x7fee30148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee300b1340 0x7fee30148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:28.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 -- 172.21.2.137:0/3367766648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2000b1e0 con 0x7fee30143f00 2021-11-15T19:34:28.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2f59e700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee301567a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fee28003270 tx=0x7fee280090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:28.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2800d4a0 con 0x7fee30143f00 2021-11-15T19:34:28.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2800d600 con 0x7fee30143f00 2021-11-15T19:34:28.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2800d960 con 0x7fee30143f00 2021-11-15T19:34:28.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee300aea80 con 0x7fee30143f00 2021-11-15T19:34:28.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee30149380 con 0x7fee30143f00 2021-11-15T19:34:28.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee300aad50 con 0x7fee30143f00 2021-11-15T19:34:28.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee28018030 con 0x7fee30143f00 2021-11-15T19:34:28.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee27fff700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee140536d0 0x7fee14055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fee2806af30 con 0x7fee30143f00 2021-11-15T19:34:28.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.009+0000 7fee2ed9d700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee140536d0 0x7fee14055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.013+0000 7fee2ed9d700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee140536d0 0x7fee14055b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fee18002f70 tx=0x7fee180069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:28.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.013+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee280423d0 con 0x7fee30143f00 2021-11-15T19:34:28.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.121+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee3005faf0 con 0x7fee30143f00 2021-11-15T19:34:28.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.121+0000 7fee27fff700 1 -- 172.21.2.137:0/3367766648 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fee280459f0 con 0x7fee30143f00 2021-11-15T19:34:28.133 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:28.134 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/381070964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":381070964},{"type":"v1","addr":"172.21.2.111:6835","nonce":381070964}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54},{"gid":5157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/2062762060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":2062762060},{"type":"v1","addr":"172.21.2.137:6833","nonce":2062762060}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[]} 2021-11-15T19:34:28.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee140536d0 msgr2=0x7fee14055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee140536d0 0x7fee14055b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fee18002f70 tx=0x7fee180069e0).stop 2021-11-15T19:34:28.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 msgr2=0x7fee301567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee301567a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fee28003270 tx=0x7fee280090f0).stop 2021-11-15T19:34:28.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 shutdown_connections 2021-11-15T19:34:28.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fee140536d0 0x7fee14055b90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fee30143f00 0x7fee301567a0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fee300b1340 0x7fee30148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:28.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 --2- 172.21.2.137:0/3367766648 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fee300a9f50 0x7fee300b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:28.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 >> 172.21.2.137:0/3367766648 conn(0x7fee300b4e60 msgr2=0x7fee30145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:28.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 shutdown_connections 2021-11-15T19:34:28.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.125+0000 7fee35097700 1 -- 172.21.2.137:0/3367766648 wait complete. 2021-11-15T19:34:28.138 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 54 2021-11-15T19:34:28.141 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:34:28.141 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:34:28.142 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:34:28.142 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:34:28.142 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:34:28.143 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:34:28.143 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:34:28.143 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:34:28.147 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:34:28.147 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:34:28.154 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:34:28.155 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:34:28.191 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:34:28.191 DEBUG:teuthology.parallel:result is None 2021-11-15T19:34:28.197 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:34:28.198 DEBUG:teuthology.parallel:result is None 2021-11-15T19:34:28.198 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:34:28.236 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:34:28.240 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:34:28.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 Processor -- start 2021-11-15T19:34:28.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 -- start start 2021-11-15T19:34:28.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff4600b2400 0x7ff4600b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b5330 0x7ff4600b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff460146c20 con 0x7ff4600b3e70 2021-11-15T19:34:28.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff460142af0 con 0x7ff4600b2400 2021-11-15T19:34:28.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.257+0000 7ff465c91700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600b27e0 con 0x7ff4600b5330 2021-11-15T19:34:28.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45effd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b5330 0x7ff4600b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7ff4600b3e70 0x7ff4600b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:49976/0 (socket says 172.21.2.137:49976) 2021-11-15T19:34:28.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 -- 172.21.2.137:0/2584022965 learned_addr learned my addr 172.21.2.137:0/2584022965 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:28.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 --2- 172.21.2.137:0/2584022965 >> v2:172.21.2.111:3300/0 conn(0x7ff4600b2400 0x7ff4600b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 -- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b5330 msgr2=0x7ff4600b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:28.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 --2- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b5330 0x7ff4600b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 -- 172.21.2.137:0/2584022965 >> v1:172.21.2.111:6789/0 conn(0x7ff4600b3e70 legacy=0x7ff4600b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 -- 172.21.2.137:0/2584022965 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600b4d80 con 0x7ff4600b2400 2021-11-15T19:34:28.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 --2- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b2400 0x7ff4600b2a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff448002f70 tx=0x7ff448006df0).ready entity=mon.0 client_cookie=46756bb0740dc164 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:28.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45e7fc700 1 -- 172.21.2.137:0/2584022965 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff44800d570 con 0x7ff4600b2400 2021-11-15T19:34:28.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45e7fc700 1 -- 172.21.2.137:0/2584022965 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448000e90 con 0x7ff4600b2400 2021-11-15T19:34:28.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45e7fc700 1 -- 172.21.2.137:0/2584022965 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff44800d8c0 con 0x7ff4600b2400 2021-11-15T19:34:28.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b2400 msgr2=0x7ff4600b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 --2- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b2400 0x7ff4600b2a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff448002f70 tx=0x7ff448006df0).stop 2021-11-15T19:34:28.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/2584022965 shutdown_connections 2021-11-15T19:34:28.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 --2- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b5330 0x7ff4600b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 --2- 172.21.2.137:0/2584022965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b2400 0x7ff4600b2a90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/2584022965 >> 172.21.2.137:0/2584022965 conn(0x7ff4600623a0 msgr2=0x7ff460062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:28.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/2584022965 shutdown_connections 2021-11-15T19:34:28.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/2584022965 wait complete. 2021-11-15T19:34:28.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 Processor -- start 2021-11-15T19:34:28.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- start start 2021-11-15T19:34:28.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b2400 0x7ff460144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b3e70 0x7ff4601556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 0x7ff460115540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff460113b70 con 0x7ff4600b3e70 2021-11-15T19:34:28.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4601138a0 con 0x7ff4600b5330 2021-11-15T19:34:28.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff460115050 con 0x7ff4600b2400 2021-11-15T19:34:28.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 0x7ff460115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 0x7ff460115540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38708/0 (socket says 172.21.2.137:38708) 2021-11-15T19:34:28.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 -- 172.21.2.137:0/1635038433 learned_addr learned my addr 172.21.2.137:0/1635038433 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:28.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45effd700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b3e70 0x7ff4601556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45f7fe700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b2400 0x7ff460144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 -- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b2400 msgr2=0x7ff460144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b2400 0x7ff460144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 -- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b3e70 msgr2=0x7ff4601556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:28.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b3e70 0x7ff4601556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:28.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 -- 172.21.2.137:0/1635038433 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44800b180 con 0x7ff4600b5330 2021-11-15T19:34:28.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45ffff700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 0x7ff460115540 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7ff460063210 tx=0x7ff450007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:28.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff450005ba0 con 0x7ff4600b5330 2021-11-15T19:34:28.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4600af670 con 0x7ff4600b5330 2021-11-15T19:34:28.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450005d00 con 0x7ff4600b5330 2021-11-15T19:34:28.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff460112c50 con 0x7ff4600b5330 2021-11-15T19:34:28.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.261+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4500072c0 con 0x7ff4600b5330 2021-11-15T19:34:28.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff438003410 con 0x7ff4600b5330 2021-11-15T19:34:28.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff450010070 con 0x7ff4600b5330 2021-11-15T19:34:28.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff45cff9700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4440535b0 0x7ff444055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:28.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5421+0+0 (secure 0 0 0) 0x7ff45006af90 con 0x7ff4600b5330 2021-11-15T19:34:28.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff45f7fe700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4440535b0 0x7ff444055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:28.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff45f7fe700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4440535b0 0x7ff444055a70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ff44801a000 tx=0x7ff448014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:28.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.265+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff450042270 con 0x7ff4600b5330 2021-11-15T19:34:28.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:28.357+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff438003c40 con 0x7ff4600b5330 2021-11-15T19:34:29.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff45cff9700 1 -- 172.21.2.137:0/1635038433 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff450045890 con 0x7ff4600b5330 2021-11-15T19:34:29.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4440535b0 msgr2=0x7ff444055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4440535b0 0x7ff444055a70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ff44801a000 tx=0x7ff448014000).stop 2021-11-15T19:34:29.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 msgr2=0x7ff460115540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 0x7ff460115540 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7ff460063210 tx=0x7ff450007f00).stop 2021-11-15T19:34:29.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 shutdown_connections 2021-11-15T19:34:29.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff4440535b0 0x7ff444055a70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff4600b5330 0x7ff460115540 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff4600b3e70 0x7ff4601556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 --2- 172.21.2.137:0/1635038433 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff4600b2400 0x7ff460144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 >> 172.21.2.137:0/1635038433 conn(0x7ff4600623a0 msgr2=0x7ff46005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 shutdown_connections 2021-11-15T19:34:29.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.349+0000 7ff465c91700 1 -- 172.21.2.137:0/1635038433 wait complete. 2021-11-15T19:34:29.364 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:34:29.367 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:34:29.367 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:34:29.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 Processor -- start 2021-11-15T19:34:29.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 -- start start 2021-11-15T19:34:29.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14640acab0 0x7f14640b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f14640b1180 0x7f14640b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640af2f0 0x7f1464142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14640aecf0 con 0x7f14640b1180 2021-11-15T19:34:29.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146413f180 con 0x7f14640acab0 2021-11-15T19:34:29.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.409+0000 7f146bbe1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14640aef20 con 0x7f14640af2f0 2021-11-15T19:34:29.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14640acab0 0x7f14640b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f14640acab0 0x7f14640b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38716/0 (socket says 172.21.2.137:38716) 2021-11-15T19:34:29.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1721988530 learned_addr learned my addr 172.21.2.137:0/1721988530 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:29.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1721988530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640af2f0 msgr2=0x7f1464142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- 172.21.2.137:0/1721988530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640af2f0 0x7f1464142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1721988530 >> v2:172.21.2.111:3300/0 conn(0x7f14640b1180 msgr2=0x7f14640b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- 172.21.2.137:0/1721988530 >> v2:172.21.2.111:3300/0 conn(0x7f14640b1180 0x7f14640b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1721988530 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640ace90 con 0x7f14640acab0 2021-11-15T19:34:29.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- 172.21.2.137:0/1721988530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14640b2060 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f1460002f70 tx=0x7f1460006eb0).ready entity=mon.1 client_cookie=524a16b7330b90e7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146897b700 1 -- 172.21.2.137:0/1721988530 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1460010b60 con 0x7f14640acab0 2021-11-15T19:34:29.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146897b700 1 -- 172.21.2.137:0/1721988530 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460000e90 con 0x7f14640acab0 2021-11-15T19:34:29.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146897b700 1 -- 172.21.2.137:0/1721988530 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14600183d0 con 0x7f14640acab0 2021-11-15T19:34:29.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- 172.21.2.137:0/1721988530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 msgr2=0x7f14640b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1721988530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14640b2060 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f1460002f70 tx=0x7f1460006eb0).stop 2021-11-15T19:34:29.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- 172.21.2.137:0/1721988530 shutdown_connections 2021-11-15T19:34:29.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1721988530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640af2f0 0x7f1464142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1721988530 >> v2:172.21.2.111:3300/0 conn(0x7f14640b1180 0x7f14640b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1721988530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14640b2060 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- 172.21.2.137:0/1721988530 >> 172.21.2.137:0/1721988530 conn(0x7f14640630f0 msgr2=0x7f14640634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- 172.21.2.137:0/1721988530 shutdown_connections 2021-11-15T19:34:29.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- 172.21.2.137:0/1721988530 wait complete. 2021-11-15T19:34:29.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 Processor -- start 2021-11-15T19:34:29.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- start start 2021-11-15T19:34:29.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14641195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14640af2f0 0x7f1464118a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640b1180 0x7f1464118f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14641175b0 con 0x7f14640af2f0 2021-11-15T19:34:29.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464117850 con 0x7f14640acab0 2021-11-15T19:34:29.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464117af0 con 0x7f14640b1180 2021-11-15T19:34:29.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14641195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14641195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38726/0 (socket says 172.21.2.137:38726) 2021-11-15T19:34:29.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1971406753 learned_addr learned my addr 172.21.2.137:0/1971406753 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:29.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640b1180 msgr2=0x7f1464118f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640b1180 0x7f1464118f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14640af2f0 msgr2=0x7f1464118a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14640af2f0 0x7f1464118a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 -- 172.21.2.137:0/1971406753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146000b1e0 con 0x7f14640acab0 2021-11-15T19:34:29.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146997d700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14641195f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f1460002f70 tx=0x7f1460017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1460019680 con 0x7f14640acab0 2021-11-15T19:34:29.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14600197e0 con 0x7f14640acab0 2021-11-15T19:34:29.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146413ca50 con 0x7f14640acab0 2021-11-15T19:34:29.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.413+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1460019b40 con 0x7f14640acab0 2021-11-15T19:34:29.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1464117ec0 con 0x7f14640acab0 2021-11-15T19:34:29.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14640573d0 con 0x7f14640acab0 2021-11-15T19:34:29.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f146002a070 con 0x7f14640acab0 2021-11-15T19:34:29.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f1452ffd700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1444053660 0x7f1444055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f146006c510 con 0x7f14640acab0 2021-11-15T19:34:29.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f146917c700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1444053660 0x7f1444055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f146917c700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1444053660 0x7f1444055b20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f1454002f70 tx=0x7f1454006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.417+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1460043890 con 0x7f14640acab0 2021-11-15T19:34:29.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.529+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f14640b2840 con 0x7f14640acab0 2021-11-15T19:34:29.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.529+0000 7f1452ffd700 1 -- 172.21.2.137:0/1971406753 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f1460046eb0 con 0x7f14640acab0 2021-11-15T19:34:29.542 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:29.542 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:29.542 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:34:29.543 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.543 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:34:29.543 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:34:29.543 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.543 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:29.544 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.544 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.544 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.544 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.545 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.545 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.545 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:34:29.545 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:34:29.545 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.546 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:29.546 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.546 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.546 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.547 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.547 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.547 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.547 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:34:29.547 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:34:29.548 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.548 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.548 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.548 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.549 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.549 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.549 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.549 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:34:29.549 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:34:29.550 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.550 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.550 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.550 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.551 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.551 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.551 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.551 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:34:29.552 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:34:29.552 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.552 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.552 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.553 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.553 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.553 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.553 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.554 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:34:29.554 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:34:29.554 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.554 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.554 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.555 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.555 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.555 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.555 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.556 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:34:29.556 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:34:29.556 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.556 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.556 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.557 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.557 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.557 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.557 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.557 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:34:29.558 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:34:29.558 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.558 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.558 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.559 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.559 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.559 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.559 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.560 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:34:29.560 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:34:29.560 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.560 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.560 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.561 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.561 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.561 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.561 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.561 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:34:29.562 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:34:29.562 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.562 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.562 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.563 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.563 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.563 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.563 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.563 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:34:29.564 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:34:29.564 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.564 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:29.564 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:34:29.565 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:34:29.565 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.565 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.565 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.565 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:34:29.566 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:34:29.566 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.566 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:29.566 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:34:29.567 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:34:29.567 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.567 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.567 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.567 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:34:29.568 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:34:29.568 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.568 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:34:29.568 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:34:29.568 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:34:29.569 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.569 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.569 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.569 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:34:29.570 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:34:29.570 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.570 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:34:29.570 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:34:29.570 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:34:29.571 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.571 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.571 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.571 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.572 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:34:29.572 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:34:29.572 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.572 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:34:29.572 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:34:29.573 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.573 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.573 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:29.573 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:29.573 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:34:29.574 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:34:29.574 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:34:29.574 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:34:29.574 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:34:29.575 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:34:29.575 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.575 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:29.575 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:29.575 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:29.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1444053660 msgr2=0x7f1444055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1444053660 0x7f1444055b20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f1454002f70 tx=0x7f1454006a10).stop 2021-11-15T19:34:29.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 msgr2=0x7f14641195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14641195f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f1460002f70 tx=0x7f1460017000).stop 2021-11-15T19:34:29.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 shutdown_connections 2021-11-15T19:34:29.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1444053660 0x7f1444055b20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14640b1180 0x7f1464118f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14640af2f0 0x7f1464118a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 --2- 172.21.2.137:0/1971406753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f14640acab0 0x7f14641195f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 >> 172.21.2.137:0/1971406753 conn(0x7f14640630f0 msgr2=0x7f1464069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 shutdown_connections 2021-11-15T19:34:29.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.533+0000 7f146bbe1700 1 -- 172.21.2.137:0/1971406753 wait complete. 2021-11-15T19:34:29.581 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:29.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 Processor -- start 2021-11-15T19:34:29.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- start start 2021-11-15T19:34:29.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa3d00b25c0 0x7fa3d0060e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d005ff60 con 0x7fa3d00b0c30 2021-11-15T19:34:29.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d005fcc0 con 0x7fa3d014b230 2021-11-15T19:34:29.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d014a680 con 0x7fa3d00b25c0 2021-11-15T19:34:29.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d698b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa3d014b230 0x7fa3d00af3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57512/0 (socket says 172.21.2.137:57512) 2021-11-15T19:34:29.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d698b700 1 -- 172.21.2.137:0/2324312146 learned_addr learned my addr 172.21.2.137:0/2324312146 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:29.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d618a700 1 --2- 172.21.2.137:0/2324312146 >> v2:172.21.2.137:3300/0 conn(0x7fa3d00b25c0 0x7fa3d0060e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d618a700 1 -- 172.21.2.137:0/2324312146 >> v1:172.21.2.137:6789/0 conn(0x7fa3d014b230 legacy=0x7fa3d00af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d618a700 1 -- 172.21.2.137:0/2324312146 >> v1:172.21.2.111:6789/0 conn(0x7fa3d00b0c30 legacy=0x7fa3d014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d618a700 1 -- 172.21.2.137:0/2324312146 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d005f940 con 0x7fa3d00b25c0 2021-11-15T19:34:29.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d618a700 1 --2- 172.21.2.137:0/2324312146 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b25c0 0x7fa3d0060e30 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fa3d014aa00 tx=0x7fa3cc006df0).ready entity=mon.1 client_cookie=2aac42e07c04e577 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d5188700 1 -- 172.21.2.137:0/2324312146 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3cc00d5c0 con 0x7fa3d00b25c0 2021-11-15T19:34:29.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d5188700 1 -- 172.21.2.137:0/2324312146 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc000e90 con 0x7fa3d00b25c0 2021-11-15T19:34:29.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d5188700 1 -- 172.21.2.137:0/2324312146 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3cc00d910 con 0x7fa3d00b25c0 2021-11-15T19:34:29.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- 172.21.2.137:0/2324312146 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b25c0 msgr2=0x7fa3d0060e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/2324312146 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b25c0 0x7fa3d0060e30 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fa3d014aa00 tx=0x7fa3cc006df0).stop 2021-11-15T19:34:29.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- 172.21.2.137:0/2324312146 shutdown_connections 2021-11-15T19:34:29.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/2324312146 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b25c0 0x7fa3d0060e30 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- 172.21.2.137:0/2324312146 >> 172.21.2.137:0/2324312146 conn(0x7fa3d0063980 msgr2=0x7fa3d0063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- 172.21.2.137:0/2324312146 shutdown_connections 2021-11-15T19:34:29.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- 172.21.2.137:0/2324312146 wait complete. 2021-11-15T19:34:29.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 Processor -- start 2021-11-15T19:34:29.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.625+0000 7fa3d83ee700 1 -- start start 2021-11-15T19:34:29.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 0x7fa3d0066dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa3d00b25c0 0x7fa3d015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa3d014b230 0x7fa3d015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0146c00 con 0x7fa3d00b25c0 2021-11-15T19:34:29.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0110790 con 0x7fa3d00b0c30 2021-11-15T19:34:29.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0146e50 con 0x7fa3d014b230 2021-11-15T19:34:29.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 0x7fa3d0066dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 0x7fa3d0066dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38736/0 (socket says 172.21.2.137:38736) 2021-11-15T19:34:29.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 -- 172.21.2.137:0/1392644364 learned_addr learned my addr 172.21.2.137:0/1392644364 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:29.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 -- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa3d014b230 msgr2=0x7fa3d015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa3d014b230 0x7fa3d015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 -- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa3d00b25c0 msgr2=0x7fa3d015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa3d00b25c0 0x7fa3d015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 -- 172.21.2.137:0/1392644364 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc00b180 con 0x7fa3d00b0c30 2021-11-15T19:34:29.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d618a700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 0x7fa3d0066dc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fa3d014aa00 tx=0x7fa3cc012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3cc016070 con 0x7fa3d00b0c30 2021-11-15T19:34:29.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00de30 con 0x7fa3d00b0c30 2021-11-15T19:34:29.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3cc01e450 con 0x7fa3d00b0c30 2021-11-15T19:34:29.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d01470f0 con 0x7fa3d00b0c30 2021-11-15T19:34:29.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d0142430 con 0x7fa3d00b0c30 2021-11-15T19:34:29.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d01472b0 con 0x7fa3d00b0c30 2021-11-15T19:34:29.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3cc00f030 con 0x7fa3d00b0c30 2021-11-15T19:34:29.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3c37fe700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa3b00536a0 0x7fa3b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa3cc06c5b0 con 0x7fa3d00b0c30 2021-11-15T19:34:29.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d5989700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa3b00536a0 0x7fa3b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.629+0000 7fa3d5989700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa3b00536a0 0x7fa3b0055b60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa3c4002f90 tx=0x7fa3c40069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.633+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3cc043930 con 0x7fa3d00b0c30 2021-11-15T19:34:29.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d0141300 con 0x7fa3d00b0c30 2021-11-15T19:34:29.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3c37fe700 1 -- 172.21.2.137:0/1392644364 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+13183 (secure 0 0 0) 0x7fa3cc023090 con 0x7fa3d00b0c30 2021-11-15T19:34:29.727 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:29.728 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":108,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:29.343457+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:29.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa3b00536a0 msgr2=0x7fa3b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa3b00536a0 0x7fa3b0055b60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa3c4002f90 tx=0x7fa3c40069b0).stop 2021-11-15T19:34:29.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 msgr2=0x7fa3d0066dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 0x7fa3d0066dc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fa3d014aa00 tx=0x7fa3cc012000).stop 2021-11-15T19:34:29.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 shutdown_connections 2021-11-15T19:34:29.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa3b00536a0 0x7fa3b0055b60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa3d014b230 0x7fa3d015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa3d00b25c0 0x7fa3d015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 --2- 172.21.2.137:0/1392644364 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa3d00b0c30 0x7fa3d0066dc0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 >> 172.21.2.137:0/1392644364 conn(0x7fa3d0063980 msgr2=0x7fa3d00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 shutdown_connections 2021-11-15T19:34:29.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.717+0000 7fa3d83ee700 1 -- 172.21.2.137:0/1392644364 wait complete. 2021-11-15T19:34:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:34:29.736 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:34:29.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 Processor -- start 2021-11-15T19:34:29.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 -- start start 2021-11-15T19:34:29.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f91a00afde0 0x7f91a00acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a013f5c0 0x7f91a013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a00aedf0 con 0x7f91a00b0fe0 2021-11-15T19:34:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00ae070 con 0x7f91a00afde0 2021-11-15T19:34:29.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a6d0d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00afbd0 con 0x7f91a013f5c0 2021-11-15T19:34:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a4aa9700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f91a00b0fe0 0x7f91a00af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57526/0 (socket says 172.21.2.137:57526) 2021-11-15T19:34:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a4aa9700 1 -- 172.21.2.137:0/2749119696 learned_addr learned my addr 172.21.2.137:0/2749119696 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532691016 0 0) 0x7f91a00aedf0 con 0x7f91a00b0fe0 2021-11-15T19:34:29.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9180003260 con 0x7f91a00b0fe0 2021-11-15T19:34:29.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723735685 0 0) 0x7f9180003260 con 0x7f91a00b0fe0 2021-11-15T19:34:29.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a013f5c0 msgr2=0x7f91a013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a013f5c0 0x7f91a013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 >> v2:172.21.2.111:3300/0 conn(0x7f91a00afde0 msgr2=0x7f91a00acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 --2- 172.21.2.137:0/2749119696 >> v2:172.21.2.111:3300/0 conn(0x7f91a00afde0 0x7f91a00acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00b13c0 con 0x7f91a00b0fe0 2021-11-15T19:34:29.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9188001660 con 0x7f91a00b0fe0 2021-11-15T19:34:29.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 >> v1:172.21.2.137:6789/0 conn(0x7f91a00b0fe0 legacy=0x7f91a00af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91800037d0 0x7f9180003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a013f5c0 0x7f9180004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f9180004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00ae070 con 0x7f91800037d0 2021-11-15T19:34:29.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00afbd0 con 0x7f91800049f0 2021-11-15T19:34:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918000fe40 con 0x7f91a013f5c0 2021-11-15T19:34:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a52aa700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f9180004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a52aa700 1 -- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a013f5c0 msgr2=0x7f9180004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a52aa700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a013f5c0 0x7f9180004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a52aa700 1 -- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91800037d0 msgr2=0x7f9180003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a52aa700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91800037d0 0x7f9180003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.777+0000 7f91a52aa700 1 -- 172.21.2.137:0/2749119696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9180003260 con 0x7f91800049f0 2021-11-15T19:34:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a52aa700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f9180004e70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f91980032f0 tx=0x7f9198006f90).ready entity=mon.1 client_cookie=95fe39ec73232943 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f919800b460 con 0x7f91800049f0 2021-11-15T19:34:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800b5c0 con 0x7f91800049f0 2021-11-15T19:34:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f919f7fe700 1 -- 172.21.2.137:0/2749119696 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f919800b730 con 0x7f91800049f0 2021-11-15T19:34:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/2749119696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 msgr2=0x7f9180004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/2749119696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f9180004e70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f91980032f0 tx=0x7f9198006f90).stop 2021-11-15T19:34:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a52aa700 1 -- 172.21.2.137:0/2749119696 reap_dead start 2021-11-15T19:34:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/2749119696 shutdown_connections 2021-11-15T19:34:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/2749119696 >> 172.21.2.137:0/2749119696 conn(0x7f91a00b5f50 msgr2=0x7f91a00b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/2749119696 shutdown_connections 2021-11-15T19:34:29.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/2749119696 wait complete. 2021-11-15T19:34:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 Processor -- start 2021-11-15T19:34:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- start start 2021-11-15T19:34:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f91a00674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91a00b3190 0x7f91a0156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a0146650 0x7f91a0146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00b35f0 con 0x7f91a00b3190 2021-11-15T19:34:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0146fc0 con 0x7f91800049f0 2021-11-15T19:34:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0156a80 con 0x7f91a0146650 2021-11-15T19:34:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f91a00674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f91a00674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38756/0 (socket says 172.21.2.137:38756) 2021-11-15T19:34:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 -- 172.21.2.137:0/151005231 learned_addr learned my addr 172.21.2.137:0/151005231 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:29.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 -- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a0146650 msgr2=0x7f91a0146ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:29.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a0146650 0x7f91a0146ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 -- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91a00b3190 msgr2=0x7f91a0156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91a00b3190 0x7f91a0156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 -- 172.21.2.137:0/151005231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0066660 con 0x7f91800049f0 2021-11-15T19:34:29.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a4aa9700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f91a00674b0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f91a0156c10 tx=0x7f91880019e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9188007170 con 0x7f91800049f0 2021-11-15T19:34:29.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880072d0 con 0x7f91800049f0 2021-11-15T19:34:29.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9188004920 con 0x7f91800049f0 2021-11-15T19:34:29.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a0066900 con 0x7f91800049f0 2021-11-15T19:34:29.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a0066320 con 0x7f91800049f0 2021-11-15T19:34:29.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.781+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a00ad690 con 0x7f91800049f0 2021-11-15T19:34:29.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.785+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9188004a80 con 0x7f91800049f0 2021-11-15T19:34:29.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.785+0000 7f919dffb700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9184053690 0x7f9184055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.785+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f918806b290 con 0x7f91800049f0 2021-11-15T19:34:29.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.785+0000 7f919ffff700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9184053690 0x7f9184055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.785+0000 7f919ffff700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9184053690 0x7f9184055b50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f9190002f70 tx=0x7f9190006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.785+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9188042610 con 0x7f91800049f0 2021-11-15T19:34:29.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f91a00573d0 con 0x7f91800049f0 2021-11-15T19:34:29.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f919dffb700 1 -- 172.21.2.137:0/151005231 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9188045c30 con 0x7f91800049f0 2021-11-15T19:34:29.880 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:34:29.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9184053690 msgr2=0x7f9184055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9184053690 0x7f9184055b50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f9190002f70 tx=0x7f9190006a80).stop 2021-11-15T19:34:29.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 msgr2=0x7f91a00674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f91a00674b0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f91a0156c10 tx=0x7f91880019e0).stop 2021-11-15T19:34:29.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 shutdown_connections 2021-11-15T19:34:29.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9184053690 0x7f9184055b50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f91a0146650 0x7f91a0146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f91a00b3190 0x7f91a0156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 --2- 172.21.2.137:0/151005231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f91800049f0 0x7f91a00674b0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 >> 172.21.2.137:0/151005231 conn(0x7f91a00b5f50 msgr2=0x7f91a013ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 shutdown_connections 2021-11-15T19:34:29.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.869+0000 7f91a6d0d700 1 -- 172.21.2.137:0/151005231 wait complete. 2021-11-15T19:34:29.887 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:34:29.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 Processor -- start 2021-11-15T19:34:29.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- start start 2021-11-15T19:34:29.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f97c40afde0 0x7f97c40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f97c413f5c0 0x7f97c413fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c40aedf0 con 0x7f97c40b0fe0 2021-11-15T19:34:29.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40ae070 con 0x7f97c413f5c0 2021-11-15T19:34:29.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40afbd0 con 0x7f97c40afde0 2021-11-15T19:34:29.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c9ea5700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f97c40b0fe0 0x7f97c40af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57546/0 (socket says 172.21.2.137:57546) 2021-11-15T19:34:29.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c9ea5700 1 -- 172.21.2.137:0/2422569618 learned_addr learned my addr 172.21.2.137:0/2422569618 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:29.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c96a4700 1 --2- 172.21.2.137:0/2422569618 >> v2:172.21.2.137:3300/0 conn(0x7f97c40afde0 0x7f97c40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c96a4700 1 -- 172.21.2.137:0/2422569618 >> v2:172.21.2.111:3300/0 conn(0x7f97c413f5c0 msgr2=0x7f97c413fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c96a4700 1 --2- 172.21.2.137:0/2422569618 >> v2:172.21.2.111:3300/0 conn(0x7f97c413f5c0 0x7f97c413fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c96a4700 1 -- 172.21.2.137:0/2422569618 >> v1:172.21.2.137:6789/0 conn(0x7f97c40b0fe0 legacy=0x7f97c40af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c96a4700 1 -- 172.21.2.137:0/2422569618 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40b13c0 con 0x7f97c40afde0 2021-11-15T19:34:29.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c96a4700 1 --2- 172.21.2.137:0/2422569618 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40acff0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f97c40ad960 tx=0x7f97c0006df0).ready entity=mon.1 client_cookie=4252df5b9441ad94 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c8ea3700 1 -- 172.21.2.137:0/2422569618 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97c000d5c0 con 0x7f97c40afde0 2021-11-15T19:34:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c8ea3700 1 -- 172.21.2.137:0/2422569618 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c0000e90 con 0x7f97c40afde0 2021-11-15T19:34:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97c8ea3700 1 -- 172.21.2.137:0/2422569618 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97c000d910 con 0x7f97c40afde0 2021-11-15T19:34:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- 172.21.2.137:0/2422569618 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 msgr2=0x7f97c40acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 --2- 172.21.2.137:0/2422569618 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40acff0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f97c40ad960 tx=0x7f97c0006df0).stop 2021-11-15T19:34:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- 172.21.2.137:0/2422569618 shutdown_connections 2021-11-15T19:34:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 --2- 172.21.2.137:0/2422569618 >> v2:172.21.2.111:3300/0 conn(0x7f97c413f5c0 0x7f97c413fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 --2- 172.21.2.137:0/2422569618 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40acff0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:29.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- 172.21.2.137:0/2422569618 >> 172.21.2.137:0/2422569618 conn(0x7f97c40b5f50 msgr2=0x7f97c40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- 172.21.2.137:0/2422569618 shutdown_connections 2021-11-15T19:34:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.929+0000 7f97cc109700 1 -- 172.21.2.137:0/2422569618 wait complete. 2021-11-15T19:34:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 Processor -- start 2021-11-15T19:34:29.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- start start 2021-11-15T19:34:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97c40b0fe0 0x7f97c4150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97c413f5c0 0x7f97c41506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c410f1f0 con 0x7f97c413f5c0 2021-11-15T19:34:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c410f420 con 0x7f97c40afde0 2021-11-15T19:34:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c410f6c0 con 0x7f97c40b0fe0 2021-11-15T19:34:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38772/0 (socket says 172.21.2.137:38772) 2021-11-15T19:34:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 -- 172.21.2.137:0/3038063886 learned_addr learned my addr 172.21.2.137:0/3038063886 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 -- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97c40b0fe0 msgr2=0x7f97c4150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97c40b0fe0 0x7f97c4150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 -- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97c413f5c0 msgr2=0x7f97c41506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97c413f5c0 0x7f97c41506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 -- 172.21.2.137:0/3038063886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c000b180 con 0x7f97c40afde0 2021-11-15T19:34:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c9ea5700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40b5340 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f97c4111cf0 tx=0x7f97b4007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b400ce20 con 0x7f97c40afde0 2021-11-15T19:34:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b40072e0 con 0x7f97c40afde0 2021-11-15T19:34:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c4150be0 con 0x7f97c40afde0 2021-11-15T19:34:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b4005800 con 0x7f97c40afde0 2021-11-15T19:34:29.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c40b5830 con 0x7f97c40afde0 2021-11-15T19:34:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c410f880 con 0x7f97c40afde0 2021-11-15T19:34:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97b4010070 con 0x7f97c40afde0 2021-11-15T19:34:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97b2ffd700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97a4053610 0x7f97a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:29.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f97b406ac00 con 0x7f97c40afde0 2021-11-15T19:34:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.933+0000 7f97c96a4700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97a4053610 0x7f97a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.937+0000 7f97c96a4700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97a4053610 0x7f97a4055ad0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f97c40ad960 tx=0x7f97c0012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:29.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:29.937+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97b4070020 con 0x7f97c40afde0 2021-11-15T19:34:30.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.017+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97c40ad690 con 0x7f97c40afde0 2021-11-15T19:34:30.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.017+0000 7f97b2ffd700 1 -- 172.21.2.137:0/3038063886 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97b4018070 con 0x7f97c40afde0 2021-11-15T19:34:30.029 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:30.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97a4053610 msgr2=0x7f97a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97a4053610 0x7f97a4055ad0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f97c40ad960 tx=0x7f97c0012000).stop 2021-11-15T19:34:30.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 msgr2=0x7f97c40b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40b5340 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f97c4111cf0 tx=0x7f97b4007c00).stop 2021-11-15T19:34:30.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 shutdown_connections 2021-11-15T19:34:30.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97a4053610 0x7f97a4055ad0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f97c413f5c0 0x7f97c41506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f97c40b0fe0 0x7f97c4150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 --2- 172.21.2.137:0/3038063886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f97c40afde0 0x7f97c40b5340 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 >> 172.21.2.137:0/3038063886 conn(0x7f97c40b5f50 msgr2=0x7f97c41433c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:30.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 shutdown_connections 2021-11-15T19:34:30.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.021+0000 7f97cc109700 1 -- 172.21.2.137:0/3038063886 wait complete. 2021-11-15T19:34:30.037 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:34:30.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 Processor -- start 2021-11-15T19:34:30.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 -- start start 2021-11-15T19:34:30.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 0x7febf40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7febf405f730 0x7febf405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf4060070 con 0x7febf40608f0 2021-11-15T19:34:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40ad6c0 con 0x7febf405f730 2021-11-15T19:34:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febfa3e3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b1b50 con 0x7febf413f890 2021-11-15T19:34:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf3fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7febf40608f0 0x7febf40b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57560/0 (socket says 172.21.2.137:57560) 2021-11-15T19:34:30.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf3fff700 1 -- 172.21.2.137:0/195078512 learned_addr learned my addr 172.21.2.137:0/195078512 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:30.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046005285 0 0) 0x7febf4060070 con 0x7febf40608f0 2021-11-15T19:34:30.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe0003260 con 0x7febf40608f0 2021-11-15T19:34:30.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414696349 0 0) 0x7febe0003260 con 0x7febf40608f0 2021-11-15T19:34:30.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 msgr2=0x7febf40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 0x7febf40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 >> v2:172.21.2.111:3300/0 conn(0x7febf405f730 msgr2=0x7febf405fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 --2- 172.21.2.137:0/195078512 >> v2:172.21.2.111:3300/0 conn(0x7febf405f730 0x7febf405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40b0c80 con 0x7febf40608f0 2021-11-15T19:34:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7febe8001660 con 0x7febf40608f0 2021-11-15T19:34:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 >> v1:172.21.2.137:6789/0 conn(0x7febf40608f0 legacy=0x7febf40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe00037d0 0x7febe0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 0x7febe0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febe0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40ad6c0 con 0x7febe00037d0 2021-11-15T19:34:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b1b50 con 0x7febe0004b10 2021-11-15T19:34:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe000b9e0 con 0x7febf413f890 2021-11-15T19:34:30.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febe0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf3fff700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe00037d0 0x7febe0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf37fe700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 0x7febe0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 -- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 msgr2=0x7febe0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf413f890 0x7febe0004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 -- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe00037d0 msgr2=0x7febe0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe00037d0 0x7febe0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 -- 172.21.2.137:0/195078512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40b0c80 con 0x7febe0004b10 2021-11-15T19:34:30.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf3fff700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febe00037d0 0x7febe0003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf8980700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febe0004f90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7febec0032f0 tx=0x7febec006f90).ready entity=mon.1 client_cookie=e7df4e92cbc56dd3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec00b460 con 0x7febe0004b10 2021-11-15T19:34:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00b5c0 con 0x7febe0004b10 2021-11-15T19:34:30.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.077+0000 7febf2ffd700 1 -- 172.21.2.137:0/195078512 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec00b730 con 0x7febe0004b10 2021-11-15T19:34:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/195078512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 msgr2=0x7febe0004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 --2- 172.21.2.137:0/195078512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febe0004f90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7febec0032f0 tx=0x7febec006f90).stop 2021-11-15T19:34:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf8980700 1 -- 172.21.2.137:0/195078512 reap_dead start 2021-11-15T19:34:30.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/195078512 shutdown_connections 2021-11-15T19:34:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/195078512 >> 172.21.2.137:0/195078512 conn(0x7febf4063980 msgr2=0x7febf4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/195078512 shutdown_connections 2021-11-15T19:34:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/195078512 wait complete. 2021-11-15T19:34:30.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 Processor -- start 2021-11-15T19:34:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- start start 2021-11-15T19:34:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febf4155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febf41398a0 0x7febf4156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf4067160 0x7febf413b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf413c3a0 con 0x7febf41398a0 2021-11-15T19:34:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf413a040 con 0x7febe0004b10 2021-11-15T19:34:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf413a2a0 con 0x7febf4067160 2021-11-15T19:34:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febf4155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febf4155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38790/0 (socket says 172.21.2.137:38790) 2021-11-15T19:34:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 -- 172.21.2.137:0/290041394 learned_addr learned my addr 172.21.2.137:0/290041394 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 -- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf4067160 msgr2=0x7febf413b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf4067160 0x7febf413b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 -- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febf41398a0 msgr2=0x7febf4156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febf41398a0 0x7febf4156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 -- 172.21.2.137:0/290041394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4139d40 con 0x7febe0004b10 2021-11-15T19:34:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf3fff700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febf4155c20 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7febf4066c20 tx=0x7febe8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe8007170 con 0x7febe0004b10 2021-11-15T19:34:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe80072d0 con 0x7febe0004b10 2021-11-15T19:34:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf4156730 con 0x7febe0004b10 2021-11-15T19:34:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe8004920 con 0x7febe0004b10 2021-11-15T19:34:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf413b740 con 0x7febe0004b10 2021-11-15T19:34:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf40b0f20 con 0x7febe0004b10 2021-11-15T19:34:30.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febe8004a80 con 0x7febe0004b10 2021-11-15T19:34:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf17fa700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febd40536a0 0x7febd4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.081+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5249+0+0 (secure 0 0 0) 0x7febe806ba10 con 0x7febe0004b10 2021-11-15T19:34:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.085+0000 7febf37fe700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febd40536a0 0x7febd4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.085+0000 7febf37fe700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febd40536a0 0x7febd4055b60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7febe4007000 tx=0x7febe4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:30.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.085+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febe8042ea0 con 0x7febe0004b10 2021-11-15T19:34:30.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.169+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7febf40573d0 con 0x7febe0004b10 2021-11-15T19:34:30.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.169+0000 7febf17fa700 1 -- 172.21.2.137:0/290041394 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+143 (secure 0 0 0) 0x7febe80464c0 con 0x7febe0004b10 2021-11-15T19:34:30.181 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:30.181 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:34:30.181 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:30.182 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:34:30.182 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:34:30.182 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:30.182 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:30.183 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:34:30.183 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:34:30.183 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:30.183 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:34:30.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.169+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febd40536a0 msgr2=0x7febd4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.169+0000 7febfa3e3700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febd40536a0 0x7febd4055b60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7febe4007000 tx=0x7febe4008040).stop 2021-11-15T19:34:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.169+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 msgr2=0x7febf4155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.169+0000 7febfa3e3700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febf4155c20 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7febf4066c20 tx=0x7febe8009040).stop 2021-11-15T19:34:30.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 shutdown_connections 2021-11-15T19:34:30.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7febd40536a0 0x7febd4055b60 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7febf4067160 0x7febf413b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7febf41398a0 0x7febf4156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 --2- 172.21.2.137:0/290041394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7febe0004b10 0x7febf4155c20 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 >> 172.21.2.137:0/290041394 conn(0x7febf4063980 msgr2=0x7febf4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:30.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 shutdown_connections 2021-11-15T19:34:30.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.173+0000 7febfa3e3700 1 -- 172.21.2.137:0/290041394 wait complete. 2021-11-15T19:34:30.188 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:34:30.189 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:34:30.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.229+0000 7f7ef7206700 1 Processor -- start 2021-11-15T19:34:30.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.229+0000 7f7ef7206700 1 -- start start 2021-11-15T19:34:30.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7ef00b0ec0 0x7f7ef00ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef005c430 0x7f7ef00ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef00af470 con 0x7f7ef0063900 2021-11-15T19:34:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef00676a0 con 0x7f7ef00b0ec0 2021-11-15T19:34:30.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0067940 con 0x7f7ef005c430 2021-11-15T19:34:30.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7ef0063900 0x7f7ef013c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57580/0 (socket says 172.21.2.137:57580) 2021-11-15T19:34:30.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 -- 172.21.2.137:0/3446453180 learned_addr learned my addr 172.21.2.137:0/3446453180 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:30.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521882967 0 0) 0x7f7ef00af470 con 0x7f7ef0063900 2021-11-15T19:34:30.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0003260 con 0x7f7ef0063900 2021-11-15T19:34:30.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356100102 0 0) 0x7f7ed0003260 con 0x7f7ef0063900 2021-11-15T19:34:30.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef005c430 msgr2=0x7f7ef00ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef005c430 0x7f7ef00ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 >> v2:172.21.2.111:3300/0 conn(0x7f7ef00b0ec0 msgr2=0x7f7ef00ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 --2- 172.21.2.137:0/3446453180 >> v2:172.21.2.111:3300/0 conn(0x7f7ef00b0ec0 0x7f7ef00ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0140220 con 0x7f7ef0063900 2021-11-15T19:34:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7ee0001660 con 0x7f7ef0063900 2021-11-15T19:34:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 >> v1:172.21.2.137:6789/0 conn(0x7f7ef0063900 legacy=0x7f7ef013c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ed00037d0 0x7f7ed0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef005c430 0x7f7ed0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ed000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00676a0 con 0x7f7ed00037d0 2021-11-15T19:34:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0067940 con 0x7f7ed0004bf0 2021-11-15T19:34:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0005300 con 0x7f7ef005c430 2021-11-15T19:34:30.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ed000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ed00037d0 0x7f7ed0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 -- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef005c430 msgr2=0x7f7ed0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef005c430 0x7f7ed0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 -- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ed00037d0 msgr2=0x7f7ed0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:30.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ed00037d0 0x7f7ed0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 -- 172.21.2.137:0/3446453180 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0003260 con 0x7f7ed0004bf0 2021-11-15T19:34:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ed000b750 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f7ee80032f0 tx=0x7f7ee8006f90).ready entity=mon.1 client_cookie=bc5b4fd42c419f53 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee800b460 con 0x7f7ed0004bf0 2021-11-15T19:34:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee800b5c0 con 0x7f7ed0004bf0 2021-11-15T19:34:30.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eef7fe700 1 -- 172.21.2.137:0/3446453180 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee800b730 con 0x7f7ed0004bf0 2021-11-15T19:34:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3446453180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 msgr2=0x7f7ed000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3446453180 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ed000b750 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f7ee80032f0 tx=0x7f7ee8006f90).stop 2021-11-15T19:34:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 -- 172.21.2.137:0/3446453180 reap_dead start 2021-11-15T19:34:30.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3446453180 shutdown_connections 2021-11-15T19:34:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3446453180 >> 172.21.2.137:0/3446453180 conn(0x7f7ef00631e0 msgr2=0x7f7ef005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3446453180 shutdown_connections 2021-11-15T19:34:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3446453180 wait complete. 2021-11-15T19:34:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 Processor -- start 2021-11-15T19:34:30.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- start start 2021-11-15T19:34:30.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ef0141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef013c4e0 0x7f7ef014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0141970 0x7f7ef0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0141e00 con 0x7f7ef013c4e0 2021-11-15T19:34:30.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0156510 con 0x7f7ed0004bf0 2021-11-15T19:34:30.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0159c60 con 0x7f7ef0141970 2021-11-15T19:34:30.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ef0141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ef0141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38812/0 (socket says 172.21.2.137:38812) 2021-11-15T19:34:30.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 -- 172.21.2.137:0/3085360593 learned_addr learned my addr 172.21.2.137:0/3085360593 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:30.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eeffff700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef013c4e0 0x7f7ef014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0141970 0x7f7ef0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 -- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0141970 msgr2=0x7f7ef0156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0141970 0x7f7ef0156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 -- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef013c4e0 msgr2=0x7f7ef014c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef013c4e0 0x7f7ef014c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 -- 172.21.2.137:0/3085360593 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef01599c0 con 0x7f7ed0004bf0 2021-11-15T19:34:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef57a3700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0141970 0x7f7ef0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef4fa2700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ef0141230 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f7ef0064fe0 tx=0x7f7ee000e840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee0015630 con 0x7f7ed0004bf0 2021-11-15T19:34:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0010040 con 0x7f7ed0004bf0 2021-11-15T19:34:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee0015980 con 0x7f7ed0004bf0 2021-11-15T19:34:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef0140c00 con 0x7f7ed0004bf0 2021-11-15T19:34:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.233+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef0157080 con 0x7f7ed0004bf0 2021-11-15T19:34:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef0156680 con 0x7f7ed0004bf0 2021-11-15T19:34:30.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ee0015ae0 con 0x7f7ed0004bf0 2021-11-15T19:34:30.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7eedffb700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ed4053610 0x7f7ed4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:30.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7ee006b110 con 0x7f7ed0004bf0 2021-11-15T19:34:30.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7eeffff700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ed4053610 0x7f7ed4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:30.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7eeffff700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ed4053610 0x7f7ed4055ad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f7ed800a000 tx=0x7f7ed8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:30.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.237+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ee00425a0 con 0x7f7ed0004bf0 2021-11-15T19:34:30.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:30.321+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f7ef013c9e0 con 0x7f7ed0004bf0 2021-11-15T19:34:31.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7eedffb700 1 -- 172.21.2.137:0/3085360593 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v109) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7ee001a070 con 0x7f7ed0004bf0 2021-11-15T19:34:31.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ed4053610 msgr2=0x7f7ed4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:31.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ed4053610 0x7f7ed4055ad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f7ed800a000 tx=0x7f7ed8008040).stop 2021-11-15T19:34:31.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 msgr2=0x7f7ef0141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:31.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ef0141230 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f7ef0064fe0 tx=0x7f7ee000e840).stop 2021-11-15T19:34:31.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 shutdown_connections 2021-11-15T19:34:31.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ed4053610 0x7f7ed4055ad0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:31.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0141970 0x7f7ef0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:31.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef013c4e0 0x7f7ef014c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:31.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 --2- 172.21.2.137:0/3085360593 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ed0004bf0 0x7f7ef0141230 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:31.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 >> 172.21.2.137:0/3085360593 conn(0x7f7ef00631e0 msgr2=0x7f7ef00b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:31.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 shutdown_connections 2021-11-15T19:34:31.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.201+0000 7f7ef7206700 1 -- 172.21.2.137:0/3085360593 wait complete. 2021-11-15T19:34:31.215 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:34:31.219 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:34:31.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 Processor -- start 2021-11-15T19:34:31.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- start start 2021-11-15T19:34:31.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc9800b72e0 0x7fc9800b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:31.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9800acd60 0x7fc9800b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:31.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9800b76c0 con 0x7fc9800b4680 2021-11-15T19:34:31.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9800b3100 con 0x7fc9800acd60 2021-11-15T19:34:31.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98012a170 con 0x7fc9800b72e0 2021-11-15T19:34:31.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc9800b72e0 0x7fc9800b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:31.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc9800b72e0 0x7fc9800b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38818/0 (socket says 172.21.2.137:38818) 2021-11-15T19:34:31.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 -- 172.21.2.137:0/1584515188 learned_addr learned my addr 172.21.2.137:0/1584515188 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:31.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 -- 172.21.2.137:0/1584515188 >> v2:172.21.2.111:3300/0 conn(0x7fc9800acd60 msgr2=0x7fc9800b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:31.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 --2- 172.21.2.137:0/1584515188 >> v2:172.21.2.111:3300/0 conn(0x7fc9800acd60 0x7fc9800b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:31.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 -- 172.21.2.137:0/1584515188 >> v1:172.21.2.111:6789/0 conn(0x7fc9800b4680 legacy=0x7fc980143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:31.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 -- 172.21.2.137:0/1584515188 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9800ad8a0 con 0x7fc9800b72e0 2021-11-15T19:34:31.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97e59c700 1 --2- 172.21.2.137:0/1584515188 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800b72e0 0x7fc9800b19b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fc980065c40 tx=0x7fc968006eb0).ready entity=mon.1 client_cookie=404dac5555a49820 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:31.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97d59a700 1 -- 172.21.2.137:0/1584515188 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96800d5c0 con 0x7fc9800b72e0 2021-11-15T19:34:31.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97d59a700 1 -- 172.21.2.137:0/1584515188 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc968000e90 con 0x7fc9800b72e0 2021-11-15T19:34:31.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc97d59a700 1 -- 172.21.2.137:0/1584515188 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96800d910 con 0x7fc9800b72e0 2021-11-15T19:34:31.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- 172.21.2.137:0/1584515188 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800b72e0 msgr2=0x7fc9800b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:31.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 --2- 172.21.2.137:0/1584515188 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800b72e0 0x7fc9800b19b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fc980065c40 tx=0x7fc968006eb0).stop 2021-11-15T19:34:31.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- 172.21.2.137:0/1584515188 shutdown_connections 2021-11-15T19:34:31.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 --2- 172.21.2.137:0/1584515188 >> v2:172.21.2.111:3300/0 conn(0x7fc9800acd60 0x7fc9800b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:31.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 --2- 172.21.2.137:0/1584515188 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800b72e0 0x7fc9800b19b0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:31.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- 172.21.2.137:0/1584515188 >> 172.21.2.137:0/1584515188 conn(0x7fc980064960 msgr2=0x7fc980064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:31.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.261+0000 7fc98483f700 1 -- 172.21.2.137:0/1584515188 shutdown_connections 2021-11-15T19:34:31.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- 172.21.2.137:0/1584515188 wait complete. 2021-11-15T19:34:31.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 Processor -- start 2021-11-15T19:34:31.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- start start 2021-11-15T19:34:31.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 0x7fc9801428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:31.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9800b4680 0x7fc9801555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:31.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9800b72e0 0x7fc980155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:31.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980156570 con 0x7fc9800b4680 2021-11-15T19:34:31.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980156110 con 0x7fc9800acd60 2021-11-15T19:34:31.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9801434f0 con 0x7fc9800b72e0 2021-11-15T19:34:31.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 0x7fc9801428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:31.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 0x7fc9801428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38824/0 (socket says 172.21.2.137:38824) 2021-11-15T19:34:31.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 -- 172.21.2.137:0/3426547296 learned_addr learned my addr 172.21.2.137:0/3426547296 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:31.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 -- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9800b72e0 msgr2=0x7fc980155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:31.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9800b72e0 0x7fc980155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:31.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 -- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9800b4680 msgr2=0x7fc9801555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:31.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9800b4680 0x7fc9801555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:31.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 -- 172.21.2.137:0/3426547296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96800b1e0 con 0x7fc9800acd60 2021-11-15T19:34:31.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97e59c700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 0x7fc9801428c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fc980065c40 tx=0x7fc968015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:31.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc968002f70 con 0x7fc9800acd60 2021-11-15T19:34:31.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96800de70 con 0x7fc9800acd60 2021-11-15T19:34:31.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc980143250 con 0x7fc9800acd60 2021-11-15T19:34:31.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96801e460 con 0x7fc9800acd60 2021-11-15T19:34:31.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc980125930 con 0x7fc9800acd60 2021-11-15T19:34:31.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9800b3cf0 con 0x7fc9800acd60 2021-11-15T19:34:31.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc968025030 con 0x7fc9800acd60 2021-11-15T19:34:31.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc9777fe700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc964053640 0x7fc964055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:31.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5603+0+0 (secure 0 0 0) 0x7fc96806ca50 con 0x7fc9800acd60 2021-11-15T19:34:31.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.265+0000 7fc97dd9b700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc964053640 0x7fc964055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:31.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.269+0000 7fc97dd9b700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc964053640 0x7fc964055b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc970002f70 tx=0x7fc970006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:31.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.269+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc968043dc0 con 0x7fc9800acd60 2021-11-15T19:34:31.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:31.353+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fc9800573d0 con 0x7fc9800acd60 2021-11-15T19:34:32.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.213+0000 7fc9777fe700 1 -- 172.21.2.137:0/3426547296 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v110) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc968023070 con 0x7fc9800acd60 2021-11-15T19:34:32.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc964053640 msgr2=0x7fc964055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc964053640 0x7fc964055b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc970002f70 tx=0x7fc970006a80).stop 2021-11-15T19:34:32.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 msgr2=0x7fc9801428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 0x7fc9801428c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fc980065c40 tx=0x7fc968015000).stop 2021-11-15T19:34:32.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 shutdown_connections 2021-11-15T19:34:32.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc964053640 0x7fc964055b00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9800b72e0 0x7fc980155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9800b4680 0x7fc9801555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 --2- 172.21.2.137:0/3426547296 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9800acd60 0x7fc9801428c0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 >> 172.21.2.137:0/3426547296 conn(0x7fc980064960 msgr2=0x7fc980128b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 shutdown_connections 2021-11-15T19:34:32.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.217+0000 7fc98483f700 1 -- 172.21.2.137:0/3426547296 wait complete. 2021-11-15T19:34:32.229 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:34:32.232 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:34:32.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 Processor -- start 2021-11-15T19:34:32.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- start start 2021-11-15T19:34:32.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 0x7f0924097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f09240969e0 0x7f09240997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09240aca80 con 0x7f09240b2c30 2021-11-15T19:34:32.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09240ad150 con 0x7f09240969e0 2021-11-15T19:34:32.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240accb0 con 0x7f0924097260 2021-11-15T19:34:32.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0921d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f09240b2c30 0x7f09240990e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57616/0 (socket says 172.21.2.137:57616) 2021-11-15T19:34:32.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0921d9b700 1 -- 172.21.2.137:0/210100192 learned_addr learned my addr 172.21.2.137:0/210100192 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:32.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0922d9d700 1 --2- 172.21.2.137:0/210100192 >> v2:172.21.2.137:3300/0 conn(0x7f09240969e0 0x7f09240997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0922d9d700 1 -- 172.21.2.137:0/210100192 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 msgr2=0x7f0924097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:32.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0922d9d700 1 --2- 172.21.2.137:0/210100192 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 0x7f0924097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0922d9d700 1 -- 172.21.2.137:0/210100192 >> v1:172.21.2.137:6789/0 conn(0x7f09240b2c30 legacy=0x7f09240990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0922d9d700 1 -- 172.21.2.137:0/210100192 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0924097c50 con 0x7f09240969e0 2021-11-15T19:34:32.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0922d9d700 1 --2- 172.21.2.137:0/210100192 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240997f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f091c0032f0 tx=0x7f091c0091d0).ready entity=mon.1 client_cookie=d52f5a5fdaf2aaea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092159a700 1 -- 172.21.2.137:0/210100192 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c009ea0 con 0x7f09240969e0 2021-11-15T19:34:32.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092159a700 1 -- 172.21.2.137:0/210100192 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00b8a0 con 0x7f09240969e0 2021-11-15T19:34:32.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092159a700 1 -- 172.21.2.137:0/210100192 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c00ba10 con 0x7f09240969e0 2021-11-15T19:34:32.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- 172.21.2.137:0/210100192 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 msgr2=0x7f09240997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- 172.21.2.137:0/210100192 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240997f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f091c0032f0 tx=0x7f091c0091d0).stop 2021-11-15T19:34:32.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- 172.21.2.137:0/210100192 shutdown_connections 2021-11-15T19:34:32.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- 172.21.2.137:0/210100192 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240997f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- 172.21.2.137:0/210100192 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 0x7f0924097640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- 172.21.2.137:0/210100192 >> 172.21.2.137:0/210100192 conn(0x7f09240b7070 msgr2=0x7f09240b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- 172.21.2.137:0/210100192 shutdown_connections 2021-11-15T19:34:32.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- 172.21.2.137:0/210100192 wait complete. 2021-11-15T19:34:32.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 Processor -- start 2021-11-15T19:34:32.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- start start 2021-11-15T19:34:32.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 0x7f09240672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09240b2c30 0x7f09240677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b05d0 con 0x7f09240b2c30 2021-11-15T19:34:32.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240af0c0 con 0x7f09240969e0 2021-11-15T19:34:32.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f0928fd4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240af360 con 0x7f0924097260 2021-11-15T19:34:32.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38838/0 (socket says 172.21.2.137:38838) 2021-11-15T19:34:32.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 -- 172.21.2.137:0/3250845772 learned_addr learned my addr 172.21.2.137:0/3250845772 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:32.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 -- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 msgr2=0x7f09240672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 0x7f09240672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 -- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09240b2c30 msgr2=0x7f09240677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09240b2c30 0x7f09240677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.277+0000 7f092259c700 1 -- 172.21.2.137:0/3250845772 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009470 con 0x7f09240969e0 2021-11-15T19:34:32.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f092259c700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240b13c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f092409bdf0 tx=0x7f090c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f090c013460 con 0x7f09240969e0 2021-11-15T19:34:32.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0135c0 con 0x7f09240969e0 2021-11-15T19:34:32.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f090c013920 con 0x7f09240969e0 2021-11-15T19:34:32.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09240af660 con 0x7f09240969e0 2021-11-15T19:34:32.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09240afaa0 con 0x7f09240969e0 2021-11-15T19:34:32.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09240573d0 con 0x7f09240969e0 2021-11-15T19:34:32.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f090c00f070 con 0x7f09240969e0 2021-11-15T19:34:32.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09080536a0 0x7f0908055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f090c06b120 con 0x7f09240969e0 2021-11-15T19:34:32.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f0921d9b700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09080536a0 0x7f0908055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f0921d9b700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09080536a0 0x7f0908055b60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f09240b7e10 tx=0x7f0914007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.281+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f090c0421e0 con 0x7f09240969e0 2021-11-15T19:34:32.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.393+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f092405f730 con 0x7f09240969e0 2021-11-15T19:34:32.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.397+0000 7f091b7fe700 1 -- 172.21.2.137:0/3250845772 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v56) v1 ==== 189+0+0 (secure 0 0 0) 0x7f090c045800 con 0x7f09240969e0 2021-11-15T19:34:32.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09080536a0 msgr2=0x7f0908055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09080536a0 0x7f0908055b60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f09240b7e10 tx=0x7f0914007860).stop 2021-11-15T19:34:32.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 msgr2=0x7f09240b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240b13c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f092409bdf0 tx=0x7f090c006ec0).stop 2021-11-15T19:34:32.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 shutdown_connections 2021-11-15T19:34:32.411 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f09080536a0 0x7f0908055b60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f09240b2c30 0x7f09240677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0924097260 0x7f09240672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 --2- 172.21.2.137:0/3250845772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f09240969e0 0x7f09240b13c0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 >> 172.21.2.137:0/3250845772 conn(0x7f09240b7070 msgr2=0x7f0924099260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 shutdown_connections 2021-11-15T19:34:32.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.401+0000 7f0928fd4700 1 -- 172.21.2.137:0/3250845772 wait complete. 2021-11-15T19:34:32.413 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 21 and data pool 22 2021-11-15T19:34:32.417 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:32.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 Processor -- start 2021-11-15T19:34:32.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 -- start start 2021-11-15T19:34:32.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5dec144610 0x7f5dec147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0a9f50 0x7f5dec0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec148190 con 0x7f5dec0b1340 2021-11-15T19:34:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec0b1720 con 0x7f5dec144610 2021-11-15T19:34:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5df0df7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec147e70 con 0x7f5dec0a9f50 2021-11-15T19:34:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dea59c700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f5dec0b1340 0x7f5dec143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:50132/0 (socket says 172.21.2.137:50132) 2021-11-15T19:34:32.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dea59c700 1 -- 172.21.2.137:0/3105060569 learned_addr learned my addr 172.21.2.137:0/3105060569 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5de9d9b700 1 --2- 172.21.2.137:0/3105060569 >> v2:172.21.2.111:3300/0 conn(0x7f5dec144610 0x7f5dec147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dead9d700 1 --2- 172.21.2.137:0/3105060569 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0a9f50 0x7f5dec0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5de959a700 1 -- 172.21.2.137:0/3105060569 <== mon.0 v1:172.21.2.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432968735 0 0) 0x7f5ddc001110 con 0x7f5dec0b1340 2021-11-15T19:34:32.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5de959a700 1 -- 172.21.2.137:0/3105060569 --> v1:172.21.2.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc003260 con 0x7f5dec0b1340 2021-11-15T19:34:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dead9d700 1 -- 172.21.2.137:0/3105060569 >> v2:172.21.2.111:3300/0 conn(0x7f5dec144610 msgr2=0x7f5dec147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dead9d700 1 --2- 172.21.2.137:0/3105060569 >> v2:172.21.2.111:3300/0 conn(0x7f5dec144610 0x7f5dec147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dead9d700 1 -- 172.21.2.137:0/3105060569 >> v1:172.21.2.111:6789/0 conn(0x7f5dec0b1340 legacy=0x7f5dec143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dead9d700 1 -- 172.21.2.137:0/3105060569 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0af800 con 0x7f5dec0a9f50 2021-11-15T19:34:32.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5de9d9b700 1 --2- 172.21.2.137:0/3105060569 >> v2:172.21.2.111:3300/0 conn(0x7f5dec144610 0x7f5dec147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.457+0000 7f5dead9d700 1 --2- 172.21.2.137:0/3105060569 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0a9f50 0x7f5dec0aa3a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5de40032f0 tx=0x7f5de40091d0).ready entity=mon.2 client_cookie=a2d54d18381e4527 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de959a700 1 -- 172.21.2.137:0/3105060569 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de400b600 con 0x7f5dec0a9f50 2021-11-15T19:34:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de959a700 1 -- 172.21.2.137:0/3105060569 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400b760 con 0x7f5dec0a9f50 2021-11-15T19:34:32.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de959a700 1 -- 172.21.2.137:0/3105060569 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de400b8d0 con 0x7f5dec0a9f50 2021-11-15T19:34:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3105060569 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0a9f50 msgr2=0x7f5dec0aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3105060569 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0a9f50 0x7f5dec0aa3a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5de40032f0 tx=0x7f5de40091d0).stop 2021-11-15T19:34:32.478 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3105060569 shutdown_connections 2021-11-15T19:34:32.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3105060569 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0a9f50 0x7f5dec0aa3a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3105060569 >> v2:172.21.2.111:3300/0 conn(0x7f5dec144610 0x7f5dec147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3105060569 >> 172.21.2.137:0/3105060569 conn(0x7f5dec0b4e60 msgr2=0x7f5dec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3105060569 shutdown_connections 2021-11-15T19:34:32.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3105060569 wait complete. 2021-11-15T19:34:32.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 Processor -- start 2021-11-15T19:34:32.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- start start 2021-11-15T19:34:32.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 0x7f5dec0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0b1340 0x7f5dec097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5dec144610 0x7f5dec0982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec159eb0 con 0x7f5dec144610 2021-11-15T19:34:32.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15a150 con 0x7f5dec0a9f50 2021-11-15T19:34:32.481 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15a3f0 con 0x7f5dec0b1340 2021-11-15T19:34:32.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 0x7f5dec0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 0x7f5dec0b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38864/0 (socket says 172.21.2.137:38864) 2021-11-15T19:34:32.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 -- 172.21.2.137:0/3747974305 learned_addr learned my addr 172.21.2.137:0/3747974305 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:32.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de9d9b700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0b1340 0x7f5dec097df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 -- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0b1340 msgr2=0x7f5dec097df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0b1340 0x7f5dec097df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 -- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5dec144610 msgr2=0x7f5dec0982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dead9d700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5dec144610 0x7f5dec0982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5dec144610 0x7f5dec0982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 -- 172.21.2.137:0/3747974305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd400b180 con 0x7f5dec0a9f50 2021-11-15T19:34:32.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dead9d700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5dec144610 0x7f5dec0982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:32.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5dea59c700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 0x7f5dec0b3ca0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f5ddc0012a0 tx=0x7f5ddc007920).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc0070d0 con 0x7f5dec0a9f50 2021-11-15T19:34:32.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc007230 con 0x7f5dec0a9f50 2021-11-15T19:34:32.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de4009470 con 0x7f5dec0a9f50 2021-11-15T19:34:32.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec159b30 con 0x7f5dec0a9f50 2021-11-15T19:34:32.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc005610 con 0x7f5dec0a9f50 2021-11-15T19:34:32.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec09ae10 con 0x7f5dec0a9f50 2021-11-15T19:34:32.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ddc01a060 con 0x7f5dec0a9f50 2021-11-15T19:34:32.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de37fe700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5dd0053540 0x7f5dd0055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.461+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5ddc06b0f0 con 0x7f5dec0a9f50 2021-11-15T19:34:32.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.465+0000 7f5de9d9b700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5dd0053540 0x7f5dd0055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.465+0000 7f5de9d9b700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5dd0053540 0x7f5dd0055a00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f5dd400b000 tx=0x7f5dd4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.486 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.465+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ddc042140 con 0x7f5dec0a9f50 2021-11-15T19:34:32.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.549+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dec148190 con 0x7f5dec0a9f50 2021-11-15T19:34:32.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5de37fe700 1 -- 172.21.2.137:0/3747974305 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16064 (secure 0 0 0) 0x7f5dec148190 con 0x7f5dec0a9f50 2021-11-15T19:34:32.562 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:32.562 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":111,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:32.401197+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:30.346476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:31.378520+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:32.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5dd0053540 msgr2=0x7f5dd0055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5dd0053540 0x7f5dd0055a00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f5dd400b000 tx=0x7f5dd4008040).stop 2021-11-15T19:34:32.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 msgr2=0x7f5dec0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 0x7f5dec0b3ca0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f5ddc0012a0 tx=0x7f5ddc007920).stop 2021-11-15T19:34:32.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 shutdown_connections 2021-11-15T19:34:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5dd0053540 0x7f5dd0055a00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5dec144610 0x7f5dec0982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5dec0b1340 0x7f5dec097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 --2- 172.21.2.137:0/3747974305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5dec0a9f50 0x7f5dec0b3ca0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 >> 172.21.2.137:0/3747974305 conn(0x7f5dec0b4e60 msgr2=0x7f5dec13e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 shutdown_connections 2021-11-15T19:34:32.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.553+0000 7f5df0df7700 1 -- 172.21.2.137:0/3747974305 wait complete. 2021-11-15T19:34:32.570 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:32.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.609+0000 7fa13a0b8700 1 Processor -- start 2021-11-15T19:34:32.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.609+0000 7fa13a0b8700 1 -- start start 2021-11-15T19:34:32.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa1340b1180 0x7fa134142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa1340af2f0 0x7fa134143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1340aecf0 con 0x7fa1340acab0 2021-11-15T19:34:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13413f180 con 0x7fa1340af2f0 2021-11-15T19:34:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340aef20 con 0x7fa1340b1180 2021-11-15T19:34:32.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa1340b1180 0x7fa134142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa1340b1180 0x7fa134142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38876/0 (socket says 172.21.2.137:38876) 2021-11-15T19:34:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 -- 172.21.2.137:0/3420028476 learned_addr learned my addr 172.21.2.137:0/3420028476 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 -- 172.21.2.137:0/3420028476 >> v2:172.21.2.111:3300/0 conn(0x7fa1340af2f0 msgr2=0x7fa134143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:32.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 --2- 172.21.2.137:0/3420028476 >> v2:172.21.2.111:3300/0 conn(0x7fa1340af2f0 0x7fa134143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 -- 172.21.2.137:0/3420028476 >> v1:172.21.2.111:6789/0 conn(0x7fa1340acab0 legacy=0x7fa1340b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 -- 172.21.2.137:0/3420028476 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340b2770 con 0x7fa1340b1180 2021-11-15T19:34:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa132ffd700 1 --2- 172.21.2.137:0/3420028476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa134142b80 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fa1340b2bd0 tx=0x7fa124006eb0).ready entity=mon.1 client_cookie=f9b597a59b1b9a43 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa1327fc700 1 -- 172.21.2.137:0/3420028476 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12400d5c0 con 0x7fa1340b1180 2021-11-15T19:34:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa1327fc700 1 -- 172.21.2.137:0/3420028476 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124000e90 con 0x7fa1340b1180 2021-11-15T19:34:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa1327fc700 1 -- 172.21.2.137:0/3420028476 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12400d910 con 0x7fa1340b1180 2021-11-15T19:34:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/3420028476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 msgr2=0x7fa134142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/3420028476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa134142b80 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fa1340b2bd0 tx=0x7fa124006eb0).stop 2021-11-15T19:34:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/3420028476 shutdown_connections 2021-11-15T19:34:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/3420028476 >> v2:172.21.2.111:3300/0 conn(0x7fa1340af2f0 0x7fa134143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/3420028476 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa134142b80 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/3420028476 >> 172.21.2.137:0/3420028476 conn(0x7fa1340630f0 msgr2=0x7fa1340634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/3420028476 shutdown_connections 2021-11-15T19:34:32.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/3420028476 wait complete. 2021-11-15T19:34:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 Processor -- start 2021-11-15T19:34:32.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- start start 2021-11-15T19:34:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1340acab0 0x7fa13413d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa1340af2f0 0x7fa1341564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa13411b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13410f6e0 con 0x7fa1340af2f0 2021-11-15T19:34:32.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341126e0 con 0x7fa1340b1180 2021-11-15T19:34:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa134112940 con 0x7fa1340acab0 2021-11-15T19:34:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa13411b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa13411b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38882/0 (socket says 172.21.2.137:38882) 2021-11-15T19:34:32.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 -- 172.21.2.137:0/2555695886 learned_addr learned my addr 172.21.2.137:0/2555695886 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 -- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1340acab0 msgr2=0x7fa13413d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1340acab0 0x7fa13413d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 -- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa1340af2f0 msgr2=0x7fa1341564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa1340af2f0 0x7fa1341564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 -- 172.21.2.137:0/2555695886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12400b1e0 con 0x7fa1340b1180 2021-11-15T19:34:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa133fff700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa13411b580 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fa134112580 tx=0x7fa12c009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c00d580 con 0x7fa1340b1180 2021-11-15T19:34:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c00d6e0 con 0x7fa1340b1180 2021-11-15T19:34:32.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13415a780 con 0x7fa1340b1180 2021-11-15T19:34:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c00da40 con 0x7fa1340b1180 2021-11-15T19:34:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.613+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13410ec10 con 0x7fa1340b1180 2021-11-15T19:34:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13415a910 con 0x7fa1340b1180 2021-11-15T19:34:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa12c00dba0 con 0x7fa1340b1180 2021-11-15T19:34:32.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa130ff9700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa1180536a0 0x7fa118055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa12c06bcb0 con 0x7fa1340b1180 2021-11-15T19:34:32.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa1337fe700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa1180536a0 0x7fa118055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa1337fe700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa1180536a0 0x7fa118055b60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fa11c002f90 tx=0x7fa11c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.617+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa12c042e10 con 0x7fa1340b1180 2021-11-15T19:34:32.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1340573d0 con 0x7fa1340b1180 2021-11-15T19:34:32.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa130ff9700 1 -- 172.21.2.137:0/2555695886 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16064 (secure 0 0 0) 0x7fa12c046430 con 0x7fa1340b1180 2021-11-15T19:34:32.712 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:32.713 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":111,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:32.401197+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:30.346476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:31.378520+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:32.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa1180536a0 msgr2=0x7fa118055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa1180536a0 0x7fa118055b60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fa11c002f90 tx=0x7fa11c0069b0).stop 2021-11-15T19:34:32.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 msgr2=0x7fa13411b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa13411b580 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fa134112580 tx=0x7fa12c009220).stop 2021-11-15T19:34:32.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 shutdown_connections 2021-11-15T19:34:32.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa1180536a0 0x7fa118055b60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1340b1180 0x7fa13411b580 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa1340af2f0 0x7fa1341564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 --2- 172.21.2.137:0/2555695886 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1340acab0 0x7fa13413d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 >> 172.21.2.137:0/2555695886 conn(0x7fa1340630f0 msgr2=0x7fa1340634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 shutdown_connections 2021-11-15T19:34:32.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.701+0000 7fa13a0b8700 1 -- 172.21.2.137:0/2555695886 wait complete. 2021-11-15T19:34:32.720 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:34:32.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 Processor -- start 2021-11-15T19:34:32.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 -- start start 2021-11-15T19:34:32.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f258005c770 0x7f25800aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f2580140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258005cb50 con 0x7f25800b0550 2021-11-15T19:34:32.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800b1650 con 0x7f258005c770 2021-11-15T19:34:32.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800ad030 con 0x7f2580140aa0 2021-11-15T19:34:32.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f25800b0550 0x7f258014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57672/0 (socket says 172.21.2.137:57672) 2021-11-15T19:34:32.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257ffff700 1 -- 172.21.2.137:0/3222213185 learned_addr learned my addr 172.21.2.137:0/3222213185 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:32.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f2584ea7700 1 --2- 172.21.2.137:0/3222213185 >> v2:172.21.2.137:3300/0 conn(0x7f258005c770 0x7f25800aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f25856a8700 1 --2- 172.21.2.137:0/3222213185 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f2580140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257f7fe700 1 -- 172.21.2.137:0/3222213185 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27027100 0 0) 0x7f258005cb50 con 0x7f25800b0550 2021-11-15T19:34:32.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257f7fe700 1 -- 172.21.2.137:0/3222213185 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2560003260 con 0x7f25800b0550 2021-11-15T19:34:32.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f2584ea7700 1 -- 172.21.2.137:0/3222213185 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 msgr2=0x7f2580140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:32.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f2584ea7700 1 --2- 172.21.2.137:0/3222213185 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f2580140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f2584ea7700 1 -- 172.21.2.137:0/3222213185 >> v1:172.21.2.137:6789/0 conn(0x7f25800b0550 legacy=0x7f258014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f2584ea7700 1 -- 172.21.2.137:0/3222213185 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800ad2d0 con 0x7f258005c770 2021-11-15T19:34:32.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f2584ea7700 1 --2- 172.21.2.137:0/3222213185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f25800aef30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f2570002f70 tx=0x7f2570006df0).ready entity=mon.1 client_cookie=7d8889e6a80adac9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257f7fe700 1 -- 172.21.2.137:0/3222213185 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257000d570 con 0x7f258005c770 2021-11-15T19:34:32.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257f7fe700 1 -- 172.21.2.137:0/3222213185 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570000e90 con 0x7f258005c770 2021-11-15T19:34:32.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f257f7fe700 1 -- 172.21.2.137:0/3222213185 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257000d8c0 con 0x7f258005c770 2021-11-15T19:34:32.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 -- 172.21.2.137:0/3222213185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 msgr2=0x7f25800aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.761+0000 7f258710b700 1 --2- 172.21.2.137:0/3222213185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f25800aef30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f2570002f70 tx=0x7f2570006df0).stop 2021-11-15T19:34:32.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3222213185 shutdown_connections 2021-11-15T19:34:32.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 --2- 172.21.2.137:0/3222213185 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f2580140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 --2- 172.21.2.137:0/3222213185 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f25800aef30 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:32.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3222213185 >> 172.21.2.137:0/3222213185 conn(0x7f25800631e0 msgr2=0x7f258005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:32.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3222213185 shutdown_connections 2021-11-15T19:34:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3222213185 wait complete. 2021-11-15T19:34:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 Processor -- start 2021-11-15T19:34:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- start start 2021-11-15T19:34:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f2580156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25800b0550 0x7f2580141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f25800644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580064070 con 0x7f25800b0550 2021-11-15T19:34:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258014e450 con 0x7f258005c770 2021-11-15T19:34:32.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258014e6f0 con 0x7f2580140aa0 2021-11-15T19:34:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f2580156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f2580156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38892/0 (socket says 172.21.2.137:38892) 2021-11-15T19:34:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 -- 172.21.2.137:0/3363374384 learned_addr learned my addr 172.21.2.137:0/3363374384 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:32.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 -- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 msgr2=0x7f25800644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f25800644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 -- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25800b0550 msgr2=0x7f2580141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25800b0550 0x7f2580141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 -- 172.21.2.137:0/3363374384 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257000b180 con 0x7f258005c770 2021-11-15T19:34:32.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f2584ea7700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f2580156270 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f2570002f70 tx=0x7f2570014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257000dea0 con 0x7f258005c770 2021-11-15T19:34:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257001e400 con 0x7f258005c770 2021-11-15T19:34:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257001e760 con 0x7f258005c770 2021-11-15T19:34:32.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580067560 con 0x7f258005c770 2021-11-15T19:34:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580065da0 con 0x7f258005c770 2021-11-15T19:34:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800641e0 con 0x7f258005c770 2021-11-15T19:34:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2570025030 con 0x7f258005c770 2021-11-15T19:34:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f257dffb700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2564053690 0x7f2564055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:32.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.765+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f257006c970 con 0x7f258005c770 2021-11-15T19:34:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.769+0000 7f257ffff700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2564053690 0x7f2564055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:32.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.769+0000 7f257ffff700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2564053690 0x7f2564055b50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f2568001110 tx=0x7f25680076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:32.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.769+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25800641e0 con 0x7f258005c770 2021-11-15T19:34:32.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:32.877+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f25800641e0 con 0x7f258005c770 2021-11-15T19:34:33.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f257dffb700 1 -- 172.21.2.137:0/3363374384 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f25800641e0 con 0x7f258005c770 2021-11-15T19:34:33.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2564053690 msgr2=0x7f2564055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2564053690 0x7f2564055b50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f2568001110 tx=0x7f25680076c0).stop 2021-11-15T19:34:33.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 msgr2=0x7f2580156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f2580156270 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f2570002f70 tx=0x7f2570014000).stop 2021-11-15T19:34:33.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 shutdown_connections 2021-11-15T19:34:33.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2564053690 0x7f2564055b50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2580140aa0 0x7f25800644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f25800b0550 0x7f2580141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 --2- 172.21.2.137:0/3363374384 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f258005c770 0x7f2580156270 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 >> 172.21.2.137:0/3363374384 conn(0x7f25800631e0 msgr2=0x7f2580148e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 shutdown_connections 2021-11-15T19:34:33.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.413+0000 7f258710b700 1 -- 172.21.2.137:0/3363374384 wait complete. 2021-11-15T19:34:33.431 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:33.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 Processor -- start 2021-11-15T19:34:33.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- start start 2021-11-15T19:34:33.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd23c144610 0x7fd23c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c148190 con 0x7fd23c0b1340 2021-11-15T19:34:33.487 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0b1720 con 0x7fd23c0a9f50 2021-11-15T19:34:33.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c147e70 con 0x7fd23c144610 2021-11-15T19:34:33.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd23c144610 0x7fd23c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd240df7700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd23c0a9f50 0x7fd23c0aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57682/0 (socket says 172.21.2.137:57682) 2021-11-15T19:34:33.488 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd240df7700 1 -- 172.21.2.137:0/1536612471 learned_addr learned my addr 172.21.2.137:0/1536612471 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:33.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1536612471 >> v1:172.21.2.137:6789/0 conn(0x7fd23c0a9f50 legacy=0x7fd23c0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1536612471 >> v1:172.21.2.111:6789/0 conn(0x7fd23c0b1340 legacy=0x7fd23c143f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:33.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1536612471 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0af800 con 0x7fd23c144610 2021-11-15T19:34:33.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 --2- 172.21.2.137:0/1536612471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c144610 0x7fd23c147980 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fd23c062250 tx=0x7fd22c006df0).ready entity=mon.1 client_cookie=2ddb4afaf8c2cfe4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.489 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23affd700 1 -- 172.21.2.137:0/1536612471 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd22c00d5c0 con 0x7fd23c144610 2021-11-15T19:34:33.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23affd700 1 -- 172.21.2.137:0/1536612471 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c000e90 con 0x7fd23c144610 2021-11-15T19:34:33.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23affd700 1 -- 172.21.2.137:0/1536612471 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd22c00d910 con 0x7fd23c144610 2021-11-15T19:34:33.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- 172.21.2.137:0/1536612471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c144610 msgr2=0x7fd23c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 --2- 172.21.2.137:0/1536612471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c144610 0x7fd23c147980 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fd23c062250 tx=0x7fd22c006df0).stop 2021-11-15T19:34:33.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- 172.21.2.137:0/1536612471 shutdown_connections 2021-11-15T19:34:33.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 --2- 172.21.2.137:0/1536612471 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c144610 0x7fd23c147980 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- 172.21.2.137:0/1536612471 >> 172.21.2.137:0/1536612471 conn(0x7fd23c0b4e60 msgr2=0x7fd23c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- 172.21.2.137:0/1536612471 shutdown_connections 2021-11-15T19:34:33.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- 172.21.2.137:0/1536612471 wait complete. 2021-11-15T19:34:33.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 Processor -- start 2021-11-15T19:34:33.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- start start 2021-11-15T19:34:33.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd23c0a9f50 0x7fd23c14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 0x7fd23c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd23c144610 0x7fd23c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0af200 con 0x7fd23c144610 2021-11-15T19:34:33.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0ae320 con 0x7fd23c0b1340 2021-11-15T19:34:33.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd24285a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0aef60 con 0x7fd23c0a9f50 2021-11-15T19:34:33.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 0x7fd23c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 0x7fd23c159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38906/0 (socket says 172.21.2.137:38906) 2021-11-15T19:34:33.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1418169522 learned_addr learned my addr 172.21.2.137:0/1418169522 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:33.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd23c0a9f50 msgr2=0x7fd23c14a6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:33.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd23c0a9f50 0x7fd23c14a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd23c144610 msgr2=0x7fd23c15a230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:33.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd23c144610 0x7fd23c15a230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.473+0000 7fd23b7fe700 1 -- 172.21.2.137:0/1418169522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c00b180 con 0x7fd23c0b1340 2021-11-15T19:34:33.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd23b7fe700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 0x7fd23c159d40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fd23c062250 tx=0x7fd22c012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd22c016070 con 0x7fd23c0b1340 2021-11-15T19:34:33.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c002f70 con 0x7fd23c0b1340 2021-11-15T19:34:33.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0ad730 con 0x7fd23c0b1340 2021-11-15T19:34:33.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c09a2b0 con 0x7fd23c0b1340 2021-11-15T19:34:33.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd22c013f00 con 0x7fd23c0b1340 2021-11-15T19:34:33.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c05faf0 con 0x7fd23c0b1340 2021-11-15T19:34:33.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd22c025030 con 0x7fd23c0b1340 2021-11-15T19:34:33.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2200534f0 0x7fd2200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd22c06c820 con 0x7fd23c0b1340 2021-11-15T19:34:33.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd23bfff700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2200534f0 0x7fd2200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd23bfff700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2200534f0 0x7fd2200559b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd224002fb0 tx=0x7fd224006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.477+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd22c0439c0 con 0x7fd23c0b1340 2021-11-15T19:34:33.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.585+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd23c148190 con 0x7fd23c0b1340 2021-11-15T19:34:33.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.585+0000 7fd2397fa700 1 -- 172.21.2.137:0/1418169522 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fd23c148190 con 0x7fd23c0b1340 2021-11-15T19:34:33.597 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:33.598 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":57,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1937261911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1937261911},{"type":"v1","addr":"172.21.2.111:6835","nonce":1937261911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:32.401324+0000","modified":"2021-11-15T19:34:33.405100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7564":{"gid":7564,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3862600413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3862600413},{"type":"v1","addr":"172.21.2.137:6833","nonce":3862600413}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T19:34:33.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2200534f0 msgr2=0x7fd2200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2200534f0 0x7fd2200559b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd224002fb0 tx=0x7fd224006930).stop 2021-11-15T19:34:33.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 msgr2=0x7fd23c159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 0x7fd23c159d40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fd23c062250 tx=0x7fd22c012000).stop 2021-11-15T19:34:33.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 shutdown_connections 2021-11-15T19:34:33.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd2200534f0 0x7fd2200559b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd23c144610 0x7fd23c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd23c0b1340 0x7fd23c159d40 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 --2- 172.21.2.137:0/1418169522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd23c0a9f50 0x7fd23c14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 >> 172.21.2.137:0/1418169522 conn(0x7fd23c0b4e60 msgr2=0x7fd23c148430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 shutdown_connections 2021-11-15T19:34:33.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.589+0000 7fd24285a700 1 -- 172.21.2.137:0/1418169522 wait complete. 2021-11-15T19:34:33.602 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 57 2021-11-15T19:34:33.604 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:33.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 Processor -- start 2021-11-15T19:34:33.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- start start 2021-11-15T19:34:33.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f46c00b1e70 0x7f46c00ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c0096940 con 0x7f46c00b12f0 2021-11-15T19:34:33.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c0143bf0 con 0x7f46c013fdf0 2021-11-15T19:34:33.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00966a0 con 0x7f46c00b1e70 2021-11-15T19:34:33.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bf7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f46c013fdf0 0x7f46c01434e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57696/0 (socket says 172.21.2.137:57696) 2021-11-15T19:34:33.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bf7fe700 1 -- 172.21.2.137:0/1416661303 learned_addr learned my addr 172.21.2.137:0/1416661303 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:33.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150867507 0 0) 0x7f46c0143bf0 con 0x7f46c013fdf0 2021-11-15T19:34:33.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a0003260 con 0x7f46c013fdf0 2021-11-15T19:34:33.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46beffd700 1 --2- 172.21.2.137:0/1416661303 >> v2:172.21.2.111:3300/0 conn(0x7f46c00b1e70 0x7f46c00ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052392058 0 0) 0x7f46a0003260 con 0x7f46c013fdf0 2021-11-15T19:34:33.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 >> v2:172.21.2.111:3300/0 conn(0x7f46c00b1e70 msgr2=0x7f46c00ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:33.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 --2- 172.21.2.137:0/1416661303 >> v2:172.21.2.111:3300/0 conn(0x7f46c00b1e70 0x7f46c00ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 >> v1:172.21.2.111:6789/0 conn(0x7f46c00b12f0 legacy=0x7f46c0142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:33.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00aaff0 con 0x7f46c013fdf0 2021-11-15T19:34:33.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f46b80019e0 con 0x7f46c013fdf0 2021-11-15T19:34:33.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 >> v1:172.21.2.137:6789/0 conn(0x7f46c013fdf0 legacy=0x7f46c01434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46a0003750 0x7f46a0003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46a0004500 0x7f46a0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004ec0 0x7f46a000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00966a0 con 0x7f46a0003750 2021-11-15T19:34:33.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a000bd80 con 0x7f46a0004500 2021-11-15T19:34:33.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a000bf40 con 0x7f46a0004ec0 2021-11-15T19:34:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46a0004500 0x7f46a0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46beffd700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46a0003750 0x7f46a0003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 -- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004ec0 msgr2=0x7f46a000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bf7fe700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004ec0 0x7f46a000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004ec0 0x7f46a000b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 -- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46a0003750 msgr2=0x7f46a0003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46a0003750 0x7f46a0003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bf7fe700 1 -- 172.21.2.137:0/1416661303 reap_dead start 2021-11-15T19:34:33.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 -- 172.21.2.137:0/1416661303 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0003260 con 0x7f46a0004500 2021-11-15T19:34:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46be7fc700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46a0004500 0x7f46a0004980 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f46b0001fa0 tx=0x7f46b0007a00).ready entity=mon.1 client_cookie=62a286d42dfb22b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0007030 con 0x7f46a0004500 2021-11-15T19:34:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0002e90 con 0x7f46a0004500 2021-11-15T19:34:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46bdffb700 1 -- 172.21.2.137:0/1416661303 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0007380 con 0x7f46a0004500 2021-11-15T19:34:33.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- 172.21.2.137:0/1416661303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46a0004500 msgr2=0x7f46a0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46a0004500 0x7f46a0004980 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f46b0001fa0 tx=0x7f46b0007a00).stop 2021-11-15T19:34:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- 172.21.2.137:0/1416661303 shutdown_connections 2021-11-15T19:34:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 --2- 172.21.2.137:0/1416661303 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46a0004500 0x7f46a0004980 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- 172.21.2.137:0/1416661303 >> 172.21.2.137:0/1416661303 conn(0x7f46c00b2a20 msgr2=0x7f46c00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- 172.21.2.137:0/1416661303 shutdown_connections 2021-11-15T19:34:33.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.645+0000 7f46c5342700 1 -- 172.21.2.137:0/1416661303 wait complete. 2021-11-15T19:34:33.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 Processor -- start 2021-11-15T19:34:33.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- start start 2021-11-15T19:34:33.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004500 0x7f46c005c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 0x7f46c0156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c0156a00 0x7f46c0159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c013d710 con 0x7f46c0156a00 2021-11-15T19:34:33.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0140ee0 con 0x7f46c00b3db0 2021-11-15T19:34:33.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0156e90 con 0x7f46a0004500 2021-11-15T19:34:33.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 0x7f46c0156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 0x7f46c0156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38924/0 (socket says 172.21.2.137:38924) 2021-11-15T19:34:33.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 -- 172.21.2.137:0/3829693377 learned_addr learned my addr 172.21.2.137:0/3829693377 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:33.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 -- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004500 msgr2=0x7f46c005c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004500 0x7f46c005c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 -- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c0156a00 msgr2=0x7f46c0159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c0156a00 0x7f46c0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 -- 172.21.2.137:0/3829693377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0141110 con 0x7f46c00b3db0 2021-11-15T19:34:33.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46be7fc700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 0x7f46c0156510 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f46c013d850 tx=0x7f46b0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b00137c0 con 0x7f46c00b3db0 2021-11-15T19:34:33.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0000e90 con 0x7f46c00b3db0 2021-11-15T19:34:33.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c01413b0 con 0x7f46c00b3db0 2021-11-15T19:34:33.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0155f40 con 0x7f46c00b3db0 2021-11-15T19:34:33.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0013b10 con 0x7f46c00b3db0 2021-11-15T19:34:33.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0141540 con 0x7f46c00b3db0 2021-11-15T19:34:33.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46b0013c70 con 0x7f46c00b3db0 2021-11-15T19:34:33.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46b7fff700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a4053660 0x7f46a4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f46b006c4e0 con 0x7f46c00b3db0 2021-11-15T19:34:33.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.649+0000 7f46beffd700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a4053660 0x7f46a4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.653+0000 7f46beffd700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a4053660 0x7f46a4055b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f46a800c000 tx=0x7f46a8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.653+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46b0043530 con 0x7f46c00b3db0 2021-11-15T19:34:33.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.733+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46c00573d0 con 0x7f46c00b3db0 2021-11-15T19:34:33.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46b7fff700 1 -- 172.21.2.137:0/3829693377 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f46b0046b50 con 0x7f46c00b3db0 2021-11-15T19:34:33.746 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:33.746 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":112,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:33.403628+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:30.346476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:31.378520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:33.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a4053660 msgr2=0x7f46a4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a4053660 0x7f46a4055b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f46a800c000 tx=0x7f46a8008040).stop 2021-11-15T19:34:33.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 msgr2=0x7f46c0156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 0x7f46c0156510 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f46c013d850 tx=0x7f46b0015000).stop 2021-11-15T19:34:33.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 shutdown_connections 2021-11-15T19:34:33.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f46a4053660 0x7f46a4055b20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f46c0156a00 0x7f46c0159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f46c00b3db0 0x7f46c0156510 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 --2- 172.21.2.137:0/3829693377 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f46a0004500 0x7f46c005c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 >> 172.21.2.137:0/3829693377 conn(0x7f46c00b2a20 msgr2=0x7f46c0143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 shutdown_connections 2021-11-15T19:34:33.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.737+0000 7f46c5342700 1 -- 172.21.2.137:0/3829693377 wait complete. 2021-11-15T19:34:33.754 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:34:33.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 Processor -- start 2021-11-15T19:34:33.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 -- start start 2021-11-15T19:34:33.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 0x7ff9080af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff9080b0830 0x7ff9080aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff908147f70 con 0x7ff9080b10b0 2021-11-15T19:34:33.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff908060100 con 0x7ff9080b0830 2021-11-15T19:34:33.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.797+0000 7ff90e51d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff908147cd0 con 0x7ff90805fd20 2021-11-15T19:34:33.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 0x7ff9080af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90caba700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff9080b0830 0x7ff9080aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 0x7ff9080af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:40504/0 (socket says 172.21.2.137:40504) 2021-11-15T19:34:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff9077fe700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7ff9080b10b0 0x7ff9080b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:50210/0 (socket says 172.21.2.137:50210) 2021-11-15T19:34:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 -- 172.21.2.137:0/586778027 learned_addr learned my addr 172.21.2.137:0/586778027 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:33.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 -- 172.21.2.137:0/586778027 >> v2:172.21.2.111:3300/0 conn(0x7ff9080b0830 msgr2=0x7ff9080aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 --2- 172.21.2.137:0/586778027 >> v2:172.21.2.111:3300/0 conn(0x7ff9080b0830 0x7ff9080aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 -- 172.21.2.137:0/586778027 >> v1:172.21.2.111:6789/0 conn(0x7ff9080b10b0 legacy=0x7ff9080b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 -- 172.21.2.137:0/586778027 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080a9ed0 con 0x7ff90805fd20 2021-11-15T19:34:33.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff907fff700 1 --2- 172.21.2.137:0/586778027 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 0x7ff9080af800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff8f0002f70 tx=0x7ff8f0006eb0).ready entity=mon.2 client_cookie=4e32fd3d3254c171 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff906ffd700 1 -- 172.21.2.137:0/586778027 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8f000d570 con 0x7ff90805fd20 2021-11-15T19:34:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff906ffd700 1 -- 172.21.2.137:0/586778027 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0000e90 con 0x7ff90805fd20 2021-11-15T19:34:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff906ffd700 1 -- 172.21.2.137:0/586778027 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8f000d900 con 0x7ff90805fd20 2021-11-15T19:34:33.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 -- 172.21.2.137:0/586778027 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 msgr2=0x7ff9080af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 --2- 172.21.2.137:0/586778027 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 0x7ff9080af800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff8f0002f70 tx=0x7ff8f0006eb0).stop 2021-11-15T19:34:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 -- 172.21.2.137:0/586778027 shutdown_connections 2021-11-15T19:34:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 --2- 172.21.2.137:0/586778027 >> v2:172.21.2.111:3300/0 conn(0x7ff9080b0830 0x7ff9080aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 --2- 172.21.2.137:0/586778027 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff90805fd20 0x7ff9080af800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 -- 172.21.2.137:0/586778027 >> 172.21.2.137:0/586778027 conn(0x7ff9080b4e60 msgr2=0x7ff9080b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 -- 172.21.2.137:0/586778027 shutdown_connections 2021-11-15T19:34:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 -- 172.21.2.137:0/586778027 wait complete. 2021-11-15T19:34:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 Processor -- start 2021-11-15T19:34:33.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.801+0000 7ff90e51d700 1 -- start start 2021-11-15T19:34:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff90805fd20 0x7ff9081464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9080b0830 0x7ff908157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 0x7ff9081416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff908156a90 con 0x7ff90805fd20 2021-11-15T19:34:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff908156d30 con 0x7ff9080b10b0 2021-11-15T19:34:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff908156fd0 con 0x7ff9080b0830 2021-11-15T19:34:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 0x7ff9081416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 0x7ff9081416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38938/0 (socket says 172.21.2.137:38938) 2021-11-15T19:34:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 -- 172.21.2.137:0/1271842224 learned_addr learned my addr 172.21.2.137:0/1271842224 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 -- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9080b0830 msgr2=0x7ff908157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9080b0830 0x7ff908157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 -- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff90805fd20 msgr2=0x7ff9081464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff90805fd20 0x7ff9081464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 -- 172.21.2.137:0/1271842224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f000b1e0 con 0x7ff9080b10b0 2021-11-15T19:34:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90caba700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 0x7ff9081416c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7ff90000c000 tx=0x7ff9000091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90000c850 con 0x7ff9080b10b0 2021-11-15T19:34:33.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90000c9b0 con 0x7ff9080b10b0 2021-11-15T19:34:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90000cd10 con 0x7ff9080b10b0 2021-11-15T19:34:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9081566a0 con 0x7ff9080b10b0 2021-11-15T19:34:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff908064640 con 0x7ff9080b10b0 2021-11-15T19:34:33.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff908157190 con 0x7ff9080b10b0 2021-11-15T19:34:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff900022070 con 0x7ff9080b10b0 2021-11-15T19:34:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff9057fa700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff8ec0534f0 0x7ff8ec0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff90006c020 con 0x7ff9080b10b0 2021-11-15T19:34:33.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff907fff700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff8ec0534f0 0x7ff8ec0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:33.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.805+0000 7ff907fff700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff8ec0534f0 0x7ff8ec0559b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7ff8f0002f70 tx=0x7ff8f0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:33.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.809+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff900043180 con 0x7ff9080b10b0 2021-11-15T19:34:33.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.921+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff9080573d0 con 0x7ff9080b10b0 2021-11-15T19:34:33.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff9057fa700 1 -- 172.21.2.137:0/1271842224 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff900016020 con 0x7ff9080b10b0 2021-11-15T19:34:33.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff8ec0534f0 msgr2=0x7ff8ec0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff8ec0534f0 0x7ff8ec0559b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7ff8f0002f70 tx=0x7ff8f0015000).stop 2021-11-15T19:34:33.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 msgr2=0x7ff9081416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:33.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 0x7ff9081416c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7ff90000c000 tx=0x7ff9000091d0).stop 2021-11-15T19:34:33.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 shutdown_connections 2021-11-15T19:34:33.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff8ec0534f0 0x7ff8ec0559b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff9080b10b0 0x7ff9081416c0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:33.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff9080b0830 0x7ff908157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 --2- 172.21.2.137:0/1271842224 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff90805fd20 0x7ff9081464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:33.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 >> 172.21.2.137:0/1271842224 conn(0x7ff9080b4e60 msgr2=0x7ff908144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:33.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 shutdown_connections 2021-11-15T19:34:33.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.933+0000 7ff90e51d700 1 -- 172.21.2.137:0/1271842224 wait complete. 2021-11-15T19:34:33.948 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:34:33.952 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:34:34.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.993+0000 7f44ba666700 1 Processor -- start 2021-11-15T19:34:34.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.993+0000 7f44ba666700 1 -- start start 2021-11-15T19:34:34.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.993+0000 7f44ba666700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 0x7f44b40af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b4147f70 con 0x7f44b40b0830 2021-11-15T19:34:34.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b4060100 con 0x7f44b40b10b0 2021-11-15T19:34:34.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4147cd0 con 0x7f44b405fd20 2021-11-15T19:34:34.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f44b40b10b0 0x7f44b40b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57730/0 (socket says 172.21.2.137:57730) 2021-11-15T19:34:34.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 -- 172.21.2.137:0/3622759998 learned_addr learned my addr 172.21.2.137:0/3622759998 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:34.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602307352 0 0) 0x7f44b4060100 con 0x7f44b40b10b0 2021-11-15T19:34:34.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4494003260 con 0x7f44b40b10b0 2021-11-15T19:34:34.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b3fff700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 0x7f44b40af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181386334 0 0) 0x7f4494003260 con 0x7f44b40b10b0 2021-11-15T19:34:34.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 msgr2=0x7f44b40af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 0x7f44b40af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 >> v1:172.21.2.111:6789/0 conn(0x7f44b40b0830 legacy=0x7f44b40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40a9ed0 con 0x7f44b40b10b0 2021-11-15T19:34:34.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f449c001660 con 0x7f44b40b10b0 2021-11-15T19:34:34.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 >> v1:172.21.2.137:6789/0 conn(0x7f44b40b10b0 legacy=0x7f44b40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44940037d0 0x7f4494003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 0x7f4494004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4494004b10 0x7f4494004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4147cd0 con 0x7f44940037d0 2021-11-15T19:34:34.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449400b8e0 con 0x7f4494004b10 2021-11-15T19:34:34.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449400baa0 con 0x7f44b405fd20 2021-11-15T19:34:34.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4494004b10 0x7f4494004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b3fff700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44940037d0 0x7f4494003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 0x7f4494004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 -- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 msgr2=0x7f4494004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b405fd20 0x7f4494004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 -- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44940037d0 msgr2=0x7f4494003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f44940037d0 0x7f4494003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 -- 172.21.2.137:0/3622759998 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494003260 con 0x7f4494004b10 2021-11-15T19:34:34.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4494004b10 0x7f4494004f90 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f44940054d0 tx=0x7f44ac007d80).ready entity=mon.1 client_cookie=7b452207026731b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ac001620 con 0x7f4494004b10 2021-11-15T19:34:34.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac006890 con 0x7f4494004b10 2021-11-15T19:34:34.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b2ffd700 1 -- 172.21.2.137:0/3622759998 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ac006bf0 con 0x7f4494004b10 2021-11-15T19:34:34.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/3622759998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4494004b10 msgr2=0x7f4494004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 --2- 172.21.2.137:0/3622759998 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4494004b10 0x7f4494004f90 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f44940054d0 tx=0x7f44ac007d80).stop 2021-11-15T19:34:34.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 -- 172.21.2.137:0/3622759998 reap_dead start 2021-11-15T19:34:34.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/3622759998 shutdown_connections 2021-11-15T19:34:34.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/3622759998 >> 172.21.2.137:0/3622759998 conn(0x7f44b40b4e60 msgr2=0x7f44b40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/3622759998 shutdown_connections 2021-11-15T19:34:34.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/3622759998 wait complete. 2021-11-15T19:34:34.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 Processor -- start 2021-11-15T19:34:34.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- start start 2021-11-15T19:34:34.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4494004b10 0x7f44b4062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 0x7f44b41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b41416a0 0x7f44b4141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4063340 con 0x7f4494004b10 2021-11-15T19:34:34.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4142010 con 0x7f44b41436c0 2021-11-15T19:34:34.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4144660 con 0x7f44b41416a0 2021-11-15T19:34:34.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 0x7f44b41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 0x7f44b41574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38960/0 (socket says 172.21.2.137:38960) 2021-11-15T19:34:34.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 -- 172.21.2.137:0/1029128613 learned_addr learned my addr 172.21.2.137:0/1029128613 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:34.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b3fff700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4494004b10 0x7f44b4062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b8c03700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b41416a0 0x7f44b4141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 -- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b41416a0 msgr2=0x7f44b4141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b41416a0 0x7f44b4141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 -- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4494004b10 msgr2=0x7f44b4062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4494004b10 0x7f44b4062a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 -- 172.21.2.137:0/1029128613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4144900 con 0x7f44b41436c0 2021-11-15T19:34:34.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b37fe700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 0x7f44b41574c0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f449c00b000 tx=0x7f44b40b5e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c015630 con 0x7f44b41436c0 2021-11-15T19:34:34.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c010040 con 0x7f44b41436c0 2021-11-15T19:34:34.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b40630a0 con 0x7f44b41436c0 2021-11-15T19:34:34.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c015980 con 0x7f44b41436c0 2021-11-15T19:34:34.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:33.997+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b41432c0 con 0x7f44b41436c0 2021-11-15T19:34:34.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b41479f0 con 0x7f44b41436c0 2021-11-15T19:34:34.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f449c015ae0 con 0x7f44b41436c0 2021-11-15T19:34:34.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44b17fa700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44980534f0 0x7f44980559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f449c06b3e0 con 0x7f44b41436c0 2021-11-15T19:34:34.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44b3fff700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44980534f0 0x7f44980559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44b3fff700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44980534f0 0x7f44980559b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f44a400c000 tx=0x7f44a4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.001+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f449c042540 con 0x7f44b41436c0 2021-11-15T19:34:34.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.113+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f44b40573d0 con 0x7f44b41436c0 2021-11-15T19:34:34.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44b17fa700 1 -- 172.21.2.137:0/1029128613 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f449c045b60 con 0x7f44b41436c0 2021-11-15T19:34:34.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44980534f0 msgr2=0x7f44980559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44980534f0 0x7f44980559b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f44a400c000 tx=0x7f44a4008040).stop 2021-11-15T19:34:34.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 msgr2=0x7f44b41574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 0x7f44b41574c0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f449c00b000 tx=0x7f44b40b5e40).stop 2021-11-15T19:34:34.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 shutdown_connections 2021-11-15T19:34:34.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f44980534f0 0x7f44980559b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f44b41416a0 0x7f44b4141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f44b41436c0 0x7f44b41574c0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 --2- 172.21.2.137:0/1029128613 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4494004b10 0x7f44b4062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 >> 172.21.2.137:0/1029128613 conn(0x7f44b40b4e60 msgr2=0x7f44b41464c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 shutdown_connections 2021-11-15T19:34:34.143 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.133+0000 7f44ba666700 1 -- 172.21.2.137:0/1029128613 wait complete. 2021-11-15T19:34:34.143 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:34:34.146 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:34:34.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.189+0000 7eff1509f700 1 Processor -- start 2021-11-15T19:34:34.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.189+0000 7eff1509f700 1 -- start start 2021-11-15T19:34:34.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.189+0000 7eff1509f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 0x7eff10097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.189+0000 7eff1509f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100aca80 con 0x7eff100969e0 2021-11-15T19:34:34.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.189+0000 7eff1509f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100accb0 con 0x7eff100b2c30 2021-11-15T19:34:34.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.189+0000 7eff1509f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100ad150 con 0x7eff10097260 2021-11-15T19:34:34.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7eff100b2c30 0x7eff100990e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57752/0 (socket says 172.21.2.137:57752) 2021-11-15T19:34:34.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 -- 172.21.2.137:0/3854994453 learned_addr learned my addr 172.21.2.137:0/3854994453 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:34.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53780394 0 0) 0x7eff100accb0 con 0x7eff100b2c30 2021-11-15T19:34:34.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef0003260 con 0x7eff100b2c30 2021-11-15T19:34:34.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 0x7eff10097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006387370 0 0) 0x7efef0003260 con 0x7eff100b2c30 2021-11-15T19:34:34.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 msgr2=0x7eff10097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 0x7eff10097640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 >> v1:172.21.2.111:6789/0 conn(0x7eff100969e0 legacy=0x7eff1005f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10097c50 con 0x7eff100b2c30 2021-11-15T19:34:34.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7eff00001660 con 0x7eff100b2c30 2021-11-15T19:34:34.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 >> v1:172.21.2.137:6789/0 conn(0x7eff100b2c30 legacy=0x7eff100990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efef00037d0 0x7efef0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 0x7efef0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efef0004a60 0x7efef0004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef000b8e0 con 0x7efef0004a60 2021-11-15T19:34:34.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef000ba20 con 0x7efef00037d0 2021-11-15T19:34:34.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef000bbb0 con 0x7eff10097260 2021-11-15T19:34:34.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efef00037d0 0x7efef0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 -- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 msgr2=0x7efef0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff10097260 0x7efef0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 -- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efef0004a60 msgr2=0x7efef0004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efef0004a60 0x7efef0004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 -- 172.21.2.137:0/3854994453 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef0003260 con 0x7efef00037d0 2021-11-15T19:34:34.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efef00037d0 0x7efef0003bd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7efef800a000 tx=0x7efef8008040).ready entity=mon.1 client_cookie=5d97fc90d42e9b84 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef8013670 con 0x7efef00037d0 2021-11-15T19:34:34.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef80137d0 con 0x7efef00037d0 2021-11-15T19:34:34.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0dd9b700 1 -- 172.21.2.137:0/3854994453 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef8013b30 con 0x7efef00037d0 2021-11-15T19:34:34.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/3854994453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efef00037d0 msgr2=0x7efef0003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 --2- 172.21.2.137:0/3854994453 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efef00037d0 0x7efef0003bd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7efef800a000 tx=0x7efef8008040).stop 2021-11-15T19:34:34.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0f59e700 1 -- 172.21.2.137:0/3854994453 reap_dead start 2021-11-15T19:34:34.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/3854994453 shutdown_connections 2021-11-15T19:34:34.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/3854994453 >> 172.21.2.137:0/3854994453 conn(0x7eff100b7070 msgr2=0x7eff100b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/3854994453 shutdown_connections 2021-11-15T19:34:34.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/3854994453 wait complete. 2021-11-15T19:34:34.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 Processor -- start 2021-11-15T19:34:34.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- start start 2021-11-15T19:34:34.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efef00037d0 0x7eff100af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 0x7eff1009c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff101533c0 0x7eff10153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100aec70 con 0x7eff101533c0 2021-11-15T19:34:34.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100aef10 con 0x7eff1009be00 2021-11-15T19:34:34.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1009b950 con 0x7efef00037d0 2021-11-15T19:34:34.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 0x7eff1009c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 0x7eff1009c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38982/0 (socket says 172.21.2.137:38982) 2021-11-15T19:34:34.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 -- 172.21.2.137:0/1351724395 learned_addr learned my addr 172.21.2.137:0/1351724395 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:34.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 -- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efef00037d0 msgr2=0x7eff100af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efef00037d0 0x7eff100af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 -- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff101533c0 msgr2=0x7eff10153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff101533c0 0x7eff10153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 -- 172.21.2.137:0/1351724395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100afc30 con 0x7eff1009be00 2021-11-15T19:34:34.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff0e59c700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 0x7eff1009c280 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7eff100b7e10 tx=0x7eff00001a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff00007170 con 0x7eff1009be00 2021-11-15T19:34:34.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff000072d0 con 0x7eff1009be00 2021-11-15T19:34:34.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff00004920 con 0x7eff1009be00 2021-11-15T19:34:34.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff100ae960 con 0x7eff1009be00 2021-11-15T19:34:34.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.193+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff10153f80 con 0x7eff1009be00 2021-11-15T19:34:34.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1009bb10 con 0x7eff1009be00 2021-11-15T19:34:34.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff00004a80 con 0x7eff1009be00 2021-11-15T19:34:34.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff07fff700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef4053640 0x7efef4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7eff0006b650 con 0x7eff1009be00 2021-11-15T19:34:34.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef4053640 0x7efef4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff0ed9d700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef4053640 0x7efef4055b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7efef800a000 tx=0x7efef8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.197+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff000426a0 con 0x7eff1009be00 2021-11-15T19:34:34.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.309+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7eff1005f730 con 0x7eff1009be00 2021-11-15T19:34:34.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff07fff700 1 -- 172.21.2.137:0/1351724395 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7eff00045cc0 con 0x7eff1009be00 2021-11-15T19:34:34.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef4053640 msgr2=0x7efef4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef4053640 0x7efef4055b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7efef800a000 tx=0x7efef8008040).stop 2021-11-15T19:34:34.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 msgr2=0x7eff1009c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 0x7eff1009c280 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7eff100b7e10 tx=0x7eff00001a60).stop 2021-11-15T19:34:34.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 shutdown_connections 2021-11-15T19:34:34.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efef4053640 0x7efef4055b00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff101533c0 0x7eff10153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff1009be00 0x7eff1009c280 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 --2- 172.21.2.137:0/1351724395 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efef00037d0 0x7eff100af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 >> 172.21.2.137:0/1351724395 conn(0x7eff100b7070 msgr2=0x7eff100b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 shutdown_connections 2021-11-15T19:34:34.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.325+0000 7eff1509f700 1 -- 172.21.2.137:0/1351724395 wait complete. 2021-11-15T19:34:34.338 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:34:34.342 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:34.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 Processor -- start 2021-11-15T19:34:34.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 -- start start 2021-11-15T19:34:34.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe290063010 0x7fe29013e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe2900b1270 0x7fe2901423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900633f0 con 0x7fe2900ac8c0 2021-11-15T19:34:34.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe290067af0 con 0x7fe2900b1270 2021-11-15T19:34:34.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900af790 con 0x7fe290063010 2021-11-15T19:34:34.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe290063010 0x7fe29013e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe290063010 0x7fe29013e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38986/0 (socket says 172.21.2.137:38986) 2021-11-15T19:34:34.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 -- 172.21.2.137:0/738831125 learned_addr learned my addr 172.21.2.137:0/738831125 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 -- 172.21.2.137:0/738831125 >> v2:172.21.2.111:3300/0 conn(0x7fe2900b1270 msgr2=0x7fe2901423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 --2- 172.21.2.137:0/738831125 >> v2:172.21.2.111:3300/0 conn(0x7fe2900b1270 0x7fe2901423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 -- 172.21.2.137:0/738831125 >> v1:172.21.2.111:6789/0 conn(0x7fe2900ac8c0 legacy=0x7fe29013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 -- 172.21.2.137:0/738831125 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900afa30 con 0x7fe290063010 2021-11-15T19:34:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28f7fe700 1 --2- 172.21.2.137:0/738831125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe290063010 0x7fe29013e030 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fe29005caf0 tx=0x7fe280006eb0).ready entity=mon.1 client_cookie=2ac9658ced2f30f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28e7fc700 1 -- 172.21.2.137:0/738831125 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe280010810 con 0x7fe290063010 2021-11-15T19:34:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28e7fc700 1 -- 172.21.2.137:0/738831125 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280000e90 con 0x7fe290063010 2021-11-15T19:34:34.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe28e7fc700 1 -- 172.21.2.137:0/738831125 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe280010ba0 con 0x7fe290063010 2021-11-15T19:34:34.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 -- 172.21.2.137:0/738831125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe290063010 msgr2=0x7fe29013e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.381+0000 7fe295fc7700 1 --2- 172.21.2.137:0/738831125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe290063010 0x7fe29013e030 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fe29005caf0 tx=0x7fe280006eb0).stop 2021-11-15T19:34:34.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/738831125 shutdown_connections 2021-11-15T19:34:34.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 --2- 172.21.2.137:0/738831125 >> v2:172.21.2.111:3300/0 conn(0x7fe2900b1270 0x7fe2901423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 --2- 172.21.2.137:0/738831125 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe290063010 0x7fe29013e030 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/738831125 >> 172.21.2.137:0/738831125 conn(0x7fe29005bd20 msgr2=0x7fe29005c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/738831125 shutdown_connections 2021-11-15T19:34:34.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/738831125 wait complete. 2021-11-15T19:34:34.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 Processor -- start 2021-11-15T19:34:34.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- start start 2021-11-15T19:34:34.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe290063010 0x7fe2900b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2900ac8c0 0x7fe2901405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 0x7fe2900661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290065a70 con 0x7fe290063010 2021-11-15T19:34:34.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290065d10 con 0x7fe2900b1270 2021-11-15T19:34:34.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290140ad0 con 0x7fe2900ac8c0 2021-11-15T19:34:34.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 0x7fe2900661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 0x7fe2900661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:38996/0 (socket says 172.21.2.137:38996) 2021-11-15T19:34:34.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 -- 172.21.2.137:0/924437338 learned_addr learned my addr 172.21.2.137:0/924437338 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:34.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 -- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2900ac8c0 msgr2=0x7fe2901405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2900ac8c0 0x7fe2901405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 -- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe290063010 msgr2=0x7fe2900b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe290063010 0x7fe2900b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 -- 172.21.2.137:0/924437338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28000c2f0 con 0x7fe2900b1270 2021-11-15T19:34:34.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28ffff700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 0x7fe2900661b0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7fe2880032f0 tx=0x7fe2880091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe28800f510 con 0x7fe2900b1270 2021-11-15T19:34:34.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900656c0 con 0x7fe2900b1270 2021-11-15T19:34:34.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800f670 con 0x7fe2900b1270 2021-11-15T19:34:34.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe28800f7e0 con 0x7fe2900b1270 2021-11-15T19:34:34.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe290140270 con 0x7fe2900b1270 2021-11-15T19:34:34.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29013ec30 con 0x7fe2900b1270 2021-11-15T19:34:34.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe28800f070 con 0x7fe2900b1270 2021-11-15T19:34:34.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28cff9700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe274053640 0x7fe274055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.385+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe28806b620 con 0x7fe2900b1270 2021-11-15T19:34:34.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.389+0000 7fe28f7fe700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe274053640 0x7fe274055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.389+0000 7fe28f7fe700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe274053640 0x7fe274055b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe29005caf0 tx=0x7fe280017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.389+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe288042720 con 0x7fe2900b1270 2021-11-15T19:34:34.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.497+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2900573d0 con 0x7fe2900b1270 2021-11-15T19:34:34.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.497+0000 7fe28cff9700 1 -- 172.21.2.137:0/924437338 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fe288045d40 con 0x7fe2900b1270 2021-11-15T19:34:34.510 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:34.510 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":57,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1937261911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1937261911},{"type":"v1","addr":"172.21.2.111:6835","nonce":1937261911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:32.401324+0000","modified":"2021-11-15T19:34:33.405100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7564":{"gid":7564,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3862600413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3862600413},{"type":"v1","addr":"172.21.2.137:6833","nonce":3862600413}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T19:34:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe274053640 msgr2=0x7fe274055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe274053640 0x7fe274055b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe29005caf0 tx=0x7fe280017000).stop 2021-11-15T19:34:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 msgr2=0x7fe2900661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 0x7fe2900661b0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7fe2880032f0 tx=0x7fe2880091a0).stop 2021-11-15T19:34:34.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 shutdown_connections 2021-11-15T19:34:34.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe274053640 0x7fe274055b00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe2900b1270 0x7fe2900661b0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe2900ac8c0 0x7fe2901405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 --2- 172.21.2.137:0/924437338 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe290063010 0x7fe2900b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 >> 172.21.2.137:0/924437338 conn(0x7fe29005bd20 msgr2=0x7fe2900ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 shutdown_connections 2021-11-15T19:34:34.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.501+0000 7fe295fc7700 1 -- 172.21.2.137:0/924437338 wait complete. 2021-11-15T19:34:34.514 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 57 2021-11-15T19:34:34.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:34:32.401324+0000', 'modified': '2021-11-15T19:34:33.405100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7564}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7564': {'gid': 7564, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/3862600413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 3862600413}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 3862600413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:34:34.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:34:34.720 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:34:34.789 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7564,"want_state":"up:active","state":"up:active","rank_uptime":2.3779015509999999,"mdsmap_epoch":57,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":6.5430057330000002} 2021-11-15T19:34:34.789 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7564, "mdsmap_epoch": 57, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 2.377901551, "state": "up:active", "uptime": 6.543005733, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:34:34.790 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:34.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 Processor -- start 2021-11-15T19:34:34.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- start start 2021-11-15T19:34:34.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc0d00b1340 0x7fc0d0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc0d0143f00 0x7fc0d0144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d0148190 con 0x7fc0d00a9f50 2021-11-15T19:34:34.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00b1720 con 0x7fc0d0143f00 2021-11-15T19:34:34.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d0147e70 con 0x7fc0d00b1340 2021-11-15T19:34:34.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc0d00b1340 0x7fc0d0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc0d00b1340 0x7fc0d0147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39000/0 (socket says 172.21.2.137:39000) 2021-11-15T19:34:34.842 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 -- 172.21.2.137:0/4284818535 learned_addr learned my addr 172.21.2.137:0/4284818535 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:34.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 -- 172.21.2.137:0/4284818535 >> v2:172.21.2.111:3300/0 conn(0x7fc0d0143f00 msgr2=0x7fc0d0144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 --2- 172.21.2.137:0/4284818535 >> v2:172.21.2.111:3300/0 conn(0x7fc0d0143f00 0x7fc0d0144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 -- 172.21.2.137:0/4284818535 >> v1:172.21.2.111:6789/0 conn(0x7fc0d00a9f50 legacy=0x7fc0d00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 -- 172.21.2.137:0/4284818535 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00af800 con 0x7fc0d00b1340 2021-11-15T19:34:34.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d49f9700 1 --2- 172.21.2.137:0/4284818535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d00b1340 0x7fc0d0147980 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fc0d0062250 tx=0x7fc0c0006eb0).ready entity=mon.1 client_cookie=cf226e947e8d5962 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0cf7fe700 1 -- 172.21.2.137:0/4284818535 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c000d5c0 con 0x7fc0d00b1340 2021-11-15T19:34:34.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0cf7fe700 1 -- 172.21.2.137:0/4284818535 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0000e90 con 0x7fc0d00b1340 2021-11-15T19:34:34.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0cf7fe700 1 -- 172.21.2.137:0/4284818535 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c000d910 con 0x7fc0d00b1340 2021-11-15T19:34:34.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/4284818535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d00b1340 msgr2=0x7fc0d0147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/4284818535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d00b1340 0x7fc0d0147980 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fc0d0062250 tx=0x7fc0c0006eb0).stop 2021-11-15T19:34:34.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/4284818535 shutdown_connections 2021-11-15T19:34:34.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/4284818535 >> v2:172.21.2.111:3300/0 conn(0x7fc0d0143f00 0x7fc0d0144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/4284818535 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d00b1340 0x7fc0d0147980 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/4284818535 >> 172.21.2.137:0/4284818535 conn(0x7fc0d00b4e60 msgr2=0x7fc0d00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/4284818535 shutdown_connections 2021-11-15T19:34:34.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.829+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/4284818535 wait complete. 2021-11-15T19:34:34.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 Processor -- start 2021-11-15T19:34:34.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- start start 2021-11-15T19:34:34.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0d00a9f50 0x7fc0d0140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0d00b1340 0x7fc0d0142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 0x7fc0d01433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d014ae20 con 0x7fc0d00b1340 2021-11-15T19:34:34.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00ac9e0 con 0x7fc0d0143f00 2021-11-15T19:34:34.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d01438d0 con 0x7fc0d00a9f50 2021-11-15T19:34:34.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 0x7fc0d01433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 0x7fc0d01433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39008/0 (socket says 172.21.2.137:39008) 2021-11-15T19:34:34.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 -- 172.21.2.137:0/2951215295 learned_addr learned my addr 172.21.2.137:0/2951215295 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:34.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 -- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0d00a9f50 msgr2=0x7fc0d0140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0d00a9f50 0x7fc0d0140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 -- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0d00b1340 msgr2=0x7fc0d0142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0d00b1340 0x7fc0d0142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 -- 172.21.2.137:0/2951215295 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c000b1e0 con 0x7fc0d0143f00 2021-11-15T19:34:34.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d51fa700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 0x7fc0d01433e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fc0c8003270 tx=0x7fc0c80090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c800d4a0 con 0x7fc0d0143f00 2021-11-15T19:34:34.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c800d600 con 0x7fc0d0143f00 2021-11-15T19:34:34.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c800d960 con 0x7fc0d0143f00 2021-11-15T19:34:34.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d00acc80 con 0x7fc0d0143f00 2021-11-15T19:34:34.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d00ac2a0 con 0x7fc0d0143f00 2021-11-15T19:34:34.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d014af90 con 0x7fc0d0143f00 2021-11-15T19:34:34.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc0c8018030 con 0x7fc0d0143f00 2021-11-15T19:34:34.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0cdffb700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0b4053570 0x7fc0b4055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc0c806b330 con 0x7fc0d0143f00 2021-11-15T19:34:34.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.833+0000 7fc0d49f9700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0b4053570 0x7fc0b4055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.837+0000 7fc0d49f9700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0b4053570 0x7fc0b4055a30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc0d0062250 tx=0x7fc0c0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:34.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.837+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0d014af90 con 0x7fc0d0143f00 2021-11-15T19:34:34.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0d0140940 con 0x7fc0d0143f00 2021-11-15T19:34:34.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0cdffb700 1 -- 172.21.2.137:0/2951215295 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fc0c8023ed0 con 0x7fc0d0143f00 2021-11-15T19:34:34.931 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:34.931 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":112,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:33.403628+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:30.346476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:31.378520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:34.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0b4053570 msgr2=0x7fc0b4055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0b4053570 0x7fc0b4055a30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc0d0062250 tx=0x7fc0c0015000).stop 2021-11-15T19:34:34.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 msgr2=0x7fc0d01433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:34.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 0x7fc0d01433e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fc0c8003270 tx=0x7fc0c80090f0).stop 2021-11-15T19:34:34.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 shutdown_connections 2021-11-15T19:34:34.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0b4053570 0x7fc0b4055a30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0d0143f00 0x7fc0d01433e0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc0d00b1340 0x7fc0d0142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 --2- 172.21.2.137:0/2951215295 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc0d00a9f50 0x7fc0d0140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:34.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 >> 172.21.2.137:0/2951215295 conn(0x7fc0d00b4e60 msgr2=0x7fc0d00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:34.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 shutdown_connections 2021-11-15T19:34:34.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.921+0000 7fc0d6c5d700 1 -- 172.21.2.137:0/2951215295 wait complete. 2021-11-15T19:34:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:34:30.346476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:34:31.378520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:34:34.939 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:34:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17bf11700 1 Processor -- start 2021-11-15T19:34:34.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17bf11700 1 -- start start 2021-11-15T19:34:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17bf11700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe174065730 0x7fe17413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:34.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17bf11700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174066270 con 0x7fe1740b00a0 2021-11-15T19:34:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17bf11700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174065fd0 con 0x7fe174065b10 2021-11-15T19:34:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17bf11700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe174067410 con 0x7fe174065730 2021-11-15T19:34:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe174065b10 0x7fe17413c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57800/0 (socket says 172.21.2.137:57800) 2021-11-15T19:34:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 -- 172.21.2.137:0/105684284 learned_addr learned my addr 172.21.2.137:0/105684284 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:34.993 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828897896 0 0) 0x7fe174065fd0 con 0x7fe174065b10 2021-11-15T19:34:34.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe15c003260 con 0x7fe174065b10 2021-11-15T19:34:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe179cad700 1 --2- 172.21.2.137:0/105684284 >> v2:172.21.2.111:3300/0 conn(0x7fe174065730 0x7fe17413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3402322403 0 0) 0x7fe15c003260 con 0x7fe174065b10 2021-11-15T19:34:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 >> v2:172.21.2.111:3300/0 conn(0x7fe174065730 msgr2=0x7fe17413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 --2- 172.21.2.137:0/105684284 >> v2:172.21.2.111:3300/0 conn(0x7fe174065730 0x7fe17413c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 >> v1:172.21.2.111:6789/0 conn(0x7fe1740b00a0 legacy=0x7fe17405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174066f70 con 0x7fe174065b10 2021-11-15T19:34:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe170001660 con 0x7fe174065b10 2021-11-15T19:34:34.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 >> v1:172.21.2.137:6789/0 conn(0x7fe174065b10 legacy=0x7fe17413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe15c003820 0x7fe15c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe15c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe15c004f70 0x7fe15c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174067410 con 0x7fe15c003820 2021-11-15T19:34:35.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c00be50 con 0x7fe15c004500 2021-11-15T19:34:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c00c010 con 0x7fe15c004f70 2021-11-15T19:34:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe15c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 -- 172.21.2.137:0/105684284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe15c004f70 msgr2=0x7fe15c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe15c004f70 0x7fe15c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 -- 172.21.2.137:0/105684284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe15c003820 msgr2=0x7fe15c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe15c003820 0x7fe15c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 -- 172.21.2.137:0/105684284 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c003260 con 0x7fe15c004500 2021-11-15T19:34:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe17a4ae700 1 -- 172.21.2.137:0/105684284 reap_dead start 2021-11-15T19:34:35.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe1794ac700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe15c004980 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fe1740612c0 tx=0x7fe174067100).ready entity=mon.1 client_cookie=47f768e268318964 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1700070d0 con 0x7fe15c004500 2021-11-15T19:34:35.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170007230 con 0x7fe15c004500 2021-11-15T19:34:35.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.981+0000 7fe178cab700 1 -- 172.21.2.137:0/105684284 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17000c8c0 con 0x7fe15c004500 2021-11-15T19:34:35.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/105684284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 msgr2=0x7fe15c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe15c004980 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fe1740612c0 tx=0x7fe174067100).stop 2021-11-15T19:34:35.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/105684284 shutdown_connections 2021-11-15T19:34:35.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 --2- 172.21.2.137:0/105684284 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe15c004980 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/105684284 >> 172.21.2.137:0/105684284 conn(0x7fe174060290 msgr2=0x7fe174060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/105684284 shutdown_connections 2021-11-15T19:34:35.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/105684284 wait complete. 2021-11-15T19:34:35.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 Processor -- start 2021-11-15T19:34:35.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- start start 2021-11-15T19:34:35.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe174141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1740aed30 0x7fe174143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe17413b3c0 0x7fe17413b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740aeb30 con 0x7fe1740aed30 2021-11-15T19:34:35.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174143070 con 0x7fe15c004500 2021-11-15T19:34:35.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe174140590 con 0x7fe17413b3c0 2021-11-15T19:34:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe174141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe174141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39026/0 (socket says 172.21.2.137:39026) 2021-11-15T19:34:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 -- 172.21.2.137:0/1947162452 learned_addr learned my addr 172.21.2.137:0/1947162452 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 -- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe17413b3c0 msgr2=0x7fe17413b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe17413b3c0 0x7fe17413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 -- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1740aed30 msgr2=0x7fe174143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1740aed30 0x7fe174143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 -- 172.21.2.137:0/1947162452 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174143d10 con 0x7fe15c004500 2021-11-15T19:34:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe179cad700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe174141890 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fe16800c000 tx=0x7fe16800b250).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe168009070 con 0x7fe15c004500 2021-11-15T19:34:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168000e90 con 0x7fe15c004500 2021-11-15T19:34:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe174155390 con 0x7fe15c004500 2021-11-15T19:34:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe174140bd0 con 0x7fe15c004500 2021-11-15T19:34:35.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe16800dea0 con 0x7fe15c004500 2021-11-15T19:34:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.985+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1740b0fb0 con 0x7fe15c004500 2021-11-15T19:34:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.989+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe16801c060 con 0x7fe15c004500 2021-11-15T19:34:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.989+0000 7fe166ffd700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe154053720 0x7fe154055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.989+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe16806bb00 con 0x7fe15c004500 2021-11-15T19:34:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.989+0000 7fe1794ac700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe154053720 0x7fe154055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.989+0000 7fe1794ac700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe154053720 0x7fe154055be0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fe1740612c0 tx=0x7fe170013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:34.989+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe168042b50 con 0x7fe15c004500 2021-11-15T19:34:35.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe1740573d0 con 0x7fe15c004500 2021-11-15T19:34:35.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe166ffd700 1 -- 172.21.2.137:0/1947162452 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe16801a070 con 0x7fe15c004500 2021-11-15T19:34:35.082 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:34:35.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe154053720 msgr2=0x7fe154055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe154053720 0x7fe154055be0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fe1740612c0 tx=0x7fe170013000).stop 2021-11-15T19:34:35.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 msgr2=0x7fe174141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe174141890 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fe16800c000 tx=0x7fe16800b250).stop 2021-11-15T19:34:35.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 shutdown_connections 2021-11-15T19:34:35.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe154053720 0x7fe154055be0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe17413b3c0 0x7fe17413b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1740aed30 0x7fe174143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 --2- 172.21.2.137:0/1947162452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe15c004500 0x7fe174141890 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 >> 172.21.2.137:0/1947162452 conn(0x7fe174060290 msgr2=0x7fe174069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 shutdown_connections 2021-11-15T19:34:35.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.073+0000 7fe17bf11700 1 -- 172.21.2.137:0/1947162452 wait complete. 2021-11-15T19:34:35.089 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:34:35.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.129+0000 7f1184053700 1 Processor -- start 2021-11-15T19:34:35.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.129+0000 7f1184053700 1 -- start start 2021-11-15T19:34:35.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 0x7f117c140410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0b6670 con 0x7f117c0b2240 2021-11-15T19:34:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c1438e0 con 0x7f117c0b6290 2021-11-15T19:34:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c143b80 con 0x7f117c064180 2021-11-15T19:34:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1181def700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f117c0b6290 0x7f117c1288d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57816/0 (socket says 172.21.2.137:57816) 2021-11-15T19:34:35.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1181def700 1 -- 172.21.2.137:0/3380348767 learned_addr learned my addr 172.21.2.137:0/3380348767 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667450707 0 0) 0x7f117c1438e0 con 0x7f117c0b6290 2021-11-15T19:34:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1160003260 con 0x7f117c0b6290 2021-11-15T19:34:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550654253 0 0) 0x7f1160003260 con 0x7f117c0b6290 2021-11-15T19:34:35.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 msgr2=0x7f117c140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 0x7f117c140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 >> v1:172.21.2.111:6789/0 conn(0x7f117c0b2240 legacy=0x7f117c13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c13f830 con 0x7f117c0b6290 2021-11-15T19:34:35.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1178001660 con 0x7f117c0b6290 2021-11-15T19:34:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 >> v1:172.21.2.137:6789/0 conn(0x7f117c0b6290 legacy=0x7f117c1288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 0x7f11600037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1160003ec0 0x7f1160004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1160004b40 0x7f1160004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c143b80 con 0x7f1160003ec0 2021-11-15T19:34:35.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116000ba00 con 0x7f1160004b40 2021-11-15T19:34:35.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116000bbc0 con 0x7f117c064180 2021-11-15T19:34:35.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1160004b40 0x7f1160004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1181def700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 0x7f11600037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11815ee700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1160003ec0 0x7f1160004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 -- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 msgr2=0x7f11600037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c064180 0x7f11600037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 -- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1160003ec0 msgr2=0x7f1160004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1160003ec0 0x7f1160004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 -- 172.21.2.137:0/3380348767 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160003260 con 0x7f1160004b40 2021-11-15T19:34:35.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11815ee700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1160003ec0 0x7f1160004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:35.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1160004b40 0x7f1160004fc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f11740032f0 tx=0x7f1174006f90).ready entity=mon.1 client_cookie=8d82113df66e129e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117400b460 con 0x7f1160004b40 2021-11-15T19:34:35.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117400b5c0 con 0x7f1160004b40 2021-11-15T19:34:35.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1180ded700 1 -- 172.21.2.137:0/3380348767 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117400b920 con 0x7f1160004b40 2021-11-15T19:34:35.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- 172.21.2.137:0/3380348767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1160004b40 msgr2=0x7f1160004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 --2- 172.21.2.137:0/3380348767 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1160004b40 0x7f1160004fc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f11740032f0 tx=0x7f1174006f90).stop 2021-11-15T19:34:35.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f11825f0700 1 -- 172.21.2.137:0/3380348767 reap_dead start 2021-11-15T19:34:35.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- 172.21.2.137:0/3380348767 shutdown_connections 2021-11-15T19:34:35.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- 172.21.2.137:0/3380348767 >> 172.21.2.137:0/3380348767 conn(0x7f117c069e70 msgr2=0x7f117c0639e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- 172.21.2.137:0/3380348767 shutdown_connections 2021-11-15T19:34:35.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- 172.21.2.137:0/3380348767 wait complete. 2021-11-15T19:34:35.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 Processor -- start 2021-11-15T19:34:35.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.133+0000 7f1184053700 1 -- start start 2021-11-15T19:34:35.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f117c127d30 0x7f117c155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c065050 0x7f117c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 0x7f117c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c067290 con 0x7f117c127d30 2021-11-15T19:34:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c128110 con 0x7f117c1422b0 2021-11-15T19:34:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0674b0 con 0x7f117c065050 2021-11-15T19:34:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 0x7f117c13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 0x7f117c13ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39044/0 (socket says 172.21.2.137:39044) 2021-11-15T19:34:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 -- 172.21.2.137:0/1903826869 learned_addr learned my addr 172.21.2.137:0/1903826869 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1181def700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f117c127d30 0x7f117c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11815ee700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c065050 0x7f117c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 -- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c065050 msgr2=0x7f117c142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c065050 0x7f117c142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 -- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f117c127d30 msgr2=0x7f117c155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f117c127d30 0x7f117c155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 -- 172.21.2.137:0/1903826869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c067750 con 0x7f117c1422b0 2021-11-15T19:34:35.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1181def700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f117c127d30 0x7f117c155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:35.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11815ee700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c065050 0x7f117c142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:35.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f11825f0700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 0x7f117c13ea80 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f117c151e60 tx=0x7f1174016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117400b460 con 0x7f117c1422b0 2021-11-15T19:34:35.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c143450 con 0x7f117c1422b0 2021-11-15T19:34:35.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174011d60 con 0x7f117c1422b0 2021-11-15T19:34:35.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117401d620 con 0x7f117c1422b0 2021-11-15T19:34:35.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c141db0 con 0x7f117c1422b0 2021-11-15T19:34:35.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c064d10 con 0x7f117c1422b0 2021-11-15T19:34:35.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1174024030 con 0x7f117c1422b0 2021-11-15T19:34:35.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f116effd700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1164053610 0x7f1164055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f117406c480 con 0x7f117c1422b0 2021-11-15T19:34:35.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.137+0000 7f1181def700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1164053610 0x7f1164055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.141+0000 7f1181def700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1164053610 0x7f1164055ad0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f1178009000 tx=0x7f1178009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.141+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1174043710 con 0x7f117c1422b0 2021-11-15T19:34:35.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.221+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f117c0b0960 con 0x7f117c1422b0 2021-11-15T19:34:35.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.221+0000 7f116effd700 1 -- 172.21.2.137:0/1903826869 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1174022020 con 0x7f117c1422b0 2021-11-15T19:34:35.234 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:35.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1164053610 msgr2=0x7f1164055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1164053610 0x7f1164055ad0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f1178009000 tx=0x7f1178009040).stop 2021-11-15T19:34:35.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 msgr2=0x7f117c13ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 0x7f117c13ea80 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f117c151e60 tx=0x7f1174016000).stop 2021-11-15T19:34:35.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 shutdown_connections 2021-11-15T19:34:35.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1164053610 0x7f1164055ad0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f117c1422b0 0x7f117c13ea80 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f117c065050 0x7f117c142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 --2- 172.21.2.137:0/1903826869 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f117c127d30 0x7f117c155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 >> 172.21.2.137:0/1903826869 conn(0x7f117c069e70 msgr2=0x7f117c1286a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 shutdown_connections 2021-11-15T19:34:35.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.225+0000 7f1184053700 1 -- 172.21.2.137:0/1903826869 wait complete. 2021-11-15T19:34:35.241 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:34:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a53d96700 1 Processor -- start 2021-11-15T19:34:35.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a53d96700 1 -- start start 2021-11-15T19:34:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a53d96700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5a4c0b0550 0x7f5a4c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a53d96700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c05cb50 con 0x7f5a4c05c770 2021-11-15T19:34:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a53d96700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0ad030 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a53d96700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c0b1650 con 0x7f5a4c0b0550 2021-11-15T19:34:35.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a51331700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5a4c0b0550 0x7f5a4c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a52333700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f5a4c14aaa0 0x7f5a4c140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57838/0 (socket says 172.21.2.137:57838) 2021-11-15T19:34:35.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.281+0000 7f5a52333700 1 -- 172.21.2.137:0/2071426993 learned_addr learned my addr 172.21.2.137:0/2071426993 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:35.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51331700 1 -- 172.21.2.137:0/2071426993 >> v1:172.21.2.137:6789/0 conn(0x7f5a4c14aaa0 legacy=0x7f5a4c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51331700 1 -- 172.21.2.137:0/2071426993 >> v1:172.21.2.111:6789/0 conn(0x7f5a4c05c770 legacy=0x7f5a4c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51331700 1 -- 172.21.2.137:0/2071426993 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0ad2d0 con 0x7f5a4c0b0550 2021-11-15T19:34:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51331700 1 --2- 172.21.2.137:0/2071426993 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c14a5b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f5a4c0aee10 tx=0x7f5a48006df0).ready entity=mon.1 client_cookie=2fb9326c9056cd1d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a50b30700 1 -- 172.21.2.137:0/2071426993 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4800d5c0 con 0x7f5a4c0b0550 2021-11-15T19:34:35.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a50b30700 1 -- 172.21.2.137:0/2071426993 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a48000e90 con 0x7f5a4c0b0550 2021-11-15T19:34:35.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a50b30700 1 -- 172.21.2.137:0/2071426993 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4800d910 con 0x7f5a4c0b0550 2021-11-15T19:34:35.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2071426993 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c0b0550 msgr2=0x7f5a4c14a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2071426993 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c14a5b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f5a4c0aee10 tx=0x7f5a48006df0).stop 2021-11-15T19:34:35.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2071426993 shutdown_connections 2021-11-15T19:34:35.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2071426993 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c14a5b0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2071426993 >> 172.21.2.137:0/2071426993 conn(0x7f5a4c0631e0 msgr2=0x7f5a4c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2071426993 shutdown_connections 2021-11-15T19:34:35.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2071426993 wait complete. 2021-11-15T19:34:35.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 Processor -- start 2021-11-15T19:34:35.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- start start 2021-11-15T19:34:35.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5a4c05c770 0x7f5a4c066530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 0x7f5a4c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c147400 con 0x7f5a4c0b0550 2021-11-15T19:34:35.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c13ec50 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c147080 con 0x7f5a4c05c770 2021-11-15T19:34:35.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 0x7f5a4c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 0x7f5a4c15a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39062/0 (socket says 172.21.2.137:39062) 2021-11-15T19:34:35.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 -- 172.21.2.137:0/2014432420 learned_addr learned my addr 172.21.2.137:0/2014432420 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:35.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51331700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51b32700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5a4c05c770 0x7f5a4c066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 -- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5a4c05c770 msgr2=0x7f5a4c066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5a4c05c770 0x7f5a4c066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 -- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5a4c0b0550 msgr2=0x7f5a4c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 -- 172.21.2.137:0/2014432420 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4800b180 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a51b32700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5a4c05c770 0x7f5a4c066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:35.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a52333700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 0x7f5a4c15a000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f5a4c0620e0 tx=0x7f5a44007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a44005ba0 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44005d00 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c147760 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a440072c0 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.285+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c143180 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c0ae7f0 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a44010070 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a3effd700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5a2c0536d0 0x7f5a2c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5a4406b2c0 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a51b32700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5a2c0536d0 0x7f5a2c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a51b32700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5a2c0536d0 0x7f5a2c055b90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f5a40007000 tx=0x7f5a40008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.289+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a44042310 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a4c0573d0 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a3effd700 1 -- 172.21.2.137:0/2014432420 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5a44045930 con 0x7f5a4c14aaa0 2021-11-15T19:34:35.383 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:35.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5a2c0536d0 msgr2=0x7f5a2c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5a2c0536d0 0x7f5a2c055b90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f5a40007000 tx=0x7f5a40008040).stop 2021-11-15T19:34:35.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 msgr2=0x7f5a4c15a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 0x7f5a4c15a000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f5a4c0620e0 tx=0x7f5a44007f00).stop 2021-11-15T19:34:35.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 shutdown_connections 2021-11-15T19:34:35.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5a2c0536d0 0x7f5a2c055b90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5a4c14aaa0 0x7f5a4c15a000 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5a4c0b0550 0x7f5a4c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 --2- 172.21.2.137:0/2014432420 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5a4c05c770 0x7f5a4c066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 >> 172.21.2.137:0/2014432420 conn(0x7f5a4c0631e0 msgr2=0x7f5a4c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 shutdown_connections 2021-11-15T19:34:35.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.373+0000 7f5a53d96700 1 -- 172.21.2.137:0/2014432420 wait complete. 2021-11-15T19:34:35.390 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:34:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 Processor -- start 2021-11-15T19:34:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- start start 2021-11-15T19:34:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f514c0608a0 0x7f514c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0a9e50 con 0x7f514c09a2f0 2021-11-15T19:34:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0b1590 con 0x7f514c0b11b0 2021-11-15T19:34:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c098d50 con 0x7f514c0608a0 2021-11-15T19:34:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5152394700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f514c0b11b0 0x7f514c05c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57848/0 (socket says 172.21.2.137:57848) 2021-11-15T19:34:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5152394700 1 -- 172.21.2.137:0/3907170941 learned_addr learned my addr 172.21.2.137:0/3907170941 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151b93700 1 --2- 172.21.2.137:0/3907170941 >> v2:172.21.2.111:3300/0 conn(0x7f514c0608a0 0x7f514c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151392700 1 -- 172.21.2.137:0/3907170941 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807213835 0 0) 0x7f514c0b1590 con 0x7f514c0b11b0 2021-11-15T19:34:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151392700 1 -- 172.21.2.137:0/3907170941 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5134003260 con 0x7f514c0b11b0 2021-11-15T19:34:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151b93700 1 -- 172.21.2.137:0/3907170941 >> v1:172.21.2.137:6789/0 conn(0x7f514c0b11b0 legacy=0x7f514c05c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151b93700 1 -- 172.21.2.137:0/3907170941 >> v1:172.21.2.111:6789/0 conn(0x7f514c09a2f0 legacy=0x7f514c09a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151b93700 1 -- 172.21.2.137:0/3907170941 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0aa080 con 0x7f514c0608a0 2021-11-15T19:34:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151b93700 1 --2- 172.21.2.137:0/3907170941 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0af6e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f513c002f70 tx=0x7f513c006df0).ready entity=mon.0 client_cookie=6ff676cdfc0b7ca3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151392700 1 -- 172.21.2.137:0/3907170941 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f513c00d610 con 0x7f514c0608a0 2021-11-15T19:34:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151392700 1 -- 172.21.2.137:0/3907170941 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c000e90 con 0x7f514c0608a0 2021-11-15T19:34:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5151392700 1 -- 172.21.2.137:0/3907170941 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f513c00d960 con 0x7f514c0608a0 2021-11-15T19:34:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- 172.21.2.137:0/3907170941 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 msgr2=0x7f514c0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 --2- 172.21.2.137:0/3907170941 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0af6e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f513c002f70 tx=0x7f513c006df0).stop 2021-11-15T19:34:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- 172.21.2.137:0/3907170941 shutdown_connections 2021-11-15T19:34:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 --2- 172.21.2.137:0/3907170941 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0af6e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- 172.21.2.137:0/3907170941 >> 172.21.2.137:0/3907170941 conn(0x7f514c0b22b0 msgr2=0x7f514c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- 172.21.2.137:0/3907170941 shutdown_connections 2021-11-15T19:34:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.433+0000 7f5153396700 1 -- 172.21.2.137:0/3907170941 wait complete. 2021-11-15T19:34:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 Processor -- start 2021-11-15T19:34:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- start start 2021-11-15T19:34:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f514c09a2f0 0x7f514c14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 0x7f514c0990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c148b90 con 0x7f514c0608a0 2021-11-15T19:34:35.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0626a0 con 0x7f514c0b11b0 2021-11-15T19:34:35.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0aedf0 con 0x7f514c09a2f0 2021-11-15T19:34:35.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 0x7f514c0990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 0x7f514c0990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39074/0 (socket says 172.21.2.137:39074) 2021-11-15T19:34:35.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 -- 172.21.2.137:0/3651868062 learned_addr learned my addr 172.21.2.137:0/3651868062 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:35.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152394700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5151b93700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f514c09a2f0 0x7f514c14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 -- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f514c09a2f0 msgr2=0x7f514c14dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f514c09a2f0 0x7f514c14dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 -- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 msgr2=0x7f514c0ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 -- 172.21.2.137:0/3651868062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c00b180 con 0x7f514c0b11b0 2021-11-15T19:34:35.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152394700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:35.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152b95700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 0x7f514c0990b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f514c0aa400 tx=0x7f5148007bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5148012400 con 0x7f514c0b11b0 2021-11-15T19:34:35.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148012560 con 0x7f514c0b11b0 2021-11-15T19:34:35.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51480128c0 con 0x7f514c0b11b0 2021-11-15T19:34:35.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c148880 con 0x7f514c0b11b0 2021-11-15T19:34:35.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c0ac530 con 0x7f514c0b11b0 2021-11-15T19:34:35.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c0573d0 con 0x7f514c0b11b0 2021-11-15T19:34:35.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5148019030 con 0x7f514c0b11b0 2021-11-15T19:34:35.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f513b7fe700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f512c053690 0x7f512c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f514806ad00 con 0x7f514c0b11b0 2021-11-15T19:34:35.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152394700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f512c053690 0x7f512c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.437+0000 7f5152394700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f512c053690 0x7f512c055b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f514400d000 tx=0x7f5144009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.441+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5148041d50 con 0x7f514c0b11b0 2021-11-15T19:34:35.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f514c05f180 con 0x7f514c0b11b0 2021-11-15T19:34:35.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f513b7fe700 1 -- 172.21.2.137:0/3651868062 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5148045370 con 0x7f514c0b11b0 2021-11-15T19:34:35.535 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:35.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f512c053690 msgr2=0x7f512c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f512c053690 0x7f512c055b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f514400d000 tx=0x7f5144009040).stop 2021-11-15T19:34:35.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 msgr2=0x7f514c0990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 0x7f514c0990b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f514c0aa400 tx=0x7f5148007bc0).stop 2021-11-15T19:34:35.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 shutdown_connections 2021-11-15T19:34:35.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f512c053690 0x7f512c055b50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f514c0b11b0 0x7f514c0990b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f514c09a2f0 0x7f514c14dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 --2- 172.21.2.137:0/3651868062 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f514c0608a0 0x7f514c0ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 >> 172.21.2.137:0/3651868062 conn(0x7f514c0b22b0 msgr2=0x7f514c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 shutdown_connections 2021-11-15T19:34:35.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.525+0000 7f5153396700 1 -- 172.21.2.137:0/3651868062 wait complete. 2021-11-15T19:34:35.542 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:34:35.542 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:35.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 Processor -- start 2021-11-15T19:34:35.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 -- start start 2021-11-15T19:34:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f43400608f0 0x7f434013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f43400b1660 0x7f43400b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400b1af0 con 0x7f43400b2c00 2021-11-15T19:34:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43400ad6c0 con 0x7f43400608f0 2021-11-15T19:34:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f4345fbe700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43400b0c80 con 0x7f43400b1660 2021-11-15T19:34:35.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f43400b2c00 0x7f434005f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57864/0 (socket says 172.21.2.137:57864) 2021-11-15T19:34:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433ffff700 1 -- 172.21.2.137:0/724333602 learned_addr learned my addr 172.21.2.137:0/724333602 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433effd700 1 --2- 172.21.2.137:0/724333602 >> v2:172.21.2.137:3300/0 conn(0x7f43400b1660 0x7f43400b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433effd700 1 -- 172.21.2.137:0/724333602 >> v2:172.21.2.111:3300/0 conn(0x7f43400608f0 msgr2=0x7f434013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433effd700 1 --2- 172.21.2.137:0/724333602 >> v2:172.21.2.111:3300/0 conn(0x7f43400608f0 0x7f434013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433effd700 1 -- 172.21.2.137:0/724333602 >> v1:172.21.2.137:6789/0 conn(0x7f43400b2c00 legacy=0x7f434005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433e7fc700 1 -- 172.21.2.137:0/724333602 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380286599 0 0) 0x7f43400b1af0 con 0x7f43400b2c00 2021-11-15T19:34:35.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.581+0000 7f433effd700 1 -- 172.21.2.137:0/724333602 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400b0f20 con 0x7f43400b1660 2021-11-15T19:34:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433effd700 1 --2- 172.21.2.137:0/724333602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b1660 0x7f43400b2710 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f4330002f70 tx=0x7f4330006df0).ready entity=mon.1 client_cookie=70a0d46edb33f0dc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433e7fc700 1 -- 172.21.2.137:0/724333602 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f433000d5c0 con 0x7f43400b1660 2021-11-15T19:34:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433e7fc700 1 -- 172.21.2.137:0/724333602 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330000e90 con 0x7f43400b1660 2021-11-15T19:34:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433e7fc700 1 -- 172.21.2.137:0/724333602 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f433000d910 con 0x7f43400b1660 2021-11-15T19:34:35.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/724333602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b1660 msgr2=0x7f43400b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 --2- 172.21.2.137:0/724333602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b1660 0x7f43400b2710 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f4330002f70 tx=0x7f4330006df0).stop 2021-11-15T19:34:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/724333602 shutdown_connections 2021-11-15T19:34:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 --2- 172.21.2.137:0/724333602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b1660 0x7f43400b2710 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 --2- 172.21.2.137:0/724333602 >> v2:172.21.2.111:3300/0 conn(0x7f43400608f0 0x7f434013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/724333602 >> 172.21.2.137:0/724333602 conn(0x7f4340063980 msgr2=0x7f4340063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/724333602 shutdown_connections 2021-11-15T19:34:35.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/724333602 wait complete. 2021-11-15T19:34:35.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 Processor -- start 2021-11-15T19:34:35.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- start start 2021-11-15T19:34:35.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f43400608f0 0x7f4340066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f43400b1660 0x7f4340141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 0x7f43401201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400648b0 con 0x7f43400608f0 2021-11-15T19:34:35.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434013f330 con 0x7f43400b2c00 2021-11-15T19:34:35.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43401427a0 con 0x7f43400b1660 2021-11-15T19:34:35.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 0x7f43401201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 0x7f43401201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39086/0 (socket says 172.21.2.137:39086) 2021-11-15T19:34:35.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 -- 172.21.2.137:0/439564829 learned_addr learned my addr 172.21.2.137:0/439564829 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:35.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 -- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f43400b1660 msgr2=0x7f4340141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f43400b1660 0x7f4340141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 -- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f43400608f0 msgr2=0x7f4340066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f43400608f0 0x7f4340066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 -- 172.21.2.137:0/439564829 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433000b180 con 0x7f43400b2c00 2021-11-15T19:34:35.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433ffff700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 0x7f43401201e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f4338001250 tx=0x7f4338001360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4338005ba0 con 0x7f43400b2c00 2021-11-15T19:34:35.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4338005d00 con 0x7f43400b2c00 2021-11-15T19:34:35.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434013f520 con 0x7f43400b2c00 2021-11-15T19:34:35.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4340141e10 con 0x7f43400b2c00 2021-11-15T19:34:35.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4338004a90 con 0x7f43400b2c00 2021-11-15T19:34:35.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4318003410 con 0x7f43400b2c00 2021-11-15T19:34:35.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.585+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4338004bf0 con 0x7f43400b2c00 2021-11-15T19:34:35.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.589+0000 7f433cff9700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f43200536a0 0x7f4320055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:35.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.589+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f433806b630 con 0x7f43400b2c00 2021-11-15T19:34:35.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.589+0000 7f433f7fe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f43200536a0 0x7f4320055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:35.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.589+0000 7f433f7fe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f43200536a0 0x7f4320055b60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f4334002f70 tx=0x7f4334006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:35.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.589+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4338042680 con 0x7f43400b2c00 2021-11-15T19:34:35.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.697+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4318003c40 con 0x7f43400b2c00 2021-11-15T19:34:35.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.697+0000 7f433cff9700 1 -- 172.21.2.137:0/439564829 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f4338045ca0 con 0x7f43400b2c00 2021-11-15T19:34:35.709 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:35.710 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":57,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1937261911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1937261911},{"type":"v1","addr":"172.21.2.111:6835","nonce":1937261911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:32.401324+0000","modified":"2021-11-15T19:34:33.405100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7564":{"gid":7564,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3862600413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3862600413},{"type":"v1","addr":"172.21.2.137:6833","nonce":3862600413}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T19:34:35.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f43200536a0 msgr2=0x7f4320055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f43200536a0 0x7f4320055b60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f4334002f70 tx=0x7f4334006a80).stop 2021-11-15T19:34:35.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 msgr2=0x7f43401201e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:35.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 0x7f43401201e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f4338001250 tx=0x7f4338001360).stop 2021-11-15T19:34:35.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 shutdown_connections 2021-11-15T19:34:35.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f43200536a0 0x7f4320055b60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f43400b2c00 0x7f43401201e0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:35.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f43400b1660 0x7f4340141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 --2- 172.21.2.137:0/439564829 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f43400608f0 0x7f4340066f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:35.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 >> 172.21.2.137:0/439564829 conn(0x7f4340063980 msgr2=0x7f43401288b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:35.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 shutdown_connections 2021-11-15T19:34:35.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:35.701+0000 7f4345fbe700 1 -- 172.21.2.137:0/439564829 wait complete. 2021-11-15T19:34:35.714 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 57 2021-11-15T19:34:35.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:34:32.401324+0000', 'modified': '2021-11-15T19:34:33.405100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7564}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7564': {'gid': 7564, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/3862600413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 3862600413}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 3862600413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:34:35.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:34:35.918 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:34:35.987 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7564,"want_state":"up:active","state":"up:active","rank_uptime":3.575736515,"mdsmap_epoch":57,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":7.7408403349999997} 2021-11-15T19:34:35.987 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7564, "mdsmap_epoch": 57, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 3.575736515, "state": "up:active", "uptime": 7.740840335, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:34:35.988 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:34:35.988 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:34:35.989 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:34:35.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:35.990 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:36.000 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:34:36.012 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:36.012 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:36.018 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:36.019 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:36.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:36.021 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:34:36.066 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:34:36.066 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:36.069 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:34:36.078 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:36.078 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:36.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:34:36.098+0000 7f06cc44c080 -1 init, newargv = 0x55577225c7e0 newargc=9 2021-11-15T19:34:36.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15106]: starting ceph client 2021-11-15T19:34:36.111 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:36.111 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:36.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:36.113 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:34:36.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15106]: starting fuse 2021-11-15T19:34:36.117 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:34:36.117 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:34:36.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:36.118 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:34:36.118 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:34:36.119 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:34:36.119 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:34:36.120 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:34:36.120 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:36.120 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:34:36.121 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:34:36.121 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:34:36.122 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:36.122 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:34:36.122 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:34:36.123 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:34:36.123 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:34:36.124 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:36.124 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:34:36.125 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:34:36.125 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:34:36.125 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:34:36.126 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:34:36.126 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:34:36.127 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:34:36.127 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:34:36.193 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.15106.asok 2021-11-15T19:34:36.197 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15106.asok 2021-11-15T19:34:36.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:36.198 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15106.asok status 2021-11-15T19:34:36.251 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:34:36.252 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:34:36.252 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:34:36.252 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:34:36.252 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:34:36.253 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:34:36.253 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:34:36.253 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "15106", 2021-11-15T19:34:36.253 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:34:36.253 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:36.254 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:34:36.254 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:34:36.254 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 4922, 2021-11-15T19:34:36.254 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:34:36.255 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:34:36.255 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:34:36.255 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 4922 2021-11-15T19:34:36.255 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:36.255 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:34:36.256 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:34:36.256 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:34:36.256 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2509800180 2021-11-15T19:34:36.256 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:34:36.256 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:36.257 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:34:36.257 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:34:36.257 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:34:36.257 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2509800180 2021-11-15T19:34:36.258 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:34:36.258 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.4922 172.21.2.131:0/2509800180", 2021-11-15T19:34:36.258 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2509800180", 2021-11-15T19:34:36.258 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:34:36.259 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 57, 2021-11-15T19:34:36.259 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 112, 2021-11-15T19:34:36.259 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:34:36.259 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:34:36.259 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:34:36.260 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:34:36.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:36.261 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:36.261 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:36.266 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:34:36.267 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:36.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:36.268 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:36.319 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:34:36.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.361+0000 7f4c7d913700 1 Processor -- start 2021-11-15T19:34:36.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.361+0000 7f4c7d913700 1 -- start start 2021-11-15T19:34:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 0x7f4c78142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f4c780af2f0 0x7f4c78143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c780aecf0 con 0x7f4c780acab0 2021-11-15T19:34:36.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7813f180 con 0x7f4c780af2f0 2021-11-15T19:34:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780aef20 con 0x7f4c780b1180 2021-11-15T19:34:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c76ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4c780acab0 0x7f4c780b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57876/0 (socket says 172.21.2.137:57876) 2021-11-15T19:34:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c76ffd700 1 -- 172.21.2.137:0/2191965746 learned_addr learned my addr 172.21.2.137:0/2191965746 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:36.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227102306 0 0) 0x7f4c780aecf0 con 0x7f4c780acab0 2021-11-15T19:34:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c58003260 con 0x7f4c780acab0 2021-11-15T19:34:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c767fc700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 0x7f4c78142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 --2- 172.21.2.137:0/2191965746 >> v2:172.21.2.111:3300/0 conn(0x7f4c780af2f0 0x7f4c78143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229690646 0 0) 0x7f4c58003260 con 0x7f4c780acab0 2021-11-15T19:34:36.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 msgr2=0x7f4c78142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 0x7f4c78142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 >> v2:172.21.2.111:3300/0 conn(0x7f4c780af2f0 msgr2=0x7f4c78143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 --2- 172.21.2.137:0/2191965746 >> v2:172.21.2.111:3300/0 conn(0x7f4c780af2f0 0x7f4c78143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780b2770 con 0x7f4c780acab0 2021-11-15T19:34:36.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4c60001680 con 0x7f4c780acab0 2021-11-15T19:34:36.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 >> v1:172.21.2.137:6789/0 conn(0x7f4c780acab0 legacy=0x7f4c780b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 0x7f4c580037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c58003e00 0x7f4c58004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c580049f0 0x7f4c58004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7813f180 con 0x7f4c58003e00 2021-11-15T19:34:36.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780aef20 con 0x7f4c580049f0 2021-11-15T19:34:36.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5800b8e0 con 0x7f4c780b1180 2021-11-15T19:34:36.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c580049f0 0x7f4c58004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 -- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 msgr2=0x7f4c580037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c76ffd700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 0x7f4c580037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c767fc700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c58003e00 0x7f4c58004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c780b1180 0x7f4c580037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 -- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c58003e00 msgr2=0x7f4c58004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c58003e00 0x7f4c58004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 -- 172.21.2.137:0/2191965746 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58003260 con 0x7f4c580049f0 2021-11-15T19:34:36.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c767fc700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c58003e00 0x7f4c58004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:36.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c580049f0 0x7f4c58004e70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f4c7000a000 tx=0x7f4c70008040).ready entity=mon.1 client_cookie=d4e1332546486431 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7000c070 con 0x7f4c580049f0 2021-11-15T19:34:36.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7000e5f0 con 0x7f4c580049f0 2021-11-15T19:34:36.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c75ffb700 1 -- 172.21.2.137:0/2191965746 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7000e950 con 0x7f4c580049f0 2021-11-15T19:34:36.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- 172.21.2.137:0/2191965746 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c580049f0 msgr2=0x7f4c58004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 --2- 172.21.2.137:0/2191965746 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c580049f0 0x7f4c58004e70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f4c7000a000 tx=0x7f4c70008040).stop 2021-11-15T19:34:36.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c777fe700 1 -- 172.21.2.137:0/2191965746 reap_dead start 2021-11-15T19:34:36.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- 172.21.2.137:0/2191965746 shutdown_connections 2021-11-15T19:34:36.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- 172.21.2.137:0/2191965746 >> 172.21.2.137:0/2191965746 conn(0x7f4c780630f0 msgr2=0x7f4c780634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- 172.21.2.137:0/2191965746 shutdown_connections 2021-11-15T19:34:36.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- 172.21.2.137:0/2191965746 wait complete. 2021-11-15T19:34:36.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 Processor -- start 2021-11-15T19:34:36.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.365+0000 7f4c7d913700 1 -- start start 2021-11-15T19:34:36.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c580049f0 0x7f4c780b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c78137a00 0x7f4c78155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 0x7f4c7813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7813bf40 con 0x7f4c78137a00 2021-11-15T19:34:36.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78139c20 con 0x7f4c7813b5d0 2021-11-15T19:34:36.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78138940 con 0x7f4c580049f0 2021-11-15T19:34:36.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 0x7f4c7813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 0x7f4c7813ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39110/0 (socket says 172.21.2.137:39110) 2021-11-15T19:34:36.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 -- 172.21.2.137:0/886323480 learned_addr learned my addr 172.21.2.137:0/886323480 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:36.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c767fc700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c78137a00 0x7f4c78155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c76ffd700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c580049f0 0x7f4c780b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 -- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c580049f0 msgr2=0x7f4c780b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c580049f0 0x7f4c780b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 -- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c78137a00 msgr2=0x7f4c78155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c78137a00 0x7f4c78155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 -- 172.21.2.137:0/886323480 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78138be0 con 0x7f4c7813b5d0 2021-11-15T19:34:36.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c767fc700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c78137a00 0x7f4c78155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:36.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c777fe700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 0x7f4c7813ba50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f4c780628d0 tx=0x7f4c70008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7001d410 con 0x7f4c7813b5d0 2021-11-15T19:34:36.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7001d570 con 0x7f4c7813b5d0 2021-11-15T19:34:36.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7813b130 con 0x7f4c7813b5d0 2021-11-15T19:34:36.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7001d8d0 con 0x7f4c7813b5d0 2021-11-15T19:34:36.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c781377c0 con 0x7f4c7813b5d0 2021-11-15T19:34:36.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c780ace90 con 0x7f4c7813b5d0 2021-11-15T19:34:36.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c7001da30 con 0x7f4c7813b5d0 2021-11-15T19:34:36.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c6ffff700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c053660 0x7f4c5c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4c7006c0a0 con 0x7f4c7813b5d0 2021-11-15T19:34:36.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.369+0000 7f4c76ffd700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c053660 0x7f4c5c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.373+0000 7f4c76ffd700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c053660 0x7f4c5c055b20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f4c6000c000 tx=0x7f4c60009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.373+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c700430f0 con 0x7f4c7813b5d0 2021-11-15T19:34:36.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.457+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c780573d0 con 0x7f4c7813b5d0 2021-11-15T19:34:36.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.457+0000 7f4c6ffff700 1 -- 172.21.2.137:0/886323480 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f4c70023090 con 0x7f4c7813b5d0 2021-11-15T19:34:36.469 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:36.470 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":112,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:34:33.403628+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:34:30.346476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T19:34:31.378520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:34:36.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c053660 msgr2=0x7f4c5c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c053660 0x7f4c5c055b20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f4c6000c000 tx=0x7f4c60009040).stop 2021-11-15T19:34:36.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 msgr2=0x7f4c7813ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 0x7f4c7813ba50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f4c780628d0 tx=0x7f4c70008040).stop 2021-11-15T19:34:36.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 shutdown_connections 2021-11-15T19:34:36.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4c5c053660 0x7f4c5c055b20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4c7813b5d0 0x7f4c7813ba50 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4c78137a00 0x7f4c78155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 --2- 172.21.2.137:0/886323480 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4c580049f0 0x7f4c780b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 >> 172.21.2.137:0/886323480 conn(0x7f4c780630f0 msgr2=0x7f4c780b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 shutdown_connections 2021-11-15T19:34:36.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.461+0000 7f4c7d913700 1 -- 172.21.2.137:0/886323480 wait complete. 2021-11-15T19:34:36.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:34:30.346476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:34:31.378520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:34:36.478 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:34:36.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 Processor -- start 2021-11-15T19:34:36.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- start start 2021-11-15T19:34:36.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd254140aa0 0x7fd254140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25405cb50 con 0x7fd25405c770 2021-11-15T19:34:36.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2540ad030 con 0x7fd2540b0550 2021-11-15T19:34:36.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2540b1650 con 0x7fd254140aa0 2021-11-15T19:34:36.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd2540b0550 0x7fd25414a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57900/0 (socket says 172.21.2.137:57900) 2021-11-15T19:34:36.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 -- 172.21.2.137:0/2725970799 learned_addr learned my addr 172.21.2.137:0/2725970799 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:36.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161658310 0 0) 0x7fd2540ad030 con 0x7fd2540b0550 2021-11-15T19:34:36.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd234003260 con 0x7fd2540b0550 2021-11-15T19:34:36.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586908629 0 0) 0x7fd234003260 con 0x7fd2540b0550 2021-11-15T19:34:36.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 >> v2:172.21.2.111:3300/0 conn(0x7fd254140aa0 msgr2=0x7fd254140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 --2- 172.21.2.137:0/2725970799 >> v2:172.21.2.111:3300/0 conn(0x7fd254140aa0 0x7fd254140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 >> v1:172.21.2.111:6789/0 conn(0x7fd25405c770 legacy=0x7fd2540aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2540ad2d0 con 0x7fd2540b0550 2021-11-15T19:34:36.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd244001660 con 0x7fd2540b0550 2021-11-15T19:34:36.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 >> v1:172.21.2.137:6789/0 conn(0x7fd2540b0550 legacy=0x7fd25414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd234003820 0x7fd234003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd234004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd234005050 0x7fd23400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540b1650 con 0x7fd234003820 2021-11-15T19:34:36.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23400bf40 con 0x7fd234004500 2021-11-15T19:34:36.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23400c100 con 0x7fd234005050 2021-11-15T19:34:36.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd234004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 -- 172.21.2.137:0/2725970799 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd234005050 msgr2=0x7fd23400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd234005050 0x7fd23400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 -- 172.21.2.137:0/2725970799 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd234003820 msgr2=0x7fd234003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd234003820 0x7fd234003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 -- 172.21.2.137:0/2725970799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234003260 con 0x7fd234004500 2021-11-15T19:34:36.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2596e4700 1 -- 172.21.2.137:0/2725970799 reap_dead start 2021-11-15T19:34:36.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd253fff700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd234004980 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fd2540aee10 tx=0x7fd254146fe0).ready entity=mon.1 client_cookie=e246a1a30d24dc5b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2440070d0 con 0x7fd234004500 2021-11-15T19:34:36.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244007230 con 0x7fd234004500 2021-11-15T19:34:36.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd2537fe700 1 -- 172.21.2.137:0/2725970799 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24400c8f0 con 0x7fd234004500 2021-11-15T19:34:36.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- 172.21.2.137:0/2725970799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 msgr2=0x7fd234004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd234004980 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fd2540aee10 tx=0x7fd254146fe0).stop 2021-11-15T19:34:36.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- 172.21.2.137:0/2725970799 shutdown_connections 2021-11-15T19:34:36.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 --2- 172.21.2.137:0/2725970799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd234004980 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- 172.21.2.137:0/2725970799 >> 172.21.2.137:0/2725970799 conn(0x7fd2540631e0 msgr2=0x7fd25405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- 172.21.2.137:0/2725970799 shutdown_connections 2021-11-15T19:34:36.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.521+0000 7fd25b147700 1 -- 172.21.2.137:0/2725970799 wait complete. 2021-11-15T19:34:36.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 Processor -- start 2021-11-15T19:34:36.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- start start 2021-11-15T19:34:36.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd2540b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254156310 0x7fd2541569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254063760 0x7fd254156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541598e0 con 0x7fd254156310 2021-11-15T19:34:36.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541438d0 con 0x7fd234004500 2021-11-15T19:34:36.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd254143b70 con 0x7fd254063760 2021-11-15T19:34:36.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd2540b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd2540b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39126/0 (socket says 172.21.2.137:39126) 2021-11-15T19:34:36.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 -- 172.21.2.137:0/2779214615 learned_addr learned my addr 172.21.2.137:0/2779214615 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:36.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 -- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254063760 msgr2=0x7fd254156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254063760 0x7fd254156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 -- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254156310 msgr2=0x7fd2541569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254156310 0x7fd2541569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 -- 172.21.2.137:0/2779214615 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254143e10 con 0x7fd234004500 2021-11-15T19:34:36.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd258ee3700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd2540b2dd0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fd254156770 tx=0x7fd23c007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c00ce70 con 0x7fd234004500 2021-11-15T19:34:36.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c000e90 con 0x7fd234004500 2021-11-15T19:34:36.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2540b32c0 con 0x7fd234004500 2021-11-15T19:34:36.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c007430 con 0x7fd234004500 2021-11-15T19:34:36.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd254144400 con 0x7fd234004500 2021-11-15T19:34:36.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540ae7f0 con 0x7fd234004500 2021-11-15T19:34:36.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd23c01a060 con 0x7fd234004500 2021-11-15T19:34:36.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd251ffb700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd238053640 0x7fd238055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd23c06af70 con 0x7fd234004500 2021-11-15T19:34:36.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.525+0000 7fd253fff700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd238053640 0x7fd238055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.529+0000 7fd253fff700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd238053640 0x7fd238055b00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd2540aee10 tx=0x7fd244015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.529+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd23c0420d0 con 0x7fd234004500 2021-11-15T19:34:36.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd254144400 con 0x7fd234004500 2021-11-15T19:34:36.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd251ffb700 1 -- 172.21.2.137:0/2779214615 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd254144400 con 0x7fd234004500 2021-11-15T19:34:36.624 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:34:36.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd238053640 msgr2=0x7fd238055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd238053640 0x7fd238055b00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd2540aee10 tx=0x7fd244015000).stop 2021-11-15T19:34:36.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 msgr2=0x7fd2540b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd2540b2dd0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fd254156770 tx=0x7fd23c007c30).stop 2021-11-15T19:34:36.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 shutdown_connections 2021-11-15T19:34:36.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd238053640 0x7fd238055b00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd254063760 0x7fd254156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd254156310 0x7fd2541569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 --2- 172.21.2.137:0/2779214615 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd234004500 0x7fd2540b2dd0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 >> 172.21.2.137:0/2779214615 conn(0x7fd2540631e0 msgr2=0x7fd25414aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 shutdown_connections 2021-11-15T19:34:36.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.613+0000 7fd25b147700 1 -- 172.21.2.137:0/2779214615 wait complete. 2021-11-15T19:34:36.631 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:34:36.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 Processor -- start 2021-11-15T19:34:36.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- start start 2021-11-15T19:34:36.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdd740b0550 0x7fdd7414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 0x7fdd74140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7405cb50 con 0x7fdd7405c770 2021-11-15T19:34:36.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd740b1650 con 0x7fdd740b0550 2021-11-15T19:34:36.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740ad030 con 0x7fdd7414aaa0 2021-11-15T19:34:36.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd73fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdd7405c770 0x7fdd740aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57916/0 (socket says 172.21.2.137:57916) 2021-11-15T19:34:36.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd73fff700 1 -- 172.21.2.137:0/90890892 learned_addr learned my addr 172.21.2.137:0/90890892 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:36.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708879658 0 0) 0x7fdd7405cb50 con 0x7fdd7405c770 2021-11-15T19:34:36.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd54003260 con 0x7fdd7405c770 2021-11-15T19:34:36.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd78e91700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 0x7fdd74140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 --2- 172.21.2.137:0/90890892 >> v2:172.21.2.111:3300/0 conn(0x7fdd740b0550 0x7fdd7414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949644924 0 0) 0x7fdd54003260 con 0x7fdd7405c770 2021-11-15T19:34:36.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 msgr2=0x7fdd74140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 0x7fdd74140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 >> v2:172.21.2.111:3300/0 conn(0x7fdd740b0550 msgr2=0x7fdd7414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 --2- 172.21.2.137:0/90890892 >> v2:172.21.2.111:3300/0 conn(0x7fdd740b0550 0x7fdd7414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740ad2d0 con 0x7fdd7405c770 2021-11-15T19:34:36.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fdd5c001660 con 0x7fdd7405c770 2021-11-15T19:34:36.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 >> v1:172.21.2.137:6789/0 conn(0x7fdd7405c770 legacy=0x7fdd740aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 0x7fdd540037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd54003e00 0x7fdd54004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd540049f0 0x7fdd54004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740b1650 con 0x7fdd540049f0 2021-11-15T19:34:36.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740ad030 con 0x7fdd54003e00 2021-11-15T19:34:36.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5400b8e0 con 0x7fdd7414aaa0 2021-11-15T19:34:36.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd54003e00 0x7fdd54004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd73fff700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 0x7fdd540037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd78e91700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd540049f0 0x7fdd54004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 -- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 msgr2=0x7fdd540037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd7414aaa0 0x7fdd540037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 -- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd540049f0 msgr2=0x7fdd54004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd540049f0 0x7fdd54004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 -- 172.21.2.137:0/90890892 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54003260 con 0x7fdd54003e00 2021-11-15T19:34:36.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd737fe700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd54003e00 0x7fdd54004500 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fdd6400a000 tx=0x7fdd64008040).ready entity=mon.1 client_cookie=d39d8d3c4ad4328b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd64013670 con 0x7fdd54003e00 2021-11-15T19:34:36.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd640137d0 con 0x7fdd54003e00 2021-11-15T19:34:36.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd72ffd700 1 -- 172.21.2.137:0/90890892 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd64013b30 con 0x7fdd54003e00 2021-11-15T19:34:36.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/90890892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd54003e00 msgr2=0x7fdd54004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/90890892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd54003e00 0x7fdd54004500 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fdd6400a000 tx=0x7fdd64008040).stop 2021-11-15T19:34:36.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd78e91700 1 -- 172.21.2.137:0/90890892 reap_dead start 2021-11-15T19:34:36.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/90890892 shutdown_connections 2021-11-15T19:34:36.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/90890892 >> 172.21.2.137:0/90890892 conn(0x7fdd740631e0 msgr2=0x7fdd7405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/90890892 shutdown_connections 2021-11-15T19:34:36.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.673+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/90890892 wait complete. 2021-11-15T19:34:36.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 Processor -- start 2021-11-15T19:34:36.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- start start 2021-11-15T19:34:36.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd54003e00 0x7fdd74063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd740656c0 0x7fdd74149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 0x7fdd74145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74117220 con 0x7fdd54003e00 2021-11-15T19:34:36.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd741169c0 con 0x7fdd74145200 2021-11-15T19:34:36.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74118710 con 0x7fdd740656c0 2021-11-15T19:34:36.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 0x7fdd74145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 0x7fdd74145680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39150/0 (socket says 172.21.2.137:39150) 2021-11-15T19:34:36.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 -- 172.21.2.137:0/4152816911 learned_addr learned my addr 172.21.2.137:0/4152816911 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:36.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd73fff700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd54003e00 0x7fdd74063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd737fe700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd740656c0 0x7fdd74149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 -- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd740656c0 msgr2=0x7fdd74149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd740656c0 0x7fdd74149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 -- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd54003e00 msgr2=0x7fdd74063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd54003e00 0x7fdd74063760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 -- 172.21.2.137:0/4152816911 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd741189b0 con 0x7fdd74145200 2021-11-15T19:34:36.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd78e91700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 0x7fdd74145680 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fdd6c00d000 tx=0x7fdd6c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6c0126d0 con 0x7fdd74145200 2021-11-15T19:34:36.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00c070 con 0x7fdd74145200 2021-11-15T19:34:36.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6c012a20 con 0x7fdd74145200 2021-11-15T19:34:36.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd74156660 con 0x7fdd74145200 2021-11-15T19:34:36.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd74063c50 con 0x7fdd74145200 2021-11-15T19:34:36.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd74065460 con 0x7fdd74145200 2021-11-15T19:34:36.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd6c012040 con 0x7fdd74145200 2021-11-15T19:34:36.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd717fa700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd58053640 0x7fdd58055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdd6c06b8c0 con 0x7fdd74145200 2021-11-15T19:34:36.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.677+0000 7fdd73fff700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd58053640 0x7fdd58055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.681+0000 7fdd73fff700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd58053640 0x7fdd58055b00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fdd5c00d000 tx=0x7fdd5c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.681+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd6c042a20 con 0x7fdd74145200 2021-11-15T19:34:36.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd740ae7f0 con 0x7fdd74145200 2021-11-15T19:34:36.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd717fa700 1 -- 172.21.2.137:0/4152816911 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd6c046040 con 0x7fdd74145200 2021-11-15T19:34:36.775 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:36.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd58053640 msgr2=0x7fdd58055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd58053640 0x7fdd58055b00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fdd5c00d000 tx=0x7fdd5c009040).stop 2021-11-15T19:34:36.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 msgr2=0x7fdd74145680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 0x7fdd74145680 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fdd6c00d000 tx=0x7fdd6c008040).stop 2021-11-15T19:34:36.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 shutdown_connections 2021-11-15T19:34:36.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd58053640 0x7fdd58055b00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdd74145200 0x7fdd74145680 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdd740656c0 0x7fdd74149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 --2- 172.21.2.137:0/4152816911 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdd54003e00 0x7fdd74063760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 >> 172.21.2.137:0/4152816911 conn(0x7fdd740631e0 msgr2=0x7fdd740b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 shutdown_connections 2021-11-15T19:34:36.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.765+0000 7fdd7a8f4700 1 -- 172.21.2.137:0/4152816911 wait complete. 2021-11-15T19:34:36.782 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:34:36.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 Processor -- start 2021-11-15T19:34:36.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- start start 2021-11-15T19:34:36.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdafc0afde0 0x7fdafc0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc0aedf0 con 0x7fdafc13f5c0 2021-11-15T19:34:36.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc0afbd0 con 0x7fdafc0b0fe0 2021-11-15T19:34:36.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc0ae070 con 0x7fdafc0afde0 2021-11-15T19:34:36.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb00a01700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdafc0b0fe0 0x7fdafc0af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57936/0 (socket says 172.21.2.137:57936) 2021-11-15T19:34:36.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb00a01700 1 -- 172.21.2.137:0/300876320 learned_addr learned my addr 172.21.2.137:0/300876320 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:36.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafbfff700 1 --2- 172.21.2.137:0/300876320 >> v2:172.21.2.137:3300/0 conn(0x7fdafc0afde0 0x7fdafc0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafbfff700 1 -- 172.21.2.137:0/300876320 >> v1:172.21.2.137:6789/0 conn(0x7fdafc0b0fe0 legacy=0x7fdafc0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafbfff700 1 -- 172.21.2.137:0/300876320 >> v1:172.21.2.111:6789/0 conn(0x7fdafc13f5c0 legacy=0x7fdafc13c640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:36.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafbfff700 1 -- 172.21.2.137:0/300876320 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0b13c0 con 0x7fdafc0afde0 2021-11-15T19:34:36.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafbfff700 1 --2- 172.21.2.137:0/300876320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc0afde0 0x7fdafc0acff0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fdafc0aec90 tx=0x7fdae4006df0).ready entity=mon.1 client_cookie=811a55a34b717a16 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafb7fe700 1 -- 172.21.2.137:0/300876320 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae4014070 con 0x7fdafc0afde0 2021-11-15T19:34:36.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafb7fe700 1 -- 172.21.2.137:0/300876320 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4000e90 con 0x7fdafc0afde0 2021-11-15T19:34:36.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdafb7fe700 1 -- 172.21.2.137:0/300876320 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae400fbb0 con 0x7fdafc0afde0 2021-11-15T19:34:36.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- 172.21.2.137:0/300876320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc0afde0 msgr2=0x7fdafc0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 --2- 172.21.2.137:0/300876320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc0afde0 0x7fdafc0acff0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fdafc0aec90 tx=0x7fdae4006df0).stop 2021-11-15T19:34:36.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- 172.21.2.137:0/300876320 shutdown_connections 2021-11-15T19:34:36.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 --2- 172.21.2.137:0/300876320 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc0afde0 0x7fdafc0acff0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- 172.21.2.137:0/300876320 >> 172.21.2.137:0/300876320 conn(0x7fdafc0b5f50 msgr2=0x7fdafc0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- 172.21.2.137:0/300876320 shutdown_connections 2021-11-15T19:34:36.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- 172.21.2.137:0/300876320 wait complete. 2021-11-15T19:34:36.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 Processor -- start 2021-11-15T19:34:36.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.825+0000 7fdb02c65700 1 -- start start 2021-11-15T19:34:36.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdafc0afde0 0x7fdafc142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdafc0b0fe0 0x7fdafc14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 0x7fdafc14e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc1100d0 con 0x7fdafc0afde0 2021-11-15T19:34:36.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc10f900 con 0x7fdafc13f5c0 2021-11-15T19:34:36.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc066380 con 0x7fdafc0b0fe0 2021-11-15T19:34:36.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 0x7fdafc14e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 0x7fdafc14e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39164/0 (socket says 172.21.2.137:39164) 2021-11-15T19:34:36.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 -- 172.21.2.137:0/2583949555 learned_addr learned my addr 172.21.2.137:0/2583949555 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:36.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 -- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdafc0b0fe0 msgr2=0x7fdafc14e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdafc0b0fe0 0x7fdafc14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 -- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdafc0afde0 msgr2=0x7fdafc142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdafc0afde0 0x7fdafc142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 -- 172.21.2.137:0/2583949555 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae400b180 con 0x7fdafc13f5c0 2021-11-15T19:34:36.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb01202700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 0x7fdafc14e720 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7fdaf4003270 tx=0x7fdaf40090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf400d4a0 con 0x7fdafc13f5c0 2021-11-15T19:34:36.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf400d600 con 0x7fdafc13f5c0 2021-11-15T19:34:36.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf400d960 con 0x7fdafc13f5c0 2021-11-15T19:34:36.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc143180 con 0x7fdafc13f5c0 2021-11-15T19:34:36.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc14db00 con 0x7fdafc13f5c0 2021-11-15T19:34:36.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc10f720 con 0x7fdafc13f5c0 2021-11-15T19:34:36.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdaf4018030 con 0x7fdafc13f5c0 2021-11-15T19:34:36.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdaf9ffb700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae00536a0 0x7fdae0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdaf406b1a0 con 0x7fdafc13f5c0 2021-11-15T19:34:36.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb00a01700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae00536a0 0x7fdae0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.829+0000 7fdb00a01700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae00536a0 0x7fdae0055b60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fdafc0b04d0 tx=0x7fdaec007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.833+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdaf40423b0 con 0x7fdafc13f5c0 2021-11-15T19:34:36.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.913+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdafc0ad690 con 0x7fdafc13f5c0 2021-11-15T19:34:36.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.913+0000 7fdaf9ffb700 1 -- 172.21.2.137:0/2583949555 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdaf40459d0 con 0x7fdafc13f5c0 2021-11-15T19:34:36.926 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:36.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae00536a0 msgr2=0x7fdae0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae00536a0 0x7fdae0055b60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fdafc0b04d0 tx=0x7fdaec007800).stop 2021-11-15T19:34:36.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 msgr2=0x7fdafc14e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 0x7fdafc14e720 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7fdaf4003270 tx=0x7fdaf40090f0).stop 2021-11-15T19:34:36.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 shutdown_connections 2021-11-15T19:34:36.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdae00536a0 0x7fdae0055b60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdafc13f5c0 0x7fdafc14e720 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdafc0b0fe0 0x7fdafc14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 --2- 172.21.2.137:0/2583949555 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdafc0afde0 0x7fdafc142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 >> 172.21.2.137:0/2583949555 conn(0x7fdafc0b5f50 msgr2=0x7fdafc13cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 shutdown_connections 2021-11-15T19:34:36.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.917+0000 7fdb02c65700 1 -- 172.21.2.137:0/2583949555 wait complete. 2021-11-15T19:34:36.933 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:34:36.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 Processor -- start 2021-11-15T19:34:36.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- start start 2021-11-15T19:34:36.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f79500b72e0 0x7f79500b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500b76c0 con 0x7f79500ad320 2021-11-15T19:34:36.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795012a170 con 0x7f79500acd60 2021-11-15T19:34:36.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500b3100 con 0x7f79500b72e0 2021-11-15T19:34:36.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794effd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f79500acd60 0x7f79500b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57950/0 (socket says 172.21.2.137:57950) 2021-11-15T19:34:36.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794effd700 1 -- 172.21.2.137:0/106474242 learned_addr learned my addr 172.21.2.137:0/106474242 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:36.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- 172.21.2.137:0/106474242 >> v2:172.21.2.137:3300/0 conn(0x7f79500b72e0 0x7f79500b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/106474242 >> v1:172.21.2.137:6789/0 conn(0x7f79500acd60 legacy=0x7f79500b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/106474242 >> v1:172.21.2.111:6789/0 conn(0x7f79500ad320 legacy=0x7f79501290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:36.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/106474242 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500ad8a0 con 0x7f79500b72e0 2021-11-15T19:34:36.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- 172.21.2.137:0/106474242 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500b72e0 0x7f79500b19b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f7950065c40 tx=0x7f7944006df0).ready entity=mon.1 client_cookie=ee6cebeea83b0524 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794e7fc700 1 -- 172.21.2.137:0/106474242 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794400d5c0 con 0x7f79500b72e0 2021-11-15T19:34:36.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794e7fc700 1 -- 172.21.2.137:0/106474242 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944000e90 con 0x7f79500b72e0 2021-11-15T19:34:36.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794e7fc700 1 -- 172.21.2.137:0/106474242 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794400d910 con 0x7f79500b72e0 2021-11-15T19:34:36.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- 172.21.2.137:0/106474242 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500b72e0 msgr2=0x7f79500b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 --2- 172.21.2.137:0/106474242 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500b72e0 0x7f79500b19b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f7950065c40 tx=0x7f7944006df0).stop 2021-11-15T19:34:36.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- 172.21.2.137:0/106474242 shutdown_connections 2021-11-15T19:34:36.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 --2- 172.21.2.137:0/106474242 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500b72e0 0x7f79500b19b0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:36.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- 172.21.2.137:0/106474242 >> 172.21.2.137:0/106474242 conn(0x7f7950064960 msgr2=0x7f7950064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:36.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- 172.21.2.137:0/106474242 shutdown_connections 2021-11-15T19:34:36.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- 172.21.2.137:0/106474242 wait complete. 2021-11-15T19:34:36.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 Processor -- start 2021-11-15T19:34:36.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- start start 2021-11-15T19:34:36.994 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 0x7f795012d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79500ad320 0x7f79500af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79500b72e0 0x7f79500af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950150a80 con 0x7f79500b72e0 2021-11-15T19:34:36.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795012d8c0 con 0x7f79500acd60 2021-11-15T19:34:36.995 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f7956153700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500afb40 con 0x7f79500ad320 2021-11-15T19:34:36.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 0x7f795012d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:36.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 0x7f795012d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39176/0 (socket says 172.21.2.137:39176) 2021-11-15T19:34:36.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/2954569678 learned_addr learned my addr 172.21.2.137:0/2954569678 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:36.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79500ad320 msgr2=0x7f79500af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79500ad320 0x7f79500af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79500b72e0 msgr2=0x7f79500af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:36.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79500b72e0 0x7f79500af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:36.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 -- 172.21.2.137:0/2954569678 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794400b180 con 0x7f79500acd60 2021-11-15T19:34:36.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.977+0000 7f794f7fe700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 0x7f795012d0e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f7950065c40 tx=0x7f7944012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:36.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7944016070 con 0x7f79500acd60 2021-11-15T19:34:36.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944002f50 con 0x7f79500acd60 2021-11-15T19:34:36.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794401e450 con 0x7f79500acd60 2021-11-15T19:34:36.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795012d5d0 con 0x7f79500acd60 2021-11-15T19:34:36.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500b0a80 con 0x7f79500acd60 2021-11-15T19:34:36.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79501508c0 con 0x7f79500acd60 2021-11-15T19:34:36.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7944025030 con 0x7f79500acd60 2021-11-15T19:34:36.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7930053690 0x7f7930055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:36.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f794406cc10 con 0x7f79500acd60 2021-11-15T19:34:37.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794effd700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7930053690 0x7f7930055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:37.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794effd700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7930053690 0x7f7930055b50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f79500ac910 tx=0x7f7948007b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:37.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:36.981+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7944043c60 con 0x7f79500acd60 2021-11-15T19:34:37.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79500573d0 con 0x7f79500acd60 2021-11-15T19:34:37.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f794cff9700 1 -- 172.21.2.137:0/2954569678 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7944047280 con 0x7f79500acd60 2021-11-15T19:34:37.076 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:34:37.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7930053690 msgr2=0x7f7930055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7930053690 0x7f7930055b50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f79500ac910 tx=0x7f7948007b50).stop 2021-11-15T19:34:37.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 msgr2=0x7f795012d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 0x7f795012d0e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f7950065c40 tx=0x7f7944012000).stop 2021-11-15T19:34:37.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 shutdown_connections 2021-11-15T19:34:37.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7930053690 0x7f7930055b50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f79500b72e0 0x7f79500af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f79500ad320 0x7f79500af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 --2- 172.21.2.137:0/2954569678 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f79500acd60 0x7f795012d0e0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:37.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 >> 172.21.2.137:0/2954569678 conn(0x7f7950064960 msgr2=0x7f7950128890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:37.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 shutdown_connections 2021-11-15T19:34:37.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.065+0000 7f7956153700 1 -- 172.21.2.137:0/2954569678 wait complete. 2021-11-15T19:34:37.084 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:34:37.084 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:34:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 Processor -- start 2021-11-15T19:34:37.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 -- start start 2021-11-15T19:34:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 0x7f063009cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f06300b3140 0x7f063005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f063009ab00 0x7f0630143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063009d190 con 0x7f063009ab00 2021-11-15T19:34:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0630099790 con 0x7f06300b3140 2021-11-15T19:34:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0638592700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300b2940 con 0x7f063009c8c0 2021-11-15T19:34:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f06300b3140 0x7f063005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:37.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f06300b3140 0x7f063005f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39186/0 (socket says 172.21.2.137:39186) 2021-11-15T19:34:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 -- 172.21.2.137:0/540892329 learned_addr learned my addr 172.21.2.137:0/540892329 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 -- 172.21.2.137:0/540892329 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 msgr2=0x7f063009cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 --2- 172.21.2.137:0/540892329 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 0x7f063009cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 -- 172.21.2.137:0/540892329 >> v2:172.21.2.111:3300/0 conn(0x7f063009ab00 msgr2=0x7f0630143260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:37.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 --2- 172.21.2.137:0/540892329 >> v2:172.21.2.111:3300/0 conn(0x7f063009ab00 0x7f0630143260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 -- 172.21.2.137:0/540892329 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0630099a30 con 0x7f06300b3140 2021-11-15T19:34:37.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f0635b2d700 1 --2- 172.21.2.137:0/540892329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f063005f730 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f0624002f70 tx=0x7f0624006eb0).ready entity=mon.1 client_cookie=53fa052fb6ee6c9d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:37.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f063532c700 1 -- 172.21.2.137:0/540892329 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062400d570 con 0x7f06300b3140 2021-11-15T19:34:37.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f063532c700 1 -- 172.21.2.137:0/540892329 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624000e90 con 0x7f06300b3140 2021-11-15T19:34:37.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.157+0000 7f063532c700 1 -- 172.21.2.137:0/540892329 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062400d900 con 0x7f06300b3140 2021-11-15T19:34:37.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/540892329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 msgr2=0x7f063005f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- 172.21.2.137:0/540892329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f063005f730 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f0624002f70 tx=0x7f0624006eb0).stop 2021-11-15T19:34:37.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/540892329 shutdown_connections 2021-11-15T19:34:37.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- 172.21.2.137:0/540892329 >> v2:172.21.2.111:3300/0 conn(0x7f063009ab00 0x7f0630143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- 172.21.2.137:0/540892329 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f063005f730 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:37.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- 172.21.2.137:0/540892329 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 0x7f063009cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/540892329 >> 172.21.2.137:0/540892329 conn(0x7f06300b45b0 msgr2=0x7f063005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:37.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/540892329 shutdown_connections 2021-11-15T19:34:37.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/540892329 wait complete. 2021-11-15T19:34:37.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 Processor -- start 2021-11-15T19:34:37.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- start start 2021-11-15T19:34:37.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f063009ab00 0x7f06300ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 0x7f063013fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f06301403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300ac990 con 0x7f063009ab00 2021-11-15T19:34:37.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630150500 con 0x7f06300b3140 2021-11-15T19:34:37.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06301507a0 con 0x7f063009c8c0 2021-11-15T19:34:37.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f06301403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:37.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f06301403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39192/0 (socket says 172.21.2.137:39192) 2021-11-15T19:34:37.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 -- 172.21.2.137:0/2657789460 learned_addr learned my addr 172.21.2.137:0/2657789460 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:37.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 -- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 msgr2=0x7f063013fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 0x7f063013fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 -- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f063009ab00 msgr2=0x7f06300ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f063009ab00 0x7f06300ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 -- 172.21.2.137:0/2657789460 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062400b1e0 con 0x7f06300b3140 2021-11-15T19:34:37.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0636b2f700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f06301403c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f0628003330 tx=0x7f06280091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:37.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0628001520 con 0x7f06300b3140 2021-11-15T19:34:37.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628001680 con 0x7f06300b3140 2021-11-15T19:34:37.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300afe30 con 0x7f06300b3140 2021-11-15T19:34:37.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06300b0220 con 0x7f06300b3140 2021-11-15T19:34:37.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06280019e0 con 0x7f06300b3140 2021-11-15T19:34:37.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06300573d0 con 0x7f06300b3140 2021-11-15T19:34:37.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0628018030 con 0x7f06300b3140 2021-11-15T19:34:37.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f06237fe700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f06100536d0 0x7f0610055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:37.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f062806b400 con 0x7f06300b3140 2021-11-15T19:34:37.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.161+0000 7f063632e700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f06100536d0 0x7f0610055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:37.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.165+0000 7f063632e700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f06100536d0 0x7f0610055b90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f062c002f70 tx=0x7f062c006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:37.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.165+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0628042500 con 0x7f06300b3140 2021-11-15T19:34:37.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0630150960 con 0x7f06300b3140 2021-11-15T19:34:37.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f06237fe700 1 -- 172.21.2.137:0/2657789460 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f0628045b20 con 0x7f06300b3140 2021-11-15T19:34:37.284 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:37.284 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":57,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/1937261911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":1937261911},{"type":"v1","addr":"172.21.2.111:6835","nonce":1937261911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:34:32.401324+0000","modified":"2021-11-15T19:34:33.405100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7564":{"gid":7564,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/3862600413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3862600413},{"type":"v1","addr":"172.21.2.137:6833","nonce":3862600413}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T19:34:37.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f06100536d0 msgr2=0x7f0610055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f06100536d0 0x7f0610055b90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f062c002f70 tx=0x7f062c006a80).stop 2021-11-15T19:34:37.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 msgr2=0x7f06301403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:37.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f06301403c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f0628003330 tx=0x7f06280091a0).stop 2021-11-15T19:34:37.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 shutdown_connections 2021-11-15T19:34:37.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f06100536d0 0x7f0610055b90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:37.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f06300b3140 0x7f06301403c0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:37.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f063009c8c0 0x7f063013fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 --2- 172.21.2.137:0/2657789460 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f063009ab00 0x7f06300ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:37.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 >> 172.21.2.137:0/2657789460 conn(0x7f06300b45b0 msgr2=0x7f06300b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:37.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 shutdown_connections 2021-11-15T19:34:37.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:37.273+0000 7f0638592700 1 -- 172.21.2.137:0/2657789460 wait complete. 2021-11-15T19:34:37.288 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 57 2021-11-15T19:34:37.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:34:32.401324+0000', 'modified': '2021-11-15T19:34:33.405100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7564}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7564': {'gid': 7564, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/3862600413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 3862600413}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 3862600413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:34:37.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:34:37.493 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:34:37.558 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7564,"want_state":"up:active","state":"up:active","rank_uptime":5.1470664380000004,"mdsmap_epoch":57,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":9.312170643} 2021-11-15T19:34:37.559 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7564, "mdsmap_epoch": 57, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 5.147066438, "state": "up:active", "uptime": 9.312170643, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:34:37.559 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:34:37.560 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:34:37.560 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:34:37.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:37.561 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:37.571 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:34:37.624 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:37.624 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:37.630 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:37.630 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:37.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:37.632 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:34:37.636 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:34:37.636 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:37.679 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:34:37.689 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:37.689 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:37.694 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:37.695 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:37.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:37.696 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:34:37.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14510]: starting ceph client 2021-11-15T19:34:37.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:34:37.716+0000 7f9b1a974080 -1 init, newargv = 0x55d535191620 newargc=9 2021-11-15T19:34:37.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14510]: starting fuse 2021-11-15T19:34:38.825 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:34:38.837 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:34:38.838 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:34:38.888 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:34:38.889 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:34:38.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:38.890 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:34:38.895 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:34:38.896 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:34:38.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:38.897 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:34:38.897 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:34:38.898 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:34:38.898 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:34:38.898 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:34:38.899 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:38.899 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:34:38.900 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:34:38.900 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:34:38.900 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:38.901 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:34:38.901 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:34:38.902 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:34:38.902 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:34:38.902 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:38.903 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:34:38.903 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:34:38.904 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:34:38.904 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:34:38.904 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:34:38.905 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:34:38.905 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:34:38.906 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:34:38.971 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14510.asok 2021-11-15T19:34:38.974 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14510.asok 2021-11-15T19:34:38.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:38.975 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14510.asok status 2021-11-15T19:34:39.022 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:34:39.022 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:34:39.023 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:34:39.023 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:34:39.023 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:34:39.023 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:34:39.024 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:34:39.024 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14510", 2021-11-15T19:34:39.024 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:34:39.024 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:39.025 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:34:39.025 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:34:39.025 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 7768, 2021-11-15T19:34:39.025 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:34:39.025 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:34:39.026 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:34:39.026 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 7768 2021-11-15T19:34:39.026 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:39.026 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:34:39.027 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:34:39.027 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:34:39.027 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 3074466621 2021-11-15T19:34:39.027 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:34:39.027 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:39.028 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:34:39.028 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:34:39.028 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:34:39.028 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 3074466621 2021-11-15T19:34:39.028 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:34:39.029 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.7768 172.21.2.118:0/3074466621", 2021-11-15T19:34:39.029 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/3074466621", 2021-11-15T19:34:39.029 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:34:39.029 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 57, 2021-11-15T19:34:39.030 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 112, 2021-11-15T19:34:39.030 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:34:39.030 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:34:39.030 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:34:39.030 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:34:39.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:39.032 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:39.032 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:39.041 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:39.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:39.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:39.043 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:39.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:39.064 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:39.064 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:39.076 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:34:39.077 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:39.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:39.078 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:39.079 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:39.089 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:34:39.091 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:34:39.091 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:34:39.092 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:34:39.092 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:39.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15106]: fuse finished with error 0 and tester_r 0 2021-11-15T19:34:39.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:39.148 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:39.148 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:39.152 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:34:39.152 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:34:39.152 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:34:45.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:45.255 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:34:45.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:45.266 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:45.267 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:45.278 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:45.280 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:45.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:45.281 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:45.281 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:45.332 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:34:45.333 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:34:45.334 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:34:45.334 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:34:45.334 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:45.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14510]: fuse finished with error 0 and tester_r 0 2021-11-15T19:34:45.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:34:45.350 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:34:45.350 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:45.354 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:34:45.354 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:34:45.355 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:34:51.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:34:51.458 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:34:51.469 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:34:51.469 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:34:51.469 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:34:51.470 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:34:51.482 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:34:51.482 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:34:51.483 DEBUG:teuthology.parallel:result is None 2021-11-15T19:34:51.483 DEBUG:teuthology.parallel:result is None 2021-11-15T19:34:51.484 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-11-15T19:34:51.484 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-11-15T19:34:51.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 Processor -- start 2021-11-15T19:34:51.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fbb43e700 1 Processor -- start 2021-11-15T19:34:51.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 -- start start 2021-11-15T19:34:51.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fbb43e700 1 -- start start 2021-11-15T19:34:51.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fbb43e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8fb409cda0 0x7f8fb409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fbb43e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb405bd20 con 0x7f8fb40b2be0 2021-11-15T19:34:51.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fbb43e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb409b0e0 con 0x7f8fb409a670 2021-11-15T19:34:51.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b9d40 0x7f92000b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fbb43e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb409b340 con 0x7f8fb409cda0 2021-11-15T19:34:51.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f92000b58a0 0x7f92000b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92000ba120 con 0x7f92000b3250 2021-11-15T19:34:51.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9200146de0 con 0x7f92000b58a0 2021-11-15T19:34:51.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9207e43700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9200147080 con 0x7f92000b9d40 2021-11-15T19:34:51.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb99db700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8fb409cda0 0x7f8fb409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb91da700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8fb409a670 0x7f8fb409c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:57978/0 (socket says 172.21.2.137:57978) 2021-11-15T19:34:51.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb91da700 1 -- 172.21.2.137:0/2377293670 learned_addr learned my addr 172.21.2.137:0/2377293670 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:51.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9205bdf700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b9d40 0x7f92000b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f92053de700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f92000b58a0 0x7f92000b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f92063e0700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f92000b3250 0x7f9200142bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:50476/0 (socket says 172.21.2.137:50476) 2021-11-15T19:34:51.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f92063e0700 1 -- 172.21.2.137:0/1261832880 learned_addr learned my addr 172.21.2.137:0/1261832880 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:51.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb99db700 1 -- 172.21.2.137:0/2377293670 >> v1:172.21.2.137:6789/0 conn(0x7f8fb409a670 legacy=0x7f8fb409c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb99db700 1 -- 172.21.2.137:0/2377293670 >> v1:172.21.2.111:6789/0 conn(0x7f8fb40b2be0 legacy=0x7f8fb405c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:51.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb99db700 1 -- 172.21.2.137:0/2377293670 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40acc50 con 0x7f8fb409cda0 2021-11-15T19:34:51.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9205bdf700 1 -- 172.21.2.137:0/1261832880 >> v2:172.21.2.111:3300/0 conn(0x7f92000b58a0 msgr2=0x7f92000b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:51.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9205bdf700 1 --2- 172.21.2.137:0/1261832880 >> v2:172.21.2.111:3300/0 conn(0x7f92000b58a0 0x7f92000b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9205bdf700 1 -- 172.21.2.137:0/1261832880 >> v1:172.21.2.111:6789/0 conn(0x7f92000b3250 legacy=0x7f9200142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fb99db700 1 --2- 172.21.2.137:0/2377293670 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409cda0 0x7f8fb409aa50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f8fb40b2700 tx=0x7f8fac0091d0).ready entity=mon.1 client_cookie=f96103cb3b000d43 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:51.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9205bdf700 1 -- 172.21.2.137:0/1261832880 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92000b36e0 con 0x7f92000b9d40 2021-11-15T19:34:51.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f92053de700 1 --2- 172.21.2.137:0/1261832880 >> v2:172.21.2.111:3300/0 conn(0x7f92000b58a0 0x7f92000b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:34:51.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fa3fff700 1 -- 172.21.2.137:0/2377293670 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fac009ea0 con 0x7f8fb409cda0 2021-11-15T19:34:51.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fa3fff700 1 -- 172.21.2.137:0/2377293670 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac00b860 con 0x7f8fb409cda0 2021-11-15T19:34:51.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f8fa3fff700 1 -- 172.21.2.137:0/2377293670 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fac00b9d0 con 0x7f8fb409cda0 2021-11-15T19:34:51.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.525+0000 7f9205bdf700 1 --2- 172.21.2.137:0/1261832880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b9d40 0x7f92000b0840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f92000b4360 tx=0x7f91fc006df0).ready entity=mon.2 client_cookie=9061a06db152c7cb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:51.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9204bdd700 1 -- 172.21.2.137:0/1261832880 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91fc00d570 con 0x7f92000b9d40 2021-11-15T19:34:51.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9204bdd700 1 -- 172.21.2.137:0/1261832880 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc000e90 con 0x7f92000b9d40 2021-11-15T19:34:51.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9204bdd700 1 -- 172.21.2.137:0/1261832880 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91fc00d8c0 con 0x7f92000b9d40 2021-11-15T19:34:51.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/2377293670 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409cda0 msgr2=0x7f8fb409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/2377293670 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409cda0 0x7f8fb409aa50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f8fb40b2700 tx=0x7f8fac0091d0).stop 2021-11-15T19:34:51.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/2377293670 shutdown_connections 2021-11-15T19:34:51.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/2377293670 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409cda0 0x7f8fb409aa50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/2377293670 >> 172.21.2.137:0/2377293670 conn(0x7f8fb40b4660 msgr2=0x7f8fb405f800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:51.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/2377293670 shutdown_connections 2021-11-15T19:34:51.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/2377293670 wait complete. 2021-11-15T19:34:51.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/1261832880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b9d40 msgr2=0x7f92000b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 --2- 172.21.2.137:0/1261832880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b9d40 0x7f92000b0840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f92000b4360 tx=0x7f91fc006df0).stop 2021-11-15T19:34:51.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/1261832880 shutdown_connections 2021-11-15T19:34:51.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 --2- 172.21.2.137:0/1261832880 >> v2:172.21.2.111:3300/0 conn(0x7f92000b58a0 0x7f92000b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 --2- 172.21.2.137:0/1261832880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b9d40 0x7f92000b0840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/1261832880 >> 172.21.2.137:0/1261832880 conn(0x7f9200063060 msgr2=0x7f92000b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:51.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/1261832880 shutdown_connections 2021-11-15T19:34:51.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/1261832880 wait complete. 2021-11-15T19:34:51.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 Processor -- start 2021-11-15T19:34:51.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- start start 2021-11-15T19:34:51.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 0x7f8fb4067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8fb409cda0 0x7f8fb4091d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8fb40b2be0 0x7f8fb4153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4091660 con 0x7f8fb409cda0 2021-11-15T19:34:51.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4066be0 con 0x7f8fb409a670 2021-11-15T19:34:51.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4091890 con 0x7f8fb40b2be0 2021-11-15T19:34:51.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 Processor -- start 2021-11-15T19:34:51.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- start start 2021-11-15T19:34:51.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 0x7f8fb4067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 0x7f8fb4067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39208/0 (socket says 172.21.2.137:39208) 2021-11-15T19:34:51.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 -- 172.21.2.137:0/4211972105 learned_addr learned my addr 172.21.2.137:0/4211972105 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:51.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb99db700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8fb40b2be0 0x7f8fb4153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb89d9700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8fb409cda0 0x7f8fb4091d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 -- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8fb40b2be0 msgr2=0x7f8fb4153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8fb40b2be0 0x7f8fb4153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 -- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8fb409cda0 msgr2=0x7f8fb4091d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8fb409cda0 0x7f8fb4091d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 -- 172.21.2.137:0/4211972105 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac009470 con 0x7f8fb409a670 2021-11-15T19:34:51.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb91da700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 0x7f8fb4067660 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f8fb405da50 tx=0x7f8fa4007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:51.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b3250 0x7f92001561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 0x7f9200152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92000b9d40 0x7f9200152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92001557e0 con 0x7f92000b9d40 2021-11-15T19:34:51.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200155a80 con 0x7f92000b58a0 2021-11-15T19:34:51.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9200155d20 con 0x7f92000b3250 2021-11-15T19:34:51.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa40070d0 con 0x7f8fb409a670 2021-11-15T19:34:51.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4007230 con 0x7f8fb409a670 2021-11-15T19:34:51.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb4067b50 con 0x7f8fb409a670 2021-11-15T19:34:51.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 0x7f9200152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa4005610 con 0x7f8fb409a670 2021-11-15T19:34:51.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 0x7f9200152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39214/0 (socket says 172.21.2.137:39214) 2021-11-15T19:34:51.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 -- 172.21.2.137:0/580276257 learned_addr learned my addr 172.21.2.137:0/580276257 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:51.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb408fed0 con 0x7f8fb409a670 2021-11-15T19:34:51.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9205bdf700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b3250 0x7f92001561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92063e0700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92000b9d40 0x7f9200152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 -- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b3250 msgr2=0x7f92001561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b3250 0x7f92001561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 -- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92000b9d40 msgr2=0x7f9200152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:51.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92000b9d40 0x7f9200152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:51.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 -- 172.21.2.137:0/580276257 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f000b180 con 0x7f92000b58a0 2021-11-15T19:34:51.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92063e0700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92000b9d40 0x7f9200152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:51.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f92053de700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 0x7f9200152090 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f91f000c000 tx=0x7f91f0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:51.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f000ca40 con 0x7f92000b58a0 2021-11-15T19:34:51.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f000cba0 con 0x7f92000b58a0 2021-11-15T19:34:51.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc00b180 con 0x7f92000b58a0 2021-11-15T19:34:51.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f00123f0 con 0x7f92000b58a0 2021-11-15T19:34:51.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920013bb20 con 0x7f92000b58a0 2021-11-15T19:34:51.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8fa401a060 con 0x7f8fb409a670 2021-11-15T19:34:51.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9200155ee0 con 0x7f92000b58a0 2021-11-15T19:34:51.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb40ad020 con 0x7f8fb409a670 2021-11-15T19:34:51.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fa27fc700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f940536d0 0x7f8f94055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8fa406abd0 con 0x7f8fb409a670 2021-11-15T19:34:51.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f91f0012550 con 0x7f92000b58a0 2021-11-15T19:34:51.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb89d9700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f940536d0 0x7f8f94055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f91eeffd700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91e0053610 0x7f91e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:51.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f91f006c050 con 0x7f92000b58a0 2021-11-15T19:34:51.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f9205bdf700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91e0053610 0x7f91e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:51.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.529+0000 7f8fb89d9700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f940536d0 0x7f8f94055b90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8fb000b000 tx=0x7f8fb0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:51.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.533+0000 7f9205bdf700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91e0053610 0x7f91e0055ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f91fc018000 tx=0x7f91fc014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:51.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.533+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8fa4041d30 con 0x7f8fb409a670 2021-11-15T19:34:51.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.537+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91f0043150 con 0x7f92000b58a0 2021-11-15T19:34:51.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.649+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f8fb40573d0 con 0x7f8fb409a670 2021-11-15T19:34:51.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:51.653+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f92000b50c0 con 0x7f92000b58a0 2021-11-15T19:34:52.096 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:34:52.093+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:34:52.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.097+0000 7f91eeffd700 1 -- 172.21.2.137:0/580276257 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7564 v58) v1 ==== 95+0+0 (secure 0 0 0) 0x7f91f0046770 con 0x7f92000b58a0 2021-11-15T19:34:52.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.097+0000 7f8fa27fc700 1 -- 172.21.2.137:0/4211972105 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 4886 v58) v1 ==== 95+0+0 (secure 0 0 0) 0x7f8fa4018070 con 0x7f8fb409a670 2021-11-15T19:34:52.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f940536d0 msgr2=0x7f8f94055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f940536d0 0x7f8f94055b90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8fb000b000 tx=0x7f8fb0009040).stop 2021-11-15T19:34:52.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 msgr2=0x7f8fb4067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 0x7f8fb4067660 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f8fb405da50 tx=0x7f8fa4007ca0).stop 2021-11-15T19:34:52.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91e0053610 msgr2=0x7f91e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91e0053610 0x7f91e0055ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f91fc018000 tx=0x7f91fc014000).stop 2021-11-15T19:34:52.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 msgr2=0x7f9200152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 0x7f9200152090 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f91f000c000 tx=0x7f91f0006df0).stop 2021-11-15T19:34:52.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 shutdown_connections 2021-11-15T19:34:52.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8f940536d0 0x7f8f94055b90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8fb40b2be0 0x7f8fb4153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8fb409cda0 0x7f8fb4091d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 --2- 172.21.2.137:0/4211972105 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8fb409a670 0x7f8fb4067660 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 >> 172.21.2.137:0/4211972105 conn(0x7f8fb40b4660 msgr2=0x7f8fb409c660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:52.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 shutdown_connections 2021-11-15T19:34:52.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f8fbb43e700 1 -- 172.21.2.137:0/4211972105 wait complete. 2021-11-15T19:34:52.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 shutdown_connections 2021-11-15T19:34:52.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f91e0053610 0x7f91e0055ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f92000b9d40 0x7f9200152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000b58a0 0x7f9200152090 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 --2- 172.21.2.137:0/580276257 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f92000b3250 0x7f92001561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 >> 172.21.2.137:0/580276257 conn(0x7f9200063060 msgr2=0x7f92000b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:52.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 shutdown_connections 2021-11-15T19:34:52.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.101+0000 7f9207e43700 1 -- 172.21.2.137:0/580276257 wait complete. 2021-11-15T19:34:52.117 INFO:teuthology.orchestra.run.gibba037.stderr:failed mds gid 4886 2021-11-15T19:34:52.118 INFO:teuthology.orchestra.run.gibba037.stderr:failed mds gid 7564 2021-11-15T19:34:52.119 DEBUG:teuthology.parallel:result is '' 2021-11-15T19:34:52.120 DEBUG:teuthology.parallel:result is '' 2021-11-15T19:34:52.120 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:34:52.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 Processor -- start 2021-11-15T19:34:52.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- start start 2021-11-15T19:34:52.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f110c065b10 0x7f110c13c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:52.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f110c0b00a0 0x7f110c05bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:52.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c066270 con 0x7f110c065730 2021-11-15T19:34:52.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c067410 con 0x7f110c065b10 2021-11-15T19:34:52.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c065fd0 con 0x7f110c0b00a0 2021-11-15T19:34:52.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f110c0b00a0 0x7f110c05bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:52.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f110c0b00a0 0x7f110c05bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39222/0 (socket says 172.21.2.137:39222) 2021-11-15T19:34:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 -- 172.21.2.137:0/3372056958 learned_addr learned my addr 172.21.2.137:0/3372056958 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 -- 172.21.2.137:0/3372056958 >> v2:172.21.2.111:3300/0 conn(0x7f110c065b10 msgr2=0x7f110c13c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 --2- 172.21.2.137:0/3372056958 >> v2:172.21.2.111:3300/0 conn(0x7f110c065b10 0x7f110c13c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 -- 172.21.2.137:0/3372056958 >> v1:172.21.2.137:6789/0 conn(0x7f110c065730 legacy=0x7f110c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 -- 172.21.2.137:0/3372056958 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c066f70 con 0x7f110c0b00a0 2021-11-15T19:34:52.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f111084c700 1 --2- 172.21.2.137:0/3372056958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c05bd20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f11040032f0 tx=0x7f110400b530).ready entity=mon.1 client_cookie=3932871d63c0aa0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:52.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f110affd700 1 -- 172.21.2.137:0/3372056958 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11040155e0 con 0x7f110c0b00a0 2021-11-15T19:34:52.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f110affd700 1 -- 172.21.2.137:0/3372056958 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104015740 con 0x7f110c0b00a0 2021-11-15T19:34:52.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f110affd700 1 -- 172.21.2.137:0/3372056958 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1104015aa0 con 0x7f110c0b00a0 2021-11-15T19:34:52.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- 172.21.2.137:0/3372056958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 msgr2=0x7f110c05bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 --2- 172.21.2.137:0/3372056958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c05bd20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f11040032f0 tx=0x7f110400b530).stop 2021-11-15T19:34:52.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- 172.21.2.137:0/3372056958 shutdown_connections 2021-11-15T19:34:52.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 --2- 172.21.2.137:0/3372056958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c05bd20 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:52.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 --2- 172.21.2.137:0/3372056958 >> v2:172.21.2.111:3300/0 conn(0x7f110c065b10 0x7f110c13c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:52.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.161+0000 7f11122af700 1 -- 172.21.2.137:0/3372056958 >> 172.21.2.137:0/3372056958 conn(0x7f110c060290 msgr2=0x7f110c060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:52.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- 172.21.2.137:0/3372056958 shutdown_connections 2021-11-15T19:34:52.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- 172.21.2.137:0/3372056958 wait complete. 2021-11-15T19:34:52.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 Processor -- start 2021-11-15T19:34:52.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- start start 2021-11-15T19:34:52.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f110c065730 0x7f110c1428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:52.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f110c065b10 0x7f110c139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:52.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c13a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:52.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c140c40 con 0x7f110c065b10 2021-11-15T19:34:52.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c142450 con 0x7f110c0b00a0 2021-11-15T19:34:52.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0af650 con 0x7f110c065730 2021-11-15T19:34:52.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c13a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:52.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c13a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39230/0 (socket says 172.21.2.137:39230) 2021-11-15T19:34:52.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 -- 172.21.2.137:0/2817158004 learned_addr learned my addr 172.21.2.137:0/2817158004 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:52.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 -- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f110c065730 msgr2=0x7f110c1428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f110c065730 0x7f110c1428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:52.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 -- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f110c065b10 msgr2=0x7f110c139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:52.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f110c065b10 0x7f110c139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:52.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 -- 172.21.2.137:0/2817158004 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110400b7d0 con 0x7f110c0b00a0 2021-11-15T19:34:52.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f111084c700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c13a460 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f11040032f0 tx=0x7f1104019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:52.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1104009040 con 0x7f110c0b00a0 2021-11-15T19:34:52.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110401c580 con 0x7f110c0b00a0 2021-11-15T19:34:52.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c1407a0 con 0x7f110c0b00a0 2021-11-15T19:34:52.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0adac0 con 0x7f110c0b00a0 2021-11-15T19:34:52.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110401c920 con 0x7f110c0b00a0 2021-11-15T19:34:52.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4003410 con 0x7f110c0b00a0 2021-11-15T19:34:52.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f110401ca80 con 0x7f110c0b00a0 2021-11-15T19:34:52.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11097fa700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10ec0536d0 0x7f10ec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:52.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f110406d6c0 con 0x7f110c0b00a0 2021-11-15T19:34:52.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.165+0000 7f110bfff700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10ec0536d0 0x7f10ec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:52.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.169+0000 7f110bfff700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10ec0536d0 0x7f10ec055b90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f110c0612c0 tx=0x7f1100007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:52.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.169+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11040447d0 con 0x7f110c0b00a0 2021-11-15T19:34:52.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:52.277+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10e4003c40 con 0x7f110c0b00a0 2021-11-15T19:34:53.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11097fa700 1 -- 172.21.2.137:0/2817158004 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1104047df0 con 0x7f110c0b00a0 2021-11-15T19:34:53.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10ec0536d0 msgr2=0x7f10ec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:53.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10ec0536d0 0x7f10ec055b90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f110c0612c0 tx=0x7f1100007810).stop 2021-11-15T19:34:53.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 msgr2=0x7f110c13a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:53.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c13a460 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f11040032f0 tx=0x7f1104019000).stop 2021-11-15T19:34:53.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 shutdown_connections 2021-11-15T19:34:53.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10ec0536d0 0x7f10ec055b90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:53.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f110c0b00a0 0x7f110c13a460 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:53.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f110c065b10 0x7f110c139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:53.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 --2- 172.21.2.137:0/2817158004 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f110c065730 0x7f110c1428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:53.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 >> 172.21.2.137:0/2817158004 conn(0x7f110c060290 msgr2=0x7f110c13c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:53.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 shutdown_connections 2021-11-15T19:34:53.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.117+0000 7f11122af700 1 -- 172.21.2.137:0/2817158004 wait complete. 2021-11-15T19:34:53.135 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:34:53.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 Processor -- start 2021-11-15T19:34:53.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- start start 2021-11-15T19:34:53.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a0013f890 0x7f3a000b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:53.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3a0005f730 0x7f3a0005fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:53.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a000b0c80 con 0x7f3a000608f0 2021-11-15T19:34:53.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a000ad6c0 con 0x7f3a0005f730 2021-11-15T19:34:53.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a000b1b50 con 0x7f3a0013f890 2021-11-15T19:34:53.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a0013f890 0x7f3a000b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:53.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f3a0013f890 0x7f3a000b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39240/0 (socket says 172.21.2.137:39240) 2021-11-15T19:34:53.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 -- 172.21.2.137:0/1840592647 learned_addr learned my addr 172.21.2.137:0/1840592647 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:53.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 -- 172.21.2.137:0/1840592647 >> v2:172.21.2.111:3300/0 conn(0x7f3a0005f730 msgr2=0x7f3a0005fb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:53.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 --2- 172.21.2.137:0/1840592647 >> v2:172.21.2.111:3300/0 conn(0x7f3a0005f730 0x7f3a0005fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:53.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 -- 172.21.2.137:0/1840592647 >> v1:172.21.2.111:6789/0 conn(0x7f3a000608f0 legacy=0x7f3a000b2710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:34:53.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 -- 172.21.2.137:0/1840592647 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000b0f20 con 0x7f3a0013f890 2021-11-15T19:34:53.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39fffff700 1 --2- 172.21.2.137:0/1840592647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a000b1660 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f3a000b3ac0 tx=0x7f39f0006f40).ready entity=mon.1 client_cookie=f82cc778a70864ae server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:53.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39ff7fe700 1 -- 172.21.2.137:0/1840592647 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f000dc30 con 0x7f3a0013f890 2021-11-15T19:34:53.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39ff7fe700 1 -- 172.21.2.137:0/1840592647 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0000e90 con 0x7f3a0013f890 2021-11-15T19:34:53.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f39ff7fe700 1 -- 172.21.2.137:0/1840592647 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f000be90 con 0x7f3a0013f890 2021-11-15T19:34:53.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- 172.21.2.137:0/1840592647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 msgr2=0x7f3a000b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:53.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1840592647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a000b1660 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f3a000b3ac0 tx=0x7f39f0006f40).stop 2021-11-15T19:34:53.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- 172.21.2.137:0/1840592647 shutdown_connections 2021-11-15T19:34:53.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1840592647 >> v2:172.21.2.111:3300/0 conn(0x7f3a0005f730 0x7f3a0005fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:53.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1840592647 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a000b1660 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:53.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- 172.21.2.137:0/1840592647 >> 172.21.2.137:0/1840592647 conn(0x7f3a00063980 msgr2=0x7f3a00063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:53.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- 172.21.2.137:0/1840592647 shutdown_connections 2021-11-15T19:34:53.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- 172.21.2.137:0/1840592647 wait complete. 2021-11-15T19:34:53.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 Processor -- start 2021-11-15T19:34:53.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- start start 2021-11-15T19:34:53.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a0005f730 0x7f3a00143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:53.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a000608f0 0x7f3a00139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:53.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a00139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:53.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0012c290 con 0x7f3a0005f730 2021-11-15T19:34:53.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0012c530 con 0x7f3a0013f890 2021-11-15T19:34:53.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a06d14700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0012c7d0 con 0x7f3a000608f0 2021-11-15T19:34:53.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a052b1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a00139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:53.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a052b1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a00139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39246/0 (socket says 172.21.2.137:39246) 2021-11-15T19:34:53.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.181+0000 7f3a052b1700 1 -- 172.21.2.137:0/1191925181 learned_addr learned my addr 172.21.2.137:0/1191925181 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:53.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a052b1700 1 -- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a000608f0 msgr2=0x7f3a00139210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:53.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a052b1700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a000608f0 0x7f3a00139210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:53.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a052b1700 1 -- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a0005f730 msgr2=0x7f3a00143000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:34:53.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a052b1700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a0005f730 0x7f3a00143000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:53.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a052b1700 1 -- 172.21.2.137:0/1191925181 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f000b460 con 0x7f3a0013f890 2021-11-15T19:34:53.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a052b1700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a00139700 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f39f8003330 tx=0x7f39f80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:53.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f8001520 con 0x7f3a0013f890 2021-11-15T19:34:53.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8001680 con 0x7f3a0013f890 2021-11-15T19:34:53.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f80019e0 con 0x7f3a0013f890 2021-11-15T19:34:53.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0012cc70 con 0x7f3a0013f890 2021-11-15T19:34:53.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0012a990 con 0x7f3a0013f890 2021-11-15T19:34:53.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a00139d90 con 0x7f3a0013f890 2021-11-15T19:34:53.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f39f8018030 con 0x7f3a0013f890 2021-11-15T19:34:53.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f39fdffb700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39e40535d0 0x7f39e4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:53.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f39f806b4d0 con 0x7f3a0013f890 2021-11-15T19:34:53.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a04ab0700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39e40535d0 0x7f39e4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:53.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.185+0000 7f3a04ab0700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39e40535d0 0x7f39e4055a90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f39e8002fb0 tx=0x7f39e8006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:53.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.189+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f39f8042580 con 0x7f3a0013f890 2021-11-15T19:34:53.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:53.269+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a0012c990 con 0x7f3a0013f890 2021-11-15T19:34:54.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f39fdffb700 1 -- 172.21.2.137:0/1191925181 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 185+0+0 (secure 0 0 0) 0x7f39f8045ba0 con 0x7f3a0013f890 2021-11-15T19:34:54.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39e40535d0 msgr2=0x7f39e4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:54.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39e40535d0 0x7f39e4055a90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f39e8002fb0 tx=0x7f39e8006930).stop 2021-11-15T19:34:54.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 msgr2=0x7f3a00139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:54.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a00139700 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f39f8003330 tx=0x7f39f80091a0).stop 2021-11-15T19:34:54.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 shutdown_connections 2021-11-15T19:34:54.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f39e40535d0 0x7f39e4055a90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:54.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3a0013f890 0x7f3a00139700 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:54.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3a000608f0 0x7f3a00139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:54.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 --2- 172.21.2.137:0/1191925181 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3a0005f730 0x7f3a00143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:54.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 >> 172.21.2.137:0/1191925181 conn(0x7f3a00063980 msgr2=0x7f3a0005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:54.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 shutdown_connections 2021-11-15T19:34:54.134 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.121+0000 7f3a06d14700 1 -- 172.21.2.137:0/1191925181 wait complete. 2021-11-15T19:34:54.134 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:34:54.138 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:34:54.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 Processor -- start 2021-11-15T19:34:54.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- start start 2021-11-15T19:34:54.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffbd40b0550 0x7ffbd414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:54.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 0x7ffbd4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:54.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd405cb50 con 0x7ffbd405c770 2021-11-15T19:34:54.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40b1650 con 0x7ffbd40b0550 2021-11-15T19:34:54.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40ad030 con 0x7ffbd414aaa0 2021-11-15T19:34:54.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffbd40b0550 0x7ffbd414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:54.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffbd40b0550 0x7ffbd414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39254/0 (socket says 172.21.2.137:39254) 2021-11-15T19:34:54.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1145040269 learned_addr learned my addr 172.21.2.137:0/1145040269 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:54.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1145040269 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 msgr2=0x7ffbd4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:54.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 --2- 172.21.2.137:0/1145040269 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 0x7ffbd4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:54.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1145040269 >> v1:172.21.2.111:6789/0 conn(0x7ffbd405c770 legacy=0x7ffbd40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:54.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1145040269 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40ad2d0 con 0x7ffbd40b0550 2021-11-15T19:34:54.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd27fc700 1 --2- 172.21.2.137:0/1145040269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd414a5b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7ffbd40620e0 tx=0x7ffbc4006eb0).ready entity=mon.1 client_cookie=21fdb148250dbcfa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:54.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd1ffb700 1 -- 172.21.2.137:0/1145040269 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc400d570 con 0x7ffbd40b0550 2021-11-15T19:34:54.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd1ffb700 1 -- 172.21.2.137:0/1145040269 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4000e90 con 0x7ffbd40b0550 2021-11-15T19:34:54.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd1ffb700 1 -- 172.21.2.137:0/1145040269 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc400d8c0 con 0x7ffbd40b0550 2021-11-15T19:34:54.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1145040269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 msgr2=0x7ffbd414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:54.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1145040269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd414a5b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7ffbd40620e0 tx=0x7ffbc4006eb0).stop 2021-11-15T19:34:54.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1145040269 shutdown_connections 2021-11-15T19:34:54.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1145040269 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 0x7ffbd4140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:54.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1145040269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd414a5b0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:54.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1145040269 >> 172.21.2.137:0/1145040269 conn(0x7ffbd40631e0 msgr2=0x7ffbd405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:54.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1145040269 shutdown_connections 2021-11-15T19:34:54.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.181+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1145040269 wait complete. 2021-11-15T19:34:54.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 Processor -- start 2021-11-15T19:34:54.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- start start 2021-11-15T19:34:54.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbd405c770 0x7ffbd4149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:54.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd41565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:54.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 0x7ffbd415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:54.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4159b80 con 0x7ffbd405c770 2021-11-15T19:34:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4144890 con 0x7ffbd40b0550 2021-11-15T19:34:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4144b30 con 0x7ffbd414aaa0 2021-11-15T19:34:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd41565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd41565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39258/0 (socket says 172.21.2.137:39258) 2021-11-15T19:34:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1253238436 learned_addr learned my addr 172.21.2.137:0/1253238436 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 msgr2=0x7ffbd415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 0x7ffbd415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbd405c770 msgr2=0x7ffbd4149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbd405c770 0x7ffbd4149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:54.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 -- 172.21.2.137:0/1253238436 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc400b1e0 con 0x7ffbd40b0550 2021-11-15T19:34:54.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd27fc700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd41565f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7ffbd4143460 tx=0x7ffbc4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:54.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc400d8f0 con 0x7ffbd40b0550 2021-11-15T19:34:54.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4006b80 con 0x7ffbd40b0550 2021-11-15T19:34:54.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc4011e90 con 0x7ffbd40b0550 2021-11-15T19:34:54.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd4159db0 con 0x7ffbd40b0550 2021-11-15T19:34:54.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd4156ae0 con 0x7ffbd40b0550 2021-11-15T19:34:54.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd40ae7f0 con 0x7ffbd40b0550 2021-11-15T19:34:54.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffbc4025030 con 0x7ffbd40b0550 2021-11-15T19:34:54.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbcbfff700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffbb80536a0 0x7ffbb8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:54.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5717+0+0 (secure 0 0 0) 0x7ffbc406ca50 con 0x7ffbd40b0550 2021-11-15T19:34:54.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.185+0000 7ffbd2ffd700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffbb80536a0 0x7ffbb8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:54.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.189+0000 7ffbd2ffd700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffbb80536a0 0x7ffbb8055b60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7ffbbc002ef0 tx=0x7ffbbc006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:54.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.189+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffbc4043d10 con 0x7ffbd40b0550 2021-11-15T19:34:54.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:54.273+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ffbd405db30 con 0x7ffbd40b0550 2021-11-15T19:34:54.523 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:54.526 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:54.529 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:54.533 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:54.536 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:34:55.142 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbcbfff700 1 -- 172.21.2.137:0/1253238436 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v116) v1 ==== 133+0+0 (secure 0 0 0) 0x7ffbc4023020 con 0x7ffbd40b0550 2021-11-15T19:34:55.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffbb80536a0 msgr2=0x7ffbb8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:55.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffbb80536a0 0x7ffbb8055b60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7ffbbc002ef0 tx=0x7ffbbc006910).stop 2021-11-15T19:34:55.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 msgr2=0x7ffbd41565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:55.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd41565f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7ffbd4143460 tx=0x7ffbc4015000).stop 2021-11-15T19:34:55.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 shutdown_connections 2021-11-15T19:34:55.145 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffbb80536a0 0x7ffbb8055b60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffbd414aaa0 0x7ffbd415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:55.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffbd40b0550 0x7ffbd41565f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 --2- 172.21.2.137:0/1253238436 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffbd405c770 0x7ffbd4149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:55.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 >> 172.21.2.137:0/1253238436 conn(0x7ffbd40631e0 msgr2=0x7ffbd40b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:55.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 shutdown_connections 2021-11-15T19:34:55.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:55.133+0000 7ffbd93e3700 1 -- 172.21.2.137:0/1253238436 wait complete. 2021-11-15T19:34:55.147 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:34:55.150 DEBUG:teuthology.orchestra.run.gibba031:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-11-15T19:34:55.180 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/3323337565 wait complete. 2021-11-15T19:34:55.180 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 Processor -- start 2021-11-15T19:34:55.180 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- start start 2021-11-15T19:34:55.181 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d032a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.181 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d022f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.181 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d023400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.181 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3cf22210 con 0x561b3cf94dd0 2021-11-15T19:34:55.182 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3cf12460 con 0x561b3cf958c0 2021-11-15T19:34:55.182 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b3d023a60 con 0x561b3d033150 2021-11-15T19:34:55.182 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d022f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.182 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d022f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.131:47886/0 (socket says 172.21.2.131:47886) 2021-11-15T19:34:55.183 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/2690847778 learned_addr learned my addr 172.21.2.131:0/2690847778 (peer_addr_for_me v2:172.21.2.131:0/0) 2021-11-15T19:34:55.183 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd906050700 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d032a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.183 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd906851700 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d023400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.183 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 msgr2=0x561b3d023400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:55.183 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d023400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.184 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 msgr2=0x561b3d032a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:55.184 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d032a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.184 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/2690847778 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90000a0e0 con 0x561b3cf958c0 2021-11-15T19:34:55.184 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd906050700 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d032a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:34:55.185 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d022f10 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x561b3cf94d90 tx=0x7fd8fc0018e0).ready entity=mon.1 client_cookie=cc29362b9aa54cfb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:55.185 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd8f7fff700 1 -- 172.21.2.131:0/2690847778 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc00be40 con 0x561b3cf958c0 2021-11-15T19:34:55.185 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd8f7fff700 1 -- 172.21.2.131:0/2690847778 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc008070 con 0x561b3cf958c0 2021-11-15T19:34:55.185 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd8f7fff700 1 -- 172.21.2.131:0/2690847778 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc010650 con 0x561b3cf958c0 2021-11-15T19:34:55.186 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/2690847778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 msgr2=0x561b3d022f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:55.186 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d022f10 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x561b3cf94d90 tx=0x7fd8fc0018e0).stop 2021-11-15T19:34:55.186 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/2690847778 shutdown_connections 2021-11-15T19:34:55.186 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d023400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.187 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d022f10 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.187 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- 172.21.2.131:0/2690847778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d032a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.187 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/2690847778 >> 172.21.2.131:0/2690847778 conn(0x561b3d01bb20 msgr2=0x561b3d01c240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:55.187 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/2690847778 shutdown_connections 2021-11-15T19:34:55.187 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/2690847778 wait complete. 2021-11-15T19:34:55.188 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 Processor -- start 2021-11-15T19:34:55.188 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- start start 2021-11-15T19:34:55.188 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d0325f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.188 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d02d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.189 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d02dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.189 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d01dbf0 con 0x561b3cf94dd0 2021-11-15T19:34:55.189 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d02e130 con 0x561b3cf958c0 2021-11-15T19:34:55.189 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b3d02e2a0 con 0x561b3d033150 2021-11-15T19:34:55.190 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d02d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.190 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d02d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.131:47894/0 (socket says 172.21.2.131:47894) 2021-11-15T19:34:55.190 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/3688144305 learned_addr learned my addr 172.21.2.131:0/3688144305 (peer_addr_for_me v2:172.21.2.131:0/0) 2021-11-15T19:34:55.190 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd906851700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d02dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.190 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd906050700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d0325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.191 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 msgr2=0x561b3d02dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:55.191 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x561b3d033150 0x561b3d02dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.191 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 msgr2=0x561b3d0325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:55.191 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x561b3cf94dd0 0x561b3d0325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:55.192 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 -- 172.21.2.131:0/3688144305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc00a040 con 0x561b3cf958c0 2021-11-15T19:34:55.192 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd90584f700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d02d750 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x561b3cf94d90 tx=0x7fd8fc0018e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:55.192 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd8f77fe700 1 -- 172.21.2.131:0/3688144305 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc010b20 con 0x561b3cf958c0 2021-11-15T19:34:55.192 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b3cf0afe0 con 0x561b3cf958c0 2021-11-15T19:34:55.193 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.170+0000 7fd8f77fe700 1 -- 172.21.2.131:0/3688144305 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc010c80 con 0x561b3cf958c0 2021-11-15T19:34:55.193 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b3d043040 con 0x561b3cf958c0 2021-11-15T19:34:55.193 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd8f77fe700 1 -- 172.21.2.131:0/3688144305 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc01d460 con 0x561b3cf958c0 2021-11-15T19:34:55.193 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd8f77fe700 1 -- 172.21.2.131:0/3688144305 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8fc019040 con 0x561b3cf958c0 2021-11-15T19:34:55.193 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd8f77fe700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8e8052190 0x7fd8e8054650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.194 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd8f77fe700 1 -- 172.21.2.131:0/3688144305 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6071+0+0 (secure 0 0 0) 0x7fd8fc06b550 con 0x561b3cf958c0 2021-11-15T19:34:55.194 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd907c12b80 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x561b3d043d80 0x561b3d046170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:55.194 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 --> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e116) v8 -- 0x561b3d046660 con 0x561b3d043d80 2021-11-15T19:34:55.194 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd906050700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8e8052190 0x7fd8e8054650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.195 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd906851700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x561b3d043d80 0x561b3d046170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:55.195 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd906050700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8e8052190 0x7fd8e8054650 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd8f800d000 tx=0x7fd8f8001870).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:55.195 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:55.174+0000 7fd906851700 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x561b3d043d80 0x561b3d046170 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:56.160 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd8f77fe700 1 -- 172.21.2.131:0/3688144305 <== osd.0 v2:172.21.2.137:6800/14742 1 ==== osd_map(117..117 src has 1..117) v4 ==== 320+0+0 (crc 0 0 0) 0x7fd90000d8f0 con 0x561b3d043d80 2021-11-15T19:34:56.162 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd906851700 1 -- 172.21.2.131:0/3688144305 <== osd.0 v2:172.21.2.137:6800/14742 2 ==== osd_op_reply(1 key [writefull 0~617] v117'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fd90000dab0 con 0x561b3d043d80 2021-11-15T19:34:56.162 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x561b3d043d80 msgr2=0x561b3d046170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.163 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x561b3d043d80 0x561b3d046170 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:56.163 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8e8052190 msgr2=0x7fd8e8054650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.164 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8e8052190 0x7fd8e8054650 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd8f800d000 tx=0x7fd8f8001870).stop 2021-11-15T19:34:56.164 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 msgr2=0x561b3d02d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.164 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 --2- 172.21.2.131:0/3688144305 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x561b3cf958c0 0x561b3d02d750 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x561b3cf94d90 tx=0x7fd8fc0018e0).stop 2021-11-15T19:34:56.164 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd906851700 1 -- 172.21.2.131:0/3688144305 reap_dead start 2021-11-15T19:34:56.165 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 shutdown_connections 2021-11-15T19:34:56.165 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 >> 172.21.2.131:0/3688144305 conn(0x561b3d01bb20 msgr2=0x561b3d01c240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:56.165 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 shutdown_connections 2021-11-15T19:34:56.165 INFO:teuthology.orchestra.run.gibba031.stderr:2021-11-15T19:34:56.158+0000 7fd907c12b80 1 -- 172.21.2.131:0/3688144305 wait complete. 2021-11-15T19:34:56.170 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-15T19:34:56.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 Processor -- start 2021-11-15T19:34:56.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- start start 2021-11-15T19:34:56.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0d7c0b1340 0x7f0d7c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 0x7f0d7c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c148190 con 0x7f0d7c143f00 2021-11-15T19:34:56.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0b1720 con 0x7f0d7c0b1340 2021-11-15T19:34:56.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c147e70 con 0x7f0d7c0a9f50 2021-11-15T19:34:56.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0d7c143f00 0x7f0d7c144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58048/0 (socket says 172.21.2.137:58048) 2021-11-15T19:34:56.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 -- 172.21.2.137:0/3667959677 learned_addr learned my addr 172.21.2.137:0/3667959677 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:34:56.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331531829 0 0) 0x7f0d6c001110 con 0x7f0d7c143f00 2021-11-15T19:34:56.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d68003260 con 0x7f0d7c143f00 2021-11-15T19:34:56.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d81248700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 0x7f0d7c0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:56.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937083361 0 0) 0x7f0d68003260 con 0x7f0d7c143f00 2021-11-15T19:34:56.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 msgr2=0x7f0d7c0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:56.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 0x7f0d7c0aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:56.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 >> v2:172.21.2.111:3300/0 conn(0x7f0d7c0b1340 msgr2=0x7f0d7c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:56.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 --2- 172.21.2.137:0/3667959677 >> v2:172.21.2.111:3300/0 conn(0x7f0d7c0b1340 0x7f0d7c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0af800 con 0x7f0d7c143f00 2021-11-15T19:34:56.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f0d6c001810 con 0x7f0d7c143f00 2021-11-15T19:34:56.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 >> v1:172.21.2.137:6789/0 conn(0x7f0d7c143f00 legacy=0x7f0d7c144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 0x7f0d680037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d68003ee0 0x7f0d68004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d68004bf0 0x7f0d6800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0b1720 con 0x7f0d68004bf0 2021-11-15T19:34:56.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c147e70 con 0x7f0d68003ee0 2021-11-15T19:34:56.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680053a0 con 0x7f0d7c0a9f50 2021-11-15T19:34:56.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d68003ee0 0x7f0d68004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:56.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 -- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 msgr2=0x7f0d680037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:56.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d7c0a9f50 0x7f0d680037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 -- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d68004bf0 msgr2=0x7f0d6800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:34:56.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d68004bf0 0x7f0d6800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 -- 172.21.2.137:0/3667959677 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68003260 con 0x7f0d68003ee0 2021-11-15T19:34:56.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7bfff700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d68003ee0 0x7f0d68004500 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f0d6c001520 tx=0x7f0d7c0abfb0).ready entity=mon.1 client_cookie=6bc86802b5290f06 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:56.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6c007170 con 0x7f0d68003ee0 2021-11-15T19:34:56.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0072d0 con 0x7f0d68003ee0 2021-11-15T19:34:56.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d7b7fe700 1 -- 172.21.2.137:0/3667959677 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6c00ca20 con 0x7f0d68003ee0 2021-11-15T19:34:56.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- 172.21.2.137:0/3667959677 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d68003ee0 msgr2=0x7f0d68004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 --2- 172.21.2.137:0/3667959677 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d68003ee0 0x7f0d68004500 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f0d6c001520 tx=0x7f0d7c0abfb0).stop 2021-11-15T19:34:56.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d81248700 1 -- 172.21.2.137:0/3667959677 reap_dead start 2021-11-15T19:34:56.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- 172.21.2.137:0/3667959677 shutdown_connections 2021-11-15T19:34:56.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- 172.21.2.137:0/3667959677 >> 172.21.2.137:0/3667959677 conn(0x7f0d7c0b4e60 msgr2=0x7f0d7c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:56.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- 172.21.2.137:0/3667959677 shutdown_connections 2021-11-15T19:34:56.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- 172.21.2.137:0/3667959677 wait complete. 2021-11-15T19:34:56.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 Processor -- start 2021-11-15T19:34:56.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.229+0000 7f0d82cab700 1 -- start start 2021-11-15T19:34:56.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d68003ee0 0x7f0d7c0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d7c13fea0 0x7f0d7c13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 0x7f0d7c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c146d50 con 0x7f0d7c13fea0 2021-11-15T19:34:56.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0ad860 con 0x7f0d7c13dc90 2021-11-15T19:34:56.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c146f80 con 0x7f0d68003ee0 2021-11-15T19:34:56.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 0x7f0d7c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:56.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 0x7f0d7c156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39280/0 (socket says 172.21.2.137:39280) 2021-11-15T19:34:56.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 -- 172.21.2.137:0/437861553 learned_addr learned my addr 172.21.2.137:0/437861553 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:34:56.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 -- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d68003ee0 msgr2=0x7f0d7c0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d68003ee0 0x7f0d7c0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 -- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d7c13fea0 msgr2=0x7f0d7c13d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d7c13fea0 0x7f0d7c13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 -- 172.21.2.137:0/437861553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c147420 con 0x7f0d7c13dc90 2021-11-15T19:34:56.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d81248700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 0x7f0d7c156790 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f0d6c0019f0 tx=0x7f0d74008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:56.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d74010580 con 0x7f0d7c13dc90 2021-11-15T19:34:56.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740106e0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0ad4a0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d74010a40 con 0x7f0d7c13dc90 2021-11-15T19:34:56.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0ac7a0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c0ad6c0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d74010ba0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d79ffb700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d5c053640 0x7f0d5c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:34:56.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f0d7406b9a0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.233+0000 7f0d80a47700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d5c053640 0x7f0d5c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:34:56.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.237+0000 7f0d80a47700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d5c053640 0x7f0d5c055b00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0d70002f70 tx=0x7f0d70006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:34:56.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.237+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d7c0ad6c0 con 0x7f0d7c13dc90 2021-11-15T19:34:56.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f0d7c0ad690 con 0x7f0d7c13dc90 2021-11-15T19:34:56.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d79ffb700 1 -- 172.21.2.137:0/437861553 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1912 (secure 0 0 0) 0x7f0d74042b00 con 0x7f0d7c13dc90 2021-11-15T19:34:56.361 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:34:56.362 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:34:56.362 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:56.362 INFO:teuthology.orchestra.run.gibba037.stdout: "total_bytes": 721202184192, 2021-11-15T19:34:56.362 INFO:teuthology.orchestra.run.gibba037.stdout: "total_avail_bytes": 714958704640, 2021-11-15T19:34:56.363 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_bytes": 6243479552, 2021-11-15T19:34:56.363 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_bytes": 6243479552, 2021-11-15T19:34:56.363 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_ratio": 0.0086570447310805321, 2021-11-15T19:34:56.363 INFO:teuthology.orchestra.run.gibba037.stdout: "num_osds": 8, 2021-11-15T19:34:56.364 INFO:teuthology.orchestra.run.gibba037.stdout: "num_per_pool_osds": 0, 2021-11-15T19:34:56.364 INFO:teuthology.orchestra.run.gibba037.stdout: "num_per_pool_omap_osds": 0 2021-11-15T19:34:56.364 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:56.364 INFO:teuthology.orchestra.run.gibba037.stdout: "stats_by_class": { 2021-11-15T19:34:56.365 INFO:teuthology.orchestra.run.gibba037.stdout: "ssd": { 2021-11-15T19:34:56.365 INFO:teuthology.orchestra.run.gibba037.stdout: "total_bytes": 721202184192, 2021-11-15T19:34:56.365 INFO:teuthology.orchestra.run.gibba037.stdout: "total_avail_bytes": 714958704640, 2021-11-15T19:34:56.365 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_bytes": 6243479552, 2021-11-15T19:34:56.365 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_bytes": 6243479552, 2021-11-15T19:34:56.366 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_ratio": 0.0086570447310805321 2021-11-15T19:34:56.366 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:56.366 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:56.366 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:34:56.367 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:56.367 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "device_health_metrics", 2021-11-15T19:34:56.367 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 1, 2021-11-15T19:34:56.367 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:56.367 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:56.368 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 2, 2021-11-15T19:34:56.368 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:56.368 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:56.368 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:56.369 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449217024 2021-11-15T19:34:56.369 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:56.369 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:56.369 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:56.369 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rbd", 2021-11-15T19:34:56.370 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 2, 2021-11-15T19:34:56.370 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:56.370 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:56.370 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:34:56.371 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:56.371 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:56.371 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:56.371 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449217024 2021-11-15T19:34:56.371 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:56.372 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:56.372 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:56.372 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "cephfs_data", 2021-11-15T19:34:56.372 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 22, 2021-11-15T19:34:56.373 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:56.373 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:56.373 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:34:56.373 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:56.373 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:56.374 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:56.374 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449217024 2021-11-15T19:34:56.374 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:56.374 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:34:56.375 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:34:56.375 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "cephfs_metadata", 2021-11-15T19:34:56.375 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 23, 2021-11-15T19:34:56.375 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:34:56.375 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:34:56.376 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:34:56.376 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:34:56.376 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:34:56.376 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:34:56.377 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339449217024 2021-11-15T19:34:56.377 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:56.377 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:34:56.377 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:34:56.377 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:34:56.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d5c053640 msgr2=0x7f0d5c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d5c053640 0x7f0d5c055b00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0d70002f70 tx=0x7f0d70006a80).stop 2021-11-15T19:34:56.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 msgr2=0x7f0d7c156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:34:56.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 0x7f0d7c156790 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f0d6c0019f0 tx=0x7f0d74008040).stop 2021-11-15T19:34:56.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 shutdown_connections 2021-11-15T19:34:56.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d5c053640 0x7f0d5c055b00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0d7c13dc90 0x7f0d7c156790 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:34:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0d7c13fea0 0x7f0d7c13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 --2- 172.21.2.137:0/437861553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0d68003ee0 0x7f0d7c0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:34:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.349+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 >> 172.21.2.137:0/437861553 conn(0x7f0d7c0b4e60 msgr2=0x7f0d7c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:34:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.353+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 shutdown_connections 2021-11-15T19:34:56.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:34:56.353+0000 7f0d82cab700 1 -- 172.21.2.137:0/437861553 wait complete. 2021-11-15T19:34:56.382 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-11-15T19:35:01.384 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-15T19:35:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 Processor -- start 2021-11-15T19:35:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- start start 2021-11-15T19:35:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0dc144610 0x7fd0dc147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd0dc0a9f50 0x7fd0dc0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc148190 con 0x7fd0dc0b1340 2021-11-15T19:35:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0b1720 con 0x7fd0dc0a9f50 2021-11-15T19:35:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc147e70 con 0x7fd0dc144610 2021-11-15T19:35:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0dc144610 0x7fd0dc147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd0dc144610 0x7fd0dc147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39284/0 (socket says 172.21.2.137:39284) 2021-11-15T19:35:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0da59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd0dc0b1340 0x7fd0dc143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58068/0 (socket says 172.21.2.137:58068) 2021-11-15T19:35:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/2618457828 learned_addr learned my addr 172.21.2.137:0/2618457828 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/2618457828 >> v2:172.21.2.111:3300/0 conn(0x7fd0dc0a9f50 msgr2=0x7fd0dc0aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 --2- 172.21.2.137:0/2618457828 >> v2:172.21.2.111:3300/0 conn(0x7fd0dc0a9f50 0x7fd0dc0aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/2618457828 >> v1:172.21.2.137:6789/0 conn(0x7fd0dc0b1340 legacy=0x7fd0dc143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/2618457828 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0af800 con 0x7fd0dc144610 2021-11-15T19:35:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d9d9b700 1 --2- 172.21.2.137:0/2618457828 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc144610 0x7fd0dc147980 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fd0d40032f0 tx=0x7fd0d4009290).ready entity=mon.1 client_cookie=c1a0054e5afbc9a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d959a700 1 -- 172.21.2.137:0/2618457828 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d400b870 con 0x7fd0dc144610 2021-11-15T19:35:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d959a700 1 -- 172.21.2.137:0/2618457828 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400b9d0 con 0x7fd0dc144610 2021-11-15T19:35:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0d959a700 1 -- 172.21.2.137:0/2618457828 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d400bb80 con 0x7fd0dc144610 2021-11-15T19:35:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/2618457828 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc144610 msgr2=0x7fd0dc147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/2618457828 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc144610 0x7fd0dc147980 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fd0d40032f0 tx=0x7fd0d4009290).stop 2021-11-15T19:35:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/2618457828 shutdown_connections 2021-11-15T19:35:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/2618457828 >> v2:172.21.2.111:3300/0 conn(0x7fd0dc0a9f50 0x7fd0dc0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/2618457828 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc144610 0x7fd0dc147980 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/2618457828 >> 172.21.2.137:0/2618457828 conn(0x7fd0dc0b4e60 msgr2=0x7fd0dc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/2618457828 shutdown_connections 2021-11-15T19:35:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.429+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/2618457828 wait complete. 2021-11-15T19:35:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 Processor -- start 2021-11-15T19:35:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- start start 2021-11-15T19:35:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0dc0a9f50 0x7fd0dc0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 0x7fd0dc14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0dc144610 0x7fd0dc1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc14ae20 con 0x7fd0dc0a9f50 2021-11-15T19:35:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc14b2e0 con 0x7fd0dc0b1340 2021-11-15T19:35:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc14b040 con 0x7fd0dc144610 2021-11-15T19:35:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 0x7fd0dc14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 0x7fd0dc14a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39294/0 (socket says 172.21.2.137:39294) 2021-11-15T19:35:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/3105190635 learned_addr learned my addr 172.21.2.137:0/3105190635 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0dc144610 msgr2=0x7fd0dc1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0dc144610 0x7fd0dc1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0dc0a9f50 msgr2=0x7fd0dc0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0dc0a9f50 0x7fd0dc0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 -- 172.21.2.137:0/3105190635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009530 con 0x7fd0dc0b1340 2021-11-15T19:35:01.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d9d9b700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 0x7fd0dc14a930 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fd0dc14af60 tx=0x7fd0d4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d400bb40 con 0x7fd0dc0b1340 2021-11-15T19:35:01.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d401f3f0 con 0x7fd0dc0b1340 2021-11-15T19:35:01.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc148540 con 0x7fd0dc0b1340 2021-11-15T19:35:01.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc14a520 con 0x7fd0dc0b1340 2021-11-15T19:35:01.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d401f750 con 0x7fd0dc0b1340 2021-11-15T19:35:01.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc148700 con 0x7fd0dc0b1340 2021-11-15T19:35:01.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0d4026030 con 0x7fd0dc0b1340 2021-11-15T19:35:01.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d37fe700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0c00536f0 0x7fd0c0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6071+0+0 (secure 0 0 0) 0x7fd0d406c760 con 0x7fd0dc0b1340 2021-11-15T19:35:01.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.433+0000 7fd0da59c700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0c00536f0 0x7fd0c0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.437+0000 7fd0da59c700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0c00536f0 0x7fd0c0055bb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fd0dc062250 tx=0x7fd0c4007820).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.437+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0d40437b0 con 0x7fd0dc0b1340 2021-11-15T19:35:01.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fd0dc0573d0 con 0x7fd0dc0b1340 2021-11-15T19:35:01.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0d37fe700 1 -- 172.21.2.137:0/3105190635 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1935 (secure 0 0 0) 0x7fd0d40247a0 con 0x7fd0dc0b1340 2021-11-15T19:35:01.560 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:01.560 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:01.560 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:35:01.561 INFO:teuthology.orchestra.run.gibba037.stdout: "total_bytes": 721202184192, 2021-11-15T19:35:01.561 INFO:teuthology.orchestra.run.gibba037.stdout: "total_avail_bytes": 714955685888, 2021-11-15T19:35:01.561 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_bytes": 6245892096, 2021-11-15T19:35:01.561 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_bytes": 6246498304, 2021-11-15T19:35:01.561 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_ratio": 0.008661230094730854, 2021-11-15T19:35:01.562 INFO:teuthology.orchestra.run.gibba037.stdout: "num_osds": 8, 2021-11-15T19:35:01.562 INFO:teuthology.orchestra.run.gibba037.stdout: "num_per_pool_osds": 0, 2021-11-15T19:35:01.562 INFO:teuthology.orchestra.run.gibba037.stdout: "num_per_pool_omap_osds": 0 2021-11-15T19:35:01.562 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:01.563 INFO:teuthology.orchestra.run.gibba037.stdout: "stats_by_class": { 2021-11-15T19:35:01.563 INFO:teuthology.orchestra.run.gibba037.stdout: "ssd": { 2021-11-15T19:35:01.563 INFO:teuthology.orchestra.run.gibba037.stdout: "total_bytes": 721202184192, 2021-11-15T19:35:01.563 INFO:teuthology.orchestra.run.gibba037.stdout: "total_avail_bytes": 714955685888, 2021-11-15T19:35:01.564 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_bytes": 6245892096, 2021-11-15T19:35:01.564 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_bytes": 6246498304, 2021-11-15T19:35:01.564 INFO:teuthology.orchestra.run.gibba037.stdout: "total_used_raw_ratio": 0.008661230094730854 2021-11-15T19:35:01.564 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:01.565 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:01.565 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:35:01.565 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:01.565 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "device_health_metrics", 2021-11-15T19:35:01.566 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 1, 2021-11-15T19:35:01.566 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:35:01.566 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:35:01.566 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 2, 2021-11-15T19:35:01.566 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:35:01.567 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:35:01.567 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:35:01.567 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339447447552 2021-11-15T19:35:01.567 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:01.568 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:01.568 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:01.568 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rbd", 2021-11-15T19:35:01.568 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 2, 2021-11-15T19:35:01.568 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:35:01.568 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:35:01.569 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:35:01.569 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:35:01.569 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:35:01.569 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:35:01.569 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339447447552 2021-11-15T19:35:01.570 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:01.570 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:01.570 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:01.570 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "cephfs_data", 2021-11-15T19:35:01.571 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 22, 2021-11-15T19:35:01.571 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:35:01.571 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 0, 2021-11-15T19:35:01.571 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 0, 2021-11-15T19:35:01.571 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 0, 2021-11-15T19:35:01.572 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 0, 2021-11-15T19:35:01.572 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 0, 2021-11-15T19:35:01.572 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339447447552 2021-11-15T19:35:01.572 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:01.572 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:01.573 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:01.573 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "cephfs_metadata", 2021-11-15T19:35:01.573 INFO:teuthology.orchestra.run.gibba037.stdout: "id": 23, 2021-11-15T19:35:01.573 INFO:teuthology.orchestra.run.gibba037.stdout: "stats": { 2021-11-15T19:35:01.574 INFO:teuthology.orchestra.run.gibba037.stdout: "stored": 617, 2021-11-15T19:35:01.574 INFO:teuthology.orchestra.run.gibba037.stdout: "objects": 1, 2021-11-15T19:35:01.574 INFO:teuthology.orchestra.run.gibba037.stdout: "kb_used": 1, 2021-11-15T19:35:01.574 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 617, 2021-11-15T19:35:01.575 INFO:teuthology.orchestra.run.gibba037.stdout: "percent_used": 9.0882995573693393e-10, 2021-11-15T19:35:01.575 INFO:teuthology.orchestra.run.gibba037.stdout: "max_avail": 339447447552 2021-11-15T19:35:01.575 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:01.575 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:01.576 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:01.576 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:01.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0c00536f0 msgr2=0x7fd0c0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0c00536f0 0x7fd0c0055bb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fd0dc062250 tx=0x7fd0c4007820).stop 2021-11-15T19:35:01.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 msgr2=0x7fd0dc14a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 0x7fd0dc14a930 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fd0dc14af60 tx=0x7fd0d4016000).stop 2021-11-15T19:35:01.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 shutdown_connections 2021-11-15T19:35:01.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd0c00536f0 0x7fd0c0055bb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd0dc144610 0x7fd0dc1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd0dc0b1340 0x7fd0dc14a930 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 --2- 172.21.2.137:0/3105190635 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd0dc0a9f50 0x7fd0dc0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 >> 172.21.2.137:0/3105190635 conn(0x7fd0dc0b4e60 msgr2=0x7fd0dc0b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:01.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 shutdown_connections 2021-11-15T19:35:01.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.549+0000 7fd0e0a7f700 1 -- 172.21.2.137:0/3105190635 wait complete. 2021-11-15T19:35:01.580 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-11-15T19:35:01.581 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-11-15T19:35:01.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 Processor -- start 2021-11-15T19:35:01.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 -- start start 2021-11-15T19:35:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b2510 0x7f5d8c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5d8c0b1bf0 0x7f5d8c0acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c143330 con 0x7f5d8c0b0a10 2021-11-15T19:35:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0ad870 con 0x7f5d8c0b1bf0 2021-11-15T19:35:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d909b1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0ad3b0 con 0x7f5d8c0b2510 2021-11-15T19:35:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d89d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f5d8c0b0a10 0x7f5d8c067360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58084/0 (socket says 172.21.2.137:58084) 2021-11-15T19:35:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d89d9b700 1 -- 172.21.2.137:0/2598232558 learned_addr learned my addr 172.21.2.137:0/2598232558 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d8ad9d700 1 --2- 172.21.2.137:0/2598232558 >> v2:172.21.2.137:3300/0 conn(0x7f5d8c0b1bf0 0x7f5d8c0acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/2598232558 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b2510 msgr2=0x7f5d8c0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d8ad9d700 1 --2- 172.21.2.137:0/2598232558 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b2510 0x7f5d8c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/2598232558 >> v1:172.21.2.137:6789/0 conn(0x7f5d8c0b0a10 legacy=0x7f5d8c067360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/2598232558 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c143800 con 0x7f5d8c0b1bf0 2021-11-15T19:35:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.621+0000 7f5d8ad9d700 1 --2- 172.21.2.137:0/2598232558 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b1bf0 0x7f5d8c0acec0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f5d74001110 tx=0x7f5d8400a370).ready entity=mon.1 client_cookie=dc158a542406ac2b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8959a700 1 -- 172.21.2.137:0/2598232558 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8400cb30 con 0x7f5d8c0b1bf0 2021-11-15T19:35:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8959a700 1 -- 172.21.2.137:0/2598232558 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400cc90 con 0x7f5d8c0b1bf0 2021-11-15T19:35:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8959a700 1 -- 172.21.2.137:0/2598232558 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84010410 con 0x7f5d8c0b1bf0 2021-11-15T19:35:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/2598232558 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b1bf0 msgr2=0x7f5d8c0acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 --2- 172.21.2.137:0/2598232558 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b1bf0 0x7f5d8c0acec0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f5d74001110 tx=0x7f5d8400a370).stop 2021-11-15T19:35:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/2598232558 shutdown_connections 2021-11-15T19:35:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 --2- 172.21.2.137:0/2598232558 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b1bf0 0x7f5d8c0acec0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 --2- 172.21.2.137:0/2598232558 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b2510 0x7f5d8c0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/2598232558 >> 172.21.2.137:0/2598232558 conn(0x7f5d8c0630f0 msgr2=0x7f5d8c0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:01.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/2598232558 shutdown_connections 2021-11-15T19:35:01.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/2598232558 wait complete. 2021-11-15T19:35:01.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 Processor -- start 2021-11-15T19:35:01.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- start start 2021-11-15T19:35:01.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b0a10 0x7f5d8c10fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d8c0b1bf0 0x7f5d8c1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b2510 0x7f5d8c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c13eb30 con 0x7f5d8c0b1bf0 2021-11-15T19:35:01.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c066e30 con 0x7f5d8c0b2510 2021-11-15T19:35:01.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c10ec50 con 0x7f5d8c0b0a10 2021-11-15T19:35:01.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b2510 0x7f5d8c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b2510 0x7f5d8c156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39308/0 (socket says 172.21.2.137:39308) 2021-11-15T19:35:01.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/3942732964 learned_addr learned my addr 172.21.2.137:0/3942732964 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:01.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b0a10 msgr2=0x7f5d8c10fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 --2- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d8c0b0a10 0x7f5d8c10fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d8c0b1bf0 msgr2=0x7f5d8c1122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 --2- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d8c0b1bf0 0x7f5d8c1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 -- 172.21.2.137:0/3942732964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8400a610 con 0x7f5d8c0b2510 2021-11-15T19:35:01.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d8ad9d700 1 --2- 172.21.2.137:0/3942732964 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d8c0b2510 0x7f5d8c156520 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f5d74001110 tx=0x7f5d8400a370).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84006ea0 con 0x7f5d8c0b2510 2021-11-15T19:35:01.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8401a630 con 0x7f5d8c0b2510 2021-11-15T19:35:01.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84006b60 con 0x7f5d8c0b2510 2021-11-15T19:35:01.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/3942732964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c10ef70 con 0x7f5d8c0b2510 2021-11-15T19:35:01.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/3942732964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c10f210 con 0x7f5d8c0b2510 2021-11-15T19:35:01.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.625+0000 7f5d909b1700 1 -- 172.21.2.137:0/3942732964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c143560 con 0x7f5d8c0b2510 2021-11-15T19:35:01.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.629+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d8402a070 con 0x7f5d8c0b2510 2021-11-15T19:35:01.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.629+0000 7f5d837fe700 1 --2- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d70053660 0x7f5d70055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.629+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f5d8406d740 con 0x7f5d8c0b2510 2021-11-15T19:35:01.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.629+0000 7f5d8a59c700 1 --2- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d70053660 0x7f5d70055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.629+0000 7f5d8a59c700 1 --2- 172.21.2.137:0/3942732964 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d70053660 0x7f5d70055b20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f5d7c002f70 tx=0x7f5d7c0069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.629+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d84044790 con 0x7f5d8c0b2510 2021-11-15T19:35:01.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.737+0000 7f5d909b1700 1 -- 172.21.2.137:0/3942732964 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5d8c10f790 con 0x7f5d8c0b2510 2021-11-15T19:35:01.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.741+0000 7f5d837fe700 1 -- 172.21.2.137:0/3942732964 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v59) v1 ==== 209+0+0 (secure 0 0 0) 0x7f5d84047db0 con 0x7f5d8c0b2510 2021-11-15T19:35:01.752 INFO:teuthology.orchestra.run.gibba037.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-11-15T19:35:01.754 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-11-15T19:35:01.755 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:35:01.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 Processor -- start 2021-11-15T19:35:01.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- start start 2021-11-15T19:35:01.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb44813ce00 0x7fb448142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4480b6830 0x7fb4481433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4480b63b0 con 0x7fb4480b5fd0 2021-11-15T19:35:01.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb448147070 con 0x7fb44813ce00 2021-11-15T19:35:01.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb448146dd0 con 0x7fb4480b6830 2021-11-15T19:35:01.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb44813ce00 0x7fb448142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb447fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb4480b5fd0 0x7fb44813c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58094/0 (socket says 172.21.2.137:58094) 2021-11-15T19:35:01.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb447fff700 1 -- 172.21.2.137:0/2172038074 learned_addr learned my addr 172.21.2.137:0/2172038074 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:01.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 -- 172.21.2.137:0/2172038074 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4480b6830 msgr2=0x7fb4481433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:01.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 --2- 172.21.2.137:0/2172038074 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4480b6830 0x7fb4481433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 -- 172.21.2.137:0/2172038074 >> v1:172.21.2.137:6789/0 conn(0x7fb4480b5fd0 legacy=0x7fb44813c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 -- 172.21.2.137:0/2172038074 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448146af0 con 0x7fb44813ce00 2021-11-15T19:35:01.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 --2- 172.21.2.137:0/2172038074 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb44813ce00 0x7fb448142ed0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb430006df0).ready entity=mon.1 client_cookie=c5c221f8818356ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb446ffd700 1 -- 172.21.2.137:0/2172038074 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000d570 con 0x7fb44813ce00 2021-11-15T19:35:01.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb446ffd700 1 -- 172.21.2.137:0/2172038074 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430000e90 con 0x7fb44813ce00 2021-11-15T19:35:01.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb446ffd700 1 -- 172.21.2.137:0/2172038074 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000d8c0 con 0x7fb44813ce00 2021-11-15T19:35:01.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- 172.21.2.137:0/2172038074 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb44813ce00 msgr2=0x7fb448142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- 172.21.2.137:0/2172038074 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb44813ce00 0x7fb448142ed0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb430006df0).stop 2021-11-15T19:35:01.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- 172.21.2.137:0/2172038074 shutdown_connections 2021-11-15T19:35:01.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- 172.21.2.137:0/2172038074 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb44813ce00 0x7fb448142ed0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- 172.21.2.137:0/2172038074 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4480b6830 0x7fb4481433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- 172.21.2.137:0/2172038074 >> 172.21.2.137:0/2172038074 conn(0x7fb4480624b0 msgr2=0x7fb448062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:01.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- 172.21.2.137:0/2172038074 shutdown_connections 2021-11-15T19:35:01.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- 172.21.2.137:0/2172038074 wait complete. 2021-11-15T19:35:01.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 Processor -- start 2021-11-15T19:35:01.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- start start 2021-11-15T19:35:01.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4480b5fd0 0x7fb448140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 0x7fb448140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb44813ce00 0x7fb448152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4481531a0 con 0x7fb4480b5fd0 2021-11-15T19:35:01.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44813d370 con 0x7fb4480b6830 2021-11-15T19:35:01.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb44e79d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44813d610 con 0x7fb44813ce00 2021-11-15T19:35:01.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 0x7fb448140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 0x7fb448140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39320/0 (socket says 172.21.2.137:39320) 2021-11-15T19:35:01.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 -- 172.21.2.137:0/91107762 learned_addr learned my addr 172.21.2.137:0/91107762 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:01.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 -- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb44813ce00 msgr2=0x7fb448152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.797+0000 7fb4477fe700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb44813ce00 0x7fb448152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4477fe700 1 -- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4480b5fd0 msgr2=0x7fb448140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4477fe700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4480b5fd0 0x7fb448140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4477fe700 1 -- 172.21.2.137:0/91107762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43000b180 con 0x7fb4480b6830 2021-11-15T19:35:01.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4477fe700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 0x7fb448140d10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb430015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000de40 con 0x7fb4480b6830 2021-11-15T19:35:01.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430011ca0 con 0x7fb4480b6830 2021-11-15T19:35:01.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43001e460 con 0x7fb4480b6830 2021-11-15T19:35:01.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb448141200 con 0x7fb4480b6830 2021-11-15T19:35:01.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb448152720 con 0x7fb4480b6830 2021-11-15T19:35:01.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44813d7d0 con 0x7fb4480b6830 2021-11-15T19:35:01.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb43001a040 con 0x7fb4480b6830 2021-11-15T19:35:01.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4457fa700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb42c053640 0x7fb42c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:01.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6071+0+0 (secure 0 0 0) 0x7fb43006c940 con 0x7fb4480b6830 2021-11-15T19:35:01.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb447fff700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb42c053640 0x7fb42c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:01.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.801+0000 7fb447fff700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb42c053640 0x7fb42c055b00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb4480b91b0 tx=0x7fb4380077b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:01.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.805+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb430043aa0 con 0x7fb4480b6830 2021-11-15T19:35:01.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.909+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fb4480afff0 con 0x7fb4480b6830 2021-11-15T19:35:01.924 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:35:01.921+0000 7fd9a9577700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:35:01.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb4457fa700 1 -- 172.21.2.137:0/91107762 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v60) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb430023020 con 0x7fb4480b6830 2021-11-15T19:35:01.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb42c053640 msgr2=0x7fb42c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb42c053640 0x7fb42c055b00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb4480b91b0 tx=0x7fb4380077b0).stop 2021-11-15T19:35:01.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 msgr2=0x7fb448140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:01.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 0x7fb448140d10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb430015000).stop 2021-11-15T19:35:01.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 shutdown_connections 2021-11-15T19:35:01.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb42c053640 0x7fb42c055b00 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb44813ce00 0x7fb448152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4480b6830 0x7fb448140d10 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:01.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 --2- 172.21.2.137:0/91107762 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4480b5fd0 0x7fb448140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:01.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 >> 172.21.2.137:0/91107762 conn(0x7fb4480624b0 msgr2=0x7fb4481435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:01.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 shutdown_connections 2021-11-15T19:35:01.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.925+0000 7fb44e79d700 1 -- 172.21.2.137:0/91107762 wait complete. 2021-11-15T19:35:01.941 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 23 and data pool 22 2021-11-15T19:35:01.944 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:35:01.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 Processor -- start 2021-11-15T19:35:01.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 -- start start 2021-11-15T19:35:02.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f922005c770 0x7f92200aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9220140aa0 0x7f9220140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922005cb50 con 0x7f92200b0550 2021-11-15T19:35:02.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92200b1650 con 0x7f9220140aa0 2021-11-15T19:35:02.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9226a67700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92200ad030 con 0x7f922005c770 2021-11-15T19:35:02.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f92200b0550 0x7f922014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58112/0 (socket says 172.21.2.137:58112) 2021-11-15T19:35:02.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921ffff700 1 -- 172.21.2.137:0/1945916797 learned_addr learned my addr 172.21.2.137:0/1945916797 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:02.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836260631 0 0) 0x7f922005cb50 con 0x7f92200b0550 2021-11-15T19:35:02.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9200003260 con 0x7f92200b0550 2021-11-15T19:35:02.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140083806 0 0) 0x7f9200003260 con 0x7f92200b0550 2021-11-15T19:35:02.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f922005c770 msgr2=0x7f92200aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:02.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f922005c770 0x7f92200aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 >> v2:172.21.2.111:3300/0 conn(0x7f9220140aa0 msgr2=0x7f9220140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:02.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 --2- 172.21.2.137:0/1945916797 >> v2:172.21.2.111:3300/0 conn(0x7f9220140aa0 0x7f9220140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200ad2d0 con 0x7f92200b0550 2021-11-15T19:35:02.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f9210001660 con 0x7f92200b0550 2021-11-15T19:35:02.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 >> v1:172.21.2.137:6789/0 conn(0x7f92200b0550 legacy=0x7f922014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:02.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f9200003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f922005c770 0x7f9200004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9200004bf0 0x7f920000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200b1650 con 0x7f9200004bf0 2021-11-15T19:35:02.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200ad030 con 0x7f92000037d0 2021-11-15T19:35:02.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9200005300 con 0x7f922005c770 2021-11-15T19:35:02.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f9200003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:02.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 -- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f922005c770 msgr2=0x7f9200004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:02.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f922005c770 0x7f9200004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 -- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9200004bf0 msgr2=0x7f920000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:02.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9200004bf0 0x7f920000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 -- 172.21.2.137:0/1945916797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9200003260 con 0x7f92000037d0 2021-11-15T19:35:02.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f9224803700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f9200003bf0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f9208002f70 tx=0x7f9208006ca0).ready entity=mon.1 client_cookie=b1be1d8b2a156eb0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:02.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9208012410 con 0x7f92000037d0 2021-11-15T19:35:02.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208012570 con 0x7f92000037d0 2021-11-15T19:35:02.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.985+0000 7f921f7fe700 1 -- 172.21.2.137:0/1945916797 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92080128d0 con 0x7f92000037d0 2021-11-15T19:35:02.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/1945916797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 msgr2=0x7f9200003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:02.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 --2- 172.21.2.137:0/1945916797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f9200003bf0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f9208002f70 tx=0x7f9208006ca0).stop 2021-11-15T19:35:02.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9225004700 1 -- 172.21.2.137:0/1945916797 reap_dead start 2021-11-15T19:35:02.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/1945916797 shutdown_connections 2021-11-15T19:35:02.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/1945916797 >> 172.21.2.137:0/1945916797 conn(0x7f92200631e0 msgr2=0x7f922005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:02.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/1945916797 shutdown_connections 2021-11-15T19:35:02.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/1945916797 wait complete. 2021-11-15T19:35:02.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 Processor -- start 2021-11-15T19:35:02.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- start start 2021-11-15T19:35:02.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f92200b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f922014b000 0x7f92201569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9220156eb0 0x7f9220159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9220157330 con 0x7f922014b000 2021-11-15T19:35:02.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922013ebb0 con 0x7f92000037d0 2021-11-15T19:35:02.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92201446f0 con 0x7f9220156eb0 2021-11-15T19:35:02.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f92200b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:02.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f92200b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39340/0 (socket says 172.21.2.137:39340) 2021-11-15T19:35:02.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 -- 172.21.2.137:0/2255402280 learned_addr learned my addr 172.21.2.137:0/2255402280 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:02.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 -- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9220156eb0 msgr2=0x7f9220159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:02.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9220156eb0 0x7f9220159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 -- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f922014b000 msgr2=0x7f92201569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:02.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f922014b000 0x7f92201569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 -- 172.21.2.137:0/2255402280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922014a5d0 con 0x7f92000037d0 2021-11-15T19:35:02.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9224803700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f92200b5120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f9208002f70 tx=0x7f9208015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:02.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9208012410 con 0x7f92000037d0 2021-11-15T19:35:02.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208000e90 con 0x7f92000037d0 2021-11-15T19:35:02.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922014a870 con 0x7f92000037d0 2021-11-15T19:35:02.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9220156300 con 0x7f92000037d0 2021-11-15T19:35:02.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f920801d600 con 0x7f92000037d0 2021-11-15T19:35:02.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f8003410 con 0x7f92000037d0 2021-11-15T19:35:02.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9208024030 con 0x7f92000037d0 2021-11-15T19:35:02.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f921dffb700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9204053660 0x7f9204055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:02.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.989+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f920806c880 con 0x7f92000037d0 2021-11-15T19:35:02.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.993+0000 7f921ffff700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9204053660 0x7f9204055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:02.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.993+0000 7f921ffff700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9204053660 0x7f9204055b20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f9210001370 tx=0x7f9220146fe0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:02.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:01.993+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9208043930 con 0x7f92000037d0 2021-11-15T19:35:02.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.105+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f91f8003c40 con 0x7f92000037d0 2021-11-15T19:35:02.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f921dffb700 1 -- 172.21.2.137:0/2255402280 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92080220a0 con 0x7f92000037d0 2021-11-15T19:35:02.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9204053660 msgr2=0x7f9204055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:02.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9204053660 0x7f9204055b20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f9210001370 tx=0x7f9220146fe0).stop 2021-11-15T19:35:02.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 msgr2=0x7f92200b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:02.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f92200b5120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f9208002f70 tx=0x7f9208015000).stop 2021-11-15T19:35:02.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 shutdown_connections 2021-11-15T19:35:02.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9204053660 0x7f9204055b20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:02.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9220156eb0 0x7f9220159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f922014b000 0x7f92201569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:02.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 --2- 172.21.2.137:0/2255402280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f92000037d0 0x7f92200b5120 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:02.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 >> 172.21.2.137:0/2255402280 conn(0x7f92200631e0 msgr2=0x7f922005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:02.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 shutdown_connections 2021-11-15T19:35:02.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.929+0000 7f9226a67700 1 -- 172.21.2.137:0/2255402280 wait complete. 2021-11-15T19:35:02.948 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:35:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3b201700 1 Processor -- start 2021-11-15T19:35:03.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3b201700 1 -- start start 2021-11-15T19:35:03.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3b201700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4b34097260 0x7f4b34097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:03.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3b201700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340aca80 con 0x7f4b340b2c30 2021-11-15T19:35:03.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3b201700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340accb0 con 0x7f4b340969e0 2021-11-15T19:35:03.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3b201700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340ad150 con 0x7f4b34097260 2021-11-15T19:35:03.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b38f9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4b34097260 0x7f4b34097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:03.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3979e700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4b340969e0 0x7f4b3405f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58128/0 (socket says 172.21.2.137:58128) 2021-11-15T19:35:03.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.989+0000 7f4b3979e700 1 -- 172.21.2.137:0/1358443415 learned_addr learned my addr 172.21.2.137:0/1358443415 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:03.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b337fe700 1 -- 172.21.2.137:0/1358443415 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076744112 0 0) 0x7f4b340accb0 con 0x7f4b340969e0 2021-11-15T19:35:03.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b337fe700 1 -- 172.21.2.137:0/1358443415 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b14003260 con 0x7f4b340969e0 2021-11-15T19:35:03.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b38f9d700 1 -- 172.21.2.137:0/1358443415 >> v1:172.21.2.137:6789/0 conn(0x7f4b340969e0 legacy=0x7f4b3405f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:03.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b38f9d700 1 -- 172.21.2.137:0/1358443415 >> v1:172.21.2.111:6789/0 conn(0x7f4b340b2c30 legacy=0x7f4b340990e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:03.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b38f9d700 1 -- 172.21.2.137:0/1358443415 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34097c50 con 0x7f4b34097260 2021-11-15T19:35:03.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b38f9d700 1 --2- 172.21.2.137:0/1358443415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b34097260 0x7f4b34097640 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f4b34098090 tx=0x7f4b24006df0).ready entity=mon.1 client_cookie=451129d03f5cd391 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:03.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b337fe700 1 -- 172.21.2.137:0/1358443415 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2400d5c0 con 0x7f4b34097260 2021-11-15T19:35:03.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b337fe700 1 -- 172.21.2.137:0/1358443415 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24000e90 con 0x7f4b34097260 2021-11-15T19:35:03.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b337fe700 1 -- 172.21.2.137:0/1358443415 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2400d910 con 0x7f4b34097260 2021-11-15T19:35:03.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/1358443415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b34097260 msgr2=0x7f4b34097640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:03.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 --2- 172.21.2.137:0/1358443415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b34097260 0x7f4b34097640 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f4b34098090 tx=0x7f4b24006df0).stop 2021-11-15T19:35:03.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/1358443415 shutdown_connections 2021-11-15T19:35:03.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 --2- 172.21.2.137:0/1358443415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b34097260 0x7f4b34097640 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:03.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/1358443415 >> 172.21.2.137:0/1358443415 conn(0x7f4b340b7070 msgr2=0x7f4b340b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:03.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/1358443415 shutdown_connections 2021-11-15T19:35:03.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/1358443415 wait complete. 2021-11-15T19:35:03.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 Processor -- start 2021-11-15T19:35:03.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- start start 2021-11-15T19:35:03.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b340969e0 0x7f4b34144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:03.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b34097260 0x7f4b34098780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:03.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 0x7f4b340b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:03.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34143360 con 0x7f4b340969e0 2021-11-15T19:35:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b0a50 con 0x7f4b340b2c30 2021-11-15T19:35:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34098c70 con 0x7f4b34097260 2021-11-15T19:35:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 0x7f4b340b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 0x7f4b340b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39354/0 (socket says 172.21.2.137:39354) 2021-11-15T19:35:03.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 -- 172.21.2.137:0/3690972522 learned_addr learned my addr 172.21.2.137:0/3690972522 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 -- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b34097260 msgr2=0x7f4b34098780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b34097260 0x7f4b34098780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 -- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b340969e0 msgr2=0x7f4b34144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:03.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b340969e0 0x7f4b34144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:03.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 -- 172.21.2.137:0/3690972522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2400b180 con 0x7f4b340b2c30 2021-11-15T19:35:03.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3979e700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 0x7f4b340b0f90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f4b2c001490 tx=0x7f4b2c007da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:03.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2c005c70 con 0x7f4b340b2c30 2021-11-15T19:35:03.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c005dd0 con 0x7f4b340b2c30 2021-11-15T19:35:03.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2c0072c0 con 0x7f4b340b2c30 2021-11-15T19:35:03.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b34067c50 con 0x7f4b340b2c30 2021-11-15T19:35:03.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.993+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3409c240 con 0x7f4b340b2c30 2021-11-15T19:35:03.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34143560 con 0x7f4b340b2c30 2021-11-15T19:35:03.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b2c010070 con 0x7f4b340b2c30 2021-11-15T19:35:03.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b31ffb700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b180536d0 0x7f4b18055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:03.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f4b2c06b560 con 0x7f4b340b2c30 2021-11-15T19:35:03.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b38f9d700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b180536d0 0x7f4b18055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:03.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b38f9d700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b180536d0 0x7f4b18055b90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f4b34098090 tx=0x7f4b24014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:03.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:02.997+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b2c0424e0 con 0x7f4b340b2c30 2021-11-15T19:35:03.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.081+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b340573d0 con 0x7f4b340b2c30 2021-11-15T19:35:03.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b31ffb700 1 -- 172.21.2.137:0/3690972522 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4b2c018020 con 0x7f4b340b2c30 2021-11-15T19:35:03.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b180536d0 msgr2=0x7f4b18055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:03.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b180536d0 0x7f4b18055b90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f4b34098090 tx=0x7f4b24014000).stop 2021-11-15T19:35:03.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 msgr2=0x7f4b340b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:03.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 0x7f4b340b0f90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f4b2c001490 tx=0x7f4b2c007da0).stop 2021-11-15T19:35:03.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 shutdown_connections 2021-11-15T19:35:03.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4b180536d0 0x7f4b18055b90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:03.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4b340b2c30 0x7f4b340b0f90 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:03.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4b34097260 0x7f4b34098780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:03.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 --2- 172.21.2.137:0/3690972522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4b340969e0 0x7f4b34144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:03.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 >> 172.21.2.137:0/3690972522 conn(0x7f4b340b7070 msgr2=0x7f4b34140580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:03.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 shutdown_connections 2021-11-15T19:35:03.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.937+0000 7f4b3b201700 1 -- 172.21.2.137:0/3690972522 wait complete. 2021-11-15T19:35:03.952 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:35:03.955 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:35:04.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 Processor -- start 2021-11-15T19:35:04.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 -- start start 2021-11-15T19:35:04.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f59640b0550 0x7f596414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f596414aaa0 0x7f5964140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596405cb50 con 0x7f596405c770 2021-11-15T19:35:04.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59640b1650 con 0x7f59640b0550 2021-11-15T19:35:04.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f596aea8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640ad030 con 0x7f596414aaa0 2021-11-15T19:35:04.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5968c44700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f596405c770 0x7f59640aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58142/0 (socket says 172.21.2.137:58142) 2021-11-15T19:35:04.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5968c44700 1 -- 172.21.2.137:0/2337217440 learned_addr learned my addr 172.21.2.137:0/2337217440 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:04.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503190632 0 0) 0x7f596405cb50 con 0x7f596405c770 2021-11-15T19:35:04.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5944003260 con 0x7f596405c770 2021-11-15T19:35:04.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5963fff700 1 --2- 172.21.2.137:0/2337217440 >> v2:172.21.2.111:3300/0 conn(0x7f59640b0550 0x7f596414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f596414aaa0 0x7f5964140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3528465326 0 0) 0x7f5944003260 con 0x7f596405c770 2021-11-15T19:35:04.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f596414aaa0 msgr2=0x7f5964140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:04.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f596414aaa0 0x7f5964140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 >> v2:172.21.2.111:3300/0 conn(0x7f59640b0550 msgr2=0x7f596414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:04.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 --2- 172.21.2.137:0/2337217440 >> v2:172.21.2.111:3300/0 conn(0x7f59640b0550 0x7f596414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640ad2d0 con 0x7f596405c770 2021-11-15T19:35:04.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f594c001660 con 0x7f596405c770 2021-11-15T19:35:04.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 >> v1:172.21.2.137:6789/0 conn(0x7f596405c770 legacy=0x7f59640aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:04.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944003750 0x7f5944003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5944004500 0x7f5944004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5944004e70 0x7f594400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640b1650 con 0x7f5944003750 2021-11-15T19:35:04.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640ad030 con 0x7f5944004e70 2021-11-15T19:35:04.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594400bc40 con 0x7f5944004500 2021-11-15T19:35:04.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f596414aaa0 0x7f5964140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:04.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5944004e70 0x7f594400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5968c44700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944003750 0x7f5944003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5963fff700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5944004500 0x7f5944004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 -- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5944004500 msgr2=0x7f5944004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:04.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5944004500 0x7f5944004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 -- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944003750 msgr2=0x7f5944003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944003750 0x7f5944003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 -- 172.21.2.137:0/2337217440 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944003260 con 0x7f5944004e70 2021-11-15T19:35:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f5969445700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5944004e70 0x7f594400b750 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f595c00a000 tx=0x7f595c008040).ready entity=mon.1 client_cookie=67a502896600cace server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:04.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595c00c070 con 0x7f5944004e70 2021-11-15T19:35:04.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c0133f0 con 0x7f5944004e70 2021-11-15T19:35:04.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:03.997+0000 7f59637fe700 1 -- 172.21.2.137:0/2337217440 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595c009440 con 0x7f5944004e70 2021-11-15T19:35:04.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/2337217440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5944004e70 msgr2=0x7f594400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:04.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 --2- 172.21.2.137:0/2337217440 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5944004e70 0x7f594400b750 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f595c00a000 tx=0x7f595c008040).stop 2021-11-15T19:35:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5969445700 1 -- 172.21.2.137:0/2337217440 reap_dead start 2021-11-15T19:35:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/2337217440 shutdown_connections 2021-11-15T19:35:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/2337217440 >> 172.21.2.137:0/2337217440 conn(0x7f59640631e0 msgr2=0x7f596405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/2337217440 shutdown_connections 2021-11-15T19:35:04.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/2337217440 wait complete. 2021-11-15T19:35:04.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 Processor -- start 2021-11-15T19:35:04.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- start start 2021-11-15T19:35:04.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944004e70 0x7f59641420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 0x7f59640663e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5964146c80 0x7f5964147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964143a20 con 0x7f5944004e70 2021-11-15T19:35:04.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964143c50 con 0x7f5964067260 2021-11-15T19:35:04.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5964143ef0 con 0x7f5964146c80 2021-11-15T19:35:04.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 0x7f59640663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 0x7f59640663e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39374/0 (socket says 172.21.2.137:39374) 2021-11-15T19:35:04.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 -- 172.21.2.137:0/600952038 learned_addr learned my addr 172.21.2.137:0/600952038 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:04.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5968c44700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944004e70 0x7f59641420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5969445700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5964146c80 0x7f5964147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 -- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5964146c80 msgr2=0x7f5964147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:04.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5964146c80 0x7f5964147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 -- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944004e70 msgr2=0x7f59641420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:04.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944004e70 0x7f59641420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 -- 172.21.2.137:0/600952038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964144190 con 0x7f5964067260 2021-11-15T19:35:04.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5968c44700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944004e70 0x7f59641420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:04.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5963fff700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 0x7f59640663e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f5964065e60 tx=0x7f5954008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:04.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5954014680 con 0x7f5964067260 2021-11-15T19:35:04.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540147e0 con 0x7f5964067260 2021-11-15T19:35:04.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5964144630 con 0x7f5964067260 2021-11-15T19:35:04.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5954014b40 con 0x7f5964067260 2021-11-15T19:35:04.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964147790 con 0x7f5964067260 2021-11-15T19:35:04.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59640ae7f0 con 0x7f5964067260 2021-11-15T19:35:04.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5954014ca0 con 0x7f5964067260 2021-11-15T19:35:04.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5961ffb700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59480536a0 0x7f5948055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:04.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f595406bca0 con 0x7f5964067260 2021-11-15T19:35:04.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.001+0000 7f5968c44700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59480536a0 0x7f5948055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:04.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.005+0000 7f5968c44700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59480536a0 0x7f5948055b60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f594c005000 tx=0x7f594c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:04.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.005+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5954070070 con 0x7f5964067260 2021-11-15T19:35:04.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.089+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f596405db30 con 0x7f5964067260 2021-11-15T19:35:04.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f5961ffb700 1 -- 172.21.2.137:0/600952038 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5954042f60 con 0x7f5964067260 2021-11-15T19:35:04.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59480536a0 msgr2=0x7f5948055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:04.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59480536a0 0x7f5948055b60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f594c005000 tx=0x7f594c009040).stop 2021-11-15T19:35:04.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 msgr2=0x7f59640663e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:04.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 0x7f59640663e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f5964065e60 tx=0x7f5954008040).stop 2021-11-15T19:35:04.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 shutdown_connections 2021-11-15T19:35:04.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f59480536a0 0x7f5948055b60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5964146c80 0x7f5964147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5964067260 0x7f59640663e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 --2- 172.21.2.137:0/600952038 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5944004e70 0x7f59641420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:04.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 >> 172.21.2.137:0/600952038 conn(0x7f59640631e0 msgr2=0x7f596414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:04.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 shutdown_connections 2021-11-15T19:35:04.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:04.945+0000 7f596aea8700 1 -- 172.21.2.137:0/600952038 wait complete. 2021-11-15T19:35:04.959 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:35:04.963 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-11-15T19:35:05.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.005+0000 7fdab5209700 1 Processor -- start 2021-11-15T19:35:05.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- start start 2021-11-15T19:35:05.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 0x7fdab01473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00a9de0 con 0x7fdab01478b0 2021-11-15T19:35:05.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab005fe40 con 0x7fdab00aebe0 2021-11-15T19:35:05.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0147d00 con 0x7fdab0146f60 2021-11-15T19:35:05.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdab00aebe0 0x7fdab005f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58162/0 (socket says 172.21.2.137:58162) 2021-11-15T19:35:05.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 -- 172.21.2.137:0/3017697530 learned_addr learned my addr 172.21.2.137:0/3017697530 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:05.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaae59c700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 0x7fdab01473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158479761 0 0) 0x7fdab005fe40 con 0x7fdab00aebe0 2021-11-15T19:35:05.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda90003260 con 0x7fdab00aebe0 2021-11-15T19:35:05.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709339826 0 0) 0x7fda90003260 con 0x7fdab00aebe0 2021-11-15T19:35:05.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 msgr2=0x7fdab01473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 0x7fdab01473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 >> v1:172.21.2.111:6789/0 conn(0x7fdab01478b0 legacy=0x7fdab01518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00aa010 con 0x7fdab00aebe0 2021-11-15T19:35:05.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fda98001660 con 0x7fdab00aebe0 2021-11-15T19:35:05.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 >> v1:172.21.2.137:6789/0 conn(0x7fdab00aebe0 legacy=0x7fdab005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fda90003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 0x7fda90004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda900049f0 0x7fda90004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0147d00 con 0x7fda900049f0 2021-11-15T19:35:05.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9000b800 con 0x7fda90003750 2021-11-15T19:35:05.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9000b970 con 0x7fdab0146f60 2021-11-15T19:35:05.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fda90003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaf59e700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda900049f0 0x7fda90004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 -- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 msgr2=0x7fda90004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab0146f60 0x7fda90004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 -- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda900049f0 msgr2=0x7fda90004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda900049f0 0x7fda90004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 -- 172.21.2.137:0/3017697530 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90003260 con 0x7fda90003750 2021-11-15T19:35:05.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaf59e700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fda900049f0 0x7fda90004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:05.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fda90003b70 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fda98001370 tx=0x7fdab005cab0).ready entity=mon.1 client_cookie=d8eb53809fc49549 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda980070d0 con 0x7fda90003750 2021-11-15T19:35:05.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98007230 con 0x7fda90003750 2021-11-15T19:35:05.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaadd9b700 1 -- 172.21.2.137:0/3017697530 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda9800c8c0 con 0x7fda90003750 2021-11-15T19:35:05.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- 172.21.2.137:0/3017697530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 msgr2=0x7fda90003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 --2- 172.21.2.137:0/3017697530 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fda90003b70 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fda98001370 tx=0x7fdab005cab0).stop 2021-11-15T19:35:05.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdaaf59e700 1 -- 172.21.2.137:0/3017697530 reap_dead start 2021-11-15T19:35:05.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- 172.21.2.137:0/3017697530 shutdown_connections 2021-11-15T19:35:05.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- 172.21.2.137:0/3017697530 >> 172.21.2.137:0/3017697530 conn(0x7fdab005bd20 msgr2=0x7fdab005c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:05.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- 172.21.2.137:0/3017697530 shutdown_connections 2021-11-15T19:35:05.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- 172.21.2.137:0/3017697530 wait complete. 2021-11-15T19:35:05.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 Processor -- start 2021-11-15T19:35:05.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.009+0000 7fdab5209700 1 -- start start 2021-11-15T19:35:05.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fdab0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab00af750 0x7fdab01496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdab0149bb0 0x7fdab0141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015a510 con 0x7fdab0149bb0 2021-11-15T19:35:05.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015a7b0 con 0x7fda90003750 2021-11-15T19:35:05.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015a220 con 0x7fdab00af750 2021-11-15T19:35:05.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fdab0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fdab0159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39394/0 (socket says 172.21.2.137:39394) 2021-11-15T19:35:05.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 -- 172.21.2.137:0/1952436339 learned_addr learned my addr 172.21.2.137:0/1952436339 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:05.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaae59c700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab00af750 0x7fdab01496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaf59e700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdab0149bb0 0x7fdab0141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 -- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab00af750 msgr2=0x7fdab01496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab00af750 0x7fdab01496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 -- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdab0149bb0 msgr2=0x7fdab0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdab0149bb0 0x7fdab0141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 -- 172.21.2.137:0/1952436339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab014b310 con 0x7fda90003750 2021-11-15T19:35:05.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaae59c700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab00af750 0x7fdab01496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:05.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaaed9d700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fdab0159d30 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fda98001370 tx=0x7fda98013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda980070d0 con 0x7fda90003750 2021-11-15T19:35:05.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98004920 con 0x7fda90003750 2021-11-15T19:35:05.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab0148430 con 0x7fda90003750 2021-11-15T19:35:05.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab00afbd0 con 0x7fda90003750 2021-11-15T19:35:05.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda98001b60 con 0x7fda90003750 2021-11-15T19:35:05.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab00573d0 con 0x7fda90003750 2021-11-15T19:35:05.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda98025020 con 0x7fda90003750 2021-11-15T19:35:05.037 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaa7fff700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda94053690 0x7fda94055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6071+0+0 (secure 0 0 0) 0x7fda9806ca70 con 0x7fda90003750 2021-11-15T19:35:05.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.013+0000 7fdaae59c700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda94053690 0x7fda94055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.038 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.017+0000 7fdaae59c700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda94053690 0x7fda94055b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fdaa000b000 tx=0x7fdaa0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.039 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.017+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda98043ac0 con 0x7fda90003750 2021-11-15T19:35:05.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.129+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdab00573d0 con 0x7fda90003750 2021-11-15T19:35:05.141 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:35:05.137+0000 7fd9a9577700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:35:05.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.141+0000 7fdaa7fff700 1 -- 172.21.2.137:0/1952436339 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v62) v1 ==== 174+0+0 (secure 0 0 0) 0x7fda980470e0 con 0x7fda90003750 2021-11-15T19:35:05.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda94053690 msgr2=0x7fda94055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda94053690 0x7fda94055b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fdaa000b000 tx=0x7fdaa0008040).stop 2021-11-15T19:35:05.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 msgr2=0x7fdab0159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fdab0159d30 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fda98001370 tx=0x7fda98013000).stop 2021-11-15T19:35:05.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 shutdown_connections 2021-11-15T19:35:05.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fda94053690 0x7fda94055b50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdab0149bb0 0x7fdab0141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdab00af750 0x7fdab01496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 --2- 172.21.2.137:0/1952436339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fda90003750 0x7fdab0159d30 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 >> 172.21.2.137:0/1952436339 conn(0x7fdab005bd20 msgr2=0x7fdab00adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:05.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 shutdown_connections 2021-11-15T19:35:05.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.145+0000 7fdab5209700 1 -- 172.21.2.137:0/1952436339 wait complete. 2021-11-15T19:35:05.158 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 24 and data pool 22 2021-11-15T19:35:05.161 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:35:05.162 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:05.169 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:05.182 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:05.196 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:05.209 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:05.238 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:35:05.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:05.239 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:05.240 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:05.258 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:35:05.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:05.259 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:05.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:05.260 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:05.265 INFO:teuthology.orchestra.run.gibba031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:35:05.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:05.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:05.267 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:05.268 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:05.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:05.274 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:35:05.275 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:05.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:05.276 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:05.281 INFO:teuthology.orchestra.run.gibba018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:35:05.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:05.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:05.283 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:05.284 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:05.293 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:05.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:05.295 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:35:05.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:05.296 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:05.347 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:05.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:05.349 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:35:05.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 Processor -- start 2021-11-15T19:35:05.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 -- start start 2021-11-15T19:35:05.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f87740b1340 0x7f8774147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 0x7f8774144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8774148190 con 0x7f87740a9f50 2021-11-15T19:35:05.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87740b1720 con 0x7f87740b1340 2021-11-15T19:35:05.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f877a3a7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8774147e70 con 0x7f8774143f00 2021-11-15T19:35:05.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f87740b1340 0x7f8774147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f87740b1340 0x7f8774147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39400/0 (socket says 172.21.2.137:39400) 2021-11-15T19:35:05.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 -- 172.21.2.137:0/1564265379 learned_addr learned my addr 172.21.2.137:0/1564265379 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:05.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 -- 172.21.2.137:0/1564265379 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 msgr2=0x7f8774144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 --2- 172.21.2.137:0/1564265379 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 0x7f8774144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 -- 172.21.2.137:0/1564265379 >> v1:172.21.2.111:6789/0 conn(0x7f87740a9f50 legacy=0x7f87740aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 -- 172.21.2.137:0/1564265379 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740af800 con 0x7f87740b1340 2021-11-15T19:35:05.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8773fff700 1 --2- 172.21.2.137:0/1564265379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740b1340 0x7f8774147980 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f877405cfa0 tx=0x7f875c006eb0).ready entity=mon.1 client_cookie=922301a2a7f701ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8772ffd700 1 -- 172.21.2.137:0/1564265379 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c00d570 con 0x7f87740b1340 2021-11-15T19:35:05.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8772ffd700 1 -- 172.21.2.137:0/1564265379 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c000e90 con 0x7f87740b1340 2021-11-15T19:35:05.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.393+0000 7f8772ffd700 1 -- 172.21.2.137:0/1564265379 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c00d8c0 con 0x7f87740b1340 2021-11-15T19:35:05.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/1564265379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740b1340 msgr2=0x7f8774147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 --2- 172.21.2.137:0/1564265379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740b1340 0x7f8774147980 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f877405cfa0 tx=0x7f875c006eb0).stop 2021-11-15T19:35:05.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/1564265379 shutdown_connections 2021-11-15T19:35:05.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 --2- 172.21.2.137:0/1564265379 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 0x7f8774144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 --2- 172.21.2.137:0/1564265379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740b1340 0x7f8774147980 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/1564265379 >> 172.21.2.137:0/1564265379 conn(0x7f87740b4e60 msgr2=0x7f87740b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:05.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/1564265379 shutdown_connections 2021-11-15T19:35:05.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/1564265379 wait complete. 2021-11-15T19:35:05.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 Processor -- start 2021-11-15T19:35:05.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- start start 2021-11-15T19:35:05.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 0x7f87741457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87740b1340 0x7f87741403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 0x7f87741408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877414a620 con 0x7f87740b1340 2021-11-15T19:35:05.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877414ae40 con 0x7f87740a9f50 2021-11-15T19:35:05.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877414b0e0 con 0x7f8774143f00 2021-11-15T19:35:05.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 0x7f87741457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 0x7f87741457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39406/0 (socket says 172.21.2.137:39406) 2021-11-15T19:35:05.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 -- 172.21.2.137:0/2403799254 learned_addr learned my addr 172.21.2.137:0/2403799254 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:05.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 -- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 msgr2=0x7f87741408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 0x7f87741408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 -- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87740b1340 msgr2=0x7f87741403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87740b1340 0x7f87741403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 -- 172.21.2.137:0/2403799254 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c00b1e0 con 0x7f87740a9f50 2021-11-15T19:35:05.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f8773fff700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 0x7f87741457a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f877405cfa0 tx=0x7f875c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c006be0 con 0x7f87740a9f50 2021-11-15T19:35:05.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c002f70 con 0x7f87740a9f50 2021-11-15T19:35:05.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c00de20 con 0x7f87740a9f50 2021-11-15T19:35:05.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87741494d0 con 0x7f87740a9f50 2021-11-15T19:35:05.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8774140f60 con 0x7f87740a9f50 2021-11-15T19:35:05.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877414a460 con 0x7f87740a9f50 2021-11-15T19:35:05.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f875c025030 con 0x7f87740a9f50 2021-11-15T19:35:05.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f87717fa700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8758053660 0x7f8758055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.397+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f875c06cce0 con 0x7f87740a9f50 2021-11-15T19:35:05.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.401+0000 7f87737fe700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8758053660 0x7f8758055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.401+0000 7f87737fe700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8758053660 0x7f8758055b20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f876c0032f0 tx=0x7f876c006e10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.401+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f875c043ce0 con 0x7f87740a9f50 2021-11-15T19:35:05.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8774148190 con 0x7f87740a9f50 2021-11-15T19:35:05.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f87717fa700 1 -- 172.21.2.137:0/2403799254 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v122) v1 ==== 81+0+33826 (secure 0 0 0) 0x7f8774148190 con 0x7f87740a9f50 2021-11-15T19:35:05.497 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:05.497 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:05.498 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 122, 2021-11-15T19:35:05.498 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:35:05.498 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:35:05.498 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:35:05.137933+0000", 2021-11-15T19:35:05.499 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:05.499 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:05.499 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:35:05.499 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:35:05.499 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:35:05.500 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:35:05.500 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:35:05.500 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:35:05.500 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:35:05.501 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:05.501 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:35:05.501 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:35:05.501 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:35:05.502 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:35:05.502 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:35:05.502 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 24, 2021-11-15T19:35:05.502 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:35:05.502 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:35:05.503 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:35:05.503 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:35:05.503 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:35:05.503 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.504 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:35:05.504 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:35:05.504 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:35:05.504 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:05.504 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:05.505 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:05.505 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:05.505 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:05.505 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:05.506 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:05.506 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:05.506 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:35:05.506 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:35:05.507 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:35:05.507 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:35:05.507 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:35:05.507 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:05.507 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:05.508 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:05.508 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:05.508 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:05.508 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:05.509 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:05.509 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.509 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:35:05.509 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:05.509 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:05.510 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:05.510 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:05.510 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:05.510 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:05.511 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:05.511 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:05.511 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:05.511 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:05.511 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:05.512 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:05.512 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:05.512 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:05.512 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:05.512 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:05.513 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:05.513 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:05.513 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:05.513 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:05.514 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:05.514 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:05.514 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:05.514 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:05.514 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:05.515 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:05.515 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.515 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:05.515 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:05.516 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:05.516 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:05.516 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:05.516 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:05.516 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:05.517 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:05.517 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:05.517 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:05.517 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:05.518 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:05.518 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:35:05.518 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.518 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:05.518 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:35:05.519 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.519 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.519 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.519 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:35:05.520 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:35:05.520 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:35:05.520 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:05.520 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:05.521 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:05.521 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:05.521 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:05.521 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:05.521 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:05.522 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:05.522 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:05.522 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:05.522 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:05.523 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:05.523 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:05.523 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:05.523 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:05.523 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:05.524 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:05.524 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:05.524 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:05.524 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:05.525 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.525 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:35:05.525 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:05.525 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:05.525 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:05.526 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:05.526 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:05.526 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:05.526 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:05.527 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:05.527 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:05.527 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:05.527 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:05.527 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:05.528 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:05.528 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:05.528 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:05.528 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:05.528 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:05.529 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:05.529 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:05.529 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:05.529 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:05.530 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:05.530 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:05.530 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:05.530 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:05.530 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:05.531 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.531 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:05.531 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:05.531 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:05.532 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:05.532 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:05.532 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:05.532 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:05.532 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:05.533 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:05.533 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:05.533 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:05.533 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:05.534 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:05.534 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:35:05.534 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.534 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.534 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.535 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 22, 2021-11-15T19:35:05.535 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:35:05.535 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:34:31.378520+0000", 2021-11-15T19:35:05.535 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:05.536 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:05.536 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:05.536 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:05.536 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:05.536 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:05.537 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:05.537 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:05.537 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:05.537 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:05.537 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:05.538 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:05.538 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:05.538 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:05.538 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:05.539 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:05.539 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:05.539 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:05.539 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:05.540 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:05.540 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.540 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "122", 2021-11-15T19:35:05.540 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:05.540 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:05.541 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:05.541 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:05.541 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:05.541 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:05.541 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:05.542 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:05.542 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:05.542 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:05.542 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:05.543 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:05.543 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:05.543 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:05.543 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:05.543 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:05.544 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:05.544 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:05.544 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:05.544 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:05.545 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:05.545 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:05.545 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:05.545 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:05.545 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:05.546 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:05.546 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.546 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:05.546 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:05.546 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:05.547 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:05.547 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:05.547 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:05.547 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:05.548 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:05.548 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:05.548 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:05.548 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:05.548 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:05.549 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:05.549 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:35:05.549 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:35:05.549 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.549 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.550 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.550 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.550 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 24, 2021-11-15T19:35:05.550 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:35:05.551 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:35:04.114759+0000", 2021-11-15T19:35:05.551 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 32769, 2021-11-15T19:35:05.551 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool,creating", 2021-11-15T19:35:05.551 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:05.551 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:05.552 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:05.552 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:05.552 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:05.552 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:05.552 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:05.553 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:05.553 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:05.553 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:05.553 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:05.553 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:05.554 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:05.554 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:05.554 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:05.554 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:05.555 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:05.555 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:05.555 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.555 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "122", 2021-11-15T19:35:05.555 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:05.556 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:05.556 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:05.556 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:05.556 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:05.556 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:05.557 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:05.557 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:05.557 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:05.557 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:05.557 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:05.558 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:05.558 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:05.558 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:05.558 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:05.559 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:05.559 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:05.559 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:05.559 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:05.559 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:05.560 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:05.560 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:05.560 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:05.560 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:05.560 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:05.561 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:05.561 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.561 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:05.561 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:05.561 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:05.562 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:05.562 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:05.562 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:05.562 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:05.563 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:05.563 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:05.563 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:05.563 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:05.563 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:05.564 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:35:05.564 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:35:05.564 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:35:05.564 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.564 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:05.565 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:35:05.565 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:35:05.565 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.565 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.565 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.566 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:05.566 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:35:05.566 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.566 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:05.567 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:35:05.567 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.567 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.567 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.567 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.568 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.568 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.568 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.568 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:05.568 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.569 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.569 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.569 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.569 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.569 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.570 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:35:05.570 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.570 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.570 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.571 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.571 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:35:05.571 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.571 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.571 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.572 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.572 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.572 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.572 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.572 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.573 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:35:05.573 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.573 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.573 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.574 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.574 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:35:05.574 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.574 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.574 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.575 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.575 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.575 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.575 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.575 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.576 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:35:05.576 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.576 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.576 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.577 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.577 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:35:05.577 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.577 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.578 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.578 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.578 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.578 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.579 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.579 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.579 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:35:05.579 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.579 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.580 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.580 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.580 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:35:05.580 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:05.581 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.581 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.581 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.581 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:35:05.581 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:35:05.582 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:35:05.582 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:35:05.582 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.582 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.583 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.583 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.583 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.583 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.583 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:05.584 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:35:05.584 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.584 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.584 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.584 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.585 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.585 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.585 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.585 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:05.586 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.586 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.586 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.586 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.586 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.587 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.587 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:35:05.587 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.587 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.588 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.588 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.588 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:35:05.588 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.589 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.589 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.589 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.589 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.589 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.590 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.590 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.590 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:35:05.590 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.591 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.591 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.591 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.591 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:35:05.591 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.592 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.592 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.592 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.592 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.593 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.593 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.593 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.593 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:35:05.593 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.594 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.594 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.594 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.594 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:35:05.595 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.595 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.595 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.595 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.596 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.596 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.596 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.596 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.596 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:35:05.597 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.597 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.597 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.597 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.597 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:35:05.598 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:05.598 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.598 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.598 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.598 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:35:05.599 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:35:05.599 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:35:05.599 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:35:05.599 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.600 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.600 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.600 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.600 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.600 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.601 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:05.601 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:35:05.601 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.601 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.602 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.602 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.602 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.602 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.602 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.603 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 116, 2021-11-15T19:35:05.603 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.603 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.603 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.603 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.604 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.604 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.604 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:35:05.604 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.605 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.605 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.605 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.605 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:35:05.605 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.606 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.606 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.606 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.607 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.607 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.607 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.607 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.608 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:35:05.608 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.608 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.608 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.609 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.609 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:35:05.609 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.609 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.609 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.610 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.610 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.610 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.610 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.611 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.611 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:35:05.611 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.611 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.611 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.612 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.612 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:35:05.612 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.612 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.613 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.613 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.613 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.613 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.614 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.614 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.614 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:35:05.614 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.614 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.615 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.615 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.615 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:35:05.615 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:05.616 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.616 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.616 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.616 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:35:05.616 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:35:05.617 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:35:05.617 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:35:05.617 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.617 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.618 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.618 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.618 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.618 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.618 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:05.619 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:35:05.619 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.619 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.619 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.620 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.620 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.620 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.620 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.621 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:05.621 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.621 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.621 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.622 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.622 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.622 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.622 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:35:05.622 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.623 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.623 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.623 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.623 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:35:05.623 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.624 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.624 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.624 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.624 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.625 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.625 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.625 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.625 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:35:05.625 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.626 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.626 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.626 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.627 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:35:05.627 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.627 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.627 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.627 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.628 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.628 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.628 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.628 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.629 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:35:05.629 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.629 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.629 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.629 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.630 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:35:05.630 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.630 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.631 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.631 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.631 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.631 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.631 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.632 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.632 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:35:05.632 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.632 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.633 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.633 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.633 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:35:05.633 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:05.633 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.634 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.634 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.634 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:35:05.634 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:35:05.635 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:35:05.635 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:35:05.635 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.635 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.636 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.636 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.636 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.636 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.636 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:05.637 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:35:05.637 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.637 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.637 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.638 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.638 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.638 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.638 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.638 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 116, 2021-11-15T19:35:05.639 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.639 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.639 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.639 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.639 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.640 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.640 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:35:05.640 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.640 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.640 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.641 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.641 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:35:05.641 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.641 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.642 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.642 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.642 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.642 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.643 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.643 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.643 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:35:05.643 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.644 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.644 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.644 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.644 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:35:05.645 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.645 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.645 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.645 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.645 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.646 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.646 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.646 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.646 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:35:05.647 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.647 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.647 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.647 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.648 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:35:05.648 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.648 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.648 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.649 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.649 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.649 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.649 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.650 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.650 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:35:05.650 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.650 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.651 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.651 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.651 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:35:05.651 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:05.651 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.652 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.652 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.652 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:35:05.652 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:35:05.652 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:35:05.653 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:35:05.653 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.653 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.653 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.653 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.654 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.654 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.654 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:05.654 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:35:05.655 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.655 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.655 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.655 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.655 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.656 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.656 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.656 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:05.656 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.656 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.657 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.657 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.657 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.657 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.658 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:35:05.658 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.658 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.658 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.659 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.659 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:35:05.659 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.659 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.659 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.660 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.660 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.660 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.660 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.661 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.661 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:35:05.661 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.661 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.661 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.662 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.662 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:35:05.662 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.662 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.662 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.663 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.663 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.663 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.663 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.664 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.664 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:35:05.664 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.664 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.664 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.665 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.665 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:35:05.665 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.665 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.665 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.666 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.666 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.666 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.666 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.667 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.667 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:35:05.667 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.667 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.667 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.668 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.668 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:35:05.668 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:05.668 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.668 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.669 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.669 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:35:05.669 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:35:05.669 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:35:05.669 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:35:05.670 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.670 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.670 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.670 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.671 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.671 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.671 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:05.671 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:35:05.672 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.672 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.672 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.673 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.673 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.673 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.674 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.674 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:05.674 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.675 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.675 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.675 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.676 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.676 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.676 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:35:05.677 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.677 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.677 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.678 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.678 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:35:05.679 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.679 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.679 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.680 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.680 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.681 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.681 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.681 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:35:05.682 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.682 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.682 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.683 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.683 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:35:05.683 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.684 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.684 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.684 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.685 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.685 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.686 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:35:05.686 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.686 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.687 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.687 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:35:05.687 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.687 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.688 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.688 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.688 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.688 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.689 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.689 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:35:05.689 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.689 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.689 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.690 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.690 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:35:05.690 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:05.690 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.690 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.691 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.691 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:35:05.691 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:35:05.691 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:35:05.691 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:35:05.692 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.692 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.692 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.692 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.692 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.693 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.693 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:05.693 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:35:05.693 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:05.693 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:05.694 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:05.694 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:05.694 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:05.694 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:05.694 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:05.695 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 109, 2021-11-15T19:35:05.695 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:05.695 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:05.695 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:05.696 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.696 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.696 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.696 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:35:05.696 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.696 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.697 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.697 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.697 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:35:05.697 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.697 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.698 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.698 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.698 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:05.698 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.699 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.699 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.699 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:35:05.699 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.699 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.700 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.700 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.700 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:35:05.700 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.700 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.701 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.701 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.701 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:05.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.702 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:35:05.702 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.702 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.703 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.703 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:35:05.703 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.703 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.703 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.704 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:05.704 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:05.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.704 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:05.705 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:35:05.705 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.705 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.705 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.705 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:05.706 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:35:05.706 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:05.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.706 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.707 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.707 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:35:05.707 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:35:05.707 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:35:05.707 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:35:05.708 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:05.708 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:05.708 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:05.708 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:05.708 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.709 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:05.709 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:35:05.709 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.709 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:05.709 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.710 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.710 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.710 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.710 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.710 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:35:05.711 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.711 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.711 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:05.712 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.712 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.712 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.712 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.712 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.713 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:35:05.713 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.713 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.713 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.713 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:05.714 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.714 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.714 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.714 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.715 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.715 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:35:05.715 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.715 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.716 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.716 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:05.716 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.716 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.716 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.717 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.717 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.717 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:35:05.717 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.718 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.718 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.718 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:05.718 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.718 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.719 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.719 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.719 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.719 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:35:05.719 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.720 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:05.720 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.721 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.721 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.721 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.721 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.722 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:35:05.722 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.722 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.722 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.722 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:05.723 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.723 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.723 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.723 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.724 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.724 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:35:05.724 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.724 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.725 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:05.725 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:05.725 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:05.725 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:05.725 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:05.726 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:05.726 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:05.726 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:35:05.726 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:05.726 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.727 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:05.727 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:35:05.727 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:35:05.727 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:35:05.727 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:35:05.728 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:35:05.728 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/3862600413": "2021-11-16T19:34:51.672104+0000", 2021-11-15T19:35:05.728 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/3862600413": "2021-11-16T19:34:51.672104+0000" 2021-11-15T19:35:05.728 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.728 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:35:05.729 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:35:05.729 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:35:05.729 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:35:05.729 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:35:05.730 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:35:05.730 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:35:05.730 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:35:05.730 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:05.731 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:05.731 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:35:05.731 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:35:05.731 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:35:05.731 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:35:05.732 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:35:05.732 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:05.733 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8758053660 msgr2=0x7f8758055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8758053660 0x7f8758055b20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f876c0032f0 tx=0x7f876c006e10).stop 2021-11-15T19:35:05.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 msgr2=0x7f87741457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 0x7f87741457a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f877405cfa0 tx=0x7f875c015000).stop 2021-11-15T19:35:05.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 shutdown_connections 2021-11-15T19:35:05.734 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8758053660 0x7f8758055b20 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8774143f00 0x7f87741408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f87740b1340 0x7f87741403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 --2- 172.21.2.137:0/2403799254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f87740a9f50 0x7f87741457a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 >> 172.21.2.137:0/2403799254 conn(0x7f87740b4e60 msgr2=0x7f8774143230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:05.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 shutdown_connections 2021-11-15T19:35:05.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.485+0000 7f877a3a7700 1 -- 172.21.2.137:0/2403799254 wait complete. 2021-11-15T19:35:05.737 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:05.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 Processor -- start 2021-11-15T19:35:05.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 -- start start 2021-11-15T19:35:05.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 0x7f411c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f411c143f00 0x7f411c144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c148190 con 0x7f411c0a9f50 2021-11-15T19:35:05.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0b1720 con 0x7f411c143f00 2021-11-15T19:35:05.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f41220a4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c147e70 con 0x7f411c0b1340 2021-11-15T19:35:05.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f411c0a9f50 0x7f411c0aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58200/0 (socket says 172.21.2.137:58200) 2021-11-15T19:35:05.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411bfff700 1 -- 172.21.2.137:0/143453285 learned_addr learned my addr 172.21.2.137:0/143453285 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:05.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864620067 0 0) 0x7f4114001490 con 0x7f411c0a9f50 2021-11-15T19:35:05.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40fc003260 con 0x7f411c0a9f50 2021-11-15T19:35:05.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411affd700 1 --2- 172.21.2.137:0/143453285 >> v2:172.21.2.111:3300/0 conn(0x7f411c143f00 0x7f411c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411b7fe700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 0x7f411c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042301756 0 0) 0x7f40fc003260 con 0x7f411c0a9f50 2021-11-15T19:35:05.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 msgr2=0x7f411c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 0x7f411c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 >> v2:172.21.2.111:3300/0 conn(0x7f411c143f00 msgr2=0x7f411c144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 --2- 172.21.2.137:0/143453285 >> v2:172.21.2.111:3300/0 conn(0x7f411c143f00 0x7f411c144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0af800 con 0x7f411c0a9f50 2021-11-15T19:35:05.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f4114001b70 con 0x7f411c0a9f50 2021-11-15T19:35:05.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 >> v1:172.21.2.137:6789/0 conn(0x7f411c0a9f50 legacy=0x7f411c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc0037d0 0x7f40fc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40fc004500 0x7f40fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 0x7f40fc004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0b1720 con 0x7f40fc0037d0 2021-11-15T19:35:05.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c147e70 con 0x7f40fc004500 2021-11-15T19:35:05.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc00b8d0 con 0x7f411c0b1340 2021-11-15T19:35:05.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411affd700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40fc004500 0x7f40fc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411affd700 1 -- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 msgr2=0x7f40fc004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411affd700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c0b1340 0x7f40fc004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.797+0000 7f411affd700 1 -- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc0037d0 msgr2=0x7f40fc003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:05.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411affd700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc0037d0 0x7f40fc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:05.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411affd700 1 -- 172.21.2.137:0/143453285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc003260 con 0x7f40fc004500 2021-11-15T19:35:05.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411affd700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40fc004500 0x7f40fc004980 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f410c00a000 tx=0x7f410c008040).ready entity=mon.1 client_cookie=dfb37c9b02a90d67 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f410c013670 con 0x7f40fc004500 2021-11-15T19:35:05.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c0137d0 con 0x7f40fc004500 2021-11-15T19:35:05.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411a7fc700 1 -- 172.21.2.137:0/143453285 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f410c013b30 con 0x7f40fc004500 2021-11-15T19:35:05.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/143453285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40fc004500 msgr2=0x7f40fc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 --2- 172.21.2.137:0/143453285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f40fc004500 0x7f40fc004980 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f410c00a000 tx=0x7f410c008040).stop 2021-11-15T19:35:05.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 -- 172.21.2.137:0/143453285 reap_dead start 2021-11-15T19:35:05.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/143453285 shutdown_connections 2021-11-15T19:35:05.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/143453285 >> 172.21.2.137:0/143453285 conn(0x7f411c0b4e60 msgr2=0x7f411c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:05.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/143453285 shutdown_connections 2021-11-15T19:35:05.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/143453285 wait complete. 2021-11-15T19:35:05.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 Processor -- start 2021-11-15T19:35:05.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- start start 2021-11-15T19:35:05.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc004500 0x7f411c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c14adc0 0x7f411c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 0x7f411c0ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c156950 con 0x7f40fc004500 2021-11-15T19:35:05.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c156b90 con 0x7f411c14a2b0 2021-11-15T19:35:05.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c156e30 con 0x7f411c14adc0 2021-11-15T19:35:05.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 0x7f411c0ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 0x7f411c0ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39430/0 (socket says 172.21.2.137:39430) 2021-11-15T19:35:05.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 -- 172.21.2.137:0/115720199 learned_addr learned my addr 172.21.2.137:0/115720199 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:05.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411b7fe700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc004500 0x7f411c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411affd700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c14adc0 0x7f411c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 -- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c14adc0 msgr2=0x7f411c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c14adc0 0x7f411c1572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.827 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 -- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc004500 msgr2=0x7f411c0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc004500 0x7f411c0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 -- 172.21.2.137:0/115720199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0af190 con 0x7f411c14a2b0 2021-11-15T19:35:05.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f411bfff700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 0x7f411c0ac2a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f4114001d50 tx=0x7f411c0abfb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4114004ab0 con 0x7f411c14a2b0 2021-11-15T19:35:05.828 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114004c10 con 0x7f411c14a2b0 2021-11-15T19:35:05.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c1577c0 con 0x7f411c14a2b0 2021-11-15T19:35:05.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c0ac930 con 0x7f411c14a2b0 2021-11-15T19:35:05.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.801+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41140070d0 con 0x7f411c14a2b0 2021-11-15T19:35:05.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f4003410 con 0x7f411c14a2b0 2021-11-15T19:35:05.829 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f411401b070 con 0x7f411c14a2b0 2021-11-15T19:35:05.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f4118ff9700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4100053640 0x7f4100055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:05.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f411406af70 con 0x7f411c14a2b0 2021-11-15T19:35:05.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f411b7fe700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4100053640 0x7f4100055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:05.830 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f411b7fe700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4100053640 0x7f4100055b00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f410400c000 tx=0x7f4104008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:05.831 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.805+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4114045e60 con 0x7f411c14a2b0 2021-11-15T19:35:05.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.913+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40f4003c40 con 0x7f411c14a2b0 2021-11-15T19:35:05.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.913+0000 7f4118ff9700 1 -- 172.21.2.137:0/115720199 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f4114019030 con 0x7f411c14a2b0 2021-11-15T19:35:05.927 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:05.928 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":62,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:05.138438+0000","modified":"2021-11-15T19:35:05.138616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-11-15T19:35:05.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4100053640 msgr2=0x7f4100055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4100053640 0x7f4100055b00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f410400c000 tx=0x7f4104008040).stop 2021-11-15T19:35:05.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 msgr2=0x7f411c0ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:05.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 0x7f411c0ac2a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f4114001d50 tx=0x7f411c0abfb0).stop 2021-11-15T19:35:05.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 shutdown_connections 2021-11-15T19:35:05.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4100053640 0x7f4100055b00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f411c14a2b0 0x7f411c0ac2a0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f411c14adc0 0x7f411c1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 --2- 172.21.2.137:0/115720199 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f40fc004500 0x7f411c0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:05.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 >> 172.21.2.137:0/115720199 conn(0x7f411c0b4e60 msgr2=0x7f411c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:05.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 shutdown_connections 2021-11-15T19:35:05.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.917+0000 7f41220a4700 1 -- 172.21.2.137:0/115720199 wait complete. 2021-11-15T19:35:05.934 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 62 2021-11-15T19:35:05.936 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:35:06.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.977+0000 7f8a4302d700 1 Processor -- start 2021-11-15T19:35:06.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- start start 2021-11-15T19:35:06.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a3c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8a3c0b0550 0x7f8a3c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c05cb50 con 0x7f8a3c14aaa0 2021-11-15T19:35:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0b1650 con 0x7f8a3c0b0550 2021-11-15T19:35:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0ad030 con 0x7f8a3c05c770 2021-11-15T19:35:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a415ca700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8a3c14aaa0 0x7f8a3c140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58220/0 (socket says 172.21.2.137:58220) 2021-11-15T19:35:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a415ca700 1 -- 172.21.2.137:0/3843997220 learned_addr learned my addr 172.21.2.137:0/3843997220 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932063445 0 0) 0x7f8a3c05cb50 con 0x7f8a3c14aaa0 2021-11-15T19:35:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a28003260 con 0x7f8a3c14aaa0 2021-11-15T19:35:06.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a3c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3bfff700 1 --2- 172.21.2.137:0/3843997220 >> v2:172.21.2.111:3300/0 conn(0x7f8a3c0b0550 0x7f8a3c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984170035 0 0) 0x7f8a28003260 con 0x7f8a3c14aaa0 2021-11-15T19:35:06.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 msgr2=0x7f8a3c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a3c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 >> v2:172.21.2.111:3300/0 conn(0x7f8a3c0b0550 msgr2=0x7f8a3c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 --2- 172.21.2.137:0/3843997220 >> v2:172.21.2.111:3300/0 conn(0x7f8a3c0b0550 0x7f8a3c14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0ad2d0 con 0x7f8a3c14aaa0 2021-11-15T19:35:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8a340019e0 con 0x7f8a3c14aaa0 2021-11-15T19:35:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 >> v1:172.21.2.137:6789/0 conn(0x7f8a3c14aaa0 legacy=0x7f8a3c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:06.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a280037d0 0x7f8a28003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a28004500 0x7f8a28004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a28004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0b1650 con 0x7f8a28004500 2021-11-15T19:35:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0ad030 con 0x7f8a280037d0 2021-11-15T19:35:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800b750 con 0x7f8a3c05c770 2021-11-15T19:35:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a280037d0 0x7f8a28003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3bfff700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a28004500 0x7f8a28004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a415ca700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a28004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 -- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 msgr2=0x7f8a28004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:06.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a28004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:06.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 -- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a28004500 msgr2=0x7f8a28004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:06.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a28004500 0x7f8a28004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:06.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 -- 172.21.2.137:0/3843997220 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28003260 con 0x7f8a280037d0 2021-11-15T19:35:06.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3bfff700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a28004500 0x7f8a28004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:06.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a415ca700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a3c05c770 0x7f8a28004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:06.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a280037d0 0x7f8a28003bf0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f8a2c00c000 tx=0x7f8a2c006df0).ready entity=mon.1 client_cookie=55d9546a0706034c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:06.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00e830 con 0x7f8a280037d0 2021-11-15T19:35:06.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00e990 con 0x7f8a280037d0 2021-11-15T19:35:06.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a3b7fe700 1 -- 172.21.2.137:0/3843997220 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00ecf0 con 0x7f8a280037d0 2021-11-15T19:35:06.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- 172.21.2.137:0/3843997220 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a280037d0 msgr2=0x7f8a28003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:06.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3843997220 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a280037d0 0x7f8a28003bf0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f8a2c00c000 tx=0x7f8a2c006df0).stop 2021-11-15T19:35:06.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a415ca700 1 -- 172.21.2.137:0/3843997220 reap_dead start 2021-11-15T19:35:06.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- 172.21.2.137:0/3843997220 shutdown_connections 2021-11-15T19:35:06.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- 172.21.2.137:0/3843997220 >> 172.21.2.137:0/3843997220 conn(0x7f8a3c0631e0 msgr2=0x7f8a3c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:06.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- 172.21.2.137:0/3843997220 shutdown_connections 2021-11-15T19:35:06.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.981+0000 7f8a4302d700 1 -- 172.21.2.137:0/3843997220 wait complete. 2021-11-15T19:35:06.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 Processor -- start 2021-11-15T19:35:06.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- start start 2021-11-15T19:35:06.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a280037d0 0x7f8a3c0667a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 0x7f8a3c146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a3c1173d0 0x7f8a3c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c066d30 con 0x7f8a3c1173d0 2021-11-15T19:35:06.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c116aa0 con 0x7f8a3c065860 2021-11-15T19:35:06.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c116c90 con 0x7f8a280037d0 2021-11-15T19:35:06.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 0x7f8a3c146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 0x7f8a3c146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39446/0 (socket says 172.21.2.137:39446) 2021-11-15T19:35:06.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 -- 172.21.2.137:0/3437760957 learned_addr learned my addr 172.21.2.137:0/3437760957 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:06.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 -- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a280037d0 msgr2=0x7f8a3c0667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:06.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a280037d0 0x7f8a3c0667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:06.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 -- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a3c1173d0 msgr2=0x7f8a3c156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:06.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a3c1173d0 0x7f8a3c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:06.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 -- 172.21.2.137:0/3437760957 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c116f30 con 0x7f8a3c065860 2021-11-15T19:35:06.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a3bfff700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 0x7f8a3c146370 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f8a3c1172b0 tx=0x7f8a30008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:06.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a30010e90 con 0x7f8a3c065860 2021-11-15T19:35:06.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000e8d0 con 0x7f8a3c065860 2021-11-15T19:35:06.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a3000ec30 con 0x7f8a3c065860 2021-11-15T19:35:06.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c117880 con 0x7f8a3c065860 2021-11-15T19:35:06.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c156780 con 0x7f8a3c065860 2021-11-15T19:35:06.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c156c30 con 0x7f8a3c065860 2021-11-15T19:35:06.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a30024070 con 0x7f8a3c065860 2021-11-15T19:35:06.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a39ffb700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8a1c0536a0 0x7f8a1c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:06.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f8a3006c240 con 0x7f8a3c065860 2021-11-15T19:35:06.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8a1c0536a0 0x7f8a1c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:06.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.985+0000 7f8a40dc9700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8a1c0536a0 0x7f8a1c055b60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8a2c00c000 tx=0x7f8a2c019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:06.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:05.989+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a30043350 con 0x7f8a3c065860 2021-11-15T19:35:06.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:06.097+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8a3c1170c0 con 0x7f8a3c065860 2021-11-15T19:35:07.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.101+0000 7f8a39ffb700 1 -- 172.21.2.137:0/3437760957 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8a30046970 con 0x7f8a3c065860 2021-11-15T19:35:07.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8a1c0536a0 msgr2=0x7f8a1c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8a1c0536a0 0x7f8a1c055b60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8a2c00c000 tx=0x7f8a2c019000).stop 2021-11-15T19:35:07.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 msgr2=0x7f8a3c146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 0x7f8a3c146370 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f8a3c1172b0 tx=0x7f8a30008040).stop 2021-11-15T19:35:07.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 shutdown_connections 2021-11-15T19:35:07.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8a1c0536a0 0x7f8a1c055b60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8a3c1173d0 0x7f8a3c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8a3c065860 0x7f8a3c146370 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 --2- 172.21.2.137:0/3437760957 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8a280037d0 0x7f8a3c0667a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 >> 172.21.2.137:0/3437760957 conn(0x7f8a3c0631e0 msgr2=0x7f8a3c0b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:07.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 shutdown_connections 2021-11-15T19:35:07.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.105+0000 7f8a4302d700 1 -- 172.21.2.137:0/3437760957 wait complete. 2021-11-15T19:35:07.118 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:35:07.122 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:07.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.169+0000 7f3338d9f700 1 Processor -- start 2021-11-15T19:35:07.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.169+0000 7f3338d9f700 1 -- start start 2021-11-15T19:35:07.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 0x7f333409cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f33340b3140 0x7f333405f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333409d190 con 0x7f333409ab00 2021-11-15T19:35:07.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3334099790 con 0x7f33340b3140 2021-11-15T19:35:07.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340b2940 con 0x7f333409c8c0 2021-11-15T19:35:07.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3332d9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f333409ab00 0x7f3334143260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58240/0 (socket says 172.21.2.137:58240) 2021-11-15T19:35:07.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3332d9d700 1 -- 172.21.2.137:0/2482257600 learned_addr learned my addr 172.21.2.137:0/2482257600 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:07.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333259c700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 0x7f333409cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029790269 0 0) 0x7f333409d190 con 0x7f333409ab00 2021-11-15T19:35:07.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3314003260 con 0x7f333409ab00 2021-11-15T19:35:07.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 --2- 172.21.2.137:0/2482257600 >> v2:172.21.2.111:3300/0 conn(0x7f33340b3140 0x7f333405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851253324 0 0) 0x7f3314003260 con 0x7f333409ab00 2021-11-15T19:35:07.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 msgr2=0x7f333409cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 0x7f333409cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 >> v2:172.21.2.111:3300/0 conn(0x7f33340b3140 msgr2=0x7f333405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 --2- 172.21.2.137:0/2482257600 >> v2:172.21.2.111:3300/0 conn(0x7f33340b3140 0x7f333405f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334099a30 con 0x7f333409ab00 2021-11-15T19:35:07.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f332c0019e0 con 0x7f333409ab00 2021-11-15T19:35:07.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 >> v1:172.21.2.137:6789/0 conn(0x7f333409ab00 legacy=0x7f3334143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314003750 0x7f3314003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3314004500 0x7f3314004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 0x7f3314004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334099790 con 0x7f3314003750 2021-11-15T19:35:07.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340b2940 con 0x7f3314004500 2021-11-15T19:35:07.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331400b750 con 0x7f333409c8c0 2021-11-15T19:35:07.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3314004500 0x7f3314004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333259c700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314003750 0x7f3314003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 -- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 msgr2=0x7f3314004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333409c8c0 0x7f3314004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 -- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314003750 msgr2=0x7f3314003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314003750 0x7f3314003b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 -- 172.21.2.137:0/2482257600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3314003260 con 0x7f3314004500 2021-11-15T19:35:07.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3314004500 0x7f3314004980 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f331c00c000 tx=0x7f331c006df0).ready entity=mon.1 client_cookie=ee5c7c4dba5b5d89 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:07.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f331c00e800 con 0x7f3314004500 2021-11-15T19:35:07.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c00e960 con 0x7f3314004500 2021-11-15T19:35:07.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f333159a700 1 -- 172.21.2.137:0/2482257600 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f331c00ecc0 con 0x7f3314004500 2021-11-15T19:35:07.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- 172.21.2.137:0/2482257600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3314004500 msgr2=0x7f3314004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 --2- 172.21.2.137:0/2482257600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3314004500 0x7f3314004980 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f331c00c000 tx=0x7f331c006df0).stop 2021-11-15T19:35:07.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3332d9d700 1 -- 172.21.2.137:0/2482257600 reap_dead start 2021-11-15T19:35:07.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- 172.21.2.137:0/2482257600 shutdown_connections 2021-11-15T19:35:07.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- 172.21.2.137:0/2482257600 >> 172.21.2.137:0/2482257600 conn(0x7f33340b45b0 msgr2=0x7f333405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:07.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- 172.21.2.137:0/2482257600 shutdown_connections 2021-11-15T19:35:07.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- 172.21.2.137:0/2482257600 wait complete. 2021-11-15T19:35:07.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 Processor -- start 2021-11-15T19:35:07.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- start start 2021-11-15T19:35:07.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314004500 0x7f33340b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 0x7f33340b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333414def0 0x7f333414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340ac910 con 0x7f3314004500 2021-11-15T19:35:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340acbb0 con 0x7f33340ac390 2021-11-15T19:35:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3338d9f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340ace50 con 0x7f333414def0 2021-11-15T19:35:07.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.173+0000 7f3331d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 0x7f33340b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 0x7f33340b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39468/0 (socket says 172.21.2.137:39468) 2021-11-15T19:35:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 -- 172.21.2.137:0/708310235 learned_addr learned my addr 172.21.2.137:0/708310235 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f333259c700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314004500 0x7f33340b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 -- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333414def0 msgr2=0x7f333414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333414def0 0x7f333414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 -- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314004500 msgr2=0x7f33340b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314004500 0x7f33340b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 -- 172.21.2.137:0/708310235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333414e860 con 0x7f33340ac390 2021-11-15T19:35:07.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3331d9b700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 0x7f33340b1130 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f331c00c000 tx=0x7f331c019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:07.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f331c01b820 con 0x7f33340ac390 2021-11-15T19:35:07.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c000e90 con 0x7f33340ac390 2021-11-15T19:35:07.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333414eab0 con 0x7f33340ac390 2021-11-15T19:35:07.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33341513d0 con 0x7f33340ac390 2021-11-15T19:35:07.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f331c01bb70 con 0x7f33340ac390 2021-11-15T19:35:07.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33340573d0 con 0x7f33340ac390 2021-11-15T19:35:07.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f331c01bcd0 con 0x7f33340ac390 2021-11-15T19:35:07.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3318053690 0x7f3318055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f331c06d0b0 con 0x7f33340ac390 2021-11-15T19:35:07.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f333259c700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3318053690 0x7f3318055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f333259c700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3318053690 0x7f3318055b50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f332400f000 tx=0x7f332400d040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:07.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.177+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f331c047ae0 con 0x7f33340ac390 2021-11-15T19:35:07.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33340b6d60 con 0x7f33340ac390 2021-11-15T19:35:07.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f332b7fe700 1 -- 172.21.2.137:0/708310235 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f331c0476d0 con 0x7f33340ac390 2021-11-15T19:35:07.300 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:07.300 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":63,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":63,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:05.138438+0000","modified":"2021-11-15T19:35:07.099668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-11-15T19:35:07.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3318053690 msgr2=0x7f3318055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3318053690 0x7f3318055b50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f332400f000 tx=0x7f332400d040).stop 2021-11-15T19:35:07.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 msgr2=0x7f33340b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 0x7f33340b1130 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f331c00c000 tx=0x7f331c019000).stop 2021-11-15T19:35:07.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 shutdown_connections 2021-11-15T19:35:07.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3318053690 0x7f3318055b50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f333414def0 0x7f333414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f33340ac390 0x7f33340b1130 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 --2- 172.21.2.137:0/708310235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3314004500 0x7f33340b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 >> 172.21.2.137:0/708310235 conn(0x7f33340b45b0 msgr2=0x7f3334060870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:07.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 shutdown_connections 2021-11-15T19:35:07.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.289+0000 7f3338d9f700 1 -- 172.21.2.137:0/708310235 wait complete. 2021-11-15T19:35:07.304 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 63 2021-11-15T19:35:07.307 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:35:07.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 Processor -- start 2021-11-15T19:35:07.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- start start 2021-11-15T19:35:07.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6448140aa0 0x7f6448140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644805cb50 con 0x7f644805c770 2021-11-15T19:35:07.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480ad030 con 0x7f64480b0550 2021-11-15T19:35:07.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480b1650 con 0x7f6448140aa0 2021-11-15T19:35:07.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f6447fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f64480b0550 0x7f644814a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58260/0 (socket says 172.21.2.137:58260) 2021-11-15T19:35:07.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f6447fff700 1 -- 172.21.2.137:0/2977664056 learned_addr learned my addr 172.21.2.137:0/2977664056 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:07.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832187198 0 0) 0x7f64480ad030 con 0x7f64480b0550 2021-11-15T19:35:07.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6428003260 con 0x7f64480b0550 2021-11-15T19:35:07.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 --2- 172.21.2.137:0/2977664056 >> v2:172.21.2.111:3300/0 conn(0x7f6448140aa0 0x7f6448140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893446364 0 0) 0x7f6428003260 con 0x7f64480b0550 2021-11-15T19:35:07.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 >> v2:172.21.2.111:3300/0 conn(0x7f6448140aa0 msgr2=0x7f6448140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 --2- 172.21.2.137:0/2977664056 >> v2:172.21.2.111:3300/0 conn(0x7f6448140aa0 0x7f6448140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 >> v1:172.21.2.111:6789/0 conn(0x7f644805c770 legacy=0x7f64480aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480ad2d0 con 0x7f64480b0550 2021-11-15T19:35:07.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6430001660 con 0x7f64480b0550 2021-11-15T19:35:07.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 >> v1:172.21.2.137:6789/0 conn(0x7f64480b0550 legacy=0x7f644814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6428003820 0x7f6428003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6428004500 0x7f6428004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f642800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480b1650 con 0x7f6428003820 2021-11-15T19:35:07.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642800bf40 con 0x7f6428005050 2021-11-15T19:35:07.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642800c100 con 0x7f6428004500 2021-11-15T19:35:07.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f642800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 -- 172.21.2.137:0/2977664056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6428004500 msgr2=0x7f6428004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6428004500 0x7f6428004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 -- 172.21.2.137:0/2977664056 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6428003820 msgr2=0x7f6428003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:07.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6428003820 0x7f6428003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 -- 172.21.2.137:0/2977664056 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428003260 con 0x7f6428005050 2021-11-15T19:35:07.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 -- 172.21.2.137:0/2977664056 reap_dead start 2021-11-15T19:35:07.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644d094700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f642800b750 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f6440007000 tx=0x7f6440008040).ready entity=mon.1 client_cookie=ec837b8a263d18a1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:07.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6440015070 con 0x7f6428005050 2021-11-15T19:35:07.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000c640 con 0x7f6428005050 2021-11-15T19:35:07.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f64477fe700 1 -- 172.21.2.137:0/2977664056 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644000a4a0 con 0x7f6428005050 2021-11-15T19:35:07.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- 172.21.2.137:0/2977664056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 msgr2=0x7f642800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f642800b750 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f6440007000 tx=0x7f6440008040).stop 2021-11-15T19:35:07.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- 172.21.2.137:0/2977664056 shutdown_connections 2021-11-15T19:35:07.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2977664056 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f642800b750 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:07.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- 172.21.2.137:0/2977664056 >> 172.21.2.137:0/2977664056 conn(0x7f64480631e0 msgr2=0x7f644805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:07.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- 172.21.2.137:0/2977664056 shutdown_connections 2021-11-15T19:35:07.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.349+0000 7f644eaf7700 1 -- 172.21.2.137:0/2977664056 wait complete. 2021-11-15T19:35:07.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 Processor -- start 2021-11-15T19:35:07.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- start start 2021-11-15T19:35:07.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f64481478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f64481489c0 0x7f64481499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6448149e90 0x7f6448159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448149210 con 0x7f6448149e90 2021-11-15T19:35:07.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481494b0 con 0x7f6428005050 2021-11-15T19:35:07.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644814a320 con 0x7f64481489c0 2021-11-15T19:35:07.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f64481478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f64481478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39486/0 (socket says 172.21.2.137:39486) 2021-11-15T19:35:07.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 -- 172.21.2.137:0/2385405339 learned_addr learned my addr 172.21.2.137:0/2385405339 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:07.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 -- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f64481489c0 msgr2=0x7f64481499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f64481489c0 0x7f64481499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 -- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6448149e90 msgr2=0x7f6448159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:07.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6448149e90 0x7f6448159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 -- 172.21.2.137:0/2385405339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64481484b0 con 0x7f6428005050 2021-11-15T19:35:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644c893700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f64481478a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f6438000f70 tx=0x7f6438006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6438013460 con 0x7f6428005050 2021-11-15T19:35:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64380135c0 con 0x7f6428005050 2021-11-15T19:35:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6448063760 con 0x7f6428005050 2021-11-15T19:35:07.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6438013920 con 0x7f6428005050 2021-11-15T19:35:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448159e90 con 0x7f6428005050 2021-11-15T19:35:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480ae7f0 con 0x7f6428005050 2021-11-15T19:35:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f643800f070 con 0x7f6428005050 2021-11-15T19:35:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6445ffb700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f642c0536a0 0x7f642c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:07.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f643806b190 con 0x7f6428005050 2021-11-15T19:35:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.353+0000 7f6447fff700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f642c0536a0 0x7f642c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.357+0000 7f6447fff700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f642c0536a0 0x7f642c055b60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f64480aee10 tx=0x7f6448146fe0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:07.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.357+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64380422a0 con 0x7f6428005050 2021-11-15T19:35:07.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:07.465+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6448148740 con 0x7f6428005050 2021-11-15T19:35:08.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f6445ffb700 1 -- 172.21.2.137:0/2385405339 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f64380458c0 con 0x7f6428005050 2021-11-15T19:35:08.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f642c0536a0 msgr2=0x7f642c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:08.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f642c0536a0 0x7f642c055b60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f64480aee10 tx=0x7f6448146fe0).stop 2021-11-15T19:35:08.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 msgr2=0x7f64481478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:08.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f64481478a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f6438000f70 tx=0x7f6438006df0).stop 2021-11-15T19:35:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 shutdown_connections 2021-11-15T19:35:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f642c0536a0 0x7f642c055b60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6448149e90 0x7f6448159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:08.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f64481489c0 0x7f64481499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 --2- 172.21.2.137:0/2385405339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6428005050 0x7f64481478a0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 >> 172.21.2.137:0/2385405339 conn(0x7f64480631e0 msgr2=0x7f64480b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 shutdown_connections 2021-11-15T19:35:08.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.165+0000 7f644eaf7700 1 -- 172.21.2.137:0/2385405339 wait complete. 2021-11-15T19:35:08.188 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:35:08.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 Processor -- start 2021-11-15T19:35:08.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 -- start start 2021-11-15T19:35:08.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2b480b0830 0x7f2b480af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:08.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b10b0 0x7f2b480aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:08.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48147f70 con 0x7f2b4805fd20 2021-11-15T19:35:08.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b48060100 con 0x7f2b480b0830 2021-11-15T19:35:08.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b4e849700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48147cd0 con 0x7f2b480b10b0 2021-11-15T19:35:08.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b477fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2b480b0830 0x7f2b480af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:08.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b477fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2b480b0830 0x7f2b480af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39498/0 (socket says 172.21.2.137:39498) 2021-11-15T19:35:08.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.229+0000 7f2b477fe700 1 -- 172.21.2.137:0/2967096856 learned_addr learned my addr 172.21.2.137:0/2967096856 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:08.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b477fe700 1 -- 172.21.2.137:0/2967096856 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b10b0 msgr2=0x7f2b480aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:08.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b477fe700 1 --2- 172.21.2.137:0/2967096856 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b10b0 0x7f2b480aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:08.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b477fe700 1 -- 172.21.2.137:0/2967096856 >> v1:172.21.2.111:6789/0 conn(0x7f2b4805fd20 legacy=0x7f2b480b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:08.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b477fe700 1 -- 172.21.2.137:0/2967096856 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480a9ed0 con 0x7f2b480b0830 2021-11-15T19:35:08.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b477fe700 1 --2- 172.21.2.137:0/2967096856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b0830 0x7f2b480af800 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f2b480b4db0 tx=0x7f2b30006eb0).ready entity=mon.1 client_cookie=e136eb16342fef82 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:08.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b46ffd700 1 -- 172.21.2.137:0/2967096856 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3000d570 con 0x7f2b480b0830 2021-11-15T19:35:08.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b46ffd700 1 -- 172.21.2.137:0/2967096856 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b30000e90 con 0x7f2b480b0830 2021-11-15T19:35:08.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b46ffd700 1 -- 172.21.2.137:0/2967096856 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3000d8c0 con 0x7f2b480b0830 2021-11-15T19:35:08.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/2967096856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b0830 msgr2=0x7f2b480af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:08.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 --2- 172.21.2.137:0/2967096856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b0830 0x7f2b480af800 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f2b480b4db0 tx=0x7f2b30006eb0).stop 2021-11-15T19:35:08.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/2967096856 shutdown_connections 2021-11-15T19:35:08.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 --2- 172.21.2.137:0/2967096856 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b10b0 0x7f2b480aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:08.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 --2- 172.21.2.137:0/2967096856 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b0830 0x7f2b480af800 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:08.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/2967096856 >> 172.21.2.137:0/2967096856 conn(0x7f2b480b4e60 msgr2=0x7f2b480b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:08.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/2967096856 shutdown_connections 2021-11-15T19:35:08.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/2967096856 wait complete. 2021-11-15T19:35:08.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 Processor -- start 2021-11-15T19:35:08.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- start start 2021-11-15T19:35:08.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2b4805fd20 0x7f2b481419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:08.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b0830 0x7f2b48142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:08.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 0x7f2b480ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:08.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48142010 con 0x7f2b4805fd20 2021-11-15T19:35:08.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48156c10 con 0x7f2b480b10b0 2021-11-15T19:35:08.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48156eb0 con 0x7f2b480b0830 2021-11-15T19:35:08.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 0x7f2b480ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:08.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 0x7f2b480ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39504/0 (socket says 172.21.2.137:39504) 2021-11-15T19:35:08.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 -- 172.21.2.137:0/752777778 learned_addr learned my addr 172.21.2.137:0/752777778 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:08.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 -- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b0830 msgr2=0x7f2b48142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:08.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b0830 0x7f2b48142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:08.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 -- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2b4805fd20 msgr2=0x7f2b481419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:08.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2b4805fd20 0x7f2b481419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:08.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 -- 172.21.2.137:0/752777778 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3000b1e0 con 0x7f2b480b10b0 2021-11-15T19:35:08.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4cde6700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 0x7f2b480ad230 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f2b400032f0 tx=0x7f2b400091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:08.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4000d4a0 con 0x7f2b480b10b0 2021-11-15T19:35:08.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4000d600 con 0x7f2b480b10b0 2021-11-15T19:35:08.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b480aef10 con 0x7f2b480b10b0 2021-11-15T19:35:08.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4000d960 con 0x7f2b480b10b0 2021-11-15T19:35:08.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.233+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b480ad720 con 0x7f2b480b10b0 2021-11-15T19:35:08.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b48157070 con 0x7f2b480b10b0 2021-11-15T19:35:08.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b40018030 con 0x7f2b480b10b0 2021-11-15T19:35:08.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b457fa700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2b2c053610 0x7f2b2c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:08.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f2b4006b420 con 0x7f2b480b10b0 2021-11-15T19:35:08.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b47fff700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2b2c053610 0x7f2b2c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:08.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b47fff700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2b2c053610 0x7f2b2c055ad0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f2b38002f90 tx=0x7f2b380069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:08.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.237+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b400424d0 con 0x7f2b480b10b0 2021-11-15T19:35:08.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:08.321+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b481479f0 con 0x7f2b480b10b0 2021-11-15T19:35:09.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.173+0000 7f2b457fa700 1 -- 172.21.2.137:0/752777778 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2b40045af0 con 0x7f2b480b10b0 2021-11-15T19:35:09.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2b2c053610 msgr2=0x7f2b2c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:09.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2b2c053610 0x7f2b2c055ad0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f2b38002f90 tx=0x7f2b380069b0).stop 2021-11-15T19:35:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 msgr2=0x7f2b480ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 0x7f2b480ad230 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f2b400032f0 tx=0x7f2b400091a0).stop 2021-11-15T19:35:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 shutdown_connections 2021-11-15T19:35:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2b2c053610 0x7f2b2c055ad0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2b480b10b0 0x7f2b480ad230 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2b480b0830 0x7f2b48142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 --2- 172.21.2.137:0/752777778 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2b4805fd20 0x7f2b481419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 >> 172.21.2.137:0/752777778 conn(0x7f2b480b4e60 msgr2=0x7f2b48146090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 shutdown_connections 2021-11-15T19:35:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.177+0000 7f2b4e849700 1 -- 172.21.2.137:0/752777778 wait complete. 2021-11-15T19:35:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:35:09.194 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:35:09.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 Processor -- start 2021-11-15T19:35:09.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- start start 2021-11-15T19:35:09.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f78e00b5d50 0x7f78e01443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e01448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f78e0147200 0x7f78e0147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00b0bf0 con 0x7f78e00b5d50 2021-11-15T19:35:09.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00b6130 con 0x7f78e0147200 2021-11-15T19:35:09.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00b0950 con 0x7f78e00b1050 2021-11-15T19:35:09.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f78e0147200 0x7f78e0147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f78e0147200 0x7f78e0147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39508/0 (socket says 172.21.2.137:39508) 2021-11-15T19:35:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/3108686374 learned_addr learned my addr 172.21.2.137:0/3108686374 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/3108686374 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 msgr2=0x7f78e01448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:09.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- 172.21.2.137:0/3108686374 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e01448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/3108686374 >> v2:172.21.2.111:3300/0 conn(0x7f78e00b5d50 msgr2=0x7f78e01443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- 172.21.2.137:0/3108686374 >> v2:172.21.2.111:3300/0 conn(0x7f78e00b5d50 0x7f78e01443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/3108686374 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00af3d0 con 0x7f78e0147200 2021-11-15T19:35:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- 172.21.2.137:0/3108686374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0147670 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f78d80032f0 tx=0x7f78d8009290).ready entity=mon.1 client_cookie=8f389c9ede85016a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:09.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78dd59a700 1 -- 172.21.2.137:0/3108686374 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d800b870 con 0x7f78e0147200 2021-11-15T19:35:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78dd59a700 1 -- 172.21.2.137:0/3108686374 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800b9d0 con 0x7f78e0147200 2021-11-15T19:35:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78dd59a700 1 -- 172.21.2.137:0/3108686374 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d800bb40 con 0x7f78e0147200 2021-11-15T19:35:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- 172.21.2.137:0/3108686374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 msgr2=0x7f78e0147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:09.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- 172.21.2.137:0/3108686374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0147670 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f78d80032f0 tx=0x7f78d8009290).stop 2021-11-15T19:35:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- 172.21.2.137:0/3108686374 shutdown_connections 2021-11-15T19:35:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- 172.21.2.137:0/3108686374 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0147670 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- 172.21.2.137:0/3108686374 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e01448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- 172.21.2.137:0/3108686374 >> v2:172.21.2.111:3300/0 conn(0x7f78e00b5d50 0x7f78e01443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:09.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- 172.21.2.137:0/3108686374 >> 172.21.2.137:0/3108686374 conn(0x7f78e005c7b0 msgr2=0x7f78e00b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- 172.21.2.137:0/3108686374 shutdown_connections 2021-11-15T19:35:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- 172.21.2.137:0/3108686374 wait complete. 2021-11-15T19:35:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 Processor -- start 2021-11-15T19:35:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- start start 2021-11-15T19:35:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e00a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78e00b5d50 0x7f78e0063b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0064030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00a85e0 con 0x7f78e00b5d50 2021-11-15T19:35:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00666e0 con 0x7f78e0147200 2021-11-15T19:35:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00661a0 con 0x7f78e00b1050 2021-11-15T19:35:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0064030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:09.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0064030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39514/0 (socket says 172.21.2.137:39514) 2021-11-15T19:35:09.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/1494536170 learned_addr learned my addr 172.21.2.137:0/1494536170 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:09.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ddd9b700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78e00b5d50 0x7f78e0063b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:09.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78de59c700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e00a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:09.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 msgr2=0x7f78e00a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:09.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e00a7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:09.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78e00b5d50 msgr2=0x7f78e0063b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:09.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78e00b5d50 0x7f78e0063b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:09.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 -- 172.21.2.137:0/1494536170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8009530 con 0x7f78e0147200 2021-11-15T19:35:09.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ddd9b700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78e00b5d50 0x7f78e0063b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:09.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78ded9d700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0064030 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f78e0065930 tx=0x7f78d8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:09.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d800b870 con 0x7f78e0147200 2021-11-15T19:35:09.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8020620 con 0x7f78e0147200 2021-11-15T19:35:09.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d8020980 con 0x7f78e0147200 2021-11-15T19:35:09.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.241+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e0066440 con 0x7f78e0147200 2021-11-15T19:35:09.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e00a7b40 con 0x7f78e0147200 2021-11-15T19:35:09.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e00a73f0 con 0x7f78e0147200 2021-11-15T19:35:09.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78d8028070 con 0x7f78e0147200 2021-11-15T19:35:09.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78cf7fe700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78bc0536a0 0x7f78bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:09.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f78d806c290 con 0x7f78e0147200 2021-11-15T19:35:09.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78de59c700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78bc0536a0 0x7f78bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:09.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78de59c700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78bc0536a0 0x7f78bc055b60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f78d0007000 tx=0x7f78d0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:09.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.245+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78d8043550 con 0x7f78e0147200 2021-11-15T19:35:09.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:09.329+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f78e00b0670 con 0x7f78e0147200 2021-11-15T19:35:10.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78cf7fe700 1 -- 172.21.2.137:0/1494536170 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) v1 ==== 173+0+0 (secure 0 0 0) 0x7f78d8015020 con 0x7f78e0147200 2021-11-15T19:35:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78bc0536a0 msgr2=0x7f78bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78bc0536a0 0x7f78bc055b60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f78d0007000 tx=0x7f78d0008040).stop 2021-11-15T19:35:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 msgr2=0x7f78e0064030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0064030 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f78e0065930 tx=0x7f78d8016000).stop 2021-11-15T19:35:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 shutdown_connections 2021-11-15T19:35:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78bc0536a0 0x7f78bc055b60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78e0147200 0x7f78e0064030 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78e00b5d50 0x7f78e0063b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 --2- 172.21.2.137:0/1494536170 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78e00b1050 0x7f78e00a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 >> 172.21.2.137:0/1494536170 conn(0x7f78e005c7b0 msgr2=0x7f78e00acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 shutdown_connections 2021-11-15T19:35:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.181+0000 7f78e4b22700 1 -- 172.21.2.137:0/1494536170 wait complete. 2021-11-15T19:35:10.197 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:35:10.201 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:35:10.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 Processor -- start 2021-11-15T19:35:10.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 -- start start 2021-11-15T19:35:10.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b0550 0x7f1fb414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fb414aaa0 0x7f1fb4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb405cb50 con 0x7f1fb405c770 2021-11-15T19:35:10.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40b1650 con 0x7f1fb414aaa0 2021-11-15T19:35:10.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fbaa88700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40ad030 con 0x7f1fb40b0550 2021-11-15T19:35:10.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fb414aaa0 0x7f1fb4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:10.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fb414aaa0 0x7f1fb4140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39522/0 (socket says 172.21.2.137:39522) 2021-11-15T19:35:10.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 -- 172.21.2.137:0/1799289230 learned_addr learned my addr 172.21.2.137:0/1799289230 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:10.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 -- 172.21.2.137:0/1799289230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b0550 msgr2=0x7f1fb414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:10.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 --2- 172.21.2.137:0/1799289230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b0550 0x7f1fb414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 -- 172.21.2.137:0/1799289230 >> v1:172.21.2.111:6789/0 conn(0x7f1fb405c770 legacy=0x7f1fb40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:10.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 -- 172.21.2.137:0/1799289230 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40ad2d0 con 0x7f1fb414aaa0 2021-11-15T19:35:10.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb9025700 1 --2- 172.21.2.137:0/1799289230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4140aa0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f1fb40adfd0 tx=0x7f1fac009290).ready entity=mon.1 client_cookie=10bf8776d9af603b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:10.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb37fe700 1 -- 172.21.2.137:0/1799289230 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fac00b860 con 0x7f1fb414aaa0 2021-11-15T19:35:10.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb37fe700 1 -- 172.21.2.137:0/1799289230 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac00b9c0 con 0x7f1fb414aaa0 2021-11-15T19:35:10.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.241+0000 7f1fb37fe700 1 -- 172.21.2.137:0/1799289230 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fac00bb70 con 0x7f1fb414aaa0 2021-11-15T19:35:10.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/1799289230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 msgr2=0x7f1fb4140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/1799289230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4140aa0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f1fb40adfd0 tx=0x7f1fac009290).stop 2021-11-15T19:35:10.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/1799289230 shutdown_connections 2021-11-15T19:35:10.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/1799289230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4140aa0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/1799289230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb40b0550 0x7f1fb414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/1799289230 >> 172.21.2.137:0/1799289230 conn(0x7f1fb40631e0 msgr2=0x7f1fb405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:10.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/1799289230 shutdown_connections 2021-11-15T19:35:10.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/1799289230 wait complete. 2021-11-15T19:35:10.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 Processor -- start 2021-11-15T19:35:10.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- start start 2021-11-15T19:35:10.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb405c770 0x7f1fb4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb40b0550 0x7f1fb4146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4066ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4145c40 con 0x7f1fb40b0550 2021-11-15T19:35:10.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4144c30 con 0x7f1fb414aaa0 2021-11-15T19:35:10.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4145e70 con 0x7f1fb405c770 2021-11-15T19:35:10.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4066ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:10.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4066ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39528/0 (socket says 172.21.2.137:39528) 2021-11-15T19:35:10.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 -- 172.21.2.137:0/659351949 learned_addr learned my addr 172.21.2.137:0/659351949 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:10.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 -- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb405c770 msgr2=0x7f1fb4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb405c770 0x7f1fb4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 -- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb40b0550 msgr2=0x7f1fb4146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb40b0550 0x7f1fb4146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 -- 172.21.2.137:0/659351949 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009530 con 0x7f1fb414aaa0 2021-11-15T19:35:10.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb9025700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4066ca0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f1fb40adfd0 tx=0x7f1fac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:10.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fac00bb30 con 0x7f1fb414aaa0 2021-11-15T19:35:10.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac01f420 con 0x7f1fb414aaa0 2021-11-15T19:35:10.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fac01f780 con 0x7f1fb414aaa0 2021-11-15T19:35:10.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb4144e90 con 0x7f1fb414aaa0 2021-11-15T19:35:10.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40ac910 con 0x7f1fb414aaa0 2021-11-15T19:35:10.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40ae7f0 con 0x7f1fb414aaa0 2021-11-15T19:35:10.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fac00f070 con 0x7f1fb414aaa0 2021-11-15T19:35:10.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb1ffb700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f98053610 0x7f1f98055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.245+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1fac06c380 con 0x7f1fb414aaa0 2021-11-15T19:35:10.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.249+0000 7f1fb8824700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f98053610 0x7f1f98055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:10.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.249+0000 7f1fb8824700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f98053610 0x7f1f98055ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1f9c002ef0 tx=0x7f1f9c006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:10.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.249+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fac0436b0 con 0x7f1fb414aaa0 2021-11-15T19:35:10.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.333+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1fb40573d0 con 0x7f1fb414aaa0 2021-11-15T19:35:10.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fb1ffb700 1 -- 172.21.2.137:0/659351949 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1fac015020 con 0x7f1fb414aaa0 2021-11-15T19:35:10.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f98053610 msgr2=0x7f1f98055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f98053610 0x7f1f98055ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1f9c002ef0 tx=0x7f1f9c006910).stop 2021-11-15T19:35:10.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 msgr2=0x7f1fb4066ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4066ca0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f1fb40adfd0 tx=0x7f1fac016000).stop 2021-11-15T19:35:10.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 shutdown_connections 2021-11-15T19:35:10.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1f98053610 0x7f1f98055ad0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fb414aaa0 0x7f1fb4066ca0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fb40b0550 0x7f1fb4146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 --2- 172.21.2.137:0/659351949 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fb405c770 0x7f1fb4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 >> 172.21.2.137:0/659351949 conn(0x7f1fb40631e0 msgr2=0x7f1fb41484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:10.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 shutdown_connections 2021-11-15T19:35:10.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.345+0000 7f1fbaa88700 1 -- 172.21.2.137:0/659351949 wait complete. 2021-11-15T19:35:10.363 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-11-15T19:35:10.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 Processor -- start 2021-11-15T19:35:10.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 -- start start 2021-11-15T19:35:10.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9d5c144610 0x7f9d5c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c0a9f50 0x7f9d5c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c148190 con 0x7f9d5c0b1340 2021-11-15T19:35:10.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b1720 con 0x7f9d5c144610 2021-11-15T19:35:10.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d61519700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c147e70 con 0x7f9d5c0a9f50 2021-11-15T19:35:10.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d5a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9d5c144610 0x7f9d5c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:10.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d5affd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9d5c0b1340 0x7f9d5c143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58318/0 (socket says 172.21.2.137:58318) 2021-11-15T19:35:10.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.401+0000 7f9d5affd700 1 -- 172.21.2.137:0/1783969506 learned_addr learned my addr 172.21.2.137:0/1783969506 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:10.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/1783969506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c0a9f50 msgr2=0x7f9d5c0aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:10.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d59ffb700 1 -- 172.21.2.137:0/1783969506 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651871212 0 0) 0x7f9d44001110 con 0x7f9d5c0b1340 2021-11-15T19:35:10.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- 172.21.2.137:0/1783969506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c0a9f50 0x7f9d5c0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/1783969506 >> v1:172.21.2.137:6789/0 conn(0x7f9d5c0b1340 legacy=0x7f9d5c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/1783969506 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0af800 con 0x7f9d5c144610 2021-11-15T19:35:10.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- 172.21.2.137:0/1783969506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c144610 0x7f9d5c147980 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f9d540032f0 tx=0x7f9d540091d0).ready entity=mon.1 client_cookie=e1018164cfb4d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:10.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d59ffb700 1 -- 172.21.2.137:0/1783969506 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54009ea0 con 0x7f9d5c144610 2021-11-15T19:35:10.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d59ffb700 1 -- 172.21.2.137:0/1783969506 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400b8a0 con 0x7f9d5c144610 2021-11-15T19:35:10.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d59ffb700 1 -- 172.21.2.137:0/1783969506 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5400ba10 con 0x7f9d5c144610 2021-11-15T19:35:10.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/1783969506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c144610 msgr2=0x7f9d5c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 --2- 172.21.2.137:0/1783969506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c144610 0x7f9d5c147980 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f9d540032f0 tx=0x7f9d540091d0).stop 2021-11-15T19:35:10.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/1783969506 shutdown_connections 2021-11-15T19:35:10.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 --2- 172.21.2.137:0/1783969506 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c144610 0x7f9d5c147980 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:10.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 --2- 172.21.2.137:0/1783969506 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c0a9f50 0x7f9d5c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/1783969506 >> 172.21.2.137:0/1783969506 conn(0x7f9d5c0b4e60 msgr2=0x7f9d5c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:10.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/1783969506 shutdown_connections 2021-11-15T19:35:10.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/1783969506 wait complete. 2021-11-15T19:35:10.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 Processor -- start 2021-11-15T19:35:10.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- start start 2021-11-15T19:35:10.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d5c0a9f50 0x7f9d5c097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 0x7f9d5c1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c144610 0x7f9d5c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c09a830 con 0x7f9d5c0a9f50 2021-11-15T19:35:10.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1488f0 con 0x7f9d5c0b1340 2021-11-15T19:35:10.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c148b90 con 0x7f9d5c144610 2021-11-15T19:35:10.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 0x7f9d5c1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:10.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 0x7f9d5c1573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39544/0 (socket says 172.21.2.137:39544) 2021-11-15T19:35:10.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/3889503152 learned_addr learned my addr 172.21.2.137:0/3889503152 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:10.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c144610 msgr2=0x7f9d5c1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c144610 0x7f9d5c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d5c0a9f50 msgr2=0x7f9d5c097df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:10.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d5c0a9f50 0x7f9d5c097df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:10.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 -- 172.21.2.137:0/3889503152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009470 con 0x7f9d5c0b1340 2021-11-15T19:35:10.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d5a7fc700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 0x7f9d5c1573a0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f9d540032f0 tx=0x7f9d54016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:10.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54009ea0 con 0x7f9d5c0b1340 2021-11-15T19:35:10.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540107a0 con 0x7f9d5c0b1340 2021-11-15T19:35:10.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c09a0f0 con 0x7f9d5c0b1340 2021-11-15T19:35:10.428 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54010b00 con 0x7f9d5c0b1340 2021-11-15T19:35:10.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0982e0 con 0x7f9d5c0b1340 2021-11-15T19:35:10.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c05faf0 con 0x7f9d5c0b1340 2021-11-15T19:35:10.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d54027020 con 0x7f9d5c0b1340 2021-11-15T19:35:10.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d53fff700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d400536f0 0x7f9d40055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:10.429 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.405+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9d5406cc30 con 0x7f9d5c0b1340 2021-11-15T19:35:10.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.409+0000 7f9d5affd700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d400536f0 0x7f9d40055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:10.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.409+0000 7f9d5affd700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d400536f0 0x7f9d40055bb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9d44000bc0 tx=0x7f9d44007880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:10.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.409+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d54073080 con 0x7f9d5c0b1340 2021-11-15T19:35:10.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:10.521+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f9d5c0573d0 con 0x7f9d5c0b1340 2021-11-15T19:35:11.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.185+0000 7f9d53fff700 1 -- 172.21.2.137:0/3889503152 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v361) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d54015020 con 0x7f9d5c0b1340 2021-11-15T19:35:11.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d400536f0 msgr2=0x7f9d40055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:11.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d400536f0 0x7f9d40055bb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9d44000bc0 tx=0x7f9d44007880).stop 2021-11-15T19:35:11.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 msgr2=0x7f9d5c1573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:11.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 0x7f9d5c1573a0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f9d540032f0 tx=0x7f9d54016000).stop 2021-11-15T19:35:11.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 shutdown_connections 2021-11-15T19:35:11.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9d400536f0 0x7f9d40055bb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:11.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9d5c144610 0x7f9d5c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:11.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9d5c0b1340 0x7f9d5c1573a0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:11.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 --2- 172.21.2.137:0/3889503152 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9d5c0a9f50 0x7f9d5c097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:11.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 >> 172.21.2.137:0/3889503152 conn(0x7f9d5c0b4e60 msgr2=0x7f9d5c0aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:11.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 shutdown_connections 2021-11-15T19:35:11.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.189+0000 7f9d61519700 1 -- 172.21.2.137:0/3889503152 wait complete. 2021-11-15T19:35:11.210 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:35:11.211 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:35:11.211 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-11-15T19:35:11.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 Processor -- start 2021-11-15T19:35:11.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 -- start start 2021-11-15T19:35:11.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6b1c0b1340 0x7f6b1c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:11.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c143f00 0x7f6b1c144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:11.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c148190 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b1720 con 0x7f6b1c0b1340 2021-11-15T19:35:11.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b225fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c147e70 con 0x7f6b1c143f00 2021-11-15T19:35:11.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b1bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6b1c0b1340 0x7f6b1c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:11.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b1bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6b1c0b1340 0x7f6b1c147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39548/0 (socket says 172.21.2.137:39548) 2021-11-15T19:35:11.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.249+0000 7f6b1bfff700 1 -- 172.21.2.137:0/3420001418 learned_addr learned my addr 172.21.2.137:0/3420001418 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:11.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/3420001418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c143f00 msgr2=0x7f6b1c144360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:11.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- 172.21.2.137:0/3420001418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c143f00 0x7f6b1c144360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:11.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/3420001418 >> v1:172.21.2.111:6789/0 conn(0x7f6b1c0a9f50 legacy=0x7f6b1c0aa370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:11.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/3420001418 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0af800 con 0x7f6b1c0b1340 2021-11-15T19:35:11.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- 172.21.2.137:0/3420001418 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0b1340 0x7f6b1c147980 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f6b1c05cfa0 tx=0x7f6b0c006eb0).ready entity=mon.1 client_cookie=79ab6ebd653ac053 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:11.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1affd700 1 -- 172.21.2.137:0/3420001418 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c00d570 con 0x7f6b1c0b1340 2021-11-15T19:35:11.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1affd700 1 -- 172.21.2.137:0/3420001418 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c000e90 con 0x7f6b1c0b1340 2021-11-15T19:35:11.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1affd700 1 -- 172.21.2.137:0/3420001418 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c00d8c0 con 0x7f6b1c0b1340 2021-11-15T19:35:11.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/3420001418 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0b1340 msgr2=0x7f6b1c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:11.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 --2- 172.21.2.137:0/3420001418 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0b1340 0x7f6b1c147980 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f6b1c05cfa0 tx=0x7f6b0c006eb0).stop 2021-11-15T19:35:11.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/3420001418 shutdown_connections 2021-11-15T19:35:11.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 --2- 172.21.2.137:0/3420001418 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c143f00 0x7f6b1c144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:11.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 --2- 172.21.2.137:0/3420001418 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0b1340 0x7f6b1c147980 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:11.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/3420001418 >> 172.21.2.137:0/3420001418 conn(0x7f6b1c0b4e60 msgr2=0x7f6b1c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:11.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/3420001418 shutdown_connections 2021-11-15T19:35:11.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/3420001418 wait complete. 2021-11-15T19:35:11.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 Processor -- start 2021-11-15T19:35:11.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- start start 2021-11-15T19:35:11.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 0x7f6b1c1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:11.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c0b1340 0x7f6b1c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:11.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b1c143f00 0x7f6b1c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:11.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c14a6e0 con 0x7f6b1c143f00 2021-11-15T19:35:11.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c14a480 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c14b330 con 0x7f6b1c0b1340 2021-11-15T19:35:11.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 0x7f6b1c1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:11.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 0x7f6b1c1406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39554/0 (socket says 172.21.2.137:39554) 2021-11-15T19:35:11.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/190147960 learned_addr learned my addr 172.21.2.137:0/190147960 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:11.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c0b1340 msgr2=0x7f6b1c145610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:11.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c0b1340 0x7f6b1c145610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:11.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b1c143f00 msgr2=0x7f6b1c159bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:11.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b1c143f00 0x7f6b1c159bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:11.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 -- 172.21.2.137:0/190147960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c00b1e0 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b1bfff700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 0x7f6b1c1406b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f6b1c05cfa0 tx=0x7f6b0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:11.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c002f70 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c00de20 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c01e460 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c149f90 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c145ca0 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.253+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c05faf0 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.257+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6b0c025030 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.257+0000 7f6b197fa700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b00053660 0x7f6b00055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:11.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.257+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6b0c06ca60 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.257+0000 7f6b1b7fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b00053660 0x7f6b00055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:11.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.257+0000 7f6b1b7fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b00053660 0x7f6b00055b20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f6b04002fb0 tx=0x7f6b04006950).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:11.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.257+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b0c043d90 con 0x7f6b1c0a9f50 2021-11-15T19:35:11.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:11.369+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f6b1c148190 con 0x7f6b1c0a9f50 2021-11-15T19:35:12.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b197fa700 1 -- 172.21.2.137:0/190147960 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v362) v1 ==== 131+0+0 (secure 0 0 0) 0x7f6b1c148190 con 0x7f6b1c0a9f50 2021-11-15T19:35:12.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b00053660 msgr2=0x7f6b00055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b00053660 0x7f6b00055b20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f6b04002fb0 tx=0x7f6b04006950).stop 2021-11-15T19:35:12.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 msgr2=0x7f6b1c1406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 0x7f6b1c1406b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f6b1c05cfa0 tx=0x7f6b0c015000).stop 2021-11-15T19:35:12.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 shutdown_connections 2021-11-15T19:35:12.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b00053660 0x7f6b00055b20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b1c143f00 0x7f6b1c159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b1c0b1340 0x7f6b1c145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 --2- 172.21.2.137:0/190147960 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b1c0a9f50 0x7f6b1c1406b0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 >> 172.21.2.137:0/190147960 conn(0x7f6b1c0b4e60 msgr2=0x7f6b1c143230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:12.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 shutdown_connections 2021-11-15T19:35:12.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.197+0000 7f6b225fe700 1 -- 172.21.2.137:0/190147960 wait complete. 2021-11-15T19:35:12.215 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:35:12.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 Processor -- start 2021-11-15T19:35:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 -- start start 2021-11-15T19:35:12.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f856005c770 0x7f85600aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8560140aa0 0x7f8560140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856005cb50 con 0x7f85600b0550 2021-11-15T19:35:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600b1650 con 0x7f856005c770 2021-11-15T19:35:12.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f85670c4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600ad030 con 0x7f8560140aa0 2021-11-15T19:35:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8560140aa0 0x7f8560140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8560140aa0 0x7f8560140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39566/0 (socket says 172.21.2.137:39566) 2021-11-15T19:35:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 -- 172.21.2.137:0/1473745491 learned_addr learned my addr 172.21.2.137:0/1473745491 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 -- 172.21.2.137:0/1473745491 >> v2:172.21.2.111:3300/0 conn(0x7f856005c770 msgr2=0x7f85600aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:12.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 --2- 172.21.2.137:0/1473745491 >> v2:172.21.2.111:3300/0 conn(0x7f856005c770 0x7f85600aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 -- 172.21.2.137:0/1473745491 >> v1:172.21.2.111:6789/0 conn(0x7f85600b0550 legacy=0x7f856014a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 -- 172.21.2.137:0/1473745491 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600ad2d0 con 0x7f8560140aa0 2021-11-15T19:35:12.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f8565661700 1 --2- 172.21.2.137:0/1473745491 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560140ef0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f85600aee10 tx=0x7f8558009290).ready entity=mon.1 client_cookie=65bc6029cdaab918 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f855f7fe700 1 -- 172.21.2.137:0/1473745491 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855800b830 con 0x7f8560140aa0 2021-11-15T19:35:12.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f855f7fe700 1 -- 172.21.2.137:0/1473745491 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800b990 con 0x7f8560140aa0 2021-11-15T19:35:12.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.257+0000 7f855f7fe700 1 -- 172.21.2.137:0/1473745491 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855800bb40 con 0x7f8560140aa0 2021-11-15T19:35:12.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/1473745491 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 msgr2=0x7f8560140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 --2- 172.21.2.137:0/1473745491 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560140ef0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f85600aee10 tx=0x7f8558009290).stop 2021-11-15T19:35:12.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/1473745491 shutdown_connections 2021-11-15T19:35:12.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 --2- 172.21.2.137:0/1473745491 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560140ef0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 --2- 172.21.2.137:0/1473745491 >> v2:172.21.2.111:3300/0 conn(0x7f856005c770 0x7f85600aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/1473745491 >> 172.21.2.137:0/1473745491 conn(0x7f85600631e0 msgr2=0x7f856005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:12.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/1473745491 shutdown_connections 2021-11-15T19:35:12.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/1473745491 wait complete. 2021-11-15T19:35:12.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 Processor -- start 2021-11-15T19:35:12.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- start start 2021-11-15T19:35:12.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f856005c770 0x7f8560144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85600b0550 0x7f8560145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8560157000 con 0x7f856005c770 2021-11-15T19:35:12.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85601572a0 con 0x7f8560140aa0 2021-11-15T19:35:12.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8560066520 con 0x7f85600b0550 2021-11-15T19:35:12.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39572/0 (socket says 172.21.2.137:39572) 2021-11-15T19:35:12.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 -- 172.21.2.137:0/9619060 learned_addr learned my addr 172.21.2.137:0/9619060 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:12.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 -- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85600b0550 msgr2=0x7f8560145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85600b0550 0x7f8560145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 -- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f856005c770 msgr2=0x7f8560144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f856005c770 0x7f8560144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 -- 172.21.2.137:0/9619060 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558009530 con 0x7f8560140aa0 2021-11-15T19:35:12.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8565661700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560142c10 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f85600aee10 tx=0x7f8558016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855800b830 con 0x7f8560140aa0 2021-11-15T19:35:12.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85580107a0 con 0x7f8560140aa0 2021-11-15T19:35:12.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85601416f0 con 0x7f8560140aa0 2021-11-15T19:35:12.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8558010b00 con 0x7f8560140aa0 2021-11-15T19:35:12.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8560143100 con 0x7f8560140aa0 2021-11-15T19:35:12.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8560143690 con 0x7f8560140aa0 2021-11-15T19:35:12.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f855800f070 con 0x7f8560140aa0 2021-11-15T19:35:12.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f855dffb700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8544053640 0x7f8544055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f855806ce30 con 0x7f8560140aa0 2021-11-15T19:35:12.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.261+0000 7f8564e60700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8544053640 0x7f8544055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.265+0000 7f8564e60700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8544053640 0x7f8544055b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8548002fb0 tx=0x7f85480069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.265+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85580442f0 con 0x7f8560140aa0 2021-11-15T19:35:12.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.345+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8560156e30 con 0x7f8560140aa0 2021-11-15T19:35:12.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.357+0000 7f855dffb700 1 -- 172.21.2.137:0/9619060 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8558015070 con 0x7f8560140aa0 2021-11-15T19:35:12.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8544053640 msgr2=0x7f8544055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8544053640 0x7f8544055b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8548002fb0 tx=0x7f85480069b0).stop 2021-11-15T19:35:12.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 msgr2=0x7f8560142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560142c10 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f85600aee10 tx=0x7f8558016000).stop 2021-11-15T19:35:12.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 shutdown_connections 2021-11-15T19:35:12.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8544053640 0x7f8544055b00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8560140aa0 0x7f8560142c10 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f85600b0550 0x7f8560145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 --2- 172.21.2.137:0/9619060 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f856005c770 0x7f8560144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 >> 172.21.2.137:0/9619060 conn(0x7f85600631e0 msgr2=0x7f856013de40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:12.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 shutdown_connections 2021-11-15T19:35:12.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.361+0000 7f85670c4700 1 -- 172.21.2.137:0/9619060 wait complete. 2021-11-15T19:35:12.378 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:35:12.378 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:12.385 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:12.399 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:12.412 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:12.425 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:12.435 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:35:12.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:12.436 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:12.436 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:12.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:12.471 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:35:12.471 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:12.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:12.472 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:12.472 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:12.481 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:35:12.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:12.483 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:12.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:12.484 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:12.484 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:12.492 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:12.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:12.493 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:35:12.494 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:35:12.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe92d33e700 1 Processor -- start 2021-11-15T19:35:12.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe92d33e700 1 -- start start 2021-11-15T19:35:12.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe92d33e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe928147980 0x7fe9280aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe92d33e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe928148190 con 0x7fe928144610 2021-11-15T19:35:12.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe92d33e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280b1720 con 0x7fe9280b1340 2021-11-15T19:35:12.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe92d33e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280af800 con 0x7fe928147980 2021-11-15T19:35:12.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe926ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe9280b1340 0x7fe928143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58358/0 (socket says 172.21.2.137:58358) 2021-11-15T19:35:12.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe926ffd700 1 -- 172.21.2.137:0/4171523407 learned_addr learned my addr 172.21.2.137:0/4171523407 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:12.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337694646 0 0) 0x7fe9280b1720 con 0x7fe9280b1340 2021-11-15T19:35:12.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.537+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe908003260 con 0x7fe9280b1340 2021-11-15T19:35:12.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292164841 0 0) 0x7fe908003260 con 0x7fe9280b1340 2021-11-15T19:35:12.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 >> v2:172.21.2.111:3300/0 conn(0x7fe928147980 msgr2=0x7fe9280aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:12.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 --2- 172.21.2.137:0/4171523407 >> v2:172.21.2.111:3300/0 conn(0x7fe928147980 0x7fe9280aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 >> v1:172.21.2.111:6789/0 conn(0x7fe928144610 legacy=0x7fe9280a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:12.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92805faf0 con 0x7fe9280b1340 2021-11-15T19:35:12.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe910001660 con 0x7fe9280b1340 2021-11-15T19:35:12.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 >> v1:172.21.2.137:6789/0 conn(0x7fe9280b1340 legacy=0x7fe928143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe908003820 0x7fe908003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908004500 0x7fe908004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe908005050 0x7fe90800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280af800 con 0x7fe908003820 2021-11-15T19:35:12.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90800bfe0 con 0x7fe908005050 2021-11-15T19:35:12.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90800c1a0 con 0x7fe908004500 2021-11-15T19:35:12.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe908005050 0x7fe90800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/4171523407 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908004500 msgr2=0x7fe908004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:12.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908004500 0x7fe908004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/4171523407 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe908003820 msgr2=0x7fe908003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:12.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe908003820 0x7fe908003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/4171523407 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908003260 con 0x7fe908005050 2021-11-15T19:35:12.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/4171523407 reap_dead start 2021-11-15T19:35:12.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe908005050 0x7fe90800b750 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fe9180032f0 tx=0x7fe918006f90).ready entity=mon.1 client_cookie=b89af952aa64558b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91800b460 con 0x7fe908005050 2021-11-15T19:35:12.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91800b5c0 con 0x7fe908005050 2021-11-15T19:35:12.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe925ffb700 1 -- 172.21.2.137:0/4171523407 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91800b730 con 0x7fe908005050 2021-11-15T19:35:12.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/4171523407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe908005050 msgr2=0x7fe90800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe908005050 0x7fe90800b750 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fe9180032f0 tx=0x7fe918006f90).stop 2021-11-15T19:35:12.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/4171523407 shutdown_connections 2021-11-15T19:35:12.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 --2- 172.21.2.137:0/4171523407 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe908005050 0x7fe90800b750 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/4171523407 >> 172.21.2.137:0/4171523407 conn(0x7fe9280b4e60 msgr2=0x7fe9280b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:12.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/4171523407 shutdown_connections 2021-11-15T19:35:12.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/4171523407 wait complete. 2021-11-15T19:35:12.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 Processor -- start 2021-11-15T19:35:12.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- start start 2021-11-15T19:35:12.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908005050 0x7fe92814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe9280aee70 0x7fe928156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 0x7fe928159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280af2d0 con 0x7fe9280aee70 2021-11-15T19:35:12.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe928098170 con 0x7fe928156d20 2021-11-15T19:35:12.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe928098410 con 0x7fe908005050 2021-11-15T19:35:12.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 0x7fe928159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 0x7fe928159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39590/0 (socket says 172.21.2.137:39590) 2021-11-15T19:35:12.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/1457495396 learned_addr learned my addr 172.21.2.137:0/1457495396 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:12.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908005050 msgr2=0x7fe92814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908005050 0x7fe92814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe9280aee70 msgr2=0x7fe928156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe9280aee70 0x7fe928156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 -- 172.21.2.137:0/1457495396 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280986b0 con 0x7fe928156d20 2021-11-15T19:35:12.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe9277fe700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 0x7fe928159af0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fe92809b020 tx=0x7fe918016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe918009370 con 0x7fe928156d20 2021-11-15T19:35:12.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918011a90 con 0x7fe928156d20 2021-11-15T19:35:12.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280add00 con 0x7fe928156d20 2021-11-15T19:35:12.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe918011df0 con 0x7fe928156d20 2021-11-15T19:35:12.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.541+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281571a0 con 0x7fe928156d20 2021-11-15T19:35:12.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9281598c0 con 0x7fe928156d20 2021-11-15T19:35:12.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe918027070 con 0x7fe928156d20 2021-11-15T19:35:12.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe91ffff700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe90c0534f0 0x7fe90c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe91806c0b0 con 0x7fe928156d20 2021-11-15T19:35:12.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe926ffd700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe90c0534f0 0x7fe90c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe926ffd700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe90c0534f0 0x7fe90c0559b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fe928062250 tx=0x7fe92805f9e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.571 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.545+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9180433e0 con 0x7fe928156d20 2021-11-15T19:35:12.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.625+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe92805fd90 con 0x7fe928156d20 2021-11-15T19:35:12.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe91ffff700 1 -- 172.21.2.137:0/1457495396 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v126) v1 ==== 81+0+28837 (secure 0 0 0) 0x7fe918015030 con 0x7fe928156d20 2021-11-15T19:35:12.640 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:12.640 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:12.641 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 126, 2021-11-15T19:35:12.641 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:35:12.641 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:35:12.641 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:35:10.175774+0000", 2021-11-15T19:35:12.642 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:12.642 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:12.642 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:35:12.643 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:35:12.643 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:35:12.643 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:35:12.643 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:35:12.644 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:35:12.644 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:35:12.644 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:12.644 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:35:12.645 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:35:12.645 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:35:12.645 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:35:12.645 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:35:12.645 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 24, 2021-11-15T19:35:12.646 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:35:12.646 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:35:12.646 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:35:12.646 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:35:12.647 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:35:12.647 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.647 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:35:12.647 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:35:12.648 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:35:12.648 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:12.648 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:12.648 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:12.648 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:12.649 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:12.649 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:12.649 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:12.649 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:12.650 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:35:12.650 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:35:12.650 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:35:12.650 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:35:12.650 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:35:12.651 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:12.651 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:12.651 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:12.651 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:12.652 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:12.652 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:12.652 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:12.652 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.652 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:35:12.653 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:12.653 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:12.653 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:12.653 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:12.654 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:12.654 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:12.654 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:12.655 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:12.655 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:12.655 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:12.655 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:12.656 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:12.656 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:12.656 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:12.657 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:12.657 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:12.657 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:12.657 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:12.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:12.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:12.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:12.658 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:12.659 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:12.659 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:12.659 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:12.659 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:12.660 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.660 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:12.660 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:12.660 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:12.661 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:12.661 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:12.661 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:12.661 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:12.661 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:12.662 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:12.662 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:12.662 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:12.662 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:12.663 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:35:12.663 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.663 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:12.663 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:35:12.663 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.664 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.664 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.664 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:35:12.664 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:35:12.665 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:35:12.665 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:12.665 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:12.665 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:12.665 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:12.666 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:12.666 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:12.666 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:12.666 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:12.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:12.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:12.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:12.667 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:12.668 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:12.668 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:12.668 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:12.668 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:12.668 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:12.669 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:12.669 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:12.669 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:12.669 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:35:12.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:12.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:12.670 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:12.670 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:12.671 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:12.671 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:12.671 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:12.671 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:12.672 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:12.672 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:12.672 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:12.672 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:12.672 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:12.673 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:12.674 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:12.675 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:12.676 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:12.677 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:12.678 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:12.678 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:12.678 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:12.679 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:12.679 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:12.679 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:35:12.679 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.679 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.680 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:12.680 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:35:12.680 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.680 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:12.681 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:35:12.681 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.681 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.681 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.681 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.682 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.682 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.682 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.682 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:12.683 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.683 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.683 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.683 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.683 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.684 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.684 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:35:12.684 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.684 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.685 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:35:12.685 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.685 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.686 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.686 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.686 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.687 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.687 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.687 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:35:12.687 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.687 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.688 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.688 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:35:12.688 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.689 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.689 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.689 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.689 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.689 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.690 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.690 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.690 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:35:12.690 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.691 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.691 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.691 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.691 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:35:12.692 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.692 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.692 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.692 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.692 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.693 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.693 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:35:12.693 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.694 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.694 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.694 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.694 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:35:12.695 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:12.695 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.695 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.695 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.695 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:35:12.696 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:35:12.696 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:35:12.696 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:35:12.696 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.697 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.697 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.697 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.697 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.698 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.698 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:12.698 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:35:12.699 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.699 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.699 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.699 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.699 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.700 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.700 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.700 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:12.700 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.701 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.701 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.702 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:35:12.702 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.702 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.703 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.703 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:35:12.703 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.703 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.704 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.704 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.704 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.704 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.705 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.705 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:35:12.705 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.705 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.706 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.706 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.706 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:35:12.706 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.706 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.707 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.707 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.707 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.707 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.708 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.708 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.708 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:35:12.708 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.709 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.709 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.709 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.709 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:35:12.709 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.710 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.710 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.710 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.710 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.711 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:35:12.712 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.712 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.712 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.713 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:35:12.713 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:12.713 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.713 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.713 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.714 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:35:12.714 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:35:12.714 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:35:12.715 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:35:12.715 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.715 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.715 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.715 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.716 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.716 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.716 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:12.716 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:35:12.717 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.717 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.717 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.717 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.718 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.718 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.718 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.718 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 116, 2021-11-15T19:35:12.718 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.719 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.719 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.719 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.719 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.720 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.720 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:35:12.720 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.721 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.721 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:35:12.721 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.721 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.722 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.722 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.722 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.722 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.722 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.723 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.723 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:35:12.723 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.723 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.724 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.724 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.724 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:35:12.724 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.725 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.725 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.725 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.725 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.725 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.726 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.726 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.726 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:35:12.726 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.727 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.727 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.727 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.728 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:35:12.728 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.728 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.728 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.729 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.729 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.729 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.730 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.730 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.730 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:35:12.731 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.731 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.731 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.731 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.732 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:35:12.732 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:12.732 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.733 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.733 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.733 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:35:12.734 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:35:12.734 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:35:12.734 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:35:12.734 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.735 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.735 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.735 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.736 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.736 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.736 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:12.736 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:35:12.737 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.737 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.737 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.737 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.738 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.738 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.738 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.739 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:12.739 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.739 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.739 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.739 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.740 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.740 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.740 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:35:12.740 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.741 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.741 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.741 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.741 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:35:12.741 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.742 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.742 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.742 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.742 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.743 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.743 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.743 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.743 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:35:12.743 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.744 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.744 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.744 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.744 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:35:12.745 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.745 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.745 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.745 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.746 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.746 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.746 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.746 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.746 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:35:12.747 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.747 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.747 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.747 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.748 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:35:12.748 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.748 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.748 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.748 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.749 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.749 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.749 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.749 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.750 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:35:12.750 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.750 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.750 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.750 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.751 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:35:12.751 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:12.751 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.751 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.752 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.752 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:35:12.752 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:35:12.752 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:35:12.752 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:35:12.753 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.753 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.753 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.753 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.753 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.754 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.754 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:12.754 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:35:12.754 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.755 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.755 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.755 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.755 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.756 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.756 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.756 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 116, 2021-11-15T19:35:12.756 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.756 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.756 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.757 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.757 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:35:12.758 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.758 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.758 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.758 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.758 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:35:12.759 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.759 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.759 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.759 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.760 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.760 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.760 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.760 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.760 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:35:12.761 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.761 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.761 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.761 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.762 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:35:12.762 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.762 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.762 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.762 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.763 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.763 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.763 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.763 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.764 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:35:12.764 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.764 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.764 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.764 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.765 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:35:12.765 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.765 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.765 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.765 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.766 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.766 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.766 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.766 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.767 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:35:12.767 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.767 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.767 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.767 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.768 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:35:12.768 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:12.768 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.768 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.768 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.769 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:35:12.769 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:35:12.769 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:35:12.769 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:35:12.770 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.770 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.770 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.770 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.771 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.771 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.771 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:12.771 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:35:12.771 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.772 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.772 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.772 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.772 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.773 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.773 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.773 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:12.773 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.773 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.774 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.774 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.774 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.774 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.775 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:35:12.775 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.775 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.775 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.775 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.776 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:35:12.776 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.776 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.776 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.777 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.777 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.777 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.777 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.777 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.778 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:35:12.778 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.778 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.778 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.779 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.779 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:35:12.779 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.779 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.779 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.780 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.780 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.780 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.780 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.781 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:35:12.781 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.781 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.781 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.782 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.782 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:35:12.782 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.782 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.783 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.783 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.783 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.783 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.784 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.784 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.784 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:35:12.784 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.784 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.785 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.785 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.785 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:35:12.785 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:12.785 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.786 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.786 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.786 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:35:12.786 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:35:12.786 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:35:12.787 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:35:12.787 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.787 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.787 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.787 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.788 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.788 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.788 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:12.788 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:35:12.789 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.789 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.789 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.789 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.789 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.790 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.790 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.790 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:12.790 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.790 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.791 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.791 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.791 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:35:12.792 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.792 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.792 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.792 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.793 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:35:12.793 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.793 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.793 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.794 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.794 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.794 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.794 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.794 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.795 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:35:12.795 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.795 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.795 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.796 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.796 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:35:12.796 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.796 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.796 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.797 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.797 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.797 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.797 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.798 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.798 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:35:12.798 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.798 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.798 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.799 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.799 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:35:12.799 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.799 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.800 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.800 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.800 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.800 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.801 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.801 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:35:12.801 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.801 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.801 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.802 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.802 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:35:12.802 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:12.802 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.803 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.803 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.803 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:35:12.803 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:35:12.803 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:35:12.804 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:35:12.804 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.804 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.804 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.805 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.805 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.805 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.805 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:12.805 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:35:12.806 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:12.806 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:12.806 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:12.806 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:12.807 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:12.807 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:12.807 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:12.807 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 122, 2021-11-15T19:35:12.808 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:12.808 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:12.808 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:12.808 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.808 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.809 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.809 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:35:12.809 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.809 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.810 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.810 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.810 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:35:12.810 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.810 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.811 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.811 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.811 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:12.811 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.812 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.812 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.812 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:35:12.812 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.812 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.813 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.813 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.813 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:35:12.813 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.814 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.814 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.814 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.814 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:12.814 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.815 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.815 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.815 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:35:12.815 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.816 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.816 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.816 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:35:12.817 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.817 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.817 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.817 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.817 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:12.818 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:12.818 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.818 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:12.818 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:35:12.819 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.819 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.819 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.819 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:12.820 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:35:12.820 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:12.820 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.820 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.820 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.821 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:35:12.821 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:35:12.821 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:35:12.821 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:35:12.822 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:12.822 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:12.822 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:12.822 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:12.822 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.823 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:12.823 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:35:12.823 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.823 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:12.824 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.824 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.824 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.824 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.824 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.825 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:35:12.825 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.825 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.825 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.826 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:12.826 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.826 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.826 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.826 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.827 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.827 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:35:12.827 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.827 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.828 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.828 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:12.828 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.828 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.828 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.829 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.829 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.829 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:35:12.829 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.830 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.830 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.830 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:12.830 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.830 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.831 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.831 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.831 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.831 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:35:12.831 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.832 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.832 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.832 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:12.832 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.833 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.833 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.833 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.833 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.834 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:35:12.834 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.834 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.834 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.834 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:12.835 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.835 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.835 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.835 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.835 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.836 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:35:12.836 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.836 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.836 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.837 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:12.837 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.837 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.837 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.838 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.838 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.838 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:35:12.838 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.838 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.839 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:12.839 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:12.839 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:12.839 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:12.840 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:12.840 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:12.840 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:12.840 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:35:12.840 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:12.841 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.841 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:12.841 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:35:12.841 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:35:12.842 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:35:12.842 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:35:12.842 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:35:12.842 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/3862600413": "2021-11-16T19:34:51.672104+0000", 2021-11-15T19:35:12.842 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/3862600413": "2021-11-16T19:34:51.672104+0000" 2021-11-15T19:35:12.843 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.843 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:35:12.843 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:35:12.843 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:35:12.844 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:35:12.844 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:35:12.844 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:35:12.844 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:35:12.844 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:35:12.845 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:12.845 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:12.845 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:35:12.845 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:35:12.846 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:35:12.846 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:35:12.846 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:35:12.846 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:12.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe90c0534f0 msgr2=0x7fe90c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe90c0534f0 0x7fe90c0559b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fe928062250 tx=0x7fe92805f9e0).stop 2021-11-15T19:35:12.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 msgr2=0x7fe928159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 0x7fe928159af0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fe92809b020 tx=0x7fe918016000).stop 2021-11-15T19:35:12.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 shutdown_connections 2021-11-15T19:35:12.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe90c0534f0 0x7fe90c0559b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe928156d20 0x7fe928159af0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe9280aee70 0x7fe928156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 --2- 172.21.2.137:0/1457495396 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe908005050 0x7fe92814a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 >> 172.21.2.137:0/1457495396 conn(0x7fe9280b4e60 msgr2=0x7fe9280b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:12.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 shutdown_connections 2021-11-15T19:35:12.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.629+0000 7fe92d33e700 1 -- 172.21.2.137:0/1457495396 wait complete. 2021-11-15T19:35:12.851 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 Processor -- start 2021-11-15T19:35:12.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- start start 2021-11-15T19:35:12.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f14780b1340 0x7f1478147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1478143f00 0x7f1478144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1478148190 con 0x7f14780a9f50 2021-11-15T19:35:12.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14780b1720 con 0x7f14780b1340 2021-11-15T19:35:12.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1478147e70 con 0x7f1478143f00 2021-11-15T19:35:12.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1478143f00 0x7f1478144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1478143f00 0x7f1478144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39596/0 (socket says 172.21.2.137:39596) 2021-11-15T19:35:12.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 -- 172.21.2.137:0/2491045513 learned_addr learned my addr 172.21.2.137:0/2491045513 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:12.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1476d9d700 1 --1- 172.21.2.137:0/2491045513 >> v1:172.21.2.137:6789/0 conn(0x7f14780a9f50 0x7f14780aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58378/0 (socket says 172.21.2.137:58378) 2021-11-15T19:35:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 -- 172.21.2.137:0/2491045513 >> v2:172.21.2.111:3300/0 conn(0x7f14780b1340 msgr2=0x7f1478147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 --2- 172.21.2.137:0/2491045513 >> v2:172.21.2.111:3300/0 conn(0x7f14780b1340 0x7f1478147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 -- 172.21.2.137:0/2491045513 >> v1:172.21.2.137:6789/0 conn(0x7f14780a9f50 legacy=0x7f14780aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 -- 172.21.2.137:0/2491045513 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780af800 con 0x7f1478143f00 2021-11-15T19:35:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f1475d9b700 1 --2- 172.21.2.137:0/2491045513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f1478144390 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f146c002f70 tx=0x7f146c006eb0).ready entity=mon.1 client_cookie=8051d5b07803240a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147559a700 1 -- 172.21.2.137:0/2491045513 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146c00d610 con 0x7f1478143f00 2021-11-15T19:35:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147559a700 1 -- 172.21.2.137:0/2491045513 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c000e90 con 0x7f1478143f00 2021-11-15T19:35:12.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147559a700 1 -- 172.21.2.137:0/2491045513 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146c00d9a0 con 0x7f1478143f00 2021-11-15T19:35:12.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- 172.21.2.137:0/2491045513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 msgr2=0x7f1478144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- 172.21.2.137:0/2491045513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f1478144390 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f146c002f70 tx=0x7f146c006eb0).stop 2021-11-15T19:35:12.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- 172.21.2.137:0/2491045513 shutdown_connections 2021-11-15T19:35:12.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- 172.21.2.137:0/2491045513 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f1478144390 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:12.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- 172.21.2.137:0/2491045513 >> v2:172.21.2.111:3300/0 conn(0x7f14780b1340 0x7f1478147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- 172.21.2.137:0/2491045513 >> 172.21.2.137:0/2491045513 conn(0x7f14780b4e60 msgr2=0x7f14780b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:12.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- 172.21.2.137:0/2491045513 shutdown_connections 2021-11-15T19:35:12.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- 172.21.2.137:0/2491045513 wait complete. 2021-11-15T19:35:12.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 Processor -- start 2021-11-15T19:35:12.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 -- start start 2021-11-15T19:35:12.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14780a9f50 0x7f1478098740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14780b1340 0x7f14780b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.897+0000 7f147cc0c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f147813db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147cc0c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1478098350 con 0x7f14780b1340 2021-11-15T19:35:12.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147cc0c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147814a020 con 0x7f1478143f00 2021-11-15T19:35:12.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147cc0c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147814a2c0 con 0x7f14780a9f50 2021-11-15T19:35:12.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f147813db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f147813db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39606/0 (socket says 172.21.2.137:39606) 2021-11-15T19:35:12.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 -- 172.21.2.137:0/4025205393 learned_addr learned my addr 172.21.2.137:0/4025205393 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:12.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 -- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14780a9f50 msgr2=0x7f1478098740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14780a9f50 0x7f1478098740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 -- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14780b1340 msgr2=0x7f14780b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:12.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14780b1340 0x7f14780b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:12.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 -- 172.21.2.137:0/4025205393 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c00b1e0 con 0x7f1478143f00 2021-11-15T19:35:12.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f1476d9d700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f147813db10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f1478062250 tx=0x7f1470007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1470005ae0 con 0x7f1478143f00 2021-11-15T19:35:12.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470005c40 con 0x7f1478143f00 2021-11-15T19:35:12.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14700070d0 con 0x7f1478143f00 2021-11-15T19:35:12.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147814a560 con 0x7f1478143f00 2021-11-15T19:35:12.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147813e000 con 0x7f1478143f00 2021-11-15T19:35:12.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147814a6f0 con 0x7f1478143f00 2021-11-15T19:35:12.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1470010070 con 0x7f1478143f00 2021-11-15T19:35:12.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f14677fe700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14540536a0 0x7f1454055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:12.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f147006ae90 con 0x7f1478143f00 2021-11-15T19:35:12.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.901+0000 7f147659c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14540536a0 0x7f1454055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:12.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.905+0000 7f147659c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14540536a0 0x7f1454055b60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1468002f70 tx=0x7f14680069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:12.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:12.905+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14700421c0 con 0x7f1478143f00 2021-11-15T19:35:13.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.009+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1478148190 con 0x7f1478143f00 2021-11-15T19:35:13.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.009+0000 7f14677fe700 1 -- 172.21.2.137:0/4025205393 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+504 (secure 0 0 0) 0x7f1478148190 con 0x7f1478143f00 2021-11-15T19:35:13.023 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:13.023 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-11-15T19:35:13.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14540536a0 msgr2=0x7f1454055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14540536a0 0x7f1454055b60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1468002f70 tx=0x7f14680069e0).stop 2021-11-15T19:35:13.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 msgr2=0x7f147813db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f147813db10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f1478062250 tx=0x7f1470007f60).stop 2021-11-15T19:35:13.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 shutdown_connections 2021-11-15T19:35:13.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14540536a0 0x7f1454055b60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1478143f00 0x7f147813db10 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f14780b1340 0x7f14780b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:13.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 --2- 172.21.2.137:0/4025205393 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f14780a9f50 0x7f1478098740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:13.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 >> 172.21.2.137:0/4025205393 conn(0x7f14780b4e60 msgr2=0x7f14780b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:13.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 shutdown_connections 2021-11-15T19:35:13.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.013+0000 7f147cc0c700 1 -- 172.21.2.137:0/4025205393 wait complete. 2021-11-15T19:35:13.027 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 64 2021-11-15T19:35:13.029 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:13.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 Processor -- start 2021-11-15T19:35:13.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 -- start start 2021-11-15T19:35:13.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fefa805fb80 0x7fefa809a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa80b1130 0x7fefa8143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa8141bc0 con 0x7fefa809ab80 2021-11-15T19:35:13.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa8097ff0 con 0x7fefa805fb80 2021-11-15T19:35:13.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefafc28700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809a1f0 con 0x7fefa80b1130 2021-11-15T19:35:13.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad9c4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fefa805fb80 0x7fefa809a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad1c3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa80b1130 0x7fefa8143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefae1c5700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fefa809ab80 0x7fefa8144440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:50888/0 (socket says 172.21.2.137:50888) 2021-11-15T19:35:13.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefae1c5700 1 -- 172.21.2.137:0/2195003948 learned_addr learned my addr 172.21.2.137:0/2195003948 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:13.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad1c3700 1 -- 172.21.2.137:0/2195003948 >> v2:172.21.2.111:3300/0 conn(0x7fefa805fb80 msgr2=0x7fefa809a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:13.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad1c3700 1 --2- 172.21.2.137:0/2195003948 >> v2:172.21.2.111:3300/0 conn(0x7fefa805fb80 0x7fefa809a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad1c3700 1 -- 172.21.2.137:0/2195003948 >> v1:172.21.2.111:6789/0 conn(0x7fefa809ab80 legacy=0x7fefa8144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad1c3700 1 -- 172.21.2.137:0/2195003948 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80b1660 con 0x7fefa80b1130 2021-11-15T19:35:13.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefad1c3700 1 --2- 172.21.2.137:0/2195003948 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa80b1130 0x7fefa8143f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fef9c002f70 tx=0x7fef9c006df0).ready entity=mon.2 client_cookie=f926d3ef63b0a36f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:13.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefac9c2700 1 -- 172.21.2.137:0/2195003948 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef9c00d570 con 0x7fefa80b1130 2021-11-15T19:35:13.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefac9c2700 1 -- 172.21.2.137:0/2195003948 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c000e90 con 0x7fefa80b1130 2021-11-15T19:35:13.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.069+0000 7fefac9c2700 1 -- 172.21.2.137:0/2195003948 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef9c00d8c0 con 0x7fefa80b1130 2021-11-15T19:35:13.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/2195003948 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa80b1130 msgr2=0x7fefa8143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 --2- 172.21.2.137:0/2195003948 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa80b1130 0x7fefa8143f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fef9c002f70 tx=0x7fef9c006df0).stop 2021-11-15T19:35:13.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/2195003948 shutdown_connections 2021-11-15T19:35:13.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 --2- 172.21.2.137:0/2195003948 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa80b1130 0x7fefa8143f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 --2- 172.21.2.137:0/2195003948 >> v2:172.21.2.111:3300/0 conn(0x7fefa805fb80 0x7fefa809a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/2195003948 >> 172.21.2.137:0/2195003948 conn(0x7fefa80b4e60 msgr2=0x7fefa80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:13.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/2195003948 shutdown_connections 2021-11-15T19:35:13.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/2195003948 wait complete. 2021-11-15T19:35:13.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 Processor -- start 2021-11-15T19:35:13.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- start start 2021-11-15T19:35:13.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa805fb80 0x7fefa814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefa809ab80 0x7fefa8063ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 0x7fefa814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8063160 con 0x7fefa809ab80 2021-11-15T19:35:13.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8062c20 con 0x7fefa80b1130 2021-11-15T19:35:13.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8062ec0 con 0x7fefa805fb80 2021-11-15T19:35:13.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 0x7fefa814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 0x7fefa814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39618/0 (socket says 172.21.2.137:39618) 2021-11-15T19:35:13.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 -- 172.21.2.137:0/3978204231 learned_addr learned my addr 172.21.2.137:0/3978204231 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:13.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefad1c3700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefa809ab80 0x7fefa8063ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefad9c4700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa805fb80 0x7fefa814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 -- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa805fb80 msgr2=0x7fefa814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa805fb80 0x7fefa814daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 -- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefa809ab80 msgr2=0x7fefa8063ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefa809ab80 0x7fefa8063ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 -- 172.21.2.137:0/3978204231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c00b180 con 0x7fefa80b1130 2021-11-15T19:35:13.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefae1c5700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 0x7fefa814e220 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fefa80b2bd0 tx=0x7fefa0007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:13.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefa0005ba0 con 0x7fefa80b1130 2021-11-15T19:35:13.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0005d00 con 0x7fefa80b1130 2021-11-15T19:35:13.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa8064f80 con 0x7fefa80b1130 2021-11-15T19:35:13.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa80635d0 con 0x7fefa80b1130 2021-11-15T19:35:13.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefa00072c0 con 0x7fefa80b1130 2021-11-15T19:35:13.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.073+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa80573d0 con 0x7fefa80b1130 2021-11-15T19:35:13.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.077+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fefa0010070 con 0x7fefa80b1130 2021-11-15T19:35:13.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.077+0000 7fef9affd700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef88053660 0x7fef88055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.077+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fefa006ae00 con 0x7fefa80b1130 2021-11-15T19:35:13.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.077+0000 7fefad9c4700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef88053660 0x7fef88055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.077+0000 7fefad9c4700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef88053660 0x7fef88055b20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fefa400b000 tx=0x7fefa4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:13.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.077+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fefa0042240 con 0x7fefa80b1130 2021-11-15T19:35:13.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefa80635d0 con 0x7fefa80b1130 2021-11-15T19:35:13.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fef9affd700 1 -- 172.21.2.137:0/3978204231 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+504 (secure 0 0 0) 0x7fefa80635d0 con 0x7fefa80b1130 2021-11-15T19:35:13.197 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:13.197 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-11-15T19:35:13.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef88053660 msgr2=0x7fef88055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef88053660 0x7fef88055b20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fefa400b000 tx=0x7fefa4008040).stop 2021-11-15T19:35:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 msgr2=0x7fefa814e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 0x7fefa814e220 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fefa80b2bd0 tx=0x7fefa0007f00).stop 2021-11-15T19:35:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 shutdown_connections 2021-11-15T19:35:13.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fef88053660 0x7fef88055b20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fefa80b1130 0x7fefa814e220 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fefa809ab80 0x7fefa8063ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 --2- 172.21.2.137:0/3978204231 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fefa805fb80 0x7fefa814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 >> 172.21.2.137:0/3978204231 conn(0x7fefa80b4e60 msgr2=0x7fefa80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 shutdown_connections 2021-11-15T19:35:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.185+0000 7fefafc28700 1 -- 172.21.2.137:0/3978204231 wait complete. 2021-11-15T19:35:13.201 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 64 2021-11-15T19:35:13.204 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:35:13.204 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:35:13.205 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:35:13.205 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:35:13.208 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:35:13.208 DEBUG:teuthology.parallel:result is None 2021-11-15T19:35:13.209 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:35:13.209 DEBUG:teuthology.parallel:result is None 2021-11-15T19:35:13.210 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:35:13.243 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:35:13.245 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:35:13.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 Processor -- start 2021-11-15T19:35:13.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- start start 2021-11-15T19:35:13.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5cfc064180 0x7f5cfc140410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc0b6670 con 0x7f5cfc0b2240 2021-11-15T19:35:13.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc1438e0 con 0x7f5cfc0b6290 2021-11-15T19:35:13.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc143b80 con 0x7f5cfc064180 2021-11-15T19:35:13.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d00d50700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f5cfc0b6290 0x7f5cfc1288d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58416/0 (socket says 172.21.2.137:58416) 2021-11-15T19:35:13.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d00d50700 1 -- 172.21.2.137:0/2761826953 learned_addr learned my addr 172.21.2.137:0/2761826953 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:13.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331391976 0 0) 0x7f5cfc1438e0 con 0x7f5cfc0b6290 2021-11-15T19:35:13.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cdc003260 con 0x7f5cfc0b6290 2021-11-15T19:35:13.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d01551700 1 --2- 172.21.2.137:0/2761826953 >> v2:172.21.2.111:3300/0 conn(0x7f5cfc064180 0x7f5cfc140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3007314193 0 0) 0x7f5cdc003260 con 0x7f5cfc0b6290 2021-11-15T19:35:13.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 >> v2:172.21.2.111:3300/0 conn(0x7f5cfc064180 msgr2=0x7f5cfc140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:13.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 --2- 172.21.2.137:0/2761826953 >> v2:172.21.2.111:3300/0 conn(0x7f5cfc064180 0x7f5cfc140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 >> v1:172.21.2.111:6789/0 conn(0x7f5cfc0b2240 legacy=0x7f5cfc13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:13.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc13f830 con 0x7f5cfc0b6290 2021-11-15T19:35:13.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f5cec001660 con 0x7f5cfc0b6290 2021-11-15T19:35:13.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 >> v1:172.21.2.137:6789/0 conn(0x7f5cfc0b6290 legacy=0x7f5cfc1288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cdc0037d0 0x7f5cdc003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cdc0040c0 0x7f5cdc004580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cdc004d30 0x7f5cdc00fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc143b80 con 0x7f5cdc004d30 2021-11-15T19:35:13.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0102d0 con 0x7f5cdc0040c0 2021-11-15T19:35:13.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc010490 con 0x7f5cdc0037d0 2021-11-15T19:35:13.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cdc0040c0 0x7f5cdc004580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 -- 172.21.2.137:0/2761826953 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cdc0037d0 msgr2=0x7f5cdc003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:13.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cdc0037d0 0x7f5cdc003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:13.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 -- 172.21.2.137:0/2761826953 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cdc004d30 msgr2=0x7f5cdc00fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:13.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cdc004d30 0x7f5cdc00fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:13.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 -- 172.21.2.137:0/2761826953 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc13f830 con 0x7f5cdc0040c0 2021-11-15T19:35:13.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d01551700 1 -- 172.21.2.137:0/2761826953 reap_dead start 2021-11-15T19:35:13.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfbfff700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cdc0040c0 0x7f5cdc004580 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f5ce4001fa0 tx=0x7f5ce4007a00).ready entity=mon.1 client_cookie=4c638f90873fc639 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:13.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce4007030 con 0x7f5cdc0040c0 2021-11-15T19:35:13.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce4002e90 con 0x7f5cdc0040c0 2021-11-15T19:35:13.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5cfb7fe700 1 -- 172.21.2.137:0/2761826953 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce4007380 con 0x7f5cdc0040c0 2021-11-15T19:35:13.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2761826953 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cdc0040c0 msgr2=0x7f5cdc004580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cdc0040c0 0x7f5cdc004580 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f5ce4001fa0 tx=0x7f5ce4007a00).stop 2021-11-15T19:35:13.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2761826953 shutdown_connections 2021-11-15T19:35:13.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2761826953 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cdc0040c0 0x7f5cdc004580 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:13.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2761826953 >> 172.21.2.137:0/2761826953 conn(0x7f5cfc069e70 msgr2=0x7f5cfc0639e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:13.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2761826953 shutdown_connections 2021-11-15T19:35:13.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2761826953 wait complete. 2021-11-15T19:35:13.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 Processor -- start 2021-11-15T19:35:13.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.253+0000 7f5d02fb4700 1 -- start start 2021-11-15T19:35:13.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 0x7f5cfc13eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cfc13efe0 0x7f5cfc150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cfc151320 0x7f5cfc1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc142fe0 con 0x7f5cfc151320 2021-11-15T19:35:13.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0b5220 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc122730 con 0x7f5cfc13efe0 2021-11-15T19:35:13.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 0x7f5cfc13eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 0x7f5cfc13eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39648/0 (socket says 172.21.2.137:39648) 2021-11-15T19:35:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 -- 172.21.2.137:0/2913777428 learned_addr learned my addr 172.21.2.137:0/2913777428 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 -- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cfc13efe0 msgr2=0x7f5cfc150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cfc13efe0 0x7f5cfc150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 -- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cfc151320 msgr2=0x7f5cfc1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:13.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cfc151320 0x7f5cfc1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 -- 172.21.2.137:0/2913777428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc125a00 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d00d50700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 0x7f5cfc13eaf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f5cfc127950 tx=0x7f5cec001bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cec007170 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec0072d0 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc125ca0 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cec004920 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc0b5940 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5cec01b060 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc124340 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cf9ffb700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ce0053570 0x7f5ce0055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:13.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5cec06b4a0 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cfbfff700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ce0053570 0x7f5ce0055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:13.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.257+0000 7f5cfbfff700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ce0053570 0x7f5ce0055a30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f5ce4001fa0 tx=0x7f5ce4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:13.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.261+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5cec0427d0 con 0x7f5cfc0b4e40 2021-11-15T19:35:13.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:13.353+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5cfc0b0960 con 0x7f5cfc0b4e40 2021-11-15T19:35:14.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.213+0000 7f5cf9ffb700 1 -- 172.21.2.137:0/2913777428 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v127) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5cec019070 con 0x7f5cfc0b4e40 2021-11-15T19:35:14.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.213+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ce0053570 msgr2=0x7f5ce0055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.213+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ce0053570 0x7f5ce0055a30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f5ce4001fa0 tx=0x7f5ce4015000).stop 2021-11-15T19:35:14.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.213+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 msgr2=0x7f5cfc13eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.213+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 0x7f5cfc13eaf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f5cfc127950 tx=0x7f5cec001bd0).stop 2021-11-15T19:35:14.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 shutdown_connections 2021-11-15T19:35:14.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5ce0053570 0x7f5ce0055a30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5cfc151320 0x7f5cfc1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5cfc13efe0 0x7f5cfc150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 --2- 172.21.2.137:0/2913777428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5cfc0b4e40 0x7f5cfc13eaf0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 >> 172.21.2.137:0/2913777428 conn(0x7f5cfc069e70 msgr2=0x7f5cfc13fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 shutdown_connections 2021-11-15T19:35:14.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.217+0000 7f5d02fb4700 1 -- 172.21.2.137:0/2913777428 wait complete. 2021-11-15T19:35:14.229 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:35:14.233 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:35:14.233 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:35:14.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 Processor -- start 2021-11-15T19:35:14.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 -- start start 2021-11-15T19:35:14.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7654144610 0x7f7654147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f76540a9f50 0x7f76540aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7654148190 con 0x7f76540b1340 2021-11-15T19:35:14.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540b1720 con 0x7f7654144610 2021-11-15T19:35:14.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765c559700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7654147e70 con 0x7f76540a9f50 2021-11-15T19:35:14.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f76540a9f50 0x7f76540aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f76540a9f50 0x7f76540aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39658/0 (socket says 172.21.2.137:39658) 2021-11-15T19:35:14.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 -- 172.21.2.137:0/553247087 learned_addr learned my addr 172.21.2.137:0/553247087 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 -- 172.21.2.137:0/553247087 >> v2:172.21.2.111:3300/0 conn(0x7f7654144610 msgr2=0x7f7654147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:14.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 --2- 172.21.2.137:0/553247087 >> v2:172.21.2.111:3300/0 conn(0x7f7654144610 0x7f7654147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 -- 172.21.2.137:0/553247087 >> v1:172.21.2.111:6789/0 conn(0x7f76540b1340 legacy=0x7f7654143f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:14.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 -- 172.21.2.137:0/553247087 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540af800 con 0x7f76540a9f50 2021-11-15T19:35:14.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f765aaf6700 1 --2- 172.21.2.137:0/553247087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f76540a9f50 0x7f76540aa3a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f7654062250 tx=0x7f764c009290).ready entity=mon.1 client_cookie=58ad929e7434dee0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f76592f3700 1 -- 172.21.2.137:0/553247087 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c00b830 con 0x7f76540a9f50 2021-11-15T19:35:14.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f76592f3700 1 -- 172.21.2.137:0/553247087 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c00b990 con 0x7f76540a9f50 2021-11-15T19:35:14.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.273+0000 7f76592f3700 1 -- 172.21.2.137:0/553247087 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c00bb40 con 0x7f76540a9f50 2021-11-15T19:35:14.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/553247087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f76540a9f50 msgr2=0x7f76540aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 --2- 172.21.2.137:0/553247087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f76540a9f50 0x7f76540aa3a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f7654062250 tx=0x7f764c009290).stop 2021-11-15T19:35:14.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/553247087 shutdown_connections 2021-11-15T19:35:14.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 --2- 172.21.2.137:0/553247087 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f76540a9f50 0x7f76540aa3a0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 --2- 172.21.2.137:0/553247087 >> v2:172.21.2.111:3300/0 conn(0x7f7654144610 0x7f7654147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/553247087 >> 172.21.2.137:0/553247087 conn(0x7f76540b4e60 msgr2=0x7f76540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/553247087 shutdown_connections 2021-11-15T19:35:14.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/553247087 wait complete. 2021-11-15T19:35:14.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 Processor -- start 2021-11-15T19:35:14.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- start start 2021-11-15T19:35:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f76540a9f50 0x7f765413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f76540b1340 0x7f765409a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 0x7f765413eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765415a6b0 con 0x7f76540b1340 2021-11-15T19:35:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765415a950 con 0x7f7654144610 2021-11-15T19:35:14.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765413f290 con 0x7f76540a9f50 2021-11-15T19:35:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 0x7f765413eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 0x7f765413eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39660/0 (socket says 172.21.2.137:39660) 2021-11-15T19:35:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 -- 172.21.2.137:0/1868408179 learned_addr learned my addr 172.21.2.137:0/1868408179 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 -- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f76540a9f50 msgr2=0x7f765413fe30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:14.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f76540a9f50 0x7f765413fe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 -- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f76540b1340 msgr2=0x7f765409a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f76540b1340 0x7f765409a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 -- 172.21.2.137:0/1868408179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009530 con 0x7f7654144610 2021-11-15T19:35:14.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765aaf6700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 0x7f765413eda0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f7654062250 tx=0x7f764c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c021630 con 0x7f7654144610 2021-11-15T19:35:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c021790 con 0x7f7654144610 2021-11-15T19:35:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765414a660 con 0x7f7654144610 2021-11-15T19:35:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7654159b90 con 0x7f7654144610 2021-11-15T19:35:14.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c021af0 con 0x7f7654144610 2021-11-15T19:35:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765415ab10 con 0x7f7654144610 2021-11-15T19:35:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f764c027020 con 0x7f7654144610 2021-11-15T19:35:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f76477fe700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7634053720 0x7f7634055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.277+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f764c06ce40 con 0x7f7654144610 2021-11-15T19:35:14.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.281+0000 7f765a2f5700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7634053720 0x7f7634055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.281+0000 7f765a2f5700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7634053720 0x7f7634055be0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f7650002ef0 tx=0x7f7650006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.281+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f764c0441c0 con 0x7f7654144610 2021-11-15T19:35:14.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.389+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7654148190 con 0x7f7654144610 2021-11-15T19:35:14.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.389+0000 7f76477fe700 1 -- 172.21.2.137:0/1868408179 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v36) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f7654148190 con 0x7f7654144610 2021-11-15T19:35:14.402 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:14.402 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:14.403 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:35:14.403 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.403 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:35:14.403 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:35:14.403 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.404 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:14.404 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.404 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.404 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.404 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.405 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.405 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.405 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:35:14.405 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:35:14.405 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.406 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:14.406 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.406 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.406 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.407 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.407 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.407 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.407 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:35:14.407 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:35:14.408 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.408 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.408 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.408 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.409 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.409 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.409 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.409 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:35:14.409 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:35:14.410 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.410 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.410 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.410 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.410 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.411 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.411 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.411 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:35:14.411 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:35:14.411 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.412 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.412 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.412 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.412 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.412 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.413 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.413 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:35:14.413 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:35:14.413 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.414 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.414 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.414 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.414 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.414 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.415 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.415 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:35:14.415 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:35:14.415 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.415 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.416 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.416 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.416 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.416 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.416 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.417 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:35:14.417 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:35:14.417 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.417 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.417 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.418 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.418 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.418 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.418 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.419 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:35:14.419 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:35:14.419 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.419 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.419 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.420 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.420 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.420 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.420 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.420 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:35:14.421 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:35:14.421 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.421 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.421 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.421 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.422 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.422 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.422 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.422 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:35:14.423 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:35:14.423 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.423 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:14.423 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:35:14.424 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:35:14.424 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.424 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.424 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.424 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:35:14.425 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:35:14.425 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.425 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:14.425 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:35:14.426 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:35:14.426 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.426 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.426 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.426 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:35:14.427 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:35:14.427 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.427 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:14.428 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:35:14.428 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:35:14.428 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.428 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.429 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.429 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:35:14.429 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:35:14.429 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.429 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:35:14.430 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:14.430 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:14.430 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.430 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.430 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.431 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.431 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:35:14.431 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:35:14.431 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.432 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:35:14.432 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:35:14.432 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.432 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.432 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:14.433 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:14.433 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:35:14.433 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:35:14.433 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:14.434 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:35:14.434 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:35:14.434 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:14.434 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.434 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:14.435 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:14.435 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:14.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.389+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7634053720 msgr2=0x7f7634055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.389+0000 7f765c559700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7634053720 0x7f7634055be0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f7650002ef0 tx=0x7f7650006890).stop 2021-11-15T19:35:14.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.389+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 msgr2=0x7f765413eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.389+0000 7f765c559700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 0x7f765413eda0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f7654062250 tx=0x7f764c016000).stop 2021-11-15T19:35:14.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 shutdown_connections 2021-11-15T19:35:14.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7634053720 0x7f7634055be0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7654144610 0x7f765413eda0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f76540b1340 0x7f765409a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 --2- 172.21.2.137:0/1868408179 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f76540a9f50 0x7f765413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 >> 172.21.2.137:0/1868408179 conn(0x7f76540b4e60 msgr2=0x7f76540b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 shutdown_connections 2021-11-15T19:35:14.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.393+0000 7f765c559700 1 -- 172.21.2.137:0/1868408179 wait complete. 2021-11-15T19:35:14.439 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:14.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.477+0000 7f9ab2115700 1 Processor -- start 2021-11-15T19:35:14.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.477+0000 7f9ab2115700 1 -- start start 2021-11-15T19:35:14.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac0b1340 0x7f9aac147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9aac143f00 0x7f9aac144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac148190 con 0x7f9aac0a9f50 2021-11-15T19:35:14.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0b1720 con 0x7f9aac143f00 2021-11-15T19:35:14.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac147e70 con 0x7f9aac0b1340 2021-11-15T19:35:14.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaaffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9aac143f00 0x7f9aac144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aab7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac0b1340 0x7f9aac147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aabfff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f9aac0a9f50 0x7f9aac0aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:50946/0 (socket says 172.21.2.137:50946) 2021-11-15T19:35:14.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aabfff700 1 -- 172.21.2.137:0/1484460168 learned_addr learned my addr 172.21.2.137:0/1484460168 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:14.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaaffd700 1 -- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac0b1340 msgr2=0x7f9aac147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:14.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaaffd700 1 --2- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac0b1340 0x7f9aac147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaaffd700 1 -- 172.21.2.137:0/1484460168 >> v1:172.21.2.111:6789/0 conn(0x7f9aac0a9f50 legacy=0x7f9aac0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaaffd700 1 -- 172.21.2.137:0/1484460168 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0af800 con 0x7f9aac143f00 2021-11-15T19:35:14.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aab7fe700 1 --2- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac0b1340 0x7f9aac147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:35:14.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaaffd700 1 --2- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac143f00 0x7f9aac144360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9a94002f70 tx=0x7f9a94006df0).ready entity=mon.0 client_cookie=70550127f82b8908 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaa7fc700 1 -- 172.21.2.137:0/1484460168 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a9400d570 con 0x7f9aac143f00 2021-11-15T19:35:14.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaa7fc700 1 -- 172.21.2.137:0/1484460168 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a94000e90 con 0x7f9aac143f00 2021-11-15T19:35:14.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9aaa7fc700 1 -- 172.21.2.137:0/1484460168 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a9400d8c0 con 0x7f9aac143f00 2021-11-15T19:35:14.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac143f00 msgr2=0x7f9aac144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 --2- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac143f00 0x7f9aac144360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9a94002f70 tx=0x7f9a94006df0).stop 2021-11-15T19:35:14.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- 172.21.2.137:0/1484460168 shutdown_connections 2021-11-15T19:35:14.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 --2- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac143f00 0x7f9aac144360 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 --2- 172.21.2.137:0/1484460168 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac0b1340 0x7f9aac147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- 172.21.2.137:0/1484460168 >> 172.21.2.137:0/1484460168 conn(0x7f9aac0b4e60 msgr2=0x7f9aac0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.481+0000 7f9ab2115700 1 -- 172.21.2.137:0/1484460168 shutdown_connections 2021-11-15T19:35:14.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- 172.21.2.137:0/1484460168 wait complete. 2021-11-15T19:35:14.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 Processor -- start 2021-11-15T19:35:14.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- start start 2021-11-15T19:35:14.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac0a9f50 0x7f9aac099d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 0x7f9aac0ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac143f00 0x7f9aac0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0ae3d0 con 0x7f9aac0a9f50 2021-11-15T19:35:14.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac142980 con 0x7f9aac0b1340 2021-11-15T19:35:14.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1426e0 con 0x7f9aac143f00 2021-11-15T19:35:14.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 0x7f9aac0ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 0x7f9aac0ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39678/0 (socket says 172.21.2.137:39678) 2021-11-15T19:35:14.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 -- 172.21.2.137:0/4233291428 learned_addr learned my addr 172.21.2.137:0/4233291428 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aabfff700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac143f00 0x7f9aac0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aab7fe700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac0a9f50 0x7f9aac099d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 -- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac143f00 msgr2=0x7f9aac0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac143f00 0x7f9aac0aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 -- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac0a9f50 msgr2=0x7f9aac099d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac0a9f50 0x7f9aac099d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 -- 172.21.2.137:0/4233291428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c00b180 con 0x7f9aac0b1340 2021-11-15T19:35:14.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aaaffd700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 0x7f9aac0ae830 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f9a94002f70 tx=0x7f9a94014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a94016070 con 0x7f9aac0b1340 2021-11-15T19:35:14.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9400d8f0 con 0x7f9aac0b1340 2021-11-15T19:35:14.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a9401e450 con 0x7f9aac0b1340 2021-11-15T19:35:14.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9400b180 con 0x7f9aac0b1340 2021-11-15T19:35:14.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac141920 con 0x7f9aac0b1340 2021-11-15T19:35:14.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac0ae540 con 0x7f9aac0b1340 2021-11-15T19:35:14.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a94025030 con 0x7f9aac0b1340 2021-11-15T19:35:14.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aa8ff9700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a900536f0 0x7f9a90055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9a9406c810 con 0x7f9aac0b1340 2021-11-15T19:35:14.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.485+0000 7f9aab7fe700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a900536f0 0x7f9a90055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.489+0000 7f9aab7fe700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a900536f0 0x7f9a90055bb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f9a9c00b000 tx=0x7f9a9c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.489+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a94043b90 con 0x7f9aac0b1340 2021-11-15T19:35:14.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aac05faf0 con 0x7f9aac0b1340 2021-11-15T19:35:14.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9aa8ff9700 1 -- 172.21.2.137:0/4233291428 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f9a94023090 con 0x7f9aac0b1340 2021-11-15T19:35:14.585 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:14.585 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":127,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:14.209397+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:14.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a900536f0 msgr2=0x7f9a90055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a900536f0 0x7f9a90055bb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f9a9c00b000 tx=0x7f9a9c008040).stop 2021-11-15T19:35:14.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 msgr2=0x7f9aac0ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 0x7f9aac0ae830 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f9a94002f70 tx=0x7f9a94014000).stop 2021-11-15T19:35:14.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 shutdown_connections 2021-11-15T19:35:14.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9a900536f0 0x7f9a90055bb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9aac143f00 0x7f9aac0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9aac0b1340 0x7f9aac0ae830 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 --2- 172.21.2.137:0/4233291428 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9aac0a9f50 0x7f9aac099d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 >> 172.21.2.137:0/4233291428 conn(0x7f9aac0b4e60 msgr2=0x7f9aac13e670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 shutdown_connections 2021-11-15T19:35:14.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.573+0000 7f9ab2115700 1 -- 172.21.2.137:0/4233291428 wait complete. 2021-11-15T19:35:14.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:35:14.593 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:14.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 Processor -- start 2021-11-15T19:35:14.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 -- start start 2021-11-15T19:35:14.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6280065730 0x7f628013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 0x7f628005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6280066270 con 0x7f6280065b10 2021-11-15T19:35:14.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6280067410 con 0x7f6280065730 2021-11-15T19:35:14.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f62885d7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6280065fd0 con 0x7f62800b00a0 2021-11-15T19:35:14.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6285b72700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6280065b10 0x7f628013c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58468/0 (socket says 172.21.2.137:58468) 2021-11-15T19:35:14.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6285b72700 1 -- 172.21.2.137:0/3255428286 learned_addr learned my addr 172.21.2.137:0/3255428286 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:14.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6286373700 1 --2- 172.21.2.137:0/3255428286 >> v2:172.21.2.137:3300/0 conn(0x7f6280065730 0x7f628013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6286373700 1 -- 172.21.2.137:0/3255428286 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 msgr2=0x7f628005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:14.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6286373700 1 --2- 172.21.2.137:0/3255428286 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 0x7f628005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6286373700 1 -- 172.21.2.137:0/3255428286 >> v1:172.21.2.137:6789/0 conn(0x7f6280065b10 legacy=0x7f628013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6286373700 1 -- 172.21.2.137:0/3255428286 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280066f70 con 0x7f6280065730 2021-11-15T19:35:14.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.633+0000 7f6285371700 1 -- 172.21.2.137:0/3255428286 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950322428 0 0) 0x7f6280066270 con 0x7f6280065b10 2021-11-15T19:35:14.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6286373700 1 --2- 172.21.2.137:0/3255428286 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065730 0x7f628013c2b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f6270002f70 tx=0x7f6270007f00).ready entity=mon.1 client_cookie=8d6c97c6f3111122 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285371700 1 -- 172.21.2.137:0/3255428286 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627000a500 con 0x7f6280065730 2021-11-15T19:35:14.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285371700 1 -- 172.21.2.137:0/3255428286 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270000e90 con 0x7f6280065730 2021-11-15T19:35:14.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285371700 1 -- 172.21.2.137:0/3255428286 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627000a850 con 0x7f6280065730 2021-11-15T19:35:14.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/3255428286 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065730 msgr2=0x7f628013c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 --2- 172.21.2.137:0/3255428286 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065730 0x7f628013c2b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f6270002f70 tx=0x7f6270007f00).stop 2021-11-15T19:35:14.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/3255428286 shutdown_connections 2021-11-15T19:35:14.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 --2- 172.21.2.137:0/3255428286 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 0x7f628005bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 --2- 172.21.2.137:0/3255428286 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065730 0x7f628013c2b0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/3255428286 >> 172.21.2.137:0/3255428286 conn(0x7f6280060290 msgr2=0x7f6280060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/3255428286 shutdown_connections 2021-11-15T19:35:14.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/3255428286 wait complete. 2021-11-15T19:35:14.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 Processor -- start 2021-11-15T19:35:14.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- start start 2021-11-15T19:35:14.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6280065730 0x7f62800b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 0x7f628014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 0x7f62801536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6280150ca0 con 0x7f6280065730 2021-11-15T19:35:14.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628012e0e0 con 0x7f6280065b10 2021-11-15T19:35:14.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6280131f00 con 0x7f62800b00a0 2021-11-15T19:35:14.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 0x7f628014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 0x7f628014fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39692/0 (socket says 172.21.2.137:39692) 2021-11-15T19:35:14.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 -- 172.21.2.137:0/890441499 learned_addr learned my addr 172.21.2.137:0/890441499 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 -- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 msgr2=0x7f62801536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 0x7f62801536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 -- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6280065730 msgr2=0x7f62800b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6280065730 0x7f62800b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 -- 172.21.2.137:0/890441499 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627000c200 con 0x7f6280065b10 2021-11-15T19:35:14.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f6285b72700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 0x7f628014fc10 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f627c000bc0 tx=0x7f627c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627c00ce20 con 0x7f6280065b10 2021-11-15T19:35:14.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c0072e0 con 0x7f6280065b10 2021-11-15T19:35:14.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627c005800 con 0x7f6280065b10 2021-11-15T19:35:14.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62801321a0 con 0x7f6280065b10 2021-11-15T19:35:14.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628012e320 con 0x7f6280065b10 2021-11-15T19:35:14.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62800b0fb0 con 0x7f6280065b10 2021-11-15T19:35:14.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.637+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f627c010070 con 0x7f6280065b10 2021-11-15T19:35:14.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.641+0000 7f626f7fe700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62600536a0 0x7f6260055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.641+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f627c06ad30 con 0x7f6280065b10 2021-11-15T19:35:14.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.641+0000 7f6286373700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62600536a0 0x7f6260055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.641+0000 7f6286373700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62600536a0 0x7f6260055b60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f6270002f70 tx=0x7f6270016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.641+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f627c0421c0 con 0x7f6280065b10 2021-11-15T19:35:14.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f62800573d0 con 0x7f6280065b10 2021-11-15T19:35:14.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f626f7fe700 1 -- 172.21.2.137:0/890441499 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7f627c0457e0 con 0x7f6280065b10 2021-11-15T19:35:14.736 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:14.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62600536a0 msgr2=0x7f6260055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62600536a0 0x7f6260055b60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f6270002f70 tx=0x7f6270016000).stop 2021-11-15T19:35:14.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 msgr2=0x7f628014fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 0x7f628014fc10 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f627c000bc0 tx=0x7f627c007a40).stop 2021-11-15T19:35:14.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 shutdown_connections 2021-11-15T19:35:14.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f62600536a0 0x7f6260055b60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62800b00a0 0x7f62801536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6280065b10 0x7f628014fc10 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 --2- 172.21.2.137:0/890441499 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6280065730 0x7f62800b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 >> 172.21.2.137:0/890441499 conn(0x7f6280060290 msgr2=0x7f6280069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 shutdown_connections 2021-11-15T19:35:14.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.725+0000 7f62885d7700 1 -- 172.21.2.137:0/890441499 wait complete. 2021-11-15T19:35:14.743 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 Processor -- start 2021-11-15T19:35:14.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- start start 2021-11-15T19:35:14.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f2a780b0550 0x7f2a7814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.799 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2a7814aaa0 0x7f2a78140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7805cb50 con 0x7f2a7805c770 2021-11-15T19:35:14.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780b1650 con 0x7f2a780b0550 2021-11-15T19:35:14.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780ad030 con 0x7f2a7814aaa0 2021-11-15T19:35:14.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2a7814aaa0 0x7f2a78140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2a7814aaa0 0x7f2a78140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39700/0 (socket says 172.21.2.137:39700) 2021-11-15T19:35:14.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 -- 172.21.2.137:0/3181029909 learned_addr learned my addr 172.21.2.137:0/3181029909 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 -- 172.21.2.137:0/3181029909 >> v2:172.21.2.111:3300/0 conn(0x7f2a780b0550 msgr2=0x7f2a7814a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:14.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 --2- 172.21.2.137:0/3181029909 >> v2:172.21.2.111:3300/0 conn(0x7f2a780b0550 0x7f2a7814a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 -- 172.21.2.137:0/3181029909 >> v1:172.21.2.111:6789/0 conn(0x7f2a7805c770 legacy=0x7f2a780aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:14.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 -- 172.21.2.137:0/3181029909 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780ad2d0 con 0x7f2a7814aaa0 2021-11-15T19:35:14.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7e9c8700 1 --2- 172.21.2.137:0/3181029909 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a7814aaa0 0x7f2a78140aa0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f2a780aee10 tx=0x7f2a70009290).ready entity=mon.1 client_cookie=d5856a6efe0afc98 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d1c5700 1 -- 172.21.2.137:0/3181029909 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7000b830 con 0x7f2a7814aaa0 2021-11-15T19:35:14.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d1c5700 1 -- 172.21.2.137:0/3181029909 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7000b990 con 0x7f2a7814aaa0 2021-11-15T19:35:14.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d1c5700 1 -- 172.21.2.137:0/3181029909 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7000bb40 con 0x7f2a7814aaa0 2021-11-15T19:35:14.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/3181029909 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a7814aaa0 msgr2=0x7f2a78140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- 172.21.2.137:0/3181029909 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a7814aaa0 0x7f2a78140aa0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f2a780aee10 tx=0x7f2a70009290).stop 2021-11-15T19:35:14.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/3181029909 shutdown_connections 2021-11-15T19:35:14.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- 172.21.2.137:0/3181029909 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a7814aaa0 0x7f2a78140aa0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- 172.21.2.137:0/3181029909 >> v2:172.21.2.111:3300/0 conn(0x7f2a780b0550 0x7f2a7814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/3181029909 >> 172.21.2.137:0/3181029909 conn(0x7f2a780631e0 msgr2=0x7f2a7805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/3181029909 shutdown_connections 2021-11-15T19:35:14.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/3181029909 wait complete. 2021-11-15T19:35:14.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 Processor -- start 2021-11-15T19:35:14.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- start start 2021-11-15T19:35:14.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2a7805c770 0x7f2a780b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 0x7f2a78159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2a7814aaa0 0x7f2a78159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78147130 con 0x7f2a7805c770 2021-11-15T19:35:14.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78142970 con 0x7f2a780b0550 2021-11-15T19:35:14.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78142c10 con 0x7f2a7814aaa0 2021-11-15T19:35:14.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 0x7f2a78159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 0x7f2a78159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39704/0 (socket says 172.21.2.137:39704) 2021-11-15T19:35:14.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 -- 172.21.2.137:0/611330041 learned_addr learned my addr 172.21.2.137:0/611330041 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 -- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2a7814aaa0 msgr2=0x7f2a78159f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:14.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2a7814aaa0 0x7f2a78159f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 -- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2a7805c770 msgr2=0x7f2a780b3550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:14.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2a7805c770 0x7f2a780b3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 -- 172.21.2.137:0/611330041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009530 con 0x7f2a780b0550 2021-11-15T19:35:14.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a7d9c6700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 0x7f2a78159aa0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f2a74002ef0 tx=0x7f2a74006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a74012410 con 0x7f2a780b0550 2021-11-15T19:35:14.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74012570 con 0x7f2a780b0550 2021-11-15T19:35:14.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a781425f0 con 0x7f2a780b0550 2021-11-15T19:35:14.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a740128d0 con 0x7f2a780b0550 2021-11-15T19:35:14.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.785+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a78147780 con 0x7f2a780b0550 2021-11-15T19:35:14.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a781472a0 con 0x7f2a780b0550 2021-11-15T19:35:14.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a7400f030 con 0x7f2a780b0550 2021-11-15T19:35:14.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a6b7fe700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2a580536a0 0x7f2a58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2a7406b310 con 0x7f2a780b0550 2021-11-15T19:35:14.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a7e1c7700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2a580536a0 0x7f2a58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a7e1c7700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2a580536a0 0x7f2a58055b60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f2a6c002ef0 tx=0x7f2a6c006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.789+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a781472a0 con 0x7f2a780b0550 2021-11-15T19:35:14.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a781427e0 con 0x7f2a780b0550 2021-11-15T19:35:14.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a6b7fe700 1 -- 172.21.2.137:0/611330041 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a740461d0 con 0x7f2a780b0550 2021-11-15T19:35:14.885 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:14.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2a580536a0 msgr2=0x7f2a58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2a580536a0 0x7f2a58055b60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f2a6c002ef0 tx=0x7f2a6c006890).stop 2021-11-15T19:35:14.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 msgr2=0x7f2a78159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 0x7f2a78159aa0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f2a74002ef0 tx=0x7f2a74006d50).stop 2021-11-15T19:35:14.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 shutdown_connections 2021-11-15T19:35:14.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2a580536a0 0x7f2a58055b60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2a7814aaa0 0x7f2a78159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2a780b0550 0x7f2a78159aa0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 --2- 172.21.2.137:0/611330041 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2a7805c770 0x7f2a780b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 >> 172.21.2.137:0/611330041 conn(0x7f2a780631e0 msgr2=0x7f2a78140390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 shutdown_connections 2021-11-15T19:35:14.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.873+0000 7f2a8042b700 1 -- 172.21.2.137:0/611330041 wait complete. 2021-11-15T19:35:14.892 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:35:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 Processor -- start 2021-11-15T19:35:14.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- start start 2021-11-15T19:35:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 0x7f1cc4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1cc40a9f50 0x7f1cc40aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc4148190 con 0x7f1cc4143f00 2021-11-15T19:35:14.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40b1720 con 0x7f1cc40a9f50 2021-11-15T19:35:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4147e70 con 0x7f1cc40b1340 2021-11-15T19:35:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1cc40a9f50 0x7f1cc40aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1cc40a9f50 0x7f1cc40aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39712/0 (socket says 172.21.2.137:39712) 2021-11-15T19:35:14.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/2725476452 learned_addr learned my addr 172.21.2.137:0/2725476452 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/2725476452 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 msgr2=0x7f1cc4147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 --2- 172.21.2.137:0/2725476452 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 0x7f1cc4147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/2725476452 >> v1:172.21.2.111:6789/0 conn(0x7f1cc4143f00 legacy=0x7f1cc4144360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:14.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/2725476452 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40af800 con 0x7f1cc40a9f50 2021-11-15T19:35:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc2d9d700 1 --2- 172.21.2.137:0/2725476452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc40a9f50 0x7f1cc40aa370 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f1cc405cfa0 tx=0x7f1cbc009290).ready entity=mon.1 client_cookie=b08d2b2545e56ba1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc159a700 1 -- 172.21.2.137:0/2725476452 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00b860 con 0x7f1cc40a9f50 2021-11-15T19:35:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc159a700 1 -- 172.21.2.137:0/2725476452 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00b9c0 con 0x7f1cc40a9f50 2021-11-15T19:35:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc159a700 1 -- 172.21.2.137:0/2725476452 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00bb70 con 0x7f1cc40a9f50 2021-11-15T19:35:14.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- 172.21.2.137:0/2725476452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc40a9f50 msgr2=0x7f1cc40aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/2725476452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc40a9f50 0x7f1cc40aa370 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f1cc405cfa0 tx=0x7f1cbc009290).stop 2021-11-15T19:35:14.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- 172.21.2.137:0/2725476452 shutdown_connections 2021-11-15T19:35:14.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/2725476452 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc40a9f50 0x7f1cc40aa370 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:14.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/2725476452 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 0x7f1cc4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- 172.21.2.137:0/2725476452 >> 172.21.2.137:0/2725476452 conn(0x7f1cc40b4e60 msgr2=0x7f1cc40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:14.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- 172.21.2.137:0/2725476452 shutdown_connections 2021-11-15T19:35:14.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- 172.21.2.137:0/2725476452 wait complete. 2021-11-15T19:35:14.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 Processor -- start 2021-11-15T19:35:14.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.933+0000 7f1cc89f9700 1 -- start start 2021-11-15T19:35:14.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cc40a9f50 0x7f1cc40ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 0x7f1cc40b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 0x7f1cc40988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4097f00 con 0x7f1cc40a9f50 2021-11-15T19:35:14.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40981a0 con 0x7f1cc4143f00 2021-11-15T19:35:14.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4098440 con 0x7f1cc40b1340 2021-11-15T19:35:14.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 0x7f1cc40988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 0x7f1cc40988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39720/0 (socket says 172.21.2.137:39720) 2021-11-15T19:35:14.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/294689239 learned_addr learned my addr 172.21.2.137:0/294689239 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:14.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 msgr2=0x7f1cc40b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 0x7f1cc40b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cc40a9f50 msgr2=0x7f1cc40ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:14.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cc40a9f50 0x7f1cc40ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:14.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 -- 172.21.2.137:0/294689239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009530 con 0x7f1cc4143f00 2021-11-15T19:35:14.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc2d9d700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 0x7f1cc40988e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f1cc405cfa0 tx=0x7f1cbc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00b860 con 0x7f1cc4143f00 2021-11-15T19:35:14.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0032d0 con 0x7f1cc4143f00 2021-11-15T19:35:14.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc0107a0 con 0x7f1cc4143f00 2021-11-15T19:35:14.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40aef40 con 0x7f1cc4143f00 2021-11-15T19:35:14.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc409ada0 con 0x7f1cc4143f00 2021-11-15T19:35:14.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc4098600 con 0x7f1cc4143f00 2021-11-15T19:35:14.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cbc028070 con 0x7f1cc4143f00 2021-11-15T19:35:14.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cbb7fe700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ca80536d0 0x7f1ca8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:14.958 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1cbc06c4e0 con 0x7f1cc4143f00 2021-11-15T19:35:14.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.937+0000 7f1cc259c700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ca80536d0 0x7f1ca8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:14.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.941+0000 7f1cc259c700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ca80536d0 0x7f1ca8055b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f1cac002ef0 tx=0x7f1cac006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:14.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:14.941+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cbc043970 con 0x7f1cc4143f00 2021-11-15T19:35:15.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1cc405faf0 con 0x7f1cc4143f00 2021-11-15T19:35:15.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cbb7fe700 1 -- 172.21.2.137:0/294689239 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1cbc015070 con 0x7f1cc4143f00 2021-11-15T19:35:15.037 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:15.037 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:35:15.037 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:15.038 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:35:15.038 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:35:15.038 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:15.038 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:15.039 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:35:15.039 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:35:15.039 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:15.039 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:35:15.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ca80536d0 msgr2=0x7f1ca8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.040 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ca80536d0 0x7f1ca8055b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f1cac002ef0 tx=0x7f1cac006910).stop 2021-11-15T19:35:15.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 msgr2=0x7f1cc40988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 0x7f1cc40988e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f1cc405cfa0 tx=0x7f1cbc016000).stop 2021-11-15T19:35:15.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 shutdown_connections 2021-11-15T19:35:15.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1ca80536d0 0x7f1ca8055b90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:15.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1cc4143f00 0x7f1cc40988e0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:15.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1cc40b1340 0x7f1cc40b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 --2- 172.21.2.137:0/294689239 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1cc40a9f50 0x7f1cc40ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.042 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 >> 172.21.2.137:0/294689239 conn(0x7f1cc40b4e60 msgr2=0x7f1cc40b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:15.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 shutdown_connections 2021-11-15T19:35:15.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.025+0000 7f1cc89f9700 1 -- 172.21.2.137:0/294689239 wait complete. 2021-11-15T19:35:15.044 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:35:15.045 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:35:15.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 Processor -- start 2021-11-15T19:35:15.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 -- start start 2021-11-15T19:35:15.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540b72e0 0x7f0f540b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0f540ad320 0x7f0f541290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f540b76c0 con 0x7f0f540acd60 2021-11-15T19:35:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540b3100 con 0x7f0f540ad320 2021-11-15T19:35:15.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f5b846700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5412a170 con 0x7f0f540b72e0 2021-11-15T19:35:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f58de1700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0f540acd60 0x7f0f540b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58510/0 (socket says 172.21.2.137:58510) 2021-11-15T19:35:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f58de1700 1 -- 172.21.2.137:0/1207713443 learned_addr learned my addr 172.21.2.137:0/1207713443 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f59de3700 1 --2- 172.21.2.137:0/1207713443 >> v2:172.21.2.137:3300/0 conn(0x7f0f540ad320 0x7f0f541290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f47fff700 1 -- 172.21.2.137:0/1207713443 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953054464 0 0) 0x7f0f540b76c0 con 0x7f0f540acd60 2021-11-15T19:35:15.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f47fff700 1 -- 172.21.2.137:0/1207713443 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f3c003260 con 0x7f0f540acd60 2021-11-15T19:35:15.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f59de3700 1 -- 172.21.2.137:0/1207713443 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540b72e0 msgr2=0x7f0f540b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:15.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f59de3700 1 --2- 172.21.2.137:0/1207713443 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540b72e0 0x7f0f540b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f59de3700 1 -- 172.21.2.137:0/1207713443 >> v1:172.21.2.137:6789/0 conn(0x7f0f540acd60 legacy=0x7f0f540b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f59de3700 1 -- 172.21.2.137:0/1207713443 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540ad8a0 con 0x7f0f540ad320 2021-11-15T19:35:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f59de3700 1 --2- 172.21.2.137:0/1207713443 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540ad320 0x7f0f541290c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f0f4c0032f0 tx=0x7f0f4c0091d0).ready entity=mon.1 client_cookie=eeaf84decfbe4c6e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f47fff700 1 -- 172.21.2.137:0/1207713443 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f4c00b6c0 con 0x7f0f540ad320 2021-11-15T19:35:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f47fff700 1 -- 172.21.2.137:0/1207713443 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00b820 con 0x7f0f540ad320 2021-11-15T19:35:15.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.085+0000 7f0f47fff700 1 -- 172.21.2.137:0/1207713443 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f4c00b990 con 0x7f0f540ad320 2021-11-15T19:35:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/1207713443 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540ad320 msgr2=0x7f0f541290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 --2- 172.21.2.137:0/1207713443 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540ad320 0x7f0f541290c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f0f4c0032f0 tx=0x7f0f4c0091d0).stop 2021-11-15T19:35:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/1207713443 shutdown_connections 2021-11-15T19:35:15.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 --2- 172.21.2.137:0/1207713443 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540ad320 0x7f0f541290c0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 --2- 172.21.2.137:0/1207713443 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540b72e0 0x7f0f540b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/1207713443 >> 172.21.2.137:0/1207713443 conn(0x7f0f54064960 msgr2=0x7f0f54064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/1207713443 shutdown_connections 2021-11-15T19:35:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/1207713443 wait complete. 2021-11-15T19:35:15.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 Processor -- start 2021-11-15T19:35:15.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- start start 2021-11-15T19:35:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 0x7f0f540672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540ad320 0x7f0f5414d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f540b72e0 0x7f0f541512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54143f90 con 0x7f0f540b72e0 2021-11-15T19:35:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54143700 con 0x7f0f540acd60 2021-11-15T19:35:15.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54125060 con 0x7f0f540ad320 2021-11-15T19:35:15.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 0x7f0f540672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:15.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 0x7f0f540672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39730/0 (socket says 172.21.2.137:39730) 2021-11-15T19:35:15.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 -- 172.21.2.137:0/3519324954 learned_addr learned my addr 172.21.2.137:0/3519324954 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:15.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 -- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540ad320 msgr2=0x7f0f5414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540ad320 0x7f0f5414d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 -- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f540b72e0 msgr2=0x7f0f541512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f540b72e0 0x7f0f541512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 -- 172.21.2.137:0/3519324954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009470 con 0x7f0f540acd60 2021-11-15T19:35:15.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f595e2700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 0x7f0f540672c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f0f50002f70 tx=0x7f0f50006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:15.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f50013460 con 0x7f0f540acd60 2021-11-15T19:35:15.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500135c0 con 0x7f0f540acd60 2021-11-15T19:35:15.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f54150e10 con 0x7f0f540acd60 2021-11-15T19:35:15.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f50013920 con 0x7f0f540acd60 2021-11-15T19:35:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5414dc30 con 0x7f0f540acd60 2021-11-15T19:35:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f541251a0 con 0x7f0f540acd60 2021-11-15T19:35:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f5001a060 con 0x7f0f540acd60 2021-11-15T19:35:15.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f467fc700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f340536a0 0x7f0f34055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.089+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0f5006afe0 con 0x7f0f540acd60 2021-11-15T19:35:15.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.093+0000 7f0f58de1700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f340536a0 0x7f0f34055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:15.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.093+0000 7f0f58de1700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f340536a0 0x7f0f34055b60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f0f48001110 tx=0x7f0f480076c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:15.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.093+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f50042470 con 0x7f0f540acd60 2021-11-15T19:35:15.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.177+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f0f540573d0 con 0x7f0f540acd60 2021-11-15T19:35:15.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f467fc700 1 -- 172.21.2.137:0/3519324954 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v128) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0f50018030 con 0x7f0f540acd60 2021-11-15T19:35:15.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f340536a0 msgr2=0x7f0f34055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f340536a0 0x7f0f34055b60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f0f48001110 tx=0x7f0f480076c0).stop 2021-11-15T19:35:15.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 msgr2=0x7f0f540672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 0x7f0f540672c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f0f50002f70 tx=0x7f0f50006e20).stop 2021-11-15T19:35:15.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 shutdown_connections 2021-11-15T19:35:15.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0f340536a0 0x7f0f34055b60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:15.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0f540b72e0 0x7f0f541512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0f540ad320 0x7f0f5414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 --2- 172.21.2.137:0/3519324954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0f540acd60 0x7f0f540672c0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:15.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 >> 172.21.2.137:0/3519324954 conn(0x7f0f54064960 msgr2=0x7f0f54141040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:15.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 shutdown_connections 2021-11-15T19:35:15.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.221+0000 7f0f5b846700 1 -- 172.21.2.137:0/3519324954 wait complete. 2021-11-15T19:35:15.236 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:35:15.239 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:35:15.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.277+0000 7f6e39e78700 1 Processor -- start 2021-11-15T19:35:15.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.277+0000 7f6e39e78700 1 -- start start 2021-11-15T19:35:15.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6e3405c770 0x7f6e340aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6e340b0550 0x7f6e3414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3405cb50 con 0x7f6e3414aaa0 2021-11-15T19:35:15.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e340b1650 con 0x7f6e340b0550 2021-11-15T19:35:15.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e340ad030 con 0x7f6e3405c770 2021-11-15T19:35:15.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e33fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6e3414aaa0 0x7f6e34140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58524/0 (socket says 172.21.2.137:58524) 2021-11-15T19:35:15.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e33fff700 1 -- 172.21.2.137:0/2998332857 learned_addr learned my addr 172.21.2.137:0/2998332857 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:15.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- 172.21.2.137:0/2998332857 >> v2:172.21.2.137:3300/0 conn(0x7f6e3405c770 0x7f6e340aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:15.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2998332857 >> v2:172.21.2.111:3300/0 conn(0x7f6e340b0550 msgr2=0x7f6e3414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:15.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- 172.21.2.137:0/2998332857 >> v2:172.21.2.111:3300/0 conn(0x7f6e340b0550 0x7f6e3414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2998332857 >> v1:172.21.2.137:6789/0 conn(0x7f6e3414aaa0 legacy=0x7f6e34140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2998332857 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340ad2d0 con 0x7f6e3405c770 2021-11-15T19:35:15.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- 172.21.2.137:0/2998332857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e340aef30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f6e28002f70 tx=0x7f6e28006df0).ready entity=mon.1 client_cookie=adf0413e38d85587 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:15.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e327fc700 1 -- 172.21.2.137:0/2998332857 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2800d5c0 con 0x7f6e3405c770 2021-11-15T19:35:15.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e327fc700 1 -- 172.21.2.137:0/2998332857 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28000e90 con 0x7f6e3405c770 2021-11-15T19:35:15.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e327fc700 1 -- 172.21.2.137:0/2998332857 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2800d910 con 0x7f6e3405c770 2021-11-15T19:35:15.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2998332857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 msgr2=0x7f6e340aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:15.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2998332857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e340aef30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f6e28002f70 tx=0x7f6e28006df0).stop 2021-11-15T19:35:15.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2998332857 shutdown_connections 2021-11-15T19:35:15.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2998332857 >> v2:172.21.2.111:3300/0 conn(0x7f6e340b0550 0x7f6e3414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2998332857 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e340aef30 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:15.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2998332857 >> 172.21.2.137:0/2998332857 conn(0x7f6e340631e0 msgr2=0x7f6e3405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:15.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2998332857 shutdown_connections 2021-11-15T19:35:15.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2998332857 wait complete. 2021-11-15T19:35:15.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 Processor -- start 2021-11-15T19:35:15.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- start start 2021-11-15T19:35:15.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e34067160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e340b0550 0x7f6e34142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e3414aaa0 0x7f6e341476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341578b0 con 0x7f6e340b0550 2021-11-15T19:35:15.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341570b0 con 0x7f6e3405c770 2021-11-15T19:35:15.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34157580 con 0x7f6e3414aaa0 2021-11-15T19:35:15.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e34067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:15.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e34067160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39744/0 (socket says 172.21.2.137:39744) 2021-11-15T19:35:15.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2565434478 learned_addr learned my addr 172.21.2.137:0/2565434478 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:15.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e3414aaa0 msgr2=0x7f6e341476a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:15.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e3414aaa0 0x7f6e341476a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e340b0550 msgr2=0x7f6e34142000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:15.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e340b0550 0x7f6e34142000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:15.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 -- 172.21.2.137:0/2565434478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2800b180 con 0x7f6e3405c770 2021-11-15T19:35:15.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e337fe700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e34067160 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f6e34156660 tx=0x7f6e28014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:15.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e28016070 con 0x7f6e3405c770 2021-11-15T19:35:15.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800de90 con 0x7f6e3405c770 2021-11-15T19:35:15.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2801e450 con 0x7f6e3405c770 2021-11-15T19:35:15.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e341424f0 con 0x7f6e3405c770 2021-11-15T19:35:15.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.281+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34144240 con 0x7f6e3405c770 2021-11-15T19:35:15.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e340ae7f0 con 0x7f6e3405c770 2021-11-15T19:35:15.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e28025030 con 0x7f6e3405c770 2021-11-15T19:35:15.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e30ff9700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e140536a0 0x7f6e14055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:15.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f6e2806c970 con 0x7f6e3405c770 2021-11-15T19:35:15.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e32ffd700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e140536a0 0x7f6e14055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:15.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e32ffd700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e140536a0 0x7f6e14055b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6e2c0032f0 tx=0x7f6e2c006d80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:15.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.285+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e28043b90 con 0x7f6e3405c770 2021-11-15T19:35:15.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:15.369+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6e341424f0 con 0x7f6e3405c770 2021-11-15T19:35:16.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e30ff9700 1 -- 172.21.2.137:0/2565434478 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v129) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6e341424f0 con 0x7f6e3405c770 2021-11-15T19:35:16.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e140536a0 msgr2=0x7f6e14055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e140536a0 0x7f6e14055b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6e2c0032f0 tx=0x7f6e2c006d80).stop 2021-11-15T19:35:16.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 msgr2=0x7f6e34067160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e34067160 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f6e34156660 tx=0x7f6e28014000).stop 2021-11-15T19:35:16.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 shutdown_connections 2021-11-15T19:35:16.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e140536a0 0x7f6e14055b60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6e3414aaa0 0x7f6e341476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6e340b0550 0x7f6e34142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 --2- 172.21.2.137:0/2565434478 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6e3405c770 0x7f6e34067160 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 >> 172.21.2.137:0/2565434478 conn(0x7f6e340631e0 msgr2=0x7f6e340b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 shutdown_connections 2021-11-15T19:35:16.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.241+0000 7f6e39e78700 1 -- 172.21.2.137:0/2565434478 wait complete. 2021-11-15T19:35:16.256 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:35:16.260 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:35:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f347357d700 1 Processor -- start 2021-11-15T19:35:16.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f347357d700 1 -- start start 2021-11-15T19:35:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f347357d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f346c05fd20 0x7f346c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f347357d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c147f70 con 0x7f346c0b0830 2021-11-15T19:35:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f347357d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c060100 con 0x7f346c0b10b0 2021-11-15T19:35:16.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f347357d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c147cd0 con 0x7f346c05fd20 2021-11-15T19:35:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3470b18700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f346c0b10b0 0x7f346c0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58534/0 (socket says 172.21.2.137:58534) 2021-11-15T19:35:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3470b18700 1 -- 172.21.2.137:0/385908876 learned_addr learned my addr 172.21.2.137:0/385908876 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413544517 0 0) 0x7f346c060100 con 0x7f346c0b10b0 2021-11-15T19:35:16.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3454003260 con 0x7f346c0b10b0 2021-11-15T19:35:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 --2- 172.21.2.137:0/385908876 >> v2:172.21.2.111:3300/0 conn(0x7f346c05fd20 0x7f346c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264634507 0 0) 0x7f3454003260 con 0x7f346c0b10b0 2021-11-15T19:35:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 >> v2:172.21.2.111:3300/0 conn(0x7f346c05fd20 msgr2=0x7f346c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 --2- 172.21.2.137:0/385908876 >> v2:172.21.2.111:3300/0 conn(0x7f346c05fd20 0x7f346c0af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 >> v1:172.21.2.111:6789/0 conn(0x7f346c0b0830 legacy=0x7f346c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0a9ed0 con 0x7f346c0b10b0 2021-11-15T19:35:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3460001660 con 0x7f346c0b10b0 2021-11-15T19:35:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 >> v1:172.21.2.137:6789/0 conn(0x7f346c0b10b0 legacy=0x7f346c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f34540037d0 0x7f3454003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3454004500 0x7f3454004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3454004f90 0x7f345400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c147cd0 con 0x7f3454004500 2021-11-15T19:35:16.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345400be00 con 0x7f34540037d0 2021-11-15T19:35:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345400bfc0 con 0x7f3454004f90 2021-11-15T19:35:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f34540037d0 0x7f3454003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 -- 172.21.2.137:0/385908876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3454004f90 msgr2=0x7f345400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3454004f90 0x7f345400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 -- 172.21.2.137:0/385908876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3454004500 msgr2=0x7f3454004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3454004500 0x7f3454004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 -- 172.21.2.137:0/385908876 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0a9ed0 con 0x7f34540037d0 2021-11-15T19:35:16.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471b1a700 1 -- 172.21.2.137:0/385908876 reap_dead start 2021-11-15T19:35:16.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f3471319700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f34540037d0 0x7f3454003bd0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f346800a000 tx=0x7f3468008040).ready entity=mon.1 client_cookie=3771d5a6473cb1cd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3468013670 con 0x7f34540037d0 2021-11-15T19:35:16.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34680137d0 con 0x7f34540037d0 2021-11-15T19:35:16.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.301+0000 7f345ffff700 1 -- 172.21.2.137:0/385908876 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3468013b30 con 0x7f34540037d0 2021-11-15T19:35:16.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/385908876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f34540037d0 msgr2=0x7f3454003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f34540037d0 0x7f3454003bd0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f346800a000 tx=0x7f3468008040).stop 2021-11-15T19:35:16.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/385908876 shutdown_connections 2021-11-15T19:35:16.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 --2- 172.21.2.137:0/385908876 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f34540037d0 0x7f3454003bd0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/385908876 >> 172.21.2.137:0/385908876 conn(0x7f346c0b4e60 msgr2=0x7f346c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/385908876 shutdown_connections 2021-11-15T19:35:16.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/385908876 wait complete. 2021-11-15T19:35:16.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 Processor -- start 2021-11-15T19:35:16.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- start start 2021-11-15T19:35:16.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f34540037d0 0x7f346c099e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f346c09a690 0x7f346c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 0x7f346c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0ae090 con 0x7f34540037d0 2021-11-15T19:35:16.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c159ad0 con 0x7f346c09ab10 2021-11-15T19:35:16.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c159d70 con 0x7f346c09a690 2021-11-15T19:35:16.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 0x7f346c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 0x7f346c156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39766/0 (socket says 172.21.2.137:39766) 2021-11-15T19:35:16.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 -- 172.21.2.137:0/2264030148 learned_addr learned my addr 172.21.2.137:0/2264030148 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:16.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3470b18700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f346c09a690 0x7f346c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471319700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f34540037d0 0x7f346c099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 -- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f346c09a690 msgr2=0x7f346c15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f346c09a690 0x7f346c15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 -- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f34540037d0 msgr2=0x7f346c099e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f34540037d0 0x7f346c099e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 -- 172.21.2.137:0/2264030148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c09a350 con 0x7f346c09ab10 2021-11-15T19:35:16.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f3471b1a700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 0x7f346c156400 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f3460001110 tx=0x7f3464007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3464005880 con 0x7f346c09ab10 2021-11-15T19:35:16.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34640059e0 con 0x7f346c09ab10 2021-11-15T19:35:16.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c15a700 con 0x7f346c09ab10 2021-11-15T19:35:16.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3464005d80 con 0x7f346c09ab10 2021-11-15T19:35:16.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c156b10 con 0x7f346c09ab10 2021-11-15T19:35:16.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c159f30 con 0x7f346c09ab10 2021-11-15T19:35:16.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.305+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f346401a060 con 0x7f346c09ab10 2021-11-15T19:35:16.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.309+0000 7f345e7fc700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f344c0536a0 0x7f344c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.309+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f346406b060 con 0x7f346c09ab10 2021-11-15T19:35:16.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.309+0000 7f3471319700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f344c0536a0 0x7f344c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.309+0000 7f3471319700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f344c0536a0 0x7f344c055b60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f3468019000 tx=0x7f3468008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.309+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3464042230 con 0x7f346c09ab10 2021-11-15T19:35:16.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.421+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f346c1479c0 con 0x7f346c09ab10 2021-11-15T19:35:16.435 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:35:16.429+0000 7fd9a9577700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:35:16.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f345e7fc700 1 -- 172.21.2.137:0/2264030148 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v65) v1 ==== 189+0+0 (secure 0 0 0) 0x7f3464018030 con 0x7f346c09ab10 2021-11-15T19:35:16.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f344c0536a0 msgr2=0x7f344c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f344c0536a0 0x7f344c055b60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f3468019000 tx=0x7f3468008040).stop 2021-11-15T19:35:16.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 msgr2=0x7f346c156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 0x7f346c156400 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f3460001110 tx=0x7f3464007dc0).stop 2021-11-15T19:35:16.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 shutdown_connections 2021-11-15T19:35:16.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f344c0536a0 0x7f344c055b60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f346c09ab10 0x7f346c156400 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f346c09a690 0x7f346c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 --2- 172.21.2.137:0/2264030148 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f34540037d0 0x7f346c099e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 >> 172.21.2.137:0/2264030148 conn(0x7f346c0b4e60 msgr2=0x7f346c0b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 shutdown_connections 2021-11-15T19:35:16.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.437+0000 7f347357d700 1 -- 172.21.2.137:0/2264030148 wait complete. 2021-11-15T19:35:16.452 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 25 and data pool 26 2021-11-15T19:35:16.455 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:16.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 Processor -- start 2021-11-15T19:35:16.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 -- start start 2021-11-15T19:35:16.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f7f100b1340 0x7f7f10147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10143f00 0x7f7f10144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f10148190 con 0x7f7f100a9f50 2021-11-15T19:35:16.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100b1720 con 0x7f7f100b1340 2021-11-15T19:35:16.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f15702700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10147e70 con 0x7f7f10143f00 2021-11-15T19:35:16.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f0f7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7f100a9f50 0x7f7f100aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58554/0 (socket says 172.21.2.137:58554) 2021-11-15T19:35:16.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1271062801 learned_addr learned my addr 172.21.2.137:0/1271062801 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:16.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933497520 0 0) 0x7f7f08001490 con 0x7f7f100a9f50 2021-11-15T19:35:16.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.493+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef0003260 con 0x7f7f100a9f50 2021-11-15T19:35:16.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858228746 0 0) 0x7f7ef0003260 con 0x7f7f100a9f50 2021-11-15T19:35:16.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10143f00 msgr2=0x7f7f10144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0effd700 1 --2- 172.21.2.137:0/1271062801 >> v2:172.21.2.111:3300/0 conn(0x7f7f100b1340 0x7f7f10147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0e7fc700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10143f00 0x7f7f10144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10143f00 0x7f7f10144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 >> v2:172.21.2.111:3300/0 conn(0x7f7f100b1340 msgr2=0x7f7f10147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 --2- 172.21.2.137:0/1271062801 >> v2:172.21.2.111:3300/0 conn(0x7f7f100b1340 0x7f7f10147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100af800 con 0x7f7f100a9f50 2021-11-15T19:35:16.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7f08001b70 con 0x7f7f100a9f50 2021-11-15T19:35:16.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0effd700 1 --2- 172.21.2.137:0/1271062801 >> v2:172.21.2.111:3300/0 conn(0x7f7f100b1340 0x7f7f10147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:16.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 >> v1:172.21.2.137:6789/0 conn(0x7f7f100a9f50 legacy=0x7f7f100aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0003750 0x7f7ef0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004500 0x7f7ef0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ef0004f90 0x7f7ef000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100b1720 con 0x7f7ef0004500 2021-11-15T19:35:16.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10147e70 con 0x7f7ef0004f90 2021-11-15T19:35:16.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef000be50 con 0x7f7ef0003750 2021-11-15T19:35:16.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0e7fc700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10143f00 0x7f7f10144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:16.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ef0004f90 0x7f7ef000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0effd700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0003750 0x7f7ef0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0e7fc700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004500 0x7f7ef0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0003750 msgr2=0x7f7ef0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7ef0003750 0x7f7ef0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004500 msgr2=0x7f7ef0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004500 0x7f7ef0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1271062801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0003260 con 0x7f7ef0004f90 2021-11-15T19:35:16.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0e7fc700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004500 0x7f7ef0004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:16.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ef0004f90 0x7f7ef000b750 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f7f08001880 tx=0x7f7f100abfb0).ready entity=mon.1 client_cookie=c4d76b29221e4f40 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08005990 con 0x7f7ef0004f90 2021-11-15T19:35:16.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08005af0 con 0x7f7ef0004f90 2021-11-15T19:35:16.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0dffb700 1 -- 172.21.2.137:0/1271062801 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08005e50 con 0x7f7ef0004f90 2021-11-15T19:35:16.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1271062801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ef0004f90 msgr2=0x7f7ef000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 --2- 172.21.2.137:0/1271062801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7ef0004f90 0x7f7ef000b750 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f7f08001880 tx=0x7f7f100abfb0).stop 2021-11-15T19:35:16.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1271062801 reap_dead start 2021-11-15T19:35:16.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1271062801 shutdown_connections 2021-11-15T19:35:16.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1271062801 >> 172.21.2.137:0/1271062801 conn(0x7f7f100b4e60 msgr2=0x7f7f100b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1271062801 shutdown_connections 2021-11-15T19:35:16.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1271062801 wait complete. 2021-11-15T19:35:16.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 Processor -- start 2021-11-15T19:35:16.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- start start 2021-11-15T19:35:16.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004f90 0x7f7f10144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10156760 0x7f7f10156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 0x7f7f10159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101462a0 con 0x7f7ef0004f90 2021-11-15T19:35:16.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100ae220 con 0x7f7f101570d0 2021-11-15T19:35:16.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100ad600 con 0x7f7f10156760 2021-11-15T19:35:16.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 0x7f7f10159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 0x7f7f10159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39788/0 (socket says 172.21.2.137:39788) 2021-11-15T19:35:16.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1308527 learned_addr learned my addr 172.21.2.137:0/1308527 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:16.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0effd700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004f90 0x7f7f10144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0e7fc700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10156760 0x7f7f10156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10156760 msgr2=0x7f7f10156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10156760 0x7f7f10156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004f90 msgr2=0x7f7f10144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004f90 0x7f7f10144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 -- 172.21.2.137:0/1308527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10157550 con 0x7f7f101570d0 2021-11-15T19:35:16.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f0f7fe700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 0x7f7f10159ce0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f7f10147c40 tx=0x7f7f08013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08001b50 con 0x7f7f101570d0 2021-11-15T19:35:16.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08001490 con 0x7f7f101570d0 2021-11-15T19:35:16.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f100adf80 con 0x7f7f101570d0 2021-11-15T19:35:16.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f08005e50 con 0x7f7f101570d0 2021-11-15T19:35:16.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.497+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f100ad2f0 con 0x7f7f101570d0 2021-11-15T19:35:16.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f101463f0 con 0x7f7f101570d0 2021-11-15T19:35:16.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f08026070 con 0x7f7f101570d0 2021-11-15T19:35:16.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f07fff700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ef40534f0 0x7f7ef40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7f0806c1f0 con 0x7f7f101570d0 2021-11-15T19:35:16.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f0effd700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ef40534f0 0x7f7ef40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f0effd700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ef40534f0 0x7f7ef40559b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f7f0000d000 tx=0x7f7f00008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.501+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f08043240 con 0x7f7f101570d0 2021-11-15T19:35:16.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.585+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f10148190 con 0x7f7f101570d0 2021-11-15T19:35:16.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.585+0000 7f7f07fff700 1 -- 172.21.2.137:0/1308527 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f7f10148190 con 0x7f7f101570d0 2021-11-15T19:35:16.599 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:16.599 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":130,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:16.432598+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:15.202823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:15.395889+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:16.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ef40534f0 msgr2=0x7f7ef40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ef40534f0 0x7f7ef40559b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f7f0000d000 tx=0x7f7f00008040).stop 2021-11-15T19:35:16.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 msgr2=0x7f7f10159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 0x7f7f10159ce0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f7f10147c40 tx=0x7f7f08013000).stop 2021-11-15T19:35:16.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 shutdown_connections 2021-11-15T19:35:16.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7ef40534f0 0x7f7ef40559b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7f101570d0 0x7f7f10159ce0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7f10156760 0x7f7f10156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 --2- 172.21.2.137:0/1308527 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7ef0004f90 0x7f7f10144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 >> 172.21.2.137:0/1308527 conn(0x7f7f100b4e60 msgr2=0x7f7f100af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 shutdown_connections 2021-11-15T19:35:16.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.589+0000 7f7f15702700 1 -- 172.21.2.137:0/1308527 wait complete. 2021-11-15T19:35:16.607 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:16.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f627daa4700 1 Processor -- start 2021-11-15T19:35:16.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f627daa4700 1 -- start start 2021-11-15T19:35:16.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f627daa4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62780608f0 0x7f627813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f627daa4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62780b0c80 con 0x7f627805f730 2021-11-15T19:35:16.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f627daa4700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62780b0f20 con 0x7f62780b1660 2021-11-15T19:35:16.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f627daa4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62780ad6c0 con 0x7f62780608f0 2021-11-15T19:35:16.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f6276ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f62780b1660 0x7f62780b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58576/0 (socket says 172.21.2.137:58576) 2021-11-15T19:35:16.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f6276ffd700 1 -- 172.21.2.137:0/93603154 learned_addr learned my addr 172.21.2.137:0/93603154 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:16.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.645+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032758641 0 0) 0x7f62780b0f20 con 0x7f62780b1660 2021-11-15T19:35:16.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003260 con 0x7f62780b1660 2021-11-15T19:35:16.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1469757576 0 0) 0x7f6258003260 con 0x7f62780b1660 2021-11-15T19:35:16.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62780608f0 msgr2=0x7f627813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62780608f0 0x7f627813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 >> v1:172.21.2.111:6789/0 conn(0x7f627805f730 legacy=0x7f627814a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62780b11c0 con 0x7f62780b1660 2021-11-15T19:35:16.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f6260001660 con 0x7f62780b1660 2021-11-15T19:35:16.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 >> v1:172.21.2.137:6789/0 conn(0x7f62780b1660 legacy=0x7f62780b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f6258003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62780608f0 0x7f6258004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6258004b40 0x7f6258004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62780ad6c0 con 0x7f6258004b40 2021-11-15T19:35:16.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625800b9b0 con 0x7f62580037d0 2021-11-15T19:35:16.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625800bb70 con 0x7f62780608f0 2021-11-15T19:35:16.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f6258003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62780608f0 msgr2=0x7f6258004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f62780608f0 0x7f6258004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6258004b40 msgr2=0x7f6258004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:16.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6258004b40 0x7f6258004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/93603154 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258003260 con 0x7f62580037d0 2021-11-15T19:35:16.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f6258003bd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f6268002f70 tx=0x7f6268006ca0).ready entity=mon.1 client_cookie=37ee364b90a510fe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6268012410 con 0x7f62580037d0 2021-11-15T19:35:16.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268012570 con 0x7f62580037d0 2021-11-15T19:35:16.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62767fc700 1 -- 172.21.2.137:0/93603154 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62680128d0 con 0x7f62580037d0 2021-11-15T19:35:16.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/93603154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 msgr2=0x7f6258003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 --2- 172.21.2.137:0/93603154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f6258003bd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f6268002f70 tx=0x7f6268006ca0).stop 2021-11-15T19:35:16.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f6277fff700 1 -- 172.21.2.137:0/93603154 reap_dead start 2021-11-15T19:35:16.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/93603154 shutdown_connections 2021-11-15T19:35:16.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/93603154 >> 172.21.2.137:0/93603154 conn(0x7f6278063980 msgr2=0x7f6278063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/93603154 shutdown_connections 2021-11-15T19:35:16.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/93603154 wait complete. 2021-11-15T19:35:16.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 Processor -- start 2021-11-15T19:35:16.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- start start 2021-11-15T19:35:16.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f627805c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6278139fa0 0x7f6278156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62781571a0 0x7f62781598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62781562f0 con 0x7f62781571a0 2021-11-15T19:35:16.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278156570 con 0x7f62580037d0 2021-11-15T19:35:16.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6278156810 con 0x7f6278139fa0 2021-11-15T19:35:16.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f627805c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f627805c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39804/0 (socket says 172.21.2.137:39804) 2021-11-15T19:35:16.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/3395248950 learned_addr learned my addr 172.21.2.137:0/3395248950 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:16.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6278139fa0 msgr2=0x7f6278156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6278139fa0 0x7f6278156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62781571a0 msgr2=0x7f62781598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62781571a0 0x7f62781598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 -- 172.21.2.137:0/3395248950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278141cf0 con 0x7f62580037d0 2021-11-15T19:35:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f62777fe700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f627805c060 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f6268002f70 tx=0x7f6268015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6268012410 con 0x7f62580037d0 2021-11-15T19:35:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268011e40 con 0x7f62580037d0 2021-11-15T19:35:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626801e670 con 0x7f62580037d0 2021-11-15T19:35:16.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278141ee0 con 0x7f62580037d0 2021-11-15T19:35:16.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6278142df0 con 0x7f62580037d0 2021-11-15T19:35:16.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.649+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62780b1ac0 con 0x7f62580037d0 2021-11-15T19:35:16.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.653+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f626800f030 con 0x7f62580037d0 2021-11-15T19:35:16.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.653+0000 7f6274ff9700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f625c0534f0 0x7f625c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.653+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f626806c930 con 0x7f62580037d0 2021-11-15T19:35:16.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.653+0000 7f6276ffd700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f625c0534f0 0x7f625c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.653+0000 7f6276ffd700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f625c0534f0 0x7f625c0559b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f62780b3ac0 tx=0x7f6260001590).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.653+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6268043a90 con 0x7f62580037d0 2021-11-15T19:35:16.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62780573d0 con 0x7f62580037d0 2021-11-15T19:35:16.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f6274ff9700 1 -- 172.21.2.137:0/3395248950 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f62680470b0 con 0x7f62580037d0 2021-11-15T19:35:16.749 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:16.750 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":130,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:16.432598+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:15.202823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:15.395889+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:16.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f625c0534f0 msgr2=0x7f625c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f625c0534f0 0x7f625c0559b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f62780b3ac0 tx=0x7f6260001590).stop 2021-11-15T19:35:16.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 msgr2=0x7f627805c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f627805c060 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f6268002f70 tx=0x7f6268015000).stop 2021-11-15T19:35:16.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 shutdown_connections 2021-11-15T19:35:16.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f625c0534f0 0x7f625c0559b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f62781571a0 0x7f62781598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6278139fa0 0x7f6278156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 --2- 172.21.2.137:0/3395248950 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f62580037d0 0x7f627805c060 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 >> 172.21.2.137:0/3395248950 conn(0x7f6278063980 msgr2=0x7f6278128b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 shutdown_connections 2021-11-15T19:35:16.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.737+0000 7f627daa4700 1 -- 172.21.2.137:0/3395248950 wait complete. 2021-11-15T19:35:16.757 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:35:16.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 Processor -- start 2021-11-15T19:35:16.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 -- start start 2021-11-15T19:35:16.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f83d80b72e0 0x7f83d80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f83d80ad320 0x7f83d81290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80b76c0 con 0x7f83d80acd60 2021-11-15T19:35:16.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80b3100 con 0x7f83d80ad320 2021-11-15T19:35:16.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83dd0cc700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d812a170 con 0x7f83d80b72e0 2021-11-15T19:35:16.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83d6d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f83d80b72e0 0x7f83d80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83d6d9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f83d80b72e0 0x7f83d80b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39812/0 (socket says 172.21.2.137:39812) 2021-11-15T19:35:16.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.797+0000 7f83d6d9d700 1 -- 172.21.2.137:0/1858651221 learned_addr learned my addr 172.21.2.137:0/1858651221 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:16.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d6d9d700 1 -- 172.21.2.137:0/1858651221 >> v2:172.21.2.111:3300/0 conn(0x7f83d80ad320 msgr2=0x7f83d81290c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:16.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d6d9d700 1 --2- 172.21.2.137:0/1858651221 >> v2:172.21.2.111:3300/0 conn(0x7f83d80ad320 0x7f83d81290c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d6d9d700 1 -- 172.21.2.137:0/1858651221 >> v1:172.21.2.111:6789/0 conn(0x7f83d80acd60 legacy=0x7f83d80b4190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:16.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d6d9d700 1 -- 172.21.2.137:0/1858651221 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80ad8a0 con 0x7f83d80b72e0 2021-11-15T19:35:16.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d6d9d700 1 --2- 172.21.2.137:0/1858651221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b19b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f83d8065c40 tx=0x7f83c0006eb0).ready entity=mon.1 client_cookie=4d0d5e541d2395ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d5d9b700 1 -- 172.21.2.137:0/1858651221 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c000d5c0 con 0x7f83d80b72e0 2021-11-15T19:35:16.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d5d9b700 1 -- 172.21.2.137:0/1858651221 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0000e90 con 0x7f83d80b72e0 2021-11-15T19:35:16.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d5d9b700 1 -- 172.21.2.137:0/1858651221 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c000d910 con 0x7f83d80b72e0 2021-11-15T19:35:16.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/1858651221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 msgr2=0x7f83d80b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/1858651221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b19b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f83d8065c40 tx=0x7f83c0006eb0).stop 2021-11-15T19:35:16.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/1858651221 shutdown_connections 2021-11-15T19:35:16.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/1858651221 >> v2:172.21.2.111:3300/0 conn(0x7f83d80ad320 0x7f83d81290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/1858651221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b19b0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:16.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/1858651221 >> 172.21.2.137:0/1858651221 conn(0x7f83d8064960 msgr2=0x7f83d8064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:16.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/1858651221 shutdown_connections 2021-11-15T19:35:16.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/1858651221 wait complete. 2021-11-15T19:35:16.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 Processor -- start 2021-11-15T19:35:16.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- start start 2021-11-15T19:35:16.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83d80acd60 0x7f83d813f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83d80ad320 0x7f83d80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d813a470 con 0x7f83d80acd60 2021-11-15T19:35:16.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80b08e0 con 0x7f83d80b72e0 2021-11-15T19:35:16.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d813cbf0 con 0x7f83d80ad320 2021-11-15T19:35:16.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39822/0 (socket says 172.21.2.137:39822) 2021-11-15T19:35:16.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 -- 172.21.2.137:0/388020797 learned_addr learned my addr 172.21.2.137:0/388020797 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:16.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 -- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83d80ad320 msgr2=0x7f83d80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83d80ad320 0x7f83d80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 -- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83d80acd60 msgr2=0x7f83d813f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:16.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83d80acd60 0x7f83d813f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:16.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 -- 172.21.2.137:0/388020797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c000b1e0 con 0x7f83d80b72e0 2021-11-15T19:35:16.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83d759e700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b0f60 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f83d0003330 tx=0x7f83d00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d0001520 con 0x7f83d80b72e0 2021-11-15T19:35:16.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0001680 con 0x7f83d80b72e0 2021-11-15T19:35:16.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d8143420 con 0x7f83d80b72e0 2021-11-15T19:35:16.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d8144260 con 0x7f83d80b72e0 2021-11-15T19:35:16.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d00019e0 con 0x7f83d80b72e0 2021-11-15T19:35:16.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.801+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d80b3a50 con 0x7f83d80b72e0 2021-11-15T19:35:16.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.805+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83d0018030 con 0x7f83d80b72e0 2021-11-15T19:35:16.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.805+0000 7f83cffff700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83bc0536a0 0x7f83bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:16.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.805+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f83d006b320 con 0x7f83d80b72e0 2021-11-15T19:35:16.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.805+0000 7f83d6d9d700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83bc0536a0 0x7f83bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:16.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.805+0000 7f83d6d9d700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83bc0536a0 0x7f83bc055b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f83d8065c40 tx=0x7f83c0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:16.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.805+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83d0042530 con 0x7f83d80b72e0 2021-11-15T19:35:16.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:16.917+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83d81435b0 con 0x7f83d80b72e0 2021-11-15T19:35:17.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83cffff700 1 -- 172.21.2.137:0/388020797 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83d0045b50 con 0x7f83d80b72e0 2021-11-15T19:35:17.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83bc0536a0 msgr2=0x7f83bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83bc0536a0 0x7f83bc055b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f83d8065c40 tx=0x7f83c0015000).stop 2021-11-15T19:35:17.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 msgr2=0x7f83d80b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b0f60 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f83d0003330 tx=0x7f83d00091a0).stop 2021-11-15T19:35:17.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 shutdown_connections 2021-11-15T19:35:17.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f83bc0536a0 0x7f83bc055b60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f83d80b72e0 0x7f83d80b0f60 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f83d80ad320 0x7f83d80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 --2- 172.21.2.137:0/388020797 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f83d80acd60 0x7f83d813f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 >> 172.21.2.137:0/388020797 conn(0x7f83d8064960 msgr2=0x7f83d80b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 shutdown_connections 2021-11-15T19:35:17.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.449+0000 7f83dd0cc700 1 -- 172.21.2.137:0/388020797 wait complete. 2021-11-15T19:35:17.471 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:17.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.509+0000 7f1bd7465700 1 Processor -- start 2021-11-15T19:35:17.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.509+0000 7f1bd7465700 1 -- start start 2021-11-15T19:35:17.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bd01493f0 0x7f1bd014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd0097c50 con 0x7f1bd00ac3c0 2021-11-15T19:35:17.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd00aceb0 con 0x7f1bd00b2d50 2021-11-15T19:35:17.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00ac120 con 0x7f1bd01493f0 2021-11-15T19:35:17.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd4a00700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1bd00b2d50 0x7f1bd005f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58622/0 (socket says 172.21.2.137:58622) 2021-11-15T19:35:17.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd4a00700 1 -- 172.21.2.137:0/2381735378 learned_addr learned my addr 172.21.2.137:0/2381735378 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:17.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bd01493f0 0x7f1bd014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880499449 0 0) 0x7f1bd00aceb0 con 0x7f1bd00b2d50 2021-11-15T19:35:17.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb8003260 con 0x7f1bd00b2d50 2021-11-15T19:35:17.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333751479 0 0) 0x7f1bb8003260 con 0x7f1bd00b2d50 2021-11-15T19:35:17.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bd01493f0 msgr2=0x7f1bd014b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bd01493f0 0x7f1bd014b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 >> v1:172.21.2.111:6789/0 conn(0x7f1bd00ac3c0 legacy=0x7f1bd00ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0061100 con 0x7f1bd00b2d50 2021-11-15T19:35:17.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1bc0001660 con 0x7f1bd00b2d50 2021-11-15T19:35:17.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 >> v1:172.21.2.137:6789/0 conn(0x7f1bd00b2d50 legacy=0x7f1bd005f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8003750 0x7f1bb8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bb8004060 0x7f1bb8004540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bb8004cf0 0x7f1bb800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb800bc40 con 0x7f1bb8004060 2021-11-15T19:35:17.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb800bd80 con 0x7f1bb8004cf0 2021-11-15T19:35:17.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb800bef0 con 0x7f1bb8003750 2021-11-15T19:35:17.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bb8004cf0 0x7f1bb800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5201700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8003750 0x7f1bb8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd4a00700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bb8004060 0x7f1bb8004540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 -- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8003750 msgr2=0x7f1bb8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8003750 0x7f1bb8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 -- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bb8004060 msgr2=0x7f1bb8004540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bb8004060 0x7f1bb8004540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 -- 172.21.2.137:0/2381735378 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0061100 con 0x7f1bb8004cf0 2021-11-15T19:35:17.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bb8004cf0 0x7f1bb800b750 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f1bc800c000 tx=0x7f1bc80091d0).ready entity=mon.1 client_cookie=a2041c776fc3d2c6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc800e610 con 0x7f1bb8004cf0 2021-11-15T19:35:17.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800e770 con 0x7f1bb8004cf0 2021-11-15T19:35:17.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bbffff700 1 -- 172.21.2.137:0/2381735378 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc800ead0 con 0x7f1bb8004cf0 2021-11-15T19:35:17.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- 172.21.2.137:0/2381735378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bb8004cf0 msgr2=0x7f1bb800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 --2- 172.21.2.137:0/2381735378 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bb8004cf0 0x7f1bb800b750 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f1bc800c000 tx=0x7f1bc80091d0).stop 2021-11-15T19:35:17.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd5a02700 1 -- 172.21.2.137:0/2381735378 reap_dead start 2021-11-15T19:35:17.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- 172.21.2.137:0/2381735378 shutdown_connections 2021-11-15T19:35:17.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- 172.21.2.137:0/2381735378 >> 172.21.2.137:0/2381735378 conn(0x7f1bd00b7070 msgr2=0x7f1bd00b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- 172.21.2.137:0/2381735378 shutdown_connections 2021-11-15T19:35:17.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- 172.21.2.137:0/2381735378 wait complete. 2021-11-15T19:35:17.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 Processor -- start 2021-11-15T19:35:17.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- start start 2021-11-15T19:35:17.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8004cf0 0x7f1bd0142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bd01440b0 0x7f1bd0153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 0x7f1bd0143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0153ad0 con 0x7f1bd01440b0 2021-11-15T19:35:17.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0153d70 con 0x7f1bd013fb30 2021-11-15T19:35:17.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.513+0000 7f1bd7465700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0154010 con 0x7f1bb8004cf0 2021-11-15T19:35:17.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 0x7f1bd0143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 0x7f1bd0143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39854/0 (socket says 172.21.2.137:39854) 2021-11-15T19:35:17.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 -- 172.21.2.137:0/1553594875 learned_addr learned my addr 172.21.2.137:0/1553594875 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:17.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5201700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8004cf0 0x7f1bd0142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd4a00700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bd01440b0 0x7f1bd0153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 -- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8004cf0 msgr2=0x7f1bd0142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8004cf0 0x7f1bd0142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 -- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bd01440b0 msgr2=0x7f1bd0153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bd01440b0 0x7f1bd0153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 -- 172.21.2.137:0/1553594875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd013ffb0 con 0x7f1bd013fb30 2021-11-15T19:35:17.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5a02700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 0x7f1bd0143760 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f1bc0001430 tx=0x7f1bc801a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc800e610 con 0x7f1bd013fb30 2021-11-15T19:35:17.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc801de50 con 0x7f1bd013fb30 2021-11-15T19:35:17.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd0143c50 con 0x7f1bd013fb30 2021-11-15T19:35:17.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc801b640 con 0x7f1bd013fb30 2021-11-15T19:35:17.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd0139080 con 0x7f1bd013fb30 2021-11-15T19:35:17.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd0153900 con 0x7f1bd013fb30 2021-11-15T19:35:17.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1bc801b7a0 con 0x7f1bd013fb30 2021-11-15T19:35:17.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bbe7fc700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bb00535b0 0x7f1bb0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1bc806d870 con 0x7f1bd013fb30 2021-11-15T19:35:17.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5201700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bb00535b0 0x7f1bb0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.517+0000 7f1bd5201700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bb00535b0 0x7f1bb0055a70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f1bcc00d000 tx=0x7f1bcc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.521+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1bc8044a10 con 0x7f1bd013fb30 2021-11-15T19:35:17.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.629+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bd00979b0 con 0x7f1bd013fb30 2021-11-15T19:35:17.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bbe7fc700 1 -- 172.21.2.137:0/1553594875 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f1bc8016020 con 0x7f1bd013fb30 2021-11-15T19:35:17.643 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:17.643 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:17.458003+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7969":{"gid":7969,"name":"a","rank":0,"incarnation":67,"state":"up:creating","state_seq":2,"addr":"172.21.2.137:6833/4213511213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4213511213},{"type":"v1","addr":"172.21.2.137:6833","nonce":4213511213}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:17.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bb00535b0 msgr2=0x7f1bb0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bb00535b0 0x7f1bb0055a70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f1bcc00d000 tx=0x7f1bcc009040).stop 2021-11-15T19:35:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 msgr2=0x7f1bd0143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 0x7f1bd0143760 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f1bc0001430 tx=0x7f1bc801a000).stop 2021-11-15T19:35:17.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 shutdown_connections 2021-11-15T19:35:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1bb00535b0 0x7f1bb0055a70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1bd013fb30 0x7f1bd0143760 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1bd01440b0 0x7f1bd0153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 --2- 172.21.2.137:0/1553594875 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1bb8004cf0 0x7f1bd0142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 >> 172.21.2.137:0/1553594875 conn(0x7f1bd00b7070 msgr2=0x7f1bd00b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 shutdown_connections 2021-11-15T19:35:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.633+0000 7f1bd7465700 1 -- 172.21.2.137:0/1553594875 wait complete. 2021-11-15T19:35:17.647 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 67 2021-11-15T19:35:17.651 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:17.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 Processor -- start 2021-11-15T19:35:17.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- start start 2021-11-15T19:35:17.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f980c144610 0x7f980c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f980c0a9f50 0x7f980c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c148190 con 0x7f980c0b1340 2021-11-15T19:35:17.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0b1720 con 0x7f980c0a9f50 2021-11-15T19:35:17.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c147e70 con 0x7f980c144610 2021-11-15T19:35:17.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980bfff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f980c0b1340 0x7f980c143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58640/0 (socket says 172.21.2.137:58640) 2021-11-15T19:35:17.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980bfff700 1 -- 172.21.2.137:0/1698232061 learned_addr learned my addr 172.21.2.137:0/1698232061 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:17.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980b7fe700 1 --2- 172.21.2.137:0/1698232061 >> v2:172.21.2.137:3300/0 conn(0x7f980c144610 0x7f980c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980b7fe700 1 -- 172.21.2.137:0/1698232061 >> v2:172.21.2.111:3300/0 conn(0x7f980c0a9f50 msgr2=0x7f980c0aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:17.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980b7fe700 1 --2- 172.21.2.137:0/1698232061 >> v2:172.21.2.111:3300/0 conn(0x7f980c0a9f50 0x7f980c0aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980b7fe700 1 -- 172.21.2.137:0/1698232061 >> v1:172.21.2.137:6789/0 conn(0x7f980c0b1340 legacy=0x7f980c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980b7fe700 1 -- 172.21.2.137:0/1698232061 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0af800 con 0x7f980c144610 2021-11-15T19:35:17.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980b7fe700 1 --2- 172.21.2.137:0/1698232061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c144610 0x7f980c147980 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f97fc002f70 tx=0x7f97fc006df0).ready entity=mon.1 client_cookie=343bfe3e4c723272 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980affd700 1 -- 172.21.2.137:0/1698232061 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97fc00d5c0 con 0x7f980c144610 2021-11-15T19:35:17.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980affd700 1 -- 172.21.2.137:0/1698232061 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc000e90 con 0x7f980c144610 2021-11-15T19:35:17.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f980affd700 1 -- 172.21.2.137:0/1698232061 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97fc00d950 con 0x7f980c144610 2021-11-15T19:35:17.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- 172.21.2.137:0/1698232061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c144610 msgr2=0x7f980c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 --2- 172.21.2.137:0/1698232061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c144610 0x7f980c147980 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f97fc002f70 tx=0x7f97fc006df0).stop 2021-11-15T19:35:17.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- 172.21.2.137:0/1698232061 shutdown_connections 2021-11-15T19:35:17.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 --2- 172.21.2.137:0/1698232061 >> v2:172.21.2.111:3300/0 conn(0x7f980c0a9f50 0x7f980c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 --2- 172.21.2.137:0/1698232061 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c144610 0x7f980c147980 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- 172.21.2.137:0/1698232061 >> 172.21.2.137:0/1698232061 conn(0x7f980c0b4e60 msgr2=0x7f980c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- 172.21.2.137:0/1698232061 shutdown_connections 2021-11-15T19:35:17.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.689+0000 7f9812396700 1 -- 172.21.2.137:0/1698232061 wait complete. 2021-11-15T19:35:17.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 Processor -- start 2021-11-15T19:35:17.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- start start 2021-11-15T19:35:17.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 0x7f980c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f980c0b1340 0x7f980c142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f980c144610 0x7f980c142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0996a0 con 0x7f980c0b1340 2021-11-15T19:35:17.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c143040 con 0x7f980c0a9f50 2021-11-15T19:35:17.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c14ac70 con 0x7f980c144610 2021-11-15T19:35:17.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 0x7f980c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 0x7f980c0ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39864/0 (socket says 172.21.2.137:39864) 2021-11-15T19:35:17.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 -- 172.21.2.137:0/697079782 learned_addr learned my addr 172.21.2.137:0/697079782 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:17.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 -- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f980c144610 msgr2=0x7f980c142b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:17.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f980c144610 0x7f980c142b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 -- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f980c0b1340 msgr2=0x7f980c142660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:17.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f980c0b1340 0x7f980c142660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 -- 172.21.2.137:0/697079782 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc00b180 con 0x7f980c0a9f50 2021-11-15T19:35:17.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980bfff700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 0x7f980c0ae6f0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f980c062250 tx=0x7f97f4007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f400ce30 con 0x7f980c0a9f50 2021-11-15T19:35:17.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40072e0 con 0x7f980c0a9f50 2021-11-15T19:35:17.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c14af10 con 0x7f980c0a9f50 2021-11-15T19:35:17.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f4005800 con 0x7f980c0a9f50 2021-11-15T19:35:17.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c097df0 con 0x7f980c0a9f50 2021-11-15T19:35:17.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c05faf0 con 0x7f980c0a9f50 2021-11-15T19:35:17.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97f4010070 con 0x7f980c0a9f50 2021-11-15T19:35:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f98097fa700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97f0053640 0x7f97f0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f97f406ad60 con 0x7f980c0a9f50 2021-11-15T19:35:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.693+0000 7f980b7fe700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97f0053640 0x7f97f0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.697+0000 7f980b7fe700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97f0053640 0x7f97f0055b00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f97fc002f70 tx=0x7f97fc014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.697+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97f4041ec0 con 0x7f980c0a9f50 2021-11-15T19:35:17.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980c148190 con 0x7f980c0a9f50 2021-11-15T19:35:17.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f98097fa700 1 -- 172.21.2.137:0/697079782 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f980c148190 con 0x7f980c0a9f50 2021-11-15T19:35:17.793 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:17.793 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":131,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:17.437552+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:15.202823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:15.395889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:17.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97f0053640 msgr2=0x7f97f0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97f0053640 0x7f97f0055b00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f97fc002f70 tx=0x7f97fc014000).stop 2021-11-15T19:35:17.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 msgr2=0x7f980c0ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 0x7f980c0ae6f0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f980c062250 tx=0x7f97f4007ca0).stop 2021-11-15T19:35:17.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 shutdown_connections 2021-11-15T19:35:17.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f97f0053640 0x7f97f0055b00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f980c144610 0x7f980c142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f980c0b1340 0x7f980c142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 --2- 172.21.2.137:0/697079782 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f980c0a9f50 0x7f980c0ae6f0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 >> 172.21.2.137:0/697079782 conn(0x7f980c0b4e60 msgr2=0x7f980c13eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 shutdown_connections 2021-11-15T19:35:17.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.781+0000 7f9812396700 1 -- 172.21.2.137:0/697079782 wait complete. 2021-11-15T19:35:17.801 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:35:17.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 Processor -- start 2021-11-15T19:35:17.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- start start 2021-11-15T19:35:17.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f612c0b25b0 0x7f612c0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0b2990 con 0x7f612c143170 2021-11-15T19:35:17.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c13f2f0 con 0x7f612c069e70 2021-11-15T19:35:17.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c13f590 con 0x7f612c0b25b0 2021-11-15T19:35:17.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f612c069e70 0x7f612c0b0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58656/0 (socket says 172.21.2.137:58656) 2021-11-15T19:35:17.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 -- 172.21.2.137:0/4021369400 learned_addr learned my addr 172.21.2.137:0/4021369400 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:17.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115413282 0 0) 0x7f612c13f2f0 con 0x7f612c069e70 2021-11-15T19:35:17.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6114003260 con 0x7f612c069e70 2021-11-15T19:35:17.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2190211865 0 0) 0x7f6114003260 con 0x7f612c069e70 2021-11-15T19:35:17.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 >> v2:172.21.2.111:3300/0 conn(0x7f612c0b25b0 msgr2=0x7f612c0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 --2- 172.21.2.137:0/4021369400 >> v2:172.21.2.111:3300/0 conn(0x7f612c0b25b0 0x7f612c0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 >> v1:172.21.2.111:6789/0 conn(0x7f612c143170 legacy=0x7f612c13fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c13f830 con 0x7f612c069e70 2021-11-15T19:35:17.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f61240019e0 con 0x7f612c069e70 2021-11-15T19:35:17.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 >> v1:172.21.2.137:6789/0 conn(0x7f612c069e70 legacy=0x7f612c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114003820 0x7f6114003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6114004500 0x7f6114004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6114005050 0x7f611400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c13f590 con 0x7f6114004500 2021-11-15T19:35:17.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611400bf40 con 0x7f6114005050 2021-11-15T19:35:17.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611400c100 con 0x7f6114003820 2021-11-15T19:35:17.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6114005050 0x7f611400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 -- 172.21.2.137:0/4021369400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114003820 msgr2=0x7f6114003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114003820 0x7f6114003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 -- 172.21.2.137:0/4021369400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6114004500 msgr2=0x7f6114004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:17.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6114004500 0x7f6114004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 -- 172.21.2.137:0/4021369400 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114003260 con 0x7f6114005050 2021-11-15T19:35:17.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 -- 172.21.2.137:0/4021369400 reap_dead start 2021-11-15T19:35:17.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f61322c9700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6114005050 0x7f611400b750 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f612c0b00d0 tx=0x7f612c0ad9a0).ready entity=mon.1 client_cookie=8b1324757f3304aa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612400cc60 con 0x7f6114005050 2021-11-15T19:35:17.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612400cdc0 con 0x7f6114005050 2021-11-15T19:35:17.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6130ac6700 1 -- 172.21.2.137:0/4021369400 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6124005b80 con 0x7f6114005050 2021-11-15T19:35:17.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- 172.21.2.137:0/4021369400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6114005050 msgr2=0x7f611400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6114005050 0x7f611400b750 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f612c0b00d0 tx=0x7f612c0ad9a0).stop 2021-11-15T19:35:17.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- 172.21.2.137:0/4021369400 shutdown_connections 2021-11-15T19:35:17.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 --2- 172.21.2.137:0/4021369400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6114005050 0x7f611400b750 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- 172.21.2.137:0/4021369400 >> 172.21.2.137:0/4021369400 conn(0x7f612c063200 msgr2=0x7f612c063610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- 172.21.2.137:0/4021369400 shutdown_connections 2021-11-15T19:35:17.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.845+0000 7f6133d2c700 1 -- 172.21.2.137:0/4021369400 wait complete. 2021-11-15T19:35:17.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 Processor -- start 2021-11-15T19:35:17.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- start start 2021-11-15T19:35:17.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114005050 0x7f612c14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f612c156090 0x7f612c156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 0x7f612c0654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1599c0 con 0x7f612c156090 2021-11-15T19:35:17.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c159c60 con 0x7f612c156a00 2021-11-15T19:35:17.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c159f00 con 0x7f6114005050 2021-11-15T19:35:17.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 0x7f612c0654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 0x7f612c0654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39884/0 (socket says 172.21.2.137:39884) 2021-11-15T19:35:17.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 -- 172.21.2.137:0/230650225 learned_addr learned my addr 172.21.2.137:0/230650225 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:17.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 -- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114005050 msgr2=0x7f612c14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114005050 0x7f612c14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 -- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f612c156090 msgr2=0x7f612c156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f612c156090 0x7f612c156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 -- 172.21.2.137:0/230650225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c156e80 con 0x7f612c156a00 2021-11-15T19:35:17.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f61322c9700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 0x7f612c0654c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f612c0b00d0 tx=0x7f6124015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6124001ec0 con 0x7f612c156a00 2021-11-15T19:35:17.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240072e0 con 0x7f612c156a00 2021-11-15T19:35:17.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c159640 con 0x7f612c156a00 2021-11-15T19:35:17.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c0679f0 con 0x7f612c156a00 2021-11-15T19:35:17.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6124007640 con 0x7f612c156a00 2021-11-15T19:35:17.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c13efb0 con 0x7f612c156a00 2021-11-15T19:35:17.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f612401d070 con 0x7f612c156a00 2021-11-15T19:35:17.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f611effd700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f610c053690 0x7f610c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:17.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f612406c790 con 0x7f612c156a00 2021-11-15T19:35:17.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.849+0000 7f6131ac8700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f610c053690 0x7f610c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:17.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.853+0000 7f6131ac8700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f610c053690 0x7f610c055b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6128002f70 tx=0x7f6128006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:17.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.853+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61240437e0 con 0x7f612c156a00 2021-11-15T19:35:17.973 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.961+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f612c0573d0 con 0x7f612c156a00 2021-11-15T19:35:17.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.973+0000 7f611effd700 1 -- 172.21.2.137:0/230650225 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f612401a020 con 0x7f612c156a00 2021-11-15T19:35:17.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f610c053690 msgr2=0x7f610c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f610c053690 0x7f610c055b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6128002f70 tx=0x7f6128006a00).stop 2021-11-15T19:35:17.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 msgr2=0x7f612c0654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:17.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 0x7f612c0654c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f612c0b00d0 tx=0x7f6124015000).stop 2021-11-15T19:35:17.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 shutdown_connections 2021-11-15T19:35:17.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f610c053690 0x7f610c055b50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f612c156a00 0x7f612c0654c0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:17.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f612c156090 0x7f612c156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 --2- 172.21.2.137:0/230650225 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6114005050 0x7f612c14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:17.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 >> 172.21.2.137:0/230650225 conn(0x7f612c063200 msgr2=0x7f612c0b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:17.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 shutdown_connections 2021-11-15T19:35:17.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:17.977+0000 7f6133d2c700 1 -- 172.21.2.137:0/230650225 wait complete. 2021-11-15T19:35:17.991 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:35:17.994 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:35:18.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 Processor -- start 2021-11-15T19:35:18.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 -- start start 2021-11-15T19:35:18.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8c6c0b2c30 0x7f8c6c0997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0969e0 0x7f8c6c097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0aca80 con 0x7f8c6c097260 2021-11-15T19:35:18.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0ad150 con 0x7f8c6c0b2c30 2021-11-15T19:35:18.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c71a99700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0accb0 con 0x7f8c6c0969e0 2021-11-15T19:35:18.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8c6c0b2c30 0x7f8c6c0997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8c6c097260 0x7f8c6c0990e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58674/0 (socket says 172.21.2.137:58674) 2021-11-15T19:35:18.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6b7fe700 1 -- 172.21.2.137:0/1308229532 learned_addr learned my addr 172.21.2.137:0/1308229532 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:18.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6affd700 1 -- 172.21.2.137:0/1308229532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0969e0 msgr2=0x7f8c6c097640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:18.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6affd700 1 --2- 172.21.2.137:0/1308229532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0969e0 0x7f8c6c097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6affd700 1 -- 172.21.2.137:0/1308229532 >> v1:172.21.2.137:6789/0 conn(0x7f8c6c097260 legacy=0x7f8c6c0990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6affd700 1 -- 172.21.2.137:0/1308229532 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c097c50 con 0x7f8c6c0b2c30 2021-11-15T19:35:18.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.037+0000 7f8c6affd700 1 --2- 172.21.2.137:0/1308229532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c0b2c30 0x7f8c6c0997f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f8c54002f70 tx=0x7f8c54006df0).ready entity=mon.1 client_cookie=ccbb913129876da8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6a7fc700 1 -- 172.21.2.137:0/1308229532 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c5400d570 con 0x7f8c6c0b2c30 2021-11-15T19:35:18.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6a7fc700 1 -- 172.21.2.137:0/1308229532 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54000e90 con 0x7f8c6c0b2c30 2021-11-15T19:35:18.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6a7fc700 1 -- 172.21.2.137:0/1308229532 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c5400d900 con 0x7f8c6c0b2c30 2021-11-15T19:35:18.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/1308229532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c0b2c30 msgr2=0x7f8c6c0997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 --2- 172.21.2.137:0/1308229532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c0b2c30 0x7f8c6c0997f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f8c54002f70 tx=0x7f8c54006df0).stop 2021-11-15T19:35:18.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/1308229532 shutdown_connections 2021-11-15T19:35:18.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 --2- 172.21.2.137:0/1308229532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c0b2c30 0x7f8c6c0997f0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 --2- 172.21.2.137:0/1308229532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0969e0 0x7f8c6c097640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/1308229532 >> 172.21.2.137:0/1308229532 conn(0x7f8c6c0b7070 msgr2=0x7f8c6c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/1308229532 shutdown_connections 2021-11-15T19:35:18.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/1308229532 wait complete. 2021-11-15T19:35:18.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 Processor -- start 2021-11-15T19:35:18.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- start start 2021-11-15T19:35:18.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c6c0969e0 0x7f8c6c065db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 0x7f8c6c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0b2c30 0x7f8c6c0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c066fb0 con 0x7f8c6c0969e0 2021-11-15T19:35:18.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c09cd00 con 0x7f8c6c097260 2021-11-15T19:35:18.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0b14e0 con 0x7f8c6c0b2c30 2021-11-15T19:35:18.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 0x7f8c6c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 0x7f8c6c0aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39898/0 (socket says 172.21.2.137:39898) 2021-11-15T19:35:18.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 -- 172.21.2.137:0/2740859600 learned_addr learned my addr 172.21.2.137:0/2740859600 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:18.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 -- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0b2c30 msgr2=0x7f8c6c0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0b2c30 0x7f8c6c0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 -- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c6c0969e0 msgr2=0x7f8c6c065db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c6c0969e0 0x7f8c6c065db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 -- 172.21.2.137:0/2740859600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5400b180 con 0x7f8c6c097260 2021-11-15T19:35:18.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6affd700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 0x7f8c6c0aefa0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f8c54002f70 tx=0x7f8c54015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c54011790 con 0x7f8c6c097260 2021-11-15T19:35:18.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c540118f0 con 0x7f8c6c097260 2021-11-15T19:35:18.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c064d20 con 0x7f8c6c097260 2021-11-15T19:35:18.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c141ae0 con 0x7f8c6c097260 2021-11-15T19:35:18.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c54011c50 con 0x7f8c6c097260 2021-11-15T19:35:18.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c0573d0 con 0x7f8c6c097260 2021-11-15T19:35:18.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c54025030 con 0x7f8c6c097260 2021-11-15T19:35:18.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c68ff9700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c50053660 0x7f8c50055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8c5406cb00 con 0x7f8c6c097260 2021-11-15T19:35:18.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.041+0000 7f8c6b7fe700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c50053660 0x7f8c50055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.045+0000 7f8c6b7fe700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c50053660 0x7f8c50055b20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f8c6c0b4c10 tx=0x7f8c5c0077d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.045+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c54043c60 con 0x7f8c6c097260 2021-11-15T19:35:18.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.153+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8c6c0990e0 con 0x7f8c6c097260 2021-11-15T19:35:18.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.165+0000 7f8c68ff9700 1 -- 172.21.2.137:0/2740859600 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8c540230e0 con 0x7f8c6c097260 2021-11-15T19:35:18.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c50053660 msgr2=0x7f8c50055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c50053660 0x7f8c50055b20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f8c6c0b4c10 tx=0x7f8c5c0077d0).stop 2021-11-15T19:35:18.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 msgr2=0x7f8c6c0aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 0x7f8c6c0aefa0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f8c54002f70 tx=0x7f8c54015000).stop 2021-11-15T19:35:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 shutdown_connections 2021-11-15T19:35:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c50053660 0x7f8c50055b20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c6c0b2c30 0x7f8c6c0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c6c097260 0x7f8c6c0aefa0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 --2- 172.21.2.137:0/2740859600 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c6c0969e0 0x7f8c6c065db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 >> 172.21.2.137:0/2740859600 conn(0x7f8c6c0b7070 msgr2=0x7f8c6c0993d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 shutdown_connections 2021-11-15T19:35:18.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.169+0000 7f8c71a99700 1 -- 172.21.2.137:0/2740859600 wait complete. 2021-11-15T19:35:18.185 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:35:18.196 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:35:18.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 Processor -- start 2021-11-15T19:35:18.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- start start 2021-11-15T19:35:18.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f4aec05fd20 0x7f4aec0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec147f70 con 0x7f4aec0b10b0 2021-11-15T19:35:18.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec060100 con 0x7f4aec0b0830 2021-11-15T19:35:18.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec147cd0 con 0x7f4aec05fd20 2021-11-15T19:35:18.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeb7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f4aec0b0830 0x7f4aec0aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58688/0 (socket says 172.21.2.137:58688) 2021-11-15T19:35:18.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeb7fe700 1 -- 172.21.2.137:0/2175620215 learned_addr learned my addr 172.21.2.137:0/2175620215 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:18.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeaffd700 1 --2- 172.21.2.137:0/2175620215 >> v2:172.21.2.137:3300/0 conn(0x7f4aec05fd20 0x7f4aec0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4ae9ffb700 1 -- 172.21.2.137:0/2175620215 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271650585 0 0) 0x7f4aec060100 con 0x7f4aec0b0830 2021-11-15T19:35:18.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4ae9ffb700 1 -- 172.21.2.137:0/2175620215 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4acc003260 con 0x7f4aec0b0830 2021-11-15T19:35:18.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeaffd700 1 -- 172.21.2.137:0/2175620215 >> v1:172.21.2.137:6789/0 conn(0x7f4aec0b0830 legacy=0x7f4aec0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeaffd700 1 -- 172.21.2.137:0/2175620215 >> v1:172.21.2.111:6789/0 conn(0x7f4aec0b10b0 legacy=0x7f4aec0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:18.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeaffd700 1 -- 172.21.2.137:0/2175620215 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0a9ed0 con 0x7f4aec05fd20 2021-11-15T19:35:18.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeaffd700 1 --2- 172.21.2.137:0/2175620215 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec05fd20 0x7f4aec0af800 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f4aec0b4db0 tx=0x7f4adc006df0).ready entity=mon.1 client_cookie=27ddc2d080cbadf6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4ae9ffb700 1 -- 172.21.2.137:0/2175620215 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00d5c0 con 0x7f4aec05fd20 2021-11-15T19:35:18.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4ae9ffb700 1 -- 172.21.2.137:0/2175620215 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc000e90 con 0x7f4aec05fd20 2021-11-15T19:35:18.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4ae9ffb700 1 -- 172.21.2.137:0/2175620215 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00d910 con 0x7f4aec05fd20 2021-11-15T19:35:18.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- 172.21.2.137:0/2175620215 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec05fd20 msgr2=0x7f4aec0af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 --2- 172.21.2.137:0/2175620215 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec05fd20 0x7f4aec0af800 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f4aec0b4db0 tx=0x7f4adc006df0).stop 2021-11-15T19:35:18.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- 172.21.2.137:0/2175620215 shutdown_connections 2021-11-15T19:35:18.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 --2- 172.21.2.137:0/2175620215 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec05fd20 0x7f4aec0af800 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- 172.21.2.137:0/2175620215 >> 172.21.2.137:0/2175620215 conn(0x7f4aec0b4e60 msgr2=0x7f4aec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- 172.21.2.137:0/2175620215 shutdown_connections 2021-11-15T19:35:18.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- 172.21.2.137:0/2175620215 wait complete. 2021-11-15T19:35:18.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 Processor -- start 2021-11-15T19:35:18.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- start start 2021-11-15T19:35:18.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aec05fd20 0x7f4aec0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aec0b0830 0x7f4aec098980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 0x7f4aec098e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0675a0 con 0x7f4aec05fd20 2021-11-15T19:35:18.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec097f70 con 0x7f4aec0b10b0 2021-11-15T19:35:18.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4af181b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec067220 con 0x7f4aec0b0830 2021-11-15T19:35:18.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 0x7f4aec098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 0x7f4aec098e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39914/0 (socket says 172.21.2.137:39914) 2021-11-15T19:35:18.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.245+0000 7f4aeb7fe700 1 -- 172.21.2.137:0/2614440910 learned_addr learned my addr 172.21.2.137:0/2614440910 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:18.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeb7fe700 1 -- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aec0b0830 msgr2=0x7f4aec098980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:18.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeb7fe700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aec0b0830 0x7f4aec098980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeb7fe700 1 -- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aec05fd20 msgr2=0x7f4aec0b4150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:18.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeb7fe700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aec05fd20 0x7f4aec0b4150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeb7fe700 1 -- 172.21.2.137:0/2614440910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc00b180 con 0x7f4aec0b10b0 2021-11-15T19:35:18.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeb7fe700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 0x7f4aec098e70 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f4ae4001490 tx=0x7f4ae4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae4005c70 con 0x7f4aec0b10b0 2021-11-15T19:35:18.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4005dd0 con 0x7f4aec0b10b0 2021-11-15T19:35:18.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae40072c0 con 0x7f4aec0b10b0 2021-11-15T19:35:18.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec098410 con 0x7f4aec0b10b0 2021-11-15T19:35:18.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec0639e0 con 0x7f4aec0b10b0 2021-11-15T19:35:18.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec098170 con 0x7f4aec0b10b0 2021-11-15T19:35:18.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4ae4010070 con 0x7f4aec0b10b0 2021-11-15T19:35:18.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4ad0053610 0x7f4ad0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4ae406b2a0 con 0x7f4aec0b10b0 2021-11-15T19:35:18.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeaffd700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4ad0053610 0x7f4ad0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4aeaffd700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4ad0053610 0x7f4ad0055ad0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f4aec0b4db0 tx=0x7f4adc014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.249+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4aec098170 con 0x7f4aec0b10b0 2021-11-15T19:35:18.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.361+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4aec0639e0 con 0x7f4aec0b10b0 2021-11-15T19:35:18.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4ae3fff700 1 -- 172.21.2.137:0/2614440910 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4aec0639e0 con 0x7f4aec0b10b0 2021-11-15T19:35:18.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4ad0053610 msgr2=0x7f4ad0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4ad0053610 0x7f4ad0055ad0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f4aec0b4db0 tx=0x7f4adc014000).stop 2021-11-15T19:35:18.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 msgr2=0x7f4aec098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 0x7f4aec098e70 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f4ae4001490 tx=0x7f4ae4007dc0).stop 2021-11-15T19:35:18.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 shutdown_connections 2021-11-15T19:35:18.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4ad0053610 0x7f4ad0055ad0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4aec0b10b0 0x7f4aec098e70 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4aec0b0830 0x7f4aec098980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 --2- 172.21.2.137:0/2614440910 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f4aec05fd20 0x7f4aec0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 >> 172.21.2.137:0/2614440910 conn(0x7f4aec0b4e60 msgr2=0x7f4aec146090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 shutdown_connections 2021-11-15T19:35:18.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.373+0000 7f4af181b700 1 -- 172.21.2.137:0/2614440910 wait complete. 2021-11-15T19:35:18.389 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:35:18.392 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:18.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.429+0000 7fa06afb1700 1 Processor -- start 2021-11-15T19:35:18.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.429+0000 7fa06afb1700 1 -- start start 2021-11-15T19:35:18.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa0640ac3c0 0x7fa0640ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa0640b2d50 0x7fa0641440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0641445b0 0x7fa064144a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0640ac120 con 0x7fa0640b2d50 2021-11-15T19:35:18.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa064097c50 con 0x7fa0640ac3c0 2021-11-15T19:35:18.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa064144f20 con 0x7fa0641445b0 2021-11-15T19:35:18.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa0640ac3c0 0x7fa0640ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa0640ac3c0 0x7fa0640ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39918/0 (socket says 172.21.2.137:39918) 2021-11-15T19:35:18.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2205321892 learned_addr learned my addr 172.21.2.137:0/2205321892 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:18.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2205321892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0641445b0 msgr2=0x7fa064144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:18.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- 172.21.2.137:0/2205321892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0641445b0 0x7fa064144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2205321892 >> v2:172.21.2.111:3300/0 conn(0x7fa0640b2d50 msgr2=0x7fa0641440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:18.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- 172.21.2.137:0/2205321892 >> v2:172.21.2.111:3300/0 conn(0x7fa0640b2d50 0x7fa0641440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2205321892 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640979b0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- 172.21.2.137:0/2205321892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa0640ac7a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fa054002f70 tx=0x7fa054006eb0).ready entity=mon.1 client_cookie=113160363c82068b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa0637fe700 1 -- 172.21.2.137:0/2205321892 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa054010b60 con 0x7fa0640ac3c0 2021-11-15T19:35:18.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa0637fe700 1 -- 172.21.2.137:0/2205321892 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054000e90 con 0x7fa0640ac3c0 2021-11-15T19:35:18.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa0637fe700 1 -- 172.21.2.137:0/2205321892 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0540183d0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2205321892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 msgr2=0x7fa0640ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2205321892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa0640ac7a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fa054002f70 tx=0x7fa054006eb0).stop 2021-11-15T19:35:18.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2205321892 shutdown_connections 2021-11-15T19:35:18.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2205321892 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa0641445b0 0x7fa064144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2205321892 >> v2:172.21.2.111:3300/0 conn(0x7fa0640b2d50 0x7fa0641440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2205321892 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa0640ac7a0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2205321892 >> 172.21.2.137:0/2205321892 conn(0x7fa0640b7070 msgr2=0x7fa0640b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2205321892 shutdown_connections 2021-11-15T19:35:18.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2205321892 wait complete. 2021-11-15T19:35:18.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 Processor -- start 2021-11-15T19:35:18.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- start start 2021-11-15T19:35:18.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa064062680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0641445b0 0x7fa064141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa064067520 0x7fa0641424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064096930 con 0x7fa0641445b0 2021-11-15T19:35:18.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064066090 con 0x7fa0640ac3c0 2021-11-15T19:35:18.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa064143720 con 0x7fa064067520 2021-11-15T19:35:18.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa064062680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa064062680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39924/0 (socket says 172.21.2.137:39924) 2021-11-15T19:35:18.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2656887441 learned_addr learned my addr 172.21.2.137:0/2656887441 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:18.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa064067520 msgr2=0x7fa0641424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa064067520 0x7fa0641424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0641445b0 msgr2=0x7fa064141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0641445b0 0x7fa064141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 -- 172.21.2.137:0/2656887441 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05400b1e0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa068d4d700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa064062680 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fa054002f70 tx=0x7fa054017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa054006be0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054019d50 con 0x7fa0640ac3c0 2021-11-15T19:35:18.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0641439c0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa054025640 con 0x7fa0640ac3c0 2021-11-15T19:35:18.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.433+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa064065cd0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa064143b50 con 0x7fa0640ac3c0 2021-11-15T19:35:18.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa054022070 con 0x7fa0640ac3c0 2021-11-15T19:35:18.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa061ffb700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa044053640 0x7fa044055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa0540709e0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa063fff700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa044053640 0x7fa044055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa063fff700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa044053640 0x7fa044055b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fa058002f70 tx=0x7fa0580069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.437+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa054047b40 con 0x7fa0640ac3c0 2021-11-15T19:35:18.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.545+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0640573d0 con 0x7fa0640ac3c0 2021-11-15T19:35:18.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa061ffb700 1 -- 172.21.2.137:0/2656887441 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fa05404b160 con 0x7fa0640ac3c0 2021-11-15T19:35:18.560 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:18.560 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":68,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:18.459599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7969":{"gid":7969,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4213511213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4213511213},{"type":"v1","addr":"172.21.2.137:6833","nonce":4213511213}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:18.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa044053640 msgr2=0x7fa044055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa044053640 0x7fa044055b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fa058002f70 tx=0x7fa0580069e0).stop 2021-11-15T19:35:18.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 msgr2=0x7fa064062680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa064062680 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fa054002f70 tx=0x7fa054017000).stop 2021-11-15T19:35:18.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 shutdown_connections 2021-11-15T19:35:18.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa044053640 0x7fa044055b00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa064067520 0x7fa0641424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa0641445b0 0x7fa064141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 --2- 172.21.2.137:0/2656887441 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa0640ac3c0 0x7fa064062680 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 >> 172.21.2.137:0/2656887441 conn(0x7fa0640b7070 msgr2=0x7fa0640b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 shutdown_connections 2021-11-15T19:35:18.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.549+0000 7fa06afb1700 1 -- 172.21.2.137:0/2656887441 wait complete. 2021-11-15T19:35:18.563 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 68 2021-11-15T19:35:18.769 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:16.433090+0000', 'modified': '2021-11-15T19:35:18.459599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7969': {'gid': 7969, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4213511213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4213511213}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4213511213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:18.769 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:18.770 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:18.839 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7969,"want_state":"up:active","state":"up:active","rank_uptime":1.3715666559999999,"mdsmap_epoch":68,"osdmap_epoch":131,"osdmap_epoch_barrier":131,"uptime":5.5898089090000003} 2021-11-15T19:35:18.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7969, "mdsmap_epoch": 68, "osdmap_epoch": 131, "osdmap_epoch_barrier": 131, "rank_uptime": 1.371566656, "state": "up:active", "uptime": 5.589808909, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:18.840 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:18.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.877+0000 7f6ead79b700 1 Processor -- start 2021-11-15T19:35:18.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- start start 2021-11-15T19:35:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 0x7f6ea8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6ea8143f00 0x7f6ea8144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f6ea80a9f50 0x7f6ea80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea8148190 con 0x7f6ea80a9f50 2021-11-15T19:35:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80b1720 con 0x7f6ea8143f00 2021-11-15T19:35:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8147e70 con 0x7f6ea80b1340 2021-11-15T19:35:18.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6ea8143f00 0x7f6ea8144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6ea8143f00 0x7f6ea8144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39936/0 (socket says 172.21.2.137:39936) 2021-11-15T19:35:18.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 -- 172.21.2.137:0/1550158031 learned_addr learned my addr 172.21.2.137:0/1550158031 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:18.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 -- 172.21.2.137:0/1550158031 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 msgr2=0x7f6ea8147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:18.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 --2- 172.21.2.137:0/1550158031 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 0x7f6ea8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 -- 172.21.2.137:0/1550158031 >> v2:172.21.2.111:3300/0 conn(0x7f6ea80a9f50 msgr2=0x7f6ea80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:18.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 --2- 172.21.2.137:0/1550158031 >> v2:172.21.2.111:3300/0 conn(0x7f6ea80a9f50 0x7f6ea80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 -- 172.21.2.137:0/1550158031 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80af800 con 0x7f6ea8143f00 2021-11-15T19:35:18.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea67fc700 1 --2- 172.21.2.137:0/1550158031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea8144360 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f6e90002f70 tx=0x7f6e90006eb0).ready entity=mon.1 client_cookie=b682cdac311181c4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.896 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea5ffb700 1 -- 172.21.2.137:0/1550158031 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9000d570 con 0x7f6ea8143f00 2021-11-15T19:35:18.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea5ffb700 1 -- 172.21.2.137:0/1550158031 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e90000e90 con 0x7f6ea8143f00 2021-11-15T19:35:18.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea5ffb700 1 -- 172.21.2.137:0/1550158031 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9000d900 con 0x7f6ea8143f00 2021-11-15T19:35:18.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- 172.21.2.137:0/1550158031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 msgr2=0x7f6ea8144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- 172.21.2.137:0/1550158031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea8144360 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f6e90002f70 tx=0x7f6e90006eb0).stop 2021-11-15T19:35:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- 172.21.2.137:0/1550158031 shutdown_connections 2021-11-15T19:35:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- 172.21.2.137:0/1550158031 >> v2:172.21.2.111:3300/0 conn(0x7f6ea80a9f50 0x7f6ea80aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- 172.21.2.137:0/1550158031 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea8144360 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- 172.21.2.137:0/1550158031 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 0x7f6ea8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- 172.21.2.137:0/1550158031 >> 172.21.2.137:0/1550158031 conn(0x7f6ea80b4e60 msgr2=0x7f6ea80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- 172.21.2.137:0/1550158031 shutdown_connections 2021-11-15T19:35:18.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- 172.21.2.137:0/1550158031 wait complete. 2021-11-15T19:35:18.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 Processor -- start 2021-11-15T19:35:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- start start 2021-11-15T19:35:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ea80a9f50 0x7f6ea814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 0x7f6ea80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea813fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea815ae30 con 0x7f6ea80a9f50 2021-11-15T19:35:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8099fa0 con 0x7f6ea8143f00 2021-11-15T19:35:18.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ead79b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea809a240 con 0x7f6ea80b1340 2021-11-15T19:35:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.881+0000 7f6ea77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea813fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea813fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39944/0 (socket says 172.21.2.137:39944) 2021-11-15T19:35:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 -- 172.21.2.137:0/4103669641 learned_addr learned my addr 172.21.2.137:0/4103669641 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 -- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 msgr2=0x7f6ea80b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 0x7f6ea80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 -- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ea80a9f50 msgr2=0x7f6ea814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ea80a9f50 0x7f6ea814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 -- 172.21.2.137:0/4103669641 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9000b1e0 con 0x7f6ea8143f00 2021-11-15T19:35:18.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea77fe700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea813fe20 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f6ea814a720 tx=0x7f6ea00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea000d4a0 con 0x7f6ea8143f00 2021-11-15T19:35:18.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea000d600 con 0x7f6ea8143f00 2021-11-15T19:35:18.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea809ad50 con 0x7f6ea8143f00 2021-11-15T19:35:18.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea000d960 con 0x7f6ea8143f00 2021-11-15T19:35:18.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea8140530 con 0x7f6ea8143f00 2021-11-15T19:35:18.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea815ac90 con 0x7f6ea8143f00 2021-11-15T19:35:18.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ea0018030 con 0x7f6ea8143f00 2021-11-15T19:35:18.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6e9ffff700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e8c0536a0 0x7f6e8c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:18.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6ea006b1c0 con 0x7f6ea8143f00 2021-11-15T19:35:18.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.885+0000 7f6ea6ffd700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e8c0536a0 0x7f6e8c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:18.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.889+0000 7f6ea6ffd700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e8c0536a0 0x7f6e8c055b60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f6e98002f70 tx=0x7f6e98006960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:18.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.889+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ea815ac90 con 0x7f6ea8143f00 2021-11-15T19:35:18.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.969+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ea809a400 con 0x7f6ea8143f00 2021-11-15T19:35:18.982 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.969+0000 7f6e9ffff700 1 -- 172.21.2.137:0/4103669641 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f6ea0023ed0 con 0x7f6ea8143f00 2021-11-15T19:35:18.983 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:18.983 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":131,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:17.437552+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:15.202823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:15.395889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:18.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e8c0536a0 msgr2=0x7f6e8c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e8c0536a0 0x7f6e8c055b60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f6e98002f70 tx=0x7f6e98006960).stop 2021-11-15T19:35:18.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 msgr2=0x7f6ea813fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:18.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea813fe20 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f6ea814a720 tx=0x7f6ea00091a0).stop 2021-11-15T19:35:18.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 shutdown_connections 2021-11-15T19:35:18.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6e8c0536a0 0x7f6e8c055b60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6ea8143f00 0x7f6ea813fe20 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:18.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6ea80b1340 0x7f6ea80b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 --2- 172.21.2.137:0/4103669641 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6ea80a9f50 0x7f6ea814ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:18.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 >> 172.21.2.137:0/4103669641 conn(0x7f6ea80b4e60 msgr2=0x7f6ea8145a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:18.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 shutdown_connections 2021-11-15T19:35:18.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:18.973+0000 7f6ead79b700 1 -- 172.21.2.137:0/4103669641 wait complete. 2021-11-15T19:35:18.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:35:15.202823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:35:15.395889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:35:18.991 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:19.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 Processor -- start 2021-11-15T19:35:19.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 -- start start 2021-11-15T19:35:19.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8c700b0550 0x7f8c7014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c7014aaa0 0x7f8c70140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7005cb50 con 0x7f8c7005c770 2021-11-15T19:35:19.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c700b1650 con 0x7f8c700b0550 2021-11-15T19:35:19.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c769ca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700ad030 con 0x7f8c7014aaa0 2021-11-15T19:35:19.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c6ffff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f8c7005c770 0x7f8c700aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:51222/0 (socket says 172.21.2.137:51222) 2021-11-15T19:35:19.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c6f7fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8c700b0550 0x7f8c7014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c6ffff700 1 -- 172.21.2.137:0/1038778202 learned_addr learned my addr 172.21.2.137:0/1038778202 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:19.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.033+0000 7f8c74f67700 1 --2- 172.21.2.137:0/1038778202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c7014aaa0 0x7f8c70140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/1038778202 >> v2:172.21.2.111:3300/0 conn(0x7f8c700b0550 msgr2=0x7f8c7014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- 172.21.2.137:0/1038778202 >> v2:172.21.2.111:3300/0 conn(0x7f8c700b0550 0x7f8c7014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/1038778202 >> v1:172.21.2.111:6789/0 conn(0x7f8c7005c770 legacy=0x7f8c700aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/1038778202 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700ad2d0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- 172.21.2.137:0/1038778202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c7014aaa0 0x7f8c70140aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8c680032f0 tx=0x7f8c680091d0).ready entity=mon.2 client_cookie=4e74bf866bc28774 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c6effd700 1 -- 172.21.2.137:0/1038778202 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6800b6c0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c6effd700 1 -- 172.21.2.137:0/1038778202 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800b820 con 0x7f8c7014aaa0 2021-11-15T19:35:19.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c6effd700 1 -- 172.21.2.137:0/1038778202 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6800b990 con 0x7f8c7014aaa0 2021-11-15T19:35:19.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/1038778202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c7014aaa0 msgr2=0x7f8c70140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 --2- 172.21.2.137:0/1038778202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c7014aaa0 0x7f8c70140aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8c680032f0 tx=0x7f8c680091d0).stop 2021-11-15T19:35:19.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/1038778202 shutdown_connections 2021-11-15T19:35:19.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 --2- 172.21.2.137:0/1038778202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c7014aaa0 0x7f8c70140aa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 --2- 172.21.2.137:0/1038778202 >> v2:172.21.2.111:3300/0 conn(0x7f8c700b0550 0x7f8c7014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/1038778202 >> 172.21.2.137:0/1038778202 conn(0x7f8c700631e0 msgr2=0x7f8c7005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/1038778202 shutdown_connections 2021-11-15T19:35:19.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/1038778202 wait complete. 2021-11-15T19:35:19.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 Processor -- start 2021-11-15T19:35:19.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- start start 2021-11-15T19:35:19.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c7005c770 0x7f8c70156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c700b0550 0x7f8c70149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 0x7f8c70141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700666c0 con 0x7f8c7005c770 2021-11-15T19:35:19.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700664e0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700668f0 con 0x7f8c700b0550 2021-11-15T19:35:19.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 0x7f8c70141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 0x7f8c70141d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39956/0 (socket says 172.21.2.137:39956) 2021-11-15T19:35:19.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/977822519 learned_addr learned my addr 172.21.2.137:0/977822519 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:19.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c700b0550 msgr2=0x7f8c70149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c700b0550 0x7f8c70149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c7005c770 msgr2=0x7f8c70156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c7005c770 0x7f8c70156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 -- 172.21.2.137:0/977822519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68009470 con 0x7f8c7014aaa0 2021-11-15T19:35:19.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c74f67700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 0x7f8c70141d40 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f8c70065bf0 tx=0x7f8c68016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6800b6c0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800b990 con 0x7f8c7014aaa0 2021-11-15T19:35:19.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7015a4a0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c680107a0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.037+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c70067400 con 0x7f8c7014aaa0 2021-11-15T19:35:19.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700ae7f0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c6801e070 con 0x7f8c7014aaa0 2021-11-15T19:35:19.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c6d7fa700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c540536a0 0x7f8c54055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8c6806c8e0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c6ffff700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c540536a0 0x7f8c54055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c6ffff700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c540536a0 0x7f8c54055b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f8c700620e0 tx=0x7f8c58007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.041+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c68043a40 con 0x7f8c7014aaa0 2021-11-15T19:35:19.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8c700573d0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c6d7fa700 1 -- 172.21.2.137:0/977822519 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v131) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8c6801b0b0 con 0x7f8c7014aaa0 2021-11-15T19:35:19.137 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:19.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c540536a0 msgr2=0x7f8c54055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c540536a0 0x7f8c54055b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f8c700620e0 tx=0x7f8c58007860).stop 2021-11-15T19:35:19.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 msgr2=0x7f8c70141d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 0x7f8c70141d40 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f8c70065bf0 tx=0x7f8c68016000).stop 2021-11-15T19:35:19.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 shutdown_connections 2021-11-15T19:35:19.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8c540536a0 0x7f8c54055b60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8c7014aaa0 0x7f8c70141d40 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8c700b0550 0x7f8c70149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 --2- 172.21.2.137:0/977822519 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8c7005c770 0x7f8c70156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 >> 172.21.2.137:0/977822519 conn(0x7f8c700631e0 msgr2=0x7f8c700b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 shutdown_connections 2021-11-15T19:35:19.141 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.125+0000 7f8c769ca700 1 -- 172.21.2.137:0/977822519 wait complete. 2021-11-15T19:35:19.145 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:19.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 Processor -- start 2021-11-15T19:35:19.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 -- start start 2021-11-15T19:35:19.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580b5330 0x7fe0580b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe0580b3e70 0x7fe0580b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe058146c20 con 0x7fe0580b2400 2021-11-15T19:35:19.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe058142af0 con 0x7fe0580b3e70 2021-11-15T19:35:19.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe05ddd2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580b27e0 con 0x7fe0580b5330 2021-11-15T19:35:19.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0577fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe0580b2400 0x7fe0580b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58744/0 (socket says 172.21.2.137:58744) 2021-11-15T19:35:19.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0577fe700 1 -- 172.21.2.137:0/2770741400 learned_addr learned my addr 172.21.2.137:0/2770741400 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:19.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911776707 0 0) 0x7fe058146c20 con 0x7fe0580b2400 2021-11-15T19:35:19.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe044003260 con 0x7fe0580b2400 2021-11-15T19:35:19.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154773699 0 0) 0x7fe044003260 con 0x7fe0580b2400 2021-11-15T19:35:19.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580b5330 msgr2=0x7fe0580b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580b5330 0x7fe0580b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 >> v2:172.21.2.111:3300/0 conn(0x7fe0580b3e70 msgr2=0x7fe0580b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 --2- 172.21.2.137:0/2770741400 >> v2:172.21.2.111:3300/0 conn(0x7fe0580b3e70 0x7fe0580b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0580b4d80 con 0x7fe0580b2400 2021-11-15T19:35:19.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe04c001660 con 0x7fe0580b2400 2021-11-15T19:35:19.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 >> v1:172.21.2.137:6789/0 conn(0x7fe0580b2400 legacy=0x7fe0580b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe0440037d0 0x7fe044003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580b5330 0x7fe044004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe04400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe058142af0 con 0x7fe0440037d0 2021-11-15T19:35:19.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580b27e0 con 0x7fe044004bf0 2021-11-15T19:35:19.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.185+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe044005330 con 0x7fe0580b5330 2021-11-15T19:35:19.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe04400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 -- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580b5330 msgr2=0x7fe044004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580b5330 0x7fe044004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe0440037d0 0x7fe044003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 -- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe0440037d0 msgr2=0x7fe044003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe0440037d0 0x7fe044003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 -- 172.21.2.137:0/2770741400 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044003260 con 0x7fe044004bf0 2021-11-15T19:35:19.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe04400b750 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fe0500032f0 tx=0x7fe050006f90).ready entity=mon.1 client_cookie=218acfef3a880dca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05000b460 con 0x7fe044004bf0 2021-11-15T19:35:19.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000b5c0 con 0x7fe044004bf0 2021-11-15T19:35:19.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0567fc700 1 -- 172.21.2.137:0/2770741400 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05000b730 con 0x7fe044004bf0 2021-11-15T19:35:19.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2770741400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 msgr2=0x7fe04400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2770741400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe04400b750 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fe0500032f0 tx=0x7fe050006f90).stop 2021-11-15T19:35:19.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe057fff700 1 -- 172.21.2.137:0/2770741400 reap_dead start 2021-11-15T19:35:19.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2770741400 shutdown_connections 2021-11-15T19:35:19.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2770741400 >> 172.21.2.137:0/2770741400 conn(0x7fe0580623a0 msgr2=0x7fe058062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2770741400 shutdown_connections 2021-11-15T19:35:19.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2770741400 wait complete. 2021-11-15T19:35:19.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 Processor -- start 2021-11-15T19:35:19.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- start start 2021-11-15T19:35:19.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe058146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.213 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe05811ae40 0x7fe05811b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580aea20 0x7fe0580aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05811b7b0 con 0x7fe05811ae40 2021-11-15T19:35:19.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05815a350 con 0x7fe044004bf0 2021-11-15T19:35:19.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05815a5e0 con 0x7fe0580aea20 2021-11-15T19:35:19.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe058146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe058146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39974/0 (socket says 172.21.2.137:39974) 2021-11-15T19:35:19.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 -- 172.21.2.137:0/2097834221 learned_addr learned my addr 172.21.2.137:0/2097834221 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:19.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 -- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580aea20 msgr2=0x7fe0580aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580aea20 0x7fe0580aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 -- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe05811ae40 msgr2=0x7fe05811b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe05811ae40 0x7fe05811b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 -- 172.21.2.137:0/2097834221 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05815a880 con 0x7fe044004bf0 2021-11-15T19:35:19.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe0577fe700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe058146220 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fe04c008000 tx=0x7fe04c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04c007170 con 0x7fe044004bf0 2021-11-15T19:35:19.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c0072d0 con 0x7fe044004bf0 2021-11-15T19:35:19.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe058146710 con 0x7fe044004bf0 2021-11-15T19:35:19.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04c004920 con 0x7fe044004bf0 2021-11-15T19:35:19.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.189+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe058067810 con 0x7fe044004bf0 2021-11-15T19:35:19.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe058146e50 con 0x7fe044004bf0 2021-11-15T19:35:19.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe04c01b060 con 0x7fe044004bf0 2021-11-15T19:35:19.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe054ff9700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe038053640 0x7fe038055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe04c06b690 con 0x7fe044004bf0 2021-11-15T19:35:19.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe056ffd700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe038053640 0x7fe038055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe056ffd700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe038053640 0x7fe038055b00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe048002f70 tx=0x7fe048006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.193+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe04c0426e0 con 0x7fe044004bf0 2021-11-15T19:35:19.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0580573d0 con 0x7fe044004bf0 2021-11-15T19:35:19.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe054ff9700 1 -- 172.21.2.137:0/2097834221 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe04c045d00 con 0x7fe044004bf0 2021-11-15T19:35:19.289 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:19.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe038053640 msgr2=0x7fe038055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe038053640 0x7fe038055b00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe048002f70 tx=0x7fe048006a10).stop 2021-11-15T19:35:19.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 msgr2=0x7fe058146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe058146220 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fe04c008000 tx=0x7fe04c009040).stop 2021-11-15T19:35:19.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 shutdown_connections 2021-11-15T19:35:19.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe038053640 0x7fe038055b00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe0580aea20 0x7fe0580aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe05811ae40 0x7fe05811b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 --2- 172.21.2.137:0/2097834221 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe044004bf0 0x7fe058146220 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 >> 172.21.2.137:0/2097834221 conn(0x7fe0580623a0 msgr2=0x7fe058142f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 shutdown_connections 2021-11-15T19:35:19.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.277+0000 7fe05ddd2700 1 -- 172.21.2.137:0/2097834221 wait complete. 2021-11-15T19:35:19.296 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:35:19.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 Processor -- start 2021-11-15T19:35:19.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 -- start start 2021-11-15T19:35:19.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3cc405c770 0x7f3cc40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc40b0550 0x7f3cc414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc405cb50 con 0x7f3cc414aaa0 2021-11-15T19:35:19.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc40b1650 con 0x7f3cc405c770 2021-11-15T19:35:19.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3ccb9f3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40ad030 con 0x7f3cc40b0550 2021-11-15T19:35:19.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3cc9f90700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f3cc414aaa0 0x7f3cc4140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58768/0 (socket says 172.21.2.137:58768) 2021-11-15T19:35:19.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1187997224 learned_addr learned my addr 172.21.2.137:0/1187997224 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:19.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130632557 0 0) 0x7f3cc405cb50 con 0x7f3cc414aaa0 2021-11-15T19:35:19.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.337+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cac003260 con 0x7f3cc414aaa0 2021-11-15T19:35:19.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1878689296 0 0) 0x7f3cac003260 con 0x7f3cc414aaa0 2021-11-15T19:35:19.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc40b0550 msgr2=0x7f3cc414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc40b0550 0x7f3cc414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 >> v2:172.21.2.111:3300/0 conn(0x7f3cc405c770 msgr2=0x7f3cc40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 --2- 172.21.2.137:0/1187997224 >> v2:172.21.2.111:3300/0 conn(0x7f3cc405c770 0x7f3cc40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc40ad2d0 con 0x7f3cc414aaa0 2021-11-15T19:35:19.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3cbc0019e0 con 0x7f3cc414aaa0 2021-11-15T19:35:19.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 >> v1:172.21.2.137:6789/0 conn(0x7f3cc414aaa0 legacy=0x7f3cc4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc40b0550 0x7f3cac0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac003ee0 0x7f3cac004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cac004bf0 0x7f3cac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40b1650 con 0x7f3cac003ee0 2021-11-15T19:35:19.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40ad030 con 0x7f3cac004bf0 2021-11-15T19:35:19.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0053a0 con 0x7f3cc40b0550 2021-11-15T19:35:19.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cac004bf0 0x7f3cac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc40b0550 msgr2=0x7f3cac0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc40b0550 0x7f3cac0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac003ee0 msgr2=0x7f3cac004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac003ee0 0x7f3cac004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1187997224 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac003260 con 0x7f3cac004bf0 2021-11-15T19:35:19.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cac004bf0 0x7f3cac00b750 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f3cbc0016f0 tx=0x7f3cbc002100).ready entity=mon.1 client_cookie=e10e4a585e303e6c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cbc00cbb0 con 0x7f3cac004bf0 2021-11-15T19:35:19.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc00cd10 con 0x7f3cac004bf0 2021-11-15T19:35:19.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb7fff700 1 -- 172.21.2.137:0/1187997224 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cbc005b80 con 0x7f3cac004bf0 2021-11-15T19:35:19.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1187997224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cac004bf0 msgr2=0x7f3cac00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1187997224 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cac004bf0 0x7f3cac00b750 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f3cbc0016f0 tx=0x7f3cbc002100).stop 2021-11-15T19:35:19.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1187997224 reap_dead start 2021-11-15T19:35:19.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1187997224 shutdown_connections 2021-11-15T19:35:19.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1187997224 >> 172.21.2.137:0/1187997224 conn(0x7f3cc40631e0 msgr2=0x7f3cc405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1187997224 shutdown_connections 2021-11-15T19:35:19.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1187997224 wait complete. 2021-11-15T19:35:19.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 Processor -- start 2021-11-15T19:35:19.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- start start 2021-11-15T19:35:19.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac004bf0 0x7f3cc4149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc4065900 0x7f3cc4063960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 0x7f3cc4063e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4146790 con 0x7f3cac004bf0 2021-11-15T19:35:19.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4146a30 con 0x7f3cc4147780 2021-11-15T19:35:19.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4146cd0 con 0x7f3cc4065900 2021-11-15T19:35:19.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 0x7f3cc4063e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 0x7f3cc4063e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:39998/0 (socket says 172.21.2.137:39998) 2021-11-15T19:35:19.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1494894339 learned_addr learned my addr 172.21.2.137:0/1494894339 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:19.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc4065900 msgr2=0x7f3cc4063960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc4065900 0x7f3cc4063960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac004bf0 msgr2=0x7f3cc4149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac004bf0 0x7f3cc4149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 -- 172.21.2.137:0/1494894339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4067510 con 0x7f3cc4147780 2021-11-15T19:35:19.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cc9f90700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 0x7f3cc4063e50 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f3cbc001b40 tx=0x7f3cbc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cbc001ee0 con 0x7f3cc4147780 2021-11-15T19:35:19.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0074d0 con 0x7f3cc4147780 2021-11-15T19:35:19.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc4064340 con 0x7f3cc4147780 2021-11-15T19:35:19.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cbc007830 con 0x7f3cc4147780 2021-11-15T19:35:19.367 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.341+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc4146500 con 0x7f3cc4147780 2021-11-15T19:35:19.368 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc40ae7f0 con 0x7f3cc4147780 2021-11-15T19:35:19.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3cbc01d070 con 0x7f3cc4147780 2021-11-15T19:35:19.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3cb67fc700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ca4053640 0x7f3ca4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3cbc019030 con 0x7f3cc4147780 2021-11-15T19:35:19.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3cc978f700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ca4053640 0x7f3ca4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3cc978f700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ca4053640 0x7f3ca4055b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f3cb8002f70 tx=0x7f3cb8006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.345+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3cbc042bf0 con 0x7f3cc4147780 2021-11-15T19:35:19.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cc40573d0 con 0x7f3cc4147780 2021-11-15T19:35:19.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3cb67fc700 1 -- 172.21.2.137:0/1494894339 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3cbc046210 con 0x7f3cc4147780 2021-11-15T19:35:19.441 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:19.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ca4053640 msgr2=0x7f3ca4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ca4053640 0x7f3ca4055b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f3cb8002f70 tx=0x7f3cb8006a80).stop 2021-11-15T19:35:19.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 msgr2=0x7f3cc4063e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 0x7f3cc4063e50 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f3cbc001b40 tx=0x7f3cbc015000).stop 2021-11-15T19:35:19.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 shutdown_connections 2021-11-15T19:35:19.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3ca4053640 0x7f3ca4055b00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3cc4147780 0x7f3cc4063e50 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3cc4065900 0x7f3cc4063960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 --2- 172.21.2.137:0/1494894339 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3cac004bf0 0x7f3cc4149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:19.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 >> 172.21.2.137:0/1494894339 conn(0x7f3cc40631e0 msgr2=0x7f3cc40b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 shutdown_connections 2021-11-15T19:35:19.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.429+0000 7f3ccb9f3700 1 -- 172.21.2.137:0/1494894339 wait complete. 2021-11-15T19:35:19.448 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:35:19.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 Processor -- start 2021-11-15T19:35:19.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 -- start start 2021-11-15T19:35:19.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b805c770 0x7f63b80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f63b80b0550 0x7f63b814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b805cb50 con 0x7f63b814aaa0 2021-11-15T19:35:19.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b80b1650 con 0x7f63b80b0550 2021-11-15T19:35:19.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bff08700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80ad030 con 0x7f63b805c770 2021-11-15T19:35:19.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63be4a5700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f63b814aaa0 0x7f63b8140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:51280/0 (socket says 172.21.2.137:51280) 2021-11-15T19:35:19.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63be4a5700 1 -- 172.21.2.137:0/2718575704 learned_addr learned my addr 172.21.2.137:0/2718575704 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:19.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bdca4700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b805c770 0x7f63b80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bd4a3700 1 --2- 172.21.2.137:0/2718575704 >> v2:172.21.2.111:3300/0 conn(0x7f63b80b0550 0x7f63b814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bcca2700 1 -- 172.21.2.137:0/2718575704 <== mon.0 v1:172.21.2.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600625804 0 0) 0x7f63b805cb50 con 0x7f63b814aaa0 2021-11-15T19:35:19.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bcca2700 1 -- 172.21.2.137:0/2718575704 --> v1:172.21.2.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a0003260 con 0x7f63b814aaa0 2021-11-15T19:35:19.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bd4a3700 1 -- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b805c770 msgr2=0x7f63b80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bd4a3700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b805c770 0x7f63b80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bd4a3700 1 -- 172.21.2.137:0/2718575704 >> v1:172.21.2.111:6789/0 conn(0x7f63b814aaa0 legacy=0x7f63b8140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bd4a3700 1 -- 172.21.2.137:0/2718575704 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b80ad2d0 con 0x7f63b80b0550 2021-11-15T19:35:19.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bdca4700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b805c770 0x7f63b80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:35:19.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.489+0000 7f63bd4a3700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b814a5b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f63b4002f70 tx=0x7f63b4006df0).ready entity=mon.0 client_cookie=50d541da7e59322c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bcca2700 1 -- 172.21.2.137:0/2718575704 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b400d4a0 con 0x7f63b80b0550 2021-11-15T19:35:19.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bcca2700 1 -- 172.21.2.137:0/2718575704 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b4000e90 con 0x7f63b80b0550 2021-11-15T19:35:19.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bcca2700 1 -- 172.21.2.137:0/2718575704 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b400d7f0 con 0x7f63b80b0550 2021-11-15T19:35:19.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 msgr2=0x7f63b814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b814a5b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f63b4002f70 tx=0x7f63b4006df0).stop 2021-11-15T19:35:19.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/2718575704 shutdown_connections 2021-11-15T19:35:19.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b814a5b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 --2- 172.21.2.137:0/2718575704 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b805c770 0x7f63b80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/2718575704 >> 172.21.2.137:0/2718575704 conn(0x7f63b80631e0 msgr2=0x7f63b805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/2718575704 shutdown_connections 2021-11-15T19:35:19.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/2718575704 wait complete. 2021-11-15T19:35:19.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 Processor -- start 2021-11-15T19:35:19.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- start start 2021-11-15T19:35:19.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 0x7f63b8146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b8143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b814aaa0 0x7f63b81436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8067810 con 0x7f63b80b0550 2021-11-15T19:35:19.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8064fa0 con 0x7f63b805c770 2021-11-15T19:35:19.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8065240 con 0x7f63b814aaa0 2021-11-15T19:35:19.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 0x7f63b8146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 0x7f63b8146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40008/0 (socket says 172.21.2.137:40008) 2021-11-15T19:35:19.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bd4a3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b8143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 -- 172.21.2.137:0/855620730 learned_addr learned my addr 172.21.2.137:0/855620730 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:19.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63be4a5700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b814aaa0 0x7f63b81436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 -- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b814aaa0 msgr2=0x7f63b81436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b814aaa0 0x7f63b81436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 -- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 msgr2=0x7f63b8143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b8143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 -- 172.21.2.137:0/855620730 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac00b180 con 0x7f63b805c770 2021-11-15T19:35:19.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63be4a5700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b814aaa0 0x7f63b81436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:19.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bdca4700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 0x7f63b8146ee0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f63ac00c000 tx=0x7f63ac006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ac00c890 con 0x7f63b805c770 2021-11-15T19:35:19.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac00c9f0 con 0x7f63b805c770 2021-11-15T19:35:19.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b400b180 con 0x7f63b805c770 2021-11-15T19:35:19.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ac00cd50 con 0x7f63b805c770 2021-11-15T19:35:19.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b8157480 con 0x7f63b805c770 2021-11-15T19:35:19.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b80ae7f0 con 0x7f63b805c770 2021-11-15T19:35:19.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.493+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63ac01c460 con 0x7f63b805c770 2021-11-15T19:35:19.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.497+0000 7f63aaffd700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63980536a0 0x7f6398055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.497+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f63ac06c090 con 0x7f63b805c770 2021-11-15T19:35:19.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.497+0000 7f63bd4a3700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63980536a0 0x7f6398055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.497+0000 7f63bd4a3700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63980536a0 0x7f6398055b60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f63b401a000 tx=0x7f63b4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.497+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63ac043080 con 0x7f63b805c770 2021-11-15T19:35:19.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63b805db30 con 0x7f63b805c770 2021-11-15T19:35:19.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63aaffd700 1 -- 172.21.2.137:0/855620730 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+10 (secure 0 0 0) 0x7f63ac0466a0 con 0x7f63b805c770 2021-11-15T19:35:19.594 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:19.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63980536a0 msgr2=0x7f6398055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63980536a0 0x7f6398055b60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f63b401a000 tx=0x7f63b4014000).stop 2021-11-15T19:35:19.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 msgr2=0x7f63b8146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 0x7f63b8146ee0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f63ac00c000 tx=0x7f63ac006df0).stop 2021-11-15T19:35:19.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 shutdown_connections 2021-11-15T19:35:19.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f63980536a0 0x7f6398055b60 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f63b814aaa0 0x7f63b81436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f63b80b0550 0x7f63b8143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 --2- 172.21.2.137:0/855620730 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f63b805c770 0x7f63b8146ee0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 >> 172.21.2.137:0/855620730 conn(0x7f63b80631e0 msgr2=0x7f63b8144040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 shutdown_connections 2021-11-15T19:35:19.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.581+0000 7f63bff08700 1 -- 172.21.2.137:0/855620730 wait complete. 2021-11-15T19:35:19.600 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:35:19.601 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:19.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 Processor -- start 2021-11-15T19:35:19.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 -- start start 2021-11-15T19:35:19.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f03080acab0 0x7f03080b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 0x7f03080b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03080aecf0 con 0x7f03080b1180 2021-11-15T19:35:19.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030813f180 con 0x7f03080acab0 2021-11-15T19:35:19.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030c868700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03080aef20 con 0x7f03080af2f0 2021-11-15T19:35:19.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f0306d9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 0x7f03080b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030659c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f03080acab0 0x7f03080b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030659c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f03080acab0 0x7f03080b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:47242/0 (socket says 172.21.2.137:47242) 2021-11-15T19:35:19.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f0306d9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 0x7f03080b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:41586/0 (socket says 172.21.2.137:41586) 2021-11-15T19:35:19.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f030659c700 1 -- 172.21.2.137:0/4284362880 learned_addr learned my addr 172.21.2.137:0/4284362880 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:19.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.641+0000 7f0305d9b700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f03080b1180 0x7f0308142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:51288/0 (socket says 172.21.2.137:51288) 2021-11-15T19:35:19.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/4284362880 >> v2:172.21.2.111:3300/0 conn(0x7f03080acab0 msgr2=0x7f03080b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:19.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- 172.21.2.137:0/4284362880 >> v2:172.21.2.111:3300/0 conn(0x7f03080acab0 0x7f03080b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/4284362880 >> v1:172.21.2.111:6789/0 conn(0x7f03080b1180 legacy=0x7f0308142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/4284362880 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080ace90 con 0x7f03080af2f0 2021-11-15T19:35:19.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- 172.21.2.137:0/4284362880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 0x7f03080b2550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f03000032f0 tx=0x7f03000091d0).ready entity=mon.2 client_cookie=1ff69ba06eec8055 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030559a700 1 -- 172.21.2.137:0/4284362880 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f030000b6c0 con 0x7f03080af2f0 2021-11-15T19:35:19.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030559a700 1 -- 172.21.2.137:0/4284362880 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030000b820 con 0x7f03080af2f0 2021-11-15T19:35:19.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030559a700 1 -- 172.21.2.137:0/4284362880 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f030000b990 con 0x7f03080af2f0 2021-11-15T19:35:19.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/4284362880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 msgr2=0x7f03080b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 --2- 172.21.2.137:0/4284362880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 0x7f03080b2550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f03000032f0 tx=0x7f03000091d0).stop 2021-11-15T19:35:19.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/4284362880 shutdown_connections 2021-11-15T19:35:19.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 --2- 172.21.2.137:0/4284362880 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080af2f0 0x7f03080b2550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 --2- 172.21.2.137:0/4284362880 >> v2:172.21.2.111:3300/0 conn(0x7f03080acab0 0x7f03080b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/4284362880 >> 172.21.2.137:0/4284362880 conn(0x7f03080630f0 msgr2=0x7f03080634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/4284362880 shutdown_connections 2021-11-15T19:35:19.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/4284362880 wait complete. 2021-11-15T19:35:19.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 Processor -- start 2021-11-15T19:35:19.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- start start 2021-11-15T19:35:19.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080acab0 0x7f0308069d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03080af2f0 0x7f0308132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 0x7f0308133380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308064fb0 con 0x7f03080af2f0 2021-11-15T19:35:19.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030813e730 con 0x7f03080b1180 2021-11-15T19:35:19.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030813e990 con 0x7f03080acab0 2021-11-15T19:35:19.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 0x7f0308133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 0x7f0308133380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40022/0 (socket says 172.21.2.137:40022) 2021-11-15T19:35:19.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/66962700 learned_addr learned my addr 172.21.2.137:0/66962700 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:19.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030659c700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080acab0 0x7f0308069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0305d9b700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03080af2f0 0x7f0308132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080acab0 msgr2=0x7f0308069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080acab0 0x7f0308069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03080af2f0 msgr2=0x7f0308132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03080af2f0 0x7f0308132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 -- 172.21.2.137:0/66962700 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300009470 con 0x7f03080b1180 2021-11-15T19:35:19.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f0306d9d700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 0x7f0308133380 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f03000032f0 tx=0x7f0300016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f030000b6c0 con 0x7f03080b1180 2021-11-15T19:35:19.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000107a0 con 0x7f03080b1180 2021-11-15T19:35:19.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0300010b00 con 0x7f03080b1180 2021-11-15T19:35:19.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030815a8b0 con 0x7f03080b1180 2021-11-15T19:35:19.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.645+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0308133870 con 0x7f03080b1180 2021-11-15T19:35:19.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030815aa70 con 0x7f03080b1180 2021-11-15T19:35:19.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0300027020 con 0x7f03080b1180 2021-11-15T19:35:19.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f02ff7fe700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f02ec0536a0 0x7f02ec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:19.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f030006cef0 con 0x7f03080b1180 2021-11-15T19:35:19.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f030659c700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f02ec0536a0 0x7f02ec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:19.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f030659c700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f02ec0536a0 0x7f02ec055b60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f02f0008000 tx=0x7f02f0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:19.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.649+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0300043fb0 con 0x7f03080b1180 2021-11-15T19:35:19.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.757+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03080573d0 con 0x7f03080b1180 2021-11-15T19:35:19.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.757+0000 7f02ff7fe700 1 -- 172.21.2.137:0/66962700 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f0300015090 con 0x7f03080b1180 2021-11-15T19:35:19.770 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:19.770 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":68,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:18.459599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7969":{"gid":7969,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4213511213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4213511213},{"type":"v1","addr":"172.21.2.137:6833","nonce":4213511213}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:19.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f02ec0536a0 msgr2=0x7f02ec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f02ec0536a0 0x7f02ec055b60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f02f0008000 tx=0x7f02f0008040).stop 2021-11-15T19:35:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 msgr2=0x7f0308133380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 0x7f0308133380 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f03000032f0 tx=0x7f0300016000).stop 2021-11-15T19:35:19.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 shutdown_connections 2021-11-15T19:35:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f02ec0536a0 0x7f02ec055b60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03080b1180 0x7f0308133380 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03080af2f0 0x7f0308132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 --2- 172.21.2.137:0/66962700 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03080acab0 0x7f0308069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:19.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 >> 172.21.2.137:0/66962700 conn(0x7f03080630f0 msgr2=0x7f03080634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:19.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 shutdown_connections 2021-11-15T19:35:19.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:19.761+0000 7f030c868700 1 -- 172.21.2.137:0/66962700 wait complete. 2021-11-15T19:35:19.774 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 68 2021-11-15T19:35:19.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:16.433090+0000', 'modified': '2021-11-15T19:35:18.459599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7969': {'gid': 7969, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4213511213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4213511213}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4213511213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:19.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:19.981 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:20.046 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7969,"want_state":"up:active","state":"up:active","rank_uptime":2.5782831179999999,"mdsmap_epoch":68,"osdmap_epoch":131,"osdmap_epoch_barrier":131,"uptime":6.7965250719999997} 2021-11-15T19:35:20.046 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7969, "mdsmap_epoch": 68, "osdmap_epoch": 131, "osdmap_epoch_barrier": 131, "rank_uptime": 2.578283118, "state": "up:active", "uptime": 6.796525072, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:20.047 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:35:20.047 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:35:20.047 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:35:20.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.048 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:20.054 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:35:20.063 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:20.063 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:20.116 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:20.117 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:20.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.118 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:35:20.122 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:35:20.123 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:20.125 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:35:20.131 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:20.132 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:20.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15232]: starting ceph client 2021-11-15T19:35:20.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:35:20.154+0000 7fea3325e080 -1 init, newargv = 0x55fba0f6ab80 newargc=9 2021-11-15T19:35:20.165 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:20.166 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:20.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.167 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:35:20.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15232]: starting fuse 2021-11-15T19:35:20.180 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:35:20.180 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:35:20.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.181 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:35:20.181 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:35:20.181 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:35:20.182 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:35:20.182 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:35:20.183 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:20.183 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:35:20.183 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:35:20.184 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:35:20.184 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:20.185 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:35:20.185 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:35:20.185 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:35:20.186 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:35:20.186 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:20.186 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:35:20.187 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:35:20.187 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:35:20.188 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:35:20.188 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:35:20.188 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:20.189 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:35:20.189 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:35:20.255 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.15232.asok 2021-11-15T19:35:20.260 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15232.asok 2021-11-15T19:35:20.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.261 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15232.asok status 2021-11-15T19:35:20.326 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:35:20.326 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:35:20.326 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:35:20.326 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:35:20.327 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:35:20.327 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:35:20.327 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:35:20.327 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "15232", 2021-11-15T19:35:20.328 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:35:20.328 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:20.328 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:35:20.328 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:35:20.329 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 5451, 2021-11-15T19:35:20.329 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:35:20.329 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:35:20.329 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:35:20.329 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 5451 2021-11-15T19:35:20.330 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:20.330 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:35:20.330 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:35:20.330 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:35:20.331 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2637628905 2021-11-15T19:35:20.331 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:35:20.331 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:20.331 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:35:20.331 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:35:20.332 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:35:20.332 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2637628905 2021-11-15T19:35:20.332 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:20.332 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.5451 172.21.2.131:0/2637628905", 2021-11-15T19:35:20.333 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2637628905", 2021-11-15T19:35:20.333 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:35:20.333 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 68, 2021-11-15T19:35:20.333 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 131, 2021-11-15T19:35:20.333 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:35:20.334 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:35:20.334 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:35:20.334 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:35:20.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.336 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:20.336 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:20.342 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:35:20.343 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:20.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:20.343 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:20.395 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:20.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.437+0000 7f655ce70700 1 Processor -- start 2021-11-15T19:35:20.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.437+0000 7f655ce70700 1 -- start start 2021-11-15T19:35:20.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655ce70700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f65580b1340 0x7f6558147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655ce70700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f65580aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655ce70700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6558148190 con 0x7f6558143f00 2021-11-15T19:35:20.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655ce70700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65580b1720 con 0x7f65580b1340 2021-11-15T19:35:20.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655ce70700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6558147e70 con 0x7f65580a9f50 2021-11-15T19:35:20.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f6556d9d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f65580aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f6555d9b700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f6558143f00 0x7f6558144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:51300/0 (socket says 172.21.2.137:51300) 2021-11-15T19:35:20.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f6555d9b700 1 -- 172.21.2.137:0/304427426 learned_addr learned my addr 172.21.2.137:0/304427426 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:20.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655659c700 1 --2- 172.21.2.137:0/304427426 >> v2:172.21.2.111:3300/0 conn(0x7f65580b1340 0x7f6558147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655659c700 1 -- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 msgr2=0x7f65580aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:20.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655659c700 1 --2- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f65580aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655659c700 1 -- 172.21.2.137:0/304427426 >> v1:172.21.2.111:6789/0 conn(0x7f6558143f00 legacy=0x7f6558144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655659c700 1 -- 172.21.2.137:0/304427426 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580af800 con 0x7f65580b1340 2021-11-15T19:35:20.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f6556d9d700 1 --2- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f65580aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:35:20.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.441+0000 7f655659c700 1 --2- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 0x7f6558147980 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f6548002f70 tx=0x7f6548006df0).ready entity=mon.0 client_cookie=e201b577b45e5501 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655559a700 1 -- 172.21.2.137:0/304427426 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f654800d570 con 0x7f65580b1340 2021-11-15T19:35:20.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655559a700 1 -- 172.21.2.137:0/304427426 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548000e90 con 0x7f65580b1340 2021-11-15T19:35:20.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655559a700 1 -- 172.21.2.137:0/304427426 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f654800d8c0 con 0x7f65580b1340 2021-11-15T19:35:20.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 msgr2=0x7f6558147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 --2- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 0x7f6558147980 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f6548002f70 tx=0x7f6548006df0).stop 2021-11-15T19:35:20.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/304427426 shutdown_connections 2021-11-15T19:35:20.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 --2- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f65580aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 --2- 172.21.2.137:0/304427426 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 0x7f6558147980 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/304427426 >> 172.21.2.137:0/304427426 conn(0x7f65580b4e60 msgr2=0x7f65580b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/304427426 shutdown_connections 2021-11-15T19:35:20.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/304427426 wait complete. 2021-11-15T19:35:20.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 Processor -- start 2021-11-15T19:35:20.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- start start 2021-11-15T19:35:20.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f655814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 0x7f6558159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 0x7f6558140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580ad1a0 con 0x7f65580b1340 2021-11-15T19:35:20.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655814b3a0 con 0x7f6558143f00 2021-11-15T19:35:20.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65580ac900 con 0x7f65580a9f50 2021-11-15T19:35:20.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 0x7f6558140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 0x7f6558140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40034/0 (socket says 172.21.2.137:40034) 2021-11-15T19:35:20.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 -- 172.21.2.137:0/1662372900 learned_addr learned my addr 172.21.2.137:0/1662372900 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:20.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 -- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 msgr2=0x7f655814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f655814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 -- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 msgr2=0x7f6558159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 0x7f6558159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 -- 172.21.2.137:0/1662372900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550009470 con 0x7f6558143f00 2021-11-15T19:35:20.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f6556d9d700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 0x7f6558140110 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f65580aefb0 tx=0x7f65500091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655000c920 con 0x7f6558143f00 2021-11-15T19:35:20.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655000ca80 con 0x7f6558143f00 2021-11-15T19:35:20.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654800b180 con 0x7f6558143f00 2021-11-15T19:35:20.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6558149e60 con 0x7f6558143f00 2021-11-15T19:35:20.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655000cde0 con 0x7f6558143f00 2021-11-15T19:35:20.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.445+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655805faf0 con 0x7f6558143f00 2021-11-15T19:35:20.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.449+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65500123f0 con 0x7f6558143f00 2021-11-15T19:35:20.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.449+0000 7f654f7fe700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f653c0535d0 0x7f653c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.449+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f655006bfa0 con 0x7f6558143f00 2021-11-15T19:35:20.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.449+0000 7f655659c700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f653c0535d0 0x7f653c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.449+0000 7f655659c700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f653c0535d0 0x7f653c055a90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6548002f70 tx=0x7f6548014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.449+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6550042f90 con 0x7f6558143f00 2021-11-15T19:35:20.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65580573d0 con 0x7f6558143f00 2021-11-15T19:35:20.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f654f7fe700 1 -- 172.21.2.137:0/1662372900 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f6550016090 con 0x7f6558143f00 2021-11-15T19:35:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:20.545 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":131,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:17.437552+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:15.202823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:15.395889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:20.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f653c0535d0 msgr2=0x7f653c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f653c0535d0 0x7f653c055a90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6548002f70 tx=0x7f6548014000).stop 2021-11-15T19:35:20.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 msgr2=0x7f6558140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 0x7f6558140110 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f65580aefb0 tx=0x7f65500091d0).stop 2021-11-15T19:35:20.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 shutdown_connections 2021-11-15T19:35:20.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f653c0535d0 0x7f653c055a90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6558143f00 0x7f6558140110 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f65580b1340 0x7f6558159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 --2- 172.21.2.137:0/1662372900 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65580a9f50 0x7f655814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 >> 172.21.2.137:0/1662372900 conn(0x7f65580b4e60 msgr2=0x7f65580af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 shutdown_connections 2021-11-15T19:35:20.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.533+0000 7f655ce70700 1 -- 172.21.2.137:0/1662372900 wait complete. 2021-11-15T19:35:20.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:35:15.202823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:35:15.395889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:35:20.553 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:20.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 Processor -- start 2021-11-15T19:35:20.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- start start 2021-11-15T19:35:20.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe3c805c770 0x7fe3c80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe3c8140aa0 0x7fe3c8140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c805cb50 con 0x7fe3c80b0550 2021-11-15T19:35:20.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c80b1650 con 0x7fe3c8140aa0 2021-11-15T19:35:20.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c80ad030 con 0x7fe3c805c770 2021-11-15T19:35:20.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe3c80b0550 0x7fe3c814a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58822/0 (socket says 172.21.2.137:58822) 2021-11-15T19:35:20.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 -- 172.21.2.137:0/1430946149 learned_addr learned my addr 172.21.2.137:0/1430946149 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:20.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c659c700 1 --2- 172.21.2.137:0/1430946149 >> v2:172.21.2.137:3300/0 conn(0x7fe3c805c770 0x7fe3c80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c659c700 1 -- 172.21.2.137:0/1430946149 >> v2:172.21.2.111:3300/0 conn(0x7fe3c8140aa0 msgr2=0x7fe3c8140ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:20.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c659c700 1 --2- 172.21.2.137:0/1430946149 >> v2:172.21.2.111:3300/0 conn(0x7fe3c8140aa0 0x7fe3c8140ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c659c700 1 -- 172.21.2.137:0/1430946149 >> v1:172.21.2.137:6789/0 conn(0x7fe3c80b0550 legacy=0x7fe3c814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c659c700 1 -- 172.21.2.137:0/1430946149 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80ad2d0 con 0x7fe3c805c770 2021-11-15T19:35:20.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c659c700 1 --2- 172.21.2.137:0/1430946149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c805c770 0x7fe3c80aef30 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fe3b8002f70 tx=0x7fe3b8006df0).ready entity=mon.1 client_cookie=6ca9ed8a5dae413e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c559a700 1 -- 172.21.2.137:0/1430946149 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3b800d5c0 con 0x7fe3c805c770 2021-11-15T19:35:20.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c559a700 1 -- 172.21.2.137:0/1430946149 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8000e90 con 0x7fe3c805c770 2021-11-15T19:35:20.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c559a700 1 -- 172.21.2.137:0/1430946149 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3b800d950 con 0x7fe3c805c770 2021-11-15T19:35:20.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1430946149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c805c770 msgr2=0x7fe3c80aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1430946149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c805c770 0x7fe3c80aef30 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fe3b8002f70 tx=0x7fe3b8006df0).stop 2021-11-15T19:35:20.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1430946149 shutdown_connections 2021-11-15T19:35:20.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1430946149 >> v2:172.21.2.111:3300/0 conn(0x7fe3c8140aa0 0x7fe3c8140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1430946149 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c805c770 0x7fe3c80aef30 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1430946149 >> 172.21.2.137:0/1430946149 conn(0x7fe3c80631e0 msgr2=0x7fe3c805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1430946149 shutdown_connections 2021-11-15T19:35:20.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1430946149 wait complete. 2021-11-15T19:35:20.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 Processor -- start 2021-11-15T19:35:20.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- start start 2021-11-15T19:35:20.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3c805c770 0x7fe3c8066cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 0x7fe3c81416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe3c8140aa0 0x7fe3c8141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c8066100 con 0x7fe3c8140aa0 2021-11-15T19:35:20.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c8156710 con 0x7fe3c80b0550 2021-11-15T19:35:20.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c81569b0 con 0x7fe3c805c770 2021-11-15T19:35:20.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 0x7fe3c81416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 0x7fe3c81416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40048/0 (socket says 172.21.2.137:40048) 2021-11-15T19:35:20.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 -- 172.21.2.137:0/1438061928 learned_addr learned my addr 172.21.2.137:0/1438061928 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:20.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 -- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3c805c770 msgr2=0x7fe3c8066cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:20.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3c805c770 0x7fe3c8066cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 -- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe3c8140aa0 msgr2=0x7fe3c8141be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:20.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe3c8140aa0 0x7fe3c8141be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 -- 172.21.2.137:0/1438061928 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b800b180 con 0x7fe3c80b0550 2021-11-15T19:35:20.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3c5d9b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 0x7fe3c81416f0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fe3c80aee10 tx=0x7fe3c000c940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c0005ba0 con 0x7fe3c80b0550 2021-11-15T19:35:20.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0005d00 con 0x7fe3c80b0550 2021-11-15T19:35:20.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c8156c50 con 0x7fe3c80b0550 2021-11-15T19:35:20.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c0007300 con 0x7fe3c80b0550 2021-11-15T19:35:20.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.605+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c81420d0 con 0x7fe3c80b0550 2021-11-15T19:35:20.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c8156de0 con 0x7fe3c80b0550 2021-11-15T19:35:20.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3c0010030 con 0x7fe3c80b0550 2021-11-15T19:35:20.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3b77fe700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe3a4053580 0x7fe3a4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe3c006b8c0 con 0x7fe3c80b0550 2021-11-15T19:35:20.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3c659c700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe3a4053580 0x7fe3a4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3c659c700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe3a4053580 0x7fe3a4055a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fe3b8002f70 tx=0x7fe3b8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.609+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3c0042a20 con 0x7fe3c80b0550 2021-11-15T19:35:20.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe3c80ae7f0 con 0x7fe3c80b0550 2021-11-15T19:35:20.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3b77fe700 1 -- 172.21.2.137:0/1438061928 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v131) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe3c0046040 con 0x7fe3c80b0550 2021-11-15T19:35:20.705 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:20.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe3a4053580 msgr2=0x7fe3a4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe3a4053580 0x7fe3a4055a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fe3b8002f70 tx=0x7fe3b8014000).stop 2021-11-15T19:35:20.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 msgr2=0x7fe3c81416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 0x7fe3c81416f0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fe3c80aee10 tx=0x7fe3c000c940).stop 2021-11-15T19:35:20.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 shutdown_connections 2021-11-15T19:35:20.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe3a4053580 0x7fe3a4055a40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe3c8140aa0 0x7fe3c8141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe3c80b0550 0x7fe3c81416f0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 --2- 172.21.2.137:0/1438061928 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe3c805c770 0x7fe3c8066cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 >> 172.21.2.137:0/1438061928 conn(0x7fe3c80631e0 msgr2=0x7fe3c813dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 shutdown_connections 2021-11-15T19:35:20.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.693+0000 7fe3cc84b700 1 -- 172.21.2.137:0/1438061928 wait complete. 2021-11-15T19:35:20.712 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:20.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 Processor -- start 2021-11-15T19:35:20.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 -- start start 2021-11-15T19:35:20.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5d24065730 0x7f5d2413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 0x7f5d2405bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d24066270 con 0x7f5d24065b10 2021-11-15T19:35:20.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d24067410 con 0x7f5d24065730 2021-11-15T19:35:20.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d2b82f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24065fd0 con 0x7f5d240b00a0 2021-11-15T19:35:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d29dcc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 0x7f5d2405bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d295cb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f5d24065730 0x7f5d2413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d28dca700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f5d24065b10 0x7f5d2413c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:51330/0 (socket says 172.21.2.137:51330) 2021-11-15T19:35:20.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d29dcc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 0x7f5d2405bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:41628/0 (socket says 172.21.2.137:41628) 2021-11-15T19:35:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d28dca700 1 -- 172.21.2.137:0/509431355 learned_addr learned my addr 172.21.2.137:0/509431355 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d29dcc700 1 -- 172.21.2.137:0/509431355 >> v2:172.21.2.111:3300/0 conn(0x7f5d24065730 msgr2=0x7f5d2413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d29dcc700 1 --2- 172.21.2.137:0/509431355 >> v2:172.21.2.111:3300/0 conn(0x7f5d24065730 0x7f5d2413c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d29dcc700 1 -- 172.21.2.137:0/509431355 >> v1:172.21.2.111:6789/0 conn(0x7f5d24065b10 legacy=0x7f5d2413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.768 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.753+0000 7f5d29dcc700 1 -- 172.21.2.137:0/509431355 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24066f70 con 0x7f5d240b00a0 2021-11-15T19:35:20.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 --2- 172.21.2.137:0/509431355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 0x7f5d2405bd20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5d1c0032f0 tx=0x7f5d1c0091d0).ready entity=mon.2 client_cookie=6f1a6cdfa35b9150 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d17fff700 1 -- 172.21.2.137:0/509431355 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c00b8b0 con 0x7f5d240b00a0 2021-11-15T19:35:20.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d17fff700 1 -- 172.21.2.137:0/509431355 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00ba10 con 0x7f5d240b00a0 2021-11-15T19:35:20.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d17fff700 1 -- 172.21.2.137:0/509431355 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c00bd70 con 0x7f5d240b00a0 2021-11-15T19:35:20.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/509431355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 msgr2=0x7f5d2405bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/509431355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 0x7f5d2405bd20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5d1c0032f0 tx=0x7f5d1c0091d0).stop 2021-11-15T19:35:20.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/509431355 shutdown_connections 2021-11-15T19:35:20.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/509431355 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d240b00a0 0x7f5d2405bd20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/509431355 >> v2:172.21.2.111:3300/0 conn(0x7f5d24065730 0x7f5d2413c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/509431355 >> 172.21.2.137:0/509431355 conn(0x7f5d24060290 msgr2=0x7f5d24060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/509431355 shutdown_connections 2021-11-15T19:35:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/509431355 wait complete. 2021-11-15T19:35:20.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 Processor -- start 2021-11-15T19:35:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- start start 2021-11-15T19:35:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d24065730 0x7f5d2414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d24065b10 0x7f5d240ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 0x7f5d240aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240ac910 con 0x7f5d24065b10 2021-11-15T19:35:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240afa90 con 0x7f5d240b00a0 2021-11-15T19:35:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240acb40 con 0x7f5d24065730 2021-11-15T19:35:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 0x7f5d240aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 0x7f5d240aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40064/0 (socket says 172.21.2.137:40064) 2021-11-15T19:35:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 -- 172.21.2.137:0/2905546971 learned_addr learned my addr 172.21.2.137:0/2905546971 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 -- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d24065730 msgr2=0x7f5d2414df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d24065730 0x7f5d2414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 -- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d24065b10 msgr2=0x7f5d240ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d24065b10 0x7f5d240ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 -- 172.21.2.137:0/2905546971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009470 con 0x7f5d240b00a0 2021-11-15T19:35:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d29dcc700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 0x7f5d240aede0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f5d1c0032f0 tx=0x7f5d1c018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c01d070 con 0x7f5d240b00a0 2021-11-15T19:35:20.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c022420 con 0x7f5d240b00a0 2021-11-15T19:35:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c022780 con 0x7f5d240b00a0 2021-11-15T19:35:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d240acde0 con 0x7f5d240b00a0 2021-11-15T19:35:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.757+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d240ad420 con 0x7f5d240b00a0 2021-11-15T19:35:20.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d240acf70 con 0x7f5d240b00a0 2021-11-15T19:35:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d1c0228e0 con 0x7f5d240b00a0 2021-11-15T19:35:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d167fc700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d04053720 0x7f5d04055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5d1c06d460 con 0x7f5d240b00a0 2021-11-15T19:35:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d295cb700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d04053720 0x7f5d04055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d295cb700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d04053720 0x7f5d04055be0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f5d1800c000 tx=0x7f5d18006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.761+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d1c0444b0 con 0x7f5d240b00a0 2021-11-15T19:35:20.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d240b0fb0 con 0x7f5d240b00a0 2021-11-15T19:35:20.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d167fc700 1 -- 172.21.2.137:0/2905546971 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d1c047ad0 con 0x7f5d240b00a0 2021-11-15T19:35:20.856 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:20.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d04053720 msgr2=0x7f5d04055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d04053720 0x7f5d04055be0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f5d1800c000 tx=0x7f5d18006df0).stop 2021-11-15T19:35:20.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 msgr2=0x7f5d240aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 0x7f5d240aede0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f5d1c0032f0 tx=0x7f5d1c018000).stop 2021-11-15T19:35:20.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 shutdown_connections 2021-11-15T19:35:20.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5d04053720 0x7f5d04055be0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5d240b00a0 0x7f5d240aede0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5d24065b10 0x7f5d240ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 --2- 172.21.2.137:0/2905546971 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5d24065730 0x7f5d2414df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 >> 172.21.2.137:0/2905546971 conn(0x7f5d24060290 msgr2=0x7f5d24069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 shutdown_connections 2021-11-15T19:35:20.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.845+0000 7f5d2b82f700 1 -- 172.21.2.137:0/2905546971 wait complete. 2021-11-15T19:35:20.863 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:35:20.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 Processor -- start 2021-11-15T19:35:20.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- start start 2021-11-15T19:35:20.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f6b400acd60 0x7f6b400b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 0x7f6b401290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400b76c0 con 0x7f6b400b72e0 2021-11-15T19:35:20.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400b3100 con 0x7f6b400acd60 2021-11-15T19:35:20.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b20c0 con 0x7f6b400b4680 2021-11-15T19:35:20.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b4488d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f6b400b72e0 0x7f6b400b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58850/0 (socket says 172.21.2.137:58850) 2021-11-15T19:35:20.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b4488d700 1 -- 172.21.2.137:0/223399474 learned_addr learned my addr 172.21.2.137:0/223399474 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:20.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3ffff700 1 --2- 172.21.2.137:0/223399474 >> v2:172.21.2.137:3300/0 conn(0x7f6b400acd60 0x7f6b400b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3f7fe700 1 -- 172.21.2.137:0/223399474 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392454819 0 0) 0x7f6b400b76c0 con 0x7f6b400b72e0 2021-11-15T19:35:20.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3f7fe700 1 -- 172.21.2.137:0/223399474 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b20003260 con 0x7f6b400b72e0 2021-11-15T19:35:20.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3ffff700 1 -- 172.21.2.137:0/223399474 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 msgr2=0x7f6b401290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:20.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3ffff700 1 --2- 172.21.2.137:0/223399474 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 0x7f6b401290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3ffff700 1 -- 172.21.2.137:0/223399474 >> v1:172.21.2.137:6789/0 conn(0x7f6b400b72e0 legacy=0x7f6b400b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3ffff700 1 -- 172.21.2.137:0/223399474 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4012a170 con 0x7f6b400acd60 2021-11-15T19:35:20.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3ffff700 1 --2- 172.21.2.137:0/223399474 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400acd60 0x7f6b400b4190 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f6b30001370 tx=0x7f6b28006df0).ready entity=mon.1 client_cookie=8c2072aa9c10c010 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3f7fe700 1 -- 172.21.2.137:0/223399474 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b2800d4a0 con 0x7f6b400acd60 2021-11-15T19:35:20.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3f7fe700 1 -- 172.21.2.137:0/223399474 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b28000e90 con 0x7f6b400acd60 2021-11-15T19:35:20.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b3f7fe700 1 -- 172.21.2.137:0/223399474 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b2800d7f0 con 0x7f6b400acd60 2021-11-15T19:35:20.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- 172.21.2.137:0/223399474 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400acd60 msgr2=0x7f6b400b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:20.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 --2- 172.21.2.137:0/223399474 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400acd60 0x7f6b400b4190 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f6b30001370 tx=0x7f6b28006df0).stop 2021-11-15T19:35:20.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- 172.21.2.137:0/223399474 shutdown_connections 2021-11-15T19:35:20.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 --2- 172.21.2.137:0/223399474 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400acd60 0x7f6b400b4190 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:20.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 --2- 172.21.2.137:0/223399474 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 0x7f6b401290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- 172.21.2.137:0/223399474 >> 172.21.2.137:0/223399474 conn(0x7f6b40064960 msgr2=0x7f6b40064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:20.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- 172.21.2.137:0/223399474 shutdown_connections 2021-11-15T19:35:20.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- 172.21.2.137:0/223399474 wait complete. 2021-11-15T19:35:20.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 Processor -- start 2021-11-15T19:35:20.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.905+0000 7f6b46af1700 1 -- start start 2021-11-15T19:35:20.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b400acd60 0x7f6b40126af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 0x7f6b40127180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 0x7f6b4013f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40128ab0 con 0x7f6b400acd60 2021-11-15T19:35:20.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40128d50 con 0x7f6b400b72e0 2021-11-15T19:35:20.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40126170 con 0x7f6b400b4680 2021-11-15T19:35:20.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 0x7f6b4013f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 0x7f6b4013f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40074/0 (socket says 172.21.2.137:40074) 2021-11-15T19:35:20.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 -- 172.21.2.137:0/3714122475 learned_addr learned my addr 172.21.2.137:0/3714122475 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:20.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 -- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 msgr2=0x7f6b40127180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:20.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 0x7f6b40127180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 -- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b400acd60 msgr2=0x7f6b40126af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:20.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b400acd60 0x7f6b40126af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:20.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 -- 172.21.2.137:0/3714122475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2800b180 con 0x7f6b400b72e0 2021-11-15T19:35:20.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4508e700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 0x7f6b4013f950 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f6b380032f0 tx=0x7f6b380091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3800d6f0 con 0x7f6b400b72e0 2021-11-15T19:35:20.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800d850 con 0x7f6b400b72e0 2021-11-15T19:35:20.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b40126410 con 0x7f6b400b72e0 2021-11-15T19:35:20.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4013fe40 con 0x7f6b400b72e0 2021-11-15T19:35:20.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3800dbb0 con 0x7f6b400b72e0 2021-11-15T19:35:20.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b40127670 con 0x7f6b400b72e0 2021-11-15T19:35:20.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6b38018030 con 0x7f6b400b72e0 2021-11-15T19:35:20.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b3dffb700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b240536f0 0x7f6b24055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:20.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6b3806b7e0 con 0x7f6b400b72e0 2021-11-15T19:35:20.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.909+0000 7f6b4488d700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b240536f0 0x7f6b24055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:20.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.913+0000 7f6b4488d700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b240536f0 0x7f6b24055bb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f6b30000ed0 tx=0x7f6b30007600).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:20.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.913+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b38041e90 con 0x7f6b400b72e0 2021-11-15T19:35:21.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b400b3a50 con 0x7f6b400b72e0 2021-11-15T19:35:21.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b3dffb700 1 -- 172.21.2.137:0/3714122475 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6b38046310 con 0x7f6b400b72e0 2021-11-15T19:35:21.008 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b240536f0 msgr2=0x7f6b24055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b240536f0 0x7f6b24055bb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f6b30000ed0 tx=0x7f6b30007600).stop 2021-11-15T19:35:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 msgr2=0x7f6b4013f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 0x7f6b4013f950 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f6b380032f0 tx=0x7f6b380091d0).stop 2021-11-15T19:35:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 shutdown_connections 2021-11-15T19:35:21.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6b240536f0 0x7f6b24055bb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6b400b72e0 0x7f6b4013f950 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6b400b4680 0x7f6b40127180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 --2- 172.21.2.137:0/3714122475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f6b400acd60 0x7f6b40126af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 >> 172.21.2.137:0/3714122475 conn(0x7f6b40064960 msgr2=0x7f6b400614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:21.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 shutdown_connections 2021-11-15T19:35:21.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:20.997+0000 7f6b46af1700 1 -- 172.21.2.137:0/3714122475 wait complete. 2021-11-15T19:35:21.015 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:35:21.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 Processor -- start 2021-11-15T19:35:21.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 -- start start 2021-11-15T19:35:21.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd5e00b0550 0x7fd5e014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e005cb50 con 0x7fd5e014aaa0 2021-11-15T19:35:21.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e00ad030 con 0x7fd5e005c770 2021-11-15T19:35:21.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e00b1650 con 0x7fd5e00b0550 2021-11-15T19:35:21.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e59bd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd5e005c770 0x7fd5e00aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58864/0 (socket says 172.21.2.137:58864) 2021-11-15T19:35:21.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e59bd700 1 -- 172.21.2.137:0/3895522361 learned_addr learned my addr 172.21.2.137:0/3895522361 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:21.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679468964 0 0) 0x7fd5e00ad030 con 0x7fd5e005c770 2021-11-15T19:35:21.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c8003260 con 0x7fd5e005c770 2021-11-15T19:35:21.073 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184883508 0 0) 0x7fd5c8003260 con 0x7fd5e005c770 2021-11-15T19:35:21.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 >> v2:172.21.2.111:3300/0 conn(0x7fd5e00b0550 msgr2=0x7fd5e014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:21.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 --2- 172.21.2.137:0/3895522361 >> v2:172.21.2.111:3300/0 conn(0x7fd5e00b0550 0x7fd5e014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 >> v1:172.21.2.111:6789/0 conn(0x7fd5e014aaa0 legacy=0x7fd5e0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:21.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00ad2d0 con 0x7fd5e005c770 2021-11-15T19:35:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fd5d4001660 con 0x7fd5e005c770 2021-11-15T19:35:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 >> v1:172.21.2.137:6789/0 conn(0x7fd5e005c770 legacy=0x7fd5e00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5c8003820 0x7fd5c8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5c8004500 0x7fd5c8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5c800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00b1650 con 0x7fd5c8003820 2021-11-15T19:35:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c800bf40 con 0x7fd5c8005050 2021-11-15T19:35:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c800c100 con 0x7fd5c8004500 2021-11-15T19:35:21.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5c800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e59bd700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5c8003820 0x7fd5c8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 -- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5c8004500 msgr2=0x7fd5c8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5c8004500 0x7fd5c8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 -- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5c8003820 msgr2=0x7fd5c8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:21.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5c8003820 0x7fd5c8003c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 -- 172.21.2.137:0/3895522361 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8003260 con 0x7fd5c8005050 2021-11-15T19:35:21.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 -- 172.21.2.137:0/3895522361 reap_dead start 2021-11-15T19:35:21.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e61be700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5c800b750 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fd5d80012f0 tx=0x7fd5d8007d60).ready entity=mon.1 client_cookie=8da0dae74085d897 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:21.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5d80014c0 con 0x7fd5c8005050 2021-11-15T19:35:21.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8006870 con 0x7fd5c8005050 2021-11-15T19:35:21.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e49bb700 1 -- 172.21.2.137:0/3895522361 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5d8006bd0 con 0x7fd5c8005050 2021-11-15T19:35:21.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3895522361 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 msgr2=0x7fd5c800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.057+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5c800b750 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fd5d80012f0 tx=0x7fd5d8007d60).stop 2021-11-15T19:35:21.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3895522361 shutdown_connections 2021-11-15T19:35:21.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3895522361 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5c800b750 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3895522361 >> 172.21.2.137:0/3895522361 conn(0x7fd5e00631e0 msgr2=0x7fd5e005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:21.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3895522361 shutdown_connections 2021-11-15T19:35:21.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3895522361 wait complete. 2021-11-15T19:35:21.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 Processor -- start 2021-11-15T19:35:21.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- start start 2021-11-15T19:35:21.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5e0067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5e01416f0 0x7fd5e0159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5e0159e40 0x7fd5e015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e01442f0 con 0x7fd5e01416f0 2021-11-15T19:35:21.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e0142920 con 0x7fd5c8005050 2021-11-15T19:35:21.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e015a7b0 con 0x7fd5e0159e40 2021-11-15T19:35:21.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5e0067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5e0067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40094/0 (socket says 172.21.2.137:40094) 2021-11-15T19:35:21.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 -- 172.21.2.137:0/3032513810 learned_addr learned my addr 172.21.2.137:0/3032513810 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:21.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 -- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5e0159e40 msgr2=0x7fd5e015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5e0159e40 0x7fd5e015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 -- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5e01416f0 msgr2=0x7fd5e0159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5e01416f0 0x7fd5e0159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 -- 172.21.2.137:0/3032513810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e01571a0 con 0x7fd5c8005050 2021-11-15T19:35:21.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e59bd700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5e0067210 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fd5d4008000 tx=0x7fd5d4009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:21.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5d4007170 con 0x7fd5c8005050 2021-11-15T19:35:21.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d40072d0 con 0x7fd5c8005050 2021-11-15T19:35:21.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e0157440 con 0x7fd5c8005050 2021-11-15T19:35:21.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5d4004920 con 0x7fd5c8005050 2021-11-15T19:35:21.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e0156e20 con 0x7fd5c8005050 2021-11-15T19:35:21.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e00ae7f0 con 0x7fd5c8005050 2021-11-15T19:35:21.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5d4004a80 con 0x7fd5c8005050 2021-11-15T19:35:21.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5d2ffd700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd5c00536a0 0x7fd5c0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd5d406b5c0 con 0x7fd5c8005050 2021-11-15T19:35:21.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.061+0000 7fd5e51bc700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd5c00536a0 0x7fd5c0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.065+0000 7fd5e51bc700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd5c00536a0 0x7fd5c0055b60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fd5dc002f70 tx=0x7fd5dc006a00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:21.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.065+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5d4042720 con 0x7fd5c8005050 2021-11-15T19:35:21.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5e00573d0 con 0x7fd5c8005050 2021-11-15T19:35:21.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5d2ffd700 1 -- 172.21.2.137:0/3032513810 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd5d4045d40 con 0x7fd5c8005050 2021-11-15T19:35:21.160 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:21.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd5c00536a0 msgr2=0x7fd5c0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd5c00536a0 0x7fd5c0055b60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fd5dc002f70 tx=0x7fd5dc006a00).stop 2021-11-15T19:35:21.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 msgr2=0x7fd5e0067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5e0067210 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fd5d4008000 tx=0x7fd5d4009040).stop 2021-11-15T19:35:21.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 shutdown_connections 2021-11-15T19:35:21.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd5c00536a0 0x7fd5c0055b60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5e0159e40 0x7fd5e015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd5e01416f0 0x7fd5e0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:21.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 --2- 172.21.2.137:0/3032513810 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5c8005050 0x7fd5e0067210 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 >> 172.21.2.137:0/3032513810 conn(0x7fd5e00631e0 msgr2=0x7fd5e00b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:21.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 shutdown_connections 2021-11-15T19:35:21.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.149+0000 7fd5e7c21700 1 -- 172.21.2.137:0/3032513810 wait complete. 2021-11-15T19:35:21.168 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:35:21.168 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:21.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.205+0000 7f99a6a0e700 1 Processor -- start 2021-11-15T19:35:21.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.205+0000 7f99a6a0e700 1 -- start start 2021-11-15T19:35:21.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.205+0000 7f99a6a0e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f99a00acab0 0x7f99a00b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.205+0000 7f99a6a0e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00aecf0 con 0x7f99a00b1180 2021-11-15T19:35:21.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.205+0000 7f99a6a0e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a013f180 con 0x7f99a00af2f0 2021-11-15T19:35:21.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.205+0000 7f99a6a0e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a006a580 con 0x7f99a00acab0 2021-11-15T19:35:21.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a4fab700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f99a00af2f0 0x7f99a0142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58886/0 (socket says 172.21.2.137:58886) 2021-11-15T19:35:21.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a4fab700 1 -- 172.21.2.137:0/2468776254 learned_addr learned my addr 172.21.2.137:0/2468776254 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:21.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999ffff700 1 --2- 172.21.2.137:0/2468776254 >> v2:172.21.2.137:3300/0 conn(0x7f99a00acab0 0x7f99a00b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999effd700 1 -- 172.21.2.137:0/2468776254 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190473697 0 0) 0x7f9998001110 con 0x7f99a00af2f0 2021-11-15T19:35:21.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999effd700 1 -- 172.21.2.137:0/2468776254 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9980003260 con 0x7f99a00af2f0 2021-11-15T19:35:21.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999ffff700 1 -- 172.21.2.137:0/2468776254 >> v1:172.21.2.137:6789/0 conn(0x7f99a00af2f0 legacy=0x7f99a0142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999ffff700 1 -- 172.21.2.137:0/2468776254 >> v1:172.21.2.111:6789/0 conn(0x7f99a00b1180 legacy=0x7f99a0069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:21.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999ffff700 1 -- 172.21.2.137:0/2468776254 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00aef20 con 0x7f99a00acab0 2021-11-15T19:35:21.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999ffff700 1 --2- 172.21.2.137:0/2468776254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00acab0 0x7f99a00b2060 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f99a00b2bd0 tx=0x7f9988006df0).ready entity=mon.1 client_cookie=d1c3d4af5874b0e3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:21.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999effd700 1 -- 172.21.2.137:0/2468776254 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f998800d5c0 con 0x7f99a00acab0 2021-11-15T19:35:21.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999effd700 1 -- 172.21.2.137:0/2468776254 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9988000e90 con 0x7f99a00acab0 2021-11-15T19:35:21.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999effd700 1 -- 172.21.2.137:0/2468776254 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f998800d910 con 0x7f99a00acab0 2021-11-15T19:35:21.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/2468776254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00acab0 msgr2=0x7f99a00b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/2468776254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00acab0 0x7f99a00b2060 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f99a00b2bd0 tx=0x7f9988006df0).stop 2021-11-15T19:35:21.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/2468776254 shutdown_connections 2021-11-15T19:35:21.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/2468776254 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00acab0 0x7f99a00b2060 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/2468776254 >> 172.21.2.137:0/2468776254 conn(0x7f99a00630f0 msgr2=0x7f99a00634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:21.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/2468776254 shutdown_connections 2021-11-15T19:35:21.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/2468776254 wait complete. 2021-11-15T19:35:21.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 Processor -- start 2021-11-15T19:35:21.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- start start 2021-11-15T19:35:21.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a00acab0 0x7f99a0112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 0x7f99a013e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99a00b1180 0x7f99a013e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0112a60 con 0x7f99a00b1180 2021-11-15T19:35:21.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a01153c0 con 0x7f99a00af2f0 2021-11-15T19:35:21.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0115630 con 0x7f99a00acab0 2021-11-15T19:35:21.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 0x7f99a013e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 0x7f99a013e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40108/0 (socket says 172.21.2.137:40108) 2021-11-15T19:35:21.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 -- 172.21.2.137:0/4119776785 learned_addr learned my addr 172.21.2.137:0/4119776785 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:21.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999ffff700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a00acab0 0x7f99a0112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a4fab700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99a00b1180 0x7f99a013e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 -- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a00acab0 msgr2=0x7f99a0112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a00acab0 0x7f99a0112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 -- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99a00b1180 msgr2=0x7f99a013e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99a00b1180 0x7f99a013e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 -- 172.21.2.137:0/4119776785 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998800b180 con 0x7f99a00af2f0 2021-11-15T19:35:21.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999f7fe700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 0x7f99a013e070 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f99a0114890 tx=0x7f9990006f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:21.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999000d4a0 con 0x7f99a00af2f0 2021-11-15T19:35:21.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999000d600 con 0x7f99a00af2f0 2021-11-15T19:35:21.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a01110a0 con 0x7f99a00af2f0 2021-11-15T19:35:21.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999000d960 con 0x7f99a00af2f0 2021-11-15T19:35:21.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.209+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0111540 con 0x7f99a00af2f0 2021-11-15T19:35:21.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0111260 con 0x7f99a00af2f0 2021-11-15T19:35:21.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9990018030 con 0x7f99a00af2f0 2021-11-15T19:35:21.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f999d7fa700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053660 0x7f9984055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:21.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f999006b3b0 con 0x7f99a00af2f0 2021-11-15T19:35:21.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f999ffff700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053660 0x7f9984055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:21.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f999ffff700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053660 0x7f9984055b20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f9988015000 tx=0x7f9988014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:21.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.213+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99900424b0 con 0x7f99a00af2f0 2021-11-15T19:35:21.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a00573d0 con 0x7f99a00af2f0 2021-11-15T19:35:21.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f999d7fa700 1 -- 172.21.2.137:0/4119776785 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f9990016070 con 0x7f99a00af2f0 2021-11-15T19:35:21.336 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:21.336 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":68,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:18.459599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7969":{"gid":7969,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4213511213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4213511213},{"type":"v1","addr":"172.21.2.137:6833","nonce":4213511213}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053660 msgr2=0x7f9984055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053660 0x7f9984055b20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f9988015000 tx=0x7f9988014000).stop 2021-11-15T19:35:21.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 msgr2=0x7f99a013e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 0x7f99a013e070 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f99a0114890 tx=0x7f9990006f90).stop 2021-11-15T19:35:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 shutdown_connections 2021-11-15T19:35:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9984053660 0x7f9984055b20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f99a00b1180 0x7f99a013e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f99a00af2f0 0x7f99a013e070 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 --2- 172.21.2.137:0/4119776785 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f99a00acab0 0x7f99a0112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 >> 172.21.2.137:0/4119776785 conn(0x7f99a00630f0 msgr2=0x7f99a0140700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 shutdown_connections 2021-11-15T19:35:21.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:21.325+0000 7f99a6a0e700 1 -- 172.21.2.137:0/4119776785 wait complete. 2021-11-15T19:35:21.340 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 68 2021-11-15T19:35:21.545 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:16.433090+0000', 'modified': '2021-11-15T19:35:18.459599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7969': {'gid': 7969, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4213511213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4213511213}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4213511213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:21.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:21.546 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:21.609 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7969,"want_state":"up:active","state":"up:active","rank_uptime":4.141474229,"mdsmap_epoch":68,"osdmap_epoch":131,"osdmap_epoch_barrier":131,"uptime":8.3597165059999998} 2021-11-15T19:35:21.609 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7969, "mdsmap_epoch": 68, "osdmap_epoch": 131, "osdmap_epoch_barrier": 131, "rank_uptime": 4.141474229, "state": "up:active", "uptime": 8.359716506, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:21.610 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:35:21.610 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:35:21.610 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:35:21.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:21.611 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:21.622 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:21.634 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:21.634 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:21.640 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:21.641 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:21.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:21.642 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:21.646 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:35:21.646 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:21.691 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:21.700 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:21.701 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:21.706 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:21.706 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:21.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:21.708 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:21.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14618]: starting ceph client 2021-11-15T19:35:21.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:35:21.728+0000 7f920a4cb080 -1 init, newargv = 0x555f51659af0 newargc=9 2021-11-15T19:35:21.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14618]: starting fuse 2021-11-15T19:35:22.835 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:22.848 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:22.848 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:22.896 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:22.896 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:22.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:22.898 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:22.903 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:35:22.903 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:35:22.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:22.904 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:35:22.905 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:35:22.905 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:35:22.906 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:35:22.906 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:35:22.906 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:22.907 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:35:22.907 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:35:22.908 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:35:22.908 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:22.908 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:35:22.909 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:35:22.909 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:35:22.910 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:35:22.910 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:22.910 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:35:22.911 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:35:22.911 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:35:22.912 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:35:22.912 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:35:22.912 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:22.913 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:35:22.913 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:35:22.979 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14618.asok 2021-11-15T19:35:22.981 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14618.asok 2021-11-15T19:35:22.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:22.982 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14618.asok status 2021-11-15T19:35:23.029 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:35:23.030 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:35:23.030 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:35:23.030 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:35:23.030 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:35:23.031 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:35:23.031 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:35:23.031 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14618", 2021-11-15T19:35:23.031 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:35:23.032 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:23.032 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:35:23.032 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:35:23.032 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 8173, 2021-11-15T19:35:23.032 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:35:23.033 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:35:23.033 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:35:23.033 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 8173 2021-11-15T19:35:23.033 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:23.034 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:35:23.034 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:35:23.034 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:35:23.034 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 2652750271 2021-11-15T19:35:23.034 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:35:23.035 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:23.035 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:35:23.035 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:35:23.035 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:35:23.036 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 2652750271 2021-11-15T19:35:23.036 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:23.036 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.8173 172.21.2.118:0/2652750271", 2021-11-15T19:35:23.036 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/2652750271", 2021-11-15T19:35:23.036 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:35:23.037 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 68, 2021-11-15T19:35:23.037 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 131, 2021-11-15T19:35:23.037 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:35:23.037 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:35:23.038 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:35:23.038 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:35:23.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:23.039 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:23.040 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:23.045 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:23.046 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:23.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:23.047 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:23.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:23.056 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:23.056 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:23.102 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:23.103 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:23.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:23.104 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:23.104 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:23.110 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:23.110 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:23.110 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:35:23.111 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:35:23.111 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:23.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14618]: fuse finished with error 0 and tester_r 0 2021-11-15T19:35:23.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:23.120 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:23.121 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:23.169 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:35:23.170 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:35:23.171 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:35:24.597 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:24.601 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:24.604 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:24.607 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:24.611 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:29.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:29.274 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:29.285 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:29.288 DEBUG:teuthology.orchestra.run.gibba017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:29.292 DEBUG:teuthology.orchestra.run.gibba018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:29.327 DEBUG:teuthology.orchestra.run.gibba031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:29.330 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:29.335 INFO:teuthology.orchestra.run.gibba017.stdout:[global] 2021-11-15T19:35:29.336 INFO:teuthology.orchestra.run.gibba017.stdout: chdir = "" 2021-11-15T19:35:29.336 INFO:teuthology.orchestra.run.gibba017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:29.336 INFO:teuthology.orchestra.run.gibba017.stdout: auth supported = cephx 2021-11-15T19:35:29.337 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.337 INFO:teuthology.orchestra.run.gibba017.stdout: filestore xattr use omap = true 2021-11-15T19:35:29.337 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.337 INFO:teuthology.orchestra.run.gibba017.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:29.338 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.338 INFO:teuthology.orchestra.run.gibba017.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:29.338 INFO:teuthology.orchestra.run.gibba017.stdout: auth debug = true 2021-11-15T19:35:29.338 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.338 INFO:teuthology.orchestra.run.gibba017.stdout: ms die on old message = true 2021-11-15T19:35:29.339 INFO:teuthology.orchestra.run.gibba017.stdout: ms die on bug = true 2021-11-15T19:35:29.339 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.339 INFO:teuthology.orchestra.run.gibba017.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:29.339 INFO:teuthology.orchestra.run.gibba017.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:29.340 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.340 INFO:teuthology.orchestra.run.gibba017.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:29.340 INFO:teuthology.orchestra.run.gibba017.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:29.340 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.341 INFO:teuthology.orchestra.run.gibba017.stdout: osd pool default size = 2 2021-11-15T19:35:29.341 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.341 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:29.341 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd allow pg remap = true 2021-11-15T19:35:29.341 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:29.342 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:29.342 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:29.342 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:29.342 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on too few osds = false 2021-11-15T19:35:29.343 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:29.343 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:29.343 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.343 INFO:teuthology.orchestra.run.gibba017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:29.344 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.344 INFO:teuthology.orchestra.run.gibba017.stdout: osd default data pool replay window = 5 2021-11-15T19:35:29.344 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.344 INFO:teuthology.orchestra.run.gibba017.stdout: mon allow pool delete = true 2021-11-15T19:35:29.345 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.345 INFO:teuthology.orchestra.run.gibba017.stdout: mon cluster log file level = debug 2021-11-15T19:35:29.345 INFO:teuthology.orchestra.run.gibba017.stdout: debug asserts on shutdown = true 2021-11-15T19:35:29.345 INFO:teuthology.orchestra.run.gibba017.stdout: mon health detail to clog = false 2021-11-15T19:35:29.345 INFO:teuthology.orchestra.run.gibba017.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:29.346 INFO:teuthology.orchestra.run.gibba017.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:29.346 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.346 INFO:teuthology.orchestra.run.gibba017.stdout:[osd] 2021-11-15T19:35:29.346 INFO:teuthology.orchestra.run.gibba017.stdout: osd journal size = 100 2021-11-15T19:35:29.347 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.347 INFO:teuthology.orchestra.run.gibba017.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:29.347 INFO:teuthology.orchestra.run.gibba017.stdout: osd scrub max interval = 600 2021-11-15T19:35:29.347 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.347 INFO:teuthology.orchestra.run.gibba017.stdout: osd recover clone overlap = true 2021-11-15T19:35:29.348 INFO:teuthology.orchestra.run.gibba017.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:29.348 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.348 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug shutdown = true 2021-11-15T19:35:29.348 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug op order = true 2021-11-15T19:35:29.349 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:29.349 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.349 INFO:teuthology.orchestra.run.gibba017.stdout: osd open classes on start = true 2021-11-15T19:35:29.349 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug pg log writeout = true 2021-11-15T19:35:29.349 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.350 INFO:teuthology.orchestra.run.gibba017.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:29.350 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.350 INFO:teuthology.orchestra.run.gibba017.stdout: osd map max advance = 10 2021-11-15T19:35:29.350 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.351 INFO:teuthology.orchestra.run.gibba017.stdout: journal zero on create = true 2021-11-15T19:35:29.351 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.351 INFO:teuthology.orchestra.run.gibba017.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:29.351 INFO:teuthology.orchestra.run.gibba017.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:29.352 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.352 INFO:teuthology.orchestra.run.gibba017.stdout: bdev debug aio = true 2021-11-15T19:35:29.352 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug misdirected ops = true 2021-11-15T19:35:29.352 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:29.352 INFO:teuthology.orchestra.run.gibba017.stdout: debug osd = 20 2021-11-15T19:35:29.353 INFO:teuthology.orchestra.run.gibba017.stdout: osd objectstore = filestore 2021-11-15T19:35:29.353 INFO:teuthology.orchestra.run.gibba017.stdout: osd op complaint time = 180 2021-11-15T19:35:29.353 INFO:teuthology.orchestra.run.gibba017.stdout: osd sloppy crc = True 2021-11-15T19:35:29.353 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.353 INFO:teuthology.orchestra.run.gibba017.stdout:[mgr] 2021-11-15T19:35:29.354 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:29.354 INFO:teuthology.orchestra.run.gibba017.stdout: debug mgr = 20 2021-11-15T19:35:29.354 INFO:teuthology.orchestra.run.gibba017.stdout: debug mon = 20 2021-11-15T19:35:29.354 INFO:teuthology.orchestra.run.gibba017.stdout: debug auth = 20 2021-11-15T19:35:29.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.355 INFO:teuthology.orchestra.run.gibba017.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:29.355 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.356 INFO:teuthology.orchestra.run.gibba017.stdout:[mon] 2021-11-15T19:35:29.356 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:29.356 INFO:teuthology.orchestra.run.gibba017.stdout: debug mon = 20 2021-11-15T19:35:29.356 INFO:teuthology.orchestra.run.gibba017.stdout: debug paxos = 20 2021-11-15T19:35:29.357 INFO:teuthology.orchestra.run.gibba017.stdout: debug auth = 20 2021-11-15T19:35:29.357 INFO:teuthology.orchestra.run.gibba017.stdout: mon data avail warn = 5 2021-11-15T19:35:29.357 INFO:teuthology.orchestra.run.gibba017.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:29.357 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.357 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:29.358 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd prime pg temp = true 2021-11-15T19:35:29.358 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.358 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.358 INFO:teuthology.orchestra.run.gibba017.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:29.359 INFO:teuthology.orchestra.run.gibba017.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:29.359 INFO:teuthology.orchestra.run.gibba017.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:29.359 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.359 INFO:teuthology.orchestra.run.gibba017.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:29.359 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:29.360 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:29.360 INFO:teuthology.orchestra.run.gibba017.stdout: mon op complaint time = 120 2021-11-15T19:35:29.360 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:29.360 INFO:teuthology.orchestra.run.gibba017.stdout:[client] 2021-11-15T19:35:29.361 INFO:teuthology.orchestra.run.gibba017.stdout: rgw cache enabled = true 2021-11-15T19:35:29.361 INFO:teuthology.orchestra.run.gibba017.stdout: rgw enable ops log = true 2021-11-15T19:35:29.361 INFO:teuthology.orchestra.run.gibba017.stdout: rgw enable usage log = true 2021-11-15T19:35:29.361 INFO:teuthology.orchestra.run.gibba017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:29.362 INFO:teuthology.orchestra.run.gibba017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:29.362 INFO:teuthology.orchestra.run.gibba017.stdout: client mount timeout = 600 2021-11-15T19:35:29.362 INFO:teuthology.orchestra.run.gibba017.stdout: debug client = 20 2021-11-15T19:35:29.362 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:29.362 INFO:teuthology.orchestra.run.gibba017.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.363 INFO:teuthology.orchestra.run.gibba017.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.363 INFO:teuthology.orchestra.run.gibba017.stdout: client debug getattr caps = true 2021-11-15T19:35:29.363 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.a] 2021-11-15T19:35:29.363 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.b] 2021-11-15T19:35:29.364 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.c] 2021-11-15T19:35:29.364 INFO:teuthology.orchestra.run.gibba017.stdout:[mds.a] 2021-11-15T19:35:29.364 INFO:teuthology.orchestra.run.gibba017.stdout:[mds.b] 2021-11-15T19:35:29.364 INFO:teuthology.orchestra.run.gibba017.stdout:[mds] 2021-11-15T19:35:29.365 INFO:teuthology.orchestra.run.gibba017.stdout: debug mds = 20 2021-11-15T19:35:29.365 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:29.365 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal frag = True 2021-11-15T19:35:29.365 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:29.366 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal merge size = 5 2021-11-15T19:35:29.366 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal split bits = 3 2021-11-15T19:35:29.366 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal split size = 100 2021-11-15T19:35:29.366 INFO:teuthology.orchestra.run.gibba017.stdout: mds debug frag = True 2021-11-15T19:35:29.366 INFO:teuthology.orchestra.run.gibba017.stdout: mds debug scatterstat = True 2021-11-15T19:35:29.367 INFO:teuthology.orchestra.run.gibba017.stdout: mds op complaint time = 180 2021-11-15T19:35:29.367 INFO:teuthology.orchestra.run.gibba017.stdout: mds verify scatter = True 2021-11-15T19:35:29.367 INFO:teuthology.orchestra.run.gibba017.stdout: osd op complaint time = 180 2021-11-15T19:35:29.367 INFO:teuthology.orchestra.run.gibba017.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.367 INFO:teuthology.orchestra.run.gibba017.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.368 INFO:teuthology.orchestra.run.gibba011.stdout:[global] 2021-11-15T19:35:29.368 INFO:teuthology.orchestra.run.gibba011.stdout: chdir = "" 2021-11-15T19:35:29.368 INFO:teuthology.orchestra.run.gibba011.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:29.368 INFO:teuthology.orchestra.run.gibba011.stdout: auth supported = cephx 2021-11-15T19:35:29.369 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.369 INFO:teuthology.orchestra.run.gibba011.stdout: filestore xattr use omap = true 2021-11-15T19:35:29.369 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.369 INFO:teuthology.orchestra.run.gibba011.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:29.369 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.370 INFO:teuthology.orchestra.run.gibba011.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:29.370 INFO:teuthology.orchestra.run.gibba011.stdout: auth debug = true 2021-11-15T19:35:29.370 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.370 INFO:teuthology.orchestra.run.gibba011.stdout: ms die on old message = true 2021-11-15T19:35:29.371 INFO:teuthology.orchestra.run.gibba011.stdout: ms die on bug = true 2021-11-15T19:35:29.371 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.371 INFO:teuthology.orchestra.run.gibba011.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:29.371 INFO:teuthology.orchestra.run.gibba011.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:29.371 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.372 INFO:teuthology.orchestra.run.gibba011.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:29.372 INFO:teuthology.orchestra.run.gibba011.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:29.372 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.372 INFO:teuthology.orchestra.run.gibba011.stdout: osd pool default size = 2 2021-11-15T19:35:29.373 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.373 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:29.373 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd allow pg remap = true 2021-11-15T19:35:29.373 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:29.373 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:29.374 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:29.374 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:29.374 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on too few osds = false 2021-11-15T19:35:29.374 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:29.374 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:29.375 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.375 INFO:teuthology.orchestra.run.gibba011.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:29.375 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.375 INFO:teuthology.orchestra.run.gibba011.stdout: osd default data pool replay window = 5 2021-11-15T19:35:29.375 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.376 INFO:teuthology.orchestra.run.gibba011.stdout: mon allow pool delete = true 2021-11-15T19:35:29.376 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.376 INFO:teuthology.orchestra.run.gibba011.stdout: mon cluster log file level = debug 2021-11-15T19:35:29.376 INFO:teuthology.orchestra.run.gibba011.stdout: debug asserts on shutdown = true 2021-11-15T19:35:29.377 INFO:teuthology.orchestra.run.gibba011.stdout: mon health detail to clog = false 2021-11-15T19:35:29.377 INFO:teuthology.orchestra.run.gibba011.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:29.377 INFO:teuthology.orchestra.run.gibba011.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:29.377 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.377 INFO:teuthology.orchestra.run.gibba011.stdout:[osd] 2021-11-15T19:35:29.378 INFO:teuthology.orchestra.run.gibba011.stdout: osd journal size = 100 2021-11-15T19:35:29.378 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.378 INFO:teuthology.orchestra.run.gibba011.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:29.378 INFO:teuthology.orchestra.run.gibba011.stdout: osd scrub max interval = 600 2021-11-15T19:35:29.378 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.379 INFO:teuthology.orchestra.run.gibba011.stdout: osd recover clone overlap = true 2021-11-15T19:35:29.379 INFO:teuthology.orchestra.run.gibba011.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:29.379 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.379 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug shutdown = true 2021-11-15T19:35:29.380 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug op order = true 2021-11-15T19:35:29.380 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:29.380 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.380 INFO:teuthology.orchestra.run.gibba011.stdout: osd open classes on start = true 2021-11-15T19:35:29.380 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug pg log writeout = true 2021-11-15T19:35:29.381 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.381 INFO:teuthology.orchestra.run.gibba011.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:29.381 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.381 INFO:teuthology.orchestra.run.gibba011.stdout: osd map max advance = 10 2021-11-15T19:35:29.381 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.382 INFO:teuthology.orchestra.run.gibba011.stdout: journal zero on create = true 2021-11-15T19:35:29.382 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.382 INFO:teuthology.orchestra.run.gibba011.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:29.382 INFO:teuthology.orchestra.run.gibba011.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:29.382 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.383 INFO:teuthology.orchestra.run.gibba011.stdout: bdev debug aio = true 2021-11-15T19:35:29.383 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug misdirected ops = true 2021-11-15T19:35:29.383 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:29.384 INFO:teuthology.orchestra.run.gibba011.stdout: debug osd = 20 2021-11-15T19:35:29.384 INFO:teuthology.orchestra.run.gibba011.stdout: osd objectstore = filestore 2021-11-15T19:35:29.384 INFO:teuthology.orchestra.run.gibba011.stdout: osd op complaint time = 180 2021-11-15T19:35:29.384 INFO:teuthology.orchestra.run.gibba011.stdout: osd sloppy crc = True 2021-11-15T19:35:29.384 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.385 INFO:teuthology.orchestra.run.gibba011.stdout:[mgr] 2021-11-15T19:35:29.385 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:29.385 INFO:teuthology.orchestra.run.gibba011.stdout: debug mgr = 20 2021-11-15T19:35:29.385 INFO:teuthology.orchestra.run.gibba011.stdout: debug mon = 20 2021-11-15T19:35:29.385 INFO:teuthology.orchestra.run.gibba011.stdout: debug auth = 20 2021-11-15T19:35:29.386 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.386 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.386 INFO:teuthology.orchestra.run.gibba011.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:29.386 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.387 INFO:teuthology.orchestra.run.gibba011.stdout:[mon] 2021-11-15T19:35:29.387 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:29.387 INFO:teuthology.orchestra.run.gibba011.stdout: debug mon = 20 2021-11-15T19:35:29.387 INFO:teuthology.orchestra.run.gibba011.stdout: debug paxos = 20 2021-11-15T19:35:29.387 INFO:teuthology.orchestra.run.gibba011.stdout: debug auth = 20 2021-11-15T19:35:29.388 INFO:teuthology.orchestra.run.gibba011.stdout: mon data avail warn = 5 2021-11-15T19:35:29.388 INFO:teuthology.orchestra.run.gibba011.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:29.388 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.388 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:29.389 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd prime pg temp = true 2021-11-15T19:35:29.389 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.389 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.389 INFO:teuthology.orchestra.run.gibba011.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:29.389 INFO:teuthology.orchestra.run.gibba011.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:29.390 INFO:teuthology.orchestra.run.gibba011.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:29.390 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.390 INFO:teuthology.orchestra.run.gibba011.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:29.390 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:29.391 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:29.391 INFO:teuthology.orchestra.run.gibba011.stdout: mon op complaint time = 120 2021-11-15T19:35:29.391 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:29.391 INFO:teuthology.orchestra.run.gibba011.stdout:[client] 2021-11-15T19:35:29.391 INFO:teuthology.orchestra.run.gibba011.stdout: rgw cache enabled = true 2021-11-15T19:35:29.392 INFO:teuthology.orchestra.run.gibba011.stdout: rgw enable ops log = true 2021-11-15T19:35:29.392 INFO:teuthology.orchestra.run.gibba011.stdout: rgw enable usage log = true 2021-11-15T19:35:29.392 INFO:teuthology.orchestra.run.gibba011.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:29.392 INFO:teuthology.orchestra.run.gibba011.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:29.393 INFO:teuthology.orchestra.run.gibba011.stdout: client mount timeout = 600 2021-11-15T19:35:29.393 INFO:teuthology.orchestra.run.gibba011.stdout: debug client = 20 2021-11-15T19:35:29.393 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:29.393 INFO:teuthology.orchestra.run.gibba011.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.393 INFO:teuthology.orchestra.run.gibba011.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.394 INFO:teuthology.orchestra.run.gibba011.stdout: client debug getattr caps = true 2021-11-15T19:35:29.394 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.a] 2021-11-15T19:35:29.394 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.b] 2021-11-15T19:35:29.394 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.c] 2021-11-15T19:35:29.394 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.a] 2021-11-15T19:35:29.395 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.b] 2021-11-15T19:35:29.395 INFO:teuthology.orchestra.run.gibba011.stdout:[mds] 2021-11-15T19:35:29.395 INFO:teuthology.orchestra.run.gibba011.stdout: debug mds = 20 2021-11-15T19:35:29.395 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal frag = True 2021-11-15T19:35:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal merge size = 5 2021-11-15T19:35:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal split bits = 3 2021-11-15T19:35:29.396 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal split size = 100 2021-11-15T19:35:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: mds debug frag = True 2021-11-15T19:35:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: mds debug scatterstat = True 2021-11-15T19:35:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: mds op complaint time = 180 2021-11-15T19:35:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: mds verify scatter = True 2021-11-15T19:35:29.397 INFO:teuthology.orchestra.run.gibba011.stdout: osd op complaint time = 180 2021-11-15T19:35:29.398 INFO:teuthology.orchestra.run.gibba011.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.398 INFO:teuthology.orchestra.run.gibba011.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.401 INFO:teuthology.orchestra.run.gibba037.stdout:[global] 2021-11-15T19:35:29.401 INFO:teuthology.orchestra.run.gibba037.stdout: chdir = "" 2021-11-15T19:35:29.402 INFO:teuthology.orchestra.run.gibba037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:29.402 INFO:teuthology.orchestra.run.gibba037.stdout: auth supported = cephx 2021-11-15T19:35:29.402 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.402 INFO:teuthology.orchestra.run.gibba037.stdout: filestore xattr use omap = true 2021-11-15T19:35:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:29.403 INFO:teuthology.orchestra.run.gibba037.stdout: auth debug = true 2021-11-15T19:35:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on old message = true 2021-11-15T19:35:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on bug = true 2021-11-15T19:35:29.404 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.405 INFO:teuthology.orchestra.run.gibba037.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:29.405 INFO:teuthology.orchestra.run.gibba037.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:29.405 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.405 INFO:teuthology.orchestra.run.gibba037.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default size = 2 2021-11-15T19:35:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.406 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:29.407 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow pg remap = true 2021-11-15T19:35:29.407 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:29.407 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:29.407 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on too few osds = false 2021-11-15T19:35:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:29.408 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.409 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:29.409 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.409 INFO:teuthology.orchestra.run.gibba037.stdout: osd default data pool replay window = 5 2021-11-15T19:35:29.409 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.410 INFO:teuthology.orchestra.run.gibba037.stdout: mon allow pool delete = true 2021-11-15T19:35:29.410 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.410 INFO:teuthology.orchestra.run.gibba037.stdout: mon cluster log file level = debug 2021-11-15T19:35:29.410 INFO:teuthology.orchestra.run.gibba037.stdout: debug asserts on shutdown = true 2021-11-15T19:35:29.410 INFO:teuthology.orchestra.run.gibba037.stdout: mon health detail to clog = false 2021-11-15T19:35:29.411 INFO:teuthology.orchestra.run.gibba037.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:29.411 INFO:teuthology.orchestra.run.gibba037.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:29.411 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.411 INFO:teuthology.orchestra.run.gibba037.stdout:[osd] 2021-11-15T19:35:29.412 INFO:teuthology.orchestra.run.gibba037.stdout: osd journal size = 100 2021-11-15T19:35:29.412 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.412 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:29.412 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub max interval = 600 2021-11-15T19:35:29.412 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.413 INFO:teuthology.orchestra.run.gibba037.stdout: osd recover clone overlap = true 2021-11-15T19:35:29.413 INFO:teuthology.orchestra.run.gibba037.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:29.413 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.413 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug shutdown = true 2021-11-15T19:35:29.413 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug op order = true 2021-11-15T19:35:29.414 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:29.414 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.414 INFO:teuthology.orchestra.run.gibba037.stdout: osd open classes on start = true 2021-11-15T19:35:29.414 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug pg log writeout = true 2021-11-15T19:35:29.415 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.415 INFO:teuthology.orchestra.run.gibba037.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:29.415 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.415 INFO:teuthology.orchestra.run.gibba037.stdout: osd map max advance = 10 2021-11-15T19:35:29.416 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.416 INFO:teuthology.orchestra.run.gibba037.stdout: journal zero on create = true 2021-11-15T19:35:29.416 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.416 INFO:teuthology.orchestra.run.gibba037.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:29.416 INFO:teuthology.orchestra.run.gibba037.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:29.417 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.417 INFO:teuthology.orchestra.run.gibba037.stdout: bdev debug aio = true 2021-11-15T19:35:29.417 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug misdirected ops = true 2021-11-15T19:35:29.417 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:29.418 INFO:teuthology.orchestra.run.gibba037.stdout: debug osd = 20 2021-11-15T19:35:29.418 INFO:teuthology.orchestra.run.gibba037.stdout: osd objectstore = filestore 2021-11-15T19:35:29.418 INFO:teuthology.orchestra.run.gibba037.stdout: osd op complaint time = 180 2021-11-15T19:35:29.418 INFO:teuthology.orchestra.run.gibba037.stdout: osd sloppy crc = True 2021-11-15T19:35:29.419 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.419 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr] 2021-11-15T19:35:29.419 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:29.419 INFO:teuthology.orchestra.run.gibba037.stdout: debug mgr = 20 2021-11-15T19:35:29.419 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-11-15T19:35:29.420 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-11-15T19:35:29.420 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.420 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.420 INFO:teuthology.orchestra.run.gibba037.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:29.420 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.421 INFO:teuthology.orchestra.run.gibba037.stdout:[mon] 2021-11-15T19:35:29.421 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:29.421 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-11-15T19:35:29.421 INFO:teuthology.orchestra.run.gibba037.stdout: debug paxos = 20 2021-11-15T19:35:29.422 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-11-15T19:35:29.422 INFO:teuthology.orchestra.run.gibba037.stdout: mon data avail warn = 5 2021-11-15T19:35:29.422 INFO:teuthology.orchestra.run.gibba037.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:29.422 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.422 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:29.423 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd prime pg temp = true 2021-11-15T19:35:29.423 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.423 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.423 INFO:teuthology.orchestra.run.gibba037.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:29.424 INFO:teuthology.orchestra.run.gibba037.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:29.424 INFO:teuthology.orchestra.run.gibba037.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:29.424 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.424 INFO:teuthology.orchestra.run.gibba037.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:29.424 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:29.425 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:29.425 INFO:teuthology.orchestra.run.gibba037.stdout: mon op complaint time = 120 2021-11-15T19:35:29.425 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.425 INFO:teuthology.orchestra.run.gibba037.stdout:[client] 2021-11-15T19:35:29.425 INFO:teuthology.orchestra.run.gibba037.stdout: rgw cache enabled = true 2021-11-15T19:35:29.426 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable ops log = true 2021-11-15T19:35:29.426 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable usage log = true 2021-11-15T19:35:29.426 INFO:teuthology.orchestra.run.gibba037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:29.426 INFO:teuthology.orchestra.run.gibba037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:29.427 INFO:teuthology.orchestra.run.gibba037.stdout: client mount timeout = 600 2021-11-15T19:35:29.427 INFO:teuthology.orchestra.run.gibba037.stdout: debug client = 20 2021-11-15T19:35:29.427 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:29.427 INFO:teuthology.orchestra.run.gibba037.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.427 INFO:teuthology.orchestra.run.gibba037.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.428 INFO:teuthology.orchestra.run.gibba037.stdout: client debug getattr caps = true 2021-11-15T19:35:29.428 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.a] 2021-11-15T19:35:29.428 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.b] 2021-11-15T19:35:29.428 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.c] 2021-11-15T19:35:29.428 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.a] 2021-11-15T19:35:29.429 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.b] 2021-11-15T19:35:29.429 INFO:teuthology.orchestra.run.gibba037.stdout:[mds] 2021-11-15T19:35:29.429 INFO:teuthology.orchestra.run.gibba037.stdout: debug mds = 20 2021-11-15T19:35:29.429 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:29.429 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal frag = True 2021-11-15T19:35:29.430 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:29.430 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal merge size = 5 2021-11-15T19:35:29.430 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal split bits = 3 2021-11-15T19:35:29.430 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal split size = 100 2021-11-15T19:35:29.431 INFO:teuthology.orchestra.run.gibba037.stdout: mds debug frag = True 2021-11-15T19:35:29.431 INFO:teuthology.orchestra.run.gibba037.stdout: mds debug scatterstat = True 2021-11-15T19:35:29.431 INFO:teuthology.orchestra.run.gibba037.stdout: mds op complaint time = 180 2021-11-15T19:35:29.431 INFO:teuthology.orchestra.run.gibba037.stdout: mds verify scatter = True 2021-11-15T19:35:29.431 INFO:teuthology.orchestra.run.gibba037.stdout: osd op complaint time = 180 2021-11-15T19:35:29.432 INFO:teuthology.orchestra.run.gibba037.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.432 INFO:teuthology.orchestra.run.gibba037.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.432 INFO:teuthology.orchestra.run.gibba031.stdout:[global] 2021-11-15T19:35:29.432 INFO:teuthology.orchestra.run.gibba031.stdout: chdir = "" 2021-11-15T19:35:29.433 INFO:teuthology.orchestra.run.gibba031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:29.433 INFO:teuthology.orchestra.run.gibba031.stdout: auth supported = cephx 2021-11-15T19:35:29.433 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.433 INFO:teuthology.orchestra.run.gibba031.stdout: filestore xattr use omap = true 2021-11-15T19:35:29.433 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.434 INFO:teuthology.orchestra.run.gibba031.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:29.434 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.434 INFO:teuthology.orchestra.run.gibba031.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:29.434 INFO:teuthology.orchestra.run.gibba031.stdout: auth debug = true 2021-11-15T19:35:29.435 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.435 INFO:teuthology.orchestra.run.gibba031.stdout: ms die on old message = true 2021-11-15T19:35:29.435 INFO:teuthology.orchestra.run.gibba031.stdout: ms die on bug = true 2021-11-15T19:35:29.435 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.435 INFO:teuthology.orchestra.run.gibba031.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:29.436 INFO:teuthology.orchestra.run.gibba031.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:29.436 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.436 INFO:teuthology.orchestra.run.gibba031.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:29.436 INFO:teuthology.orchestra.run.gibba031.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:29.436 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.437 INFO:teuthology.orchestra.run.gibba031.stdout: osd pool default size = 2 2021-11-15T19:35:29.437 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.437 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:29.437 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd allow pg remap = true 2021-11-15T19:35:29.438 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:29.438 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:29.438 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:29.438 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:29.439 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on too few osds = false 2021-11-15T19:35:29.439 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:29.439 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:29.439 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.439 INFO:teuthology.orchestra.run.gibba031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:29.440 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.440 INFO:teuthology.orchestra.run.gibba031.stdout: osd default data pool replay window = 5 2021-11-15T19:35:29.440 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.440 INFO:teuthology.orchestra.run.gibba031.stdout: mon allow pool delete = true 2021-11-15T19:35:29.440 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.441 INFO:teuthology.orchestra.run.gibba031.stdout: mon cluster log file level = debug 2021-11-15T19:35:29.441 INFO:teuthology.orchestra.run.gibba031.stdout: debug asserts on shutdown = true 2021-11-15T19:35:29.441 INFO:teuthology.orchestra.run.gibba031.stdout: mon health detail to clog = false 2021-11-15T19:35:29.441 INFO:teuthology.orchestra.run.gibba031.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:29.442 INFO:teuthology.orchestra.run.gibba031.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:29.442 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.442 INFO:teuthology.orchestra.run.gibba031.stdout:[osd] 2021-11-15T19:35:29.442 INFO:teuthology.orchestra.run.gibba031.stdout: osd journal size = 100 2021-11-15T19:35:29.442 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.443 INFO:teuthology.orchestra.run.gibba031.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:29.443 INFO:teuthology.orchestra.run.gibba031.stdout: osd scrub max interval = 600 2021-11-15T19:35:29.443 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.443 INFO:teuthology.orchestra.run.gibba031.stdout: osd recover clone overlap = true 2021-11-15T19:35:29.443 INFO:teuthology.orchestra.run.gibba031.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:29.444 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.444 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug shutdown = true 2021-11-15T19:35:29.444 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug op order = true 2021-11-15T19:35:29.444 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:29.445 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.445 INFO:teuthology.orchestra.run.gibba031.stdout: osd open classes on start = true 2021-11-15T19:35:29.445 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug pg log writeout = true 2021-11-15T19:35:29.445 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.446 INFO:teuthology.orchestra.run.gibba031.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:29.446 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.446 INFO:teuthology.orchestra.run.gibba031.stdout: osd map max advance = 10 2021-11-15T19:35:29.446 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.446 INFO:teuthology.orchestra.run.gibba031.stdout: journal zero on create = true 2021-11-15T19:35:29.447 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.447 INFO:teuthology.orchestra.run.gibba031.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:29.447 INFO:teuthology.orchestra.run.gibba031.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:29.447 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.447 INFO:teuthology.orchestra.run.gibba031.stdout: bdev debug aio = true 2021-11-15T19:35:29.448 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug misdirected ops = true 2021-11-15T19:35:29.448 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:29.448 INFO:teuthology.orchestra.run.gibba031.stdout: debug osd = 20 2021-11-15T19:35:29.448 INFO:teuthology.orchestra.run.gibba031.stdout: osd objectstore = filestore 2021-11-15T19:35:29.448 INFO:teuthology.orchestra.run.gibba031.stdout: osd op complaint time = 180 2021-11-15T19:35:29.449 INFO:teuthology.orchestra.run.gibba031.stdout: osd sloppy crc = True 2021-11-15T19:35:29.449 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.449 INFO:teuthology.orchestra.run.gibba031.stdout:[mgr] 2021-11-15T19:35:29.449 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:29.449 INFO:teuthology.orchestra.run.gibba031.stdout: debug mgr = 20 2021-11-15T19:35:29.450 INFO:teuthology.orchestra.run.gibba031.stdout: debug mon = 20 2021-11-15T19:35:29.450 INFO:teuthology.orchestra.run.gibba031.stdout: debug auth = 20 2021-11-15T19:35:29.450 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.450 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.451 INFO:teuthology.orchestra.run.gibba031.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:29.451 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.451 INFO:teuthology.orchestra.run.gibba031.stdout:[mon] 2021-11-15T19:35:29.451 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:29.451 INFO:teuthology.orchestra.run.gibba031.stdout: debug mon = 20 2021-11-15T19:35:29.452 INFO:teuthology.orchestra.run.gibba031.stdout: debug paxos = 20 2021-11-15T19:35:29.452 INFO:teuthology.orchestra.run.gibba031.stdout: debug auth = 20 2021-11-15T19:35:29.452 INFO:teuthology.orchestra.run.gibba031.stdout: mon data avail warn = 5 2021-11-15T19:35:29.452 INFO:teuthology.orchestra.run.gibba031.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:29.453 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.453 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:29.453 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd prime pg temp = true 2021-11-15T19:35:29.453 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.453 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.454 INFO:teuthology.orchestra.run.gibba031.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:29.454 INFO:teuthology.orchestra.run.gibba031.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:29.454 INFO:teuthology.orchestra.run.gibba031.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:29.454 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.455 INFO:teuthology.orchestra.run.gibba031.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:29.455 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:29.455 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:29.455 INFO:teuthology.orchestra.run.gibba031.stdout: mon op complaint time = 120 2021-11-15T19:35:29.455 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:29.456 INFO:teuthology.orchestra.run.gibba031.stdout:[client] 2021-11-15T19:35:29.456 INFO:teuthology.orchestra.run.gibba031.stdout: rgw cache enabled = true 2021-11-15T19:35:29.456 INFO:teuthology.orchestra.run.gibba031.stdout: rgw enable ops log = true 2021-11-15T19:35:29.456 INFO:teuthology.orchestra.run.gibba031.stdout: rgw enable usage log = true 2021-11-15T19:35:29.457 INFO:teuthology.orchestra.run.gibba031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:29.457 INFO:teuthology.orchestra.run.gibba031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:29.457 INFO:teuthology.orchestra.run.gibba031.stdout: client mount timeout = 600 2021-11-15T19:35:29.457 INFO:teuthology.orchestra.run.gibba031.stdout: debug client = 20 2021-11-15T19:35:29.457 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:29.458 INFO:teuthology.orchestra.run.gibba031.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.458 INFO:teuthology.orchestra.run.gibba031.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.458 INFO:teuthology.orchestra.run.gibba031.stdout: client debug getattr caps = true 2021-11-15T19:35:29.458 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.a] 2021-11-15T19:35:29.459 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.b] 2021-11-15T19:35:29.459 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.c] 2021-11-15T19:35:29.459 INFO:teuthology.orchestra.run.gibba031.stdout:[mds.a] 2021-11-15T19:35:29.459 INFO:teuthology.orchestra.run.gibba031.stdout:[mds.b] 2021-11-15T19:35:29.459 INFO:teuthology.orchestra.run.gibba031.stdout:[mds] 2021-11-15T19:35:29.460 INFO:teuthology.orchestra.run.gibba031.stdout: debug mds = 20 2021-11-15T19:35:29.460 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:29.460 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal frag = True 2021-11-15T19:35:29.460 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:29.460 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal merge size = 5 2021-11-15T19:35:29.461 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal split bits = 3 2021-11-15T19:35:29.461 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal split size = 100 2021-11-15T19:35:29.461 INFO:teuthology.orchestra.run.gibba031.stdout: mds debug frag = True 2021-11-15T19:35:29.461 INFO:teuthology.orchestra.run.gibba031.stdout: mds debug scatterstat = True 2021-11-15T19:35:29.462 INFO:teuthology.orchestra.run.gibba031.stdout: mds op complaint time = 180 2021-11-15T19:35:29.462 INFO:teuthology.orchestra.run.gibba031.stdout: mds verify scatter = True 2021-11-15T19:35:29.462 INFO:teuthology.orchestra.run.gibba031.stdout: osd op complaint time = 180 2021-11-15T19:35:29.462 INFO:teuthology.orchestra.run.gibba031.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.462 INFO:teuthology.orchestra.run.gibba031.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.463 INFO:teuthology.orchestra.run.gibba018.stdout:[global] 2021-11-15T19:35:29.463 INFO:teuthology.orchestra.run.gibba018.stdout: chdir = "" 2021-11-15T19:35:29.463 INFO:teuthology.orchestra.run.gibba018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:29.463 INFO:teuthology.orchestra.run.gibba018.stdout: auth supported = cephx 2021-11-15T19:35:29.464 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.464 INFO:teuthology.orchestra.run.gibba018.stdout: filestore xattr use omap = true 2021-11-15T19:35:29.464 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.464 INFO:teuthology.orchestra.run.gibba018.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:29.464 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.465 INFO:teuthology.orchestra.run.gibba018.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:29.465 INFO:teuthology.orchestra.run.gibba018.stdout: auth debug = true 2021-11-15T19:35:29.465 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.465 INFO:teuthology.orchestra.run.gibba018.stdout: ms die on old message = true 2021-11-15T19:35:29.465 INFO:teuthology.orchestra.run.gibba018.stdout: ms die on bug = true 2021-11-15T19:35:29.466 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.466 INFO:teuthology.orchestra.run.gibba018.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:29.466 INFO:teuthology.orchestra.run.gibba018.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:29.466 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.466 INFO:teuthology.orchestra.run.gibba018.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:29.467 INFO:teuthology.orchestra.run.gibba018.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:29.467 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.467 INFO:teuthology.orchestra.run.gibba018.stdout: osd pool default size = 2 2021-11-15T19:35:29.467 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.468 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:29.468 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd allow pg remap = true 2021-11-15T19:35:29.468 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:29.468 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:29.469 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:29.469 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:29.469 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on too few osds = false 2021-11-15T19:35:29.469 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:29.470 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:29.470 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.470 INFO:teuthology.orchestra.run.gibba018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:29.470 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.470 INFO:teuthology.orchestra.run.gibba018.stdout: osd default data pool replay window = 5 2021-11-15T19:35:29.471 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.471 INFO:teuthology.orchestra.run.gibba018.stdout: mon allow pool delete = true 2021-11-15T19:35:29.471 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.471 INFO:teuthology.orchestra.run.gibba018.stdout: mon cluster log file level = debug 2021-11-15T19:35:29.472 INFO:teuthology.orchestra.run.gibba018.stdout: debug asserts on shutdown = true 2021-11-15T19:35:29.472 INFO:teuthology.orchestra.run.gibba018.stdout: mon health detail to clog = false 2021-11-15T19:35:29.472 INFO:teuthology.orchestra.run.gibba018.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:29.472 INFO:teuthology.orchestra.run.gibba018.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:29.473 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.473 INFO:teuthology.orchestra.run.gibba018.stdout:[osd] 2021-11-15T19:35:29.473 INFO:teuthology.orchestra.run.gibba018.stdout: osd journal size = 100 2021-11-15T19:35:29.473 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.474 INFO:teuthology.orchestra.run.gibba018.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:29.474 INFO:teuthology.orchestra.run.gibba018.stdout: osd scrub max interval = 600 2021-11-15T19:35:29.474 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.474 INFO:teuthology.orchestra.run.gibba018.stdout: osd recover clone overlap = true 2021-11-15T19:35:29.474 INFO:teuthology.orchestra.run.gibba018.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:29.475 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.475 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug shutdown = true 2021-11-15T19:35:29.475 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug op order = true 2021-11-15T19:35:29.475 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:29.475 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.476 INFO:teuthology.orchestra.run.gibba018.stdout: osd open classes on start = true 2021-11-15T19:35:29.476 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug pg log writeout = true 2021-11-15T19:35:29.476 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.476 INFO:teuthology.orchestra.run.gibba018.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:29.476 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.477 INFO:teuthology.orchestra.run.gibba018.stdout: osd map max advance = 10 2021-11-15T19:35:29.477 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.477 INFO:teuthology.orchestra.run.gibba018.stdout: journal zero on create = true 2021-11-15T19:35:29.477 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.478 INFO:teuthology.orchestra.run.gibba018.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:29.478 INFO:teuthology.orchestra.run.gibba018.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:29.478 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.478 INFO:teuthology.orchestra.run.gibba018.stdout: bdev debug aio = true 2021-11-15T19:35:29.478 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug misdirected ops = true 2021-11-15T19:35:29.479 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:29.479 INFO:teuthology.orchestra.run.gibba018.stdout: debug osd = 20 2021-11-15T19:35:29.479 INFO:teuthology.orchestra.run.gibba018.stdout: osd objectstore = filestore 2021-11-15T19:35:29.479 INFO:teuthology.orchestra.run.gibba018.stdout: osd op complaint time = 180 2021-11-15T19:35:29.480 INFO:teuthology.orchestra.run.gibba018.stdout: osd sloppy crc = True 2021-11-15T19:35:29.480 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.480 INFO:teuthology.orchestra.run.gibba018.stdout:[mgr] 2021-11-15T19:35:29.480 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:29.480 INFO:teuthology.orchestra.run.gibba018.stdout: debug mgr = 20 2021-11-15T19:35:29.481 INFO:teuthology.orchestra.run.gibba018.stdout: debug mon = 20 2021-11-15T19:35:29.481 INFO:teuthology.orchestra.run.gibba018.stdout: debug auth = 20 2021-11-15T19:35:29.481 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.481 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.481 INFO:teuthology.orchestra.run.gibba018.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:29.482 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.482 INFO:teuthology.orchestra.run.gibba018.stdout:[mon] 2021-11-15T19:35:29.482 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:29.482 INFO:teuthology.orchestra.run.gibba018.stdout: debug mon = 20 2021-11-15T19:35:29.483 INFO:teuthology.orchestra.run.gibba018.stdout: debug paxos = 20 2021-11-15T19:35:29.483 INFO:teuthology.orchestra.run.gibba018.stdout: debug auth = 20 2021-11-15T19:35:29.483 INFO:teuthology.orchestra.run.gibba018.stdout: mon data avail warn = 5 2021-11-15T19:35:29.483 INFO:teuthology.orchestra.run.gibba018.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:29.484 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:29.484 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:29.484 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd prime pg temp = true 2021-11-15T19:35:29.484 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:29.484 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.485 INFO:teuthology.orchestra.run.gibba018.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:29.485 INFO:teuthology.orchestra.run.gibba018.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:29.485 INFO:teuthology.orchestra.run.gibba018.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:29.485 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.485 INFO:teuthology.orchestra.run.gibba018.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:29.486 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:29.486 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:29.486 INFO:teuthology.orchestra.run.gibba018.stdout: mon op complaint time = 120 2021-11-15T19:35:29.486 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:29.486 INFO:teuthology.orchestra.run.gibba018.stdout:[client] 2021-11-15T19:35:29.487 INFO:teuthology.orchestra.run.gibba018.stdout: rgw cache enabled = true 2021-11-15T19:35:29.487 INFO:teuthology.orchestra.run.gibba018.stdout: rgw enable ops log = true 2021-11-15T19:35:29.487 INFO:teuthology.orchestra.run.gibba018.stdout: rgw enable usage log = true 2021-11-15T19:35:29.487 INFO:teuthology.orchestra.run.gibba018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:29.488 INFO:teuthology.orchestra.run.gibba018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:29.488 INFO:teuthology.orchestra.run.gibba018.stdout: client mount timeout = 600 2021-11-15T19:35:29.488 INFO:teuthology.orchestra.run.gibba018.stdout: debug client = 20 2021-11-15T19:35:29.488 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:29.488 INFO:teuthology.orchestra.run.gibba018.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.489 INFO:teuthology.orchestra.run.gibba018.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.489 INFO:teuthology.orchestra.run.gibba018.stdout: client debug getattr caps = true 2021-11-15T19:35:29.489 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.a] 2021-11-15T19:35:29.489 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.b] 2021-11-15T19:35:29.489 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.c] 2021-11-15T19:35:29.490 INFO:teuthology.orchestra.run.gibba018.stdout:[mds.a] 2021-11-15T19:35:29.490 INFO:teuthology.orchestra.run.gibba018.stdout:[mds.b] 2021-11-15T19:35:29.490 INFO:teuthology.orchestra.run.gibba018.stdout:[mds] 2021-11-15T19:35:29.490 INFO:teuthology.orchestra.run.gibba018.stdout: debug mds = 20 2021-11-15T19:35:29.491 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:29.491 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal frag = True 2021-11-15T19:35:29.491 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:29.491 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal merge size = 5 2021-11-15T19:35:29.491 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal split bits = 3 2021-11-15T19:35:29.492 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal split size = 100 2021-11-15T19:35:29.492 INFO:teuthology.orchestra.run.gibba018.stdout: mds debug frag = True 2021-11-15T19:35:29.492 INFO:teuthology.orchestra.run.gibba018.stdout: mds debug scatterstat = True 2021-11-15T19:35:29.492 INFO:teuthology.orchestra.run.gibba018.stdout: mds op complaint time = 180 2021-11-15T19:35:29.493 INFO:teuthology.orchestra.run.gibba018.stdout: mds verify scatter = True 2021-11-15T19:35:29.493 INFO:teuthology.orchestra.run.gibba018.stdout: osd op complaint time = 180 2021-11-15T19:35:29.493 INFO:teuthology.orchestra.run.gibba018.stdout: rados mon op timeout = 15m 2021-11-15T19:35:29.493 INFO:teuthology.orchestra.run.gibba018.stdout: rados osd op timeout = 15m 2021-11-15T19:35:29.494 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:29.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 Processor -- start 2021-11-15T19:35:29.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 -- start start 2021-11-15T19:35:29.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8140b62b0 0x7fb814140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb814064360 0x7fb8140b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81413fc20 con 0x7fb8140b1010 2021-11-15T19:35:29.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81413fa30 con 0x7fb814064360 2021-11-15T19:35:29.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb81a833700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81413fec0 con 0x7fb8140b62b0 2021-11-15T19:35:29.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb814064360 0x7fb8140b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb814064360 0x7fb8140b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40114/0 (socket says 172.21.2.137:40114) 2021-11-15T19:35:29.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 -- 172.21.2.137:0/1374727147 learned_addr learned my addr 172.21.2.137:0/1374727147 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:29.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb813fff700 1 --2- 172.21.2.137:0/1374727147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8140b62b0 0x7fb814140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 -- 172.21.2.137:0/1374727147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8140b62b0 msgr2=0x7fb814140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:29.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 --2- 172.21.2.137:0/1374727147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8140b62b0 0x7fb814140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 -- 172.21.2.137:0/1374727147 >> v1:172.21.2.111:6789/0 conn(0x7fb8140b1010 legacy=0x7fb8140b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:29.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 -- 172.21.2.137:0/1374727147 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814140850 con 0x7fb814064360 2021-11-15T19:35:29.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb8137fe700 1 --2- 172.21.2.137:0/1374727147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb814064360 0x7fb8140b0b20 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fb8140b3ef0 tx=0x7fb808006eb0).ready entity=mon.1 client_cookie=b07768619cf0d2e2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.538+0000 7fb812ffd700 1 -- 172.21.2.137:0/1374727147 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80800d570 con 0x7fb814064360 2021-11-15T19:35:29.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb812ffd700 1 -- 172.21.2.137:0/1374727147 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808000e90 con 0x7fb814064360 2021-11-15T19:35:29.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb812ffd700 1 -- 172.21.2.137:0/1374727147 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80800d900 con 0x7fb814064360 2021-11-15T19:35:29.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/1374727147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb814064360 msgr2=0x7fb8140b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 --2- 172.21.2.137:0/1374727147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb814064360 0x7fb8140b0b20 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fb8140b3ef0 tx=0x7fb808006eb0).stop 2021-11-15T19:35:29.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/1374727147 shutdown_connections 2021-11-15T19:35:29.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 --2- 172.21.2.137:0/1374727147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb814064360 0x7fb8140b0b20 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 --2- 172.21.2.137:0/1374727147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb8140b62b0 0x7fb814140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/1374727147 >> 172.21.2.137:0/1374727147 conn(0x7fb814069990 msgr2=0x7fb814063a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:29.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/1374727147 shutdown_connections 2021-11-15T19:35:29.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/1374727147 wait complete. 2021-11-15T19:35:29.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 Processor -- start 2021-11-15T19:35:29.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- start start 2021-11-15T19:35:29.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb814064360 0x7fb81412a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8140b1010 0x7fb8141557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 0x7fb814155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81412ad30 con 0x7fb8140b1010 2021-11-15T19:35:29.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814065450 con 0x7fb8140b62b0 2021-11-15T19:35:29.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140651b0 con 0x7fb814064360 2021-11-15T19:35:29.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 0x7fb814155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 0x7fb814155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40118/0 (socket says 172.21.2.137:40118) 2021-11-15T19:35:29.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 -- 172.21.2.137:0/2326988564 learned_addr learned my addr 172.21.2.137:0/2326988564 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:29.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 -- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb814064360 msgr2=0x7fb81412a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb814064360 0x7fb81412a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 -- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8140b1010 msgr2=0x7fb8141557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8140b1010 0x7fb8141557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 -- 172.21.2.137:0/2326988564 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80800b1e0 con 0x7fb8140b62b0 2021-11-15T19:35:29.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb818dd0700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 0x7fb814155cc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fb80c002320 tx=0x7fb80c0023f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80c006aa0 con 0x7fb8140b62b0 2021-11-15T19:35:29.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c006c00 con 0x7fb8140b62b0 2021-11-15T19:35:29.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81412aa90 con 0x7fb8140b62b0 2021-11-15T19:35:29.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80c007030 con 0x7fb8140b62b0 2021-11-15T19:35:29.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb814142be0 con 0x7fb8140b62b0 2021-11-15T19:35:29.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140573d0 con 0x7fb8140b62b0 2021-11-15T19:35:29.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb80c010030 con 0x7fb8140b62b0 2021-11-15T19:35:29.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb8117fa700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7f4053640 0x7fb7f4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.542+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb80c06b910 con 0x7fb8140b62b0 2021-11-15T19:35:29.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.546+0000 7fb813fff700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7f4053640 0x7fb7f4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.546+0000 7fb813fff700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7f4053640 0x7fb7f4055b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fb804007000 tx=0x7fb804008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.546+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb80c042a70 con 0x7fb8140b62b0 2021-11-15T19:35:29.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.626+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb814152d40 con 0x7fb8140b62b0 2021-11-15T19:35:29.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb8117fa700 1 -- 172.21.2.137:0/2326988564 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fb80c046090 con 0x7fb8140b62b0 2021-11-15T19:35:29.641 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:29.642 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":131,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:17.437552+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:15.202823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:15.395889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:29.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7f4053640 msgr2=0x7fb7f4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7f4053640 0x7fb7f4055b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fb804007000 tx=0x7fb804008040).stop 2021-11-15T19:35:29.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 msgr2=0x7fb814155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 0x7fb814155cc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fb80c002320 tx=0x7fb80c0023f0).stop 2021-11-15T19:35:29.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 shutdown_connections 2021-11-15T19:35:29.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7f4053640 0x7fb7f4055b00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb8140b62b0 0x7fb814155cc0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb8140b1010 0x7fb8141557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 --2- 172.21.2.137:0/2326988564 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb814064360 0x7fb81412a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 >> 172.21.2.137:0/2326988564 conn(0x7fb814069990 msgr2=0x7fb8140b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:29.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 shutdown_connections 2021-11-15T19:35:29.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.630+0000 7fb81a833700 1 -- 172.21.2.137:0/2326988564 wait complete. 2021-11-15T19:35:29.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:35:15.202823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:35:15.395889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:35:29.653 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:29.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 Processor -- start 2021-11-15T19:35:29.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- start start 2021-11-15T19:35:29.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c05c100 0x7f239c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f239c0afeb0 0x7f239c14b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f239c05f940 0x7f239c05fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c14a730 con 0x7f239c05f940 2021-11-15T19:35:29.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c0abda0 con 0x7f239c0afeb0 2021-11-15T19:35:29.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c05c4e0 con 0x7f239c05c100 2021-11-15T19:35:29.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f239c0afeb0 0x7f239c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f239c0afeb0 0x7f239c14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40130/0 (socket says 172.21.2.137:40130) 2021-11-15T19:35:29.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 -- 172.21.2.137:0/3907446599 learned_addr learned my addr 172.21.2.137:0/3907446599 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:29.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 -- 172.21.2.137:0/3907446599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c05c100 msgr2=0x7f239c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:29.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 --2- 172.21.2.137:0/3907446599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c05c100 0x7f239c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 -- 172.21.2.137:0/3907446599 >> v2:172.21.2.111:3300/0 conn(0x7f239c05f940 msgr2=0x7f239c05fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:29.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 --2- 172.21.2.137:0/3907446599 >> v2:172.21.2.111:3300/0 conn(0x7f239c05f940 0x7f239c05fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 -- 172.21.2.137:0/3907446599 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0afbd0 con 0x7f239c0afeb0 2021-11-15T19:35:29.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f239a7fc700 1 --2- 172.21.2.137:0/3907446599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c0afeb0 0x7f239c14b060 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f2384006eb0).ready entity=mon.1 client_cookie=fb0d27184cd3b0e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f2399ffb700 1 -- 172.21.2.137:0/3907446599 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400d570 con 0x7f239c0afeb0 2021-11-15T19:35:29.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f2399ffb700 1 -- 172.21.2.137:0/3907446599 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384000e90 con 0x7f239c0afeb0 2021-11-15T19:35:29.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f2399ffb700 1 -- 172.21.2.137:0/3907446599 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400d900 con 0x7f239c0afeb0 2021-11-15T19:35:29.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- 172.21.2.137:0/3907446599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c0afeb0 msgr2=0x7f239c14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- 172.21.2.137:0/3907446599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c0afeb0 0x7f239c14b060 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f2384006eb0).stop 2021-11-15T19:35:29.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- 172.21.2.137:0/3907446599 shutdown_connections 2021-11-15T19:35:29.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- 172.21.2.137:0/3907446599 >> v2:172.21.2.111:3300/0 conn(0x7f239c05f940 0x7f239c05fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- 172.21.2.137:0/3907446599 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c0afeb0 0x7f239c14b060 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 --2- 172.21.2.137:0/3907446599 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c05c100 0x7f239c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- 172.21.2.137:0/3907446599 >> 172.21.2.137:0/3907446599 conn(0x7f239c0b5000 msgr2=0x7f239c0b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:29.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- 172.21.2.137:0/3907446599 shutdown_connections 2021-11-15T19:35:29.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.698+0000 7f23a1924700 1 -- 172.21.2.137:0/3907446599 wait complete. 2021-11-15T19:35:29.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 Processor -- start 2021-11-15T19:35:29.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- start start 2021-11-15T19:35:29.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f239c05c100 0x7f239c09a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 0x7f239c097ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c0afeb0 0x7f239c066fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0654d0 con 0x7f239c05c100 2021-11-15T19:35:29.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0b11d0 con 0x7f239c05f940 2021-11-15T19:35:29.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c066990 con 0x7f239c0afeb0 2021-11-15T19:35:29.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 0x7f239c097ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 0x7f239c097ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40134/0 (socket says 172.21.2.137:40134) 2021-11-15T19:35:29.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 -- 172.21.2.137:0/2331358191 learned_addr learned my addr 172.21.2.137:0/2331358191 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:29.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239affd700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f239c05c100 0x7f239c09a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239b7fe700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c0afeb0 0x7f239c066fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 -- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c0afeb0 msgr2=0x7f239c066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c0afeb0 0x7f239c066fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.721 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 -- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f239c05c100 msgr2=0x7f239c09a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f239c05c100 0x7f239c09a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 -- 172.21.2.137:0/2331358191 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238400b1e0 con 0x7f239c05f940 2021-11-15T19:35:29.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239a7fc700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 0x7f239c097ff0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f2384015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400de20 con 0x7f239c05f940 2021-11-15T19:35:29.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384011bf0 con 0x7f239c05f940 2021-11-15T19:35:29.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c066bf0 con 0x7f239c05f940 2021-11-15T19:35:29.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c0984e0 con 0x7f239c05f940 2021-11-15T19:35:29.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238401e460 con 0x7f239c05f940 2021-11-15T19:35:29.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c14a920 con 0x7f239c05f940 2021-11-15T19:35:29.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2384025030 con 0x7f239c05f940 2021-11-15T19:35:29.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f2393fff700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23800536a0 0x7f2380055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f238406cbb0 con 0x7f239c05f940 2021-11-15T19:35:29.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.702+0000 7f239affd700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23800536a0 0x7f2380055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.706+0000 7f239affd700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23800536a0 0x7f2380055b60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f238c00c000 tx=0x7f238c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.706+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2384073080 con 0x7f239c05f940 2021-11-15T19:35:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f239c0573d0 con 0x7f239c05f940 2021-11-15T19:35:29.800 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f2393fff700 1 -- 172.21.2.137:0/2331358191 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v131) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2384043d10 con 0x7f239c05f940 2021-11-15T19:35:29.801 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:29.801 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23800536a0 msgr2=0x7f2380055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23800536a0 0x7f2380055b60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f238c00c000 tx=0x7f238c008040).stop 2021-11-15T19:35:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 msgr2=0x7f239c097ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.802 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 0x7f239c097ff0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f2384015000).stop 2021-11-15T19:35:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 shutdown_connections 2021-11-15T19:35:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23800536a0 0x7f2380055b60 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f239c0afeb0 0x7f239c066fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.803 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f239c05f940 0x7f239c097ff0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 --2- 172.21.2.137:0/2331358191 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f239c05c100 0x7f239c09a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 >> 172.21.2.137:0/2331358191 conn(0x7f239c0b5000 msgr2=0x7f239c149e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 shutdown_connections 2021-11-15T19:35:29.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.790+0000 7f23a1924700 1 -- 172.21.2.137:0/2331358191 wait complete. 2021-11-15T19:35:29.808 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:29.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 Processor -- start 2021-11-15T19:35:29.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- start start 2021-11-15T19:35:29.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f479005c100 0x7f47900ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f47900afeb0 0x7f479014b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47900abda0 con 0x7f479005f940 2021-11-15T19:35:29.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479014a730 con 0x7f479005c100 2021-11-15T19:35:29.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479005c4e0 con 0x7f47900afeb0 2021-11-15T19:35:29.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f479005c100 0x7f47900ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f479005c100 0x7f47900ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40140/0 (socket says 172.21.2.137:40140) 2021-11-15T19:35:29.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 -- 172.21.2.137:0/312691860 learned_addr learned my addr 172.21.2.137:0/312691860 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:29.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 -- 172.21.2.137:0/312691860 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f47900afeb0 msgr2=0x7f479014b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:29.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 --2- 172.21.2.137:0/312691860 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f47900afeb0 0x7f479014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 -- 172.21.2.137:0/312691860 >> v1:172.21.2.111:6789/0 conn(0x7f479005f940 legacy=0x7f479005fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:29.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 -- 172.21.2.137:0/312691860 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900afbd0 con 0x7f479005c100 2021-11-15T19:35:29.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4795559700 1 --2- 172.21.2.137:0/312691860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005c100 0x7f47900ab8b0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f479005c800 tx=0x7f4784006eb0).ready entity=mon.1 client_cookie=b34a066c34b225f6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4783fff700 1 -- 172.21.2.137:0/312691860 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f478400d570 con 0x7f479005c100 2021-11-15T19:35:29.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4783fff700 1 -- 172.21.2.137:0/312691860 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784000e90 con 0x7f479005c100 2021-11-15T19:35:29.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f4783fff700 1 -- 172.21.2.137:0/312691860 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f478400d8c0 con 0x7f479005c100 2021-11-15T19:35:29.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- 172.21.2.137:0/312691860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005c100 msgr2=0x7f47900ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 --2- 172.21.2.137:0/312691860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005c100 0x7f47900ab8b0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f479005c800 tx=0x7f4784006eb0).stop 2021-11-15T19:35:29.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- 172.21.2.137:0/312691860 shutdown_connections 2021-11-15T19:35:29.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 --2- 172.21.2.137:0/312691860 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f47900afeb0 0x7f479014b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 --2- 172.21.2.137:0/312691860 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005c100 0x7f47900ab8b0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- 172.21.2.137:0/312691860 >> 172.21.2.137:0/312691860 conn(0x7f47900b5000 msgr2=0x7f47900b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:29.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- 172.21.2.137:0/312691860 shutdown_connections 2021-11-15T19:35:29.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.850+0000 7f47977bd700 1 -- 172.21.2.137:0/312691860 wait complete. 2021-11-15T19:35:29.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 Processor -- start 2021-11-15T19:35:29.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- start start 2021-11-15T19:35:29.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f479005c100 0x7f479009ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 0x7f4790146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f47900afeb0 0x7f4790065720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790099d50 con 0x7f47900afeb0 2021-11-15T19:35:29.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479009a4c0 con 0x7f479005f940 2021-11-15T19:35:29.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479009a760 con 0x7f479005c100 2021-11-15T19:35:29.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 0x7f4790146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 0x7f4790146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40148/0 (socket says 172.21.2.137:40148) 2021-11-15T19:35:29.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 -- 172.21.2.137:0/3962188101 learned_addr learned my addr 172.21.2.137:0/3962188101 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:29.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 -- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f479005c100 msgr2=0x7f479009ac00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:29.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f479005c100 0x7f479009ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 -- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f47900afeb0 msgr2=0x7f4790065720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:29.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f47900afeb0 0x7f4790065720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 -- 172.21.2.137:0/3962188101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478400b1e0 con 0x7f479005f940 2021-11-15T19:35:29.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4794d58700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 0x7f4790146470 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f478c002f70 tx=0x7f478c006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f478c00e470 con 0x7f479005f940 2021-11-15T19:35:29.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00e5d0 con 0x7f479005f940 2021-11-15T19:35:29.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f478c00e930 con 0x7f479005f940 2021-11-15T19:35:29.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4790097a70 con 0x7f479005f940 2021-11-15T19:35:29.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47900999d0 con 0x7f479005f940 2021-11-15T19:35:29.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479009a920 con 0x7f479005f940 2021-11-15T19:35:29.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f478c018030 con 0x7f479005f940 2021-11-15T19:35:29.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47827fc700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4770053540 0x7f4770055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:29.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f478c06af30 con 0x7f479005f940 2021-11-15T19:35:29.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.854+0000 7f4795559700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4770053540 0x7f4770055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:29.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.858+0000 7f4795559700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4770053540 0x7f4770055a00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f479005c800 tx=0x7f4784015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:29.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.858+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f478c042030 con 0x7f479005f940 2021-11-15T19:35:29.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.938+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f479014a920 con 0x7f479005f940 2021-11-15T19:35:29.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.938+0000 7f47827fc700 1 -- 172.21.2.137:0/3962188101 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7f478c020020 con 0x7f479005f940 2021-11-15T19:35:29.950 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.938+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4770053540 msgr2=0x7f4770055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.938+0000 7f47977bd700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4770053540 0x7f4770055a00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f479005c800 tx=0x7f4784015000).stop 2021-11-15T19:35:29.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.938+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 msgr2=0x7f4790146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.938+0000 7f47977bd700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 0x7f4790146470 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f478c002f70 tx=0x7f478c006e30).stop 2021-11-15T19:35:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 shutdown_connections 2021-11-15T19:35:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4770053540 0x7f4770055a00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f47900afeb0 0x7f4790065720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f479005f940 0x7f4790146470 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 --2- 172.21.2.137:0/3962188101 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f479005c100 0x7f479009ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 >> 172.21.2.137:0/3962188101 conn(0x7f47900b5000 msgr2=0x7f4790145870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 shutdown_connections 2021-11-15T19:35:29.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.942+0000 7f47977bd700 1 -- 172.21.2.137:0/3962188101 wait complete. 2021-11-15T19:35:29.957 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:35:30.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff2441f5700 1 Processor -- start 2021-11-15T19:35:30.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff2441f5700 1 -- start start 2021-11-15T19:35:30.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff2441f5700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff23c142760 0x7ff23c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff2441f5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0b66f0 con 0x7ff23c0ae390 2021-11-15T19:35:30.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff2441f5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0ae840 con 0x7ff23c0b6310 2021-11-15T19:35:30.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff2441f5700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c05cae0 con 0x7ff23c142760 2021-11-15T19:35:30.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff241f91700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff23c0b6310 0x7ff23c0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:58936/0 (socket says 172.21.2.137:58936) 2021-11-15T19:35:30.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff241f91700 1 -- 172.21.2.137:0/2209857992 learned_addr learned my addr 172.21.2.137:0/2209857992 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:30.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665199740 0 0) 0x7ff23c0ae840 con 0x7ff23c0b6310 2021-11-15T19:35:30.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff224003260 con 0x7ff23c0b6310 2021-11-15T19:35:30.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff241790700 1 --2- 172.21.2.137:0/2209857992 >> v2:172.21.2.111:3300/0 conn(0x7ff23c142760 0x7ff23c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492044273 0 0) 0x7ff224003260 con 0x7ff23c0b6310 2021-11-15T19:35:30.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 >> v2:172.21.2.111:3300/0 conn(0x7ff23c142760 msgr2=0x7ff23c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:30.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 --2- 172.21.2.137:0/2209857992 >> v2:172.21.2.111:3300/0 conn(0x7ff23c142760 0x7ff23c0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 >> v1:172.21.2.111:6789/0 conn(0x7ff23c0ae390 legacy=0x7ff23c13bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:30.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c05cd80 con 0x7ff23c0b6310 2021-11-15T19:35:30.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff238001660 con 0x7ff23c0b6310 2021-11-15T19:35:30.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 >> v1:172.21.2.137:6789/0 conn(0x7ff23c0b6310 legacy=0x7ff23c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff224003820 0x7ff224003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff224004500 0x7ff224004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224004f70 0x7ff22400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c05cae0 con 0x7ff224004f70 2021-11-15T19:35:30.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22400be50 con 0x7ff224003820 2021-11-15T19:35:30.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22400c010 con 0x7ff224004500 2021-11-15T19:35:30.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:29.998+0000 7ff241f91700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff224003820 0x7ff224003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff241f91700 1 -- 172.21.2.137:0/2209857992 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff224004500 msgr2=0x7ff224004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:30.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff241f91700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff224004500 0x7ff224004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff241f91700 1 -- 172.21.2.137:0/2209857992 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224004f70 msgr2=0x7ff22400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:30.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff241f91700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224004f70 0x7ff22400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff241f91700 1 -- 172.21.2.137:0/2209857992 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224003260 con 0x7ff224003820 2021-11-15T19:35:30.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 -- 172.21.2.137:0/2209857992 reap_dead start 2021-11-15T19:35:30.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff241f91700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff224003820 0x7ff224003c20 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7ff23c05c2e0 tx=0x7ff238001d60).ready entity=mon.1 client_cookie=a8342011cb7cf348 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2380070d0 con 0x7ff224003820 2021-11-15T19:35:30.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff238007230 con 0x7ff224003820 2021-11-15T19:35:30.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff240f8f700 1 -- 172.21.2.137:0/2209857992 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23800c8f0 con 0x7ff224003820 2021-11-15T19:35:30.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/2209857992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff224003820 msgr2=0x7ff224003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff224003820 0x7ff224003c20 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7ff23c05c2e0 tx=0x7ff238001d60).stop 2021-11-15T19:35:30.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/2209857992 shutdown_connections 2021-11-15T19:35:30.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 --2- 172.21.2.137:0/2209857992 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff224003820 0x7ff224003c20 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/2209857992 >> 172.21.2.137:0/2209857992 conn(0x7ff23c063d20 msgr2=0x7ff23c0b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:30.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/2209857992 shutdown_connections 2021-11-15T19:35:30.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/2209857992 wait complete. 2021-11-15T19:35:30.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 Processor -- start 2021-11-15T19:35:30.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- start start 2021-11-15T19:35:30.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224003820 0x7ff23c14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff23c0668b0 0x7ff23c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 0x7ff23c10fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.023 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c13cca0 con 0x7ff224003820 2021-11-15T19:35:30.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c065ee0 con 0x7ff23c10f840 2021-11-15T19:35:30.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c10f3f0 con 0x7ff23c0668b0 2021-11-15T19:35:30.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 0x7ff23c10fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 0x7ff23c10fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40170/0 (socket says 172.21.2.137:40170) 2021-11-15T19:35:30.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 -- 172.21.2.137:0/1538348475 learned_addr learned my addr 172.21.2.137:0/1538348475 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:30.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 -- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff23c0668b0 msgr2=0x7ff23c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff23c0668b0 0x7ff23c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 -- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224003820 msgr2=0x7ff23c14daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224003820 0x7ff23c14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 -- 172.21.2.137:0/1538348475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c066140 con 0x7ff23c10f840 2021-11-15T19:35:30.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff242792700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 0x7ff23c10fcd0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7ff23c0ad900 tx=0x7ff234007d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2340058d0 con 0x7ff23c10f840 2021-11-15T19:35:30.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234005a30 con 0x7ff23c10f840 2021-11-15T19:35:30.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff234005d90 con 0x7ff23c10f840 2021-11-15T19:35:30.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c10f0e0 con 0x7ff23c10f840 2021-11-15T19:35:30.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c066dc0 con 0x7ff23c10f840 2021-11-15T19:35:30.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c0662d0 con 0x7ff23c10f840 2021-11-15T19:35:30.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff23401a060 con 0x7ff23c10f840 2021-11-15T19:35:30.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff22effd700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff21c057a10 0x7ff21c059ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.002+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff23406b100 con 0x7ff23c10f840 2021-11-15T19:35:30.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.006+0000 7ff241f91700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff21c057a10 0x7ff21c059ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.006+0000 7ff241f91700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff21c057a10 0x7ff21c059ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ff23c05c2e0 tx=0x7ff238015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.006+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff234042150 con 0x7ff23c10f840 2021-11-15T19:35:30.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.090+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff23c0b02d0 con 0x7ff23c10f840 2021-11-15T19:35:30.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.090+0000 7ff22effd700 1 -- 172.21.2.137:0/1538348475 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff2340180a0 con 0x7ff23c10f840 2021-11-15T19:35:30.103 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff21c057a10 msgr2=0x7ff21c059ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff21c057a10 0x7ff21c059ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ff23c05c2e0 tx=0x7ff238015000).stop 2021-11-15T19:35:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 msgr2=0x7ff23c10fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 0x7ff23c10fcd0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7ff23c0ad900 tx=0x7ff234007d90).stop 2021-11-15T19:35:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 shutdown_connections 2021-11-15T19:35:30.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff21c057a10 0x7ff21c059ed0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff23c10f840 0x7ff23c10fcd0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff23c0668b0 0x7ff23c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 --2- 172.21.2.137:0/1538348475 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff224003820 0x7ff23c14daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 >> 172.21.2.137:0/1538348475 conn(0x7ff23c063d20 msgr2=0x7ff23c13e860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:30.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 shutdown_connections 2021-11-15T19:35:30.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.094+0000 7ff2441f5700 1 -- 172.21.2.137:0/1538348475 wait complete. 2021-11-15T19:35:30.111 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:35:30.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.154+0000 7f6674bea700 1 Processor -- start 2021-11-15T19:35:30.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.154+0000 7f6674bea700 1 -- start start 2021-11-15T19:35:30.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f66700b21b0 0x7f66700af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f66701466d0 0x7f6670146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667009af50 con 0x7f667005f730 2021-11-15T19:35:30.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6670098740 con 0x7f66700b21b0 2021-11-15T19:35:30.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6670147010 con 0x7f66701466d0 2021-11-15T19:35:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f66701466d0 0x7f6670146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f66701466d0 0x7f6670146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40174/0 (socket says 172.21.2.137:40174) 2021-11-15T19:35:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 -- 172.21.2.137:0/2877586310 learned_addr learned my addr 172.21.2.137:0/2877586310 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 -- 172.21.2.137:0/2877586310 >> v2:172.21.2.111:3300/0 conn(0x7f66700b21b0 msgr2=0x7f66700af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:30.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 --2- 172.21.2.137:0/2877586310 >> v2:172.21.2.111:3300/0 conn(0x7f66700b21b0 0x7f66700af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 -- 172.21.2.137:0/2877586310 >> v1:172.21.2.111:6789/0 conn(0x7f667005f730 legacy=0x7f667005fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 -- 172.21.2.137:0/2877586310 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667014b170 con 0x7f66701466d0 2021-11-15T19:35:30.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666effd700 1 --2- 172.21.2.137:0/2877586310 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66701466d0 0x7f6670146b20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f66700b2960 tx=0x7f6658006eb0).ready entity=mon.1 client_cookie=76e962e2cd1280d6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666e7fc700 1 -- 172.21.2.137:0/2877586310 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f665800d5c0 con 0x7f66701466d0 2021-11-15T19:35:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666e7fc700 1 -- 172.21.2.137:0/2877586310 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6658000e90 con 0x7f66701466d0 2021-11-15T19:35:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666e7fc700 1 -- 172.21.2.137:0/2877586310 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f665800d910 con 0x7f66701466d0 2021-11-15T19:35:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- 172.21.2.137:0/2877586310 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66701466d0 msgr2=0x7f6670146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- 172.21.2.137:0/2877586310 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66701466d0 0x7f6670146b20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f66700b2960 tx=0x7f6658006eb0).stop 2021-11-15T19:35:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- 172.21.2.137:0/2877586310 shutdown_connections 2021-11-15T19:35:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- 172.21.2.137:0/2877586310 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f66701466d0 0x7f6670146b20 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- 172.21.2.137:0/2877586310 >> v2:172.21.2.111:3300/0 conn(0x7f66700b21b0 0x7f66700af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- 172.21.2.137:0/2877586310 >> 172.21.2.137:0/2877586310 conn(0x7f66700b58d0 msgr2=0x7f66700b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:30.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- 172.21.2.137:0/2877586310 shutdown_connections 2021-11-15T19:35:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- 172.21.2.137:0/2877586310 wait complete. 2021-11-15T19:35:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 Processor -- start 2021-11-15T19:35:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- start start 2021-11-15T19:35:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 0x7f66700aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66700b21b0 0x7f66700648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66701466d0 0x7f6670064d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670063d10 con 0x7f66700b21b0 2021-11-15T19:35:30.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670066cd0 con 0x7f667005f730 2021-11-15T19:35:30.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f6674bea700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6670066f70 con 0x7f66701466d0 2021-11-15T19:35:30.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 0x7f66700aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 0x7f66700aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40180/0 (socket says 172.21.2.137:40180) 2021-11-15T19:35:30.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 -- 172.21.2.137:0/811608883 learned_addr learned my addr 172.21.2.137:0/811608883 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:30.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 -- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66701466d0 msgr2=0x7f6670064d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:30.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66701466d0 0x7f6670064d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 -- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66700b21b0 msgr2=0x7f66700648a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:30.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66700b21b0 0x7f66700648a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 -- 172.21.2.137:0/811608883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665800b1e0 con 0x7f667005f730 2021-11-15T19:35:30.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.158+0000 7f666f7fe700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 0x7f66700aa590 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f6660002f70 tx=0x7f6660006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6660013460 con 0x7f667005f730 2021-11-15T19:35:30.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66600135c0 con 0x7f667005f730 2021-11-15T19:35:30.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6670067210 con 0x7f667005f730 2021-11-15T19:35:30.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6660013920 con 0x7f667005f730 2021-11-15T19:35:30.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700a98d0 con 0x7f667005f730 2021-11-15T19:35:30.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700673a0 con 0x7f667005f730 2021-11-15T19:35:30.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f666000f070 con 0x7f667005f730 2021-11-15T19:35:30.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6654053610 0x7f6654055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f666006b2b0 con 0x7f667005f730 2021-11-15T19:35:30.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666effd700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6654053610 0x7f6654055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666effd700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6654053610 0x7f6654055ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f66700b2960 tx=0x7f6658015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.162+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6660042410 con 0x7f667005f730 2021-11-15T19:35:30.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f667014b3d0 con 0x7f667005f730 2021-11-15T19:35:30.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f666cff9700 1 -- 172.21.2.137:0/811608883 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6660045a30 con 0x7f667005f730 2021-11-15T19:35:30.257 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6654053610 msgr2=0x7f6654055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6654053610 0x7f6654055ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f66700b2960 tx=0x7f6658015000).stop 2021-11-15T19:35:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 msgr2=0x7f66700aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 0x7f66700aa590 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f6660002f70 tx=0x7f6660006ec0).stop 2021-11-15T19:35:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 shutdown_connections 2021-11-15T19:35:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f6654053610 0x7f6654055ad0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f66701466d0 0x7f6670064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f66700b21b0 0x7f66700648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 --2- 172.21.2.137:0/811608883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f667005f730 0x7f66700aa590 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 >> 172.21.2.137:0/811608883 conn(0x7f66700b58d0 msgr2=0x7f6670099140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 shutdown_connections 2021-11-15T19:35:30.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.246+0000 7f6674bea700 1 -- 172.21.2.137:0/811608883 wait complete. 2021-11-15T19:35:30.264 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:35:30.265 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:30.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 Processor -- start 2021-11-15T19:35:30.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- start start 2021-11-15T19:35:30.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f179405c100 0x7f1794147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f179405cdd0 0x7f17940ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f17940b1310 0x7f17940ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17940ad900 con 0x7f17940b1310 2021-11-15T19:35:30.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17940ace30 con 0x7f179405cdd0 2021-11-15T19:35:30.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17940af3b0 con 0x7f179405c100 2021-11-15T19:35:30.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f179405cdd0 0x7f17940ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f179405cdd0 0x7f17940ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40190/0 (socket says 172.21.2.137:40190) 2021-11-15T19:35:30.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 -- 172.21.2.137:0/3981606891 learned_addr learned my addr 172.21.2.137:0/3981606891 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:30.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 -- 172.21.2.137:0/3981606891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f179405c100 msgr2=0x7f1794147ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:30.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 --2- 172.21.2.137:0/3981606891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f179405c100 0x7f1794147ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 -- 172.21.2.137:0/3981606891 >> v2:172.21.2.111:3300/0 conn(0x7f17940b1310 msgr2=0x7f17940ac940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:30.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 --2- 172.21.2.137:0/3981606891 >> v2:172.21.2.111:3300/0 conn(0x7f17940b1310 0x7f17940ac940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 -- 172.21.2.137:0/3981606891 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17941471c0 con 0x7f179405cdd0 2021-11-15T19:35:30.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17927fc700 1 --2- 172.21.2.137:0/3981606891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405cdd0 0x7f17940ac450 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f177c002f70 tx=0x7f177c006eb0).ready entity=mon.1 client_cookie=5132df4e80fb1214 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1791ffb700 1 -- 172.21.2.137:0/3981606891 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177c00d570 con 0x7f179405cdd0 2021-11-15T19:35:30.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1791ffb700 1 -- 172.21.2.137:0/3981606891 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c000e90 con 0x7f179405cdd0 2021-11-15T19:35:30.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1791ffb700 1 -- 172.21.2.137:0/3981606891 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177c00d8c0 con 0x7f179405cdd0 2021-11-15T19:35:30.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/3981606891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405cdd0 msgr2=0x7f17940ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- 172.21.2.137:0/3981606891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405cdd0 0x7f17940ac450 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f177c002f70 tx=0x7f177c006eb0).stop 2021-11-15T19:35:30.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/3981606891 shutdown_connections 2021-11-15T19:35:30.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- 172.21.2.137:0/3981606891 >> v2:172.21.2.111:3300/0 conn(0x7f17940b1310 0x7f17940ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- 172.21.2.137:0/3981606891 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405cdd0 0x7f17940ac450 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- 172.21.2.137:0/3981606891 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f179405c100 0x7f1794147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/3981606891 >> 172.21.2.137:0/3981606891 conn(0x7f17940b5010 msgr2=0x7f17940b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:30.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/3981606891 shutdown_connections 2021-11-15T19:35:30.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/3981606891 wait complete. 2021-11-15T19:35:30.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 Processor -- start 2021-11-15T19:35:30.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- start start 2021-11-15T19:35:30.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 0x7f17940a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f179405cdd0 0x7f1794144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f17940b1310 0x7f17940aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794067720 con 0x7f179405cdd0 2021-11-15T19:35:30.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940a7230 con 0x7f179405c100 2021-11-15T19:35:30.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17940a74d0 con 0x7f17940b1310 2021-11-15T19:35:30.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 0x7f17940a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 0x7f17940a8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40192/0 (socket says 172.21.2.137:40192) 2021-11-15T19:35:30.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 -- 172.21.2.137:0/942277799 learned_addr learned my addr 172.21.2.137:0/942277799 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:30.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 -- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f17940b1310 msgr2=0x7f17940aabd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:30.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f17940b1310 0x7f17940aabd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 -- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f179405cdd0 msgr2=0x7f1794144420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:30.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f179405cdd0 0x7f1794144420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 -- 172.21.2.137:0/942277799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c00b1e0 con 0x7f179405c100 2021-11-15T19:35:30.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f1792ffd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 0x7f17940a8a90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f17940a6a30 tx=0x7f1784006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1784013460 con 0x7f179405c100 2021-11-15T19:35:30.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17840135c0 con 0x7f179405c100 2021-11-15T19:35:30.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17940673a0 con 0x7f179405c100 2021-11-15T19:35:30.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1784013920 con 0x7f179405c100 2021-11-15T19:35:30.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.306+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17940a7a30 con 0x7f179405c100 2021-11-15T19:35:30.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1794067530 con 0x7f179405c100 2021-11-15T19:35:30.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f178400f070 con 0x7f179405c100 2021-11-15T19:35:30.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f178bfff700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1778053580 0x7f1778055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:30.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f178406b480 con 0x7f179405c100 2021-11-15T19:35:30.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f17927fc700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1778053580 0x7f1778055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:30.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f17927fc700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1778053580 0x7f1778055a40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f177c002f70 tx=0x7f177c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:30.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.310+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17840424d0 con 0x7f179405c100 2021-11-15T19:35:30.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1794147460 con 0x7f179405c100 2021-11-15T19:35:30.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f178bfff700 1 -- 172.21.2.137:0/942277799 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f1784045af0 con 0x7f179405c100 2021-11-15T19:35:30.433 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:30.433 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":68,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:18.459599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7969":{"gid":7969,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4213511213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4213511213},{"type":"v1","addr":"172.21.2.137:6833","nonce":4213511213}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:30.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1778053580 msgr2=0x7f1778055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1778053580 0x7f1778055a40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f177c002f70 tx=0x7f177c015000).stop 2021-11-15T19:35:30.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 msgr2=0x7f17940a8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:30.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 0x7f17940a8a90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f17940a6a30 tx=0x7f1784006df0).stop 2021-11-15T19:35:30.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 shutdown_connections 2021-11-15T19:35:30.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1778053580 0x7f1778055a40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f17940b1310 0x7f17940aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f179405cdd0 0x7f1794144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:30.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 --2- 172.21.2.137:0/942277799 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f179405c100 0x7f17940a8a90 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:30.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 >> 172.21.2.137:0/942277799 conn(0x7f17940b5010 msgr2=0x7f179414ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:30.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 shutdown_connections 2021-11-15T19:35:30.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:30.422+0000 7f17996dd700 1 -- 172.21.2.137:0/942277799 wait complete. 2021-11-15T19:35:30.437 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 68 2021-11-15T19:35:30.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:16.433090+0000', 'modified': '2021-11-15T19:35:18.459599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7969': {'gid': 7969, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4213511213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4213511213}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4213511213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:30.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:30.642 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:30.709 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":7969,"want_state":"up:active","state":"up:active","rank_uptime":13.241021313999999,"mdsmap_epoch":68,"osdmap_epoch":131,"osdmap_epoch_barrier":131,"uptime":17.459263850999999} 2021-11-15T19:35:30.709 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 7969, "mdsmap_epoch": 68, "osdmap_epoch": 131, "osdmap_epoch_barrier": 131, "rank_uptime": 13.241021314, "state": "up:active", "uptime": 17.459263851, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:30.710 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:35:30.710 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:35:30.710 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:35:30.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:30.711 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:30.722 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:30.776 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:30.776 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:30.782 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:30.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:30.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:30.784 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:30.788 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:35:30.788 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:30.831 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:30.840 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:30.840 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:30.845 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:30.846 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:30.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:30.847 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:30.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:35:30.864+0000 7f9e522f0080 -1 init, newargv = 0x5637eee2abd0 newargc=9 2021-11-15T19:35:30.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14702]: starting ceph client 2021-11-15T19:35:30.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14702]: starting fuse 2021-11-15T19:35:31.972 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:31.984 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:31.985 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:32.036 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:32.037 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:32.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:32.038 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:32.044 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:35:32.044 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:35:32.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:32.045 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:35:32.045 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:35:32.046 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:35:32.046 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:35:32.046 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:35:32.047 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:32.047 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:35:32.048 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:35:32.048 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:35:32.048 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:32.049 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:35:32.049 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:35:32.050 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:35:32.050 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:35:32.051 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:32.051 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:35:32.051 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:35:32.052 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:35:32.052 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:35:32.053 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:35:32.053 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:32.053 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:35:32.054 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:35:32.087 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14702.asok 2021-11-15T19:35:32.089 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14702.asok 2021-11-15T19:35:32.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:32.090 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14702.asok status 2021-11-15T19:35:32.193 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:35:32.193 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:35:32.194 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:35:32.194 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:35:32.194 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:35:32.194 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:35:32.194 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:35:32.195 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14702", 2021-11-15T19:35:32.195 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:35:32.195 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:32.195 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:35:32.196 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:35:32.196 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 8215, 2021-11-15T19:35:32.196 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:35:32.196 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:35:32.196 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:35:32.197 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 8215 2021-11-15T19:35:32.197 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:32.197 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:35:32.197 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:35:32.197 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:35:32.198 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 523140724 2021-11-15T19:35:32.198 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:35:32.198 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:32.198 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:35:32.199 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:35:32.199 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:35:32.199 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 523140724 2021-11-15T19:35:32.199 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:32.199 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.8215 172.21.2.118:0/523140724", 2021-11-15T19:35:32.200 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/523140724", 2021-11-15T19:35:32.200 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:35:32.200 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 68, 2021-11-15T19:35:32.200 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 131, 2021-11-15T19:35:32.200 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:35:32.201 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:35:32.201 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:35:32.201 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:35:32.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:32.203 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:32.203 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:32.208 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:32.208 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:32.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:32.209 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:32.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:32.258 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:32.259 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:32.270 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:35:32.271 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:32.271 DEBUG:teuthology.orchestra.run.gibba031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T19:35:32.272 DEBUG:teuthology.orchestra.run.gibba031:> import time 2021-11-15T19:35:32.272 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:32.272 DEBUG:teuthology.orchestra.run.gibba031:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-11-15T19:35:32.273 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content'"'"') 2021-11-15T19:35:32.273 DEBUG:teuthology.orchestra.run.gibba031:> f.flush() 2021-11-15T19:35:32.273 DEBUG:teuthology.orchestra.run.gibba031:> f.write('"'"'content2'"'"') 2021-11-15T19:35:32.274 DEBUG:teuthology.orchestra.run.gibba031:> while True: 2021-11-15T19:35:32.274 DEBUG:teuthology.orchestra.run.gibba031:> time.sleep(1) 2021-11-15T19:35:32.275 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:35:32.316 DEBUG:teuthology.orchestra.run.gibba031:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-11-15T19:35:32.329 INFO:teuthology.orchestra.run.gibba031.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-11-15T19:35:32.330 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-11-15T19:35:33.331 DEBUG:teuthology.orchestra.run.gibba031:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-11-15T19:35:33.343 INFO:teuthology.orchestra.run.gibba031.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-11-15T19:35:33.344 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-11-15T19:35:33.344 DEBUG:teuthology.orchestra.run.gibba018:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-11-15T19:35:33.385 INFO:teuthology.orchestra.run.gibba018.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-11-15T19:35:33.387 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-11-15T19:35:33.388 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T19:35:33.388 DEBUG:teuthology.orchestra.run.gibba018:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-11-15T19:35:33.499 INFO:teuthology.orchestra.run.gibba018.stdout:content 2021-11-15T19:35:33.510 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:35:33.510 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:33.523 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:33.536 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:33.549 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:33.560 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:33.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:35:33.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:33.573 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:33.574 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:33.587 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:35:33.588 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:33.589 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:35:33.589 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:35:33.590 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:33.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15232]: fuse finished with error 0 and tester_r 0 2021-11-15T19:35:33.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:33.651 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:33.651 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:33.660 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:35:33.661 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:35:33.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:33.782 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:33.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:33.791 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:33.792 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:33.803 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:33.805 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:33.805 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:35:33.805 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:35:33.806 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:33.862 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14702]: fuse finished with error 0 and tester_r 0 2021-11-15T19:35:33.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:33.864 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:33.864 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:33.868 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:35:33.869 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:35:33.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:33.978 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:34.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:34.026 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:34.026 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:34.036 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:34.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:34.037 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:35:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:34.038 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:34.087 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:34.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:34.088 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:35:34.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 Processor -- start 2021-11-15T19:35:34.144 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- start start 2021-11-15T19:35:34.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f58340b9e90 0x7f5834143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f5834143750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5834143c40 0x7f5834146250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5834142e00 con 0x7f58340b9e90 2021-11-15T19:35:34.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58340ba270 con 0x7f5834143c40 2021-11-15T19:35:34.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583405c100 con 0x7f58340b00f0 2021-11-15T19:35:34.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5834143c40 0x7f5834146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5834143c40 0x7f5834146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40200/0 (socket says 172.21.2.137:40200) 2021-11-15T19:35:34.148 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 -- 172.21.2.137:0/2257315230 learned_addr learned my addr 172.21.2.137:0/2257315230 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:34.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f5832ffd700 1 --2- 172.21.2.137:0/2257315230 >> v2:172.21.2.111:3300/0 conn(0x7f58340b9e90 0x7f5834143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58327fc700 1 --2- 172.21.2.137:0/2257315230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f5834143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 -- 172.21.2.137:0/2257315230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 msgr2=0x7f5834143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:34.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 --2- 172.21.2.137:0/2257315230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f5834143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.149 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 -- 172.21.2.137:0/2257315230 >> v2:172.21.2.111:3300/0 conn(0x7f58340b9e90 msgr2=0x7f5834143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:34.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 --2- 172.21.2.137:0/2257315230 >> v2:172.21.2.111:3300/0 conn(0x7f58340b9e90 0x7f5834143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 -- 172.21.2.137:0/2257315230 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583405be60 con 0x7f5834143c40 2021-11-15T19:35:34.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58337fe700 1 --2- 172.21.2.137:0/2257315230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5834143c40 0x7f5834146250 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5824002f70 tx=0x7f5824006eb0).ready entity=mon.1 client_cookie=4c288ff74566571d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.150 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f5831ffb700 1 -- 172.21.2.137:0/2257315230 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582400d570 con 0x7f5834143c40 2021-11-15T19:35:34.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f5831ffb700 1 -- 172.21.2.137:0/2257315230 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824000e90 con 0x7f5834143c40 2021-11-15T19:35:34.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f5831ffb700 1 -- 172.21.2.137:0/2257315230 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582400d900 con 0x7f5834143c40 2021-11-15T19:35:34.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- 172.21.2.137:0/2257315230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5834143c40 msgr2=0x7f5834146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- 172.21.2.137:0/2257315230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5834143c40 0x7f5834146250 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5824002f70 tx=0x7f5824006eb0).stop 2021-11-15T19:35:34.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- 172.21.2.137:0/2257315230 shutdown_connections 2021-11-15T19:35:34.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- 172.21.2.137:0/2257315230 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5834143c40 0x7f5834146250 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- 172.21.2.137:0/2257315230 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f5834143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 --2- 172.21.2.137:0/2257315230 >> v2:172.21.2.111:3300/0 conn(0x7f58340b9e90 0x7f5834143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- 172.21.2.137:0/2257315230 >> 172.21.2.137:0/2257315230 conn(0x7f5834063230 msgr2=0x7f58340b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:34.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- 172.21.2.137:0/2257315230 shutdown_connections 2021-11-15T19:35:34.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.134+0000 7f58396f6700 1 -- 172.21.2.137:0/2257315230 wait complete. 2021-11-15T19:35:34.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 Processor -- start 2021-11-15T19:35:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- start start 2021-11-15T19:35:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f58341442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58340b9e90 0x7f583413d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5834143c40 0x7f583413ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340aedd0 con 0x7f5834143c40 2021-11-15T19:35:34.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340af000 con 0x7f58340b9e90 2021-11-15T19:35:34.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340af2a0 con 0x7f58340b00f0 2021-11-15T19:35:34.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58327fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58340b9e90 0x7f583413d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f58341442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58327fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58340b9e90 0x7f583413d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40206/0 (socket says 172.21.2.137:40206) 2021-11-15T19:35:34.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58327fc700 1 -- 172.21.2.137:0/174871796 learned_addr learned my addr 172.21.2.137:0/174871796 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:34.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58337fe700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5834143c40 0x7f583413ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 -- 172.21.2.137:0/174871796 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58340b9e90 msgr2=0x7f583413d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58340b9e90 0x7f583413d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 -- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5834143c40 msgr2=0x7f583413ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5834143c40 0x7f583413ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 -- 172.21.2.137:0/174871796 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582400b1e0 con 0x7f58340b00f0 2021-11-15T19:35:34.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5832ffd700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f58341442e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f582c00c000 tx=0x7f582c0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582c0126d0 con 0x7f58340b00f0 2021-11-15T19:35:34.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c012830 con 0x7f58340b00f0 2021-11-15T19:35:34.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58341447d0 con 0x7f58340b00f0 2021-11-15T19:35:34.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582c012b90 con 0x7f58340b00f0 2021-11-15T19:35:34.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5834145060 con 0x7f58340b00f0 2021-11-15T19:35:34.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583405cce0 con 0x7f58340b00f0 2021-11-15T19:35:34.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f582c022070 con 0x7f58340b00f0 2021-11-15T19:35:34.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5823fff700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5810053580 0x7f5810055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f582c06bf90 con 0x7f58340b00f0 2021-11-15T19:35:34.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58327fc700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5810053580 0x7f5810055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.138+0000 7f58327fc700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5810053580 0x7f5810055a40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f5828008000 tx=0x7f5828008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.142+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f582c042fe0 con 0x7f58340b00f0 2021-11-15T19:35:34.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.226+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f58340af3e0 con 0x7f58340b00f0 2021-11-15T19:35:34.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f5823fff700 1 -- 172.21.2.137:0/174871796 <== mon.2 v2:172.21.2.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v131) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f582c046600 con 0x7f58340b00f0 2021-11-15T19:35:34.240 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:34.241 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:34.241 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 131, 2021-11-15T19:35:34.241 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:35:34.241 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:35:34.242 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:35:17.437552+0000", 2021-11-15T19:35:34.242 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:34.242 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:34.242 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:35:34.242 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:35:34.243 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:35:34.243 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:35:34.243 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:35:34.243 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:35:34.243 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:35:34.244 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:34.244 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:35:34.244 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:35:34.244 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:35:34.244 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:35:34.245 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:35:34.245 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 26, 2021-11-15T19:35:34.245 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:35:34.245 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:35:34.246 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:35:34.246 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:35:34.246 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:35:34.246 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.246 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:35:34.247 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:35:34.247 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:35:34.247 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:34.247 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:34.247 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:34.248 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:34.248 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:34.248 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:34.248 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:34.248 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:34.249 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:35:34.249 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:35:34.249 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:35:34.249 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:35:34.249 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:35:34.250 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:34.250 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:34.250 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:34.250 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:34.251 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:34.251 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:34.251 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:34.251 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.251 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:35:34.252 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:34.252 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:34.252 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:34.252 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:34.252 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:34.253 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:34.253 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:34.253 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:34.253 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:34.253 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:34.254 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:34.254 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:34.254 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:34.254 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:34.254 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:34.255 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:34.255 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:34.255 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:34.255 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:34.255 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:34.256 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:34.256 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:34.256 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:34.256 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:34.256 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:34.257 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:34.257 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.257 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:34.257 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:34.257 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:34.258 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:34.258 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:34.258 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:34.258 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:34.258 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:34.259 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:34.259 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:34.259 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:34.259 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:34.259 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:35:34.260 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.260 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:34.260 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:35:34.260 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.260 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.261 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.261 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:35:34.261 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:35:34.261 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:35:34.261 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:34.262 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:34.262 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:34.262 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:34.262 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:34.262 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:34.263 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:34.263 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:34.263 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:34.263 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:34.264 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:34.264 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:34.264 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:34.264 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:34.264 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:34.265 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:34.265 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:34.265 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:34.265 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:34.266 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:34.266 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.266 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:35:34.266 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:34.266 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:34.267 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:34.267 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:34.267 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:34.267 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:34.267 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:34.268 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:34.268 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:34.268 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:34.268 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:34.268 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:34.269 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:34.269 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:34.270 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:34.270 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:34.270 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:34.271 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:34.271 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:34.271 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:34.271 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:34.271 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:34.272 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:34.272 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:34.272 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:34.272 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:34.273 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.273 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:34.273 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:34.273 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:34.273 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:34.274 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:34.274 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:34.274 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:34.274 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:34.275 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:34.275 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:34.275 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:34.275 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:34.275 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:34.276 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:35:34.276 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.276 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.276 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.276 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 25, 2021-11-15T19:35:34.277 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:35:34.277 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:35:15.202823+0000", 2021-11-15T19:35:34.277 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:34.277 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:34.278 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:34.278 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:34.278 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:34.278 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:34.278 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:34.279 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:34.279 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:34.279 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:34.279 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:34.279 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:34.280 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:34.280 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:34.280 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:34.280 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:34.280 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:34.281 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:34.281 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:34.281 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:34.281 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.282 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "130", 2021-11-15T19:35:34.282 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:34.282 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:34.282 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:34.282 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:34.283 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:34.283 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:34.283 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:34.283 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:34.283 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:34.284 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:34.284 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:34.284 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:34.284 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:34.285 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:34.285 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:34.285 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:34.285 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:34.285 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:34.286 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:34.286 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:34.286 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:34.286 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:34.286 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:34.287 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:34.287 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:34.287 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:34.287 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.287 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:34.288 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:34.288 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:34.288 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:34.288 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:34.289 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:34.289 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:34.289 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:34.289 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:34.289 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:34.290 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:34.290 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:34.290 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:35:34.290 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:35:34.290 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:35:34.291 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.291 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:34.291 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:35:34.291 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:35:34.291 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.292 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.292 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.292 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.292 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 26, 2021-11-15T19:35:34.293 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:35:34.293 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:35:15.395889+0000", 2021-11-15T19:35:34.293 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:34.293 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:34.293 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:34.294 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:34.294 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:34.294 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:34.294 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:34.294 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:34.295 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:34.295 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:34.295 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:34.295 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:34.296 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:34.296 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:34.296 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:34.296 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:34.296 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:34.297 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:34.297 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:34.297 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:34.297 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.297 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "131", 2021-11-15T19:35:34.298 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:34.298 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:34.298 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:34.298 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:34.298 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:34.299 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:34.299 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:34.299 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:34.299 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:34.300 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:34.300 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:34.300 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:34.300 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:34.300 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:34.301 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:34.301 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:34.301 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:34.301 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:34.301 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:34.302 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:34.302 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:34.302 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:34.302 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:34.303 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:34.303 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:34.303 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:34.303 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.303 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:34.304 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:34.304 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:34.304 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:34.304 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:34.304 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:34.305 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:34.305 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:34.305 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:34.305 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:34.306 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:34.306 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:34.306 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:34.306 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:35:34.306 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:35:34.307 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.307 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.307 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.307 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:34.307 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:35:34.308 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.308 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:34.308 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:35:34.308 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.308 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.309 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.309 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.309 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.309 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.310 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.310 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 128, 2021-11-15T19:35:34.310 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.310 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.310 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.311 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.311 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.311 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.311 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:35:34.311 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.312 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.312 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.312 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.312 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:35:34.313 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.313 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.313 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.313 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.313 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.314 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.314 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.314 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.314 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:35:34.314 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.315 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.315 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.315 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.315 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:35:34.316 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.316 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.316 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.316 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.316 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.317 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.317 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.317 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.317 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:35:34.317 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.318 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.318 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.318 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.318 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:35:34.319 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.319 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.319 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.319 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.319 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.320 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.320 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.320 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.320 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:35:34.320 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.321 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.321 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.321 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.321 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:35:34.322 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:34.322 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.322 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.322 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.322 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:35:34.323 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:35:34.323 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:35:34.323 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:35:34.323 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.323 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.324 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.324 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.324 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.324 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.325 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:34.325 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:35:34.325 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.325 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.325 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.326 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.326 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.326 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.326 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:34.327 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.327 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.327 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.327 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.328 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.328 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.328 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:35:34.328 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.328 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.329 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.329 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.329 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:35:34.329 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.329 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.330 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.330 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.330 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.330 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.330 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.331 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.331 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:35:34.331 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.331 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.332 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.332 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.332 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:35:34.332 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.332 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.333 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.333 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.333 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.333 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.333 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.334 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.334 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:35:34.334 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.334 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.334 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.335 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.335 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:35:34.335 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.335 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.336 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.336 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.336 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.336 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.336 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.337 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.337 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:35:34.337 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.337 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.337 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.338 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.338 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:35:34.338 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:34.338 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.338 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.339 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.339 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:35:34.339 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:35:34.339 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:35:34.340 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:35:34.340 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.340 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.340 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.340 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.341 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.341 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.341 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:34.341 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:35:34.341 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.342 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.342 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.342 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.342 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.342 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.343 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.343 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:34.343 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.343 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.344 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.344 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.344 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.344 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.344 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:35:34.345 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.345 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.345 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.345 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.346 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:35:34.346 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.346 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.346 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.346 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.347 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.347 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.347 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.347 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.347 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:35:34.348 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.348 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.348 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.348 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.348 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:35:34.349 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.349 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.349 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.349 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.350 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.350 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.350 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.350 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.350 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:35:34.351 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.351 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.351 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.351 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.352 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:35:34.352 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.352 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.352 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.352 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.353 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.353 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.353 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.353 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.354 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:35:34.354 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.354 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.354 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.354 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.355 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:35:34.355 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:34.355 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.355 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.356 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.356 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:35:34.356 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:35:34.356 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:35:34.356 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:35:34.357 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.357 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.357 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.357 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.357 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.358 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.358 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:34.358 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:35:34.358 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.359 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.359 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.359 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.359 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.359 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.360 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.360 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 128, 2021-11-15T19:35:34.360 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.360 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.360 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.361 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.361 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.361 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.361 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:35:34.362 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.362 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.362 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.362 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.362 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:35:34.363 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.363 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.363 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.363 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.363 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.364 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.364 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.364 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.364 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:35:34.365 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.365 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.365 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.365 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.365 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:35:34.366 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.366 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.366 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.366 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.367 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.367 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.367 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.367 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.367 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:35:34.368 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.368 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.368 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.368 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.368 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:35:34.369 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.369 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.369 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.369 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.370 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.370 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.370 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.370 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.370 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:35:34.371 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.371 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.371 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.371 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.371 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:35:34.372 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:34.372 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.372 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.372 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.373 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:35:34.373 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:35:34.373 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:35:34.373 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:35:34.373 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.374 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.374 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.374 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.374 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.375 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.375 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:34.375 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:35:34.375 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.376 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.376 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.376 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.376 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.376 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.377 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.377 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:34.377 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.377 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.377 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.378 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.378 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.378 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.378 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:35:34.379 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.379 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.379 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.379 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.379 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:35:34.380 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.380 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.380 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.380 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.381 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.381 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.381 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.381 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.381 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:35:34.382 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.382 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.382 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.382 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.383 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:35:34.383 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.383 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.383 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.384 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.384 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.384 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.384 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.384 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.385 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:35:34.385 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.385 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.385 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.386 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.386 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:35:34.386 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.386 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.386 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.387 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.387 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.387 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.387 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.388 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.388 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:35:34.388 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.388 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.388 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.389 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.389 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:35:34.389 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:34.389 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.389 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.390 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.390 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:35:34.390 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:35:34.390 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:35:34.390 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:35:34.391 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.391 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.391 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.391 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.391 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.392 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.392 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:34.392 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:35:34.392 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.392 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.393 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.393 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.393 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.393 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.394 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.394 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:34.394 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.394 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.394 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.395 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.395 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.395 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.395 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:35:34.395 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.396 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.396 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.396 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.396 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:35:34.396 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.397 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.397 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.397 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.397 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.397 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.398 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.398 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.398 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:35:34.398 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.399 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.399 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.399 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.399 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:35:34.400 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.400 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.400 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.400 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.400 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.401 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.401 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.401 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.401 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:35:34.401 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.402 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.402 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.402 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.402 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:35:34.403 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.403 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.403 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.403 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.403 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.404 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.404 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.404 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.404 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:35:34.405 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.405 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.405 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.405 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.405 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:35:34.406 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:34.406 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.406 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.406 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.407 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:35:34.407 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:35:34.407 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:35:34.407 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:35:34.407 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.408 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.408 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.408 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.408 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.408 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.409 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:34.409 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:35:34.409 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.409 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.409 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.410 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.410 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.410 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.410 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.410 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:34.411 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.411 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.411 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.411 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.411 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.412 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.412 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:35:34.412 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.412 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.413 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.413 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.413 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:35:34.413 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.413 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.414 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.414 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.414 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.414 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.414 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.415 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.415 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:35:34.415 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.415 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.416 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.416 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.416 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:35:34.416 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.416 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.417 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.417 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.417 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.417 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.418 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.418 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.418 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:35:34.418 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.419 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.419 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.419 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.419 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:35:34.419 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.420 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.420 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.420 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.420 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.420 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.421 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.421 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.421 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:35:34.421 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.422 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.422 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.422 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.422 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:35:34.422 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:34.423 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.423 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.423 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.423 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:35:34.424 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:35:34.424 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:35:34.424 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:35:34.424 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.424 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.425 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.425 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.425 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.425 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.425 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:34.426 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:35:34.426 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:34.426 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:34.426 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:34.426 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:34.427 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:34.427 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:34.427 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:34.427 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:34.427 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:34.428 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:34.428 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:34.428 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.428 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.428 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.429 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:35:34.429 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.429 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.429 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.429 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.430 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:35:34.430 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.430 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.430 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.430 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.431 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:34.431 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.431 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.431 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.431 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:35:34.432 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.432 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.432 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.432 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.432 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:35:34.433 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.433 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.433 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.433 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.433 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:34.434 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.434 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.434 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.434 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:35:34.435 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.435 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.435 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.435 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.435 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:35:34.436 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.436 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.436 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.436 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.436 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:34.437 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:34.437 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.437 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:34.437 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:35:34.437 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.438 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.438 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.438 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:34.438 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:35:34.438 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:34.439 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.439 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.439 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.439 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:35:34.439 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:35:34.440 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:35:34.440 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:35:34.440 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:34.440 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:34.440 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:34.441 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:34.441 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.441 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:34.441 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:35:34.441 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.442 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:34.442 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.442 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.442 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.442 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.443 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.443 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:35:34.443 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.443 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.443 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.444 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:34.444 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.444 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.444 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.444 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.445 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.445 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:35:34.445 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.445 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.445 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.446 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:34.446 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.446 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.446 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.447 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.447 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.447 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:35:34.447 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.448 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.448 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.448 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:34.448 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.448 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.449 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.449 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.449 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.449 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:35:34.449 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.450 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.450 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.450 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:34.450 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.450 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.451 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.451 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.451 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.451 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:35:34.452 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.452 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.452 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.452 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:34.452 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.453 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.453 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.453 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.453 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.453 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:35:34.454 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.454 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.454 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.454 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:34.454 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.455 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.455 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.455 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.455 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.456 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:35:34.456 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.456 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.456 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:34.456 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:34.457 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:34.457 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:34.457 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:34.457 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:34.457 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:34.458 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:35:34.458 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:34.458 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.458 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:34.458 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:35:34.459 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:35:34.459 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:35:34.459 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:35:34.459 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:35:34.459 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:35:34.460 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:35:34.460 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:35:34.460 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:35:34.460 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:35:34.460 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:35:34.461 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:35:34.461 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:35:34.461 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:34.461 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:34.462 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:35:34.462 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:35:34.462 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:35:34.462 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:35:34.463 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:35:34.463 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5810053580 msgr2=0x7f5810055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5810053580 0x7f5810055a40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f5828008000 tx=0x7f5828008040).stop 2021-11-15T19:35:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 msgr2=0x7f58341442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f58341442e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f582c00c000 tx=0x7f582c0091d0).stop 2021-11-15T19:35:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 shutdown_connections 2021-11-15T19:35:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5810053580 0x7f5810055a40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5834143c40 0x7f583413ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.466 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58340b9e90 0x7f583413d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 --2- 172.21.2.137:0/174871796 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58340b00f0 0x7f58341442e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 >> 172.21.2.137:0/174871796 conn(0x7f5834063230 msgr2=0x7f583405c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:34.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 shutdown_connections 2021-11-15T19:35:34.467 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.234+0000 7f58396f6700 1 -- 172.21.2.137:0/174871796 wait complete. 2021-11-15T19:35:34.468 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:34.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 Processor -- start 2021-11-15T19:35:34.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- start start 2021-11-15T19:35:34.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0ec805c100 0x7f0ec8147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0ec805cdd0 0x7f0ec80ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec80af3b0 con 0x7f0ec80b1310 2021-11-15T19:35:34.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec80ad900 con 0x7f0ec805c100 2021-11-15T19:35:34.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec81471c0 con 0x7f0ec805cdd0 2021-11-15T19:35:34.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0ec805cdd0 0x7f0ec80ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0ec805cdd0 0x7f0ec80ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40216/0 (socket says 172.21.2.137:40216) 2021-11-15T19:35:34.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 -- 172.21.2.137:0/1848173893 learned_addr learned my addr 172.21.2.137:0/1848173893 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:34.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 -- 172.21.2.137:0/1848173893 >> v2:172.21.2.111:3300/0 conn(0x7f0ec805c100 msgr2=0x7f0ec8147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:34.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 --2- 172.21.2.137:0/1848173893 >> v2:172.21.2.111:3300/0 conn(0x7f0ec805c100 0x7f0ec8147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 -- 172.21.2.137:0/1848173893 >> v1:172.21.2.111:6789/0 conn(0x7f0ec80b1310 legacy=0x7f0ec8143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:34.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 -- 172.21.2.137:0/1848173893 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8147460 con 0x7f0ec805cdd0 2021-11-15T19:35:34.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecd155700 1 --2- 172.21.2.137:0/1848173893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80ac450 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f0ec805cb90 tx=0x7f0eb8006eb0).ready entity=mon.1 client_cookie=19b4777ac74ed693 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecc954700 1 -- 172.21.2.137:0/1848173893 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb800d5c0 con 0x7f0ec805cdd0 2021-11-15T19:35:34.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecc954700 1 -- 172.21.2.137:0/1848173893 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8000e90 con 0x7f0ec805cdd0 2021-11-15T19:35:34.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecc954700 1 -- 172.21.2.137:0/1848173893 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb800d910 con 0x7f0ec805cdd0 2021-11-15T19:35:34.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- 172.21.2.137:0/1848173893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 msgr2=0x7f0ec80ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/1848173893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80ac450 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f0ec805cb90 tx=0x7f0eb8006eb0).stop 2021-11-15T19:35:34.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- 172.21.2.137:0/1848173893 shutdown_connections 2021-11-15T19:35:34.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/1848173893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80ac450 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/1848173893 >> v2:172.21.2.111:3300/0 conn(0x7f0ec805c100 0x7f0ec8147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- 172.21.2.137:0/1848173893 >> 172.21.2.137:0/1848173893 conn(0x7f0ec80b5010 msgr2=0x7f0ec80b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:34.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- 172.21.2.137:0/1848173893 shutdown_connections 2021-11-15T19:35:34.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.518+0000 7f0ecfbba700 1 -- 172.21.2.137:0/1848173893 wait complete. 2021-11-15T19:35:34.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 Processor -- start 2021-11-15T19:35:34.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- start start 2021-11-15T19:35:34.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ec805c100 0x7f0ec80a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ec80b1310 0x7f0ec8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80a7ba0 con 0x7f0ec80b1310 2021-11-15T19:35:34.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80a8860 con 0x7f0ec805cdd0 2021-11-15T19:35:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80a8b00 con 0x7f0ec805c100 2021-11-15T19:35:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80a8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40224/0 (socket says 172.21.2.137:40224) 2021-11-15T19:35:34.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 -- 172.21.2.137:0/2966755588 learned_addr learned my addr 172.21.2.137:0/2966755588 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 -- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ec805c100 msgr2=0x7f0ec80a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ec805c100 0x7f0ec80a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 -- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ec80b1310 msgr2=0x7f0ec8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ec80b1310 0x7f0ec8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 -- 172.21.2.137:0/2966755588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb800b1e0 con 0x7f0ec805cdd0 2021-11-15T19:35:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd155700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80a8fa0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f0ec805cb90 tx=0x7f0eb8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb8002f70 con 0x7f0ec805cdd0 2021-11-15T19:35:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800de70 con 0x7f0ec805cdd0 2021-11-15T19:35:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eb801e460 con 0x7f0ec805cdd0 2021-11-15T19:35:34.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80a9490 con 0x7f0ec805cdd0 2021-11-15T19:35:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec80673f0 con 0x7f0ec805cdd0 2021-11-15T19:35:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec8066030 con 0x7f0ec805cdd0 2021-11-15T19:35:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0eb801a040 con 0x7f0ec805cdd0 2021-11-15T19:35:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0eb6ffd700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0ea80536a0 0x7f0ea8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0eb806cb20 con 0x7f0ec805cdd0 2021-11-15T19:35:34.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.522+0000 7f0ecd956700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0ea80536a0 0x7f0ea8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.526+0000 7f0ecd956700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0ea80536a0 0x7f0ea8055b60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f0ec4002f70 tx=0x7f0ec4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.526+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ec8066030 con 0x7f0ec805cdd0 2021-11-15T19:35:34.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.634+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ec8066030 con 0x7f0ec805cdd0 2021-11-15T19:35:34.646 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.634+0000 7f0eb6ffd700 1 -- 172.21.2.137:0/2966755588 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f0ec8066030 con 0x7f0ec805cdd0 2021-11-15T19:35:34.646 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:34.647 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":68,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:18.459599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7969":{"gid":7969,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4213511213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4213511213},{"type":"v1","addr":"172.21.2.137:6833","nonce":4213511213}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:34.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0ea80536a0 msgr2=0x7f0ea8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0ea80536a0 0x7f0ea8055b60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f0ec4002f70 tx=0x7f0ec4006a80).stop 2021-11-15T19:35:34.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 msgr2=0x7f0ec80a8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80a8fa0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f0ec805cb90 tx=0x7f0eb8015000).stop 2021-11-15T19:35:34.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 shutdown_connections 2021-11-15T19:35:34.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0ea80536a0 0x7f0ea8055b60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0ec80b1310 0x7f0ec8159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0ec805cdd0 0x7f0ec80a8fa0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 --2- 172.21.2.137:0/2966755588 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0ec805c100 0x7f0ec80a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 >> 172.21.2.137:0/2966755588 conn(0x7f0ec80b5010 msgr2=0x7f0ec814b010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:34.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 shutdown_connections 2021-11-15T19:35:34.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.638+0000 7f0ecfbba700 1 -- 172.21.2.137:0/2966755588 wait complete. 2021-11-15T19:35:34.650 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 68 2021-11-15T19:35:34.654 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:35:34.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 Processor -- start 2021-11-15T19:35:34.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- start start 2021-11-15T19:35:34.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc59005cdd0 0x7fc590147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5900af3b0 con 0x7fc59005c100 2021-11-15T19:35:34.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5901471c0 con 0x7fc5900acb60 2021-11-15T19:35:34.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5900ad900 con 0x7fc59005cdd0 2021-11-15T19:35:34.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58ed9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc59005cdd0 0x7fc590147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58dd9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc5900acb60 0x7fc590143ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59012/0 (socket says 172.21.2.137:59012) 2021-11-15T19:35:34.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58dd9b700 1 -- 172.21.2.137:0/1211748132 learned_addr learned my addr 172.21.2.137:0/1211748132 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:34.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58ed9d700 1 -- 172.21.2.137:0/1211748132 >> v1:172.21.2.137:6789/0 conn(0x7fc5900acb60 legacy=0x7fc590143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58ed9d700 1 -- 172.21.2.137:0/1211748132 >> v1:172.21.2.111:6789/0 conn(0x7fc59005c100 legacy=0x7fc5900ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:34.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58ed9d700 1 -- 172.21.2.137:0/1211748132 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590147460 con 0x7fc59005cdd0 2021-11-15T19:35:34.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58ed9d700 1 --2- 172.21.2.137:0/1211748132 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005cdd0 0x7fc590147ba0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fc5901470e0 tx=0x7fc5880091d0).ready entity=mon.1 client_cookie=3c42b60d8e724983 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58d59a700 1 -- 172.21.2.137:0/1211748132 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc58800b7e0 con 0x7fc59005cdd0 2021-11-15T19:35:34.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58d59a700 1 -- 172.21.2.137:0/1211748132 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58800b940 con 0x7fc59005cdd0 2021-11-15T19:35:34.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc58d59a700 1 -- 172.21.2.137:0/1211748132 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc58800bab0 con 0x7fc59005cdd0 2021-11-15T19:35:34.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- 172.21.2.137:0/1211748132 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005cdd0 msgr2=0x7fc590147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 --2- 172.21.2.137:0/1211748132 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005cdd0 0x7fc590147ba0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fc5901470e0 tx=0x7fc5880091d0).stop 2021-11-15T19:35:34.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- 172.21.2.137:0/1211748132 shutdown_connections 2021-11-15T19:35:34.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 --2- 172.21.2.137:0/1211748132 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005cdd0 0x7fc590147ba0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:34.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- 172.21.2.137:0/1211748132 >> 172.21.2.137:0/1211748132 conn(0x7fc5900b5010 msgr2=0x7fc5900b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:34.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- 172.21.2.137:0/1211748132 shutdown_connections 2021-11-15T19:35:34.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.694+0000 7fc594cff700 1 -- 172.21.2.137:0/1211748132 wait complete. 2021-11-15T19:35:34.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 Processor -- start 2021-11-15T19:35:34.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- start start 2021-11-15T19:35:34.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 0x7fc590064cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc59005cdd0 0x7fc590159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5900acb60 0x7fc59015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900a6de0 con 0x7fc5900acb60 2021-11-15T19:35:34.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc590065950 con 0x7fc59005c100 2021-11-15T19:35:34.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900a68a0 con 0x7fc59005cdd0 2021-11-15T19:35:34.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 0x7fc590064cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 0x7fc590064cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40238/0 (socket says 172.21.2.137:40238) 2021-11-15T19:35:34.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 -- 172.21.2.137:0/3282199292 learned_addr learned my addr 172.21.2.137:0/3282199292 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:34.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 -- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc59005cdd0 msgr2=0x7fc590159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc59005cdd0 0x7fc590159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 -- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5900acb60 msgr2=0x7fc59015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:34.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5900acb60 0x7fc59015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:34.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 -- 172.21.2.137:0/3282199292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009470 con 0x7fc59005c100 2021-11-15T19:35:34.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58e59c700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 0x7fc590064cb0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fc580002f90 tx=0x7fc580006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc580013460 con 0x7fc59005c100 2021-11-15T19:35:34.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800135c0 con 0x7fc59005c100 2021-11-15T19:35:34.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc580013920 con 0x7fc59005c100 2021-11-15T19:35:34.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5900a6b40 con 0x7fc59005c100 2021-11-15T19:35:34.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5900676e0 con 0x7fc59005c100 2021-11-15T19:35:34.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5900a77a0 con 0x7fc59005c100 2021-11-15T19:35:34.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc58000f070 con 0x7fc59005c100 2021-11-15T19:35:34.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc57f7fe700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc56c053610 0x7fc56c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:34.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc58006b1f0 con 0x7fc59005c100 2021-11-15T19:35:34.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.698+0000 7fc58dd9b700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc56c053610 0x7fc56c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:34.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.702+0000 7fc58dd9b700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc56c053610 0x7fc56c055ad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fc5900ac050 tx=0x7fc584007860).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:34.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.702+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc5900a77a0 con 0x7fc59005c100 2021-11-15T19:35:34.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:34.810+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc5900a77a0 con 0x7fc59005c100 2021-11-15T19:35:35.144 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:35:35.137+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:35:35.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.142+0000 7fc57f7fe700 1 -- 172.21.2.137:0/3282199292 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc5900a77a0 con 0x7fc59005c100 2021-11-15T19:35:35.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc56c053610 msgr2=0x7fc56c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc56c053610 0x7fc56c055ad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fc5900ac050 tx=0x7fc584007860).stop 2021-11-15T19:35:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 msgr2=0x7fc590064cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 0x7fc590064cb0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fc580002f90 tx=0x7fc580006df0).stop 2021-11-15T19:35:35.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 shutdown_connections 2021-11-15T19:35:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc56c053610 0x7fc56c055ad0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc5900acb60 0x7fc59015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc59005cdd0 0x7fc590159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 --2- 172.21.2.137:0/3282199292 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc59005c100 0x7fc590064cb0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:35.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 >> 172.21.2.137:0/3282199292 conn(0x7fc5900b5010 msgr2=0x7fc590145980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 shutdown_connections 2021-11-15T19:35:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.146+0000 7fc594cff700 1 -- 172.21.2.137:0/3282199292 wait complete. 2021-11-15T19:35:35.159 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:35:35.163 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:35.171 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:35:35.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.202+0000 7fe57f977700 1 Processor -- start 2021-11-15T19:35:35.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.202+0000 7fe57f977700 1 -- start start 2021-11-15T19:35:35.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.202+0000 7fe57f977700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe578067570 0x7fe5781406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57813fd00 con 0x7fe578143b50 2021-11-15T19:35:35.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57813ffa0 con 0x7fe5780b0c60 2021-11-15T19:35:35.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe578140240 con 0x7fe578067570 2021-11-15T19:35:35.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57df14700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe578067570 0x7fe5781406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:35.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe5780b0c60 0x7fe5780ac450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59038/0 (socket says 172.21.2.137:59038) 2021-11-15T19:35:35.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 -- 172.21.2.137:0/659724379 learned_addr learned my addr 172.21.2.137:0/659724379 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:35.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57df14700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe578067570 0x7fe5781406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40254/0 (socket says 172.21.2.137:40254) 2021-11-15T19:35:35.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57df14700 1 -- 172.21.2.137:0/659724379 >> v1:172.21.2.137:6789/0 conn(0x7fe5780b0c60 legacy=0x7fe5780ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57df14700 1 -- 172.21.2.137:0/659724379 >> v1:172.21.2.111:6789/0 conn(0x7fe578143b50 legacy=0x7fe57813ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:35.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe567fff700 1 -- 172.21.2.137:0/659724379 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720402739 0 0) 0x7fe57813ffa0 con 0x7fe5780b0c60 2021-11-15T19:35:35.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57df14700 1 -- 172.21.2.137:0/659724379 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780b1040 con 0x7fe578067570 2021-11-15T19:35:35.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57df14700 1 --2- 172.21.2.137:0/659724379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5781406e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fe578062c60 tx=0x7fe57000b460).ready entity=mon.1 client_cookie=d749f226924d1ff3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:35.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe567fff700 1 -- 172.21.2.137:0/659724379 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57000dd60 con 0x7fe578067570 2021-11-15T19:35:35.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe567fff700 1 -- 172.21.2.137:0/659724379 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570010470 con 0x7fe578067570 2021-11-15T19:35:35.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe567fff700 1 -- 172.21.2.137:0/659724379 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5700107d0 con 0x7fe578067570 2021-11-15T19:35:35.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/659724379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 msgr2=0x7fe5781406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 --2- 172.21.2.137:0/659724379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5781406e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fe578062c60 tx=0x7fe57000b460).stop 2021-11-15T19:35:35.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/659724379 shutdown_connections 2021-11-15T19:35:35.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 --2- 172.21.2.137:0/659724379 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5781406e0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:35.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/659724379 >> 172.21.2.137:0/659724379 conn(0x7fe5780b5010 msgr2=0x7fe5780b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:35.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/659724379 shutdown_connections 2021-11-15T19:35:35.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/659724379 wait complete. 2021-11-15T19:35:35.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 Processor -- start 2021-11-15T19:35:35.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- start start 2021-11-15T19:35:35.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5780aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5780b0c60 0x7fe5780a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe578143b50 0x7fe578156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe578132e60 con 0x7fe578143b50 2021-11-15T19:35:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780a9f20 con 0x7fe578067570 2021-11-15T19:35:35.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780aa1a0 con 0x7fe5780b0c60 2021-11-15T19:35:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5780aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5780aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40260/0 (socket says 172.21.2.137:40260) 2021-11-15T19:35:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 -- 172.21.2.137:0/426507211 learned_addr learned my addr 172.21.2.137:0/426507211 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 -- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5780b0c60 msgr2=0x7fe5780a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5780b0c60 0x7fe5780a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 -- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe578143b50 msgr2=0x7fe578156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe578143b50 0x7fe578156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 -- 172.21.2.137:0/426507211 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57000b700 con 0x7fe578067570 2021-11-15T19:35:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57d713700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5780aab80 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fe574000ed0 tx=0x7fe574007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:35.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57400ce50 con 0x7fe578067570 2021-11-15T19:35:35.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740072e0 con 0x7fe578067570 2021-11-15T19:35:35.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5780aa440 con 0x7fe578067570 2021-11-15T19:35:35.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe574005610 con 0x7fe578067570 2021-11-15T19:35:35.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.206+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5780a7360 con 0x7fe578067570 2021-11-15T19:35:35.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5780aa8e0 con 0x7fe578067570 2021-11-15T19:35:35.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe57401a060 con 0x7fe578067570 2021-11-15T19:35:35.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe5667fc700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe558053660 0x7fe558055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fe57406b2a0 con 0x7fe578067570 2021-11-15T19:35:35.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe57cf12700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe558053660 0x7fe558055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:35.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe57cf12700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe558053660 0x7fe558055b20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fe568002f10 tx=0x7fe568006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:35.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.210+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5780aa8e0 con 0x7fe578067570 2021-11-15T19:35:35.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5780aa8e0 con 0x7fe578067570 2021-11-15T19:35:35.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe5667fc700 1 -- 172.21.2.137:0/426507211 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fe5780aa8e0 con 0x7fe578067570 2021-11-15T19:35:35.333 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:35.334 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":69,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:16.433090+0000","modified":"2021-11-15T19:35:35.140955+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T19:35:35.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe558053660 msgr2=0x7fe558055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe558053660 0x7fe558055b20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fe568002f10 tx=0x7fe568006930).stop 2021-11-15T19:35:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 msgr2=0x7fe5780aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5780aab80 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fe574000ed0 tx=0x7fe574007ac0).stop 2021-11-15T19:35:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 shutdown_connections 2021-11-15T19:35:35.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe558053660 0x7fe558055b20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe578143b50 0x7fe578156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe5780b0c60 0x7fe5780a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 --2- 172.21.2.137:0/426507211 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe578067570 0x7fe5780aab80 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 >> 172.21.2.137:0/426507211 conn(0x7fe5780b5010 msgr2=0x7fe5780ac450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:35.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 shutdown_connections 2021-11-15T19:35:35.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.322+0000 7fe57f977700 1 -- 172.21.2.137:0/426507211 wait complete. 2021-11-15T19:35:35.337 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 69 2021-11-15T19:35:35.341 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:35:35.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.422+0000 7f81e7e98700 1 Processor -- start 2021-11-15T19:35:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.422+0000 7f81e7e98700 1 -- start start 2021-11-15T19:35:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.422+0000 7f81e7e98700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f81e00acb60 0x7f81e0147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.422+0000 7f81e7e98700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00af3b0 con 0x7f81e005c100 2021-11-15T19:35:35.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.422+0000 7f81e7e98700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e01471c0 con 0x7f81e005cdd0 2021-11-15T19:35:35.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.422+0000 7f81e7e98700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00ad900 con 0x7f81e00acb60 2021-11-15T19:35:35.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e6435700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f81e005cdd0 0x7f81e0143ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59052/0 (socket says 172.21.2.137:59052) 2021-11-15T19:35:35.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e6435700 1 -- 172.21.2.137:0/3872520115 learned_addr learned my addr 172.21.2.137:0/3872520115 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:35.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766858996 0 0) 0x7f81e01471c0 con 0x7f81e005cdd0 2021-11-15T19:35:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8003260 con 0x7f81e005cdd0 2021-11-15T19:35:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76798167 0 0) 0x7f81c8003260 con 0x7f81e005cdd0 2021-11-15T19:35:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 >> v2:172.21.2.111:3300/0 conn(0x7f81e00acb60 msgr2=0x7f81e0147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:35.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 --2- 172.21.2.137:0/3872520115 >> v2:172.21.2.111:3300/0 conn(0x7f81e00acb60 0x7f81e0147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 >> v1:172.21.2.111:6789/0 conn(0x7f81e005c100 legacy=0x7f81e00ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0147460 con 0x7f81e005cdd0 2021-11-15T19:35:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f81d8001a30 con 0x7f81e005cdd0 2021-11-15T19:35:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 >> v1:172.21.2.137:6789/0 conn(0x7f81e005cdd0 legacy=0x7f81e0143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81c8003850 0x7f81c8003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81c8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81c80050c0 0x7f81c800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00ad900 con 0x7f81c8003850 2021-11-15T19:35:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800c000 con 0x7f81c8004500 2021-11-15T19:35:35.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800c1c0 con 0x7f81c80050c0 2021-11-15T19:35:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81c8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 -- 172.21.2.137:0/3872520115 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81c80050c0 msgr2=0x7f81c800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81c80050c0 0x7f81c800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 -- 172.21.2.137:0/3872520115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81c8003850 msgr2=0x7f81c8003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81c8003850 0x7f81c8003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 -- 172.21.2.137:0/3872520115 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8003260 con 0x7f81c8004500 2021-11-15T19:35:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e6435700 1 -- 172.21.2.137:0/3872520115 reap_dead start 2021-11-15T19:35:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5433700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81c8004980 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f81dc002f70 tx=0x7f81dc006ca0).ready entity=mon.1 client_cookie=bbf5c46a18901447 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:35.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc012410 con 0x7f81c8004500 2021-11-15T19:35:35.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc012570 con 0x7f81c8004500 2021-11-15T19:35:35.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e4c32700 1 -- 172.21.2.137:0/3872520115 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc0128d0 con 0x7f81c8004500 2021-11-15T19:35:35.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- 172.21.2.137:0/3872520115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 msgr2=0x7f81c8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81c8004980 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f81dc002f70 tx=0x7f81dc006ca0).stop 2021-11-15T19:35:35.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- 172.21.2.137:0/3872520115 shutdown_connections 2021-11-15T19:35:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 --2- 172.21.2.137:0/3872520115 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81c8004980 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- 172.21.2.137:0/3872520115 >> 172.21.2.137:0/3872520115 conn(0x7f81e00b5010 msgr2=0x7f81e00b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- 172.21.2.137:0/3872520115 shutdown_connections 2021-11-15T19:35:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- 172.21.2.137:0/3872520115 wait complete. 2021-11-15T19:35:35.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 Processor -- start 2021-11-15T19:35:35.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- start start 2021-11-15T19:35:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81e00b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81e00658c0 0x7f81e0156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81e0067480 0x7f81e0156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0067050 con 0x7f81e0067480 2021-11-15T19:35:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00649c0 con 0x7f81c8004500 2021-11-15T19:35:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e7e98700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0064c60 con 0x7f81e00658c0 2021-11-15T19:35:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5c34700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81e00b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:35.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5c34700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81e00b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40284/0 (socket says 172.21.2.137:40284) 2021-11-15T19:35:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.426+0000 7f81e5c34700 1 -- 172.21.2.137:0/4154320349 learned_addr learned my addr 172.21.2.137:0/4154320349 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5c34700 1 -- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81e00658c0 msgr2=0x7f81e0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5c34700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81e00658c0 0x7f81e0156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5c34700 1 -- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81e0067480 msgr2=0x7f81e0156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:35.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5c34700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81e0067480 0x7f81e0156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5c34700 1 -- 172.21.2.137:0/4154320349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e014d0b0 con 0x7f81c8004500 2021-11-15T19:35:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5c34700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81e00b4110 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f81d4000f70 tx=0x7f81d4006d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d4012410 con 0x7f81c8004500 2021-11-15T19:35:35.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4012570 con 0x7f81c8004500 2021-11-15T19:35:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e0063e10 con 0x7f81c8004500 2021-11-15T19:35:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d40128d0 con 0x7f81c8004500 2021-11-15T19:35:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e0156db0 con 0x7f81c8004500 2021-11-15T19:35:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e00671c0 con 0x7f81c8004500 2021-11-15T19:35:35.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f81d400f030 con 0x7f81c8004500 2021-11-15T19:35:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81d2ffd700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81c00536f0 0x7f81c0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f81d406b6a0 con 0x7f81c8004500 2021-11-15T19:35:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5433700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81c00536f0 0x7f81c0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.430+0000 7f81e5433700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81c00536f0 0x7f81c0055bb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f81dc002f70 tx=0x7f81dc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:35.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.434+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81e00671c0 con 0x7f81c8004500 2021-11-15T19:35:35.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:35.542+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f81e00671c0 con 0x7f81c8004500 2021-11-15T19:35:36.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81d2ffd700 1 -- 172.21.2.137:0/4154320349 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f81e00671c0 con 0x7f81c8004500 2021-11-15T19:35:36.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81c00536f0 msgr2=0x7f81c0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:36.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81c00536f0 0x7f81c0055bb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f81dc002f70 tx=0x7f81dc015000).stop 2021-11-15T19:35:36.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 msgr2=0x7f81e00b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:36.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81e00b4110 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f81d4000f70 tx=0x7f81d4006d10).stop 2021-11-15T19:35:36.166 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 shutdown_connections 2021-11-15T19:35:36.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f81c00536f0 0x7f81c0055bb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:36.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81e0067480 0x7f81e0156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:36.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81e00658c0 0x7f81e0156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:36.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 --2- 172.21.2.137:0/4154320349 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81c8004500 0x7f81e00b4110 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:36.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 >> 172.21.2.137:0/4154320349 conn(0x7f81e00b5010 msgr2=0x7f81e014ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:36.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 shutdown_connections 2021-11-15T19:35:36.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.154+0000 7f81e7e98700 1 -- 172.21.2.137:0/4154320349 wait complete. 2021-11-15T19:35:36.174 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:35:36.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 Processor -- start 2021-11-15T19:35:36.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 -- start start 2021-11-15T19:35:36.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa6300b21b0 0x7fa6300af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:36.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa6301466d0 0x7fa630146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:36.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63009af50 con 0x7fa63005f730 2021-11-15T19:35:36.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa630098740 con 0x7fa6301466d0 2021-11-15T19:35:36.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62f59e700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa630147010 con 0x7fa6300b21b0 2021-11-15T19:35:36.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62ed9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa63005f730 0x7fa63005fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59076/0 (socket says 172.21.2.137:59076) 2021-11-15T19:35:36.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62ed9d700 1 -- 172.21.2.137:0/818624280 learned_addr learned my addr 172.21.2.137:0/818624280 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:36.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.214+0000 7fa62e59c700 1 --2- 172.21.2.137:0/818624280 >> v2:172.21.2.137:3300/0 conn(0x7fa6300b21b0 0x7fa6300af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:36.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62d59a700 1 -- 172.21.2.137:0/818624280 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301263285 0 0) 0x7fa63009af50 con 0x7fa63005f730 2021-11-15T19:35:36.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62d59a700 1 -- 172.21.2.137:0/818624280 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa614003260 con 0x7fa63005f730 2021-11-15T19:35:36.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62e59c700 1 -- 172.21.2.137:0/818624280 >> v2:172.21.2.111:3300/0 conn(0x7fa6301466d0 msgr2=0x7fa630146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:36.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62e59c700 1 --2- 172.21.2.137:0/818624280 >> v2:172.21.2.111:3300/0 conn(0x7fa6301466d0 0x7fa630146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:36.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62e59c700 1 -- 172.21.2.137:0/818624280 >> v1:172.21.2.137:6789/0 conn(0x7fa63005f730 legacy=0x7fa63005fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:36.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62e59c700 1 -- 172.21.2.137:0/818624280 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63014b170 con 0x7fa6300b21b0 2021-11-15T19:35:36.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62e59c700 1 --2- 172.21.2.137:0/818624280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa6300af800 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fa620002f70 tx=0x7fa620006df0).ready entity=mon.1 client_cookie=1322ab45c5aaa984 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:36.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62d59a700 1 -- 172.21.2.137:0/818624280 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62000d570 con 0x7fa6300b21b0 2021-11-15T19:35:36.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62d59a700 1 -- 172.21.2.137:0/818624280 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620000e90 con 0x7fa6300b21b0 2021-11-15T19:35:36.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62d59a700 1 -- 172.21.2.137:0/818624280 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62000d8c0 con 0x7fa6300b21b0 2021-11-15T19:35:36.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/818624280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 msgr2=0x7fa6300af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:36.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 --2- 172.21.2.137:0/818624280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa6300af800 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fa620002f70 tx=0x7fa620006df0).stop 2021-11-15T19:35:36.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/818624280 shutdown_connections 2021-11-15T19:35:36.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 --2- 172.21.2.137:0/818624280 >> v2:172.21.2.111:3300/0 conn(0x7fa6301466d0 0x7fa630146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:36.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 --2- 172.21.2.137:0/818624280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa6300af800 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:36.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/818624280 >> 172.21.2.137:0/818624280 conn(0x7fa6300b58d0 msgr2=0x7fa6300b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:36.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/818624280 shutdown_connections 2021-11-15T19:35:36.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/818624280 wait complete. 2021-11-15T19:35:36.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 Processor -- start 2021-11-15T19:35:36.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- start start 2021-11-15T19:35:36.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa63005f730 0x7fa6301594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:36.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa630064990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:36.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6301466d0 0x7fa630066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:36.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa630065180 con 0x7fa6301466d0 2021-11-15T19:35:36.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa630065650 con 0x7fa6300b21b0 2021-11-15T19:35:36.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6301599a0 con 0x7fa63005f730 2021-11-15T19:35:36.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa630064990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:36.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa630064990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40298/0 (socket says 172.21.2.137:40298) 2021-11-15T19:35:36.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 -- 172.21.2.137:0/3438891968 learned_addr learned my addr 172.21.2.137:0/3438891968 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:36.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 -- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa63005f730 msgr2=0x7fa6301594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:36.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa63005f730 0x7fa6301594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:36.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 -- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6301466d0 msgr2=0x7fa630066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:36.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6301466d0 0x7fa630066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:36.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 -- 172.21.2.137:0/3438891968 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62000b180 con 0x7fa6300b21b0 2021-11-15T19:35:36.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62dd9b700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa630064990 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fa6300aca90 tx=0x7fa624006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:36.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa624013460 con 0x7fa6300b21b0 2021-11-15T19:35:36.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6240135c0 con 0x7fa6300b21b0 2021-11-15T19:35:36.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa624013920 con 0x7fa6300b21b0 2021-11-15T19:35:36.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6300653b0 con 0x7fa6300b21b0 2021-11-15T19:35:36.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.218+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6300acd70 con 0x7fa6300b21b0 2021-11-15T19:35:36.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6300adb60 con 0x7fa6300b21b0 2021-11-15T19:35:36.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa62401a060 con 0x7fa6300b21b0 2021-11-15T19:35:36.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa61f7fe700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa60c0535d0 0x7fa60c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fa62406b460 con 0x7fa6300b21b0 2021-11-15T19:35:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa62e59c700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa60c0535d0 0x7fa60c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa62e59c700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa60c0535d0 0x7fa60c055a90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa620002f70 tx=0x7fa620014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:36.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.222+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6300adb60 con 0x7fa6300b21b0 2021-11-15T19:35:36.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:36.306+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6300adb60 con 0x7fa6300b21b0 2021-11-15T19:35:37.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa61f7fe700 1 -- 172.21.2.137:0/3438891968 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa6300adb60 con 0x7fa6300b21b0 2021-11-15T19:35:37.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa60c0535d0 msgr2=0x7fa60c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa60c0535d0 0x7fa60c055a90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa620002f70 tx=0x7fa620014000).stop 2021-11-15T19:35:37.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 msgr2=0x7fa630064990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa630064990 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fa6300aca90 tx=0x7fa624006e20).stop 2021-11-15T19:35:37.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 shutdown_connections 2021-11-15T19:35:37.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa60c0535d0 0x7fa60c055a90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:37.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa6301466d0 0x7fa630066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:37.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa6300b21b0 0x7fa630064990 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:37.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 --2- 172.21.2.137:0/3438891968 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa63005f730 0x7fa6301594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:37.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 >> 172.21.2.137:0/3438891968 conn(0x7fa6300b58d0 msgr2=0x7fa6300b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:37.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 shutdown_connections 2021-11-15T19:35:37.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.174+0000 7fa62f59e700 1 -- 172.21.2.137:0/3438891968 wait complete. 2021-11-15T19:35:37.188 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:35:37.192 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:35:37.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 Processor -- start 2021-11-15T19:35:37.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- start start 2021-11-15T19:35:37.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f03c40ab8b0 0x7f03c4146d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:37.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c405c4e0 con 0x7f03c40afeb0 2021-11-15T19:35:37.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40afbd0 con 0x7f03c405c100 2021-11-15T19:35:37.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c414a730 con 0x7f03c40ab8b0 2021-11-15T19:35:37.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c37fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f03c405c100 0x7f03c414b060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59086/0 (socket says 172.21.2.137:59086) 2021-11-15T19:35:37.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c37fe700 1 -- 172.21.2.137:0/2929909978 learned_addr learned my addr 172.21.2.137:0/2929909978 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:37.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c3fff700 1 --2- 172.21.2.137:0/2929909978 >> v2:172.21.2.111:3300/0 conn(0x7f03c40ab8b0 0x7f03c4146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:37.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c27fc700 1 -- 172.21.2.137:0/2929909978 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871630319 0 0) 0x7f03c40afbd0 con 0x7f03c405c100 2021-11-15T19:35:37.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c27fc700 1 -- 172.21.2.137:0/2929909978 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a4003260 con 0x7f03c405c100 2021-11-15T19:35:37.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c27fc700 1 -- 172.21.2.137:0/2929909978 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3552325415 0 0) 0x7f03a4003260 con 0x7f03c405c100 2021-11-15T19:35:37.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c3fff700 1 -- 172.21.2.137:0/2929909978 >> v1:172.21.2.137:6789/0 conn(0x7f03c405c100 legacy=0x7f03c414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c3fff700 1 -- 172.21.2.137:0/2929909978 >> v1:172.21.2.111:6789/0 conn(0x7f03c40afeb0 legacy=0x7f03c4146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c3fff700 1 -- 172.21.2.137:0/2929909978 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c414a920 con 0x7f03c40ab8b0 2021-11-15T19:35:37.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c3fff700 1 --2- 172.21.2.137:0/2929909978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c40ab8b0 0x7f03c4146d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f03b4001800 tx=0x7f03bc0091d0).ready entity=mon.0 client_cookie=72a02f419a7deb41 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:37.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c27fc700 1 -- 172.21.2.137:0/2929909978 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03b4001660 con 0x7f03c40ab8b0 2021-11-15T19:35:37.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c27fc700 1 -- 172.21.2.137:0/2929909978 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00b580 con 0x7f03c40ab8b0 2021-11-15T19:35:37.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03c27fc700 1 -- 172.21.2.137:0/2929909978 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc00b6f0 con 0x7f03c40ab8b0 2021-11-15T19:35:37.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- 172.21.2.137:0/2929909978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c40ab8b0 msgr2=0x7f03c4146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/2929909978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c40ab8b0 0x7f03c4146d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f03b4001800 tx=0x7f03bc0091d0).stop 2021-11-15T19:35:37.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- 172.21.2.137:0/2929909978 shutdown_connections 2021-11-15T19:35:37.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/2929909978 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c40ab8b0 0x7f03c4146d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:37.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- 172.21.2.137:0/2929909978 >> 172.21.2.137:0/2929909978 conn(0x7f03c40b5000 msgr2=0x7f03c40b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:37.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- 172.21.2.137:0/2929909978 shutdown_connections 2021-11-15T19:35:37.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.234+0000 7f03ca1fb700 1 -- 172.21.2.137:0/2929909978 wait complete. 2021-11-15T19:35:37.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 Processor -- start 2021-11-15T19:35:37.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- start start 2021-11-15T19:35:37.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c405c100 0x7f03c40651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:37.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 0x7f03c40aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:37.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03c40afeb0 0x7f03c4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:37.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4159ad0 con 0x7f03c405c100 2021-11-15T19:35:37.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4064290 con 0x7f03c40ab8b0 2021-11-15T19:35:37.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4064530 con 0x7f03c40afeb0 2021-11-15T19:35:37.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 0x7f03c40aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:37.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 0x7f03c40aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40314/0 (socket says 172.21.2.137:40314) 2021-11-15T19:35:37.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 -- 172.21.2.137:0/1374165040 learned_addr learned my addr 172.21.2.137:0/1374165040 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:37.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c37fe700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c405c100 0x7f03c40651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:37.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c3fff700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03c40afeb0 0x7f03c4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:37.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 -- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03c40afeb0 msgr2=0x7f03c4159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03c40afeb0 0x7f03c4159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:37.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 -- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c405c100 msgr2=0x7f03c40651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:37.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c405c100 0x7f03c40651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:37.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 -- 172.21.2.137:0/1374165040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc009470 con 0x7f03c40ab8b0 2021-11-15T19:35:37.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c37fe700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c405c100 0x7f03c40651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:37.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c2ffd700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 0x7f03c40aeeb0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f03c40b5c60 tx=0x7f03ac007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:37.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac00ce30 con 0x7f03c40ab8b0 2021-11-15T19:35:37.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac00f470 con 0x7f03c40ab8b0 2021-11-15T19:35:37.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c40ae020 con 0x7f03c40ab8b0 2021-11-15T19:35:37.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac00f7d0 con 0x7f03c40ab8b0 2021-11-15T19:35:37.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c4063f30 con 0x7f03c40ab8b0 2021-11-15T19:35:37.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c4159c40 con 0x7f03c40ab8b0 2021-11-15T19:35:37.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f03ac010070 con 0x7f03c40ab8b0 2021-11-15T19:35:37.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c0ff9700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f03a80534f0 0x7f03a80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:37.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f03ac06a890 con 0x7f03c40ab8b0 2021-11-15T19:35:37.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c37fe700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f03a80534f0 0x7f03a80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:37.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.238+0000 7f03c37fe700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f03a80534f0 0x7f03a80559b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f03b400b000 tx=0x7f03b40018d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:37.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.242+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03c4159c40 con 0x7f03c40ab8b0 2021-11-15T19:35:37.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:37.326+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03c4159c40 con 0x7f03c40ab8b0 2021-11-15T19:35:38.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03c0ff9700 1 -- 172.21.2.137:0/1374165040 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) v1 ==== 173+0+0 (secure 0 0 0) 0x7f03c4159c40 con 0x7f03c40ab8b0 2021-11-15T19:35:38.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f03a80534f0 msgr2=0x7f03a80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f03a80534f0 0x7f03a80559b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f03b400b000 tx=0x7f03b40018d0).stop 2021-11-15T19:35:38.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 msgr2=0x7f03c40aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 0x7f03c40aeeb0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f03c40b5c60 tx=0x7f03ac007c50).stop 2021-11-15T19:35:38.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 shutdown_connections 2021-11-15T19:35:38.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f03a80534f0 0x7f03a80559b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f03c40afeb0 0x7f03c4159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f03c40ab8b0 0x7f03c40aeeb0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 --2- 172.21.2.137:0/1374165040 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f03c405c100 0x7f03c40651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 >> 172.21.2.137:0/1374165040 conn(0x7f03c40b5000 msgr2=0x7f03c4146880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:38.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 shutdown_connections 2021-11-15T19:35:38.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.186+0000 7f03ca1fb700 1 -- 172.21.2.137:0/1374165040 wait complete. 2021-11-15T19:35:38.202 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:35:38.206 DEBUG:teuthology.orchestra.run.gibba011:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:38.209 DEBUG:teuthology.orchestra.run.gibba017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:38.212 DEBUG:teuthology.orchestra.run.gibba018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:38.216 DEBUG:teuthology.orchestra.run.gibba031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:38.219 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T19:35:38.223 INFO:teuthology.orchestra.run.gibba011.stdout:[global] 2021-11-15T19:35:38.223 INFO:teuthology.orchestra.run.gibba011.stdout: chdir = "" 2021-11-15T19:35:38.224 INFO:teuthology.orchestra.run.gibba011.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:38.224 INFO:teuthology.orchestra.run.gibba011.stdout: auth supported = cephx 2021-11-15T19:35:38.224 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.224 INFO:teuthology.orchestra.run.gibba011.stdout: filestore xattr use omap = true 2021-11-15T19:35:38.225 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.225 INFO:teuthology.orchestra.run.gibba011.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:38.225 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.225 INFO:teuthology.orchestra.run.gibba011.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:38.225 INFO:teuthology.orchestra.run.gibba011.stdout: auth debug = true 2021-11-15T19:35:38.226 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.226 INFO:teuthology.orchestra.run.gibba011.stdout: ms die on old message = true 2021-11-15T19:35:38.226 INFO:teuthology.orchestra.run.gibba011.stdout: ms die on bug = true 2021-11-15T19:35:38.226 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.227 INFO:teuthology.orchestra.run.gibba011.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:38.227 INFO:teuthology.orchestra.run.gibba011.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:38.227 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.227 INFO:teuthology.orchestra.run.gibba011.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:38.227 INFO:teuthology.orchestra.run.gibba011.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:38.228 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.228 INFO:teuthology.orchestra.run.gibba011.stdout: osd pool default size = 2 2021-11-15T19:35:38.228 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.228 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:38.228 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd allow pg remap = true 2021-11-15T19:35:38.229 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:38.229 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:38.229 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:38.229 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:38.230 INFO:teuthology.orchestra.run.gibba011.stdout: mon warn on too few osds = false 2021-11-15T19:35:38.230 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:38.230 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:38.230 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.230 INFO:teuthology.orchestra.run.gibba011.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:38.231 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.231 INFO:teuthology.orchestra.run.gibba011.stdout: osd default data pool replay window = 5 2021-11-15T19:35:38.231 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.231 INFO:teuthology.orchestra.run.gibba011.stdout: mon allow pool delete = true 2021-11-15T19:35:38.232 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.232 INFO:teuthology.orchestra.run.gibba011.stdout: mon cluster log file level = debug 2021-11-15T19:35:38.232 INFO:teuthology.orchestra.run.gibba011.stdout: debug asserts on shutdown = true 2021-11-15T19:35:38.232 INFO:teuthology.orchestra.run.gibba011.stdout: mon health detail to clog = false 2021-11-15T19:35:38.232 INFO:teuthology.orchestra.run.gibba011.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:38.233 INFO:teuthology.orchestra.run.gibba011.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:38.233 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.233 INFO:teuthology.orchestra.run.gibba011.stdout:[osd] 2021-11-15T19:35:38.233 INFO:teuthology.orchestra.run.gibba011.stdout: osd journal size = 100 2021-11-15T19:35:38.234 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.234 INFO:teuthology.orchestra.run.gibba011.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:38.234 INFO:teuthology.orchestra.run.gibba011.stdout: osd scrub max interval = 600 2021-11-15T19:35:38.234 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.234 INFO:teuthology.orchestra.run.gibba011.stdout: osd recover clone overlap = true 2021-11-15T19:35:38.235 INFO:teuthology.orchestra.run.gibba011.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:38.235 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.235 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug shutdown = true 2021-11-15T19:35:38.235 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug op order = true 2021-11-15T19:35:38.236 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:38.236 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.236 INFO:teuthology.orchestra.run.gibba011.stdout: osd open classes on start = true 2021-11-15T19:35:38.236 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug pg log writeout = true 2021-11-15T19:35:38.236 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.237 INFO:teuthology.orchestra.run.gibba011.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:38.237 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.237 INFO:teuthology.orchestra.run.gibba011.stdout: osd map max advance = 10 2021-11-15T19:35:38.237 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.237 INFO:teuthology.orchestra.run.gibba011.stdout: journal zero on create = true 2021-11-15T19:35:38.238 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.238 INFO:teuthology.orchestra.run.gibba011.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:38.238 INFO:teuthology.orchestra.run.gibba011.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:38.238 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.239 INFO:teuthology.orchestra.run.gibba011.stdout: bdev debug aio = true 2021-11-15T19:35:38.239 INFO:teuthology.orchestra.run.gibba011.stdout: osd debug misdirected ops = true 2021-11-15T19:35:38.239 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:38.239 INFO:teuthology.orchestra.run.gibba011.stdout: debug osd = 20 2021-11-15T19:35:38.239 INFO:teuthology.orchestra.run.gibba011.stdout: osd objectstore = filestore 2021-11-15T19:35:38.240 INFO:teuthology.orchestra.run.gibba011.stdout: osd op complaint time = 180 2021-11-15T19:35:38.240 INFO:teuthology.orchestra.run.gibba011.stdout: osd sloppy crc = True 2021-11-15T19:35:38.240 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.240 INFO:teuthology.orchestra.run.gibba011.stdout:[mgr] 2021-11-15T19:35:38.240 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:38.241 INFO:teuthology.orchestra.run.gibba011.stdout: debug mgr = 20 2021-11-15T19:35:38.241 INFO:teuthology.orchestra.run.gibba011.stdout: debug mon = 20 2021-11-15T19:35:38.241 INFO:teuthology.orchestra.run.gibba011.stdout: debug auth = 20 2021-11-15T19:35:38.241 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.242 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.242 INFO:teuthology.orchestra.run.gibba011.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:38.242 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.242 INFO:teuthology.orchestra.run.gibba011.stdout:[mon] 2021-11-15T19:35:38.242 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:38.243 INFO:teuthology.orchestra.run.gibba011.stdout: debug mon = 20 2021-11-15T19:35:38.243 INFO:teuthology.orchestra.run.gibba011.stdout: debug paxos = 20 2021-11-15T19:35:38.243 INFO:teuthology.orchestra.run.gibba011.stdout: debug auth = 20 2021-11-15T19:35:38.243 INFO:teuthology.orchestra.run.gibba011.stdout: mon data avail warn = 5 2021-11-15T19:35:38.244 INFO:teuthology.orchestra.run.gibba011.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:38.244 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.244 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:38.244 INFO:teuthology.orchestra.run.gibba011.stdout: mon osd prime pg temp = true 2021-11-15T19:35:38.244 INFO:teuthology.orchestra.run.gibba011.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.245 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.245 INFO:teuthology.orchestra.run.gibba011.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:38.245 INFO:teuthology.orchestra.run.gibba011.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:38.245 INFO:teuthology.orchestra.run.gibba011.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:38.245 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.246 INFO:teuthology.orchestra.run.gibba011.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:38.246 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:38.246 INFO:teuthology.orchestra.run.gibba011.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:38.246 INFO:teuthology.orchestra.run.gibba011.stdout: mon op complaint time = 120 2021-11-15T19:35:38.247 INFO:teuthology.orchestra.run.gibba011.stdout: 2021-11-15T19:35:38.247 INFO:teuthology.orchestra.run.gibba011.stdout:[client] 2021-11-15T19:35:38.247 INFO:teuthology.orchestra.run.gibba011.stdout: rgw cache enabled = true 2021-11-15T19:35:38.247 INFO:teuthology.orchestra.run.gibba011.stdout: rgw enable ops log = true 2021-11-15T19:35:38.247 INFO:teuthology.orchestra.run.gibba011.stdout: rgw enable usage log = true 2021-11-15T19:35:38.248 INFO:teuthology.orchestra.run.gibba011.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:38.248 INFO:teuthology.orchestra.run.gibba011.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:38.248 INFO:teuthology.orchestra.run.gibba011.stdout: client mount timeout = 600 2021-11-15T19:35:38.248 INFO:teuthology.orchestra.run.gibba011.stdout: debug client = 20 2021-11-15T19:35:38.248 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:38.249 INFO:teuthology.orchestra.run.gibba011.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.249 INFO:teuthology.orchestra.run.gibba011.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.249 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.a] 2021-11-15T19:35:38.249 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.b] 2021-11-15T19:35:38.250 INFO:teuthology.orchestra.run.gibba011.stdout:[mon.c] 2021-11-15T19:35:38.250 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.a] 2021-11-15T19:35:38.250 INFO:teuthology.orchestra.run.gibba011.stdout:[mds.b] 2021-11-15T19:35:38.250 INFO:teuthology.orchestra.run.gibba011.stdout:[mds] 2021-11-15T19:35:38.250 INFO:teuthology.orchestra.run.gibba011.stdout: debug mds = 20 2021-11-15T19:35:38.251 INFO:teuthology.orchestra.run.gibba011.stdout: debug ms = 1 2021-11-15T19:35:38.251 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal frag = True 2021-11-15T19:35:38.251 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:38.251 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal merge size = 5 2021-11-15T19:35:38.252 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal split bits = 3 2021-11-15T19:35:38.252 INFO:teuthology.orchestra.run.gibba011.stdout: mds bal split size = 100 2021-11-15T19:35:38.252 INFO:teuthology.orchestra.run.gibba011.stdout: mds debug frag = True 2021-11-15T19:35:38.252 INFO:teuthology.orchestra.run.gibba011.stdout: mds debug scatterstat = True 2021-11-15T19:35:38.252 INFO:teuthology.orchestra.run.gibba011.stdout: mds op complaint time = 180 2021-11-15T19:35:38.253 INFO:teuthology.orchestra.run.gibba011.stdout: mds verify scatter = True 2021-11-15T19:35:38.253 INFO:teuthology.orchestra.run.gibba011.stdout: osd op complaint time = 180 2021-11-15T19:35:38.253 INFO:teuthology.orchestra.run.gibba011.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.253 INFO:teuthology.orchestra.run.gibba011.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.257 INFO:teuthology.orchestra.run.gibba031.stdout:[global] 2021-11-15T19:35:38.257 INFO:teuthology.orchestra.run.gibba031.stdout: chdir = "" 2021-11-15T19:35:38.257 INFO:teuthology.orchestra.run.gibba031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:38.257 INFO:teuthology.orchestra.run.gibba031.stdout: auth supported = cephx 2021-11-15T19:35:38.258 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.258 INFO:teuthology.orchestra.run.gibba031.stdout: filestore xattr use omap = true 2021-11-15T19:35:38.258 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.258 INFO:teuthology.orchestra.run.gibba031.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:38.259 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.259 INFO:teuthology.orchestra.run.gibba031.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:38.259 INFO:teuthology.orchestra.run.gibba031.stdout: auth debug = true 2021-11-15T19:35:38.259 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.259 INFO:teuthology.orchestra.run.gibba031.stdout: ms die on old message = true 2021-11-15T19:35:38.260 INFO:teuthology.orchestra.run.gibba031.stdout: ms die on bug = true 2021-11-15T19:35:38.260 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.260 INFO:teuthology.orchestra.run.gibba031.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:38.260 INFO:teuthology.orchestra.run.gibba031.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:38.261 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.261 INFO:teuthology.orchestra.run.gibba031.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:38.261 INFO:teuthology.orchestra.run.gibba031.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:38.261 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.261 INFO:teuthology.orchestra.run.gibba031.stdout: osd pool default size = 2 2021-11-15T19:35:38.262 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.262 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:38.262 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd allow pg remap = true 2021-11-15T19:35:38.262 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:38.263 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:38.263 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:38.263 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:38.263 INFO:teuthology.orchestra.run.gibba031.stdout: mon warn on too few osds = false 2021-11-15T19:35:38.263 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:38.264 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:38.264 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.264 INFO:teuthology.orchestra.run.gibba031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:38.264 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.264 INFO:teuthology.orchestra.run.gibba031.stdout: osd default data pool replay window = 5 2021-11-15T19:35:38.265 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.265 INFO:teuthology.orchestra.run.gibba031.stdout: mon allow pool delete = true 2021-11-15T19:35:38.265 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.265 INFO:teuthology.orchestra.run.gibba031.stdout: mon cluster log file level = debug 2021-11-15T19:35:38.266 INFO:teuthology.orchestra.run.gibba031.stdout: debug asserts on shutdown = true 2021-11-15T19:35:38.266 INFO:teuthology.orchestra.run.gibba031.stdout: mon health detail to clog = false 2021-11-15T19:35:38.266 INFO:teuthology.orchestra.run.gibba031.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:38.266 INFO:teuthology.orchestra.run.gibba031.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:38.266 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.267 INFO:teuthology.orchestra.run.gibba031.stdout:[osd] 2021-11-15T19:35:38.267 INFO:teuthology.orchestra.run.gibba031.stdout: osd journal size = 100 2021-11-15T19:35:38.267 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.267 INFO:teuthology.orchestra.run.gibba031.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:38.268 INFO:teuthology.orchestra.run.gibba031.stdout: osd scrub max interval = 600 2021-11-15T19:35:38.268 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.268 INFO:teuthology.orchestra.run.gibba031.stdout: osd recover clone overlap = true 2021-11-15T19:35:38.268 INFO:teuthology.orchestra.run.gibba031.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:38.268 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.269 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug shutdown = true 2021-11-15T19:35:38.269 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug op order = true 2021-11-15T19:35:38.269 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:38.269 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.270 INFO:teuthology.orchestra.run.gibba031.stdout: osd open classes on start = true 2021-11-15T19:35:38.270 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug pg log writeout = true 2021-11-15T19:35:38.270 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.270 INFO:teuthology.orchestra.run.gibba031.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:38.271 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.271 INFO:teuthology.orchestra.run.gibba031.stdout: osd map max advance = 10 2021-11-15T19:35:38.271 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.271 INFO:teuthology.orchestra.run.gibba031.stdout: journal zero on create = true 2021-11-15T19:35:38.271 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.272 INFO:teuthology.orchestra.run.gibba031.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:38.272 INFO:teuthology.orchestra.run.gibba031.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:38.272 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.272 INFO:teuthology.orchestra.run.gibba031.stdout: bdev debug aio = true 2021-11-15T19:35:38.273 INFO:teuthology.orchestra.run.gibba031.stdout: osd debug misdirected ops = true 2021-11-15T19:35:38.273 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:38.273 INFO:teuthology.orchestra.run.gibba031.stdout: debug osd = 20 2021-11-15T19:35:38.273 INFO:teuthology.orchestra.run.gibba031.stdout: osd objectstore = filestore 2021-11-15T19:35:38.273 INFO:teuthology.orchestra.run.gibba031.stdout: osd op complaint time = 180 2021-11-15T19:35:38.274 INFO:teuthology.orchestra.run.gibba031.stdout: osd sloppy crc = True 2021-11-15T19:35:38.274 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.274 INFO:teuthology.orchestra.run.gibba031.stdout:[mgr] 2021-11-15T19:35:38.274 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:38.275 INFO:teuthology.orchestra.run.gibba031.stdout: debug mgr = 20 2021-11-15T19:35:38.275 INFO:teuthology.orchestra.run.gibba031.stdout: debug mon = 20 2021-11-15T19:35:38.275 INFO:teuthology.orchestra.run.gibba031.stdout: debug auth = 20 2021-11-15T19:35:38.275 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.275 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.276 INFO:teuthology.orchestra.run.gibba031.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:38.276 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.276 INFO:teuthology.orchestra.run.gibba031.stdout:[mon] 2021-11-15T19:35:38.276 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:38.277 INFO:teuthology.orchestra.run.gibba031.stdout: debug mon = 20 2021-11-15T19:35:38.277 INFO:teuthology.orchestra.run.gibba031.stdout: debug paxos = 20 2021-11-15T19:35:38.277 INFO:teuthology.orchestra.run.gibba031.stdout: debug auth = 20 2021-11-15T19:35:38.277 INFO:teuthology.orchestra.run.gibba031.stdout: mon data avail warn = 5 2021-11-15T19:35:38.277 INFO:teuthology.orchestra.run.gibba031.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:38.278 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.278 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:38.278 INFO:teuthology.orchestra.run.gibba031.stdout: mon osd prime pg temp = true 2021-11-15T19:35:38.278 INFO:teuthology.orchestra.run.gibba031.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.279 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.279 INFO:teuthology.orchestra.run.gibba031.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:38.279 INFO:teuthology.orchestra.run.gibba031.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:38.279 INFO:teuthology.orchestra.run.gibba031.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:38.279 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.280 INFO:teuthology.orchestra.run.gibba031.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:38.280 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:38.280 INFO:teuthology.orchestra.run.gibba031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:38.280 INFO:teuthology.orchestra.run.gibba031.stdout: mon op complaint time = 120 2021-11-15T19:35:38.281 INFO:teuthology.orchestra.run.gibba031.stdout: 2021-11-15T19:35:38.281 INFO:teuthology.orchestra.run.gibba031.stdout:[client] 2021-11-15T19:35:38.281 INFO:teuthology.orchestra.run.gibba031.stdout: rgw cache enabled = true 2021-11-15T19:35:38.281 INFO:teuthology.orchestra.run.gibba031.stdout: rgw enable ops log = true 2021-11-15T19:35:38.281 INFO:teuthology.orchestra.run.gibba031.stdout: rgw enable usage log = true 2021-11-15T19:35:38.282 INFO:teuthology.orchestra.run.gibba031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:38.282 INFO:teuthology.orchestra.run.gibba031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:38.282 INFO:teuthology.orchestra.run.gibba031.stdout: client mount timeout = 600 2021-11-15T19:35:38.282 INFO:teuthology.orchestra.run.gibba031.stdout: debug client = 20 2021-11-15T19:35:38.283 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:38.283 INFO:teuthology.orchestra.run.gibba031.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.283 INFO:teuthology.orchestra.run.gibba031.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.283 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.a] 2021-11-15T19:35:38.283 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.b] 2021-11-15T19:35:38.284 INFO:teuthology.orchestra.run.gibba031.stdout:[mon.c] 2021-11-15T19:35:38.284 INFO:teuthology.orchestra.run.gibba031.stdout:[mds.a] 2021-11-15T19:35:38.284 INFO:teuthology.orchestra.run.gibba031.stdout:[mds.b] 2021-11-15T19:35:38.284 INFO:teuthology.orchestra.run.gibba031.stdout:[mds] 2021-11-15T19:35:38.285 INFO:teuthology.orchestra.run.gibba031.stdout: debug mds = 20 2021-11-15T19:35:38.285 INFO:teuthology.orchestra.run.gibba031.stdout: debug ms = 1 2021-11-15T19:35:38.285 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal frag = True 2021-11-15T19:35:38.285 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:38.285 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal merge size = 5 2021-11-15T19:35:38.286 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal split bits = 3 2021-11-15T19:35:38.286 INFO:teuthology.orchestra.run.gibba031.stdout: mds bal split size = 100 2021-11-15T19:35:38.286 INFO:teuthology.orchestra.run.gibba031.stdout: mds debug frag = True 2021-11-15T19:35:38.286 INFO:teuthology.orchestra.run.gibba031.stdout: mds debug scatterstat = True 2021-11-15T19:35:38.287 INFO:teuthology.orchestra.run.gibba031.stdout: mds op complaint time = 180 2021-11-15T19:35:38.287 INFO:teuthology.orchestra.run.gibba031.stdout: mds verify scatter = True 2021-11-15T19:35:38.287 INFO:teuthology.orchestra.run.gibba031.stdout: osd op complaint time = 180 2021-11-15T19:35:38.287 INFO:teuthology.orchestra.run.gibba031.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.287 INFO:teuthology.orchestra.run.gibba031.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.288 INFO:teuthology.orchestra.run.gibba037.stdout:[global] 2021-11-15T19:35:38.288 INFO:teuthology.orchestra.run.gibba037.stdout: chdir = "" 2021-11-15T19:35:38.288 INFO:teuthology.orchestra.run.gibba037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:38.288 INFO:teuthology.orchestra.run.gibba037.stdout: auth supported = cephx 2021-11-15T19:35:38.289 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.289 INFO:teuthology.orchestra.run.gibba037.stdout: filestore xattr use omap = true 2021-11-15T19:35:38.289 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.289 INFO:teuthology.orchestra.run.gibba037.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:38.290 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.290 INFO:teuthology.orchestra.run.gibba037.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:38.290 INFO:teuthology.orchestra.run.gibba037.stdout: auth debug = true 2021-11-15T19:35:38.290 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.290 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on old message = true 2021-11-15T19:35:38.291 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on bug = true 2021-11-15T19:35:38.291 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.291 INFO:teuthology.orchestra.run.gibba037.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:38.291 INFO:teuthology.orchestra.run.gibba037.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:38.292 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.292 INFO:teuthology.orchestra.run.gibba037.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:38.292 INFO:teuthology.orchestra.run.gibba037.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:38.292 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.292 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default size = 2 2021-11-15T19:35:38.293 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.293 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:38.293 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow pg remap = true 2021-11-15T19:35:38.293 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:38.294 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:38.294 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:38.294 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:38.294 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on too few osds = false 2021-11-15T19:35:38.294 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:38.295 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:38.295 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.295 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:38.295 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.296 INFO:teuthology.orchestra.run.gibba037.stdout: osd default data pool replay window = 5 2021-11-15T19:35:38.296 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.296 INFO:teuthology.orchestra.run.gibba037.stdout: mon allow pool delete = true 2021-11-15T19:35:38.296 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.296 INFO:teuthology.orchestra.run.gibba037.stdout: mon cluster log file level = debug 2021-11-15T19:35:38.297 INFO:teuthology.orchestra.run.gibba037.stdout: debug asserts on shutdown = true 2021-11-15T19:35:38.297 INFO:teuthology.orchestra.run.gibba037.stdout: mon health detail to clog = false 2021-11-15T19:35:38.297 INFO:teuthology.orchestra.run.gibba037.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:38.297 INFO:teuthology.orchestra.run.gibba037.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:38.298 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.298 INFO:teuthology.orchestra.run.gibba037.stdout:[osd] 2021-11-15T19:35:38.298 INFO:teuthology.orchestra.run.gibba037.stdout: osd journal size = 100 2021-11-15T19:35:38.298 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.299 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:38.299 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub max interval = 600 2021-11-15T19:35:38.299 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.299 INFO:teuthology.orchestra.run.gibba037.stdout: osd recover clone overlap = true 2021-11-15T19:35:38.299 INFO:teuthology.orchestra.run.gibba037.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:38.300 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.300 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug shutdown = true 2021-11-15T19:35:38.300 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug op order = true 2021-11-15T19:35:38.300 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:38.300 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd open classes on start = true 2021-11-15T19:35:38.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug pg log writeout = true 2021-11-15T19:35:38.301 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:38.302 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.302 INFO:teuthology.orchestra.run.gibba037.stdout: osd map max advance = 10 2021-11-15T19:35:38.302 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.302 INFO:teuthology.orchestra.run.gibba037.stdout: journal zero on create = true 2021-11-15T19:35:38.302 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.303 INFO:teuthology.orchestra.run.gibba037.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:38.303 INFO:teuthology.orchestra.run.gibba037.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:38.303 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.303 INFO:teuthology.orchestra.run.gibba037.stdout: bdev debug aio = true 2021-11-15T19:35:38.304 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug misdirected ops = true 2021-11-15T19:35:38.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:38.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug osd = 20 2021-11-15T19:35:38.304 INFO:teuthology.orchestra.run.gibba037.stdout: osd objectstore = filestore 2021-11-15T19:35:38.304 INFO:teuthology.orchestra.run.gibba037.stdout: osd op complaint time = 180 2021-11-15T19:35:38.305 INFO:teuthology.orchestra.run.gibba037.stdout: osd sloppy crc = True 2021-11-15T19:35:38.305 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.305 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr] 2021-11-15T19:35:38.305 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:38.306 INFO:teuthology.orchestra.run.gibba037.stdout: debug mgr = 20 2021-11-15T19:35:38.306 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-11-15T19:35:38.306 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-11-15T19:35:38.306 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.306 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.307 INFO:teuthology.orchestra.run.gibba037.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:38.307 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.307 INFO:teuthology.orchestra.run.gibba037.stdout:[mon] 2021-11-15T19:35:38.307 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:38.308 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-11-15T19:35:38.308 INFO:teuthology.orchestra.run.gibba037.stdout: debug paxos = 20 2021-11-15T19:35:38.308 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-11-15T19:35:38.308 INFO:teuthology.orchestra.run.gibba037.stdout: mon data avail warn = 5 2021-11-15T19:35:38.309 INFO:teuthology.orchestra.run.gibba037.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:38.309 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.309 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:38.309 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd prime pg temp = true 2021-11-15T19:35:38.309 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.310 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.310 INFO:teuthology.orchestra.run.gibba037.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:38.310 INFO:teuthology.orchestra.run.gibba037.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:38.310 INFO:teuthology.orchestra.run.gibba037.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:38.310 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.311 INFO:teuthology.orchestra.run.gibba037.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:38.311 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:38.311 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:38.311 INFO:teuthology.orchestra.run.gibba037.stdout: mon op complaint time = 120 2021-11-15T19:35:38.312 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:38.312 INFO:teuthology.orchestra.run.gibba037.stdout:[client] 2021-11-15T19:35:38.312 INFO:teuthology.orchestra.run.gibba037.stdout: rgw cache enabled = true 2021-11-15T19:35:38.312 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable ops log = true 2021-11-15T19:35:38.312 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable usage log = true 2021-11-15T19:35:38.313 INFO:teuthology.orchestra.run.gibba037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:38.313 INFO:teuthology.orchestra.run.gibba037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:38.313 INFO:teuthology.orchestra.run.gibba037.stdout: client mount timeout = 600 2021-11-15T19:35:38.313 INFO:teuthology.orchestra.run.gibba037.stdout: debug client = 20 2021-11-15T19:35:38.313 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:38.314 INFO:teuthology.orchestra.run.gibba037.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.314 INFO:teuthology.orchestra.run.gibba037.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.314 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.a] 2021-11-15T19:35:38.314 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.b] 2021-11-15T19:35:38.315 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.c] 2021-11-15T19:35:38.315 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.a] 2021-11-15T19:35:38.315 INFO:teuthology.orchestra.run.gibba037.stdout:[mds.b] 2021-11-15T19:35:38.315 INFO:teuthology.orchestra.run.gibba037.stdout:[mds] 2021-11-15T19:35:38.316 INFO:teuthology.orchestra.run.gibba037.stdout: debug mds = 20 2021-11-15T19:35:38.316 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-11-15T19:35:38.316 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal frag = True 2021-11-15T19:35:38.316 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:38.316 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal merge size = 5 2021-11-15T19:35:38.317 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal split bits = 3 2021-11-15T19:35:38.317 INFO:teuthology.orchestra.run.gibba037.stdout: mds bal split size = 100 2021-11-15T19:35:38.317 INFO:teuthology.orchestra.run.gibba037.stdout: mds debug frag = True 2021-11-15T19:35:38.317 INFO:teuthology.orchestra.run.gibba037.stdout: mds debug scatterstat = True 2021-11-15T19:35:38.317 INFO:teuthology.orchestra.run.gibba037.stdout: mds op complaint time = 180 2021-11-15T19:35:38.318 INFO:teuthology.orchestra.run.gibba037.stdout: mds verify scatter = True 2021-11-15T19:35:38.318 INFO:teuthology.orchestra.run.gibba037.stdout: osd op complaint time = 180 2021-11-15T19:35:38.318 INFO:teuthology.orchestra.run.gibba037.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.318 INFO:teuthology.orchestra.run.gibba037.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.319 INFO:teuthology.orchestra.run.gibba018.stdout:[global] 2021-11-15T19:35:38.319 INFO:teuthology.orchestra.run.gibba018.stdout: chdir = "" 2021-11-15T19:35:38.319 INFO:teuthology.orchestra.run.gibba018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:38.319 INFO:teuthology.orchestra.run.gibba018.stdout: auth supported = cephx 2021-11-15T19:35:38.320 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.320 INFO:teuthology.orchestra.run.gibba018.stdout: filestore xattr use omap = true 2021-11-15T19:35:38.320 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.320 INFO:teuthology.orchestra.run.gibba018.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:38.320 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.321 INFO:teuthology.orchestra.run.gibba018.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:38.321 INFO:teuthology.orchestra.run.gibba018.stdout: auth debug = true 2021-11-15T19:35:38.321 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.321 INFO:teuthology.orchestra.run.gibba018.stdout: ms die on old message = true 2021-11-15T19:35:38.322 INFO:teuthology.orchestra.run.gibba018.stdout: ms die on bug = true 2021-11-15T19:35:38.322 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.322 INFO:teuthology.orchestra.run.gibba018.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:38.322 INFO:teuthology.orchestra.run.gibba018.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:38.322 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.323 INFO:teuthology.orchestra.run.gibba018.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:38.323 INFO:teuthology.orchestra.run.gibba018.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:38.323 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.323 INFO:teuthology.orchestra.run.gibba018.stdout: osd pool default size = 2 2021-11-15T19:35:38.324 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.324 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:38.324 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd allow pg remap = true 2021-11-15T19:35:38.324 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:38.324 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:38.325 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:38.325 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:38.325 INFO:teuthology.orchestra.run.gibba018.stdout: mon warn on too few osds = false 2021-11-15T19:35:38.325 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:38.325 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:38.326 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.326 INFO:teuthology.orchestra.run.gibba018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:38.326 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.326 INFO:teuthology.orchestra.run.gibba018.stdout: osd default data pool replay window = 5 2021-11-15T19:35:38.327 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.327 INFO:teuthology.orchestra.run.gibba018.stdout: mon allow pool delete = true 2021-11-15T19:35:38.327 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.327 INFO:teuthology.orchestra.run.gibba018.stdout: mon cluster log file level = debug 2021-11-15T19:35:38.327 INFO:teuthology.orchestra.run.gibba018.stdout: debug asserts on shutdown = true 2021-11-15T19:35:38.328 INFO:teuthology.orchestra.run.gibba018.stdout: mon health detail to clog = false 2021-11-15T19:35:38.328 INFO:teuthology.orchestra.run.gibba018.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:38.328 INFO:teuthology.orchestra.run.gibba018.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:38.328 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.329 INFO:teuthology.orchestra.run.gibba018.stdout:[osd] 2021-11-15T19:35:38.329 INFO:teuthology.orchestra.run.gibba018.stdout: osd journal size = 100 2021-11-15T19:35:38.329 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.329 INFO:teuthology.orchestra.run.gibba018.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:38.329 INFO:teuthology.orchestra.run.gibba018.stdout: osd scrub max interval = 600 2021-11-15T19:35:38.330 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.330 INFO:teuthology.orchestra.run.gibba018.stdout: osd recover clone overlap = true 2021-11-15T19:35:38.330 INFO:teuthology.orchestra.run.gibba018.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:38.330 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.331 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug shutdown = true 2021-11-15T19:35:38.331 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug op order = true 2021-11-15T19:35:38.331 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:38.331 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.331 INFO:teuthology.orchestra.run.gibba018.stdout: osd open classes on start = true 2021-11-15T19:35:38.332 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug pg log writeout = true 2021-11-15T19:35:38.332 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.332 INFO:teuthology.orchestra.run.gibba018.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:38.332 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.332 INFO:teuthology.orchestra.run.gibba018.stdout: osd map max advance = 10 2021-11-15T19:35:38.333 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.333 INFO:teuthology.orchestra.run.gibba018.stdout: journal zero on create = true 2021-11-15T19:35:38.333 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.333 INFO:teuthology.orchestra.run.gibba018.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:38.334 INFO:teuthology.orchestra.run.gibba018.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:38.334 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.334 INFO:teuthology.orchestra.run.gibba018.stdout: bdev debug aio = true 2021-11-15T19:35:38.334 INFO:teuthology.orchestra.run.gibba018.stdout: osd debug misdirected ops = true 2021-11-15T19:35:38.334 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:38.335 INFO:teuthology.orchestra.run.gibba018.stdout: debug osd = 20 2021-11-15T19:35:38.335 INFO:teuthology.orchestra.run.gibba018.stdout: osd objectstore = filestore 2021-11-15T19:35:38.335 INFO:teuthology.orchestra.run.gibba018.stdout: osd op complaint time = 180 2021-11-15T19:35:38.335 INFO:teuthology.orchestra.run.gibba018.stdout: osd sloppy crc = True 2021-11-15T19:35:38.336 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.336 INFO:teuthology.orchestra.run.gibba018.stdout:[mgr] 2021-11-15T19:35:38.336 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:38.336 INFO:teuthology.orchestra.run.gibba018.stdout: debug mgr = 20 2021-11-15T19:35:38.337 INFO:teuthology.orchestra.run.gibba018.stdout: debug mon = 20 2021-11-15T19:35:38.337 INFO:teuthology.orchestra.run.gibba018.stdout: debug auth = 20 2021-11-15T19:35:38.337 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.337 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.337 INFO:teuthology.orchestra.run.gibba018.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:38.338 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.338 INFO:teuthology.orchestra.run.gibba018.stdout:[mon] 2021-11-15T19:35:38.338 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:38.338 INFO:teuthology.orchestra.run.gibba018.stdout: debug mon = 20 2021-11-15T19:35:38.339 INFO:teuthology.orchestra.run.gibba018.stdout: debug paxos = 20 2021-11-15T19:35:38.339 INFO:teuthology.orchestra.run.gibba018.stdout: debug auth = 20 2021-11-15T19:35:38.339 INFO:teuthology.orchestra.run.gibba018.stdout: mon data avail warn = 5 2021-11-15T19:35:38.339 INFO:teuthology.orchestra.run.gibba018.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:38.339 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.340 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:38.340 INFO:teuthology.orchestra.run.gibba018.stdout: mon osd prime pg temp = true 2021-11-15T19:35:38.340 INFO:teuthology.orchestra.run.gibba018.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.340 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.341 INFO:teuthology.orchestra.run.gibba018.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:38.341 INFO:teuthology.orchestra.run.gibba018.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:38.341 INFO:teuthology.orchestra.run.gibba018.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:38.341 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.341 INFO:teuthology.orchestra.run.gibba018.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:38.342 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:38.342 INFO:teuthology.orchestra.run.gibba018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:38.342 INFO:teuthology.orchestra.run.gibba018.stdout: mon op complaint time = 120 2021-11-15T19:35:38.342 INFO:teuthology.orchestra.run.gibba018.stdout: 2021-11-15T19:35:38.342 INFO:teuthology.orchestra.run.gibba018.stdout:[client] 2021-11-15T19:35:38.343 INFO:teuthology.orchestra.run.gibba018.stdout: rgw cache enabled = true 2021-11-15T19:35:38.343 INFO:teuthology.orchestra.run.gibba018.stdout: rgw enable ops log = true 2021-11-15T19:35:38.343 INFO:teuthology.orchestra.run.gibba018.stdout: rgw enable usage log = true 2021-11-15T19:35:38.343 INFO:teuthology.orchestra.run.gibba018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:38.344 INFO:teuthology.orchestra.run.gibba018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:38.344 INFO:teuthology.orchestra.run.gibba018.stdout: client mount timeout = 600 2021-11-15T19:35:38.344 INFO:teuthology.orchestra.run.gibba018.stdout: debug client = 20 2021-11-15T19:35:38.344 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:38.344 INFO:teuthology.orchestra.run.gibba018.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.345 INFO:teuthology.orchestra.run.gibba018.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.345 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.a] 2021-11-15T19:35:38.345 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.b] 2021-11-15T19:35:38.345 INFO:teuthology.orchestra.run.gibba018.stdout:[mon.c] 2021-11-15T19:35:38.345 INFO:teuthology.orchestra.run.gibba018.stdout:[mds.a] 2021-11-15T19:35:38.346 INFO:teuthology.orchestra.run.gibba018.stdout:[mds.b] 2021-11-15T19:35:38.346 INFO:teuthology.orchestra.run.gibba018.stdout:[mds] 2021-11-15T19:35:38.346 INFO:teuthology.orchestra.run.gibba018.stdout: debug mds = 20 2021-11-15T19:35:38.346 INFO:teuthology.orchestra.run.gibba018.stdout: debug ms = 1 2021-11-15T19:35:38.347 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal frag = True 2021-11-15T19:35:38.347 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:38.347 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal merge size = 5 2021-11-15T19:35:38.347 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal split bits = 3 2021-11-15T19:35:38.347 INFO:teuthology.orchestra.run.gibba018.stdout: mds bal split size = 100 2021-11-15T19:35:38.348 INFO:teuthology.orchestra.run.gibba018.stdout: mds debug frag = True 2021-11-15T19:35:38.348 INFO:teuthology.orchestra.run.gibba018.stdout: mds debug scatterstat = True 2021-11-15T19:35:38.348 INFO:teuthology.orchestra.run.gibba018.stdout: mds op complaint time = 180 2021-11-15T19:35:38.348 INFO:teuthology.orchestra.run.gibba018.stdout: mds verify scatter = True 2021-11-15T19:35:38.349 INFO:teuthology.orchestra.run.gibba018.stdout: osd op complaint time = 180 2021-11-15T19:35:38.349 INFO:teuthology.orchestra.run.gibba018.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.349 INFO:teuthology.orchestra.run.gibba018.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.349 INFO:teuthology.orchestra.run.gibba017.stdout:[global] 2021-11-15T19:35:38.349 INFO:teuthology.orchestra.run.gibba017.stdout: chdir = "" 2021-11-15T19:35:38.350 INFO:teuthology.orchestra.run.gibba017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T19:35:38.350 INFO:teuthology.orchestra.run.gibba017.stdout: auth supported = cephx 2021-11-15T19:35:38.350 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.350 INFO:teuthology.orchestra.run.gibba017.stdout: filestore xattr use omap = true 2021-11-15T19:35:38.351 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.351 INFO:teuthology.orchestra.run.gibba017.stdout: mon clock drift allowed = 1.000 2021-11-15T19:35:38.351 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.351 INFO:teuthology.orchestra.run.gibba017.stdout: osd crush chooseleaf type = 0 2021-11-15T19:35:38.352 INFO:teuthology.orchestra.run.gibba017.stdout: auth debug = true 2021-11-15T19:35:38.352 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.352 INFO:teuthology.orchestra.run.gibba017.stdout: ms die on old message = true 2021-11-15T19:35:38.352 INFO:teuthology.orchestra.run.gibba017.stdout: ms die on bug = true 2021-11-15T19:35:38.352 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.353 INFO:teuthology.orchestra.run.gibba017.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T19:35:38.353 INFO:teuthology.orchestra.run.gibba017.stdout: mon pg warn max object skew = 0 2021-11-15T19:35:38.353 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.353 INFO:teuthology.orchestra.run.gibba017.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T19:35:38.353 INFO:teuthology.orchestra.run.gibba017.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T19:35:38.354 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.354 INFO:teuthology.orchestra.run.gibba017.stdout: osd pool default size = 2 2021-11-15T19:35:38.354 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.354 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd allow primary affinity = true 2021-11-15T19:35:38.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd allow pg remap = true 2021-11-15T19:35:38.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on legacy crush tunables = false 2021-11-15T19:35:38.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on crush straw calc version zero = false 2021-11-15T19:35:38.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on no sortbitwise = false 2021-11-15T19:35:38.355 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on osd down out interval zero = false 2021-11-15T19:35:38.356 INFO:teuthology.orchestra.run.gibba017.stdout: mon warn on too few osds = false 2021-11-15T19:35:38.356 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T19:35:38.356 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T19:35:38.356 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.357 INFO:teuthology.orchestra.run.gibba017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T19:35:38.357 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.357 INFO:teuthology.orchestra.run.gibba017.stdout: osd default data pool replay window = 5 2021-11-15T19:35:38.357 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.357 INFO:teuthology.orchestra.run.gibba017.stdout: mon allow pool delete = true 2021-11-15T19:35:38.358 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.358 INFO:teuthology.orchestra.run.gibba017.stdout: mon cluster log file level = debug 2021-11-15T19:35:38.358 INFO:teuthology.orchestra.run.gibba017.stdout: debug asserts on shutdown = true 2021-11-15T19:35:38.358 INFO:teuthology.orchestra.run.gibba017.stdout: mon health detail to clog = false 2021-11-15T19:35:38.359 INFO:teuthology.orchestra.run.gibba017.stdout: mon host = "172.21.2.137,172.21.2.111,[v2:172.21.2.111:3301,v1:172.21.2.111:6790]" 2021-11-15T19:35:38.359 INFO:teuthology.orchestra.run.gibba017.stdout: fsid = 83e72b0f-d369-4e28-ba83-5e0d7df7d510 2021-11-15T19:35:38.359 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.359 INFO:teuthology.orchestra.run.gibba017.stdout:[osd] 2021-11-15T19:35:38.359 INFO:teuthology.orchestra.run.gibba017.stdout: osd journal size = 100 2021-11-15T19:35:38.360 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.360 INFO:teuthology.orchestra.run.gibba017.stdout: osd scrub load threshold = 5.0 2021-11-15T19:35:38.360 INFO:teuthology.orchestra.run.gibba017.stdout: osd scrub max interval = 600 2021-11-15T19:35:38.360 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.361 INFO:teuthology.orchestra.run.gibba017.stdout: osd recover clone overlap = true 2021-11-15T19:35:38.361 INFO:teuthology.orchestra.run.gibba017.stdout: osd recovery max chunk = 1048576 2021-11-15T19:35:38.361 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.361 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug shutdown = true 2021-11-15T19:35:38.361 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug op order = true 2021-11-15T19:35:38.362 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug verify stray on activate = true 2021-11-15T19:35:38.362 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.362 INFO:teuthology.orchestra.run.gibba017.stdout: osd open classes on start = true 2021-11-15T19:35:38.362 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug pg log writeout = true 2021-11-15T19:35:38.363 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.363 INFO:teuthology.orchestra.run.gibba017.stdout: osd deep scrub update digest min age = 30 2021-11-15T19:35:38.363 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.363 INFO:teuthology.orchestra.run.gibba017.stdout: osd map max advance = 10 2021-11-15T19:35:38.363 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.364 INFO:teuthology.orchestra.run.gibba017.stdout: journal zero on create = true 2021-11-15T19:35:38.364 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.364 INFO:teuthology.orchestra.run.gibba017.stdout: filestore ondisk finisher threads = 3 2021-11-15T19:35:38.364 INFO:teuthology.orchestra.run.gibba017.stdout: filestore apply finisher threads = 3 2021-11-15T19:35:38.365 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.365 INFO:teuthology.orchestra.run.gibba017.stdout: bdev debug aio = true 2021-11-15T19:35:38.365 INFO:teuthology.orchestra.run.gibba017.stdout: osd debug misdirected ops = true 2021-11-15T19:35:38.365 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:38.365 INFO:teuthology.orchestra.run.gibba017.stdout: debug osd = 20 2021-11-15T19:35:38.366 INFO:teuthology.orchestra.run.gibba017.stdout: osd objectstore = filestore 2021-11-15T19:35:38.366 INFO:teuthology.orchestra.run.gibba017.stdout: osd op complaint time = 180 2021-11-15T19:35:38.366 INFO:teuthology.orchestra.run.gibba017.stdout: osd sloppy crc = True 2021-11-15T19:35:38.366 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.367 INFO:teuthology.orchestra.run.gibba017.stdout:[mgr] 2021-11-15T19:35:38.367 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:38.367 INFO:teuthology.orchestra.run.gibba017.stdout: debug mgr = 20 2021-11-15T19:35:38.367 INFO:teuthology.orchestra.run.gibba017.stdout: debug mon = 20 2021-11-15T19:35:38.367 INFO:teuthology.orchestra.run.gibba017.stdout: debug auth = 20 2021-11-15T19:35:38.368 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.368 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.368 INFO:teuthology.orchestra.run.gibba017.stdout: mgr/telemetry/nag = false 2021-11-15T19:35:38.368 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.368 INFO:teuthology.orchestra.run.gibba017.stdout:[mon] 2021-11-15T19:35:38.369 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:38.369 INFO:teuthology.orchestra.run.gibba017.stdout: debug mon = 20 2021-11-15T19:35:38.369 INFO:teuthology.orchestra.run.gibba017.stdout: debug paxos = 20 2021-11-15T19:35:38.369 INFO:teuthology.orchestra.run.gibba017.stdout: debug auth = 20 2021-11-15T19:35:38.370 INFO:teuthology.orchestra.run.gibba017.stdout: mon data avail warn = 5 2021-11-15T19:35:38.370 INFO:teuthology.orchestra.run.gibba017.stdout: mon mgr mkfs grace = 240 2021-11-15T19:35:38.370 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min pgs per osd = 4 2021-11-15T19:35:38.370 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd reporter subtree level = osd 2021-11-15T19:35:38.370 INFO:teuthology.orchestra.run.gibba017.stdout: mon osd prime pg temp = true 2021-11-15T19:35:38.371 INFO:teuthology.orchestra.run.gibba017.stdout: mon reweight min bytes per osd = 10 2021-11-15T19:35:38.371 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.371 INFO:teuthology.orchestra.run.gibba017.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T19:35:38.371 INFO:teuthology.orchestra.run.gibba017.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T19:35:38.372 INFO:teuthology.orchestra.run.gibba017.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T19:35:38.372 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.372 INFO:teuthology.orchestra.run.gibba017.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T19:35:38.372 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T19:35:38.372 INFO:teuthology.orchestra.run.gibba017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T19:35:38.373 INFO:teuthology.orchestra.run.gibba017.stdout: mon op complaint time = 120 2021-11-15T19:35:38.373 INFO:teuthology.orchestra.run.gibba017.stdout: 2021-11-15T19:35:38.373 INFO:teuthology.orchestra.run.gibba017.stdout:[client] 2021-11-15T19:35:38.373 INFO:teuthology.orchestra.run.gibba017.stdout: rgw cache enabled = true 2021-11-15T19:35:38.374 INFO:teuthology.orchestra.run.gibba017.stdout: rgw enable ops log = true 2021-11-15T19:35:38.374 INFO:teuthology.orchestra.run.gibba017.stdout: rgw enable usage log = true 2021-11-15T19:35:38.374 INFO:teuthology.orchestra.run.gibba017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T19:35:38.374 INFO:teuthology.orchestra.run.gibba017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T19:35:38.374 INFO:teuthology.orchestra.run.gibba017.stdout: client mount timeout = 600 2021-11-15T19:35:38.375 INFO:teuthology.orchestra.run.gibba017.stdout: debug client = 20 2021-11-15T19:35:38.375 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:38.375 INFO:teuthology.orchestra.run.gibba017.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.375 INFO:teuthology.orchestra.run.gibba017.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.376 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.a] 2021-11-15T19:35:38.376 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.b] 2021-11-15T19:35:38.376 INFO:teuthology.orchestra.run.gibba017.stdout:[mon.c] 2021-11-15T19:35:38.376 INFO:teuthology.orchestra.run.gibba017.stdout:[mds.a] 2021-11-15T19:35:38.376 INFO:teuthology.orchestra.run.gibba017.stdout:[mds.b] 2021-11-15T19:35:38.377 INFO:teuthology.orchestra.run.gibba017.stdout:[mds] 2021-11-15T19:35:38.377 INFO:teuthology.orchestra.run.gibba017.stdout: debug mds = 20 2021-11-15T19:35:38.377 INFO:teuthology.orchestra.run.gibba017.stdout: debug ms = 1 2021-11-15T19:35:38.377 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal frag = True 2021-11-15T19:35:38.378 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal fragment size max = 10000 2021-11-15T19:35:38.378 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal merge size = 5 2021-11-15T19:35:38.378 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal split bits = 3 2021-11-15T19:35:38.378 INFO:teuthology.orchestra.run.gibba017.stdout: mds bal split size = 100 2021-11-15T19:35:38.378 INFO:teuthology.orchestra.run.gibba017.stdout: mds debug frag = True 2021-11-15T19:35:38.379 INFO:teuthology.orchestra.run.gibba017.stdout: mds debug scatterstat = True 2021-11-15T19:35:38.379 INFO:teuthology.orchestra.run.gibba017.stdout: mds op complaint time = 180 2021-11-15T19:35:38.379 INFO:teuthology.orchestra.run.gibba017.stdout: mds verify scatter = True 2021-11-15T19:35:38.379 INFO:teuthology.orchestra.run.gibba017.stdout: osd op complaint time = 180 2021-11-15T19:35:38.380 INFO:teuthology.orchestra.run.gibba017.stdout: rados mon op timeout = 15m 2021-11-15T19:35:38.380 INFO:teuthology.orchestra.run.gibba017.stdout: rados osd op timeout = 15m 2021-11-15T19:35:38.380 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:35:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 Processor -- start 2021-11-15T19:35:38.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- start start 2021-11-15T19:35:38.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fed740acd60 0x7fed740b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fed740b4680 0x7fed741290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740b76c0 con 0x7fed740b72e0 2021-11-15T19:35:38.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740b3100 con 0x7fed740acd60 2021-11-15T19:35:38.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740b20c0 con 0x7fed740b4680 2021-11-15T19:35:38.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed737fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fed740b4680 0x7fed741290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:38.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed72ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fed740b72e0 0x7fed740b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59100/0 (socket says 172.21.2.137:59100) 2021-11-15T19:35:38.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed72ffd700 1 -- 172.21.2.137:0/1278266119 learned_addr learned my addr 172.21.2.137:0/1278266119 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:38.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed737fe700 1 -- 172.21.2.137:0/1278266119 >> v2:172.21.2.111:3300/0 conn(0x7fed740acd60 msgr2=0x7fed740b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:38.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed737fe700 1 --2- 172.21.2.137:0/1278266119 >> v2:172.21.2.111:3300/0 conn(0x7fed740acd60 0x7fed740b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed737fe700 1 -- 172.21.2.137:0/1278266119 >> v1:172.21.2.137:6789/0 conn(0x7fed740b72e0 legacy=0x7fed740b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed737fe700 1 -- 172.21.2.137:0/1278266119 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7412a170 con 0x7fed740b4680 2021-11-15T19:35:38.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed737fe700 1 --2- 172.21.2.137:0/1278266119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b4680 0x7fed741290c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fed6c0032f0 tx=0x7fed6c0091d0).ready entity=mon.1 client_cookie=f0bc41deec23f088 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:38.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed71ffb700 1 -- 172.21.2.137:0/1278266119 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c009ea0 con 0x7fed740b4680 2021-11-15T19:35:38.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed71ffb700 1 -- 172.21.2.137:0/1278266119 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c00b870 con 0x7fed740b4680 2021-11-15T19:35:38.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed71ffb700 1 -- 172.21.2.137:0/1278266119 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c00b9e0 con 0x7fed740b4680 2021-11-15T19:35:38.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- 172.21.2.137:0/1278266119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b4680 msgr2=0x7fed741290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 --2- 172.21.2.137:0/1278266119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b4680 0x7fed741290c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fed6c0032f0 tx=0x7fed6c0091d0).stop 2021-11-15T19:35:38.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- 172.21.2.137:0/1278266119 shutdown_connections 2021-11-15T19:35:38.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 --2- 172.21.2.137:0/1278266119 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b4680 0x7fed741290c0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 --2- 172.21.2.137:0/1278266119 >> v2:172.21.2.111:3300/0 conn(0x7fed740acd60 0x7fed740b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- 172.21.2.137:0/1278266119 >> 172.21.2.137:0/1278266119 conn(0x7fed74064960 msgr2=0x7fed74064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:38.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- 172.21.2.137:0/1278266119 shutdown_connections 2021-11-15T19:35:38.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.426+0000 7fed7946c700 1 -- 172.21.2.137:0/1278266119 wait complete. 2021-11-15T19:35:38.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 Processor -- start 2021-11-15T19:35:38.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- start start 2021-11-15T19:35:38.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acd60 0x7fed741430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b4680 0x7fed740af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 0x7fed74156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7413f7a0 con 0x7fed740b4680 2021-11-15T19:35:38.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74156870 con 0x7fed740b72e0 2021-11-15T19:35:38.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed74125330 con 0x7fed740acd60 2021-11-15T19:35:38.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 0x7fed74156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:38.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 0x7fed74156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40324/0 (socket says 172.21.2.137:40324) 2021-11-15T19:35:38.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 -- 172.21.2.137:0/352955592 learned_addr learned my addr 172.21.2.137:0/352955592 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:38.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 -- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acd60 msgr2=0x7fed741430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acd60 0x7fed741430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 -- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b4680 msgr2=0x7fed740af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b4680 0x7fed740af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 -- 172.21.2.137:0/352955592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009470 con 0x7fed740b72e0 2021-11-15T19:35:38.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed737fe700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 0x7fed74156380 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fed741236f0 tx=0x7fed6c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:38.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c009ea0 con 0x7fed740b72e0 2021-11-15T19:35:38.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c00be90 con 0x7fed740b72e0 2021-11-15T19:35:38.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c0107a0 con 0x7fed740b72e0 2021-11-15T19:35:38.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed740ae150 con 0x7fed740b72e0 2021-11-15T19:35:38.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74124ff0 con 0x7fed740b72e0 2021-11-15T19:35:38.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed740b3a50 con 0x7fed740b72e0 2021-11-15T19:35:38.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed6c027020 con 0x7fed740b72e0 2021-11-15T19:35:38.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed6bfff700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed580536a0 0x7fed58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fed6c06cc50 con 0x7fed740b72e0 2021-11-15T19:35:38.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.430+0000 7fed72ffd700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed580536a0 0x7fed58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:38.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.434+0000 7fed72ffd700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed580536a0 0x7fed58055b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fed74065c40 tx=0x7fed64007820).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:38.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.434+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed6c044090 con 0x7fed740b72e0 2021-11-15T19:35:38.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.518+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fed740573d0 con 0x7fed740b72e0 2021-11-15T19:35:38.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed6bfff700 1 -- 172.21.2.137:0/352955592 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed6c0150a0 con 0x7fed740b72e0 2021-11-15T19:35:38.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed580536a0 msgr2=0x7fed58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed580536a0 0x7fed58055b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fed74065c40 tx=0x7fed64007820).stop 2021-11-15T19:35:38.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 msgr2=0x7fed74156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 0x7fed74156380 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fed741236f0 tx=0x7fed6c016000).stop 2021-11-15T19:35:38.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 shutdown_connections 2021-11-15T19:35:38.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed580536a0 0x7fed58055b60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740b72e0 0x7fed74156380 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b4680 0x7fed740af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 --2- 172.21.2.137:0/352955592 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acd60 0x7fed741430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 >> 172.21.2.137:0/352955592 conn(0x7fed74064960 msgr2=0x7fed74140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:38.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 shutdown_connections 2021-11-15T19:35:38.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.530+0000 7fed7946c700 1 -- 172.21.2.137:0/352955592 wait complete. 2021-11-15T19:35:38.548 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-11-15T19:35:38.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.586+0000 7f72643c2700 1 Processor -- start 2021-11-15T19:35:38.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.586+0000 7f72643c2700 1 -- start start 2021-11-15T19:35:38.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f725c0b1340 0x7f725c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f725c0a9f50 0x7f725c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c148190 con 0x7f725c143f00 2021-11-15T19:35:38.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0b1720 con 0x7f725c0a9f50 2021-11-15T19:35:38.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c147e70 con 0x7f725c0b1340 2021-11-15T19:35:38.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726195d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f725c143f00 0x7f725c144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59118/0 (socket says 172.21.2.137:59118) 2021-11-15T19:35:38.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726195d700 1 -- 172.21.2.137:0/3012586539 learned_addr learned my addr 172.21.2.137:0/3012586539 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:38.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726215e700 1 --2- 172.21.2.137:0/3012586539 >> v2:172.21.2.137:3300/0 conn(0x7f725c0b1340 0x7f725c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:38.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726215e700 1 -- 172.21.2.137:0/3012586539 >> v2:172.21.2.111:3300/0 conn(0x7f725c0a9f50 msgr2=0x7f725c0aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:38.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726215e700 1 --2- 172.21.2.137:0/3012586539 >> v2:172.21.2.111:3300/0 conn(0x7f725c0a9f50 0x7f725c0aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726215e700 1 -- 172.21.2.137:0/3012586539 >> v1:172.21.2.137:6789/0 conn(0x7f725c143f00 legacy=0x7f725c144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726215e700 1 -- 172.21.2.137:0/3012586539 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0af800 con 0x7f725c0b1340 2021-11-15T19:35:38.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726215e700 1 --2- 172.21.2.137:0/3012586539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c0b1340 0x7f725c147980 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f7258002f70 tx=0x7f7258006df0).ready entity=mon.1 client_cookie=8a58a68fdade2f14 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:38.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726115c700 1 -- 172.21.2.137:0/3012586539 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f725800d5c0 con 0x7f725c0b1340 2021-11-15T19:35:38.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726115c700 1 -- 172.21.2.137:0/3012586539 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258000e90 con 0x7f725c0b1340 2021-11-15T19:35:38.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726115c700 1 -- 172.21.2.137:0/3012586539 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f725800d950 con 0x7f725c0b1340 2021-11-15T19:35:38.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/3012586539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c0b1340 msgr2=0x7f725c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- 172.21.2.137:0/3012586539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c0b1340 0x7f725c147980 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f7258002f70 tx=0x7f7258006df0).stop 2021-11-15T19:35:38.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/3012586539 shutdown_connections 2021-11-15T19:35:38.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- 172.21.2.137:0/3012586539 >> v2:172.21.2.111:3300/0 conn(0x7f725c0a9f50 0x7f725c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- 172.21.2.137:0/3012586539 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c0b1340 0x7f725c147980 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:38.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/3012586539 >> 172.21.2.137:0/3012586539 conn(0x7f725c0b4e60 msgr2=0x7f725c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:38.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/3012586539 shutdown_connections 2021-11-15T19:35:38.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/3012586539 wait complete. 2021-11-15T19:35:38.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 Processor -- start 2021-11-15T19:35:38.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- start start 2021-11-15T19:35:38.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f725c0a9f50 0x7f725c148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f725c0b1340 0x7f725c15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 0x7f725c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c141e60 con 0x7f725c0b1340 2021-11-15T19:35:38.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c140630 con 0x7f725c143f00 2021-11-15T19:35:38.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c141b70 con 0x7f725c0a9f50 2021-11-15T19:35:38.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 0x7f725c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:38.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 0x7f725c15a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40340/0 (socket says 172.21.2.137:40340) 2021-11-15T19:35:38.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 -- 172.21.2.137:0/2474497695 learned_addr learned my addr 172.21.2.137:0/2474497695 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:38.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 -- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f725c0a9f50 msgr2=0x7f725c148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f725c0a9f50 0x7f725c148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 -- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f725c0b1340 msgr2=0x7f725c15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:38.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f725c0b1340 0x7f725c15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:38.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 -- 172.21.2.137:0/2474497695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725800b180 con 0x7f725c143f00 2021-11-15T19:35:38.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f726295f700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 0x7f725c15a5a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f7254003270 tx=0x7f72540090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:38.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f725400d4a0 con 0x7f725c143f00 2021-11-15T19:35:38.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725400d600 con 0x7f725c143f00 2021-11-15T19:35:38.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c15aa90 con 0x7f725c143f00 2021-11-15T19:35:38.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f725400d960 con 0x7f725c143f00 2021-11-15T19:35:38.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.590+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c140e80 con 0x7f725c143f00 2021-11-15T19:35:38.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c15ac20 con 0x7f725c143f00 2021-11-15T19:35:38.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7254018030 con 0x7f725c143f00 2021-11-15T19:35:38.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f724b7fe700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f723c0534f0 0x7f723c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:38.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f725406b080 con 0x7f725c143f00 2021-11-15T19:35:38.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f726215e700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f723c0534f0 0x7f723c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:38.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f726215e700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f723c0534f0 0x7f723c0559b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f7258002f70 tx=0x7f7258014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:38.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.594+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7254042460 con 0x7f725c143f00 2021-11-15T19:35:38.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:38.710+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f725c0573d0 con 0x7f725c143f00 2021-11-15T19:35:39.207 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.194+0000 7f724b7fe700 1 -- 172.21.2.137:0/2474497695 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v382) v1 ==== 128+0+0 (secure 0 0 0) 0x7f7254045a80 con 0x7f725c143f00 2021-11-15T19:35:39.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f723c0534f0 msgr2=0x7f723c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f723c0534f0 0x7f723c0559b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f7258002f70 tx=0x7f7258014000).stop 2021-11-15T19:35:39.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 msgr2=0x7f725c15a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 0x7f725c15a5a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f7254003270 tx=0x7f72540090f0).stop 2021-11-15T19:35:39.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 shutdown_connections 2021-11-15T19:35:39.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f723c0534f0 0x7f723c0559b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:39.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f725c143f00 0x7f725c15a5a0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:39.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f725c0b1340 0x7f725c15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:39.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 --2- 172.21.2.137:0/2474497695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f725c0a9f50 0x7f725c148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:39.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 >> 172.21.2.137:0/2474497695 conn(0x7f725c0b4e60 msgr2=0x7f725c144e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:39.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 shutdown_connections 2021-11-15T19:35:39.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.198+0000 7f72643c2700 1 -- 172.21.2.137:0/2474497695 wait complete. 2021-11-15T19:35:39.215 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:35:39.216 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:35:39.216 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-11-15T19:35:39.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 Processor -- start 2021-11-15T19:35:39.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- start start 2021-11-15T19:35:39.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f06440b1340 0x7f0644147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0644148190 con 0x7f0644143f00 2021-11-15T19:35:39.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440b1720 con 0x7f06440a9f50 2021-11-15T19:35:39.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0644147e70 con 0x7f06440b1340 2021-11-15T19:35:39.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f06440a9f50 0x7f06440aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59132/0 (socket says 172.21.2.137:59132) 2021-11-15T19:35:39.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 -- 172.21.2.137:0/585578050 learned_addr learned my addr 172.21.2.137:0/585578050 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:39.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478796681 0 0) 0x7f06440b1720 con 0x7f06440a9f50 2021-11-15T19:35:39.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c003260 con 0x7f06440a9f50 2021-11-15T19:35:39.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064a36a700 1 --2- 172.21.2.137:0/585578050 >> v2:172.21.2.111:3300/0 conn(0x7f06440b1340 0x7f0644147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:39.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067323679 0 0) 0x7f062c003260 con 0x7f06440a9f50 2021-11-15T19:35:39.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 >> v2:172.21.2.111:3300/0 conn(0x7f06440b1340 msgr2=0x7f0644147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:39.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 --2- 172.21.2.137:0/585578050 >> v2:172.21.2.111:3300/0 conn(0x7f06440b1340 0x7f0644147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:39.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 >> v1:172.21.2.111:6789/0 conn(0x7f0644143f00 legacy=0x7f0644144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440af800 con 0x7f06440a9f50 2021-11-15T19:35:39.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f063c0019e0 con 0x7f06440a9f50 2021-11-15T19:35:39.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 >> v1:172.21.2.137:6789/0 conn(0x7f06440a9f50 legacy=0x7f06440aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f062c0037a0 0x7f062c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f062c004500 0x7f062c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f062c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644147e70 con 0x7f062c004500 2021-11-15T19:35:39.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c00be50 con 0x7f062c004e70 2021-11-15T19:35:39.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c00c010 con 0x7f062c0037a0 2021-11-15T19:35:39.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f062c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:39.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649b69700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f062c004500 0x7f062c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:39.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 -- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f062c0037a0 msgr2=0x7f062c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:39.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f062c0037a0 0x7f062c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:39.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 -- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f062c004500 msgr2=0x7f062c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:39.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f062c004500 0x7f062c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:39.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 -- 172.21.2.137:0/585578050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c003260 con 0x7f062c004e70 2021-11-15T19:35:39.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 -- 172.21.2.137:0/585578050 reap_dead start 2021-11-15T19:35:39.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064ab6b700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f062c00b750 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f063c0016f0 tx=0x7f064405f9e0).ready entity=mon.1 client_cookie=ed38f84c398a6f6f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:39.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063c00cba0 con 0x7f062c004e70 2021-11-15T19:35:39.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c00cd00 con 0x7f062c004e70 2021-11-15T19:35:39.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f0649368700 1 -- 172.21.2.137:0/585578050 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063c005b80 con 0x7f062c004e70 2021-11-15T19:35:39.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- 172.21.2.137:0/585578050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 msgr2=0x7f062c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f062c00b750 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f063c0016f0 tx=0x7f064405f9e0).stop 2021-11-15T19:35:39.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- 172.21.2.137:0/585578050 shutdown_connections 2021-11-15T19:35:39.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 --2- 172.21.2.137:0/585578050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f062c00b750 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:39.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- 172.21.2.137:0/585578050 >> 172.21.2.137:0/585578050 conn(0x7f06440b4e60 msgr2=0x7f06440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:39.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- 172.21.2.137:0/585578050 shutdown_connections 2021-11-15T19:35:39.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.258+0000 7f064c5ce700 1 -- 172.21.2.137:0/585578050 wait complete. 2021-11-15T19:35:39.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 Processor -- start 2021-11-15T19:35:39.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- start start 2021-11-15T19:35:39.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f0644159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f064413fcd0 0x7f0644141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0644144b30 0x7f0644145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064415a480 con 0x7f064413fcd0 2021-11-15T19:35:39.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064415a720 con 0x7f062c004e70 2021-11-15T19:35:39.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0644141070 con 0x7f0644144b30 2021-11-15T19:35:39.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f0644159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:39.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f0644159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40360/0 (socket says 172.21.2.137:40360) 2021-11-15T19:35:39.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 -- 172.21.2.137:0/3354615921 learned_addr learned my addr 172.21.2.137:0/3354615921 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:39.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 -- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0644144b30 msgr2=0x7f0644145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0644144b30 0x7f0644145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:39.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 -- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f064413fcd0 msgr2=0x7f0644141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:39.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f064413fcd0 0x7f0644141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:39.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 -- 172.21.2.137:0/3354615921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644140220 con 0x7f062c004e70 2021-11-15T19:35:39.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064a36a700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f0644159ca0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f064000c000 tx=0x7f0640006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:39.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0640016070 con 0x7f062c004e70 2021-11-15T19:35:39.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0640000e90 con 0x7f062c004e70 2021-11-15T19:35:39.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064415a190 con 0x7f062c004e70 2021-11-15T19:35:39.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0640010970 con 0x7f062c004e70 2021-11-15T19:35:39.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644141a00 con 0x7f062c004e70 2021-11-15T19:35:39.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0644141230 con 0x7f062c004e70 2021-11-15T19:35:39.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0640010ad0 con 0x7f062c004e70 2021-11-15T19:35:39.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f06377fe700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0624053540 0x7f0624055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:39.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f064006b6a0 con 0x7f062c004e70 2021-11-15T19:35:39.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.262+0000 7f0649b69700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0624053540 0x7f0624055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:39.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.266+0000 7f0649b69700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0624053540 0x7f0624055a00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f0638008000 tx=0x7f0638009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:39.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.266+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0640042ae0 con 0x7f062c004e70 2021-11-15T19:35:39.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:39.378+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f064405faf0 con 0x7f062c004e70 2021-11-15T19:35:40.212 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f06377fe700 1 -- 172.21.2.137:0/3354615921 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v383) v1 ==== 130+0+0 (secure 0 0 0) 0x7f0640046100 con 0x7f062c004e70 2021-11-15T19:35:40.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0624053540 msgr2=0x7f0624055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0624053540 0x7f0624055a00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f0638008000 tx=0x7f0638009040).stop 2021-11-15T19:35:40.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 msgr2=0x7f0644159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f0644159ca0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f064000c000 tx=0x7f0640006df0).stop 2021-11-15T19:35:40.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 shutdown_connections 2021-11-15T19:35:40.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0624053540 0x7f0624055a00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0644144b30 0x7f0644145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f064413fcd0 0x7f0644141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 --2- 172.21.2.137:0/3354615921 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f062c004e70 0x7f0644159ca0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 >> 172.21.2.137:0/3354615921 conn(0x7f06440b4e60 msgr2=0x7f0644143440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:40.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 shutdown_connections 2021-11-15T19:35:40.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.202+0000 7f064c5ce700 1 -- 172.21.2.137:0/3354615921 wait complete. 2021-11-15T19:35:40.221 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:35:40.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 Processor -- start 2021-11-15T19:35:40.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 -- start start 2021-11-15T19:35:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fe005c770 0x7f1fe00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe0140aa0 0x7f1fe0140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe005cb50 con 0x7f1fe00b0550 2021-11-15T19:35:40.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe00b1650 con 0x7f1fe005c770 2021-11-15T19:35:40.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe82f8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe00ad030 con 0x7f1fe0140aa0 2021-11-15T19:35:40.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe6094700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1fe005c770 0x7f1fe00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe5893700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1fe00b0550 0x7f1fe014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59150/0 (socket says 172.21.2.137:59150) 2021-11-15T19:35:40.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe5893700 1 -- 172.21.2.137:0/3908371428 learned_addr learned my addr 172.21.2.137:0/3908371428 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:40.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe6094700 1 -- 172.21.2.137:0/3908371428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe0140aa0 msgr2=0x7f1fe0140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:40.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe6094700 1 --2- 172.21.2.137:0/3908371428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe0140aa0 0x7f1fe0140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe6094700 1 -- 172.21.2.137:0/3908371428 >> v1:172.21.2.137:6789/0 conn(0x7f1fe00b0550 legacy=0x7f1fe014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe6094700 1 -- 172.21.2.137:0/3908371428 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe00ad2d0 con 0x7f1fe005c770 2021-11-15T19:35:40.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe6094700 1 --2- 172.21.2.137:0/3908371428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe005c770 0x7f1fe00aef30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f1fdc002f70 tx=0x7f1fdc006df0).ready entity=mon.1 client_cookie=7e02f28c6ef9cb9d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe5092700 1 -- 172.21.2.137:0/3908371428 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fdc00d570 con 0x7f1fe005c770 2021-11-15T19:35:40.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe5092700 1 -- 172.21.2.137:0/3908371428 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc000e90 con 0x7f1fe005c770 2021-11-15T19:35:40.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.262+0000 7f1fe5092700 1 -- 172.21.2.137:0/3908371428 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fdc00d8c0 con 0x7f1fe005c770 2021-11-15T19:35:40.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3908371428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe005c770 msgr2=0x7f1fe00aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3908371428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe005c770 0x7f1fe00aef30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f1fdc002f70 tx=0x7f1fdc006df0).stop 2021-11-15T19:35:40.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3908371428 shutdown_connections 2021-11-15T19:35:40.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3908371428 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe0140aa0 0x7f1fe0140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3908371428 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe005c770 0x7f1fe00aef30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3908371428 >> 172.21.2.137:0/3908371428 conn(0x7f1fe00631e0 msgr2=0x7f1fe005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:40.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3908371428 shutdown_connections 2021-11-15T19:35:40.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3908371428 wait complete. 2021-11-15T19:35:40.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 Processor -- start 2021-11-15T19:35:40.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- start start 2021-11-15T19:35:40.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fe005c770 0x7f1fe0141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe00b0550 0x7f1fe0144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 0x7f1fe01452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01441a0 con 0x7f1fe005c770 2021-11-15T19:35:40.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01458c0 con 0x7f1fe0140aa0 2021-11-15T19:35:40.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0157030 con 0x7f1fe00b0550 2021-11-15T19:35:40.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 0x7f1fe01452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 0x7f1fe01452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40372/0 (socket says 172.21.2.137:40372) 2021-11-15T19:35:40.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 -- 172.21.2.137:0/3962077585 learned_addr learned my addr 172.21.2.137:0/3962077585 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:40.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 -- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe00b0550 msgr2=0x7f1fe0144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe00b0550 0x7f1fe0144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 -- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fe005c770 msgr2=0x7f1fe0141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fe005c770 0x7f1fe0141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 -- 172.21.2.137:0/3962077585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc00b180 con 0x7f1fe0140aa0 2021-11-15T19:35:40.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6895700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 0x7f1fe01452b0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f1fd80032f0 tx=0x7f1fd80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd800d4a0 con 0x7f1fe0140aa0 2021-11-15T19:35:40.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800d600 con 0x7f1fe0140aa0 2021-11-15T19:35:40.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe01417d0 con 0x7f1fe0140aa0 2021-11-15T19:35:40.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe0156620 con 0x7f1fe0140aa0 2021-11-15T19:35:40.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd800d960 con 0x7f1fe0140aa0 2021-11-15T19:35:40.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe01571f0 con 0x7f1fe0140aa0 2021-11-15T19:35:40.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fd8018030 con 0x7f1fe0140aa0 2021-11-15T19:35:40.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fcf7fe700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1fc0053580 0x7f1fc0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1fd806b0b0 con 0x7f1fe0140aa0 2021-11-15T19:35:40.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.266+0000 7f1fe6094700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1fc0053580 0x7f1fc0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.270+0000 7f1fe6094700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1fc0053580 0x7f1fc0055a40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f1fdc002f70 tx=0x7f1fdc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.270+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fd8042500 con 0x7f1fe0140aa0 2021-11-15T19:35:40.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.354+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1fe0145a50 con 0x7f1fe0140aa0 2021-11-15T19:35:40.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fcf7fe700 1 -- 172.21.2.137:0/3962077585 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1fd8045b20 con 0x7f1fe0140aa0 2021-11-15T19:35:40.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1fc0053580 msgr2=0x7f1fc0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1fc0053580 0x7f1fc0055a40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f1fdc002f70 tx=0x7f1fdc015000).stop 2021-11-15T19:35:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 msgr2=0x7f1fe01452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 0x7f1fe01452b0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f1fd80032f0 tx=0x7f1fd80091a0).stop 2021-11-15T19:35:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 shutdown_connections 2021-11-15T19:35:40.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1fc0053580 0x7f1fc0055a40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1fe0140aa0 0x7f1fe01452b0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1fe00b0550 0x7f1fe0144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 --2- 172.21.2.137:0/3962077585 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1fe005c770 0x7f1fe0141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 >> 172.21.2.137:0/3962077585 conn(0x7f1fe00631e0 msgr2=0x7f1fe00b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:40.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 shutdown_connections 2021-11-15T19:35:40.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.366+0000 7f1fe82f8700 1 -- 172.21.2.137:0/3962077585 wait complete. 2021-11-15T19:35:40.384 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:35:40.384 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:40.392 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:40.405 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:40.418 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:40.431 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:40.441 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:35:40.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:40.442 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:40.443 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:40.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:40.447 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:35:40.448 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:40.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:40.448 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:40.449 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:40.453 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:35:40.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:40.455 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:40.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:40.455 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:40.456 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:40.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:40.461 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:40.462 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:35:40.462 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:35:40.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 Processor -- start 2021-11-15T19:35:40.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- start start 2021-11-15T19:35:40.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2c040acab0 0x7f2c040b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040b1180 0x7f2c040b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f2c040af2f0 0x7f2c04142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c040aecf0 con 0x7f2c040af2f0 2021-11-15T19:35:40.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0413f180 con 0x7f2c040acab0 2021-11-15T19:35:40.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040aef20 con 0x7f2c040b1180 2021-11-15T19:35:40.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2c040acab0 0x7f2c040b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2c040acab0 0x7f2c040b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40380/0 (socket says 172.21.2.137:40380) 2021-11-15T19:35:40.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 -- 172.21.2.137:0/335101975 learned_addr learned my addr 172.21.2.137:0/335101975 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:40.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 -- 172.21.2.137:0/335101975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040b1180 msgr2=0x7f2c040b2550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:40.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 --2- 172.21.2.137:0/335101975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040b1180 0x7f2c040b2550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 -- 172.21.2.137:0/335101975 >> v2:172.21.2.111:3300/0 conn(0x7f2c040af2f0 msgr2=0x7f2c04142b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:40.544 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 --2- 172.21.2.137:0/335101975 >> v2:172.21.2.111:3300/0 conn(0x7f2c040af2f0 0x7f2c04142b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 -- 172.21.2.137:0/335101975 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040ace90 con 0x7f2c040acab0 2021-11-15T19:35:40.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c088fe700 1 --2- 172.21.2.137:0/335101975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c040b2060 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f2bf4002f70 tx=0x7f2bf4006eb0).ready entity=mon.1 client_cookie=3f9d7caefa545c23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c037fe700 1 -- 172.21.2.137:0/335101975 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf4010810 con 0x7f2c040acab0 2021-11-15T19:35:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c037fe700 1 -- 172.21.2.137:0/335101975 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf4000e90 con 0x7f2c040acab0 2021-11-15T19:35:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c037fe700 1 -- 172.21.2.137:0/335101975 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf4010ba0 con 0x7f2c040acab0 2021-11-15T19:35:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- 172.21.2.137:0/335101975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 msgr2=0x7f2c040b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/335101975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c040b2060 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f2bf4002f70 tx=0x7f2bf4006eb0).stop 2021-11-15T19:35:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- 172.21.2.137:0/335101975 shutdown_connections 2021-11-15T19:35:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/335101975 >> v2:172.21.2.111:3300/0 conn(0x7f2c040af2f0 0x7f2c04142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/335101975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040b1180 0x7f2c040b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/335101975 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c040b2060 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- 172.21.2.137:0/335101975 >> 172.21.2.137:0/335101975 conn(0x7f2c040630f0 msgr2=0x7f2c040634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- 172.21.2.137:0/335101975 shutdown_connections 2021-11-15T19:35:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- 172.21.2.137:0/335101975 wait complete. 2021-11-15T19:35:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 Processor -- start 2021-11-15T19:35:40.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.530+0000 7f2c0ab62700 1 -- start start 2021-11-15T19:35:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c0413f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040af2f0 0x7f2c04156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c040b1180 0x7f2c04156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c04111ec0 con 0x7f2c040b1180 2021-11-15T19:35:40.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0410f330 con 0x7f2c040acab0 2021-11-15T19:35:40.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0410f560 con 0x7f2c040af2f0 2021-11-15T19:35:40.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c0413f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c0413f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40386/0 (socket says 172.21.2.137:40386) 2021-11-15T19:35:40.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 -- 172.21.2.137:0/69710862 learned_addr learned my addr 172.21.2.137:0/69710862 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:40.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 -- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040af2f0 msgr2=0x7f2c04156740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:40.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040af2f0 0x7f2c04156740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 -- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c040b1180 msgr2=0x7f2c04156c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:40.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c040b1180 0x7f2c04156c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 -- 172.21.2.137:0/69710862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf400c2f0 con 0x7f2c040acab0 2021-11-15T19:35:40.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c088fe700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c0413f630 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f2bf4002f70 tx=0x7f2bf4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf401ae00 con 0x7f2c040acab0 2021-11-15T19:35:40.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf400c030 con 0x7f2c040acab0 2021-11-15T19:35:40.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c04159cd0 con 0x7f2c040acab0 2021-11-15T19:35:40.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0410f0d0 con 0x7f2c040acab0 2021-11-15T19:35:40.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf4018610 con 0x7f2c040acab0 2021-11-15T19:35:40.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c04159e90 con 0x7f2c040acab0 2021-11-15T19:35:40.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2bf400e040 con 0x7f2c040acab0 2021-11-15T19:35:40.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c01ffb700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2be80536f0 0x7f2be8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2bf406d180 con 0x7f2c040acab0 2021-11-15T19:35:40.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c03fff700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2be80536f0 0x7f2be8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.534+0000 7f2c03fff700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2be80536f0 0x7f2be8055bb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f2bec000ed0 tx=0x7f2bec0068b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.538+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2bf40444f0 con 0x7f2c040acab0 2021-11-15T19:35:40.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2c040b1820 con 0x7f2c040acab0 2021-11-15T19:35:40.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c01ffb700 1 -- 172.21.2.137:0/69710862 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+28837 (secure 0 0 0) 0x7f2bf4047ad0 con 0x7f2c040acab0 2021-11-15T19:35:40.633 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:40.633 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:40.633 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 134, 2021-11-15T19:35:40.634 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:35:40.634 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:35:40.634 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:35:38.179998+0000", 2021-11-15T19:35:40.634 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:40.635 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:40.635 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:35:40.635 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:35:40.635 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:35:40.635 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:35:40.636 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:35:40.636 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:35:40.636 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:35:40.636 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:40.636 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:35:40.637 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:35:40.637 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:35:40.637 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:35:40.637 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:35:40.638 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 26, 2021-11-15T19:35:40.638 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:35:40.638 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:35:40.638 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:35:40.638 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:35:40.639 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:35:40.639 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.639 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:35:40.639 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:35:40.640 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:35:40.640 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:40.640 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:40.640 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:40.640 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:40.641 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:40.641 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:40.641 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:40.641 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:40.642 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:35:40.642 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:35:40.642 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:35:40.642 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:35:40.643 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:35:40.643 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:40.643 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:40.643 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:40.643 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:40.644 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:40.644 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:40.644 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:40.644 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.645 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:35:40.645 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:40.645 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:40.645 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:40.646 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:40.646 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:40.646 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:40.646 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:40.647 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:40.647 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:40.647 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:40.647 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:40.647 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:40.648 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:40.648 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:40.648 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:40.648 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:40.649 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:40.649 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:40.649 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:40.649 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:40.649 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:40.650 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:40.650 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:40.650 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:40.650 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:40.651 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:40.651 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.651 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:40.651 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:40.652 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:40.652 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:40.652 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:40.652 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:40.652 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:40.653 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:40.653 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:40.653 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:40.653 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:40.654 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:40.654 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:35:40.654 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.654 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:40.655 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:35:40.655 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.655 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.655 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.655 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:35:40.656 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:35:40.656 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:35:40.656 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:40.656 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:40.656 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:40.657 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:40.657 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:40.657 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:40.657 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:40.658 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:40.658 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:40.658 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:40.658 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:40.659 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:40.659 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:40.659 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:40.659 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:40.660 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:40.660 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:40.660 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:40.660 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:40.660 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:40.661 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.661 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:35:40.661 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:40.661 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:40.662 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:40.662 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:40.662 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:40.662 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:40.662 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:40.663 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:40.663 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:40.663 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:40.663 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:40.664 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:40.664 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:40.664 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:40.664 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:40.664 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:40.665 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:40.665 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:40.665 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:40.665 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:40.666 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:40.666 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:40.666 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:40.666 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:40.667 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:40.667 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:40.667 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.667 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:40.667 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:40.668 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:40.668 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:40.668 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:40.668 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:40.669 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:40.669 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:40.669 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:40.669 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:40.669 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:40.670 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:40.670 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:40.670 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:35:40.670 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.671 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.671 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:40.671 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:35:40.671 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.671 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:40.672 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:35:40.672 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.672 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.672 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.673 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.673 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.673 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.673 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.673 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 128, 2021-11-15T19:35:40.674 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.674 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.674 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.674 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.675 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.675 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.675 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:35:40.675 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.675 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.676 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.676 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.676 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:35:40.676 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.676 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.677 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.677 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.677 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.677 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.677 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.678 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.678 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:35:40.678 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.678 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.679 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.679 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.679 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:35:40.679 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.679 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.680 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.680 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.680 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.680 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.680 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.681 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.681 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:35:40.681 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.681 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.682 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.682 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.682 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:35:40.682 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.683 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.683 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.683 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.683 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.684 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.684 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.684 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.684 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:35:40.684 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.685 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.685 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.685 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.685 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:35:40.685 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:40.686 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.686 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.686 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.686 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:35:40.687 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:35:40.687 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:35:40.687 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:35:40.687 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.688 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.688 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.688 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.688 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.688 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.689 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:40.689 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:35:40.689 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.689 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.690 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.690 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.690 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.690 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.690 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.691 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:40.691 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.691 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.691 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.692 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.692 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.692 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.692 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:35:40.692 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.693 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.693 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.693 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.693 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:35:40.694 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.694 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.694 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.694 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.694 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.695 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.695 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.695 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.695 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:35:40.696 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.696 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.696 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.696 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.697 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:35:40.697 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.697 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.697 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.697 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.698 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.698 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.698 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.698 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.699 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:35:40.699 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.699 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.699 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.700 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.700 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:35:40.700 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.700 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.700 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.701 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.701 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.701 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.701 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.702 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.702 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:35:40.702 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.702 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.702 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.703 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.703 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:35:40.703 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:40.703 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.704 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.704 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.704 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:35:40.704 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:35:40.704 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:35:40.705 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:35:40.705 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.705 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.705 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.706 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.706 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.706 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.706 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:40.707 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:35:40.707 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.707 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.707 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.707 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.708 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.708 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.708 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.708 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:40.709 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.709 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.709 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.709 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.709 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.710 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.710 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:35:40.710 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.710 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.711 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.711 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.711 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:35:40.711 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.712 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.712 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.712 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.712 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.713 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.713 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.713 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.713 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:35:40.714 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.714 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.714 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.714 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.714 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:35:40.715 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.715 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.715 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.715 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.716 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.716 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.716 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.716 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.717 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:35:40.717 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.717 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.717 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.717 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.718 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:35:40.718 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.718 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.718 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.719 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.719 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.719 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.719 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.719 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.720 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:35:40.720 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.720 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.720 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.721 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.721 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:35:40.721 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:40.721 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.722 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.722 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.722 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:35:40.722 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:35:40.722 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:35:40.723 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:35:40.723 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.723 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.723 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.724 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.724 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.724 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.724 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:40.724 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:35:40.725 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.725 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.725 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.725 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.725 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.726 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.726 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.726 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 128, 2021-11-15T19:35:40.726 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.727 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.727 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.727 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.727 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.728 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.728 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:35:40.728 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.728 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.728 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.729 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.729 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:35:40.729 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.729 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.730 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.730 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.730 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.730 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.731 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.731 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.731 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:35:40.731 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.731 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.732 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.732 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.732 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:35:40.732 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.733 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.733 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.733 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.733 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.734 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.734 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.734 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.734 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:35:40.734 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.735 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.735 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.735 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.735 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:35:40.736 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.736 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.736 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.736 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.737 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.737 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.737 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.737 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.737 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:35:40.738 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.738 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.738 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.738 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.738 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:35:40.739 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:40.739 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.739 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.739 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.740 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:35:40.740 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:35:40.740 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:35:40.740 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:35:40.740 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.741 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.741 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.741 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.741 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.742 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.742 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:40.742 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:35:40.742 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.743 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.743 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.743 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.743 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.744 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.744 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.744 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:40.744 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.745 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.745 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.745 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.745 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.746 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.746 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:35:40.746 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.746 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.747 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.747 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.747 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:35:40.747 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.748 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.748 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.748 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.749 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.749 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.749 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.749 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.750 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:35:40.750 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.750 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.750 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.751 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.751 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:35:40.751 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.751 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.751 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.752 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.752 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.752 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.752 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.753 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.753 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:35:40.753 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.753 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.753 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.754 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.754 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:35:40.754 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.754 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.755 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.755 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.755 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.755 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.756 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.756 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.756 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:35:40.756 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.756 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.757 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.757 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.757 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:35:40.757 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:40.757 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.758 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.758 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.758 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:35:40.758 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:35:40.759 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:35:40.759 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:35:40.759 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.759 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.760 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.760 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.760 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.760 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.760 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:40.761 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:35:40.761 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.761 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.761 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.762 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.762 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.762 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.762 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.763 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 121, 2021-11-15T19:35:40.763 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.763 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.763 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.763 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.764 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.764 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.764 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:35:40.764 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.765 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.765 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.765 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.765 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:35:40.765 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.766 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.766 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.766 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.766 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.767 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.767 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.767 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.767 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:35:40.768 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.768 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.768 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.768 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.768 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:35:40.769 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.769 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.769 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.769 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.769 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.770 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.770 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.770 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.770 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:35:40.771 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.771 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.771 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.771 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.771 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:35:40.772 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.772 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.772 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.772 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.773 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.773 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.773 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.773 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.774 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:35:40.774 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.774 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.774 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.774 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.775 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:35:40.775 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:40.775 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.775 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.775 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.776 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:35:40.776 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:35:40.776 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:35:40.776 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:35:40.776 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.777 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.777 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.777 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.777 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.778 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.778 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:40.778 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:35:40.778 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.778 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.779 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.779 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.779 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.779 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.779 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.780 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:40.780 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.780 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.780 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.781 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.781 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.781 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:35:40.782 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.782 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.782 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.782 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.783 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:35:40.783 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.783 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.783 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.784 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.784 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.784 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.784 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.784 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.785 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:35:40.785 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.785 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.785 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.786 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.786 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:35:40.786 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.786 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.786 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.787 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.787 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.787 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.787 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.788 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.788 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:35:40.788 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.788 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.788 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.789 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.789 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:35:40.789 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.789 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.790 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.790 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.790 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.790 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.791 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.791 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.791 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:35:40.791 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.791 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.792 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.792 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.792 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:35:40.792 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:40.793 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.793 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.793 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.793 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:35:40.793 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:35:40.794 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:35:40.794 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:35:40.794 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.794 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.795 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.795 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.795 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.795 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.795 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:40.796 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:35:40.796 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:40.796 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:40.796 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:40.797 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:40.797 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:40.797 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:40.797 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:40.797 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 129, 2021-11-15T19:35:40.798 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:40.798 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:40.798 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:40.799 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.799 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.799 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.799 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:35:40.799 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.800 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.800 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.800 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.800 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:35:40.801 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.801 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.801 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.801 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.802 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:40.802 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.802 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.803 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.803 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:35:40.803 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.803 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.803 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.804 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.804 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:35:40.804 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.804 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.805 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.805 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.805 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:40.805 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.806 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.806 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.806 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:35:40.806 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.806 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.807 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.807 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.807 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:35:40.807 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.808 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.808 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.814 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.814 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:40.814 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:40.815 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.815 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:40.815 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:35:40.815 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.816 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.816 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.816 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:40.816 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:35:40.817 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:40.817 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.817 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.817 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.817 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:35:40.818 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:35:40.818 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:35:40.818 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:35:40.818 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:40.819 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:40.819 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:40.819 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:40.819 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.819 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:40.820 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:35:40.820 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.820 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:40.820 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.820 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.821 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.821 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.821 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.821 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:35:40.821 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.822 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.822 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.822 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:40.822 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.823 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.823 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.823 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.823 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.823 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:35:40.824 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.824 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.824 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.824 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:40.825 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.825 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.825 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.825 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.825 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.826 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:35:40.826 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.826 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.826 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.827 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:40.827 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.827 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.827 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.827 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.828 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.828 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:35:40.828 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.828 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.829 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.829 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:40.829 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.829 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.829 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.830 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.830 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.830 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:35:40.830 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.831 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.831 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.831 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:40.831 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.832 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.832 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.832 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.832 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.832 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:35:40.833 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.833 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.833 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.833 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:40.834 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.834 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.834 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.834 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.835 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.835 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:35:40.835 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.835 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.836 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:40.836 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:40.836 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:40.836 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:40.836 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:40.837 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:40.837 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:40.837 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:35:40.837 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:40.838 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.838 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:40.838 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:35:40.838 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:35:40.838 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:35:40.839 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:35:40.839 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:35:40.839 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/4213511213": "2021-11-16T19:35:34.821282+0000", 2021-11-15T19:35:40.839 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/4213511213": "2021-11-16T19:35:34.821282+0000" 2021-11-15T19:35:40.839 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.840 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:35:40.840 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:35:40.840 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:35:40.840 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:35:40.841 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:35:40.841 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:35:40.841 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:35:40.841 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:35:40.841 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:40.842 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:40.842 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:35:40.842 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:35:40.842 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:35:40.842 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:35:40.843 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:35:40.843 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:40.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2be80536f0 msgr2=0x7f2be8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2be80536f0 0x7f2be8055bb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f2bec000ed0 tx=0x7f2bec0068b0).stop 2021-11-15T19:35:40.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 msgr2=0x7f2c0413f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c0413f630 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f2bf4002f70 tx=0x7f2bf4015000).stop 2021-11-15T19:35:40.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 shutdown_connections 2021-11-15T19:35:40.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2be80536f0 0x7f2be8055bb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2c040b1180 0x7f2c04156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2c040af2f0 0x7f2c04156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 --2- 172.21.2.137:0/69710862 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2c040acab0 0x7f2c0413f630 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 >> 172.21.2.137:0/69710862 conn(0x7f2c040630f0 msgr2=0x7f2c04140700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:40.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 shutdown_connections 2021-11-15T19:35:40.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.622+0000 7f2c0ab62700 1 -- 172.21.2.137:0/69710862 wait complete. 2021-11-15T19:35:40.847 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:40.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 Processor -- start 2021-11-15T19:35:40.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- start start 2021-11-15T19:35:40.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7e7014b230 0x7f7e70060e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b0c30 0x7f7e700b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7005ff60 con 0x7f7e700b25c0 2021-11-15T19:35:40.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7005fcc0 con 0x7f7e7014b230 2021-11-15T19:35:40.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7014a680 con 0x7f7e700b0c30 2021-11-15T19:35:40.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7e7014b230 0x7f7e70060e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f7e7014b230 0x7f7e70060e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40396/0 (socket says 172.21.2.137:40396) 2021-11-15T19:35:40.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 -- 172.21.2.137:0/309332000 learned_addr learned my addr 172.21.2.137:0/309332000 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:40.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 -- 172.21.2.137:0/309332000 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b0c30 msgr2=0x7f7e700b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:40.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 --2- 172.21.2.137:0/309332000 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b0c30 0x7f7e700b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 -- 172.21.2.137:0/309332000 >> v1:172.21.2.111:6789/0 conn(0x7f7e700b25c0 legacy=0x7f7e7014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:40.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 -- 172.21.2.137:0/309332000 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7005f940 con 0x7f7e7014b230 2021-11-15T19:35:40.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6e7fc700 1 --2- 172.21.2.137:0/309332000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70060e30 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f7e700b0720 tx=0x7f7e64006eb0).ready entity=mon.1 client_cookie=cb838c3524c90790 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6dffb700 1 -- 172.21.2.137:0/309332000 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6400d570 con 0x7f7e7014b230 2021-11-15T19:35:40.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6dffb700 1 -- 172.21.2.137:0/309332000 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64000e90 con 0x7f7e7014b230 2021-11-15T19:35:40.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e6dffb700 1 -- 172.21.2.137:0/309332000 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6400d8c0 con 0x7f7e7014b230 2021-11-15T19:35:40.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- 172.21.2.137:0/309332000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 msgr2=0x7f7e70060e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 --2- 172.21.2.137:0/309332000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70060e30 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f7e700b0720 tx=0x7f7e64006eb0).stop 2021-11-15T19:35:40.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- 172.21.2.137:0/309332000 shutdown_connections 2021-11-15T19:35:40.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 --2- 172.21.2.137:0/309332000 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b0c30 0x7f7e700b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 --2- 172.21.2.137:0/309332000 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70060e30 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:40.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- 172.21.2.137:0/309332000 >> 172.21.2.137:0/309332000 conn(0x7f7e70063980 msgr2=0x7f7e70063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:40.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- 172.21.2.137:0/309332000 shutdown_connections 2021-11-15T19:35:40.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- 172.21.2.137:0/309332000 wait complete. 2021-11-15T19:35:40.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 Processor -- start 2021-11-15T19:35:40.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.898+0000 7f7e75620700 1 -- start start 2021-11-15T19:35:40.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e700b0c30 0x7f7e700ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b25c0 0x7f7e70143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701449b0 con 0x7f7e700b0c30 2021-11-15T19:35:40.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70066980 con 0x7f7e7014b230 2021-11-15T19:35:40.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70067430 con 0x7f7e700b25c0 2021-11-15T19:35:40.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40402/0 (socket says 172.21.2.137:40402) 2021-11-15T19:35:40.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 -- 172.21.2.137:0/2177598624 learned_addr learned my addr 172.21.2.137:0/2177598624 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:40.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 -- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b25c0 msgr2=0x7f7e70143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b25c0 0x7f7e70143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 -- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e700b0c30 msgr2=0x7f7e700ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:40.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e700b0c30 0x7f7e700ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:40.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 -- 172.21.2.137:0/2177598624 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6400b1e0 con 0x7f7e7014b230 2021-11-15T19:35:40.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6f7fe700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70143fe0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f7e680032f0 tx=0x7f7e68009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6800d580 con 0x7f7e7014b230 2021-11-15T19:35:40.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6800d6e0 con 0x7f7e7014b230 2021-11-15T19:35:40.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6800da40 con 0x7f7e7014b230 2021-11-15T19:35:40.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e700665e0 con 0x7f7e7014b230 2021-11-15T19:35:40.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e70142180 con 0x7f7e7014b230 2021-11-15T19:35:40.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e70141300 con 0x7f7e7014b230 2021-11-15T19:35:40.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e6800dba0 con 0x7f7e7014b230 2021-11-15T19:35:40.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e5ffff700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e4c053660 0x7f7e4c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:40.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7e6806bb60 con 0x7f7e7014b230 2021-11-15T19:35:40.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.902+0000 7f7e6effd700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e4c053660 0x7f7e4c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:40.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.906+0000 7f7e6effd700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e4c053660 0x7f7e4c055b20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f7e60002f90 tx=0x7f7e600069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:40.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:40.906+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e68042e90 con 0x7f7e7014b230 2021-11-15T19:35:41.024 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e700573d0 con 0x7f7e7014b230 2021-11-15T19:35:41.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e5ffff700 1 -- 172.21.2.137:0/2177598624 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f7e680464b0 con 0x7f7e7014b230 2021-11-15T19:35:41.025 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:41.025 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66},{"gid":8242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/3244084101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3244084101},{"type":"v1","addr":"172.21.2.137:6833","nonce":3244084101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[]} 2021-11-15T19:35:41.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e4c053660 msgr2=0x7f7e4c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e4c053660 0x7f7e4c055b20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f7e60002f90 tx=0x7f7e600069b0).stop 2021-11-15T19:35:41.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 msgr2=0x7f7e70143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70143fe0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f7e680032f0 tx=0x7f7e68009220).stop 2021-11-15T19:35:41.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 shutdown_connections 2021-11-15T19:35:41.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7e4c053660 0x7f7e4c055b20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7e7014b230 0x7f7e70143fe0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7e700b25c0 0x7f7e70143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 --2- 172.21.2.137:0/2177598624 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7e700b0c30 0x7f7e700ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 >> 172.21.2.137:0/2177598624 conn(0x7f7e70063980 msgr2=0x7f7e700b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:41.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 shutdown_connections 2021-11-15T19:35:41.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.014+0000 7f7e75620700 1 -- 172.21.2.137:0/2177598624 wait complete. 2021-11-15T19:35:41.029 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 70 2021-11-15T19:35:41.032 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:41.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.070+0000 7fddbe01a700 1 Processor -- start 2021-11-15T19:35:41.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.070+0000 7fddbe01a700 1 -- start start 2021-11-15T19:35:41.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.070+0000 7fddbe01a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 0x7fddb8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fddb8143f00 0x7fddb8144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fddb80a9f50 0x7fddb80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb8148190 con 0x7fddb8143f00 2021-11-15T19:35:41.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80b1720 con 0x7fddb80a9f50 2021-11-15T19:35:41.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8147e70 con 0x7fddb80b1340 2021-11-15T19:35:41.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fddb80a9f50 0x7fddb80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fddb80a9f50 0x7fddb80aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40412/0 (socket says 172.21.2.137:40412) 2021-11-15T19:35:41.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 -- 172.21.2.137:0/1275320893 learned_addr learned my addr 172.21.2.137:0/1275320893 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:41.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 -- 172.21.2.137:0/1275320893 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 msgr2=0x7fddb8147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:41.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 --2- 172.21.2.137:0/1275320893 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 0x7fddb8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 -- 172.21.2.137:0/1275320893 >> v2:172.21.2.111:3300/0 conn(0x7fddb8143f00 msgr2=0x7fddb8144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:41.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 --2- 172.21.2.137:0/1275320893 >> v2:172.21.2.111:3300/0 conn(0x7fddb8143f00 0x7fddb8144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 -- 172.21.2.137:0/1275320893 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80af800 con 0x7fddb80a9f50 2021-11-15T19:35:41.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb7fff700 1 --2- 172.21.2.137:0/1275320893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb80aa370 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fddb00032f0 tx=0x7fddb0009290).ready entity=mon.1 client_cookie=d7055d28e63c55e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:41.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb67fc700 1 -- 172.21.2.137:0/1275320893 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb000b870 con 0x7fddb80a9f50 2021-11-15T19:35:41.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb67fc700 1 -- 172.21.2.137:0/1275320893 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000b9d0 con 0x7fddb80a9f50 2021-11-15T19:35:41.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb67fc700 1 -- 172.21.2.137:0/1275320893 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb000bb40 con 0x7fddb80a9f50 2021-11-15T19:35:41.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/1275320893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 msgr2=0x7fddb80aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- 172.21.2.137:0/1275320893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb80aa370 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fddb00032f0 tx=0x7fddb0009290).stop 2021-11-15T19:35:41.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/1275320893 shutdown_connections 2021-11-15T19:35:41.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- 172.21.2.137:0/1275320893 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb80aa370 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- 172.21.2.137:0/1275320893 >> v2:172.21.2.111:3300/0 conn(0x7fddb8143f00 0x7fddb8144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- 172.21.2.137:0/1275320893 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 0x7fddb8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/1275320893 >> 172.21.2.137:0/1275320893 conn(0x7fddb80b4e60 msgr2=0x7fddb80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:41.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/1275320893 shutdown_connections 2021-11-15T19:35:41.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/1275320893 wait complete. 2021-11-15T19:35:41.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 Processor -- start 2021-11-15T19:35:41.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- start start 2021-11-15T19:35:41.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb809a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 0x7fddb8148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddb8143f00 0x7fddb814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb813d7f0 con 0x7fddb8143f00 2021-11-15T19:35:41.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8148a00 con 0x7fddb80a9f50 2021-11-15T19:35:41.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8149070 con 0x7fddb80b1340 2021-11-15T19:35:41.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb809a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb809a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40414/0 (socket says 172.21.2.137:40414) 2021-11-15T19:35:41.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 -- 172.21.2.137:0/3653447954 learned_addr learned my addr 172.21.2.137:0/3653447954 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:41.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 -- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 msgr2=0x7fddb8148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 0x7fddb8148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 -- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddb8143f00 msgr2=0x7fddb814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddb8143f00 0x7fddb814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 -- 172.21.2.137:0/3653447954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0009530 con 0x7fddb80a9f50 2021-11-15T19:35:41.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb77fe700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb809a580 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fddb813e030 tx=0x7fdda8006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:41.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda8013460 con 0x7fddb80a9f50 2021-11-15T19:35:41.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda80135c0 con 0x7fddb80a9f50 2021-11-15T19:35:41.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80ae730 con 0x7fddb80a9f50 2021-11-15T19:35:41.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda8013920 con 0x7fddb80a9f50 2021-11-15T19:35:41.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.074+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb814b360 con 0x7fddb80a9f50 2021-11-15T19:35:41.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb80ae8c0 con 0x7fddb80a9f50 2021-11-15T19:35:41.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdda801a060 con 0x7fddb80a9f50 2021-11-15T19:35:41.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddb4ff9700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536a0 0x7fdd9c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fdda806b0e0 con 0x7fddb80a9f50 2021-11-15T19:35:41.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddb6ffd700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536a0 0x7fdd9c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddb6ffd700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536a0 0x7fdd9c055b60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fdda0002f70 tx=0x7fdda0006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:41.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.078+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdda8042410 con 0x7fddb80a9f50 2021-11-15T19:35:41.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.186+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddb805faf0 con 0x7fddb80a9f50 2021-11-15T19:35:41.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.186+0000 7fddb4ff9700 1 -- 172.21.2.137:0/3653447954 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fdda8018020 con 0x7fddb80a9f50 2021-11-15T19:35:41.199 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:41.199 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4985,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.111:6835/708972093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":708972093},{"type":"v1","addr":"172.21.2.111:6835","nonce":708972093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":66},{"gid":8242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.137:6833/3244084101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":3244084101},{"type":"v1","addr":"172.21.2.137:6833","nonce":3244084101}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[]} 2021-11-15T19:35:41.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.186+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536a0 msgr2=0x7fdd9c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.186+0000 7fddbe01a700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536a0 0x7fdd9c055b60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fdda0002f70 tx=0x7fdda0006a10).stop 2021-11-15T19:35:41.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.186+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 msgr2=0x7fddb809a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.186+0000 7fddbe01a700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb809a580 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fddb813e030 tx=0x7fdda8006e20).stop 2021-11-15T19:35:41.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 shutdown_connections 2021-11-15T19:35:41.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdd9c0536a0 0x7fdd9c055b60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fddb8143f00 0x7fddb814acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fddb80b1340 0x7fddb8148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 --2- 172.21.2.137:0/3653447954 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fddb80a9f50 0x7fddb809a580 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 >> 172.21.2.137:0/3653447954 conn(0x7fddb80b4e60 msgr2=0x7fddb813f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:41.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 shutdown_connections 2021-11-15T19:35:41.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.190+0000 7fddbe01a700 1 -- 172.21.2.137:0/3653447954 wait complete. 2021-11-15T19:35:41.203 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 70 2021-11-15T19:35:41.206 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:35:41.206 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:35:41.206 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:35:41.207 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:35:41.207 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:35:41.207 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:35:41.208 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:35:41.208 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:35:41.212 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:35:41.212 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:35:41.217 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:35:41.218 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:35:41.220 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:35:41.221 DEBUG:teuthology.parallel:result is None 2021-11-15T19:35:41.252 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:35:41.260 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:35:41.260 DEBUG:teuthology.parallel:result is None 2021-11-15T19:35:41.261 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:35:41.308 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:35:41.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 Processor -- start 2021-11-15T19:35:41.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- start start 2021-11-15T19:35:41.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 0x7f3884065440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38841460c0 con 0x7f3884146aa0 2021-11-15T19:35:41.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3884146360 con 0x7f38840b6010 2021-11-15T19:35:41.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3884146600 con 0x7f388405c650 2021-11-15T19:35:41.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f38840b6010 0x7f38840b05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59216/0 (socket says 172.21.2.137:59216) 2021-11-15T19:35:41.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 -- 172.21.2.137:0/3874796483 learned_addr learned my addr 172.21.2.137:0/3874796483 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:41.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997619515 0 0) 0x7f3884146360 con 0x7f38840b6010 2021-11-15T19:35:41.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3864003260 con 0x7f38840b6010 2021-11-15T19:35:41.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3883fff700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 0x7f3884065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532664702 0 0) 0x7f3864003260 con 0x7f38840b6010 2021-11-15T19:35:41.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 msgr2=0x7f3884065440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:41.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 0x7f3884065440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 >> v1:172.21.2.111:6789/0 conn(0x7f3884146aa0 legacy=0x7f3884066a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3884146f30 con 0x7f38840b6010 2021-11-15T19:35:41.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f3874001660 con 0x7f38840b6010 2021-11-15T19:35:41.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 >> v1:172.21.2.137:6789/0 conn(0x7f38840b6010 legacy=0x7f38840b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38640037d0 0x7f3864003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 0x7f3864004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3864004b10 0x7f3864004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884146600 con 0x7f3864004b10 2021-11-15T19:35:41.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386400b910 con 0x7f38640037d0 2021-11-15T19:35:41.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386400bad0 con 0x7f388405c650 2021-11-15T19:35:41.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38640037d0 0x7f3864003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 -- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 msgr2=0x7f3864004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:41.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f388405c650 0x7f3864004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 -- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3864004b10 msgr2=0x7f3864004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:41.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3864004b10 0x7f3864004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:41.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 -- 172.21.2.137:0/3874796483 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864003260 con 0x7f38640037d0 2021-11-15T19:35:41.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3888d51700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38640037d0 0x7f3864003bf0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f3874001370 tx=0x7f3884146250).ready entity=mon.1 client_cookie=f6d7c9634671f099 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:41.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38740070d0 con 0x7f38640037d0 2021-11-15T19:35:41.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874007230 con 0x7f38640037d0 2021-11-15T19:35:41.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f38837fe700 1 -- 172.21.2.137:0/3874796483 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f387400c8f0 con 0x7f38640037d0 2021-11-15T19:35:41.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- 172.21.2.137:0/3874796483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38640037d0 msgr2=0x7f3864003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 --2- 172.21.2.137:0/3874796483 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f38640037d0 0x7f3864003bf0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f3874001370 tx=0x7f3884146250).stop 2021-11-15T19:35:41.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f3889552700 1 -- 172.21.2.137:0/3874796483 reap_dead start 2021-11-15T19:35:41.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- 172.21.2.137:0/3874796483 shutdown_connections 2021-11-15T19:35:41.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- 172.21.2.137:0/3874796483 >> 172.21.2.137:0/3874796483 conn(0x7f3884063c30 msgr2=0x7f38840b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:41.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- 172.21.2.137:0/3874796483 shutdown_connections 2021-11-15T19:35:41.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.318+0000 7f388afb5700 1 -- 172.21.2.137:0/3874796483 wait complete. 2021-11-15T19:35:41.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 Processor -- start 2021-11-15T19:35:41.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- start start 2021-11-15T19:35:41.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38640037d0 0x7f388413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 0x7f3884145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38840af390 0x7f38840af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884150f40 con 0x7f38640037d0 2021-11-15T19:35:41.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38840ad430 con 0x7f3884145a80 2021-11-15T19:35:41.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38840ad6d0 con 0x7f38840af390 2021-11-15T19:35:41.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 0x7f3884145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 0x7f3884145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40450/0 (socket says 172.21.2.137:40450) 2021-11-15T19:35:41.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 -- 172.21.2.137:0/1429661571 learned_addr learned my addr 172.21.2.137:0/1429661571 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:41.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3888d51700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38640037d0 0x7f388413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3889552700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38840af390 0x7f38840af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 -- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38840af390 msgr2=0x7f38840af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38840af390 0x7f38840af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 -- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38640037d0 msgr2=0x7f388413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:41.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38640037d0 0x7f388413ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 -- 172.21.2.137:0/1429661571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38840ade10 con 0x7f3884145a80 2021-11-15T19:35:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3883fff700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 0x7f3884145410 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f386c00a000 tx=0x7f386c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386c016070 con 0x7f3884145a80 2021-11-15T19:35:41.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c000e90 con 0x7f3884145a80 2021-11-15T19:35:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388409deb0 con 0x7f3884145a80 2021-11-15T19:35:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386c011970 con 0x7f3884145a80 2021-11-15T19:35:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3884151600 con 0x7f3884145a80 2021-11-15T19:35:41.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38840ad290 con 0x7f3884145a80 2021-11-15T19:35:41.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f386c011ad0 con 0x7f3884145a80 2021-11-15T19:35:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3881ffb700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3868053580 0x7f3868055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f386c06b450 con 0x7f3884145a80 2021-11-15T19:35:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.322+0000 7f3888d51700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3868053580 0x7f3868055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:41.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.326+0000 7f3888d51700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3868053580 0x7f3868055a40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f3874018000 tx=0x7f3874015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:41.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.326+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38840ad290 con 0x7f3884145a80 2021-11-15T19:35:41.431 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:41.422+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f38840ad290 con 0x7f3884145a80 2021-11-15T19:35:42.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.258+0000 7f3881ffb700 1 -- 172.21.2.137:0/1429661571 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v136) v1 ==== 97+0+0 (secure 0 0 0) 0x7f38840ad290 con 0x7f3884145a80 2021-11-15T19:35:42.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3868053580 msgr2=0x7f3868055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3868053580 0x7f3868055a40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f3874018000 tx=0x7f3874015000).stop 2021-11-15T19:35:42.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 msgr2=0x7f3884145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 0x7f3884145410 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f386c00a000 tx=0x7f386c008040).stop 2021-11-15T19:35:42.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 shutdown_connections 2021-11-15T19:35:42.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3868053580 0x7f3868055a40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f38840af390 0x7f38840af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3884145a80 0x7f3884145410 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 --2- 172.21.2.137:0/1429661571 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f38640037d0 0x7f388413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 >> 172.21.2.137:0/1429661571 conn(0x7f3884063c30 msgr2=0x7f3884141bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 shutdown_connections 2021-11-15T19:35:42.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.262+0000 7f388afb5700 1 -- 172.21.2.137:0/1429661571 wait complete. 2021-11-15T19:35:42.275 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:35:42.280 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:35:42.281 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:35:42.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.322+0000 7fd73a061700 1 Processor -- start 2021-11-15T19:35:42.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- start start 2021-11-15T19:35:42.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd7340b1340 0x7fd734147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd734143f00 0x7fd734144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd734148190 con 0x7fd7340a9f50 2021-11-15T19:35:42.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7340b1720 con 0x7fd7340b1340 2021-11-15T19:35:42.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd734147e70 con 0x7fd734143f00 2021-11-15T19:35:42.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd734143f00 0x7fd734144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd734143f00 0x7fd734144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40454/0 (socket says 172.21.2.137:40454) 2021-11-15T19:35:42.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 -- 172.21.2.137:0/3514749334 learned_addr learned my addr 172.21.2.137:0/3514749334 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:42.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 -- 172.21.2.137:0/3514749334 >> v2:172.21.2.111:3300/0 conn(0x7fd7340b1340 msgr2=0x7fd734147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:42.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 --2- 172.21.2.137:0/3514749334 >> v2:172.21.2.111:3300/0 conn(0x7fd7340b1340 0x7fd734147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 -- 172.21.2.137:0/3514749334 >> v1:172.21.2.111:6789/0 conn(0x7fd7340a9f50 legacy=0x7fd7340aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:42.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 -- 172.21.2.137:0/3514749334 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7340af800 con 0x7fd734143f00 2021-11-15T19:35:42.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd732ffd700 1 --2- 172.21.2.137:0/3514749334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734144390 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fd734062250 tx=0x7fd724006eb0).ready entity=mon.1 client_cookie=9011807119cb52fc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd7327fc700 1 -- 172.21.2.137:0/3514749334 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72400d5c0 con 0x7fd734143f00 2021-11-15T19:35:42.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd7327fc700 1 -- 172.21.2.137:0/3514749334 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd724000e90 con 0x7fd734143f00 2021-11-15T19:35:42.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd7327fc700 1 -- 172.21.2.137:0/3514749334 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72400d910 con 0x7fd734143f00 2021-11-15T19:35:42.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- 172.21.2.137:0/3514749334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 msgr2=0x7fd734144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- 172.21.2.137:0/3514749334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734144390 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fd734062250 tx=0x7fd724006eb0).stop 2021-11-15T19:35:42.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- 172.21.2.137:0/3514749334 shutdown_connections 2021-11-15T19:35:42.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- 172.21.2.137:0/3514749334 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734144390 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- 172.21.2.137:0/3514749334 >> v2:172.21.2.111:3300/0 conn(0x7fd7340b1340 0x7fd734147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- 172.21.2.137:0/3514749334 >> 172.21.2.137:0/3514749334 conn(0x7fd7340b4e60 msgr2=0x7fd7340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- 172.21.2.137:0/3514749334 shutdown_connections 2021-11-15T19:35:42.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- 172.21.2.137:0/3514749334 wait complete. 2021-11-15T19:35:42.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 Processor -- start 2021-11-15T19:35:42.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- start start 2021-11-15T19:35:42.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7340a9f50 0x7fd7340ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7340b1340 0x7fd734148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73413ffb0 con 0x7fd7340b1340 2021-11-15T19:35:42.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341407c0 con 0x7fd734143f00 2021-11-15T19:35:42.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.326+0000 7fd73a061700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341401e0 con 0x7fd7340a9f50 2021-11-15T19:35:42.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40464/0 (socket says 172.21.2.137:40464) 2021-11-15T19:35:42.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 -- 172.21.2.137:0/3093746143 learned_addr learned my addr 172.21.2.137:0/3093746143 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:42.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd732ffd700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7340b1340 0x7fd734148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 -- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7340a9f50 msgr2=0x7fd7340ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd7337fe700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7340a9f50 0x7fd7340ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7340a9f50 0x7fd7340ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 -- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7340b1340 msgr2=0x7fd734148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7340b1340 0x7fd734148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 -- 172.21.2.137:0/3093746143 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72400b1e0 con 0x7fd734143f00 2021-11-15T19:35:42.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd7337fe700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7340a9f50 0x7fd7340ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:42.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd732ffd700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7340b1340 0x7fd734148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:42.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd733fff700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734149e40 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fd72c003270 tx=0x7fd72c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72c00d4a0 con 0x7fd734143f00 2021-11-15T19:35:42.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c00d600 con 0x7fd734143f00 2021-11-15T19:35:42.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72c00d960 con 0x7fd734143f00 2021-11-15T19:35:42.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd734140a60 con 0x7fd734143f00 2021-11-15T19:35:42.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73414a330 con 0x7fd734143f00 2021-11-15T19:35:42.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7341403a0 con 0x7fd734143f00 2021-11-15T19:35:42.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd72c018030 con 0x7fd734143f00 2021-11-15T19:35:42.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd730ff9700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7180536d0 0x7fd718055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd72c06b870 con 0x7fd734143f00 2021-11-15T19:35:42.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd7337fe700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7180536d0 0x7fd718055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.330+0000 7fd7337fe700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7180536d0 0x7fd718055b90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fd71c007000 tx=0x7fd71c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.334+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd72c042ca0 con 0x7fd734143f00 2021-11-15T19:35:42.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.442+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd7340573d0 con 0x7fd734143f00 2021-11-15T19:35:42.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd730ff9700 1 -- 172.21.2.137:0/3093746143 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fd72c020030 con 0x7fd734143f00 2021-11-15T19:35:42.456 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:42.456 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:42.456 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:35:42.456 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.457 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:35:42.457 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:35:42.457 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.457 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:42.458 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.458 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.458 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.458 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.459 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.459 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.459 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:35:42.459 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:35:42.459 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.460 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:42.460 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.460 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.460 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.461 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.461 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.461 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.461 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:35:42.461 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:35:42.462 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.462 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.462 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.462 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.463 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.463 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.463 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.463 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:35:42.464 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:35:42.464 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.464 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.464 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.464 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.465 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.465 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.465 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.465 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:35:42.465 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:35:42.466 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.466 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.466 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.466 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.467 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.467 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.467 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.467 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:35:42.467 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:35:42.468 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.468 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.468 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.468 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.469 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.469 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.469 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.469 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:35:42.469 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:35:42.470 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.470 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.470 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.470 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.471 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.471 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.471 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.471 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:35:42.471 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:35:42.472 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.472 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.472 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.472 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.473 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.473 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.473 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.473 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:35:42.473 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:35:42.474 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.474 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.474 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.474 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.475 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.475 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.475 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.475 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:35:42.475 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:35:42.476 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.476 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.476 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.477 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.477 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.477 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.478 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.478 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:35:42.478 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:35:42.479 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.479 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:42.479 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:35:42.479 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:35:42.480 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.480 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.480 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.481 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:35:42.481 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:35:42.481 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.482 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:42.482 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:35:42.483 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:35:42.483 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.483 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.483 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.484 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:35:42.484 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:35:42.484 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.485 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:35:42.485 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:35:42.485 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:35:42.486 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.486 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.486 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.486 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:35:42.486 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:35:42.487 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.487 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:35:42.487 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:35:42.487 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:35:42.488 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.488 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.488 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.488 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.489 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:35:42.489 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:35:42.489 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.489 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:35:42.489 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:35:42.490 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.490 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.490 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:42.490 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:42.491 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:35:42.491 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:35:42.491 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:35:42.491 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:35:42.491 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:35:42.492 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:35:42.492 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.492 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:42.492 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:42.492 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:42.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7180536d0 msgr2=0x7fd718055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7180536d0 0x7fd718055b90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fd71c007000 tx=0x7fd71c008040).stop 2021-11-15T19:35:42.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 msgr2=0x7fd734149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734149e40 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fd72c003270 tx=0x7fd72c0090f0).stop 2021-11-15T19:35:42.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 shutdown_connections 2021-11-15T19:35:42.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd7180536d0 0x7fd718055b90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd734143f00 0x7fd734149e40 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd7340b1340 0x7fd734148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 --2- 172.21.2.137:0/3093746143 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd7340a9f50 0x7fd7340ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 >> 172.21.2.137:0/3093746143 conn(0x7fd7340b4e60 msgr2=0x7fd73413e670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 shutdown_connections 2021-11-15T19:35:42.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.446+0000 7fd73a061700 1 -- 172.21.2.137:0/3093746143 wait complete. 2021-11-15T19:35:42.498 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:42.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe561c2c700 1 Processor -- start 2021-11-15T19:35:42.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe561c2c700 1 -- start start 2021-11-15T19:35:42.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe561c2c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe55c147980 0x7fe55c0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe561c2c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c148190 con 0x7fe55c0b1340 2021-11-15T19:35:42.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe561c2c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0b1720 con 0x7fe55c144610 2021-11-15T19:35:42.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe561c2c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c0af800 con 0x7fe55c147980 2021-11-15T19:35:42.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55affd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe55c144610 0x7fe55c0a9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59250/0 (socket says 172.21.2.137:59250) 2021-11-15T19:35:42.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55affd700 1 -- 172.21.2.137:0/3115416970 learned_addr learned my addr 172.21.2.137:0/3115416970 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:42.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377657680 0 0) 0x7fe55c0b1720 con 0x7fe55c144610 2021-11-15T19:35:42.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe53c003260 con 0x7fe55c144610 2021-11-15T19:35:42.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55bfff700 1 --2- 172.21.2.137:0/3115416970 >> v2:172.21.2.111:3300/0 conn(0x7fe55c147980 0x7fe55c0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1415232924 0 0) 0x7fe53c003260 con 0x7fe55c144610 2021-11-15T19:35:42.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 >> v2:172.21.2.111:3300/0 conn(0x7fe55c147980 msgr2=0x7fe55c0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 --2- 172.21.2.137:0/3115416970 >> v2:172.21.2.111:3300/0 conn(0x7fe55c147980 0x7fe55c0aa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 >> v1:172.21.2.111:6789/0 conn(0x7fe55c0b1340 legacy=0x7fe55c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c05faf0 con 0x7fe55c144610 2021-11-15T19:35:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe54c001660 con 0x7fe55c144610 2021-11-15T19:35:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 >> v1:172.21.2.137:6789/0 conn(0x7fe55c144610 legacy=0x7fe55c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c003750 0x7fe53c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.538+0000 7fe55a7fc700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe53c004500 0x7fe53c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe53c004f90 0x7fe53c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0af800 con 0x7fe53c004500 2021-11-15T19:35:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c00bf20 con 0x7fe53c004f90 2021-11-15T19:35:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c00c0e0 con 0x7fe53c003750 2021-11-15T19:35:42.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe53c004f90 0x7fe53c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/3115416970 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c003750 msgr2=0x7fe53c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c003750 0x7fe53c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/3115416970 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe53c004500 msgr2=0x7fe53c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe53c004500 0x7fe53c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/3115416970 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c003260 con 0x7fe53c004f90 2021-11-15T19:35:42.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/3115416970 reap_dead start 2021-11-15T19:35:42.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe53c004f90 0x7fe53c00b750 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fe554007000 tx=0x7fe554008040).ready entity=mon.1 client_cookie=8f6bdc6ba6fb183b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.559 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe554015070 con 0x7fe53c004f90 2021-11-15T19:35:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55400c640 con 0x7fe53c004f90 2021-11-15T19:35:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55a7fc700 1 -- 172.21.2.137:0/3115416970 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe55400a4a0 con 0x7fe53c004f90 2021-11-15T19:35:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/3115416970 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe53c004f90 msgr2=0x7fe53c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe53c004f90 0x7fe53c00b750 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fe554007000 tx=0x7fe554008040).stop 2021-11-15T19:35:42.560 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/3115416970 shutdown_connections 2021-11-15T19:35:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 --2- 172.21.2.137:0/3115416970 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe53c004f90 0x7fe53c00b750 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/3115416970 >> 172.21.2.137:0/3115416970 conn(0x7fe55c0b4e60 msgr2=0x7fe55c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/3115416970 shutdown_connections 2021-11-15T19:35:42.561 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/3115416970 wait complete. 2021-11-15T19:35:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 Processor -- start 2021-11-15T19:35:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- start start 2021-11-15T19:35:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c004f90 0x7fe55c0ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe55c15a170 0x7fe55c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 0x7fe55c13d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c13daa0 con 0x7fe55c15a170 2021-11-15T19:35:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c15a6f0 con 0x7fe55c13cc30 2021-11-15T19:35:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c098340 con 0x7fe53c004f90 2021-11-15T19:35:42.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 0x7fe55c13d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 0x7fe55c13d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40482/0 (socket says 172.21.2.137:40482) 2021-11-15T19:35:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/1836296601 learned_addr learned my addr 172.21.2.137:0/1836296601 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55affd700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe55c15a170 0x7fe55c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c004f90 msgr2=0x7fe55c0ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55b7fe700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c004f90 0x7fe55c0ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c004f90 0x7fe55c0ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe55c15a170 msgr2=0x7fe55c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe55c15a170 0x7fe55c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 -- 172.21.2.137:0/1836296601 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0985e0 con 0x7fe55c13cc30 2021-11-15T19:35:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55affd700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe55c15a170 0x7fe55c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe55bfff700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 0x7fe55c13d0e0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fe554007000 tx=0x7fe554008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe554020070 con 0x7fe55c13cc30 2021-11-15T19:35:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554011cf0 con 0x7fe55c13cc30 2021-11-15T19:35:42.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe55400a4a0 con 0x7fe55c13cc30 2021-11-15T19:35:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c13d5d0 con 0x7fe55c13cc30 2021-11-15T19:35:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.542+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c146640 con 0x7fe55c13cc30 2021-11-15T19:35:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c098770 con 0x7fe55c13cc30 2021-11-15T19:35:42.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe55401b610 con 0x7fe55c13cc30 2021-11-15T19:35:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe558ff9700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe5400535b0 0x7fe540055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe55406cbb0 con 0x7fe55c13cc30 2021-11-15T19:35:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe55b7fe700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe5400535b0 0x7fe540055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe55b7fe700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe5400535b0 0x7fe540055a70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fe544007000 tx=0x7fe544008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.570 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.546+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe554043ed0 con 0x7fe55c13cc30 2021-11-15T19:35:42.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe55c0573d0 con 0x7fe55c13cc30 2021-11-15T19:35:42.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe558ff9700 1 -- 172.21.2.137:0/1836296601 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+13191 (secure 0 0 0) 0x7fe554011e60 con 0x7fe55c13cc30 2021-11-15T19:35:42.641 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:42.642 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":136,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:42.258048+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:42.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe5400535b0 msgr2=0x7fe540055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe5400535b0 0x7fe540055a70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fe544007000 tx=0x7fe544008040).stop 2021-11-15T19:35:42.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 msgr2=0x7fe55c13d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 0x7fe55c13d0e0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fe554007000 tx=0x7fe554008040).stop 2021-11-15T19:35:42.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 shutdown_connections 2021-11-15T19:35:42.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe5400535b0 0x7fe540055a70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe55c13cc30 0x7fe55c13d0e0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe55c15a170 0x7fe55c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 --2- 172.21.2.137:0/1836296601 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe53c004f90 0x7fe55c0ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 >> 172.21.2.137:0/1836296601 conn(0x7fe55c0b4e60 msgr2=0x7fe55c0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 shutdown_connections 2021-11-15T19:35:42.645 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.630+0000 7fe561c2c700 1 -- 172.21.2.137:0/1836296601 wait complete. 2021-11-15T19:35:42.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:35:42.649 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:42.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.690+0000 7f11008e0700 1 Processor -- start 2021-11-15T19:35:42.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.690+0000 7f11008e0700 1 -- start start 2021-11-15T19:35:42.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f10fc0b72e0 0x7f10fc0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0acd60 0x7f10fc0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f10fc0b4680 0x7f10fc143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0b3100 con 0x7f10fc0b72e0 2021-11-15T19:35:42.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0b76c0 con 0x7f10fc0b4680 2021-11-15T19:35:42.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc12a170 con 0x7f10fc0acd60 2021-11-15T19:35:42.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f10fc0b4680 0x7f10fc143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f10fc0b4680 0x7f10fc143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40486/0 (socket says 172.21.2.137:40486) 2021-11-15T19:35:42.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3035796977 learned_addr learned my addr 172.21.2.137:0/3035796977 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:42.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3035796977 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0acd60 msgr2=0x7f10fc0b4190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:42.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- 172.21.2.137:0/3035796977 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0acd60 0x7f10fc0b4190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3035796977 >> v2:172.21.2.111:3300/0 conn(0x7f10fc0b72e0 msgr2=0x7f10fc0b19b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:42.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- 172.21.2.137:0/3035796977 >> v2:172.21.2.111:3300/0 conn(0x7f10fc0b72e0 0x7f10fc0b19b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3035796977 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0ad8a0 con 0x7f10fc0b4680 2021-11-15T19:35:42.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- 172.21.2.137:0/3035796977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b4680 0x7f10fc143ed0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f10f40032f0 tx=0x7f10f4009290).ready entity=mon.1 client_cookie=c14b99f98fa94a6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10f959a700 1 -- 172.21.2.137:0/3035796977 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f400b870 con 0x7f10fc0b4680 2021-11-15T19:35:42.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10f959a700 1 -- 172.21.2.137:0/3035796977 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400b9d0 con 0x7f10fc0b4680 2021-11-15T19:35:42.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10f959a700 1 -- 172.21.2.137:0/3035796977 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f400bb80 con 0x7f10fc0b4680 2021-11-15T19:35:42.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3035796977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b4680 msgr2=0x7f10fc143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- 172.21.2.137:0/3035796977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b4680 0x7f10fc143ed0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f10f40032f0 tx=0x7f10f4009290).stop 2021-11-15T19:35:42.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3035796977 shutdown_connections 2021-11-15T19:35:42.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- 172.21.2.137:0/3035796977 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b4680 0x7f10fc143ed0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- 172.21.2.137:0/3035796977 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0acd60 0x7f10fc0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- 172.21.2.137:0/3035796977 >> v2:172.21.2.111:3300/0 conn(0x7f10fc0b72e0 0x7f10fc0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3035796977 >> 172.21.2.137:0/3035796977 conn(0x7f10fc064960 msgr2=0x7f10fc064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3035796977 shutdown_connections 2021-11-15T19:35:42.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3035796977 wait complete. 2021-11-15T19:35:42.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 Processor -- start 2021-11-15T19:35:42.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- start start 2021-11-15T19:35:42.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10fc0acd60 0x7f10fc124bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0b4680 0x7f10fc0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 0x7f10fc13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc142e10 con 0x7f10fc0acd60 2021-11-15T19:35:42.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc143070 con 0x7f10fc0b72e0 2021-11-15T19:35:42.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc144590 con 0x7f10fc0b4680 2021-11-15T19:35:42.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 0x7f10fc13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 0x7f10fc13fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40496/0 (socket says 172.21.2.137:40496) 2021-11-15T19:35:42.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3464179608 learned_addr learned my addr 172.21.2.137:0/3464179608 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:42.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0b4680 msgr2=0x7f10fc0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0b4680 0x7f10fc0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10fc0acd60 msgr2=0x7f10fc124bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10fc0acd60 0x7f10fc124bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 -- 172.21.2.137:0/3464179608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009530 con 0x7f10fc0b72e0 2021-11-15T19:35:42.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10fad9d700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 0x7f10fc13fbc0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f10f40032f0 tx=0x7f10f4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f400b870 con 0x7f10fc0b72e0 2021-11-15T19:35:42.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4021630 con 0x7f10fc0b72e0 2021-11-15T19:35:42.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f4021990 con 0x7f10fc0b72e0 2021-11-15T19:35:42.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc0af290 con 0x7f10fc0b72e0 2021-11-15T19:35:42.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.694+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc0b0470 con 0x7f10fc0b72e0 2021-11-15T19:35:42.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc144d70 con 0x7f10fc0b72e0 2021-11-15T19:35:42.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10f4029070 con 0x7f10fc0b72e0 2021-11-15T19:35:42.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f10f37fe700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10e00536a0 0x7f10e0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f10f406c740 con 0x7f10fc0b72e0 2021-11-15T19:35:42.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f10fa59c700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10e00536a0 0x7f10e0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f10fa59c700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10e00536a0 0x7f10e0055b60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f10e4000ed0 tx=0x7f10e4006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.698+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10f4043bd0 con 0x7f10fc0b72e0 2021-11-15T19:35:42.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f10fc144750 con 0x7f10fc0b72e0 2021-11-15T19:35:42.794 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f10f37fe700 1 -- 172.21.2.137:0/3464179608 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7f10f4015070 con 0x7f10fc0b72e0 2021-11-15T19:35:42.794 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:42.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10e00536a0 msgr2=0x7f10e0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.795 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10e00536a0 0x7f10e0055b60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f10e4000ed0 tx=0x7f10e4006930).stop 2021-11-15T19:35:42.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 msgr2=0x7f10fc13fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 0x7f10fc13fbc0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f10f40032f0 tx=0x7f10f4016000).stop 2021-11-15T19:35:42.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 shutdown_connections 2021-11-15T19:35:42.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f10e00536a0 0x7f10e0055b60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.796 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f10fc0b72e0 0x7f10fc13fbc0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f10fc0b4680 0x7f10fc0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 --2- 172.21.2.137:0/3464179608 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f10fc0acd60 0x7f10fc124bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.782+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 >> 172.21.2.137:0/3464179608 conn(0x7f10fc064960 msgr2=0x7f10fc062f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.797 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.786+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 shutdown_connections 2021-11-15T19:35:42.798 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.786+0000 7f11008e0700 1 -- 172.21.2.137:0/3464179608 wait complete. 2021-11-15T19:35:42.801 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:42.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 Processor -- start 2021-11-15T19:35:42.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 -- start start 2021-11-15T19:35:42.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc005c770 0x7f8cc00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8cc00b0550 0x7f8cc014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc005cb50 con 0x7f8cc014aaa0 2021-11-15T19:35:42.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc00b1650 con 0x7f8cc00b0550 2021-11-15T19:35:42.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cc5ade700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00ad030 con 0x7f8cc005c770 2021-11-15T19:35:42.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cbffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8cc014aaa0 0x7f8cc0140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59284/0 (socket says 172.21.2.137:59284) 2021-11-15T19:35:42.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cbffff700 1 -- 172.21.2.137:0/4140627528 learned_addr learned my addr 172.21.2.137:0/4140627528 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:42.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263405323 0 0) 0x7f8cc005cb50 con 0x7f8cc014aaa0 2021-11-15T19:35:42.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.842+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0003260 con 0x7f8cc014aaa0 2021-11-15T19:35:42.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420199835 0 0) 0x7f8ca0003260 con 0x7f8cc014aaa0 2021-11-15T19:35:42.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc005c770 msgr2=0x7f8cc00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc005c770 0x7f8cc00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 >> v2:172.21.2.111:3300/0 conn(0x7f8cc00b0550 msgr2=0x7f8cc014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 --2- 172.21.2.137:0/4140627528 >> v2:172.21.2.111:3300/0 conn(0x7f8cc00b0550 0x7f8cc014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00ad2d0 con 0x7f8cc014aaa0 2021-11-15T19:35:42.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8cb80019e0 con 0x7f8cc014aaa0 2021-11-15T19:35:42.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 >> v1:172.21.2.137:6789/0 conn(0x7f8cc014aaa0 legacy=0x7f8cc0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ca0003750 0x7f8ca0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ca0004500 0x7f8ca0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004f90 0x7f8ca000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00b1650 con 0x7f8ca0004f90 2021-11-15T19:35:42.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00ad030 con 0x7f8ca0004500 2021-11-15T19:35:42.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000be50 con 0x7f8ca0003750 2021-11-15T19:35:42.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ca0004500 0x7f8ca0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbf7fe700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ca0003750 0x7f8ca0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ca0003750 msgr2=0x7f8ca0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ca0003750 0x7f8ca0003b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004f90 msgr2=0x7f8ca000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:42.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbffff700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004f90 0x7f8ca000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004f90 0x7f8ca000b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/4140627528 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0003260 con 0x7f8ca0004500 2021-11-15T19:35:42.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ca0004500 0x7f8ca0004980 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f8cb0002f70 tx=0x7f8cb0006ca0).ready entity=mon.1 client_cookie=8bf16b55fdb863f3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb0012410 con 0x7f8ca0004500 2021-11-15T19:35:42.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0012570 con 0x7f8ca0004500 2021-11-15T19:35:42.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbe7fc700 1 -- 172.21.2.137:0/4140627528 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb00128d0 con 0x7f8ca0004500 2021-11-15T19:35:42.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- 172.21.2.137:0/4140627528 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ca0004500 msgr2=0x7f8ca0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/4140627528 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ca0004500 0x7f8ca0004980 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f8cb0002f70 tx=0x7f8cb0006ca0).stop 2021-11-15T19:35:42.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbffff700 1 -- 172.21.2.137:0/4140627528 reap_dead start 2021-11-15T19:35:42.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- 172.21.2.137:0/4140627528 shutdown_connections 2021-11-15T19:35:42.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- 172.21.2.137:0/4140627528 >> 172.21.2.137:0/4140627528 conn(0x7f8cc00631e0 msgr2=0x7f8cc005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- 172.21.2.137:0/4140627528 shutdown_connections 2021-11-15T19:35:42.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- 172.21.2.137:0/4140627528 wait complete. 2021-11-15T19:35:42.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 Processor -- start 2021-11-15T19:35:42.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- start start 2021-11-15T19:35:42.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004500 0x7f8cc01564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 0x7f8cc00b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc0159e20 0x7f8cc015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0063e20 con 0x7f8ca0004500 2021-11-15T19:35:42.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0147820 con 0x7f8cc01416f0 2021-11-15T19:35:42.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cc5ade700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0063b80 con 0x7f8cc0159e20 2021-11-15T19:35:42.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 0x7f8cc00b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 0x7f8cc00b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40512/0 (socket says 172.21.2.137:40512) 2021-11-15T19:35:42.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/2254823757 learned_addr learned my addr 172.21.2.137:0/2254823757 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:42.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbf7fe700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004500 0x7f8cc01564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc0159e20 msgr2=0x7f8cc015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc0159e20 0x7f8cc015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004500 msgr2=0x7f8cc01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004500 0x7f8cc01564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 -- 172.21.2.137:0/2254823757 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0157640 con 0x7f8cc01416f0 2021-11-15T19:35:42.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbeffd700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 0x7f8cc00b53d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f8cb0002f70 tx=0x7f8cb0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb0012410 con 0x7f8cc01416f0 2021-11-15T19:35:42.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0012e90 con 0x7f8cc01416f0 2021-11-15T19:35:42.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.846+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb001d7d0 con 0x7f8cc01416f0 2021-11-15T19:35:42.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc0141c00 con 0x7f8cc01416f0 2021-11-15T19:35:42.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc015a930 con 0x7f8cc01416f0 2021-11-15T19:35:42.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc00ae7f0 con 0x7f8cc01416f0 2021-11-15T19:35:42.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8cb001a030 con 0x7f8cc01416f0 2021-11-15T19:35:42.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cbcff9700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ca4053610 0x7f8ca4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:42.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8cb006c9b0 con 0x7f8cc01416f0 2021-11-15T19:35:42.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cbf7fe700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ca4053610 0x7f8ca4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:42.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cbf7fe700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ca4053610 0x7f8ca4055ad0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f8ca800b000 tx=0x7f8ca8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:42.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.850+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8cb0043e40 con 0x7f8cc01416f0 2021-11-15T19:35:42.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cc005db30 con 0x7f8cc01416f0 2021-11-15T19:35:42.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cbcff9700 1 -- 172.21.2.137:0/2254823757 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cb0047460 con 0x7f8cc01416f0 2021-11-15T19:35:42.944 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:42.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ca4053610 msgr2=0x7f8ca4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ca4053610 0x7f8ca4055ad0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f8ca800b000 tx=0x7f8ca8008040).stop 2021-11-15T19:35:42.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 msgr2=0x7f8cc00b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:42.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 0x7f8cc00b53d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f8cb0002f70 tx=0x7f8cb0015000).stop 2021-11-15T19:35:42.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 shutdown_connections 2021-11-15T19:35:42.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ca4053610 0x7f8ca4055ad0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8cc0159e20 0x7f8cc015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:42.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8cc01416f0 0x7f8cc00b53d0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 --2- 172.21.2.137:0/2254823757 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ca0004500 0x7f8cc01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:42.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 >> 172.21.2.137:0/2254823757 conn(0x7f8cc00631e0 msgr2=0x7f8cc014dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:42.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 shutdown_connections 2021-11-15T19:35:42.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.934+0000 7f8cc5ade700 1 -- 172.21.2.137:0/2254823757 wait complete. 2021-11-15T19:35:42.952 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:35:43.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 Processor -- start 2021-11-15T19:35:43.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- start start 2021-11-15T19:35:43.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f65080b01a0 0x7f65080ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f650805cf80 0x7f650814a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6508146de0 con 0x7f65080adc30 2021-11-15T19:35:43.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080aea80 con 0x7f65080b01a0 2021-11-15T19:35:43.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6508147d10 con 0x7f650805cf80 2021-11-15T19:35:43.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e197700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f65080adc30 0x7f6508067540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59302/0 (socket says 172.21.2.137:59302) 2021-11-15T19:35:43.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e197700 1 -- 172.21.2.137:0/2168799371 learned_addr learned my addr 172.21.2.137:0/2168799371 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:43.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e998700 1 --2- 172.21.2.137:0/2168799371 >> v2:172.21.2.137:3300/0 conn(0x7f650805cf80 0x7f650814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d996700 1 --2- 172.21.2.137:0/2168799371 >> v2:172.21.2.111:3300/0 conn(0x7f65080b01a0 0x7f65080ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e998700 1 -- 172.21.2.137:0/2168799371 >> v2:172.21.2.111:3300/0 conn(0x7f65080b01a0 msgr2=0x7f65080ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:43.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e998700 1 --2- 172.21.2.137:0/2168799371 >> v2:172.21.2.111:3300/0 conn(0x7f65080b01a0 0x7f65080ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:43.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e998700 1 -- 172.21.2.137:0/2168799371 >> v1:172.21.2.137:6789/0 conn(0x7f65080adc30 legacy=0x7f6508067540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e998700 1 -- 172.21.2.137:0/2168799371 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080ae620 con 0x7f650805cf80 2021-11-15T19:35:43.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650e998700 1 --2- 172.21.2.137:0/2168799371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f650805cf80 0x7f650814a530 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f65000032f0 tx=0x7f65000091d0).ready entity=mon.1 client_cookie=1e670a7684240a97 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:43.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d195700 1 -- 172.21.2.137:0/2168799371 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6500009ea0 con 0x7f650805cf80 2021-11-15T19:35:43.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d195700 1 -- 172.21.2.137:0/2168799371 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000b870 con 0x7f650805cf80 2021-11-15T19:35:43.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d195700 1 -- 172.21.2.137:0/2168799371 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650000b9e0 con 0x7f650805cf80 2021-11-15T19:35:43.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- 172.21.2.137:0/2168799371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f650805cf80 msgr2=0x7f650814a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- 172.21.2.137:0/2168799371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f650805cf80 0x7f650814a530 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f65000032f0 tx=0x7f65000091d0).stop 2021-11-15T19:35:43.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- 172.21.2.137:0/2168799371 shutdown_connections 2021-11-15T19:35:43.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- 172.21.2.137:0/2168799371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f650805cf80 0x7f650814a530 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:43.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- 172.21.2.137:0/2168799371 >> v2:172.21.2.111:3300/0 conn(0x7f65080b01a0 0x7f65080ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:43.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- 172.21.2.137:0/2168799371 >> 172.21.2.137:0/2168799371 conn(0x7f65080630f0 msgr2=0x7f65080634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:43.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- 172.21.2.137:0/2168799371 shutdown_connections 2021-11-15T19:35:43.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- 172.21.2.137:0/2168799371 wait complete. 2021-11-15T19:35:43.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 Processor -- start 2021-11-15T19:35:43.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- start start 2021-11-15T19:35:43.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f650805cf80 0x7f650810f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 0x7f65080657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65080b01a0 0x7f65081430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6508064ca0 con 0x7f650805cf80 2021-11-15T19:35:43.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650814ae70 con 0x7f65080adc30 2021-11-15T19:35:43.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650f199700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650814abd0 con 0x7f65080b01a0 2021-11-15T19:35:43.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d996700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 0x7f65080657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d996700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 0x7f65080657c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40528/0 (socket says 172.21.2.137:40528) 2021-11-15T19:35:43.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.994+0000 7f650d996700 1 -- 172.21.2.137:0/2601897952 learned_addr learned my addr 172.21.2.137:0/2601897952 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:43.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650d996700 1 -- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65080b01a0 msgr2=0x7f65081430e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:43.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650d996700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65080b01a0 0x7f65081430e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650d996700 1 -- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f650805cf80 msgr2=0x7f650810f390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:43.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650d996700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f650805cf80 0x7f650810f390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650d996700 1 -- 172.21.2.137:0/2601897952 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500009470 con 0x7f65080adc30 2021-11-15T19:35:43.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650d996700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 0x7f65080657c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f64fc007000 tx=0x7f64fc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:43.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64fc00f5b0 con 0x7f65080adc30 2021-11-15T19:35:43.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00c030 con 0x7f65080adc30 2021-11-15T19:35:43.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64fc00f900 con 0x7f65080adc30 2021-11-15T19:35:43.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6508065100 con 0x7f65080adc30 2021-11-15T19:35:43.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65081122d0 con 0x7f65080adc30 2021-11-15T19:35:43.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508147990 con 0x7f65080adc30 2021-11-15T19:35:43.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64fc019030 con 0x7f65080adc30 2021-11-15T19:35:43.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f64fb7fe700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f64e8053580 0x7f64e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f64fc06af10 con 0x7f65080adc30 2021-11-15T19:35:43.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650e197700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f64e8053580 0x7f64e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:42.998+0000 7f650e197700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f64e8053580 0x7f64e8055a40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f65080b0020 tx=0x7f6504007770).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:43.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.002+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64fc042340 con 0x7f65080adc30 2021-11-15T19:35:43.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6508064e10 con 0x7f65080adc30 2021-11-15T19:35:43.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f64fb7fe700 1 -- 172.21.2.137:0/2601897952 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) v1 ==== 84+0+143 (secure 0 0 0) 0x7f64fc045960 con 0x7f65080adc30 2021-11-15T19:35:43.097 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:43.097 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:35:43.097 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:43.098 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:35:43.098 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:35:43.098 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:43.098 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:43.098 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:35:43.099 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:35:43.099 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:43.099 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:35:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f64e8053580 msgr2=0x7f64e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f64e8053580 0x7f64e8055a40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f65080b0020 tx=0x7f6504007770).stop 2021-11-15T19:35:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 msgr2=0x7f65080657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.100 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 0x7f65080657c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f64fc007000 tx=0x7f64fc008040).stop 2021-11-15T19:35:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 shutdown_connections 2021-11-15T19:35:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f64e8053580 0x7f64e8055a40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f65080b01a0 0x7f65081430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f65080adc30 0x7f65080657c0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:43.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 --2- 172.21.2.137:0/2601897952 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f650805cf80 0x7f650810f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 >> 172.21.2.137:0/2601897952 conn(0x7f65080630f0 msgr2=0x7f65080af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 shutdown_connections 2021-11-15T19:35:43.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.086+0000 7f650f199700 1 -- 172.21.2.137:0/2601897952 wait complete. 2021-11-15T19:35:43.104 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:35:43.105 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:35:43.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 Processor -- start 2021-11-15T19:35:43.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 -- start start 2021-11-15T19:35:43.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f546005c770 0x7f54600aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f54600b0550 0x7f546014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546005cb50 con 0x7f546014aaa0 2021-11-15T19:35:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600b1650 con 0x7f54600b0550 2021-11-15T19:35:43.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f5465f30700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600ad030 con 0x7f546005c770 2021-11-15T19:35:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f546005c770 0x7f54600aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f546005c770 0x7f54600aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40534/0 (socket says 172.21.2.137:40534) 2021-11-15T19:35:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 -- 172.21.2.137:0/2267216510 learned_addr learned my addr 172.21.2.137:0/2267216510 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:43.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 -- 172.21.2.137:0/2267216510 >> v2:172.21.2.111:3300/0 conn(0x7f54600b0550 msgr2=0x7f546014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 --2- 172.21.2.137:0/2267216510 >> v2:172.21.2.111:3300/0 conn(0x7f54600b0550 0x7f546014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 -- 172.21.2.137:0/2267216510 >> v1:172.21.2.111:6789/0 conn(0x7f546014aaa0 legacy=0x7f5460140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 -- 172.21.2.137:0/2267216510 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600ad2d0 con 0x7f546005c770 2021-11-15T19:35:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545f7fe700 1 --2- 172.21.2.137:0/2267216510 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f546005c770 0x7f54600aef30 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f54600aee10 tx=0x7f5450006eb0).ready entity=mon.1 client_cookie=c2077abb69fa8291 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:43.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545e7fc700 1 -- 172.21.2.137:0/2267216510 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545000d5c0 con 0x7f546005c770 2021-11-15T19:35:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545e7fc700 1 -- 172.21.2.137:0/2267216510 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450000e90 con 0x7f546005c770 2021-11-15T19:35:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.146+0000 7f545e7fc700 1 -- 172.21.2.137:0/2267216510 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545000d910 con 0x7f546005c770 2021-11-15T19:35:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/2267216510 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f546005c770 msgr2=0x7f54600aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 --2- 172.21.2.137:0/2267216510 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f546005c770 0x7f54600aef30 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f54600aee10 tx=0x7f5450006eb0).stop 2021-11-15T19:35:43.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/2267216510 shutdown_connections 2021-11-15T19:35:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 --2- 172.21.2.137:0/2267216510 >> v2:172.21.2.111:3300/0 conn(0x7f54600b0550 0x7f546014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 --2- 172.21.2.137:0/2267216510 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f546005c770 0x7f54600aef30 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/2267216510 >> 172.21.2.137:0/2267216510 conn(0x7f54600631e0 msgr2=0x7f546005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:43.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/2267216510 shutdown_connections 2021-11-15T19:35:43.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/2267216510 wait complete. 2021-11-15T19:35:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 Processor -- start 2021-11-15T19:35:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- start start 2021-11-15T19:35:43.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546005c770 0x7f5460066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 0x7f5460159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f546014aaa0 0x7f5460159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460157710 con 0x7f546014aaa0 2021-11-15T19:35:43.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460144c20 con 0x7f54600b0550 2021-11-15T19:35:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5460143c50 con 0x7f546005c770 2021-11-15T19:35:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 0x7f5460159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 0x7f5460159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40542/0 (socket says 172.21.2.137:40542) 2021-11-15T19:35:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 -- 172.21.2.137:0/4275246611 learned_addr learned my addr 172.21.2.137:0/4275246611 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:43.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 -- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546005c770 msgr2=0x7f5460066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546005c770 0x7f5460066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 -- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f546014aaa0 msgr2=0x7f5460159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f546014aaa0 0x7f5460159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 -- 172.21.2.137:0/4275246611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545000b1e0 con 0x7f54600b0550 2021-11-15T19:35:43.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545effd700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 0x7f5460159a60 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f5448002f70 tx=0x7f5448006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:43.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5448013460 con 0x7f54600b0550 2021-11-15T19:35:43.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54480135c0 con 0x7f54600b0550 2021-11-15T19:35:43.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5460142db0 con 0x7f54600b0550 2021-11-15T19:35:43.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5448013920 con 0x7f54600b0550 2021-11-15T19:35:43.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5460142b50 con 0x7f54600b0550 2021-11-15T19:35:43.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5460144d60 con 0x7f54600b0550 2021-11-15T19:35:43.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f544801a060 con 0x7f54600b0550 2021-11-15T19:35:43.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545cff9700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5444053720 0x7f5444055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:43.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.150+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f544806b0b0 con 0x7f54600b0550 2021-11-15T19:35:43.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.154+0000 7f545f7fe700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5444053720 0x7f5444055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:43.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.154+0000 7f545f7fe700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5444053720 0x7f5444055be0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f54600aee10 tx=0x7f5450015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:43.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.154+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5460144d60 con 0x7f54600b0550 2021-11-15T19:35:43.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:43.234+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5460142fa0 con 0x7f54600b0550 2021-11-15T19:35:44.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f545cff9700 1 -- 172.21.2.137:0/4275246611 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v137) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5448018030 con 0x7f54600b0550 2021-11-15T19:35:44.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5444053720 msgr2=0x7f5444055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:44.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5444053720 0x7f5444055be0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f54600aee10 tx=0x7f5450015000).stop 2021-11-15T19:35:44.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 msgr2=0x7f5460159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:44.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 0x7f5460159a60 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f5448002f70 tx=0x7f5448006ec0).stop 2021-11-15T19:35:44.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 shutdown_connections 2021-11-15T19:35:44.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f5444053720 0x7f5444055be0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:44.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f546014aaa0 0x7f5460159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:44.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f54600b0550 0x7f5460159a60 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:44.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 --2- 172.21.2.137:0/4275246611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546005c770 0x7f5460066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:44.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 >> 172.21.2.137:0/4275246611 conn(0x7f54600631e0 msgr2=0x7f54601402f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:44.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 shutdown_connections 2021-11-15T19:35:44.244 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.230+0000 7f5465f30700 1 -- 172.21.2.137:0/4275246611 wait complete. 2021-11-15T19:35:44.245 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:35:44.248 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:35:44.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 Processor -- start 2021-11-15T19:35:44.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- start start 2021-11-15T19:35:44.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 0x7f55e414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e405cb50 con 0x7f55e414aaa0 2021-11-15T19:35:44.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e40ad030 con 0x7f55e405c770 2021-11-15T19:35:44.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b1650 con 0x7f55e40b0550 2021-11-15T19:35:44.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e9cab700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f55e405c770 0x7f55e40aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59334/0 (socket says 172.21.2.137:59334) 2021-11-15T19:35:44.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e9cab700 1 -- 172.21.2.137:0/4042614381 learned_addr learned my addr 172.21.2.137:0/4042614381 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:44.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740455216 0 0) 0x7f55e40ad030 con 0x7f55e405c770 2021-11-15T19:35:44.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc003260 con 0x7f55e405c770 2021-11-15T19:35:44.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 0x7f55e414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73944370 0 0) 0x7f55cc003260 con 0x7f55e405c770 2021-11-15T19:35:44.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 msgr2=0x7f55e414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:44.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 0x7f55e414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:44.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 >> v1:172.21.2.111:6789/0 conn(0x7f55e414aaa0 legacy=0x7f55e4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:44.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40ad2d0 con 0x7f55e405c770 2021-11-15T19:35:44.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f55d4001660 con 0x7f55e405c770 2021-11-15T19:35:44.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 >> v1:172.21.2.137:6789/0 conn(0x7f55e405c770 legacy=0x7f55e40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:44.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 0x7f55cc003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.307 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55cc0049f0 0x7f55cc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b1650 con 0x7f55cc0049f0 2021-11-15T19:35:44.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc00b860 con 0x7f55cc003d10 2021-11-15T19:35:44.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc00ba20 con 0x7f55e40b0550 2021-11-15T19:35:44.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e9cab700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 0x7f55cc003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 -- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 msgr2=0x7f55cc003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:44.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e40b0550 0x7f55cc003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:44.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 -- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55cc0049f0 msgr2=0x7f55cc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:44.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55cc0049f0 0x7f55cc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:44.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 -- 172.21.2.137:0/4042614381 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc003260 con 0x7f55cc003d10 2021-11-15T19:35:44.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e94aa700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55cc004500 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f55e000a000 tx=0x7f55e0008040).ready entity=mon.1 client_cookie=12d615017ea22be8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:44.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e0013670 con 0x7f55cc003d10 2021-11-15T19:35:44.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e00137d0 con 0x7f55cc003d10 2021-11-15T19:35:44.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55e8ca9700 1 -- 172.21.2.137:0/4042614381 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e0013b30 con 0x7f55cc003d10 2021-11-15T19:35:44.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- 172.21.2.137:0/4042614381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 msgr2=0x7f55cc004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:44.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/4042614381 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55cc004500 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f55e000a000 tx=0x7f55e0008040).stop 2021-11-15T19:35:44.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ea4ac700 1 -- 172.21.2.137:0/4042614381 reap_dead start 2021-11-15T19:35:44.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- 172.21.2.137:0/4042614381 shutdown_connections 2021-11-15T19:35:44.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- 172.21.2.137:0/4042614381 >> 172.21.2.137:0/4042614381 conn(0x7f55e40631e0 msgr2=0x7f55e405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:44.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- 172.21.2.137:0/4042614381 shutdown_connections 2021-11-15T19:35:44.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.290+0000 7f55ebf0f700 1 -- 172.21.2.137:0/4042614381 wait complete. 2021-11-15T19:35:44.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 Processor -- start 2021-11-15T19:35:44.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- start start 2021-11-15T19:35:44.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55e4142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e4064ae0 0x7f55e4143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55e4064550 0x7f55e4116e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b45e0 con 0x7f55e4064550 2021-11-15T19:35:44.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e4143940 con 0x7f55cc003d10 2021-11-15T19:35:44.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e415a410 con 0x7f55e4064ae0 2021-11-15T19:35:44.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55e4142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55e4142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40560/0 (socket says 172.21.2.137:40560) 2021-11-15T19:35:44.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 -- 172.21.2.137:0/3433748714 learned_addr learned my addr 172.21.2.137:0/3433748714 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:44.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ea4ac700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55e4064550 0x7f55e4116e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e94aa700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e4064ae0 0x7f55e4143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 -- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e4064ae0 msgr2=0x7f55e4143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:44.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e4064ae0 0x7f55e4143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:44.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 -- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55e4064550 msgr2=0x7f55e4116e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:44.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55e4064550 0x7f55e4116e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:44.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 -- 172.21.2.137:0/3433748714 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e415a6b0 con 0x7f55cc003d10 2021-11-15T19:35:44.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e9cab700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55e4142f60 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f55e40649a0 tx=0x7f55d40014c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:44.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d4010710 con 0x7f55cc003d10 2021-11-15T19:35:44.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d4010870 con 0x7f55cc003d10 2021-11-15T19:35:44.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d4010bd0 con 0x7f55cc003d10 2021-11-15T19:35:44.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e4066840 con 0x7f55cc003d10 2021-11-15T19:35:44.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e41174d0 con 0x7f55cc003d10 2021-11-15T19:35:44.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e40ae7f0 con 0x7f55cc003d10 2021-11-15T19:35:44.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f55d4010d30 con 0x7f55cc003d10 2021-11-15T19:35:44.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55d2ffd700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55c4053640 0x7f55c4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:44.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f55d406bd30 con 0x7f55cc003d10 2021-11-15T19:35:44.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.294+0000 7f55e94aa700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55c4053640 0x7f55c4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:44.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.298+0000 7f55e94aa700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55c4053640 0x7f55c4055b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f55e0019000 tx=0x7f55e0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:44.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.298+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55d4043060 con 0x7f55cc003d10 2021-11-15T19:35:44.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:44.378+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f55e405db30 con 0x7f55cc003d10 2021-11-15T19:35:45.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.234+0000 7f55d2ffd700 1 -- 172.21.2.137:0/3433748714 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v138) v1 ==== 125+0+0 (secure 0 0 0) 0x7f55d4046680 con 0x7f55cc003d10 2021-11-15T19:35:45.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55c4053640 msgr2=0x7f55c4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55c4053640 0x7f55c4055b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f55e0019000 tx=0x7f55e0008040).stop 2021-11-15T19:35:45.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 msgr2=0x7f55e4142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55e4142f60 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f55e40649a0 tx=0x7f55d40014c0).stop 2021-11-15T19:35:45.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 shutdown_connections 2021-11-15T19:35:45.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f55c4053640 0x7f55c4055b00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f55e4064550 0x7f55e4116e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f55e4064ae0 0x7f55e4143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 --2- 172.21.2.137:0/3433748714 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f55cc003d10 0x7f55e4142f60 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 >> 172.21.2.137:0/3433748714 conn(0x7f55e40631e0 msgr2=0x7f55e405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 shutdown_connections 2021-11-15T19:35:45.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.238+0000 7f55ebf0f700 1 -- 172.21.2.137:0/3433748714 wait complete. 2021-11-15T19:35:45.251 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:35:45.254 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:35:45.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1ae172700 1 Processor -- start 2021-11-15T19:35:45.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1ae172700 1 -- start start 2021-11-15T19:35:45.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1ae172700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe1a805fd20 0x7fe1a80af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1ae172700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a8147f70 con 0x7fe1a80b0830 2021-11-15T19:35:45.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1ae172700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a8060100 con 0x7fe1a80b10b0 2021-11-15T19:35:45.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1ae172700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a8147cd0 con 0x7fe1a805fd20 2021-11-15T19:35:45.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a6ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe1a80b10b0 0x7fe1a80b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59350/0 (socket says 172.21.2.137:59350) 2021-11-15T19:35:45.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a6ffd700 1 -- 172.21.2.137:0/4004694626 learned_addr learned my addr 172.21.2.137:0/4004694626 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:45.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609101744 0 0) 0x7fe1a8060100 con 0x7fe1a80b10b0 2021-11-15T19:35:45.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe188003260 con 0x7fe1a80b10b0 2021-11-15T19:35:45.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420305002 0 0) 0x7fe188003260 con 0x7fe1a80b10b0 2021-11-15T19:35:45.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 >> v2:172.21.2.111:3300/0 conn(0x7fe1a805fd20 msgr2=0x7fe1a80af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:45.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a67fc700 1 --2- 172.21.2.137:0/4004694626 >> v2:172.21.2.111:3300/0 conn(0x7fe1a805fd20 0x7fe1a80af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.294+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 >> v1:172.21.2.111:6789/0 conn(0x7fe1a80b0830 legacy=0x7fe1a80aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:45.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80a9ed0 con 0x7fe1a80b10b0 2021-11-15T19:35:45.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fe198001660 con 0x7fe1a80b10b0 2021-11-15T19:35:45.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 >> v1:172.21.2.137:6789/0 conn(0x7fe1a80b10b0 legacy=0x7fe1a80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe188003750 0x7fe188003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.312 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe188004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe188004f90 0x7fe18800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8147cd0 con 0x7fe188003750 2021-11-15T19:35:45.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18800be80 con 0x7fe188004500 2021-11-15T19:35:45.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18800c040 con 0x7fe188004f90 2021-11-15T19:35:45.313 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe188004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 -- 172.21.2.137:0/4004694626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe188004f90 msgr2=0x7fe18800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:45.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe188004f90 0x7fe18800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 -- 172.21.2.137:0/4004694626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe188003750 msgr2=0x7fe188003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:45.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe188003750 0x7fe188003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 -- 172.21.2.137:0/4004694626 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188003260 con 0x7fe188004500 2021-11-15T19:35:45.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a7fff700 1 -- 172.21.2.137:0/4004694626 reap_dead start 2021-11-15T19:35:45.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe188004980 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fe1a80b4db0 tx=0x7fe1a80a9dc0).ready entity=mon.1 client_cookie=64c1d94452390e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1980070d0 con 0x7fe188004500 2021-11-15T19:35:45.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198007230 con 0x7fe188004500 2021-11-15T19:35:45.315 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a67fc700 1 -- 172.21.2.137:0/4004694626 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19800c9c0 con 0x7fe188004500 2021-11-15T19:35:45.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/4004694626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 msgr2=0x7fe188004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe188004980 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fe1a80b4db0 tx=0x7fe1a80a9dc0).stop 2021-11-15T19:35:45.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/4004694626 shutdown_connections 2021-11-15T19:35:45.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 --2- 172.21.2.137:0/4004694626 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe188004980 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/4004694626 >> 172.21.2.137:0/4004694626 conn(0x7fe1a80b4e60 msgr2=0x7fe1a80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/4004694626 shutdown_connections 2021-11-15T19:35:45.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/4004694626 wait complete. 2021-11-15T19:35:45.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 Processor -- start 2021-11-15T19:35:45.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- start start 2021-11-15T19:35:45.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe1a81565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1a81432f0 0x7fe1a80aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1a8140860 0x7fe1a8140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a81447d0 con 0x7fe1a81432f0 2021-11-15T19:35:45.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8144030 con 0x7fe188004500 2021-11-15T19:35:45.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a81411d0 con 0x7fe1a8140860 2021-11-15T19:35:45.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe1a81565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe1a81565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40578/0 (socket says 172.21.2.137:40578) 2021-11-15T19:35:45.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 -- 172.21.2.137:0/3517183415 learned_addr learned my addr 172.21.2.137:0/3517183415 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:45.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1a81432f0 0x7fe1a80aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a7fff700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1a8140860 0x7fe1a8140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 -- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1a8140860 msgr2=0x7fe1a8140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1a8140860 0x7fe1a8140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 -- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1a81432f0 msgr2=0x7fe1a80aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1a81432f0 0x7fe1a80aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 -- 172.21.2.137:0/3517183415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8142f10 con 0x7fe188004500 2021-11-15T19:35:45.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a77fe700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe1a81565f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fe190002f70 tx=0x7fe190006de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe190009e80 con 0x7fe188004500 2021-11-15T19:35:45.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190013460 con 0x7fe188004500 2021-11-15T19:35:45.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a8159fa0 con 0x7fe188004500 2021-11-15T19:35:45.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1900137c0 con 0x7fe188004500 2021-11-15T19:35:45.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.298+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a815a4d0 con 0x7fe188004500 2021-11-15T19:35:45.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a8144600 con 0x7fe188004500 2021-11-15T19:35:45.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe19001a060 con 0x7fe188004500 2021-11-15T19:35:45.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1a4ff9700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe18c053570 0x7fe18c055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5953+0+0 (secure 0 0 0) 0x7fe19006b300 con 0x7fe188004500 2021-11-15T19:35:45.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe18c053570 0x7fe18c055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1a6ffd700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe18c053570 0x7fe18c055a30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe198006000 tx=0x7fe198013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.302+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1900423c0 con 0x7fe188004500 2021-11-15T19:35:45.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.414+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe1a8143100 con 0x7fe188004500 2021-11-15T19:35:45.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.430+0000 7fe1a4ff9700 1 -- 172.21.2.137:0/3517183415 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v72) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe190018020 con 0x7fe188004500 2021-11-15T19:35:45.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe18c053570 msgr2=0x7fe18c055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe18c053570 0x7fe18c055a30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe198006000 tx=0x7fe198013000).stop 2021-11-15T19:35:45.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 msgr2=0x7fe1a81565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe1a81565f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fe190002f70 tx=0x7fe190006de0).stop 2021-11-15T19:35:45.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 shutdown_connections 2021-11-15T19:35:45.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe18c053570 0x7fe18c055a30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe1a8140860 0x7fe1a8140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe1a81432f0 0x7fe1a80aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 --2- 172.21.2.137:0/3517183415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe188004500 0x7fe1a81565f0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 >> 172.21.2.137:0/3517183415 conn(0x7fe1a80b4e60 msgr2=0x7fe1a8146480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 shutdown_connections 2021-11-15T19:35:45.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.434+0000 7fe1ae172700 1 -- 172.21.2.137:0/3517183415 wait complete. 2021-11-15T19:35:45.447 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 27 and data pool 28 2021-11-15T19:35:45.450 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:45.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 Processor -- start 2021-11-15T19:35:45.501 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- start start 2021-11-15T19:35:45.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0a9c063010 0x7f0a9c13e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0a9c05efb0 0x7f0a9c1423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c0633f0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c067af0 con 0x7f0a9c063010 2021-11-15T19:35:45.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c0af790 con 0x7f0a9c05efb0 2021-11-15T19:35:45.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa2037700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0a9c0ac8c0 0x7f0a9c13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59382/0 (socket says 172.21.2.137:59382) 2021-11-15T19:35:45.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa2037700 1 -- 172.21.2.137:0/2085956567 learned_addr learned my addr 172.21.2.137:0/2085956567 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:45.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa1035700 1 --2- 172.21.2.137:0/2085956567 >> v2:172.21.2.137:3300/0 conn(0x7f0a9c05efb0 0x7f0a9c1423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa0834700 1 -- 172.21.2.137:0/2085956567 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344406436 0 0) 0x7f0a9c0633f0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa0834700 1 -- 172.21.2.137:0/2085956567 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a84003260 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa1035700 1 -- 172.21.2.137:0/2085956567 >> v2:172.21.2.111:3300/0 conn(0x7f0a9c063010 msgr2=0x7f0a9c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:45.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa1035700 1 --2- 172.21.2.137:0/2085956567 >> v2:172.21.2.111:3300/0 conn(0x7f0a9c063010 0x7f0a9c13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa1035700 1 -- 172.21.2.137:0/2085956567 >> v1:172.21.2.137:6789/0 conn(0x7f0a9c0ac8c0 legacy=0x7f0a9c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa1035700 1 -- 172.21.2.137:0/2085956567 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0afa30 con 0x7f0a9c05efb0 2021-11-15T19:35:45.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa1035700 1 --2- 172.21.2.137:0/2085956567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c05efb0 0x7f0a9c1423d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f0a90002f70 tx=0x7f0a90006df0).ready entity=mon.1 client_cookie=e6ffc63fa86715e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa0834700 1 -- 172.21.2.137:0/2085956567 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9000d570 con 0x7f0a9c05efb0 2021-11-15T19:35:45.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa0834700 1 -- 172.21.2.137:0/2085956567 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90000e90 con 0x7f0a9c05efb0 2021-11-15T19:35:45.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa0834700 1 -- 172.21.2.137:0/2085956567 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9000d8c0 con 0x7f0a9c05efb0 2021-11-15T19:35:45.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2085956567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c05efb0 msgr2=0x7f0a9c1423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2085956567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c05efb0 0x7f0a9c1423d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f0a90002f70 tx=0x7f0a90006df0).stop 2021-11-15T19:35:45.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2085956567 shutdown_connections 2021-11-15T19:35:45.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2085956567 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c05efb0 0x7f0a9c1423d0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2085956567 >> v2:172.21.2.111:3300/0 conn(0x7f0a9c063010 0x7f0a9c13e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2085956567 >> 172.21.2.137:0/2085956567 conn(0x7f0a9c05bd20 msgr2=0x7f0a9c05c130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2085956567 shutdown_connections 2021-11-15T19:35:45.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.490+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2085956567 wait complete. 2021-11-15T19:35:45.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 Processor -- start 2021-11-15T19:35:45.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- start start 2021-11-15T19:35:45.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c05efb0 0x7f0a9c0669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c063010 0x7f0a9c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 0x7f0a9c156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1355d0 con 0x7f0a9c05efb0 2021-11-15T19:35:45.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c159aa0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c159d40 con 0x7f0a9c063010 2021-11-15T19:35:45.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 0x7f0a9c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 0x7f0a9c156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40606/0 (socket says 172.21.2.137:40606) 2021-11-15T19:35:45.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 -- 172.21.2.137:0/2967113250 learned_addr learned my addr 172.21.2.137:0/2967113250 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:45.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 -- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c063010 msgr2=0x7f0a9c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c063010 0x7f0a9c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 -- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c05efb0 msgr2=0x7f0a9c0669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c05efb0 0x7f0a9c0669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 -- 172.21.2.137:0/2967113250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9000b180 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa2037700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 0x7f0a9c156350 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0a94001490 tx=0x7f0a94007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a94005ba0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a94005d00 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c0b4aa0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a940072c0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c136330 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c159f00 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a94010070 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0a8effd700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0534f0 0x7f0a7c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0a9406b340 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa1836700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0534f0 0x7f0a7c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.494+0000 7f0aa1836700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0534f0 0x7f0a7c0559b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0a98002f70 tx=0x7f0a98006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.498+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a940424a0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a9c13ec30 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0a8effd700 1 -- 172.21.2.137:0/2967113250 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f0a94045ac0 con 0x7f0a9c0ac8c0 2021-11-15T19:35:45.594 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:45.594 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":140,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:45.426516+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:43.261809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:44.405561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:45.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0534f0 msgr2=0x7f0a7c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0534f0 0x7f0a7c0559b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0a98002f70 tx=0x7f0a98006a80).stop 2021-11-15T19:35:45.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 msgr2=0x7f0a9c156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 0x7f0a9c156350 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0a94001490 tx=0x7f0a94007dc0).stop 2021-11-15T19:35:45.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 shutdown_connections 2021-11-15T19:35:45.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0534f0 0x7f0a7c0559b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0ac8c0 0x7f0a9c156350 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c063010 0x7f0a9c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 --2- 172.21.2.137:0/2967113250 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c05efb0 0x7f0a9c0669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 >> 172.21.2.137:0/2967113250 conn(0x7f0a9c05bd20 msgr2=0x7f0a9c0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 shutdown_connections 2021-11-15T19:35:45.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.582+0000 7f0aa3a9a700 1 -- 172.21.2.137:0/2967113250 wait complete. 2021-11-15T19:35:45.602 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:45.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 Processor -- start 2021-11-15T19:35:45.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 -- start start 2021-11-15T19:35:45.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc1f0144610 0x7fc1f0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 0x7fc1f00aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f0148190 con 0x7fc1f00b1340 2021-11-15T19:35:45.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00b1720 con 0x7fc1f0144610 2021-11-15T19:35:45.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1f59a6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0147e70 con 0x7fc1f00a9f50 2021-11-15T19:35:45.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1ef7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 0x7fc1f00aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1ee7fc700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc1f0144610 0x7fc1f0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1ef7fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 0x7fc1f00aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:42186/0 (socket says 172.21.2.137:42186) 2021-11-15T19:35:45.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.642+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/3317168595 learned_addr learned my addr 172.21.2.137:0/3317168595 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:45.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/3317168595 >> v2:172.21.2.111:3300/0 conn(0x7fc1f0144610 msgr2=0x7fc1f0147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:45.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 --2- 172.21.2.137:0/3317168595 >> v2:172.21.2.111:3300/0 conn(0x7fc1f0144610 0x7fc1f0147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/3317168595 >> v1:172.21.2.111:6789/0 conn(0x7fc1f00b1340 legacy=0x7fc1f0143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/3317168595 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00af800 con 0x7fc1f00a9f50 2021-11-15T19:35:45.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 --2- 172.21.2.137:0/3317168595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 0x7fc1f00aa3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc1e80032f0 tx=0x7fc1e8009290).ready entity=mon.2 client_cookie=36d7781f1cc15183 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1edffb700 1 -- 172.21.2.137:0/3317168595 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e800b8a0 con 0x7fc1f00a9f50 2021-11-15T19:35:45.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1edffb700 1 -- 172.21.2.137:0/3317168595 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e800ba00 con 0x7fc1f00a9f50 2021-11-15T19:35:45.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1edffb700 1 -- 172.21.2.137:0/3317168595 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e800bb70 con 0x7fc1f00a9f50 2021-11-15T19:35:45.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- 172.21.2.137:0/3317168595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 msgr2=0x7fc1f00aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/3317168595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 0x7fc1f00aa3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc1e80032f0 tx=0x7fc1e8009290).stop 2021-11-15T19:35:45.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- 172.21.2.137:0/3317168595 shutdown_connections 2021-11-15T19:35:45.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/3317168595 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00a9f50 0x7fc1f00aa3a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/3317168595 >> v2:172.21.2.111:3300/0 conn(0x7fc1f0144610 0x7fc1f0147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- 172.21.2.137:0/3317168595 >> 172.21.2.137:0/3317168595 conn(0x7fc1f00b4e60 msgr2=0x7fc1f00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- 172.21.2.137:0/3317168595 shutdown_connections 2021-11-15T19:35:45.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- 172.21.2.137:0/3317168595 wait complete. 2021-11-15T19:35:45.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 Processor -- start 2021-11-15T19:35:45.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- start start 2021-11-15T19:35:45.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1f00a9f50 0x7fc1f0099d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00b1340 0x7fc1f00981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 0x7fc1f0140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f009a210 con 0x7fc1f00a9f50 2021-11-15T19:35:45.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0099340 con 0x7fc1f0144610 2021-11-15T19:35:45.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1f59a6700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00995e0 con 0x7fc1f00b1340 2021-11-15T19:35:45.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 0x7fc1f0140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 0x7fc1f0140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40620/0 (socket says 172.21.2.137:40620) 2021-11-15T19:35:45.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.646+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/1955360177 learned_addr learned my addr 172.21.2.137:0/1955360177 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:45.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00b1340 msgr2=0x7fc1f00981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1ef7fe700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00b1340 0x7fc1f00981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1f00a9f50 msgr2=0x7fc1f0099d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1ef7fe700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1f00a9f50 0x7fc1f0099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1ef7fe700 1 -- 172.21.2.137:0/1955360177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8009530 con 0x7fc1f0144610 2021-11-15T19:35:45.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1ef7fe700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 0x7fc1f0140ac0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fc1e80032f0 tx=0x7fc1e8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e800b8a0 con 0x7fc1f0144610 2021-11-15T19:35:45.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8021440 con 0x7fc1f0144610 2021-11-15T19:35:45.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e8006b60 con 0x7fc1f0144610 2021-11-15T19:35:45.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0099880 con 0x7fc1f0144610 2021-11-15T19:35:45.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f009ae40 con 0x7fc1f0144610 2021-11-15T19:35:45.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f005faf0 con 0x7fc1f0144610 2021-11-15T19:35:45.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1e8027020 con 0x7fc1f0144610 2021-11-15T19:35:45.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1e7fff700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d4053540 0x7fc1d4055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc1e806d130 con 0x7fc1f0144610 2021-11-15T19:35:45.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1eeffd700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d4053540 0x7fc1d4055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.650+0000 7fc1eeffd700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d4053540 0x7fc1d4055a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fc1f0062250 tx=0x7fc1d8007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.654+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1e8044290 con 0x7fc1f0144610 2021-11-15T19:35:45.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1f005f730 con 0x7fc1f0144610 2021-11-15T19:35:45.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1e7fff700 1 -- 172.21.2.137:0/1955360177 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fc1e8015020 con 0x7fc1f0144610 2021-11-15T19:35:45.745 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:45.745 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":140,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:45.426516+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:43.261809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:44.405561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:45.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d4053540 msgr2=0x7fc1d4055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d4053540 0x7fc1d4055a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fc1f0062250 tx=0x7fc1d8007810).stop 2021-11-15T19:35:45.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 msgr2=0x7fc1f0140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 0x7fc1f0140ac0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fc1e80032f0 tx=0x7fc1e8016000).stop 2021-11-15T19:35:45.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 shutdown_connections 2021-11-15T19:35:45.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1d4053540 0x7fc1d4055a00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1f0144610 0x7fc1f0140ac0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1f00b1340 0x7fc1f00981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 --2- 172.21.2.137:0/1955360177 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1f00a9f50 0x7fc1f0099d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 >> 172.21.2.137:0/1955360177 conn(0x7fc1f00b4e60 msgr2=0x7fc1f0143450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 shutdown_connections 2021-11-15T19:35:45.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.734+0000 7fc1f59a6700 1 -- 172.21.2.137:0/1955360177 wait complete. 2021-11-15T19:35:45.752 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:35:45.804 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 Processor -- start 2021-11-15T19:35:45.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- start start 2021-11-15T19:35:45.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb11c060950 0x7fb11c144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11c05c440 con 0x7fb11c0affa0 2021-11-15T19:35:45.806 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11c0add50 con 0x7fb11c05c060 2021-11-15T19:35:45.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11c0aef10 con 0x7fb11c060950 2021-11-15T19:35:45.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb11c060950 0x7fb11c144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb11c060950 0x7fb11c144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40626/0 (socket says 172.21.2.137:40626) 2021-11-15T19:35:45.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 -- 172.21.2.137:0/3716181060 learned_addr learned my addr 172.21.2.137:0/3716181060 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:45.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11affd700 1 --1- 172.21.2.137:0/3716181060 >> v1:172.21.2.137:6789/0 conn(0x7fb11c05c060 0x7fb11c143d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59408/0 (socket says 172.21.2.137:59408) 2021-11-15T19:35:45.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 -- 172.21.2.137:0/3716181060 >> v1:172.21.2.137:6789/0 conn(0x7fb11c05c060 legacy=0x7fb11c143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 -- 172.21.2.137:0/3716181060 >> v1:172.21.2.111:6789/0 conn(0x7fb11c0affa0 legacy=0x7fb11c13f700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:45.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 -- 172.21.2.137:0/3716181060 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0adff0 con 0x7fb11c060950 2021-11-15T19:35:45.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb11a7fc700 1 --2- 172.21.2.137:0/3716181060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c060950 0x7fb11c144470 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7fb11c0afc40 tx=0x7fb10c006eb0).ready entity=mon.1 client_cookie=c6eb8f4a8a6de791 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb119ffb700 1 -- 172.21.2.137:0/3716181060 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c00d5c0 con 0x7fb11c060950 2021-11-15T19:35:45.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb119ffb700 1 -- 172.21.2.137:0/3716181060 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c000e90 con 0x7fb11c060950 2021-11-15T19:35:45.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb119ffb700 1 -- 172.21.2.137:0/3716181060 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c00d950 con 0x7fb11c060950 2021-11-15T19:35:45.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- 172.21.2.137:0/3716181060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c060950 msgr2=0x7fb11c144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 --2- 172.21.2.137:0/3716181060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c060950 0x7fb11c144470 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7fb11c0afc40 tx=0x7fb10c006eb0).stop 2021-11-15T19:35:45.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- 172.21.2.137:0/3716181060 shutdown_connections 2021-11-15T19:35:45.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 --2- 172.21.2.137:0/3716181060 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c060950 0x7fb11c144470 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:45.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- 172.21.2.137:0/3716181060 >> 172.21.2.137:0/3716181060 conn(0x7fb11c0b5f50 msgr2=0x7fb11c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:45.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- 172.21.2.137:0/3716181060 shutdown_connections 2021-11-15T19:35:45.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- 172.21.2.137:0/3716181060 wait complete. 2021-11-15T19:35:45.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 Processor -- start 2021-11-15T19:35:45.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.794+0000 7fb12172c700 1 -- start start 2021-11-15T19:35:45.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 0x7fb11c066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb11c060950 0x7fb11c12dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb11c0affa0 0x7fb11c12e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c134cb0 con 0x7fb11c0affa0 2021-11-15T19:35:45.813 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c131100 con 0x7fb11c05c060 2021-11-15T19:35:45.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c1313a0 con 0x7fb11c060950 2021-11-15T19:35:45.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 0x7fb11c066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 0x7fb11c066770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40630/0 (socket says 172.21.2.137:40630) 2021-11-15T19:35:45.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 -- 172.21.2.137:0/427750958 learned_addr learned my addr 172.21.2.137:0/427750958 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:45.814 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 -- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb11c060950 msgr2=0x7fb11c12dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb11c060950 0x7fb11c12dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 -- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb11c0affa0 msgr2=0x7fb11c12e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:45.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb11c0affa0 0x7fb11c12e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:45.815 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 -- 172.21.2.137:0/427750958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c00b1e0 con 0x7fb11c05c060 2021-11-15T19:35:45.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11affd700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 0x7fb11c066770 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fb11c144960 tx=0x7fb104007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10400ce30 con 0x7fb11c05c060 2021-11-15T19:35:45.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1040072e0 con 0x7fb11c05c060 2021-11-15T19:35:45.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb104005740 con 0x7fb11c05c060 2021-11-15T19:35:45.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11c134930 con 0x7fb11c05c060 2021-11-15T19:35:45.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11c12e630 con 0x7fb11c05c060 2021-11-15T19:35:45.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c131560 con 0x7fb11c05c060 2021-11-15T19:35:45.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb104010070 con 0x7fb11c05c060 2021-11-15T19:35:45.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb113fff700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1000535d0 0x7fb100055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:45.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb10406b080 con 0x7fb11c05c060 2021-11-15T19:35:45.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.798+0000 7fb11a7fc700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1000535d0 0x7fb100055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:45.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.802+0000 7fb11a7fc700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1000535d0 0x7fb100055a90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fb11c0afc40 tx=0x7fb10c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:45.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.802+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1040420d0 con 0x7fb11c05c060 2021-11-15T19:35:45.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:45.910+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb11c0ae2e0 con 0x7fb11c05c060 2021-11-15T19:35:46.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.434+0000 7fb113fff700 1 -- 172.21.2.137:0/427750958 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb1040456f0 con 0x7fb11c05c060 2021-11-15T19:35:46.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.438+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1000535d0 msgr2=0x7fb100055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.438+0000 7fb12172c700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1000535d0 0x7fb100055a90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fb11c0afc40 tx=0x7fb10c015000).stop 2021-11-15T19:35:46.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.438+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 msgr2=0x7fb11c066770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.438+0000 7fb12172c700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 0x7fb11c066770 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fb11c144960 tx=0x7fb104007c00).stop 2021-11-15T19:35:46.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 shutdown_connections 2021-11-15T19:35:46.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb1000535d0 0x7fb100055a90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb11c0affa0 0x7fb11c12e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb11c060950 0x7fb11c12dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 --2- 172.21.2.137:0/427750958 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb11c05c060 0x7fb11c066770 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 >> 172.21.2.137:0/427750958 conn(0x7fb11c0b5f50 msgr2=0x7fb11c0b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 shutdown_connections 2021-11-15T19:35:46.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.442+0000 7fb12172c700 1 -- 172.21.2.137:0/427750958 wait complete. 2021-11-15T19:35:46.461 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:46.518 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7c717700 1 Processor -- start 2021-11-15T19:35:46.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7c717700 1 -- start start 2021-11-15T19:35:46.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7c717700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fed740acab0 0x7fed740b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7c717700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740aecf0 con 0x7fed740af2f0 2021-11-15T19:35:46.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7c717700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7413f180 con 0x7fed740b1180 2021-11-15T19:35:46.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7c717700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740aef20 con 0x7fed740acab0 2021-11-15T19:35:46.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed79cb2700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fed740b1180 0x7fed74142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59422/0 (socket says 172.21.2.137:59422) 2021-11-15T19:35:46.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed79cb2700 1 -- 172.21.2.137:0/1047261216 learned_addr learned my addr 172.21.2.137:0/1047261216 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:46.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.506+0000 7fed7a4b3700 1 --2- 172.21.2.137:0/1047261216 >> v2:172.21.2.137:3300/0 conn(0x7fed740acab0 0x7fed740b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed794b1700 1 -- 172.21.2.137:0/1047261216 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947193094 0 0) 0x7fed68001110 con 0x7fed740b1180 2021-11-15T19:35:46.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed794b1700 1 -- 172.21.2.137:0/1047261216 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c003260 con 0x7fed740b1180 2021-11-15T19:35:46.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7a4b3700 1 -- 172.21.2.137:0/1047261216 >> v1:172.21.2.137:6789/0 conn(0x7fed740b1180 legacy=0x7fed74142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7a4b3700 1 -- 172.21.2.137:0/1047261216 >> v1:172.21.2.111:6789/0 conn(0x7fed740af2f0 legacy=0x7fed74149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:46.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7a4b3700 1 -- 172.21.2.137:0/1047261216 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740ace90 con 0x7fed740acab0 2021-11-15T19:35:46.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7a4b3700 1 --2- 172.21.2.137:0/1047261216 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740acab0 0x7fed740b2060 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fed740b2bd0 tx=0x7fed70006df0).ready entity=mon.1 client_cookie=c73594aa0093d75 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed794b1700 1 -- 172.21.2.137:0/1047261216 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70010980 con 0x7fed740acab0 2021-11-15T19:35:46.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed794b1700 1 -- 172.21.2.137:0/1047261216 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70000e90 con 0x7fed740acab0 2021-11-15T19:35:46.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed794b1700 1 -- 172.21.2.137:0/1047261216 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70010cd0 con 0x7fed740acab0 2021-11-15T19:35:46.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/1047261216 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740acab0 msgr2=0x7fed740b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 --2- 172.21.2.137:0/1047261216 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740acab0 0x7fed740b2060 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fed740b2bd0 tx=0x7fed70006df0).stop 2021-11-15T19:35:46.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/1047261216 shutdown_connections 2021-11-15T19:35:46.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 --2- 172.21.2.137:0/1047261216 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740acab0 0x7fed740b2060 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/1047261216 >> 172.21.2.137:0/1047261216 conn(0x7fed740630f0 msgr2=0x7fed740634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/1047261216 shutdown_connections 2021-11-15T19:35:46.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/1047261216 wait complete. 2021-11-15T19:35:46.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 Processor -- start 2021-11-15T19:35:46.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- start start 2021-11-15T19:35:46.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acab0 0x7fed7411da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 0x7fed74112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b1180 0x7fed74111340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74114b50 con 0x7fed740b1180 2021-11-15T19:35:46.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74157410 con 0x7fed740af2f0 2021-11-15T19:35:46.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed741104d0 con 0x7fed740acab0 2021-11-15T19:35:46.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 0x7fed74112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 0x7fed74112360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40644/0 (socket says 172.21.2.137:40644) 2021-11-15T19:35:46.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 -- 172.21.2.137:0/2729937749 learned_addr learned my addr 172.21.2.137:0/2729937749 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:46.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 -- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acab0 msgr2=0x7fed7411da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acab0 0x7fed7411da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 -- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b1180 msgr2=0x7fed74111340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b1180 0x7fed74111340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 -- 172.21.2.137:0/2729937749 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7000c290 con 0x7fed740af2f0 2021-11-15T19:35:46.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed79cb2700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 0x7fed74112360 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fed680012a0 tx=0x7fed68007940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed680070d0 con 0x7fed740af2f0 2021-11-15T19:35:46.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed68007230 con 0x7fed740af2f0 2021-11-15T19:35:46.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed74112850 con 0x7fed740af2f0 2021-11-15T19:35:46.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed68005610 con 0x7fed740af2f0 2021-11-15T19:35:46.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.510+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74110f40 con 0x7fed740af2f0 2021-11-15T19:35:46.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74114d50 con 0x7fed740af2f0 2021-11-15T19:35:46.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed6801a060 con 0x7fed740af2f0 2021-11-15T19:35:46.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed677fe700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed54053640 0x7fed54055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fed6806b080 con 0x7fed740af2f0 2021-11-15T19:35:46.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed7a4b3700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed54053640 0x7fed54055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed7a4b3700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed54053640 0x7fed54055b00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fed740b2bd0 tx=0x7fed70017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.514+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed680420d0 con 0x7fed740af2f0 2021-11-15T19:35:46.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed7413f180 con 0x7fed740af2f0 2021-11-15T19:35:46.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed677fe700 1 -- 172.21.2.137:0/2729937749 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fed7413f180 con 0x7fed740af2f0 2021-11-15T19:35:46.637 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:46.637 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:45.426948+0000","modified":"2021-11-15T19:35:46.431620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8338":{"gid":8338,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4036717918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4036717918},{"type":"v1","addr":"172.21.2.137:6833","nonce":4036717918}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T19:35:46.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed54053640 msgr2=0x7fed54055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed54053640 0x7fed54055b00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fed740b2bd0 tx=0x7fed70017000).stop 2021-11-15T19:35:46.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 msgr2=0x7fed74112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 0x7fed74112360 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fed680012a0 tx=0x7fed68007940).stop 2021-11-15T19:35:46.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 shutdown_connections 2021-11-15T19:35:46.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fed54053640 0x7fed54055b00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fed740b1180 0x7fed74111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fed740af2f0 0x7fed74112360 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 --2- 172.21.2.137:0/2729937749 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fed740acab0 0x7fed7411da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 >> 172.21.2.137:0/2729937749 conn(0x7fed740630f0 msgr2=0x7fed740b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 shutdown_connections 2021-11-15T19:35:46.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.626+0000 7fed7c717700 1 -- 172.21.2.137:0/2729937749 wait complete. 2021-11-15T19:35:46.641 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 73 2021-11-15T19:35:46.644 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:46.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 Processor -- start 2021-11-15T19:35:46.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 -- start start 2021-11-15T19:35:46.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f51e40acab0 0x7f51e40b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f51e40b1180 0x7f51e40b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 0x7f51e4142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40aecf0 con 0x7f51e40acab0 2021-11-15T19:35:46.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e413f180 con 0x7f51e40b1180 2021-11-15T19:35:46.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e9d7d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40aef20 con 0x7f51e40af2f0 2021-11-15T19:35:46.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f51e40b1180 0x7f51e40b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f51e40b1180 0x7f51e40b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40654/0 (socket says 172.21.2.137:40654) 2021-11-15T19:35:46.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 -- 172.21.2.137:0/3082643281 learned_addr learned my addr 172.21.2.137:0/3082643281 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:46.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 -- 172.21.2.137:0/3082643281 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 msgr2=0x7f51e4142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:46.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 --2- 172.21.2.137:0/3082643281 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 0x7f51e4142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 -- 172.21.2.137:0/3082643281 >> v2:172.21.2.111:3300/0 conn(0x7f51e40acab0 msgr2=0x7f51e40b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:46.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 --2- 172.21.2.137:0/3082643281 >> v2:172.21.2.111:3300/0 conn(0x7f51e40acab0 0x7f51e40b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 -- 172.21.2.137:0/3082643281 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40ace90 con 0x7f51e40b1180 2021-11-15T19:35:46.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.682+0000 7f51e2ffd700 1 --2- 172.21.2.137:0/3082643281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40b1180 0x7f51e40b2550 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7f51cc002f70 tx=0x7f51cc006eb0).ready entity=mon.1 client_cookie=7b7903291d9aed65 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e27fc700 1 -- 172.21.2.137:0/3082643281 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51cc00d570 con 0x7f51e40b1180 2021-11-15T19:35:46.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e27fc700 1 -- 172.21.2.137:0/3082643281 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc000e90 con 0x7f51e40b1180 2021-11-15T19:35:46.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e27fc700 1 -- 172.21.2.137:0/3082643281 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51cc00d900 con 0x7f51e40b1180 2021-11-15T19:35:46.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/3082643281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40b1180 msgr2=0x7f51e40b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/3082643281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40b1180 0x7f51e40b2550 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7f51cc002f70 tx=0x7f51cc006eb0).stop 2021-11-15T19:35:46.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/3082643281 shutdown_connections 2021-11-15T19:35:46.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/3082643281 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 0x7f51e4142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/3082643281 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40b1180 0x7f51e40b2550 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/3082643281 >> v2:172.21.2.111:3300/0 conn(0x7f51e40acab0 0x7f51e40b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/3082643281 >> 172.21.2.137:0/3082643281 conn(0x7f51e40630f0 msgr2=0x7f51e40634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/3082643281 shutdown_connections 2021-11-15T19:35:46.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/3082643281 wait complete. 2021-11-15T19:35:46.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 Processor -- start 2021-11-15T19:35:46.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- start start 2021-11-15T19:35:46.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 0x7f51e413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 0x7f51e4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51e40b1180 0x7f51e4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40678c0 con 0x7f51e40b1180 2021-11-15T19:35:46.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4067380 con 0x7f51e40acab0 2021-11-15T19:35:46.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4067620 con 0x7f51e40af2f0 2021-11-15T19:35:46.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 0x7f51e413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 0x7f51e413d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40658/0 (socket says 172.21.2.137:40658) 2021-11-15T19:35:46.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 -- 172.21.2.137:0/993585269 learned_addr learned my addr 172.21.2.137:0/993585269 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:46.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 -- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 msgr2=0x7f51e4153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 0x7f51e4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 -- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51e40b1180 msgr2=0x7f51e4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51e40b1180 0x7f51e4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 -- 172.21.2.137:0/993585269 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc00b1e0 con 0x7f51e40acab0 2021-11-15T19:35:46.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e37fe700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 0x7f51e413d4a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f51d4002f70 tx=0x7f51d4006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d4013460 con 0x7f51e40acab0 2021-11-15T19:35:46.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40135c0 con 0x7f51e40acab0 2021-11-15T19:35:46.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d4013920 con 0x7f51e40acab0 2021-11-15T19:35:46.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4067000 con 0x7f51e40acab0 2021-11-15T19:35:46.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.686+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4154000 con 0x7f51e40acab0 2021-11-15T19:35:46.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e4153360 con 0x7f51e40acab0 2021-11-15T19:35:46.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f51d401a060 con 0x7f51e40acab0 2021-11-15T19:35:46.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e0ff9700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51c8053720 0x7f51c8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f51d406b3a0 con 0x7f51e40acab0 2021-11-15T19:35:46.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e2ffd700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51c8053720 0x7f51c8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e2ffd700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51c8053720 0x7f51c8055be0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f51cc002f70 tx=0x7f51cc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.690+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51e4153360 con 0x7f51e40acab0 2021-11-15T19:35:46.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51e40573d0 con 0x7f51e40acab0 2021-11-15T19:35:46.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e0ff9700 1 -- 172.21.2.137:0/993585269 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f51d4018030 con 0x7f51e40acab0 2021-11-15T19:35:46.789 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:46.789 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":141,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:46.432707+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:43.261809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:44.405561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:46.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51c8053720 msgr2=0x7f51c8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51c8053720 0x7f51c8055be0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f51cc002f70 tx=0x7f51cc015000).stop 2021-11-15T19:35:46.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 msgr2=0x7f51e413d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 0x7f51e413d4a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f51d4002f70 tx=0x7f51d4006e20).stop 2021-11-15T19:35:46.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 shutdown_connections 2021-11-15T19:35:46.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f51c8053720 0x7f51c8055be0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f51e40b1180 0x7f51e4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f51e40af2f0 0x7f51e4153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 --2- 172.21.2.137:0/993585269 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f51e40acab0 0x7f51e413d4a0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.792 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 >> 172.21.2.137:0/993585269 conn(0x7f51e40630f0 msgr2=0x7f51e4141540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 shutdown_connections 2021-11-15T19:35:46.793 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.778+0000 7f51e9d7d700 1 -- 172.21.2.137:0/993585269 wait complete. 2021-11-15T19:35:46.797 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:35:46.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 Processor -- start 2021-11-15T19:35:46.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 -- start start 2021-11-15T19:35:46.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f293805fd20 0x7f29380af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f29380b0830 0x7f29380aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2938147f70 con 0x7f29380b10b0 2021-11-15T19:35:46.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2938060100 con 0x7f293805fd20 2021-11-15T19:35:46.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.838+0000 7f293d8c8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2938147cd0 con 0x7f29380b0830 2021-11-15T19:35:46.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f29380b0830 0x7f29380aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f29380b0830 0x7f29380aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40666/0 (socket says 172.21.2.137:40666) 2021-11-15T19:35:46.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/2922301525 learned_addr learned my addr 172.21.2.137:0/2922301525 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:46.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/2922301525 >> v2:172.21.2.111:3300/0 conn(0x7f293805fd20 msgr2=0x7f29380af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:46.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- 172.21.2.137:0/2922301525 >> v2:172.21.2.111:3300/0 conn(0x7f293805fd20 0x7f29380af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/2922301525 >> v1:172.21.2.111:6789/0 conn(0x7f29380b10b0 legacy=0x7f29380b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:46.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/2922301525 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29380a9ed0 con 0x7f29380b0830 2021-11-15T19:35:46.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- 172.21.2.137:0/2922301525 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b0830 0x7f29380aa370 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f29380b4db0 tx=0x7f2930009290).ready entity=mon.1 client_cookie=ca8673d158250f4a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f2935ffb700 1 -- 172.21.2.137:0/2922301525 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293000b830 con 0x7f29380b0830 2021-11-15T19:35:46.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f2935ffb700 1 -- 172.21.2.137:0/2922301525 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000b990 con 0x7f29380b0830 2021-11-15T19:35:46.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f2935ffb700 1 -- 172.21.2.137:0/2922301525 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293000bb40 con 0x7f29380b0830 2021-11-15T19:35:46.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/2922301525 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b0830 msgr2=0x7f29380aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 --2- 172.21.2.137:0/2922301525 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b0830 0x7f29380aa370 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f29380b4db0 tx=0x7f2930009290).stop 2021-11-15T19:35:46.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/2922301525 shutdown_connections 2021-11-15T19:35:46.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 --2- 172.21.2.137:0/2922301525 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b0830 0x7f29380aa370 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 --2- 172.21.2.137:0/2922301525 >> v2:172.21.2.111:3300/0 conn(0x7f293805fd20 0x7f29380af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/2922301525 >> 172.21.2.137:0/2922301525 conn(0x7f29380b4e60 msgr2=0x7f29380b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/2922301525 shutdown_connections 2021-11-15T19:35:46.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/2922301525 wait complete. 2021-11-15T19:35:46.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 Processor -- start 2021-11-15T19:35:46.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- start start 2021-11-15T19:35:46.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293805fd20 0x7f2938098f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29380b0830 0x7f2938099420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 0x7f29381435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293814a260 con 0x7f293805fd20 2021-11-15T19:35:46.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2938157120 con 0x7f29380b10b0 2021-11-15T19:35:46.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2938157310 con 0x7f29380b0830 2021-11-15T19:35:46.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 0x7f29381435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 0x7f29381435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40676/0 (socket says 172.21.2.137:40676) 2021-11-15T19:35:46.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/700596489 learned_addr learned my addr 172.21.2.137:0/700596489 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:46.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29380b0830 msgr2=0x7f2938099420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29367fc700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29380b0830 0x7f2938099420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29380b0830 0x7f2938099420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293805fd20 msgr2=0x7f2938098f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293805fd20 0x7f2938098f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 -- 172.21.2.137:0/700596489 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2930009530 con 0x7f29380b10b0 2021-11-15T19:35:46.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f29377fe700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 0x7f29381435f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f293814a500 tx=0x7f2930016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293000bdb0 con 0x7f29380b10b0 2021-11-15T19:35:46.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293001f420 con 0x7f29380b10b0 2021-11-15T19:35:46.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29381575b0 con 0x7f29380b10b0 2021-11-15T19:35:46.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293001f780 con 0x7f29380b10b0 2021-11-15T19:35:46.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.842+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2938141fe0 con 0x7f29380b10b0 2021-11-15T19:35:46.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2938157740 con 0x7f29380b10b0 2021-11-15T19:35:46.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f293000f070 con 0x7f29380b10b0 2021-11-15T19:35:46.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f292ffff700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f291c053660 0x7f291c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:46.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f293006c580 con 0x7f29380b10b0 2021-11-15T19:35:46.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f2936ffd700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f291c053660 0x7f291c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:46.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f2936ffd700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f291c053660 0x7f291c055b20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f2928002f70 tx=0x7f2928006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:46.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.846+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f29300435d0 con 0x7f29380b10b0 2021-11-15T19:35:46.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.958+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f29381479f0 con 0x7f29380b10b0 2021-11-15T19:35:46.981 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f292ffff700 1 -- 172.21.2.137:0/700596489 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2930046bf0 con 0x7f29380b10b0 2021-11-15T19:35:46.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f291c053660 msgr2=0x7f291c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f293d8c8700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f291c053660 0x7f291c055b20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f2928002f70 tx=0x7f2928006a80).stop 2021-11-15T19:35:46.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 msgr2=0x7f29381435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:46.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f293d8c8700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 0x7f29381435f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f293814a500 tx=0x7f2930016000).stop 2021-11-15T19:35:46.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 shutdown_connections 2021-11-15T19:35:46.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.970+0000 7f293d8c8700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f291c053660 0x7f291c055b20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.974+0000 7f293d8c8700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f29380b10b0 0x7f29381435f0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.974+0000 7f293d8c8700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f29380b0830 0x7f2938099420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:46.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.974+0000 7f293d8c8700 1 --2- 172.21.2.137:0/700596489 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f293805fd20 0x7f2938098f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:46.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.974+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 >> 172.21.2.137:0/700596489 conn(0x7f29380b4e60 msgr2=0x7f29380af800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:46.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.974+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 shutdown_connections 2021-11-15T19:35:46.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:46.974+0000 7f293d8c8700 1 -- 172.21.2.137:0/700596489 wait complete. 2021-11-15T19:35:46.986 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:35:46.989 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:35:47.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 Processor -- start 2021-11-15T19:35:47.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- start start 2021-11-15T19:35:47.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2fdc05fd20 0x7f2fdc0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b0830 0x7f2fdc0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc147f70 con 0x7f2fdc0b10b0 2021-11-15T19:35:47.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc060100 con 0x7f2fdc05fd20 2021-11-15T19:35:47.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc147cd0 con 0x7f2fdc0b0830 2021-11-15T19:35:47.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2fdc05fd20 0x7f2fdc0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2fdc05fd20 0x7f2fdc0af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40680/0 (socket says 172.21.2.137:40680) 2021-11-15T19:35:47.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 -- 172.21.2.137:0/923484968 learned_addr learned my addr 172.21.2.137:0/923484968 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:47.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 -- 172.21.2.137:0/923484968 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b0830 msgr2=0x7f2fdc0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 --2- 172.21.2.137:0/923484968 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b0830 0x7f2fdc0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 -- 172.21.2.137:0/923484968 >> v1:172.21.2.111:6789/0 conn(0x7f2fdc0b10b0 legacy=0x7f2fdc0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 -- 172.21.2.137:0/923484968 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0a9ed0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe22e6700 1 --2- 172.21.2.137:0/923484968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0af800 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f2fdc0b4db0 tx=0x7f2fd0006eb0).ready entity=mon.1 client_cookie=d1ebdf62e181a36f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe12e4700 1 -- 172.21.2.137:0/923484968 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd000d570 con 0x7f2fdc05fd20 2021-11-15T19:35:47.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe12e4700 1 -- 172.21.2.137:0/923484968 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0000e90 con 0x7f2fdc05fd20 2021-11-15T19:35:47.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe12e4700 1 -- 172.21.2.137:0/923484968 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd000d8c0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- 172.21.2.137:0/923484968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 msgr2=0x7f2fdc0af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 --2- 172.21.2.137:0/923484968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0af800 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f2fdc0b4db0 tx=0x7f2fd0006eb0).stop 2021-11-15T19:35:47.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- 172.21.2.137:0/923484968 shutdown_connections 2021-11-15T19:35:47.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 --2- 172.21.2.137:0/923484968 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b0830 0x7f2fdc0aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 --2- 172.21.2.137:0/923484968 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0af800 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- 172.21.2.137:0/923484968 >> 172.21.2.137:0/923484968 conn(0x7f2fdc0b4e60 msgr2=0x7f2fdc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- 172.21.2.137:0/923484968 shutdown_connections 2021-11-15T19:35:47.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- 172.21.2.137:0/923484968 wait complete. 2021-11-15T19:35:47.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 Processor -- start 2021-11-15T19:35:47.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.034+0000 7f2fe454a700 1 -- start start 2021-11-15T19:35:47.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2fdc0b0830 0x7f2fdc142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b10b0 0x7f2fdc143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc143b90 con 0x7f2fdc0b0830 2021-11-15T19:35:47.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc143e30 con 0x7f2fdc05fd20 2021-11-15T19:35:47.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1418f0 con 0x7f2fdc0b10b0 2021-11-15T19:35:47.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40688/0 (socket says 172.21.2.137:40688) 2021-11-15T19:35:47.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 -- 172.21.2.137:0/2072409256 learned_addr learned my addr 172.21.2.137:0/2072409256 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:47.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 -- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b10b0 msgr2=0x7f2fdc143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b10b0 0x7f2fdc143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 -- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2fdc0b0830 msgr2=0x7f2fdc142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2fdc0b0830 0x7f2fdc142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 -- 172.21.2.137:0/2072409256 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd000b1e0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe22e6700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0639e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f2fdc0b4db0 tx=0x7f2fd0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd0002f70 con 0x7f2fdc05fd20 2021-11-15T19:35:47.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd00068b0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd000de20 con 0x7f2fdc05fd20 2021-11-15T19:35:47.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc141d90 con 0x7f2fdc05fd20 2021-11-15T19:35:47.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc1438a0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc141ab0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2fd001a040 con 0x7f2fdc05fd20 2021-11-15T19:35:47.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fcf7fe700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fbc053640 0x7f2fbc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f2fd006c8f0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe1ae5700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fbc053640 0x7f2fbc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.038+0000 7f2fe1ae5700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fbc053640 0x7f2fbc055b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f2fd8002f10 tx=0x7f2fd8006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.042+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2fd0043ad0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.150+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2fdc1479f0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.162+0000 7f2fcf7fe700 1 -- 172.21.2.137:0/2072409256 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2fd00230e0 con 0x7f2fdc05fd20 2021-11-15T19:35:47.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.162+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fbc053640 msgr2=0x7f2fbc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.162+0000 7f2fe454a700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fbc053640 0x7f2fbc055b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f2fd8002f10 tx=0x7f2fd8006930).stop 2021-11-15T19:35:47.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.162+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 msgr2=0x7f2fdc0639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.162+0000 7f2fe454a700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0639e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f2fdc0b4db0 tx=0x7f2fd0015000).stop 2021-11-15T19:35:47.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 shutdown_connections 2021-11-15T19:35:47.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f2fbc053640 0x7f2fbc055b00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2fdc0b10b0 0x7f2fdc143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2fdc0b0830 0x7f2fdc142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 --2- 172.21.2.137:0/2072409256 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2fdc05fd20 0x7f2fdc0639e0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 >> 172.21.2.137:0/2072409256 conn(0x7f2fdc0b4e60 msgr2=0x7f2fdc144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 shutdown_connections 2021-11-15T19:35:47.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.166+0000 7f2fe454a700 1 -- 172.21.2.137:0/2072409256 wait complete. 2021-11-15T19:35:47.181 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:35:47.183 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:35:47.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.226+0000 7f864a564700 1 Processor -- start 2021-11-15T19:35:47.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.226+0000 7f864a564700 1 -- start start 2021-11-15T19:35:47.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440969e0 0x7f86440997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440aca80 con 0x7f86440b2c30 2021-11-15T19:35:47.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440accb0 con 0x7f8644097260 2021-11-15T19:35:47.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440ad150 con 0x7f86440969e0 2021-11-15T19:35:47.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8644097260 0x7f86440990e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59476/0 (socket says 172.21.2.137:59476) 2021-11-15T19:35:47.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 -- 172.21.2.137:0/2859514723 learned_addr learned my addr 172.21.2.137:0/2859514723 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:47.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451785765 0 0) 0x7f86440accb0 con 0x7f8644097260 2021-11-15T19:35:47.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8630003260 con 0x7f8644097260 2021-11-15T19:35:47.245 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212663269 0 0) 0x7f8630003260 con 0x7f8644097260 2021-11-15T19:35:47.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440969e0 msgr2=0x7f86440997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440969e0 0x7f86440997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 >> v1:172.21.2.111:6789/0 conn(0x7f86440b2c30 legacy=0x7f864405f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.246 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644097c50 con 0x7f8644097260 2021-11-15T19:35:47.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8634001660 con 0x7f8644097260 2021-11-15T19:35:47.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 >> v1:172.21.2.137:6789/0 conn(0x7f8644097260 legacy=0x7f86440990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.247 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8630004500 0x7f8630004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440969e0 0x7f863000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8630005280 con 0x7f8630004500 2021-11-15T19:35:47.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863000bc40 con 0x7f86300037d0 2021-11-15T19:35:47.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863000bd80 con 0x7f86440969e0 2021-11-15T19:35:47.248 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 -- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440969e0 msgr2=0x7f863000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86440969e0 0x7f863000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.249 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 -- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8630004500 msgr2=0x7f8630004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8630004500 0x7f8630004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 -- 172.21.2.137:0/2859514723 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630003260 con 0x7f86300037d0 2021-11-15T19:35:47.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bd0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f86440b4c10 tx=0x7f8634001d80).ready entity=mon.1 client_cookie=43e9f8b65be852de server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.250 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86340070d0 con 0x7f86300037d0 2021-11-15T19:35:47.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634007230 con 0x7f86300037d0 2021-11-15T19:35:47.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8642ffd700 1 -- 172.21.2.137:0/2859514723 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863400c8f0 con 0x7f86300037d0 2021-11-15T19:35:47.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- 172.21.2.137:0/2859514723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 msgr2=0x7f8630003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 --2- 172.21.2.137:0/2859514723 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f86300037d0 0x7f8630003bd0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f86440b4c10 tx=0x7f8634001d80).stop 2021-11-15T19:35:47.251 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 -- 172.21.2.137:0/2859514723 reap_dead start 2021-11-15T19:35:47.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- 172.21.2.137:0/2859514723 shutdown_connections 2021-11-15T19:35:47.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- 172.21.2.137:0/2859514723 >> 172.21.2.137:0/2859514723 conn(0x7f86440b7070 msgr2=0x7f86440b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- 172.21.2.137:0/2859514723 shutdown_connections 2021-11-15T19:35:47.252 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- 172.21.2.137:0/2859514723 wait complete. 2021-11-15T19:35:47.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 Processor -- start 2021-11-15T19:35:47.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- start start 2021-11-15T19:35:47.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86300037d0 0x7f864409c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86441421d0 0x7f864413f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.253 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 0x7f864413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644159b30 con 0x7f86441421d0 2021-11-15T19:35:47.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440614f0 con 0x7f8644157c30 2021-11-15T19:35:47.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f864a564700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8644142d70 con 0x7f86300037d0 2021-11-15T19:35:47.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 0x7f864413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 0x7f864413fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40710/0 (socket says 172.21.2.137:40710) 2021-11-15T19:35:47.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 -- 172.21.2.137:0/129330617 learned_addr learned my addr 172.21.2.137:0/129330617 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:47.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f86437fe700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86441421d0 0x7f864413f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8643fff700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86300037d0 0x7f864409c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 -- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86300037d0 msgr2=0x7f864409c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86300037d0 0x7f864409c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 -- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86441421d0 msgr2=0x7f864413f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86441421d0 0x7f864413f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 -- 172.21.2.137:0/129330617 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644143010 con 0x7f8644157c30 2021-11-15T19:35:47.256 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.230+0000 7f8648b01700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 0x7f864413fb40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f8644061800 tx=0x7f863c00a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c005a20 con 0x7f8644157c30 2021-11-15T19:35:47.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864409c6a0 con 0x7f8644157c30 2021-11-15T19:35:47.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c005b80 con 0x7f8644157c30 2021-11-15T19:35:47.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c007070 con 0x7f8644157c30 2021-11-15T19:35:47.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8644063320 con 0x7f8644157c30 2021-11-15T19:35:47.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644061660 con 0x7f8644157c30 2021-11-15T19:35:47.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f863c01d070 con 0x7f8644157c30 2021-11-15T19:35:47.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86240535b0 0x7f8624055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f863c06aaa0 con 0x7f8644157c30 2021-11-15T19:35:47.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f8643fff700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86240535b0 0x7f8624055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f8643fff700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86240535b0 0x7f8624055a70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f8634018000 tx=0x7f8634015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.234+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8644061660 con 0x7f8644157c30 2021-11-15T19:35:47.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.346+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8644061630 con 0x7f8644157c30 2021-11-15T19:35:47.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f86417fa700 1 -- 172.21.2.137:0/129330617 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7f863c045590 con 0x7f8644157c30 2021-11-15T19:35:47.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86240535b0 msgr2=0x7f8624055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86240535b0 0x7f8624055a70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f8634018000 tx=0x7f8634015000).stop 2021-11-15T19:35:47.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 msgr2=0x7f864413fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 0x7f864413fb40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f8644061800 tx=0x7f863c00a060).stop 2021-11-15T19:35:47.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 shutdown_connections 2021-11-15T19:35:47.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f86240535b0 0x7f8624055a70 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8644157c30 0x7f864413fb40 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f86441421d0 0x7f864413f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 --2- 172.21.2.137:0/129330617 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f86300037d0 0x7f864409c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 >> 172.21.2.137:0/129330617 conn(0x7f86440b7070 msgr2=0x7f86440b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 shutdown_connections 2021-11-15T19:35:47.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.362+0000 7f864a564700 1 -- 172.21.2.137:0/129330617 wait complete. 2021-11-15T19:35:47.379 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:35:47.380 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:47.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 Processor -- start 2021-11-15T19:35:47.430 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 -- start start 2021-11-15T19:35:47.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f8ae8144610 0x7f8ae8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8ae80a9f50 0x7f8ae80aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae8148190 con 0x7f8ae80b1340 2021-11-15T19:35:47.432 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae80b1720 con 0x7f8ae80a9f50 2021-11-15T19:35:47.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aef360700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae8147e70 con 0x7f8ae8144610 2021-11-15T19:35:47.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aed0fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8ae80b1340 0x7f8ae8143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59496/0 (socket says 172.21.2.137:59496) 2021-11-15T19:35:47.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aed0fc700 1 -- 172.21.2.137:0/3693316413 learned_addr learned my addr 172.21.2.137:0/3693316413 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:47.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aec8fb700 1 --2- 172.21.2.137:0/3693316413 >> v2:172.21.2.137:3300/0 conn(0x7f8ae8144610 0x7f8ae8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aec8fb700 1 -- 172.21.2.137:0/3693316413 >> v2:172.21.2.111:3300/0 conn(0x7f8ae80a9f50 msgr2=0x7f8ae80aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aec8fb700 1 --2- 172.21.2.137:0/3693316413 >> v2:172.21.2.111:3300/0 conn(0x7f8ae80a9f50 0x7f8ae80aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aec8fb700 1 -- 172.21.2.137:0/3693316413 >> v1:172.21.2.137:6789/0 conn(0x7f8ae80b1340 legacy=0x7f8ae8143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aec8fb700 1 -- 172.21.2.137:0/3693316413 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80af800 con 0x7f8ae8144610 2021-11-15T19:35:47.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8aec8fb700 1 --2- 172.21.2.137:0/3693316413 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae8144610 0x7f8ae8147980 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f8ae40012a0 tx=0x7f8ad8006df0).ready entity=mon.1 client_cookie=a2db2637b7ea26c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8ad7fff700 1 -- 172.21.2.137:0/3693316413 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad800d570 con 0x7f8ae8144610 2021-11-15T19:35:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8ad7fff700 1 -- 172.21.2.137:0/3693316413 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8000e90 con 0x7f8ae8144610 2021-11-15T19:35:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.418+0000 7f8ad7fff700 1 -- 172.21.2.137:0/3693316413 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad800d8c0 con 0x7f8ae8144610 2021-11-15T19:35:47.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/3693316413 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae8144610 msgr2=0x7f8ae8147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 --2- 172.21.2.137:0/3693316413 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae8144610 0x7f8ae8147980 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f8ae40012a0 tx=0x7f8ad8006df0).stop 2021-11-15T19:35:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/3693316413 shutdown_connections 2021-11-15T19:35:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 --2- 172.21.2.137:0/3693316413 >> v2:172.21.2.111:3300/0 conn(0x7f8ae80a9f50 0x7f8ae80aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 --2- 172.21.2.137:0/3693316413 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae8144610 0x7f8ae8147980 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/3693316413 >> 172.21.2.137:0/3693316413 conn(0x7f8ae80b4e60 msgr2=0x7f8ae80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/3693316413 shutdown_connections 2021-11-15T19:35:47.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/3693316413 wait complete. 2021-11-15T19:35:47.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 Processor -- start 2021-11-15T19:35:47.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- start start 2021-11-15T19:35:47.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 0x7f8ae8098130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ae80b1340 0x7f8ae80993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ae8144610 0x7f8ae80998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae81493b0 con 0x7f8ae80b1340 2021-11-15T19:35:47.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae814a300 con 0x7f8ae80a9f50 2021-11-15T19:35:47.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8149030 con 0x7f8ae8144610 2021-11-15T19:35:47.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 0x7f8ae8098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 0x7f8ae8098130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40722/0 (socket says 172.21.2.137:40722) 2021-11-15T19:35:47.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 -- 172.21.2.137:0/1684251898 learned_addr learned my addr 172.21.2.137:0/1684251898 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:47.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 -- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ae8144610 msgr2=0x7f8ae80998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ae8144610 0x7f8ae80998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 -- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ae80b1340 msgr2=0x7f8ae80993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ae80b1340 0x7f8ae80993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 -- 172.21.2.137:0/1684251898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad800b180 con 0x7f8ae80a9f50 2021-11-15T19:35:47.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aed0fc700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 0x7f8ae8098130 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f8ae4000fe0 tx=0x7f8ae4007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae40072e0 con 0x7f8ae80a9f50 2021-11-15T19:35:47.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4007440 con 0x7f8ae80a9f50 2021-11-15T19:35:47.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae8099da0 con 0x7f8ae80a9f50 2021-11-15T19:35:47.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae4005800 con 0x7f8ae80a9f50 2021-11-15T19:35:47.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae8148c80 con 0x7f8ae80a9f50 2021-11-15T19:35:47.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae814a500 con 0x7f8ae80a9f50 2021-11-15T19:35:47.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.422+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ae4010070 con 0x7f8ae80a9f50 2021-11-15T19:35:47.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.426+0000 7f8ad67fc700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ac8053640 0x7f8ac8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.426+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8ae406afb0 con 0x7f8ae80a9f50 2021-11-15T19:35:47.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.426+0000 7f8aec8fb700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ac8053640 0x7f8ac8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.426+0000 7f8aec8fb700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ac8053640 0x7f8ac8055b00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8ae40012a0 tx=0x7f8ad8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.426+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ae4042110 con 0x7f8ae80a9f50 2021-11-15T19:35:47.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.534+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ae81491f0 con 0x7f8ae80a9f50 2021-11-15T19:35:47.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.534+0000 7f8ad67fc700 1 -- 172.21.2.137:0/1684251898 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f8ae4045730 con 0x7f8ae80a9f50 2021-11-15T19:35:47.548 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:47.548 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:45.426948+0000","modified":"2021-11-15T19:35:46.431620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8338":{"gid":8338,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4036717918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4036717918},{"type":"v1","addr":"172.21.2.137:6833","nonce":4036717918}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T19:35:47.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ac8053640 msgr2=0x7f8ac8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ac8053640 0x7f8ac8055b00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8ae40012a0 tx=0x7f8ad8014000).stop 2021-11-15T19:35:47.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 msgr2=0x7f8ae8098130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 0x7f8ae8098130 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f8ae4000fe0 tx=0x7f8ae4007c40).stop 2021-11-15T19:35:47.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 shutdown_connections 2021-11-15T19:35:47.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8ac8053640 0x7f8ac8055b00 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ae8144610 0x7f8ae80998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ae80b1340 0x7f8ae80993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 --2- 172.21.2.137:0/1684251898 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ae80a9f50 0x7f8ae8098130 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 >> 172.21.2.137:0/1684251898 conn(0x7f8ae80b4e60 msgr2=0x7f8ae80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 shutdown_connections 2021-11-15T19:35:47.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.538+0000 7f8aef360700 1 -- 172.21.2.137:0/1684251898 wait complete. 2021-11-15T19:35:47.552 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 73 2021-11-15T19:35:47.756 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:45.426948+0000', 'modified': '2021-11-15T19:35:46.431620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8338': {'gid': 8338, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4036717918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4036717918}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4036717918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:47.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:47.757 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:47.838 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":8338,"want_state":"up:active","state":"up:active","rank_uptime":2.398355354,"mdsmap_epoch":73,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":6.5252555450000003} 2021-11-15T19:35:47.839 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 8338, "mdsmap_epoch": 73, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 2.398355354, "state": "up:active", "uptime": 6.525255545, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:47.839 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:47.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 Processor -- start 2021-11-15T19:35:47.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 -- start start 2021-11-15T19:35:47.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740ac3c0 0x7fc9740ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9740609f0 0x7fc9741447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc974097c50 con 0x7fc9740b2d50 2021-11-15T19:35:47.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740ac120 con 0x7fc9740609f0 2021-11-15T19:35:47.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.878+0000 7fc97a974700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740979b0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9740609f0 0x7fc9741447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc9740609f0 0x7fc9741447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:47958/0 (socket says 172.21.2.137:47958) 2021-11-15T19:35:47.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc973fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740ac3c0 0x7fc9740ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 -- 172.21.2.137:0/2944363077 learned_addr learned my addr 172.21.2.137:0/2944363077 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:47.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc9737fe700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fc9740b2d50 0x7fc9741440c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52004/0 (socket says 172.21.2.137:52004) 2021-11-15T19:35:47.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 -- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740ac3c0 msgr2=0x7fc9740ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:47.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 --2- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740ac3c0 0x7fc9740ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 -- 172.21.2.137:0/2944363077 >> v1:172.21.2.111:6789/0 conn(0x7fc9740b2d50 legacy=0x7fc9741440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 -- 172.21.2.137:0/2944363077 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974067c60 con 0x7fc9740609f0 2021-11-15T19:35:47.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc978f11700 1 --2- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9740609f0 0x7fc9741447d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fc96c0032f0 tx=0x7fc96c009290).ready entity=mon.0 client_cookie=82ac3582652b4f28 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc972ffd700 1 -- 172.21.2.137:0/2944363077 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00b8a0 con 0x7fc9740609f0 2021-11-15T19:35:47.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc972ffd700 1 -- 172.21.2.137:0/2944363077 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00ba00 con 0x7fc9740609f0 2021-11-15T19:35:47.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc972ffd700 1 -- 172.21.2.137:0/2944363077 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00bb70 con 0x7fc9740609f0 2021-11-15T19:35:47.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 -- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9740609f0 msgr2=0x7fc9741447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 --2- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9740609f0 0x7fc9741447d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fc96c0032f0 tx=0x7fc96c009290).stop 2021-11-15T19:35:47.897 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 -- 172.21.2.137:0/2944363077 shutdown_connections 2021-11-15T19:35:47.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 --2- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc9740609f0 0x7fc9741447d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 --2- 172.21.2.137:0/2944363077 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740ac3c0 0x7fc9740ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 -- 172.21.2.137:0/2944363077 >> 172.21.2.137:0/2944363077 conn(0x7fc9740b7070 msgr2=0x7fc9740b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 -- 172.21.2.137:0/2944363077 shutdown_connections 2021-11-15T19:35:47.898 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.882+0000 7fc97a974700 1 -- 172.21.2.137:0/2944363077 wait complete. 2021-11-15T19:35:47.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 Processor -- start 2021-11-15T19:35:47.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- start start 2021-11-15T19:35:47.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740609f0 0x7fc97409c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 0x7fc974141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc974143250 0x7fc9740b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740aebd0 con 0x7fc974143250 2021-11-15T19:35:47.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740afe00 con 0x7fc9740ac3c0 2021-11-15T19:35:47.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740ae7a0 con 0x7fc9740609f0 2021-11-15T19:35:47.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 0x7fc974141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 0x7fc974141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40736/0 (socket says 172.21.2.137:40736) 2021-11-15T19:35:47.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 -- 172.21.2.137:0/168528587 learned_addr learned my addr 172.21.2.137:0/168528587 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:47.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 -- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740609f0 msgr2=0x7fc97409c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740609f0 0x7fc97409c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 -- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc974143250 msgr2=0x7fc9740b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc974143250 0x7fc9740b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 -- 172.21.2.137:0/168528587 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009530 con 0x7fc9740ac3c0 2021-11-15T19:35:47.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9737fe700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 0x7fc974141fc0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fc9740b4e60 tx=0x7fc964007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96400ce30 con 0x7fc9740ac3c0 2021-11-15T19:35:47.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640072e0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9741424b0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964007450 con 0x7fc9740ac3c0 2021-11-15T19:35:47.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740b1840 con 0x7fc9740ac3c0 2021-11-15T19:35:47.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9740b0ad0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc964010070 con 0x7fc9740ac3c0 2021-11-15T19:35:47.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9717fa700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9580535d0 0x7fc958055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:47.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc96406b110 con 0x7fc9740ac3c0 2021-11-15T19:35:47.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.886+0000 7fc973fff700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9580535d0 0x7fc958055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:47.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.890+0000 7fc973fff700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9580535d0 0x7fc958055a90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc95c00c000 tx=0x7fc95c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:47.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.890+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9740b0ad0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.983 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9740b0ad0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.984 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc9717fa700 1 -- 172.21.2.137:0/168528587 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fc9740b0ad0 con 0x7fc9740ac3c0 2021-11-15T19:35:47.984 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:47.984 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":141,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:46.432707+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:43.261809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:44.405561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:47.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9580535d0 msgr2=0x7fc958055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9580535d0 0x7fc958055a90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc95c00c000 tx=0x7fc95c006df0).stop 2021-11-15T19:35:47.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 msgr2=0x7fc974141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:47.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 0x7fc974141fc0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fc9740b4e60 tx=0x7fc964007c40).stop 2021-11-15T19:35:47.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 shutdown_connections 2021-11-15T19:35:47.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc9580535d0 0x7fc958055a90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc974143250 0x7fc9740b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc9740ac3c0 0x7fc974141fc0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:47.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 --2- 172.21.2.137:0/168528587 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc9740609f0 0x7fc97409c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:47.987 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 >> 172.21.2.137:0/168528587 conn(0x7fc9740b7070 msgr2=0x7fc9741413f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:47.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 shutdown_connections 2021-11-15T19:35:47.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:47.974+0000 7fc97a974700 1 -- 172.21.2.137:0/168528587 wait complete. 2021-11-15T19:35:47.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:35:43.261809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:35:44.405561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:35:47.993 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:48.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78abbde700 1 Processor -- start 2021-11-15T19:35:48.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78abbde700 1 -- start start 2021-11-15T19:35:48.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78abbde700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f78a40acd60 0x7f78a40b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78abbde700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40b76c0 con 0x7f78a40b4680 2021-11-15T19:35:48.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78abbde700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a412a170 con 0x7f78a40b72e0 2021-11-15T19:35:48.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78abbde700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40b3100 con 0x7f78a40acd60 2021-11-15T19:35:48.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a997a700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f78a40b72e0 0x7f78a40b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59524/0 (socket says 172.21.2.137:59524) 2021-11-15T19:35:48.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a997a700 1 -- 172.21.2.137:0/1867290344 learned_addr learned my addr 172.21.2.137:0/1867290344 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:48.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a9179700 1 --2- 172.21.2.137:0/1867290344 >> v2:172.21.2.137:3300/0 conn(0x7f78a40acd60 0x7f78a40b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a9179700 1 -- 172.21.2.137:0/1867290344 >> v1:172.21.2.137:6789/0 conn(0x7f78a40b72e0 legacy=0x7f78a40b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a9179700 1 -- 172.21.2.137:0/1867290344 >> v1:172.21.2.111:6789/0 conn(0x7f78a40b4680 legacy=0x7f78a41290c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:48.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a9179700 1 -- 172.21.2.137:0/1867290344 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40ad8a0 con 0x7f78a40acd60 2021-11-15T19:35:48.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a9179700 1 --2- 172.21.2.137:0/1867290344 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40acd60 0x7f78a40b4190 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f78a4065c40 tx=0x7f78a0006df0).ready entity=mon.1 client_cookie=310eba30b78caea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a8978700 1 -- 172.21.2.137:0/1867290344 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a000d5c0 con 0x7f78a40acd60 2021-11-15T19:35:48.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a8978700 1 -- 172.21.2.137:0/1867290344 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0000e90 con 0x7f78a40acd60 2021-11-15T19:35:48.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.034+0000 7f78a8978700 1 -- 172.21.2.137:0/1867290344 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a000d910 con 0x7f78a40acd60 2021-11-15T19:35:48.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/1867290344 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40acd60 msgr2=0x7f78a40b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 --2- 172.21.2.137:0/1867290344 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40acd60 0x7f78a40b4190 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f78a4065c40 tx=0x7f78a0006df0).stop 2021-11-15T19:35:48.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/1867290344 shutdown_connections 2021-11-15T19:35:48.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 --2- 172.21.2.137:0/1867290344 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40acd60 0x7f78a40b4190 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.052 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/1867290344 >> 172.21.2.137:0/1867290344 conn(0x7f78a4064960 msgr2=0x7f78a4064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/1867290344 shutdown_connections 2021-11-15T19:35:48.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/1867290344 wait complete. 2021-11-15T19:35:48.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 Processor -- start 2021-11-15T19:35:48.053 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- start start 2021-11-15T19:35:48.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78a40acd60 0x7f78a4144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 0x7f78a40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78a40b72e0 0x7f78a4155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40b20c0 con 0x7f78a40b72e0 2021-11-15T19:35:48.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4155930 con 0x7f78a40b4680 2021-11-15T19:35:48.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40b0a60 con 0x7f78a40acd60 2021-11-15T19:35:48.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 0x7f78a40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 0x7f78a40afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40750/0 (socket says 172.21.2.137:40750) 2021-11-15T19:35:48.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 -- 172.21.2.137:0/3598569705 learned_addr learned my addr 172.21.2.137:0/3598569705 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:48.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 -- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78a40acd60 msgr2=0x7f78a4144220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:48.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78a40acd60 0x7f78a4144220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 -- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78a40b72e0 msgr2=0x7f78a4155cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:48.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78a40b72e0 0x7f78a4155cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 -- 172.21.2.137:0/3598569705 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a000b180 con 0x7f78a40b4680 2021-11-15T19:35:48.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78a9179700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 0x7f78a40afc10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f78a4065c40 tx=0x7f78a0012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a0002f50 con 0x7f78a40b4680 2021-11-15T19:35:48.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0013d50 con 0x7f78a40b4680 2021-11-15T19:35:48.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40b0d00 con 0x7f78a40b4680 2021-11-15T19:35:48.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a40b0450 con 0x7f78a40b4680 2021-11-15T19:35:48.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a001f640 con 0x7f78a40b4680 2021-11-15T19:35:48.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40b3cf0 con 0x7f78a40b4680 2021-11-15T19:35:48.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78a001c070 con 0x7f78a40b4680 2021-11-15T19:35:48.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f7892ffd700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78840536f0 0x7f7884055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.038+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f78a006c860 con 0x7f78a40b4680 2021-11-15T19:35:48.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.042+0000 7f78a997a700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78840536f0 0x7f7884055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.042+0000 7f78a997a700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78840536f0 0x7f7884055bb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f78a40ac910 tx=0x7f78940077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.042+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78a00438b0 con 0x7f78a40b4680 2021-11-15T19:35:48.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f78a40573d0 con 0x7f78a40b4680 2021-11-15T19:35:48.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f7892ffd700 1 -- 172.21.2.137:0/3598569705 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78a0046ed0 con 0x7f78a40b4680 2021-11-15T19:35:48.137 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:48.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78840536f0 msgr2=0x7f7884055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78840536f0 0x7f7884055bb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f78a40ac910 tx=0x7f78940077f0).stop 2021-11-15T19:35:48.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 msgr2=0x7f78a40afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 0x7f78a40afc10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f78a4065c40 tx=0x7f78a0012000).stop 2021-11-15T19:35:48.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 shutdown_connections 2021-11-15T19:35:48.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f78840536f0 0x7f7884055bb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f78a40b72e0 0x7f78a4155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78a40b4680 0x7f78a40afc10 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 --2- 172.21.2.137:0/3598569705 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f78a40acd60 0x7f78a4144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 >> 172.21.2.137:0/3598569705 conn(0x7f78a4064960 msgr2=0x7f78a4140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 shutdown_connections 2021-11-15T19:35:48.140 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.126+0000 7f78abbde700 1 -- 172.21.2.137:0/3598569705 wait complete. 2021-11-15T19:35:48.143 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:48.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 Processor -- start 2021-11-15T19:35:48.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 -- start start 2021-11-15T19:35:48.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f40b0550 0x7fe4f414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe4f414aaa0 0x7fe4f4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f405cb50 con 0x7fe4f405c770 2021-11-15T19:35:48.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f40b1650 con 0x7fe4f414aaa0 2021-11-15T19:35:48.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f973e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40ad030 con 0x7fe4f40b0550 2021-11-15T19:35:48.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f27fc700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f40b0550 0x7fe4f414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f37fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe4f414aaa0 0x7fe4f4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f2ffd700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fe4f405c770 0x7fe4f40aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52028/0 (socket says 172.21.2.137:52028) 2021-11-15T19:35:48.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f2ffd700 1 -- 172.21.2.137:0/2704416228 learned_addr learned my addr 172.21.2.137:0/2704416228 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:48.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f37fe700 1 -- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f40b0550 msgr2=0x7fe4f414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f37fe700 1 --2- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f40b0550 0x7fe4f414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f37fe700 1 -- 172.21.2.137:0/2704416228 >> v1:172.21.2.111:6789/0 conn(0x7fe4f405c770 legacy=0x7fe4f40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f37fe700 1 -- 172.21.2.137:0/2704416228 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f40ad2d0 con 0x7fe4f414aaa0 2021-11-15T19:35:48.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.186+0000 7fe4f37fe700 1 --2- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f414aaa0 0x7fe4f4140aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fe4ec0032f0 tx=0x7fe4ec0091d0).ready entity=mon.0 client_cookie=eda93f35ce48ad87 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f1ffb700 1 -- 172.21.2.137:0/2704416228 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4ec00b6c0 con 0x7fe4f414aaa0 2021-11-15T19:35:48.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f1ffb700 1 -- 172.21.2.137:0/2704416228 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00b820 con 0x7fe4f414aaa0 2021-11-15T19:35:48.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f1ffb700 1 -- 172.21.2.137:0/2704416228 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4ec00b990 con 0x7fe4f414aaa0 2021-11-15T19:35:48.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f414aaa0 msgr2=0x7fe4f4140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 --2- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f414aaa0 0x7fe4f4140aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fe4ec0032f0 tx=0x7fe4ec0091d0).stop 2021-11-15T19:35:48.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/2704416228 shutdown_connections 2021-11-15T19:35:48.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 --2- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f414aaa0 0x7fe4f4140aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 --2- 172.21.2.137:0/2704416228 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f40b0550 0x7fe4f414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/2704416228 >> 172.21.2.137:0/2704416228 conn(0x7fe4f40631e0 msgr2=0x7fe4f405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/2704416228 shutdown_connections 2021-11-15T19:35:48.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/2704416228 wait complete. 2021-11-15T19:35:48.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 Processor -- start 2021-11-15T19:35:48.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- start start 2021-11-15T19:35:48.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 0x7fe4f4146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f40b0550 0x7fe4f4143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f414aaa0 0x7fe4f4144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4149bf0 con 0x7fe4f40b0550 2021-11-15T19:35:48.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4149e90 con 0x7fe4f405c770 2021-11-15T19:35:48.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f414a130 con 0x7fe4f414aaa0 2021-11-15T19:35:48.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 0x7fe4f4146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 0x7fe4f4146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40764/0 (socket says 172.21.2.137:40764) 2021-11-15T19:35:48.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 -- 172.21.2.137:0/4285857457 learned_addr learned my addr 172.21.2.137:0/4285857457 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:48.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 -- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f414aaa0 msgr2=0x7fe4f4144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f414aaa0 0x7fe4f4144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 -- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f40b0550 msgr2=0x7fe4f4143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f40b0550 0x7fe4f4143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 -- 172.21.2.137:0/4285857457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec009470 con 0x7fe4f405c770 2021-11-15T19:35:48.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f2ffd700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 0x7fe4f4146dc0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fe4f40adfd0 tx=0x7fe4e4007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4e400ce30 con 0x7fe4f405c770 2021-11-15T19:35:48.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e40072e0 con 0x7fe4f405c770 2021-11-15T19:35:48.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f4063760 con 0x7fe4f405c770 2021-11-15T19:35:48.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f413f100 con 0x7fe4f405c770 2021-11-15T19:35:48.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4e4005800 con 0x7fe4f405c770 2021-11-15T19:35:48.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f414a2f0 con 0x7fe4f405c770 2021-11-15T19:35:48.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4e4010070 con 0x7fe4f405c770 2021-11-15T19:35:48.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4ebfff700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4d80536d0 0x7fe4d8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.190+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe4e406af90 con 0x7fe4f405c770 2021-11-15T19:35:48.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.194+0000 7fe4f27fc700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4d80536d0 0x7fe4d8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.194+0000 7fe4f27fc700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4d80536d0 0x7fe4d8055b90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fe4dc00c000 tx=0x7fe4dc006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.194+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4e40420f0 con 0x7fe4f405c770 2021-11-15T19:35:48.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4f40ae7f0 con 0x7fe4f405c770 2021-11-15T19:35:48.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4ebfff700 1 -- 172.21.2.137:0/4285857457 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4e4045710 con 0x7fe4f405c770 2021-11-15T19:35:48.298 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:48.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4d80536d0 msgr2=0x7fe4d8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4d80536d0 0x7fe4d8055b90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fe4dc00c000 tx=0x7fe4dc006df0).stop 2021-11-15T19:35:48.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 msgr2=0x7fe4f4146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 0x7fe4f4146dc0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fe4f40adfd0 tx=0x7fe4e4007ca0).stop 2021-11-15T19:35:48.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 shutdown_connections 2021-11-15T19:35:48.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4d80536d0 0x7fe4d8055b90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4f414aaa0 0x7fe4f4144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4f40b0550 0x7fe4f4143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 --2- 172.21.2.137:0/4285857457 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4f405c770 0x7fe4f4146dc0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 >> 172.21.2.137:0/4285857457 conn(0x7fe4f40631e0 msgr2=0x7fe4f414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 shutdown_connections 2021-11-15T19:35:48.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.278+0000 7fe4f973e700 1 -- 172.21.2.137:0/4285857457 wait complete. 2021-11-15T19:35:48.302 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:35:48.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e02f07700 1 Processor -- start 2021-11-15T19:35:48.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e02f07700 1 -- start start 2021-11-15T19:35:48.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e02f07700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8dfc05c770 0x7f8dfc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e02f07700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc05cb50 con 0x7f8dfc0b0550 2021-11-15T19:35:48.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e02f07700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc0ad030 con 0x7f8dfc140aa0 2021-11-15T19:35:48.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e02f07700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0b1650 con 0x7f8dfc05c770 2021-11-15T19:35:48.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e014a4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8dfc140aa0 0x7f8dfc140ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59554/0 (socket says 172.21.2.137:59554) 2021-11-15T19:35:48.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8e014a4700 1 -- 172.21.2.137:0/3175124434 learned_addr learned my addr 172.21.2.137:0/3175124434 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:48.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582440701 0 0) 0x7f8dfc0ad030 con 0x7f8dfc140aa0 2021-11-15T19:35:48.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.342+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ddc003260 con 0x7f8dfc140aa0 2021-11-15T19:35:48.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3175124434 >> v2:172.21.2.111:3300/0 conn(0x7f8dfc05c770 0x7f8dfc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3172943270 0 0) 0x7f8ddc003260 con 0x7f8dfc140aa0 2021-11-15T19:35:48.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 >> v2:172.21.2.111:3300/0 conn(0x7f8dfc05c770 msgr2=0x7f8dfc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 --2- 172.21.2.137:0/3175124434 >> v2:172.21.2.111:3300/0 conn(0x7f8dfc05c770 0x7f8dfc0aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 >> v1:172.21.2.111:6789/0 conn(0x7f8dfc0b0550 legacy=0x7f8dfc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0ad2d0 con 0x7f8dfc140aa0 2021-11-15T19:35:48.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8df40019e0 con 0x7f8dfc140aa0 2021-11-15T19:35:48.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 >> v1:172.21.2.137:6789/0 conn(0x7f8dfc140aa0 legacy=0x7f8dfc140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ddc003820 0x7f8ddc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ddc004500 0x7f8ddc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc005050 0x7f8ddc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0b1650 con 0x7f8ddc004500 2021-11-15T19:35:48.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc00bf40 con 0x7f8ddc003820 2021-11-15T19:35:48.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc00c100 con 0x7f8ddc005050 2021-11-15T19:35:48.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ddc003820 0x7f8ddc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ddc004500 0x7f8ddc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e014a4700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc005050 0x7f8ddc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 -- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc005050 msgr2=0x7f8ddc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc005050 0x7f8ddc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 -- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ddc004500 msgr2=0x7f8ddc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8ddc004500 0x7f8ddc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 -- 172.21.2.137:0/3175124434 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc003260 con 0x7f8ddc003820 2021-11-15T19:35:48.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e014a4700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc005050 0x7f8ddc00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:48.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e014a4700 1 -- 172.21.2.137:0/3175124434 reap_dead start 2021-11-15T19:35:48.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ddc003820 0x7f8ddc003c20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f8dec007000 tx=0x7f8dec008040).ready entity=mon.1 client_cookie=f03ce6a11ba2d619 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dec012470 con 0x7f8ddc003820 2021-11-15T19:35:48.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec00c030 con 0x7f8ddc003820 2021-11-15T19:35:48.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfb7fe700 1 -- 172.21.2.137:0/3175124434 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dec0127c0 con 0x7f8ddc003820 2021-11-15T19:35:48.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- 172.21.2.137:0/3175124434 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ddc003820 msgr2=0x7f8ddc003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ddc003820 0x7f8ddc003c20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f8dec007000 tx=0x7f8dec008040).stop 2021-11-15T19:35:48.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- 172.21.2.137:0/3175124434 shutdown_connections 2021-11-15T19:35:48.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3175124434 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8ddc003820 0x7f8ddc003c20 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- 172.21.2.137:0/3175124434 >> 172.21.2.137:0/3175124434 conn(0x7f8dfc0631e0 msgr2=0x7f8dfc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- 172.21.2.137:0/3175124434 shutdown_connections 2021-11-15T19:35:48.366 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- 172.21.2.137:0/3175124434 wait complete. 2021-11-15T19:35:48.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 Processor -- start 2021-11-15T19:35:48.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- start start 2021-11-15T19:35:48.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc003820 0x7f8dfc156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.369 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 0x7f8dfc146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8dfc159aa0 0x7f8dfc159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc14b210 con 0x7f8dfc159aa0 2021-11-15T19:35:48.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc141030 con 0x7f8dfc1441b0 2021-11-15T19:35:48.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e02f07700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1412d0 con 0x7f8ddc003820 2021-11-15T19:35:48.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 0x7f8dfc146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 0x7f8dfc146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40784/0 (socket says 172.21.2.137:40784) 2021-11-15T19:35:48.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 -- 172.21.2.137:0/3115315594 learned_addr learned my addr 172.21.2.137:0/3115315594 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:48.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e014a4700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8dfc159aa0 0x7f8dfc159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.371 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc003820 0x7f8dfc156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 -- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc003820 msgr2=0x7f8dfc156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc003820 0x7f8dfc156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 -- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8dfc159aa0 msgr2=0x7f8dfc159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8dfc159aa0 0x7f8dfc159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.372 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 -- 172.21.2.137:0/3115315594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc15a410 con 0x7f8dfc1441b0 2021-11-15T19:35:48.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.346+0000 7f8dfbfff700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 0x7f8dfc146630 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f8de400b000 tx=0x7f8de4009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de4014620 con 0x7f8dfc1441b0 2021-11-15T19:35:48.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4014780 con 0x7f8dfc1441b0 2021-11-15T19:35:48.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc15a6c0 con 0x7f8dfc1441b0 2021-11-15T19:35:48.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de4014ae0 con 0x7f8dfc1441b0 2021-11-15T19:35:48.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc13eca0 con 0x7f8dfc1441b0 2021-11-15T19:35:48.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc157430 con 0x7f8dfc1441b0 2021-11-15T19:35:48.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8de4014c40 con 0x7f8dfc1441b0 2021-11-15T19:35:48.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8de00536a0 0x7f8de0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f8de406b6d0 con 0x7f8dfc1441b0 2021-11-15T19:35:48.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8de00536a0 0x7f8de0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8e00ca3700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8de00536a0 0x7f8de0055b60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f8dec013000 tx=0x7f8dec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.350+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8de4042830 con 0x7f8dfc1441b0 2021-11-15T19:35:48.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.434+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dfc0ae7f0 con 0x7f8dfc1441b0 2021-11-15T19:35:48.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8df9ffb700 1 -- 172.21.2.137:0/3115315594 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8de4045e50 con 0x7f8dfc1441b0 2021-11-15T19:35:48.453 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:48.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8de00536a0 msgr2=0x7f8de0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8de00536a0 0x7f8de0055b60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f8dec013000 tx=0x7f8dec008040).stop 2021-11-15T19:35:48.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 msgr2=0x7f8dfc146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 0x7f8dfc146630 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f8de400b000 tx=0x7f8de4009040).stop 2021-11-15T19:35:48.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 shutdown_connections 2021-11-15T19:35:48.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8de00536a0 0x7f8de0055b60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8dfc159aa0 0x7f8dfc159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8dfc1441b0 0x7f8dfc146630 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 --2- 172.21.2.137:0/3115315594 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8ddc003820 0x7f8dfc156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 >> 172.21.2.137:0/3115315594 conn(0x7f8dfc0631e0 msgr2=0x7f8dfc13ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 shutdown_connections 2021-11-15T19:35:48.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.442+0000 7f8e02f07700 1 -- 172.21.2.137:0/3115315594 wait complete. 2021-11-15T19:35:48.461 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:35:48.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 Processor -- start 2021-11-15T19:35:48.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- start start 2021-11-15T19:35:48.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a100b0550 0x7f9a1014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9a1014aaa0 0x7f9a10140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1005cb50 con 0x7f9a1005c770 2021-11-15T19:35:48.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100b1650 con 0x7f9a1014aaa0 2021-11-15T19:35:48.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100ad030 con 0x7f9a100b0550 2021-11-15T19:35:48.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0effd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f9a1005c770 0x7f9a100aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59570/0 (socket says 172.21.2.137:59570) 2021-11-15T19:35:48.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0effd700 1 -- 172.21.2.137:0/4112621577 learned_addr learned my addr 172.21.2.137:0/4112621577 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:48.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/4112621577 >> v2:172.21.2.137:3300/0 conn(0x7f9a1014aaa0 0x7f9a10140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/4112621577 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a100b0550 msgr2=0x7f9a1014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/4112621577 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a100b0550 0x7f9a1014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/4112621577 >> v1:172.21.2.137:6789/0 conn(0x7f9a1005c770 legacy=0x7f9a100aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/4112621577 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100ad2d0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/4112621577 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10140aa0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f9a00001110 tx=0x7f9a080091d0).ready entity=mon.1 client_cookie=b28603dcaeb9b78c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0dffb700 1 -- 172.21.2.137:0/4112621577 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a08009ea0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0dffb700 1 -- 172.21.2.137:0/4112621577 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800b760 con 0x7f9a1014aaa0 2021-11-15T19:35:48.517 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a0dffb700 1 -- 172.21.2.137:0/4112621577 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0800b8d0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.519 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- 172.21.2.137:0/4112621577 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 msgr2=0x7f9a10140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 --2- 172.21.2.137:0/4112621577 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10140aa0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f9a00001110 tx=0x7f9a080091d0).stop 2021-11-15T19:35:48.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- 172.21.2.137:0/4112621577 shutdown_connections 2021-11-15T19:35:48.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 --2- 172.21.2.137:0/4112621577 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10140aa0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 --2- 172.21.2.137:0/4112621577 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a100b0550 0x7f9a1014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- 172.21.2.137:0/4112621577 >> 172.21.2.137:0/4112621577 conn(0x7f9a100631e0 msgr2=0x7f9a1005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- 172.21.2.137:0/4112621577 shutdown_connections 2021-11-15T19:35:48.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- 172.21.2.137:0/4112621577 wait complete. 2021-11-15T19:35:48.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 Processor -- start 2021-11-15T19:35:48.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.502+0000 7f9a1544b700 1 -- start start 2021-11-15T19:35:48.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a1005c770 0x7f9a10149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100b0550 0x7f9a10143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10063c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10141fc0 con 0x7f9a100b0550 2021-11-15T19:35:48.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10143020 con 0x7f9a1014aaa0 2021-11-15T19:35:48.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101432c0 con 0x7f9a1005c770 2021-11-15T19:35:48.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10063c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10063c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40796/0 (socket says 172.21.2.137:40796) 2021-11-15T19:35:48.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1525761532 learned_addr learned my addr 172.21.2.137:0/1525761532 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:48.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0e7fc700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100b0550 0x7f9a10143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0effd700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a1005c770 0x7f9a10149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a1005c770 msgr2=0x7f9a10149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a1005c770 0x7f9a10149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100b0550 msgr2=0x7f9a10143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100b0550 0x7f9a10143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 -- 172.21.2.137:0/1525761532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009470 con 0x7f9a1014aaa0 2021-11-15T19:35:48.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0e7fc700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100b0550 0x7f9a10143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:35:48.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0f7fe700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10063c50 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f9a00001110 tx=0x7f9a08016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a08006ea0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08006b40 con 0x7f9a1014aaa0 2021-11-15T19:35:48.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a10067280 con 0x7f9a1014aaa0 2021-11-15T19:35:48.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a101416f0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a08021630 con 0x7f9a1014aaa0 2021-11-15T19:35:48.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10143480 con 0x7f9a1014aaa0 2021-11-15T19:35:48.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a08027020 con 0x7f9a1014aaa0 2021-11-15T19:35:48.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a07fff700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053600 0x7f99f4055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9a0806cd90 con 0x7f9a1014aaa0 2021-11-15T19:35:48.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.506+0000 7f9a0effd700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053600 0x7f99f4055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.510+0000 7f9a0effd700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053600 0x7f99f4055ac0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f9a0000b000 tx=0x7f9a00009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.510+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a08043de0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a100ae7f0 con 0x7f9a1014aaa0 2021-11-15T19:35:48.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a07fff700 1 -- 172.21.2.137:0/1525761532 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9a08015020 con 0x7f9a1014aaa0 2021-11-15T19:35:48.604 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:48.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053600 msgr2=0x7f99f4055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053600 0x7f99f4055ac0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f9a0000b000 tx=0x7f9a00009040).stop 2021-11-15T19:35:48.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 msgr2=0x7f9a10063c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10063c50 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f9a00001110 tx=0x7f9a08016000).stop 2021-11-15T19:35:48.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 shutdown_connections 2021-11-15T19:35:48.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f99f4053600 0x7f99f4055ac0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9a1014aaa0 0x7f9a10063c50 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9a100b0550 0x7f9a10143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 --2- 172.21.2.137:0/1525761532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9a1005c770 0x7f9a10149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 >> 172.21.2.137:0/1525761532 conn(0x7f9a100631e0 msgr2=0x7f9a100b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 shutdown_connections 2021-11-15T19:35:48.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.594+0000 7f9a1544b700 1 -- 172.21.2.137:0/1525761532 wait complete. 2021-11-15T19:35:48.611 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:35:48.612 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:48.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 Processor -- start 2021-11-15T19:35:48.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 -- start start 2021-11-15T19:35:48.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2500b1340 0x7fd250147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd2500a9f50 0x7fd2500aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd250148190 con 0x7fd250143f00 2021-11-15T19:35:48.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500b1720 con 0x7fd2500a9f50 2021-11-15T19:35:48.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd256c1d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd250147e70 con 0x7fd2500b1340 2021-11-15T19:35:48.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd24ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd250143f00 0x7fd250144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59584/0 (socket says 172.21.2.137:59584) 2021-11-15T19:35:48.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd24ffff700 1 -- 172.21.2.137:0/1547040084 learned_addr learned my addr 172.21.2.137:0/1547040084 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:48.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd2549b9700 1 --2- 172.21.2.137:0/1547040084 >> v2:172.21.2.137:3300/0 conn(0x7fd2500b1340 0x7fd250147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd24f7fe700 1 -- 172.21.2.137:0/1547040084 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989580643 0 0) 0x7fd240001110 con 0x7fd250143f00 2021-11-15T19:35:48.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd24f7fe700 1 -- 172.21.2.137:0/1547040084 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd230003260 con 0x7fd250143f00 2021-11-15T19:35:48.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd2549b9700 1 -- 172.21.2.137:0/1547040084 >> v2:172.21.2.111:3300/0 conn(0x7fd2500a9f50 msgr2=0x7fd2500aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:48.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd2549b9700 1 --2- 172.21.2.137:0/1547040084 >> v2:172.21.2.111:3300/0 conn(0x7fd2500a9f50 0x7fd2500aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd2549b9700 1 -- 172.21.2.137:0/1547040084 >> v1:172.21.2.137:6789/0 conn(0x7fd250143f00 legacy=0x7fd250144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.650+0000 7fd2549b9700 1 -- 172.21.2.137:0/1547040084 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500af800 con 0x7fd2500b1340 2021-11-15T19:35:48.667 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 --2- 172.21.2.137:0/1547040084 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500b1340 0x7fd250147980 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fd238002f70 tx=0x7fd238006df0).ready entity=mon.1 client_cookie=33ea8a100672d12d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd24f7fe700 1 -- 172.21.2.137:0/1547040084 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23800d570 con 0x7fd2500b1340 2021-11-15T19:35:48.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd24f7fe700 1 -- 172.21.2.137:0/1547040084 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238000e90 con 0x7fd2500b1340 2021-11-15T19:35:48.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd24f7fe700 1 -- 172.21.2.137:0/1547040084 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23800d8c0 con 0x7fd2500b1340 2021-11-15T19:35:48.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/1547040084 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500b1340 msgr2=0x7fd250147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 --2- 172.21.2.137:0/1547040084 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500b1340 0x7fd250147980 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fd238002f70 tx=0x7fd238006df0).stop 2021-11-15T19:35:48.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/1547040084 shutdown_connections 2021-11-15T19:35:48.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 --2- 172.21.2.137:0/1547040084 >> v2:172.21.2.111:3300/0 conn(0x7fd2500a9f50 0x7fd2500aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 --2- 172.21.2.137:0/1547040084 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500b1340 0x7fd250147980 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/1547040084 >> 172.21.2.137:0/1547040084 conn(0x7fd2500b4e60 msgr2=0x7fd2500b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/1547040084 shutdown_connections 2021-11-15T19:35:48.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/1547040084 wait complete. 2021-11-15T19:35:48.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 Processor -- start 2021-11-15T19:35:48.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- start start 2021-11-15T19:35:48.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 0x7fd250146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2500b1340 0x7fd250140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd250143f00 0x7fd250159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501404c0 con 0x7fd2500b1340 2021-11-15T19:35:48.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd250140220 con 0x7fd2500a9f50 2021-11-15T19:35:48.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd250140790 con 0x7fd250143f00 2021-11-15T19:35:48.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 0x7fd250146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 0x7fd250146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40808/0 (socket says 172.21.2.137:40808) 2021-11-15T19:35:48.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 -- 172.21.2.137:0/3357371741 learned_addr learned my addr 172.21.2.137:0/3357371741 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:48.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 -- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd250143f00 msgr2=0x7fd250159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd250143f00 0x7fd250159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 -- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2500b1340 msgr2=0x7fd250140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2500b1340 0x7fd250140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 -- 172.21.2.137:0/3357371741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23800b180 con 0x7fd2500a9f50 2021-11-15T19:35:48.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd2549b9700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 0x7fd250146740 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fd238002f70 tx=0x7fd238014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd238016070 con 0x7fd2500a9f50 2021-11-15T19:35:48.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800de40 con 0x7fd2500a9f50 2021-11-15T19:35:48.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd250099260 con 0x7fd2500a9f50 2021-11-15T19:35:48.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd238006b20 con 0x7fd2500a9f50 2021-11-15T19:35:48.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25009a140 con 0x7fd2500a9f50 2021-11-15T19:35:48.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.654+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd250140950 con 0x7fd2500a9f50 2021-11-15T19:35:48.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.658+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd238025030 con 0x7fd2500a9f50 2021-11-15T19:35:48.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.658+0000 7fd24dffb700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd234053660 0x7fd234055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:48.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.658+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd23806c810 con 0x7fd2500a9f50 2021-11-15T19:35:48.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.658+0000 7fd24ffff700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd234053660 0x7fd234055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:48.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.658+0000 7fd24ffff700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd234053660 0x7fd234055b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fd2400012a0 tx=0x7fd240001180).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:48.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.658+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd238043970 con 0x7fd2500a9f50 2021-11-15T19:35:48.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.766+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2500573d0 con 0x7fd2500a9f50 2021-11-15T19:35:48.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.766+0000 7fd24dffb700 1 -- 172.21.2.137:0/3357371741 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fd238023090 con 0x7fd2500a9f50 2021-11-15T19:35:48.779 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:48.779 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:45.426948+0000","modified":"2021-11-15T19:35:46.431620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8338":{"gid":8338,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4036717918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4036717918},{"type":"v1","addr":"172.21.2.137:6833","nonce":4036717918}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T19:35:48.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd234053660 msgr2=0x7fd234055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd234053660 0x7fd234055b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fd2400012a0 tx=0x7fd240001180).stop 2021-11-15T19:35:48.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 msgr2=0x7fd250146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:48.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 0x7fd250146740 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fd238002f70 tx=0x7fd238014000).stop 2021-11-15T19:35:48.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 shutdown_connections 2021-11-15T19:35:48.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd234053660 0x7fd234055b20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd250143f00 0x7fd250159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2500b1340 0x7fd250140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:48.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 --2- 172.21.2.137:0/3357371741 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2500a9f50 0x7fd250146740 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:48.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 >> 172.21.2.137:0/3357371741 conn(0x7fd2500b4e60 msgr2=0x7fd2500af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:48.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 shutdown_connections 2021-11-15T19:35:48.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:48.770+0000 7fd256c1d700 1 -- 172.21.2.137:0/3357371741 wait complete. 2021-11-15T19:35:48.783 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 73 2021-11-15T19:35:48.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:45.426948+0000', 'modified': '2021-11-15T19:35:46.431620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8338': {'gid': 8338, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4036717918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4036717918}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4036717918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:48.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:48.989 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:49.053 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":8338,"want_state":"up:active","state":"up:active","rank_uptime":3.6134693370000002,"mdsmap_epoch":73,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":7.7403689370000004} 2021-11-15T19:35:49.054 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 8338, "mdsmap_epoch": 73, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 3.613469337, "state": "up:active", "uptime": 7.740368937, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:49.054 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:35:49.055 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:35:49.055 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:35:49.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:49.056 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:49.067 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:35:49.120 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:49.121 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:49.127 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:49.127 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:49.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:49.129 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:35:49.133 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:35:49.133 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:49.176 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:35:49.185 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:49.185 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:49.191 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:49.191 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:49.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:49.192 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:35:49.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:35:49.206+0000 7f215f57c080 -1 init, newargv = 0x556bc24536e0 newargc=9 2021-11-15T19:35:49.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15345]: starting ceph client 2021-11-15T19:35:49.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15345]: starting fuse 2021-11-15T19:35:50.296 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:35:50.308 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:50.309 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:50.368 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:50.369 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:50.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:50.371 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:35:50.380 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:35:50.380 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:35:50.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:50.381 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:35:50.382 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:35:50.382 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:35:50.382 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:35:50.383 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:35:50.383 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:50.384 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:35:50.384 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:35:50.384 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:35:50.385 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:50.385 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:35:50.386 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:35:50.386 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:35:50.387 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:35:50.387 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:50.387 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:35:50.388 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:35:50.388 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:35:50.389 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:35:50.389 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:35:50.389 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:35:50.390 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:35:50.390 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:35:50.424 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.15345.asok 2021-11-15T19:35:50.427 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15345.asok 2021-11-15T19:35:50.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:50.428 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15345.asok status 2021-11-15T19:35:50.533 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:35:50.534 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:35:50.534 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:35:50.534 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:35:50.535 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:35:50.535 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:35:50.535 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:35:50.535 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "15345", 2021-11-15T19:35:50.536 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:35:50.536 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:50.536 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:35:50.536 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:35:50.537 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 8503, 2021-11-15T19:35:50.537 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:35:50.537 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:35:50.537 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:35:50.538 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 8503 2021-11-15T19:35:50.538 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:50.538 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:35:50.538 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:35:50.539 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:35:50.539 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2070560600 2021-11-15T19:35:50.539 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:35:50.539 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:50.540 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:35:50.540 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:35:50.540 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:35:50.540 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 2070560600 2021-11-15T19:35:50.540 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:35:50.541 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.8503 172.21.2.131:0/2070560600", 2021-11-15T19:35:50.541 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/2070560600", 2021-11-15T19:35:50.541 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:35:50.541 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 73, 2021-11-15T19:35:50.542 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 141, 2021-11-15T19:35:50.542 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:35:50.542 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:35:50.542 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:35:50.543 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:35:50.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:50.545 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:50.545 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:50.551 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:35:50.551 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:50.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:50.552 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:50.561 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:35:50.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 Processor -- start 2021-11-15T19:35:50.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 -- start start 2021-11-15T19:35:50.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 0x7f9e900b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 0x7f9e900b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e900aecf0 con 0x7f9e900af2f0 2021-11-15T19:35:50.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9006a580 con 0x7f9e900b1180 2021-11-15T19:35:50.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e96ecd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9013f180 con 0x7f9e900acab0 2021-11-15T19:35:50.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 0x7f9e900b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e8ffff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 0x7f9e900b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e8ffff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 0x7f9e900b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:48048/0 (socket says 172.21.2.137:48048) 2021-11-15T19:35:50.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 0x7f9e900b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:42386/0 (socket says 172.21.2.137:42386) 2021-11-15T19:35:50.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e8ffff700 1 -- 172.21.2.137:0/9702306 learned_addr learned my addr 172.21.2.137:0/9702306 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:50.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 -- 172.21.2.137:0/9702306 >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 msgr2=0x7f9e900b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:50.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 --2- 172.21.2.137:0/9702306 >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 0x7f9e900b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 -- 172.21.2.137:0/9702306 >> v1:172.21.2.111:6789/0 conn(0x7f9e900af2f0 legacy=0x7f9e90069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 -- 172.21.2.137:0/9702306 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900aef20 con 0x7f9e900acab0 2021-11-15T19:35:50.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e8ffff700 1 --2- 172.21.2.137:0/9702306 >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 0x7f9e900b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:35:50.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.606+0000 7f9e94c69700 1 --2- 172.21.2.137:0/9702306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 0x7f9e900b2060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9e80002f70 tx=0x7f9e80006df0).ready entity=mon.2 client_cookie=e15711b3b13db1aa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8f7fe700 1 -- 172.21.2.137:0/9702306 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8000d570 con 0x7f9e900acab0 2021-11-15T19:35:50.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8f7fe700 1 -- 172.21.2.137:0/9702306 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80000e90 con 0x7f9e900acab0 2021-11-15T19:35:50.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8f7fe700 1 -- 172.21.2.137:0/9702306 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8000d8c0 con 0x7f9e900acab0 2021-11-15T19:35:50.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/9702306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 msgr2=0x7f9e900b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/9702306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 0x7f9e900b2060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9e80002f70 tx=0x7f9e80006df0).stop 2021-11-15T19:35:50.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/9702306 shutdown_connections 2021-11-15T19:35:50.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/9702306 >> v2:172.21.2.111:3300/0 conn(0x7f9e900b1180 0x7f9e900b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/9702306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900acab0 0x7f9e900b2060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/9702306 >> 172.21.2.137:0/9702306 conn(0x7f9e900630f0 msgr2=0x7f9e900634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:50.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/9702306 shutdown_connections 2021-11-15T19:35:50.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/9702306 wait complete. 2021-11-15T19:35:50.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 Processor -- start 2021-11-15T19:35:50.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- start start 2021-11-15T19:35:50.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 0x7f9e9013a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900af2f0 0x7f9e90138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e900b1180 0x7f9e9013f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90139850 con 0x7f9e900b1180 2021-11-15T19:35:50.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e901395b0 con 0x7f9e900acab0 2021-11-15T19:35:50.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90138950 con 0x7f9e900af2f0 2021-11-15T19:35:50.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 0x7f9e9013a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 0x7f9e9013a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40822/0 (socket says 172.21.2.137:40822) 2021-11-15T19:35:50.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 -- 172.21.2.137:0/937323235 learned_addr learned my addr 172.21.2.137:0/937323235 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:50.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e9546a700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e900b1180 0x7f9e9013f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8ffff700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900af2f0 0x7f9e90138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 -- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900af2f0 msgr2=0x7f9e90138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900af2f0 0x7f9e90138460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 -- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e900b1180 msgr2=0x7f9e9013f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e900b1180 0x7f9e9013f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 -- 172.21.2.137:0/937323235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8400b1e0 con 0x7f9e900acab0 2021-11-15T19:35:50.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e94c69700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 0x7f9e9013a6d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f9e80002f70 tx=0x7f9e80014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e80016070 con 0x7f9e900acab0 2021-11-15T19:35:50.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8000de40 con 0x7f9e900acab0 2021-11-15T19:35:50.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8000b180 con 0x7f9e900acab0 2021-11-15T19:35:50.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8001e450 con 0x7f9e900acab0 2021-11-15T19:35:50.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.610+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9013fab0 con 0x7f9e900acab0 2021-11-15T19:35:50.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e901357e0 con 0x7f9e900acab0 2021-11-15T19:35:50.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e80025030 con 0x7f9e900acab0 2021-11-15T19:35:50.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e8dffb700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e70053580 0x7f9e70055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9e8006c970 con 0x7f9e900acab0 2021-11-15T19:35:50.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e8ffff700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e70053580 0x7f9e70055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e8ffff700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e70053580 0x7f9e70055a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f9e8400b000 tx=0x7f9e84008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.614+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e80043ad0 con 0x7f9e900acab0 2021-11-15T19:35:50.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e900573d0 con 0x7f9e900acab0 2021-11-15T19:35:50.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e8dffb700 1 -- 172.21.2.137:0/937323235 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f9e80023020 con 0x7f9e900acab0 2021-11-15T19:35:50.714 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:50.714 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":141,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:35:46.432707+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:35:43.261809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T19:35:44.405561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:35:50.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e70053580 msgr2=0x7f9e70055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e70053580 0x7f9e70055a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f9e8400b000 tx=0x7f9e84008040).stop 2021-11-15T19:35:50.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 msgr2=0x7f9e9013a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 0x7f9e9013a6d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f9e80002f70 tx=0x7f9e80014000).stop 2021-11-15T19:35:50.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 shutdown_connections 2021-11-15T19:35:50.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e70053580 0x7f9e70055a40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9e900b1180 0x7f9e9013f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9e900af2f0 0x7f9e90138460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 --2- 172.21.2.137:0/937323235 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9e900acab0 0x7f9e9013a6d0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 >> 172.21.2.137:0/937323235 conn(0x7f9e900630f0 msgr2=0x7f9e90069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:50.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 shutdown_connections 2021-11-15T19:35:50.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.702+0000 7f9e96ecd700 1 -- 172.21.2.137:0/937323235 wait complete. 2021-11-15T19:35:50.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:35:43.261809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:35:44.405561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:35:50.722 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:35:50.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.762+0000 7fbc4ffff700 1 Processor -- start 2021-11-15T19:35:50.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.762+0000 7fbc4ffff700 1 -- start start 2021-11-15T19:35:50.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.762+0000 7fbc4ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbc500b11b0 0x7fbc500af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.762+0000 7fbc4ffff700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc500a9e50 con 0x7fbc5009a2f0 2021-11-15T19:35:50.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.762+0000 7fbc4ffff700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc500b1590 con 0x7fbc500608a0 2021-11-15T19:35:50.776 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.762+0000 7fbc4ffff700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc50098d50 con 0x7fbc500b11b0 2021-11-15T19:35:50.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fbc500b11b0 0x7fbc500af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4e7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbc500608a0 0x7fbc5005c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59614/0 (socket says 172.21.2.137:59614) 2021-11-15T19:35:50.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4e7fc700 1 -- 172.21.2.137:0/196455756 learned_addr learned my addr 172.21.2.137:0/196455756 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:50.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/196455756 >> v1:172.21.2.137:6789/0 conn(0x7fbc500608a0 legacy=0x7fbc5005c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/196455756 >> v1:172.21.2.111:6789/0 conn(0x7fbc5009a2f0 legacy=0x7fbc5009a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:50.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/196455756 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500aa080 con 0x7fbc500b11b0 2021-11-15T19:35:50.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- 172.21.2.137:0/196455756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500b11b0 0x7fbc500af6e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fbc500aa400 tx=0x7fbc40006df0).ready entity=mon.1 client_cookie=a2ccfb59f3e2288d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4dffb700 1 -- 172.21.2.137:0/196455756 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc4000d5c0 con 0x7fbc500b11b0 2021-11-15T19:35:50.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4dffb700 1 -- 172.21.2.137:0/196455756 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40000e90 con 0x7fbc500b11b0 2021-11-15T19:35:50.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4dffb700 1 -- 172.21.2.137:0/196455756 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc4000d910 con 0x7fbc500b11b0 2021-11-15T19:35:50.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/196455756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500b11b0 msgr2=0x7fbc500af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/196455756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500b11b0 0x7fbc500af6e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fbc500aa400 tx=0x7fbc40006df0).stop 2021-11-15T19:35:50.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/196455756 shutdown_connections 2021-11-15T19:35:50.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/196455756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500b11b0 0x7fbc500af6e0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/196455756 >> 172.21.2.137:0/196455756 conn(0x7fbc500b22b0 msgr2=0x7fbc5005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:50.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/196455756 shutdown_connections 2021-11-15T19:35:50.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/196455756 wait complete. 2021-11-15T19:35:50.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 Processor -- start 2021-11-15T19:35:50.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- start start 2021-11-15T19:35:50.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 0x7fbc500636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc5009a2f0 0x7fbc50065f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc500b11b0 0x7fbc50066480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50065450 con 0x7fbc5009a2f0 2021-11-15T19:35:50.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50097930 con 0x7fbc500608a0 2021-11-15T19:35:50.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500976d0 con 0x7fbc500b11b0 2021-11-15T19:35:50.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 0x7fbc500636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 0x7fbc500636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40834/0 (socket says 172.21.2.137:40834) 2021-11-15T19:35:50.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/2118663662 learned_addr learned my addr 172.21.2.137:0/2118663662 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:50.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc500b11b0 msgr2=0x7fbc50066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc500b11b0 0x7fbc50066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:50.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc5009a2f0 msgr2=0x7fbc50065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc5009a2f0 0x7fbc50065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:50.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 -- 172.21.2.137:0/2118663662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4000b180 con 0x7fbc500608a0 2021-11-15T19:35:50.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4effd700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 0x7fbc500636b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fbc500aa400 tx=0x7fbc40012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc40016070 con 0x7fbc500608a0 2021-11-15T19:35:50.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40002f50 con 0x7fbc500608a0 2021-11-15T19:35:50.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc50062710 con 0x7fbc500608a0 2021-11-15T19:35:50.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc4001e450 con 0x7fbc500608a0 2021-11-15T19:35:50.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.766+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc50067340 con 0x7fbc500608a0 2021-11-15T19:35:50.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc500628d0 con 0x7fbc500608a0 2021-11-15T19:35:50.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc40025030 con 0x7fbc500608a0 2021-11-15T19:35:50.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc47fff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc34053580 0x7fbc34055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fbc4006ca50 con 0x7fbc500608a0 2021-11-15T19:35:50.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc4e7fc700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc34053580 0x7fbc34055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc4e7fc700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc34053580 0x7fbc34055a40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fbc5006ab40 tx=0x7fbc380077d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.770+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc500628d0 con 0x7fbc500608a0 2021-11-15T19:35:50.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbc500628d0 con 0x7fbc500608a0 2021-11-15T19:35:50.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc47fff700 1 -- 172.21.2.137:0/2118663662 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbc500628d0 con 0x7fbc500608a0 2021-11-15T19:35:50.866 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:35:50.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc34053580 msgr2=0x7fbc34055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc34053580 0x7fbc34055a40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fbc5006ab40 tx=0x7fbc380077d0).stop 2021-11-15T19:35:50.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 msgr2=0x7fbc500636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 0x7fbc500636b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fbc500aa400 tx=0x7fbc40012000).stop 2021-11-15T19:35:50.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 shutdown_connections 2021-11-15T19:35:50.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc34053580 0x7fbc34055a40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbc500b11b0 0x7fbc50066480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:50.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbc5009a2f0 0x7fbc50065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:50.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 --2- 172.21.2.137:0/2118663662 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbc500608a0 0x7fbc500636b0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 >> 172.21.2.137:0/2118663662 conn(0x7fbc500b22b0 msgr2=0x7fbc501498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:50.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 shutdown_connections 2021-11-15T19:35:50.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.854+0000 7fbc4ffff700 1 -- 172.21.2.137:0/2118663662 wait complete. 2021-11-15T19:35:50.873 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:35:50.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 Processor -- start 2021-11-15T19:35:50.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 -- start start 2021-11-15T19:35:50.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc8080b72e0 0x7fc8080b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080ad320 0x7fc8081290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8080b76c0 con 0x7fc8080acd60 2021-11-15T19:35:50.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080b3100 con 0x7fc8080b72e0 2021-11-15T19:35:50.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ef21700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80812a170 con 0x7fc8080ad320 2021-11-15T19:35:50.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80ccbd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc8080b72e0 0x7fc8080b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc807fff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fc8080acd60 0x7fc8080b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52118/0 (socket says 172.21.2.137:52118) 2021-11-15T19:35:50.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc807fff700 1 -- 172.21.2.137:0/2065176975 learned_addr learned my addr 172.21.2.137:0/2065176975 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:50.928 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.914+0000 7fc80d4be700 1 --2- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080ad320 0x7fc8081290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.929 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ccbd700 1 -- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080ad320 msgr2=0x7fc8081290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ccbd700 1 --2- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080ad320 0x7fc8081290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ccbd700 1 -- 172.21.2.137:0/2065176975 >> v1:172.21.2.111:6789/0 conn(0x7fc8080acd60 legacy=0x7fc8080b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ccbd700 1 -- 172.21.2.137:0/2065176975 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080ad8a0 con 0x7fc8080b72e0 2021-11-15T19:35:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ccbd700 1 --2- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080b72e0 0x7fc8080b19b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fc7f8002f70 tx=0x7fc7f8006df0).ready entity=mon.0 client_cookie=60693e09b92e83a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc8077fe700 1 -- 172.21.2.137:0/2065176975 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f800d570 con 0x7fc8080b72e0 2021-11-15T19:35:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc8077fe700 1 -- 172.21.2.137:0/2065176975 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8000e90 con 0x7fc8080b72e0 2021-11-15T19:35:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc8077fe700 1 -- 172.21.2.137:0/2065176975 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f800d8c0 con 0x7fc8080b72e0 2021-11-15T19:35:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080b72e0 msgr2=0x7fc8080b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:50.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 --2- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080b72e0 0x7fc8080b19b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fc7f8002f70 tx=0x7fc7f8006df0).stop 2021-11-15T19:35:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- 172.21.2.137:0/2065176975 shutdown_connections 2021-11-15T19:35:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 --2- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080ad320 0x7fc8081290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 --2- 172.21.2.137:0/2065176975 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080b72e0 0x7fc8080b19b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- 172.21.2.137:0/2065176975 >> 172.21.2.137:0/2065176975 conn(0x7fc808064960 msgr2=0x7fc808064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:50.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- 172.21.2.137:0/2065176975 shutdown_connections 2021-11-15T19:35:50.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- 172.21.2.137:0/2065176975 wait complete. 2021-11-15T19:35:50.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 Processor -- start 2021-11-15T19:35:50.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- start start 2021-11-15T19:35:50.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080acd60 0x7fc808128250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080ad320 0x7fc808152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 0x7fc80813fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808146170 con 0x7fc8080ad320 2021-11-15T19:35:50.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808152b50 con 0x7fc8080b72e0 2021-11-15T19:35:50.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80ef21700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc808146910 con 0x7fc8080acd60 2021-11-15T19:35:50.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 0x7fc80813fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 0x7fc80813fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40848/0 (socket says 172.21.2.137:40848) 2021-11-15T19:35:50.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 -- 172.21.2.137:0/538071900 learned_addr learned my addr 172.21.2.137:0/538071900 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:50.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 -- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080acd60 msgr2=0x7fc808128250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:50.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080acd60 0x7fc808128250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:50.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 -- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080ad320 msgr2=0x7fc808152660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:50.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080ad320 0x7fc808152660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:50.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 -- 172.21.2.137:0/538071900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f800b180 con 0x7fc8080b72e0 2021-11-15T19:35:50.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.918+0000 7fc80d4be700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 0x7fc80813fc90 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fc808151c40 tx=0x7fc8000091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc80000c850 con 0x7fc8080b72e0 2021-11-15T19:35:50.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80000c9b0 con 0x7fc8080b72e0 2021-11-15T19:35:50.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc808146bb0 con 0x7fc8080b72e0 2021-11-15T19:35:50.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc80000cd10 con 0x7fc8080b72e0 2021-11-15T19:35:50.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc808146360 con 0x7fc8080b72e0 2021-11-15T19:35:50.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8080b3a50 con 0x7fc8080b72e0 2021-11-15T19:35:50.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc800022070 con 0x7fc8080b72e0 2021-11-15T19:35:50.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc7e80536a0 0x7fc7e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:50.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc80006c200 con 0x7fc8080b72e0 2021-11-15T19:35:50.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc80ccbd700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc7e80536a0 0x7fc7e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:50.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc80ccbd700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc7e80536a0 0x7fc7e8055b60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fc7f8002f70 tx=0x7fc7f8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:50.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:50.922+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8000431d0 con 0x7fc8080b72e0 2021-11-15T19:35:51.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc808147130 con 0x7fc8080b72e0 2021-11-15T19:35:51.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc805ffb700 1 -- 172.21.2.137:0/538071900 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8000467f0 con 0x7fc8080b72e0 2021-11-15T19:35:51.018 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:51.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc7e80536a0 msgr2=0x7fc7e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc7e80536a0 0x7fc7e8055b60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fc7f8002f70 tx=0x7fc7f8014000).stop 2021-11-15T19:35:51.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 msgr2=0x7fc80813fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 0x7fc80813fc90 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fc808151c40 tx=0x7fc8000091d0).stop 2021-11-15T19:35:51.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 shutdown_connections 2021-11-15T19:35:51.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc7e80536a0 0x7fc7e8055b60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc8080b72e0 0x7fc80813fc90 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc8080ad320 0x7fc808152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 --2- 172.21.2.137:0/538071900 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc8080acd60 0x7fc808128250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 >> 172.21.2.137:0/538071900 conn(0x7fc808064960 msgr2=0x7fc8080617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 shutdown_connections 2021-11-15T19:35:51.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.006+0000 7fc80ef21700 1 -- 172.21.2.137:0/538071900 wait complete. 2021-11-15T19:35:51.025 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:35:51.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 Processor -- start 2021-11-15T19:35:51.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- start start 2021-11-15T19:35:51.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f546813c840 0x7f54680af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 0x7f546813fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546805cb50 con 0x7f546805c770 2021-11-15T19:35:51.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546813f1b0 con 0x7f546813c840 2021-11-15T19:35:51.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546813f450 con 0x7f54680b1100 2021-11-15T19:35:51.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5466ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f546805c770 0x7f546813c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59636/0 (socket says 172.21.2.137:59636) 2021-11-15T19:35:51.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5466ffd700 1 -- 172.21.2.137:0/2408173345 learned_addr learned my addr 172.21.2.137:0/2408173345 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:51.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300794516 0 0) 0x7f546805cb50 con 0x7f546805c770 2021-11-15T19:35:51.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5448003260 con 0x7f546805c770 2021-11-15T19:35:51.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54667fc700 1 --2- 172.21.2.137:0/2408173345 >> v2:172.21.2.111:3300/0 conn(0x7f546813c840 0x7f54680af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 0x7f546813fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921725564 0 0) 0x7f5448003260 con 0x7f546805c770 2021-11-15T19:35:51.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 msgr2=0x7f546813fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:51.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 0x7f546813fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 >> v2:172.21.2.111:3300/0 conn(0x7f546813c840 msgr2=0x7f54680af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:51.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 --2- 172.21.2.137:0/2408173345 >> v2:172.21.2.111:3300/0 conn(0x7f546813c840 0x7f54680af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546813f6f0 con 0x7f546805c770 2021-11-15T19:35:51.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f5450001660 con 0x7f546805c770 2021-11-15T19:35:51.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 >> v1:172.21.2.137:6789/0 conn(0x7f546805c770 legacy=0x7f546813c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 0x7f54480037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5448003e90 0x7f5448004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5448004b10 0x7f5448004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546813f1b0 con 0x7f5448003e90 2021-11-15T19:35:51.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546813f450 con 0x7f5448004b10 2021-11-15T19:35:51.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544800ba60 con 0x7f54680b1100 2021-11-15T19:35:51.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54667fc700 1 --2- 172.21.2.137:0/2408173345 >> v2:172.21.2.111:3300/0 conn(0x7f546813c840 0x7f54680af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:51.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5448004b10 0x7f5448004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 -- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 msgr2=0x7f54480037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:51.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f54680b1100 0x7f54480037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 -- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5448003e90 msgr2=0x7f5448004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:51.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f5448003e90 0x7f5448004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 -- 172.21.2.137:0/2408173345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546813f6f0 con 0x7f5448004b10 2021-11-15T19:35:51.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5448004b10 0x7f5448004f90 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f5460007000 tx=0x7f5460008040).ready entity=mon.1 client_cookie=a044fbeaa0dc82df server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546000c640 con 0x7f5448004b10 2021-11-15T19:35:51.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546000c7a0 con 0x7f5448004b10 2021-11-15T19:35:51.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f5465ffb700 1 -- 172.21.2.137:0/2408173345 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546000cb00 con 0x7f5448004b10 2021-11-15T19:35:51.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- 172.21.2.137:0/2408173345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5448004b10 msgr2=0x7f5448004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 --2- 172.21.2.137:0/2408173345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5448004b10 0x7f5448004f90 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f5460007000 tx=0x7f5460008040).stop 2021-11-15T19:35:51.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f54677fe700 1 -- 172.21.2.137:0/2408173345 reap_dead start 2021-11-15T19:35:51.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- 172.21.2.137:0/2408173345 shutdown_connections 2021-11-15T19:35:51.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- 172.21.2.137:0/2408173345 >> 172.21.2.137:0/2408173345 conn(0x7f5468060200 msgr2=0x7f546805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.066+0000 7f546d6be700 1 -- 172.21.2.137:0/2408173345 shutdown_connections 2021-11-15T19:35:51.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- 172.21.2.137:0/2408173345 wait complete. 2021-11-15T19:35:51.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 Processor -- start 2021-11-15T19:35:51.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- start start 2021-11-15T19:35:51.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546812dcb0 0x7f5468134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 0x7f5468066f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54680b4a40 0x7f54680b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5468065140 con 0x7f54680b4a40 2021-11-15T19:35:51.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54680665f0 con 0x7f5468063c90 2021-11-15T19:35:51.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546812e090 con 0x7f546812dcb0 2021-11-15T19:35:51.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 0x7f5468066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 0x7f5468066f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40866/0 (socket says 172.21.2.137:40866) 2021-11-15T19:35:51.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 -- 172.21.2.137:0/2111835306 learned_addr learned my addr 172.21.2.137:0/2111835306 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:51.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 -- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546812dcb0 msgr2=0x7f5468134b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546812dcb0 0x7f5468134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 -- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54680b4a40 msgr2=0x7f54680b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54680b4a40 0x7f54680b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 -- 172.21.2.137:0/2111835306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468066820 con 0x7f5468063c90 2021-11-15T19:35:51.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f54667fc700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 0x7f5468066f60 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f54680aa270 tx=0x7f5458008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5458010580 con 0x7f5468063c90 2021-11-15T19:35:51.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800c030 con 0x7f5468063c90 2021-11-15T19:35:51.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5468066ac0 con 0x7f5468063c90 2021-11-15T19:35:51.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54580106e0 con 0x7f5468063c90 2021-11-15T19:35:51.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54680ab2e0 con 0x7f5468063c90 2021-11-15T19:35:51.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54680573d0 con 0x7f5468063c90 2021-11-15T19:35:51.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5458017020 con 0x7f5468063c90 2021-11-15T19:35:51.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f545ffff700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f544c053660 0x7f544c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f545806b2f0 con 0x7f5468063c90 2021-11-15T19:35:51.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.070+0000 7f5466ffd700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f544c053660 0x7f544c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.074+0000 7f5466ffd700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f544c053660 0x7f544c055b20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f5450001370 tx=0x7f54500015b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.074+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54580422e0 con 0x7f5468063c90 2021-11-15T19:35:51.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.154+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54680b2cd0 con 0x7f5468063c90 2021-11-15T19:35:51.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f545ffff700 1 -- 172.21.2.137:0/2111835306 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5458015070 con 0x7f5468063c90 2021-11-15T19:35:51.168 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:51.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f544c053660 msgr2=0x7f544c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f544c053660 0x7f544c055b20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f5450001370 tx=0x7f54500015b0).stop 2021-11-15T19:35:51.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 msgr2=0x7f5468066f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 0x7f5468066f60 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f54680aa270 tx=0x7f5458008040).stop 2021-11-15T19:35:51.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 shutdown_connections 2021-11-15T19:35:51.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f544c053660 0x7f544c055b20 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f54680b4a40 0x7f54680b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5468063c90 0x7f5468066f60 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 --2- 172.21.2.137:0/2111835306 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f546812dcb0 0x7f5468134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 >> 172.21.2.137:0/2111835306 conn(0x7f5448004b10 msgr2=0x7f5468135290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 shutdown_connections 2021-11-15T19:35:51.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.158+0000 7f546d6be700 1 -- 172.21.2.137:0/2111835306 wait complete. 2021-11-15T19:35:51.175 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:35:51.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.214+0000 7fa169305700 1 Processor -- start 2021-11-15T19:35:51.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.214+0000 7fa169305700 1 -- start start 2021-11-15T19:35:51.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1640b0550 0x7fa16414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa16414aaa0 0x7fa164140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16405cb50 con 0x7fa16405c770 2021-11-15T19:35:51.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1640b1650 con 0x7fa16414aaa0 2021-11-15T19:35:51.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640ad030 con 0x7fa1640b0550 2021-11-15T19:35:51.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa16414aaa0 0x7fa164140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa16414aaa0 0x7fa164140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40878/0 (socket says 172.21.2.137:40878) 2021-11-15T19:35:51.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 -- 172.21.2.137:0/3126047046 learned_addr learned my addr 172.21.2.137:0/3126047046 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:51.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 -- 172.21.2.137:0/3126047046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1640b0550 msgr2=0x7fa16414a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:51.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 --2- 172.21.2.137:0/3126047046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1640b0550 0x7fa16414a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 -- 172.21.2.137:0/3126047046 >> v1:172.21.2.111:6789/0 conn(0x7fa16405c770 legacy=0x7fa1640aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:51.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 -- 172.21.2.137:0/3126047046 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640ad2d0 con 0x7fa16414aaa0 2021-11-15T19:35:51.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1637fe700 1 --2- 172.21.2.137:0/3126047046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa16414aaa0 0x7fa164140aa0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7fa1640adfd0 tx=0x7fa15c009290).ready entity=mon.1 client_cookie=19c2939f83c9a6ae server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa161ffb700 1 -- 172.21.2.137:0/3126047046 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15c00b860 con 0x7fa16414aaa0 2021-11-15T19:35:51.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa161ffb700 1 -- 172.21.2.137:0/3126047046 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00b9c0 con 0x7fa16414aaa0 2021-11-15T19:35:51.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa161ffb700 1 -- 172.21.2.137:0/3126047046 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15c00bb70 con 0x7fa16414aaa0 2021-11-15T19:35:51.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/3126047046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa16414aaa0 msgr2=0x7fa164140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- 172.21.2.137:0/3126047046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa16414aaa0 0x7fa164140aa0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7fa1640adfd0 tx=0x7fa15c009290).stop 2021-11-15T19:35:51.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/3126047046 shutdown_connections 2021-11-15T19:35:51.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- 172.21.2.137:0/3126047046 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa16414aaa0 0x7fa164140aa0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- 172.21.2.137:0/3126047046 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa1640b0550 0x7fa16414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/3126047046 >> 172.21.2.137:0/3126047046 conn(0x7fa1640631e0 msgr2=0x7fa16405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/3126047046 shutdown_connections 2021-11-15T19:35:51.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/3126047046 wait complete. 2021-11-15T19:35:51.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 Processor -- start 2021-11-15T19:35:51.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- start start 2021-11-15T19:35:51.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa16405c770 0x7fa164142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 0x7fa164066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa16414aaa0 0x7fa1640670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164141d10 con 0x7fa16405c770 2021-11-15T19:35:51.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164064480 con 0x7fa1640b0550 2021-11-15T19:35:51.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa164064720 con 0x7fa16414aaa0 2021-11-15T19:35:51.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 0x7fa164066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 0x7fa164066bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40880/0 (socket says 172.21.2.137:40880) 2021-11-15T19:35:51.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 -- 172.21.2.137:0/263809543 learned_addr learned my addr 172.21.2.137:0/263809543 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:51.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 -- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa16414aaa0 msgr2=0x7fa1640670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa16414aaa0 0x7fa1640670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 -- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa16405c770 msgr2=0x7fa164142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa16405c770 0x7fa164142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 -- 172.21.2.137:0/263809543 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c009530 con 0x7fa1640b0550 2021-11-15T19:35:51.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa1627fc700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 0x7fa164066bc0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fa154002fb0 tx=0x7fa154006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa154013460 con 0x7fa1640b0550 2021-11-15T19:35:51.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1540135c0 con 0x7fa1640b0550 2021-11-15T19:35:51.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa164142270 con 0x7fa1640b0550 2021-11-15T19:35:51.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa154013920 con 0x7fa1640b0550 2021-11-15T19:35:51.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.218+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa164142710 con 0x7fa1640b0550 2021-11-15T19:35:51.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa164142400 con 0x7fa1640b0550 2021-11-15T19:35:51.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa15400f070 con 0x7fa1640b0550 2021-11-15T19:35:51.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa15bfff700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa148053610 0x7fa148055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa15406b3e0 con 0x7fa1640b0550 2021-11-15T19:35:51.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa162ffd700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa148053610 0x7fa148055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa162ffd700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa148053610 0x7fa148055ad0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fa14c002ef0 tx=0x7fa14c006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.222+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa154042540 con 0x7fa1640b0550 2021-11-15T19:35:51.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1640ae7f0 con 0x7fa1640b0550 2021-11-15T19:35:51.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa15bfff700 1 -- 172.21.2.137:0/263809543 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa154045b60 con 0x7fa1640b0550 2021-11-15T19:35:51.318 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:35:51.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa148053610 msgr2=0x7fa148055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa148053610 0x7fa148055ad0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fa14c002ef0 tx=0x7fa14c006910).stop 2021-11-15T19:35:51.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 msgr2=0x7fa164066bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 0x7fa164066bc0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fa154002fb0 tx=0x7fa154006df0).stop 2021-11-15T19:35:51.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 shutdown_connections 2021-11-15T19:35:51.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa148053610 0x7fa148055ad0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa16414aaa0 0x7fa1640670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa1640b0550 0x7fa164066bc0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 --2- 172.21.2.137:0/263809543 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa16405c770 0x7fa164142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 >> 172.21.2.137:0/263809543 conn(0x7fa1640631e0 msgr2=0x7fa164149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 shutdown_connections 2021-11-15T19:35:51.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.306+0000 7fa169305700 1 -- 172.21.2.137:0/263809543 wait complete. 2021-11-15T19:35:51.326 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:35:51.326 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:51.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 Processor -- start 2021-11-15T19:35:51.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- start start 2021-11-15T19:35:51.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f70ac144610 0x7f70ac147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f70ac0a9f50 0x7f70ac0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ac148190 con 0x7f70ac0b1340 2021-11-15T19:35:51.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0b1720 con 0x7f70ac0a9f50 2021-11-15T19:35:51.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac147e70 con 0x7f70ac144610 2021-11-15T19:35:51.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f70ac144610 0x7f70ac147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f70ac144610 0x7f70ac147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40890/0 (socket says 172.21.2.137:40890) 2021-11-15T19:35:51.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 -- 172.21.2.137:0/396344126 learned_addr learned my addr 172.21.2.137:0/396344126 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:51.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 -- 172.21.2.137:0/396344126 >> v2:172.21.2.111:3300/0 conn(0x7f70ac0a9f50 msgr2=0x7f70ac0aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:51.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 --2- 172.21.2.137:0/396344126 >> v2:172.21.2.111:3300/0 conn(0x7f70ac0a9f50 0x7f70ac0aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 -- 172.21.2.137:0/396344126 >> v1:172.21.2.111:6789/0 conn(0x7f70ac0b1340 legacy=0x7f70ac143f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:51.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 -- 172.21.2.137:0/396344126 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0af800 con 0x7f70ac144610 2021-11-15T19:35:51.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b0923700 1 --2- 172.21.2.137:0/396344126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac144610 0x7f70ac147980 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f70ac062250 tx=0x7f709c006eb0).ready entity=mon.1 client_cookie=f446e2d7e295e724 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f709bfff700 1 -- 172.21.2.137:0/396344126 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00d5c0 con 0x7f70ac144610 2021-11-15T19:35:51.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f709bfff700 1 -- 172.21.2.137:0/396344126 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c000e90 con 0x7f70ac144610 2021-11-15T19:35:51.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f709bfff700 1 -- 172.21.2.137:0/396344126 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00d910 con 0x7f70ac144610 2021-11-15T19:35:51.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- 172.21.2.137:0/396344126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac144610 msgr2=0x7f70ac147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 --2- 172.21.2.137:0/396344126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac144610 0x7f70ac147980 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f70ac062250 tx=0x7f709c006eb0).stop 2021-11-15T19:35:51.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- 172.21.2.137:0/396344126 shutdown_connections 2021-11-15T19:35:51.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 --2- 172.21.2.137:0/396344126 >> v2:172.21.2.111:3300/0 conn(0x7f70ac0a9f50 0x7f70ac0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 --2- 172.21.2.137:0/396344126 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac144610 0x7f70ac147980 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- 172.21.2.137:0/396344126 >> 172.21.2.137:0/396344126 conn(0x7f70ac0b4e60 msgr2=0x7f70ac0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- 172.21.2.137:0/396344126 shutdown_connections 2021-11-15T19:35:51.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.366+0000 7f70b3388700 1 -- 172.21.2.137:0/396344126 wait complete. 2021-11-15T19:35:51.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 Processor -- start 2021-11-15T19:35:51.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- start start 2021-11-15T19:35:51.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 0x7f70ac0ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70ac0b1340 0x7f70ac149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ac144610 0x7f70ac0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac149b40 con 0x7f70ac144610 2021-11-15T19:35:51.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac148430 con 0x7f70ac0a9f50 2021-11-15T19:35:51.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac149760 con 0x7f70ac0b1340 2021-11-15T19:35:51.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 0x7f70ac0ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 0x7f70ac0ac5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40896/0 (socket says 172.21.2.137:40896) 2021-11-15T19:35:51.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 -- 172.21.2.137:0/533246470 learned_addr learned my addr 172.21.2.137:0/533246470 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:51.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 -- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70ac0b1340 msgr2=0x7f70ac149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70ac0b1340 0x7f70ac149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 -- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ac144610 msgr2=0x7f70ac0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ac144610 0x7f70ac0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 -- 172.21.2.137:0/533246470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c00b1e0 con 0x7f70ac0a9f50 2021-11-15T19:35:51.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b1124700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 0x7f70ac0ac5e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f70ac1498f0 tx=0x7f70a8006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a8009e90 con 0x7f70ac0a9f50 2021-11-15T19:35:51.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8002320 con 0x7f70ac0a9f50 2021-11-15T19:35:51.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac148690 con 0x7f70ac0a9f50 2021-11-15T19:35:51.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac156810 con 0x7f70ac0a9f50 2021-11-15T19:35:51.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a8002680 con 0x7f70ac0a9f50 2021-11-15T19:35:51.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ac05faf0 con 0x7f70ac0a9f50 2021-11-15T19:35:51.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f70a800f030 con 0x7f70ac0a9f50 2021-11-15T19:35:51.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f709a7fc700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f708c053720 0x7f708c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:51.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f70a806b7b0 con 0x7f70ac0a9f50 2021-11-15T19:35:51.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.370+0000 7f70b0923700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f708c053720 0x7f708c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:51.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.374+0000 7f70b0923700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f708c053720 0x7f708c055be0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f70ac062250 tx=0x7f709c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:51.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.374+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70a8042800 con 0x7f70ac0a9f50 2021-11-15T19:35:51.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.478+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70ac15a760 con 0x7f70ac0a9f50 2021-11-15T19:35:51.492 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f709a7fc700 1 -- 172.21.2.137:0/533246470 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f70a8045e20 con 0x7f70ac0a9f50 2021-11-15T19:35:51.492 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:51.493 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:45.426948+0000","modified":"2021-11-15T19:35:46.431620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8338":{"gid":8338,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4036717918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4036717918},{"type":"v1","addr":"172.21.2.137:6833","nonce":4036717918}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T19:35:51.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f708c053720 msgr2=0x7f708c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f708c053720 0x7f708c055be0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f70ac062250 tx=0x7f709c015000).stop 2021-11-15T19:35:51.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 msgr2=0x7f70ac0ac5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:51.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 0x7f70ac0ac5e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f70ac1498f0 tx=0x7f70a8006d50).stop 2021-11-15T19:35:51.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 shutdown_connections 2021-11-15T19:35:51.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f708c053720 0x7f708c055be0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70ac144610 0x7f70ac0ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70ac0b1340 0x7f70ac149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:51.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 --2- 172.21.2.137:0/533246470 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70ac0a9f50 0x7f70ac0ac5e0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:51.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 >> 172.21.2.137:0/533246470 conn(0x7f70ac0b4e60 msgr2=0x7f70ac0b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:51.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 shutdown_connections 2021-11-15T19:35:51.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:51.482+0000 7f70b3388700 1 -- 172.21.2.137:0/533246470 wait complete. 2021-11-15T19:35:51.497 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 73 2021-11-15T19:35:51.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:35:45.426948+0000', 'modified': '2021-11-15T19:35:46.431620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8338}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8338': {'gid': 8338, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/4036717918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 4036717918}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 4036717918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:35:51.702 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:35:51.703 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:35:51.767 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":8338,"want_state":"up:active","state":"up:active","rank_uptime":6.3270148600000002,"mdsmap_epoch":73,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":10.45391487} 2021-11-15T19:35:51.768 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 8338, "mdsmap_epoch": 73, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 6.32701486, "state": "up:active", "uptime": 10.45391487, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:35:51.768 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:35:51.769 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:35:51.769 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:35:51.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:51.770 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:51.781 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:51.793 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:51.793 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:51.844 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:51.845 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:51.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:51.846 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:51.851 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:35:51.852 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:51.895 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:51.907 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:51.907 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:51.912 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:51.913 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:51.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:51.914 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:51.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:35:51.932+0000 7f09ad5b2080 -1 init, newargv = 0x55e74230bb90 newargc=9ceph-fuse[14799]: starting ceph client 2021-11-15T19:35:51.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr: 2021-11-15T19:35:51.948 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14799]: starting fuse 2021-11-15T19:35:53.042 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:35:53.054 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:35:53.055 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:35:53.105 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:35:53.105 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:35:53.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.107 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:35:53.113 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:35:53.113 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:35:53.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.114 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:35:53.114 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:35:53.115 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:35:53.115 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:35:53.116 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:35:53.116 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:53.116 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:35:53.117 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:35:53.117 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:35:53.117 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:53.118 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:35:53.118 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:35:53.119 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:35:53.119 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:35:53.120 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:53.120 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:35:53.120 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:35:53.121 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:35:53.121 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:35:53.121 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:35:53.122 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:35:53.122 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:35:53.123 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:35:53.157 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14799.asok 2021-11-15T19:35:53.159 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14799.asok 2021-11-15T19:35:53.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.160 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14799.asok status 2021-11-15T19:35:53.250 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:35:53.251 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:35:53.251 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:35:53.251 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:35:53.251 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:35:53.252 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:35:53.252 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:35:53.252 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14799", 2021-11-15T19:35:53.252 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:35:53.252 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:53.253 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:35:53.253 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:35:53.253 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 8545, 2021-11-15T19:35:53.253 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:35:53.254 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:35:53.254 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:35:53.254 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 8545 2021-11-15T19:35:53.254 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:53.254 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:35:53.255 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:35:53.255 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:35:53.255 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 383130292 2021-11-15T19:35:53.255 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:35:53.256 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:53.256 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:35:53.256 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:35:53.256 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:35:53.256 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 383130292 2021-11-15T19:35:53.257 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:35:53.257 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.8545 172.21.2.118:0/383130292", 2021-11-15T19:35:53.257 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/383130292", 2021-11-15T19:35:53.257 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:35:53.257 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 73, 2021-11-15T19:35:53.258 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 141, 2021-11-15T19:35:53.258 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:35:53.258 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:35:53.258 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:35:53.259 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:35:53.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.260 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:53.261 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:53.266 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:53.267 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:53.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.267 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:53.276 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T19:35:53.277 DEBUG:teuthology.orchestra.run.gibba031:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-11-15T19:35:53.316 INFO:teuthology.orchestra.run.gibba031.stdout:1637004953.276552403 2021-11-15T19:35:53.317 INFO:tasks.cephfs.test_misc:rctime = 1637004953.276552403 2021-11-15T19:35:53.317 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:35:53.318 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:53.331 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:53.344 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:53.356 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:53.366 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:35:53.379 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:35:53.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.380 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:53.380 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:53.419 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:35:53.421 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:35:53.421 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba031.front.sepia.ceph.com... 2021-11-15T19:35:53.421 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:35:53.422 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:53.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15345]: fuse finished with error 0 and tester_r 0 2021-11-15T19:35:53.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.437 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:53.437 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:53.486 INFO:teuthology.orchestra.run.gibba031.stdout:ext2/ext3 2021-11-15T19:35:53.487 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:35:53.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:53.608 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:35:53.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.618 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:53.619 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:53.630 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:35:53.631 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:35:53.632 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:35:53.632 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:35:53.633 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:53.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14799]: fuse finished with error 0 and tester_r 0 2021-11-15T19:35:53.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.655 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:53.656 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:53.705 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:35:53.706 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:35:53.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:53.748 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:35:53.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:35:53.758 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:35:53.758 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:53.768 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:53.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:53.769 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:35:53.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:35:53.770 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:35:53.818 INFO:teuthology.orchestra.run.gibba017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:35:53.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:35:53.820 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:35:53.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 Processor -- start 2021-11-15T19:35:53.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- start start 2021-11-15T19:35:53.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f81780b1180 0x7f8178142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:53.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780af2f0 0x7f8178143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:53.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81780aecf0 con 0x7f81780acab0 2021-11-15T19:35:53.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817813f180 con 0x7f81780b1180 2021-11-15T19:35:53.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780aef20 con 0x7f81780af2f0 2021-11-15T19:35:53.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817db27700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f81780acab0 0x7f81780b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59684/0 (socket says 172.21.2.137:59684) 2021-11-15T19:35:53.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817d326700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f81780b1180 0x7f8178142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:53.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817db27700 1 -- 172.21.2.137:0/2729115482 learned_addr learned my addr 172.21.2.137:0/2729115482 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:53.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817d326700 1 -- 172.21.2.137:0/2729115482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780af2f0 msgr2=0x7f8178143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:53.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817d326700 1 --2- 172.21.2.137:0/2729115482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780af2f0 0x7f8178143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:53.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817d326700 1 -- 172.21.2.137:0/2729115482 >> v1:172.21.2.137:6789/0 conn(0x7f81780acab0 legacy=0x7f81780b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:53.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817d326700 1 -- 172.21.2.137:0/2729115482 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780b2770 con 0x7f81780b1180 2021-11-15T19:35:53.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817d326700 1 --2- 172.21.2.137:0/2729115482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780b1180 0x7f8178142b80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f8168002f70 tx=0x7f8168006df0).ready entity=mon.1 client_cookie=8b938ad458b339a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:53.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817cb25700 1 -- 172.21.2.137:0/2729115482 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816800d570 con 0x7f81780b1180 2021-11-15T19:35:53.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817cb25700 1 -- 172.21.2.137:0/2729115482 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8168000e90 con 0x7f81780b1180 2021-11-15T19:35:53.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817cb25700 1 -- 172.21.2.137:0/2729115482 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816800d8c0 con 0x7f81780b1180 2021-11-15T19:35:53.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- 172.21.2.137:0/2729115482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780b1180 msgr2=0x7f8178142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:53.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 --2- 172.21.2.137:0/2729115482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780b1180 0x7f8178142b80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f8168002f70 tx=0x7f8168006df0).stop 2021-11-15T19:35:53.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- 172.21.2.137:0/2729115482 shutdown_connections 2021-11-15T19:35:53.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 --2- 172.21.2.137:0/2729115482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780b1180 0x7f8178142b80 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:53.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 --2- 172.21.2.137:0/2729115482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780af2f0 0x7f8178143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:53.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- 172.21.2.137:0/2729115482 >> 172.21.2.137:0/2729115482 conn(0x7f81780630f0 msgr2=0x7f81780634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:53.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- 172.21.2.137:0/2729115482 shutdown_connections 2021-11-15T19:35:53.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- 172.21.2.137:0/2729115482 wait complete. 2021-11-15T19:35:53.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 Processor -- start 2021-11-15T19:35:53.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.870+0000 7f817fd8b700 1 -- start start 2021-11-15T19:35:53.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81780acab0 0x7f8178111b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:53.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 0x7f81780b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:53.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780b1180 0x7f817813b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:53.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81781526f0 con 0x7f81780acab0 2021-11-15T19:35:53.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178152990 con 0x7f81780af2f0 2021-11-15T19:35:53.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8178152c30 con 0x7f81780b1180 2021-11-15T19:35:53.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 0x7f81780b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:53.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 0x7f81780b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40910/0 (socket says 172.21.2.137:40910) 2021-11-15T19:35:53.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 -- 172.21.2.137:0/1085743882 learned_addr learned my addr 172.21.2.137:0/1085743882 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:53.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 -- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780b1180 msgr2=0x7f817813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:53.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780b1180 0x7f817813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:53.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 -- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81780acab0 msgr2=0x7f8178111b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:53.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81780acab0 0x7f8178111b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:53.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 -- 172.21.2.137:0/1085743882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816800b180 con 0x7f81780af2f0 2021-11-15T19:35:53.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817d326700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 0x7f81780b0860 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f8168002f70 tx=0x7f8168015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:53.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8168011ca0 con 0x7f81780af2f0 2021-11-15T19:35:53.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8168011e00 con 0x7f81780af2f0 2021-11-15T19:35:53.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81781530d0 con 0x7f81780af2f0 2021-11-15T19:35:53.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816801e650 con 0x7f81780af2f0 2021-11-15T19:35:53.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8178152250 con 0x7f81780af2f0 2021-11-15T19:35:53.892 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8178152530 con 0x7f81780af2f0 2021-11-15T19:35:53.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f816801a040 con 0x7f81780af2f0 2021-11-15T19:35:53.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f8166ffd700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8158053610 0x7f8158055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:53.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f816806c9b0 con 0x7f81780af2f0 2021-11-15T19:35:53.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.874+0000 7f817db27700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8158053610 0x7f8158055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:53.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.878+0000 7f817db27700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8158053610 0x7f8158055ad0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f81780b2bd0 tx=0x7f81740077d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:53.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.878+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8168043b10 con 0x7f81780af2f0 2021-11-15T19:35:53.969 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f81780ace90 con 0x7f81780af2f0 2021-11-15T19:35:53.970 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f8166ffd700 1 -- 172.21.2.137:0/1085743882 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f8168023020 con 0x7f81780af2f0 2021-11-15T19:35:53.970 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:53.971 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:35:53.971 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 141, 2021-11-15T19:35:53.971 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:35:53.972 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:35:53.972 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:35:46.432707+0000", 2021-11-15T19:35:53.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:53.972 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:35:53.973 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:35:53.973 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:35:53.973 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:35:53.973 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:35:53.973 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:35:53.974 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:35:53.974 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:35:53.974 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:53.974 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:35:53.975 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:35:53.975 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:35:53.975 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:35:53.975 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:35:53.975 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 28, 2021-11-15T19:35:53.976 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:35:53.976 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:35:53.976 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:35:53.976 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:35:53.977 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:35:53.977 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:53.977 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:35:53.977 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:35:53.977 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:35:53.978 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:53.978 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:53.978 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:53.978 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:53.979 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:53.979 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:53.979 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:53.979 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:53.979 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:35:53.980 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:35:53.980 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:35:53.980 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:35:53.980 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:35:53.980 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:53.981 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:53.981 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:53.981 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:53.981 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:53.982 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:53.982 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:53.982 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:53.982 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:35:53.982 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:53.983 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:53.983 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:53.983 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:53.983 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:53.984 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:53.984 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:53.984 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:53.984 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:53.984 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:53.985 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:53.985 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:53.985 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:53.985 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:53.985 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:53.986 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:53.986 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:53.986 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:53.986 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:53.987 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:53.987 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:53.987 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:53.987 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:53.987 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:53.988 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:53.988 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:53.988 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:53.988 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:53.989 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:53.989 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:53.989 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:53.989 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:53.989 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:53.990 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:53.990 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:53.990 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:53.990 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:53.990 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:53.991 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:53.991 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:35:53.991 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:53.991 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:53.992 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:35:53.992 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:53.992 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:53.992 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:53.993 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:35:53.993 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:35:53.993 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:35:53.993 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:53.993 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:53.994 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:53.994 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:53.994 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:53.994 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:53.995 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:53.995 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:53.995 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:53.995 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:53.995 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:53.996 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:53.996 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:53.996 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:53.996 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:53.997 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:53.997 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:53.997 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:53.997 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:53.997 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:53.998 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:53.998 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:35:53.998 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:53.998 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:53.999 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:53.999 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:53.999 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:53.999 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:53.999 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:54.000 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:54.000 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:54.000 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:54.000 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:54.000 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:54.001 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:54.001 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:54.001 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:54.001 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:54.002 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:54.002 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:54.002 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:54.002 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:54.002 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:54.003 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:54.003 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:54.003 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:54.003 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:54.004 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:54.004 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.004 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:54.004 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:54.004 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:54.005 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:54.005 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:54.005 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:54.005 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:54.006 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:54.006 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:54.006 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:54.006 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:54.006 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:54.007 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:54.007 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:35:54.007 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.007 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.008 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.008 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 27, 2021-11-15T19:35:54.008 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:35:54.008 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:35:43.261809+0000", 2021-11-15T19:35:54.008 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:54.009 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:54.009 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:54.009 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:54.009 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:54.010 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:54.010 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:54.010 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:54.010 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:54.011 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:54.011 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:54.011 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:54.011 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:54.012 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:54.012 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:54.012 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:54.012 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:54.013 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:54.013 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:54.013 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:54.013 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.014 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "140", 2021-11-15T19:35:54.014 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:54.014 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:54.014 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:54.014 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:54.015 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:54.015 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:54.015 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:54.015 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:54.016 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:54.016 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:54.016 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:54.016 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:54.016 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:54.017 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:54.017 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:54.017 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:54.017 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:54.018 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:54.018 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:54.018 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:54.018 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:54.018 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:54.019 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:54.019 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:54.019 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:54.019 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:54.020 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.020 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:54.020 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:54.020 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:54.020 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:54.021 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:54.021 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:54.021 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:54.021 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:54.021 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:54.022 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:54.022 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:54.022 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:35:54.022 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:35:54.023 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:35:54.023 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:35:54.023 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.023 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:54.023 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:35:54.024 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:35:54.024 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.024 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.024 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.024 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.025 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 28, 2021-11-15T19:35:54.025 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:35:54.025 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:35:44.405561+0000", 2021-11-15T19:35:54.025 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:35:54.026 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:35:54.026 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:35:54.026 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:35:54.026 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:35:54.026 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:35:54.027 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:35:54.027 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:35:54.027 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:35:54.027 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:35:54.028 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:35:54.028 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:35:54.028 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:35:54.028 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:35:54.028 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:35:54.029 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:35:54.029 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:35:54.029 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:35:54.029 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:35:54.029 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:35:54.030 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.030 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "141", 2021-11-15T19:35:54.030 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:35:54.030 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:35:54.031 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:35:54.031 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:35:54.031 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:35:54.032 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:35:54.032 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:35:54.032 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:35:54.032 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:35:54.032 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:35:54.033 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:35:54.033 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:35:54.033 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:35:54.033 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:35:54.034 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:35:54.034 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:35:54.034 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:35:54.034 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:35:54.035 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:35:54.035 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:35:54.035 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:35:54.035 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:35:54.035 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:35:54.036 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:35:54.036 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:35:54.036 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:35:54.036 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.036 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:35:54.037 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:35:54.037 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:35:54.037 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:35:54.037 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:35:54.037 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:35:54.038 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:35:54.038 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:35:54.038 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:35:54.038 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:35:54.039 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:35:54.039 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:35:54.039 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:35:54.039 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:35:54.040 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:35:54.040 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.040 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.040 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.040 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:54.041 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:35:54.041 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.041 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:54.042 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:35:54.042 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.042 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.042 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.043 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.043 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.043 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.043 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.044 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:35:54.044 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.044 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.044 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.045 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.045 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.045 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.045 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:35:54.045 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.046 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.046 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.046 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.046 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:35:54.047 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.047 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.047 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.047 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.047 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.048 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.048 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.048 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.048 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:35:54.049 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.049 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.049 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.049 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.049 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:35:54.050 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.050 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.050 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.050 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.050 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.051 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.051 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.051 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.051 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:35:54.052 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.052 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.052 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.052 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.053 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:35:54.053 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.053 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.053 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.053 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.054 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.054 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.054 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.054 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.055 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:35:54.055 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.055 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.055 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.055 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.056 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:35:54.056 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:35:54.056 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.056 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.056 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.057 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:35:54.057 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:35:54.057 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:35:54.057 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:35:54.058 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.058 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.058 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.058 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.058 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.059 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.059 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:54.059 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:35:54.059 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.060 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.060 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.060 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.060 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.060 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.061 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.061 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:35:54.061 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.061 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.061 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.062 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.062 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.062 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.062 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:35:54.063 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.063 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.063 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.063 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.063 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:35:54.064 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.064 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.064 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.064 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.065 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.065 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.065 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.065 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.065 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:35:54.066 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.066 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.066 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.066 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.067 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:35:54.067 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.067 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.067 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.067 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.068 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.068 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.068 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.068 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.069 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:35:54.069 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.069 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.069 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.069 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.070 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:35:54.070 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.070 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.070 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.071 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.071 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.071 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.071 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.071 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.072 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:35:54.072 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.072 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.072 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.072 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.073 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:35:54.073 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:35:54.073 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.073 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.074 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.074 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:35:54.074 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:35:54.074 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:35:54.075 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:35:54.075 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.075 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.075 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.075 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.076 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.076 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.076 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:54.076 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:35:54.077 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.077 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.077 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.077 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.078 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.078 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.078 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.078 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 137, 2021-11-15T19:35:54.079 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.079 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.079 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.079 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.079 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.080 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.080 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:35:54.080 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.080 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.081 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.081 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.081 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:35:54.081 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.081 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.082 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.082 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.082 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.082 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.083 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.083 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.083 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:35:54.083 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.083 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.084 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.084 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.084 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:35:54.084 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.085 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.085 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.085 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.085 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.085 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.086 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.086 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.086 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:35:54.086 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.087 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.087 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.087 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.087 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:35:54.087 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.088 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.088 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.088 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.088 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.089 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.089 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.089 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.089 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:35:54.089 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.090 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.090 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.090 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.090 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:35:54.091 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:35:54.091 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.091 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.091 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.091 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:35:54.092 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:35:54.092 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:35:54.092 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:35:54.092 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.093 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.093 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.093 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.093 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.093 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.094 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:54.094 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:35:54.094 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.094 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.095 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.095 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.095 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.095 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.095 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.096 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 128, 2021-11-15T19:35:54.096 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.096 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.096 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.096 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.097 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.097 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.097 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:35:54.097 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.098 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.098 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.098 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.098 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:35:54.098 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.099 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.099 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.099 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.099 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.100 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.100 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.100 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.100 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:35:54.100 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.101 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.101 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.101 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.101 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:35:54.101 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.102 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.102 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.102 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.102 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.103 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.103 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.103 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.103 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:35:54.103 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.104 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.104 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.104 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.104 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:35:54.104 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.105 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.105 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.105 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.105 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.106 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.106 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.106 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.106 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:35:54.106 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.107 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.107 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.107 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.107 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:35:54.108 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:35:54.108 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.108 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.108 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.108 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:35:54.109 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:35:54.109 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:35:54.109 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:35:54.109 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.109 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.110 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.110 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.110 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.110 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.111 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:54.111 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:35:54.111 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.111 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.111 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.112 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.112 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.112 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.112 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.112 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 137, 2021-11-15T19:35:54.113 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.113 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.113 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.113 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.114 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.114 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.114 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:35:54.114 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.114 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.115 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.115 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.115 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:35:54.115 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.116 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.116 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.116 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.116 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.116 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.117 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.117 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.117 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:35:54.117 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.118 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.118 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.118 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.118 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:35:54.118 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.119 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.119 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.119 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.119 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.119 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.120 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.120 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.120 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:35:54.120 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.121 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.121 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.121 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.121 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:35:54.121 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.122 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.122 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.122 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.122 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.123 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.123 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.123 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.123 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:35:54.123 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.124 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.124 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.124 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.124 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:35:54.125 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:35:54.125 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.125 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.125 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.125 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:35:54.126 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:35:54.126 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:35:54.126 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:35:54.126 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.127 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.127 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.127 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.127 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.127 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.128 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:54.128 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:35:54.128 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.128 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.128 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.129 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.129 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.129 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.129 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.130 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:35:54.130 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.130 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.130 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.130 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.131 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.131 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.131 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:35:54.131 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.132 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.132 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.132 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.132 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:35:54.132 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.133 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.133 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.133 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.133 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.134 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.134 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.134 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.134 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:35:54.134 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.135 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.135 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.135 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.135 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:35:54.136 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.136 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.136 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.136 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.136 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.137 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.137 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.137 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.137 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:35:54.137 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.138 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.138 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.138 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.138 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:35:54.139 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.139 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.139 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.139 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.139 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.140 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.140 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.140 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.140 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:35:54.141 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.141 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.141 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.141 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.141 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:35:54.142 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:35:54.142 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.142 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.142 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.142 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:35:54.143 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:35:54.143 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:35:54.143 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:35:54.143 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.144 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.144 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.144 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.144 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.144 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.145 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:54.145 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:35:54.145 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.145 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.146 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.146 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.146 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.146 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.146 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.147 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:35:54.147 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.147 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.147 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.147 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.148 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.148 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.148 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:35:54.148 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.149 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.149 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.149 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.149 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:35:54.149 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.150 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.150 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.150 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.150 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.150 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.151 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.151 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.151 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:35:54.151 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.152 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.152 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.152 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.152 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:35:54.152 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.153 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.153 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.153 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.153 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.154 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.154 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.154 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.154 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:35:54.154 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.155 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.155 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.155 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.155 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:35:54.156 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.156 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.156 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.156 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.156 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.157 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.157 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.157 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.157 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:35:54.158 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.158 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.158 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.158 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.158 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:35:54.159 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:35:54.159 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.159 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.159 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.159 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:35:54.160 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:35:54.160 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:35:54.160 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:35:54.160 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.161 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.161 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.161 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.161 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.161 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.162 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:54.162 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:35:54.162 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:35:54.162 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:35:54.162 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:35:54.163 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:35:54.163 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:35:54.163 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:35:54.163 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:35:54.164 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:35:54.164 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:35:54.164 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:35:54.164 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:35:54.164 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.165 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.165 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.165 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:35:54.165 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.165 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.166 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.166 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.166 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:35:54.166 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.167 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.167 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.167 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.167 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:35:54.167 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.168 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.168 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.168 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:35:54.168 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.168 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.169 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.169 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.169 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:35:54.169 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.170 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.170 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.170 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.170 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:35:54.170 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.171 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.171 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.171 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:35:54.171 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.171 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.172 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.172 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.172 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:35:54.172 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.173 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.173 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.173 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.173 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:35:54.173 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:35:54.174 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.174 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:35:54.174 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:35:54.174 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.174 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.175 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.175 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:35:54.175 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:35:54.175 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:35:54.176 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.176 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.176 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.176 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:35:54.176 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:35:54.177 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:35:54.177 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:35:54.177 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:35:54.177 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:35:54.177 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:35:54.178 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:35:54.178 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.178 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:54.178 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:35:54.179 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.179 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:35:54.179 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.179 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.179 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.180 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.180 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.180 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:35:54.180 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.181 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.181 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.181 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:35:54.181 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.181 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.182 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.182 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.182 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.182 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:35:54.182 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.183 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.183 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.183 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:35:54.183 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.184 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.184 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.184 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.184 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.184 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:35:54.185 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.185 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.185 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.185 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:35:54.185 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.186 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.186 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.186 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.186 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.187 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:35:54.187 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.187 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.187 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.188 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:35:54.188 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.188 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.188 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.188 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.189 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.189 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:35:54.189 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.189 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.190 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.190 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:35:54.190 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.190 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.190 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.191 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.191 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.191 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:35:54.191 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.192 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.192 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.192 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:35:54.192 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.192 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.193 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.193 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.193 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.193 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:35:54.194 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.194 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.194 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:35:54.194 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:35:54.195 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:35:54.195 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:35:54.195 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:35:54.195 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:35:54.195 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:35:54.196 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:35:54.196 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:35:54.196 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.196 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:35:54.196 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:35:54.197 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:35:54.197 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:35:54.197 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:35:54.197 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:35:54.198 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:35:54.198 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:35:54.198 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:35:54.198 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:35:54.198 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:35:54.199 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:35:54.199 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:35:54.199 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:35:54.199 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:35:54.199 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:35:54.200 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:35:54.200 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:35:54.200 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:35:54.200 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:35:54.201 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:35:54.201 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:35:54.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8158053610 msgr2=0x7f8158055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8158053610 0x7f8158055ad0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f81780b2bd0 tx=0x7f81740077d0).stop 2021-11-15T19:35:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 msgr2=0x7f81780b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 0x7f81780b0860 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f8168002f70 tx=0x7f8168015000).stop 2021-11-15T19:35:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 shutdown_connections 2021-11-15T19:35:54.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8158053610 0x7f8158055ad0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f81780b1180 0x7f817813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f81780af2f0 0x7f81780b0860 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 --2- 172.21.2.137:0/1085743882 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f81780acab0 0x7f8178111b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 >> 172.21.2.137:0/1085743882 conn(0x7f81780630f0 msgr2=0x7f81780b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:54.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.958+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 shutdown_connections 2021-11-15T19:35:54.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:53.962+0000 7f817fd8b700 1 -- 172.21.2.137:0/1085743882 wait complete. 2021-11-15T19:35:54.206 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:54.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 Processor -- start 2021-11-15T19:35:54.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 -- start start 2021-11-15T19:35:54.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc1ec0b1340 0x7fc1ec147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec148190 con 0x7fc1ec143f00 2021-11-15T19:35:54.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b1720 con 0x7fc1ec0b1340 2021-11-15T19:35:54.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f4419700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec147e70 con 0x7fc1ec0a9f50 2021-11-15T19:35:54.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f21b5700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc1ec0b1340 0x7fc1ec147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.250+0000 7fc1f29b6700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc1ec0b1340 0x7fc1ec147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:48144/0 (socket says 172.21.2.137:48144) 2021-11-15T19:35:54.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 -- 172.21.2.137:0/3788946211 learned_addr learned my addr 172.21.2.137:0/3788946211 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:54.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 -- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 msgr2=0x7fc1ec0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:54.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 --2- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec0aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 -- 172.21.2.137:0/3788946211 >> v1:172.21.2.111:6789/0 conn(0x7fc1ec143f00 legacy=0x7fc1ec144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 -- 172.21.2.137:0/3788946211 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0af800 con 0x7fc1ec0b1340 2021-11-15T19:35:54.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f21b5700 1 --2- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec147980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fc1e8002f70 tx=0x7fc1e8006eb0).ready entity=mon.0 client_cookie=7dfff4dbe64b2515 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:54.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f11b3700 1 -- 172.21.2.137:0/3788946211 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e800d570 con 0x7fc1ec0b1340 2021-11-15T19:35:54.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f11b3700 1 -- 172.21.2.137:0/3788946211 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8000e90 con 0x7fc1ec0b1340 2021-11-15T19:35:54.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f11b3700 1 -- 172.21.2.137:0/3788946211 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e800d900 con 0x7fc1ec0b1340 2021-11-15T19:35:54.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec0b1340 msgr2=0x7fc1ec147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 --2- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec147980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fc1e8002f70 tx=0x7fc1e8006eb0).stop 2021-11-15T19:35:54.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- 172.21.2.137:0/3788946211 shutdown_connections 2021-11-15T19:35:54.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 --2- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 --2- 172.21.2.137:0/3788946211 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec147980 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- 172.21.2.137:0/3788946211 >> 172.21.2.137:0/3788946211 conn(0x7fc1ec0b4e60 msgr2=0x7fc1ec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:54.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- 172.21.2.137:0/3788946211 shutdown_connections 2021-11-15T19:35:54.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- 172.21.2.137:0/3788946211 wait complete. 2021-11-15T19:35:54.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 Processor -- start 2021-11-15T19:35:54.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- start start 2021-11-15T19:35:54.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec143f00 0x7fc1ec0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0adf00 con 0x7fc1ec143f00 2021-11-15T19:35:54.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0ad0b0 con 0x7fc1ec0b1340 2021-11-15T19:35:54.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.254+0000 7fc1f4419700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0ad350 con 0x7fc1ec0a9f50 2021-11-15T19:35:54.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec14aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40926/0 (socket says 172.21.2.137:40926) 2021-11-15T19:35:54.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 -- 172.21.2.137:0/2594644553 learned_addr learned my addr 172.21.2.137:0/2594644553 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:54.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f29b6700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec143f00 0x7fc1ec0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f21b5700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 -- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 msgr2=0x7fc1ec099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 -- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec143f00 msgr2=0x7fc1ec0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec143f00 0x7fc1ec0aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 -- 172.21.2.137:0/2594644553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e800b1e0 con 0x7fc1ec0b1340 2021-11-15T19:35:54.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f21b5700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:54.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f19b4700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec14aae0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fc1ec062250 tx=0x7fc1dc007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:54.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc00ce00 con 0x7fc1ec0b1340 2021-11-15T19:35:54.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc007240 con 0x7fc1ec0b1340 2021-11-15T19:35:54.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec0aeb40 con 0x7fc1ec0b1340 2021-11-15T19:35:54.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc006700 con 0x7fc1ec0b1340 2021-11-15T19:35:54.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec0ac2a0 con 0x7fc1ec0b1340 2021-11-15T19:35:54.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec0ad510 con 0x7fc1ec0b1340 2021-11-15T19:35:54.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1dc006860 con 0x7fc1ec0b1340 2021-11-15T19:35:54.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1db7fe700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1cc053610 0x7fc1cc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc1dc06b2f0 con 0x7fc1ec0b1340 2021-11-15T19:35:54.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f21b5700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1cc053610 0x7fc1cc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.258+0000 7fc1f21b5700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1cc053610 0x7fc1cc055ad0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fc1e8017000 tx=0x7fc1e8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:54.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.262+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1dc042340 con 0x7fc1ec0b1340 2021-11-15T19:35:54.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.366+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1ec148190 con 0x7fc1ec0b1340 2021-11-15T19:35:54.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.366+0000 7fc1db7fe700 1 -- 172.21.2.137:0/2594644553 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fc1ec148190 con 0x7fc1ec0b1340 2021-11-15T19:35:54.380 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:54.381 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:45.426948+0000","modified":"2021-11-15T19:35:46.431620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8338":{"gid":8338,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/4036717918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4036717918},{"type":"v1","addr":"172.21.2.137:6833","nonce":4036717918}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T19:35:54.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1cc053610 msgr2=0x7fc1cc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1cc053610 0x7fc1cc055ad0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fc1e8017000 tx=0x7fc1e8015000).stop 2021-11-15T19:35:54.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 msgr2=0x7fc1ec14aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec14aae0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fc1ec062250 tx=0x7fc1dc007be0).stop 2021-11-15T19:35:54.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 shutdown_connections 2021-11-15T19:35:54.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc1cc053610 0x7fc1cc055ad0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc1ec143f00 0x7fc1ec0aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc1ec0b1340 0x7fc1ec14aae0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 --2- 172.21.2.137:0/2594644553 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc1ec0a9f50 0x7fc1ec099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 >> 172.21.2.137:0/2594644553 conn(0x7fc1ec0b4e60 msgr2=0x7fc1ec0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:54.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 shutdown_connections 2021-11-15T19:35:54.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.370+0000 7fc1f4419700 1 -- 172.21.2.137:0/2594644553 wait complete. 2021-11-15T19:35:54.385 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 73 2021-11-15T19:35:54.387 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:35:54.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 Processor -- start 2021-11-15T19:35:54.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 -- start start 2021-11-15T19:35:54.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f099c05c770 0x7f099c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f099c140aa0 0x7f099c140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c05cb50 con 0x7f099c0b0550 2021-11-15T19:35:54.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0b1650 con 0x7f099c05c770 2021-11-15T19:35:54.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a3663700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0ad030 con 0x7f099c140aa0 2021-11-15T19:35:54.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a1c00700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f099c140aa0 0x7f099c140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a1c00700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f099c140aa0 0x7f099c140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40930/0 (socket says 172.21.2.137:40930) 2021-11-15T19:35:54.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.426+0000 7f09a1c00700 1 -- 172.21.2.137:0/786947731 learned_addr learned my addr 172.21.2.137:0/786947731 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:54.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/786947731 >> v2:172.21.2.111:3300/0 conn(0x7f099c05c770 msgr2=0x7f099c0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:54.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- 172.21.2.137:0/786947731 >> v2:172.21.2.111:3300/0 conn(0x7f099c05c770 0x7f099c0aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:54.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/786947731 >> v1:172.21.2.111:6789/0 conn(0x7f099c0b0550 legacy=0x7f099c14a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:35:54.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/786947731 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0ad2d0 con 0x7f099c140aa0 2021-11-15T19:35:54.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- 172.21.2.137:0/786947731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c140ef0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f099c0aee10 tx=0x7f0994009290).ready entity=mon.1 client_cookie=df23c75fcf613720 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:54.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f098bfff700 1 -- 172.21.2.137:0/786947731 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099400b830 con 0x7f099c140aa0 2021-11-15T19:35:54.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f098bfff700 1 -- 172.21.2.137:0/786947731 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400b990 con 0x7f099c140aa0 2021-11-15T19:35:54.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f098bfff700 1 -- 172.21.2.137:0/786947731 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099400bb40 con 0x7f099c140aa0 2021-11-15T19:35:54.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/786947731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 msgr2=0x7f099c140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:54.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 --2- 172.21.2.137:0/786947731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c140ef0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f099c0aee10 tx=0x7f0994009290).stop 2021-11-15T19:35:54.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/786947731 shutdown_connections 2021-11-15T19:35:54.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 --2- 172.21.2.137:0/786947731 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c140ef0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:54.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 --2- 172.21.2.137:0/786947731 >> v2:172.21.2.111:3300/0 conn(0x7f099c05c770 0x7f099c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:54.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/786947731 >> 172.21.2.137:0/786947731 conn(0x7f099c0631e0 msgr2=0x7f099c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:54.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/786947731 shutdown_connections 2021-11-15T19:35:54.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/786947731 wait complete. 2021-11-15T19:35:54.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 Processor -- start 2021-11-15T19:35:54.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- start start 2021-11-15T19:35:54.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f099c05c770 0x7f099c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f099c0b0550 0x7f099c145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c157000 con 0x7f099c05c770 2021-11-15T19:35:54.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1572a0 con 0x7f099c140aa0 2021-11-15T19:35:54.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c066520 con 0x7f099c0b0550 2021-11-15T19:35:54.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40938/0 (socket says 172.21.2.137:40938) 2021-11-15T19:35:54.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/642684748 learned_addr learned my addr 172.21.2.137:0/642684748 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:54.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f099c0b0550 msgr2=0x7f099c145090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:54.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f099c0b0550 0x7f099c145090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:54.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f099c05c770 msgr2=0x7f099c144ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:54.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f099c05c770 0x7f099c144ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:54.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 -- 172.21.2.137:0/642684748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009530 con 0x7f099c140aa0 2021-11-15T19:35:54.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a1c00700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c142c10 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f099c0aee10 tx=0x7f0994016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:54.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099400b830 con 0x7f099c140aa0 2021-11-15T19:35:54.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940107a0 con 0x7f099c140aa0 2021-11-15T19:35:54.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0994010b00 con 0x7f099c140aa0 2021-11-15T19:35:54.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c1416f0 con 0x7f099c140aa0 2021-11-15T19:35:54.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.430+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c143100 con 0x7f099c140aa0 2021-11-15T19:35:54.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c143690 con 0x7f099c140aa0 2021-11-15T19:35:54.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0994029070 con 0x7f099c140aa0 2021-11-15T19:35:54.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f098a7fc700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f097c053640 0x7f097c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:54.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f099406c9a0 con 0x7f099c140aa0 2021-11-15T19:35:54.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f09a13ff700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f097c053640 0x7f097c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:54.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f09a13ff700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f097c053640 0x7f097c055b00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f0998002fb0 tx=0x7f0998006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:54.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.434+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0994043b00 con 0x7f099c140aa0 2021-11-15T19:35:54.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:54.542+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f099c0ae7f0 con 0x7f099c140aa0 2021-11-15T19:35:54.674 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:54.677 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:54.681 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:54.684 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:54.688 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:35:55.499 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:35:55.493+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:35:55.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f098a7fc700 1 -- 172.21.2.137:0/642684748 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0994015070 con 0x7f099c140aa0 2021-11-15T19:35:55.513 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f097c053640 msgr2=0x7f097c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f097c053640 0x7f097c055b00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f0998002fb0 tx=0x7f0998006930).stop 2021-11-15T19:35:55.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 msgr2=0x7f099c142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c142c10 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f099c0aee10 tx=0x7f0994016000).stop 2021-11-15T19:35:55.514 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 shutdown_connections 2021-11-15T19:35:55.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f097c053640 0x7f097c055b00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:55.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f099c140aa0 0x7f099c142c10 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:55.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f099c0b0550 0x7f099c145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.515 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 --2- 172.21.2.137:0/642684748 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f099c05c770 0x7f099c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 >> 172.21.2.137:0/642684748 conn(0x7f099c0631e0 msgr2=0x7f099c13de40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:55.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 shutdown_connections 2021-11-15T19:35:55.516 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.502+0000 7f09a3663700 1 -- 172.21.2.137:0/642684748 wait complete. 2021-11-15T19:35:55.517 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:35:55.520 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:35:55.525 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:35:55.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.558+0000 7fd124a0f700 1 Processor -- start 2021-11-15T19:35:55.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- start start 2021-11-15T19:35:55.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1200adda0 0x7fd12005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd1200b00a0 0x7fd12005c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd12005d220 0x7fd12005c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12005cbf0 con 0x7fd1200b00a0 2021-11-15T19:35:55.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200ae730 con 0x7fd12005d220 2021-11-15T19:35:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd120067b90 con 0x7fd1200adda0 2021-11-15T19:35:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd12005d220 0x7fd12005c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd12005d220 0x7fd12005c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40960/0 (socket says 172.21.2.137:40960) 2021-11-15T19:35:55.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2331974756 learned_addr learned my addr 172.21.2.137:0/2331974756 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2331974756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1200adda0 msgr2=0x7fd12005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- 172.21.2.137:0/2331974756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1200adda0 0x7fd12005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2331974756 >> v2:172.21.2.111:3300/0 conn(0x7fd1200b00a0 msgr2=0x7fd12005c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:55.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- 172.21.2.137:0/2331974756 >> v2:172.21.2.111:3300/0 conn(0x7fd1200b00a0 0x7fd12005c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2331974756 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200b0880 con 0x7fd12005d220 2021-11-15T19:35:55.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- 172.21.2.137:0/2331974756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd12005d220 0x7fd12005c700 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fd1180032f0 tx=0x7fd118009290).ready entity=mon.1 client_cookie=1d29ff556bcceec8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:55.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11d59a700 1 -- 172.21.2.137:0/2331974756 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd11800b870 con 0x7fd12005d220 2021-11-15T19:35:55.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11d59a700 1 -- 172.21.2.137:0/2331974756 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800b9d0 con 0x7fd12005d220 2021-11-15T19:35:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11d59a700 1 -- 172.21.2.137:0/2331974756 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd11800bb40 con 0x7fd12005d220 2021-11-15T19:35:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2331974756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd12005d220 msgr2=0x7fd12005c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2331974756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd12005d220 0x7fd12005c700 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fd1180032f0 tx=0x7fd118009290).stop 2021-11-15T19:35:55.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2331974756 shutdown_connections 2021-11-15T19:35:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2331974756 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd12005d220 0x7fd12005c700 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2331974756 >> v2:172.21.2.111:3300/0 conn(0x7fd1200b00a0 0x7fd12005c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2331974756 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd1200adda0 0x7fd12005bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2331974756 >> 172.21.2.137:0/2331974756 conn(0x7fd1200630f0 msgr2=0x7fd1200634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:55.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2331974756 shutdown_connections 2021-11-15T19:35:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2331974756 wait complete. 2021-11-15T19:35:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 Processor -- start 2021-11-15T19:35:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- start start 2021-11-15T19:35:55.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd12005d220 0x7fd120066010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1200adda0 0x7fd120156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 0x7fd1201522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120118d00 con 0x7fd1200adda0 2021-11-15T19:35:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120155930 con 0x7fd1200b00a0 2021-11-15T19:35:55.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd120155bd0 con 0x7fd12005d220 2021-11-15T19:35:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 0x7fd1201522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 0x7fd1201522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40962/0 (socket says 172.21.2.137:40962) 2021-11-15T19:35:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2747897507 learned_addr learned my addr 172.21.2.137:0/2747897507 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:55.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd12005d220 msgr2=0x7fd120066010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:35:55.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd12005d220 0x7fd120066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1200adda0 msgr2=0x7fd120156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1200adda0 0x7fd120156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.585 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 -- 172.21.2.137:0/2747897507 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118009530 con 0x7fd1200b00a0 2021-11-15T19:35:55.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd11ed9d700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 0x7fd1201522d0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7fd120155850 tx=0x7fd118016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:55.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd11800b870 con 0x7fd1200b00a0 2021-11-15T19:35:55.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118020660 con 0x7fd1200b00a0 2021-11-15T19:35:55.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1201144a0 con 0x7fd1200b00a0 2021-11-15T19:35:55.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1180209c0 con 0x7fd1200b00a0 2021-11-15T19:35:55.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.562+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1201188d0 con 0x7fd1200b00a0 2021-11-15T19:35:55.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120155d90 con 0x7fd1200b00a0 2021-11-15T19:35:55.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd11800f070 con 0x7fd1200b00a0 2021-11-15T19:35:55.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd1177fe700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1040534f0 0x7fd1040559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fd11806c6d0 con 0x7fd1200b00a0 2021-11-15T19:35:55.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd11e59c700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1040534f0 0x7fd1040559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:55.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd11e59c700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1040534f0 0x7fd1040559b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fd108002f70 tx=0x7fd108006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:55.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.566+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd118043820 con 0x7fd1200b00a0 2021-11-15T19:35:55.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1200ae490 con 0x7fd1200b00a0 2021-11-15T19:35:55.688 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd1177fe700 1 -- 172.21.2.137:0/2747897507 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fd118015020 con 0x7fd1200b00a0 2021-11-15T19:35:55.689 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:35:55.689 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":74,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:35:45.426948+0000","modified":"2021-11-15T19:35:55.495996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":142,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T19:35:55.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1040534f0 msgr2=0x7fd1040559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1040534f0 0x7fd1040559b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fd108002f70 tx=0x7fd108006a80).stop 2021-11-15T19:35:55.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 msgr2=0x7fd1201522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 0x7fd1201522d0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7fd120155850 tx=0x7fd118016000).stop 2021-11-15T19:35:55.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 shutdown_connections 2021-11-15T19:35:55.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd1040534f0 0x7fd1040559b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:55.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd1200b00a0 0x7fd1201522d0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:55.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd1200adda0 0x7fd120156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 --2- 172.21.2.137:0/2747897507 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd12005d220 0x7fd120066010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 >> 172.21.2.137:0/2747897507 conn(0x7fd1200630f0 msgr2=0x7fd1200aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:55.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 shutdown_connections 2021-11-15T19:35:55.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.678+0000 7fd124a0f700 1 -- 172.21.2.137:0/2747897507 wait complete. 2021-11-15T19:35:55.693 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 74 2021-11-15T19:35:55.695 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:35:55.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.734+0000 7f74616ca700 1 Processor -- start 2021-11-15T19:35:55.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.734+0000 7f74616ca700 1 -- start start 2021-11-15T19:35:55.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f745c13f390 0x7f745c14a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745c0acf30 con 0x7f745c0adc30 2021-11-15T19:35:55.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745c13f7b0 con 0x7f745c0ac910 2021-11-15T19:35:55.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c05c5b0 con 0x7f745c13f390 2021-11-15T19:35:55.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745a7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f745c0ac910 0x7f745c13ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59752/0 (socket says 172.21.2.137:59752) 2021-11-15T19:35:55.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745a7fc700 1 -- 172.21.2.137:0/4021584388 learned_addr learned my addr 172.21.2.137:0/4021584388 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:55.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093097136 0 0) 0x7f745c13f7b0 con 0x7f745c0ac910 2021-11-15T19:35:55.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f743c003260 con 0x7f745c0ac910 2021-11-15T19:35:55.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 676545153 0 0) 0x7f743c003260 con 0x7f745c0ac910 2021-11-15T19:35:55.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 >> v2:172.21.2.111:3300/0 conn(0x7f745c13f390 msgr2=0x7f745c14a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:55.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 --2- 172.21.2.137:0/4021584388 >> v2:172.21.2.111:3300/0 conn(0x7f745c13f390 0x7f745c14a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 >> v1:172.21.2.111:6789/0 conn(0x7f745c0adc30 legacy=0x7f745c0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:55.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c064590 con 0x7f745c0ac910 2021-11-15T19:35:55.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f744c001660 con 0x7f745c0ac910 2021-11-15T19:35:55.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 >> v1:172.21.2.137:6789/0 conn(0x7f745c0ac910 legacy=0x7f745c13ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c003750 0x7f743c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f743c004500 0x7f743c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f743c005070 0x7f743c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c05c5b0 con 0x7f743c004500 2021-11-15T19:35:55.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c00bea0 con 0x7f743c005070 2021-11-15T19:35:55.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c00c060 con 0x7f743c003750 2021-11-15T19:35:55.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f743c005070 0x7f743c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:55.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 -- 172.21.2.137:0/4021584388 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c003750 msgr2=0x7f743c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:55.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c003750 0x7f743c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 -- 172.21.2.137:0/4021584388 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f743c004500 msgr2=0x7f743c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:55.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f743c004500 0x7f743c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 -- 172.21.2.137:0/4021584388 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c003260 con 0x7f743c005070 2021-11-15T19:35:55.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 -- 172.21.2.137:0/4021584388 reap_dead start 2021-11-15T19:35:55.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745b7fe700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f743c005070 0x7f743c00b750 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f74540032f0 tx=0x7f7454006f90).ready entity=mon.1 client_cookie=5086f5e2d6d795d1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:55.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745400b460 con 0x7f743c005070 2021-11-15T19:35:55.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400b5c0 con 0x7f743c005070 2021-11-15T19:35:55.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f7459ffb700 1 -- 172.21.2.137:0/4021584388 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745400b730 con 0x7f743c005070 2021-11-15T19:35:55.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- 172.21.2.137:0/4021584388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f743c005070 msgr2=0x7f743c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f743c005070 0x7f743c00b750 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f74540032f0 tx=0x7f7454006f90).stop 2021-11-15T19:35:55.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- 172.21.2.137:0/4021584388 shutdown_connections 2021-11-15T19:35:55.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 --2- 172.21.2.137:0/4021584388 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f743c005070 0x7f743c00b750 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:55.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- 172.21.2.137:0/4021584388 >> 172.21.2.137:0/4021584388 conn(0x7f745c0631e0 msgr2=0x7f745c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:55.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- 172.21.2.137:0/4021584388 shutdown_connections 2021-11-15T19:35:55.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- 172.21.2.137:0/4021584388 wait complete. 2021-11-15T19:35:55.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 Processor -- start 2021-11-15T19:35:55.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- start start 2021-11-15T19:35:55.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c005070 0x7f745c0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 0x7f745c139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f745c066c10 0x7f745c139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c131bb0 con 0x7f745c066c10 2021-11-15T19:35:55.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c132390 con 0x7f745c0675b0 2021-11-15T19:35:55.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f74616ca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c1317f0 con 0x7f743c005070 2021-11-15T19:35:55.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 0x7f745c139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:55.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 0x7f745c139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:40986/0 (socket says 172.21.2.137:40986) 2021-11-15T19:35:55.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.738+0000 7f745a7fc700 1 -- 172.21.2.137:0/863202147 learned_addr learned my addr 172.21.2.137:0/863202147 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:55.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745a7fc700 1 -- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c005070 msgr2=0x7f745c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745a7fc700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c005070 0x7f745c0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745a7fc700 1 -- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f745c066c10 msgr2=0x7f745c139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:55.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745a7fc700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f745c066c10 0x7f745c139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:55.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745a7fc700 1 -- 172.21.2.137:0/863202147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c1382a0 con 0x7f745c0675b0 2021-11-15T19:35:55.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745a7fc700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 0x7f745c139910 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f745c062170 tx=0x7f745c05c850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:55.764 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f744c007170 con 0x7f745c0675b0 2021-11-15T19:35:55.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0072d0 con 0x7f745c0675b0 2021-11-15T19:35:55.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c13a2f0 con 0x7f745c0675b0 2021-11-15T19:35:55.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c137240 con 0x7f745c0675b0 2021-11-15T19:35:55.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f744c004920 con 0x7f745c0675b0 2021-11-15T19:35:55.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745c132550 con 0x7f745c0675b0 2021-11-15T19:35:55.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f744c01b070 con 0x7f745c0675b0 2021-11-15T19:35:55.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7440053660 0x7f7440055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:55.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6155+0+0 (secure 0 0 0) 0x7f744c06b220 con 0x7f745c0675b0 2021-11-15T19:35:55.766 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745affd700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7440053660 0x7f7440055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:55.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f745affd700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7440053660 0x7f7440055b20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f7444000f70 tx=0x7f74440069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:55.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.742+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f744c042220 con 0x7f745c0675b0 2021-11-15T19:35:55.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:55.854+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f745c138430 con 0x7f745c0675b0 2021-11-15T19:35:56.520 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f7453fff700 1 -- 172.21.2.137:0/863202147 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7f745c138430 con 0x7f745c0675b0 2021-11-15T19:35:56.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7440053660 msgr2=0x7f7440055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:56.521 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7440053660 0x7f7440055b20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f7444000f70 tx=0x7f74440069b0).stop 2021-11-15T19:35:56.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 msgr2=0x7f745c139910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:56.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 0x7f745c139910 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f745c062170 tx=0x7f745c05c850).stop 2021-11-15T19:35:56.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 shutdown_connections 2021-11-15T19:35:56.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7440053660 0x7f7440055b20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:56.522 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f745c066c10 0x7f745c139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:56.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f745c0675b0 0x7f745c139910 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:56.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 --2- 172.21.2.137:0/863202147 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f743c005070 0x7f745c0b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:56.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 >> 172.21.2.137:0/863202147 conn(0x7f745c0631e0 msgr2=0x7f745c0b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:56.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 shutdown_connections 2021-11-15T19:35:56.524 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.510+0000 7f74616ca700 1 -- 172.21.2.137:0/863202147 wait complete. 2021-11-15T19:35:56.528 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:35:56.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb75b239700 1 Processor -- start 2021-11-15T19:35:56.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb75b239700 1 -- start start 2021-11-15T19:35:56.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb75b239700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb7540aaa80 0x7fb7540af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb75b239700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb754147f70 con 0x7fb7540b0830 2021-11-15T19:35:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb75b239700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb754060100 con 0x7fb75405fd20 2021-11-15T19:35:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb75b239700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb754147cd0 con 0x7fb7540aaa80 2021-11-15T19:35:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb758fd5700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb75405fd20 0x7fb7540b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59772/0 (socket says 172.21.2.137:59772) 2021-11-15T19:35:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb758fd5700 1 -- 172.21.2.137:0/1732645007 learned_addr learned my addr 172.21.2.137:0/1732645007 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:56.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528344597 0 0) 0x7fb754060100 con 0x7fb75405fd20 2021-11-15T19:35:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.570+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb734003260 con 0x7fb75405fd20 2021-11-15T19:35:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7597d6700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb7540aaa80 0x7fb7540af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 35005270 0 0) 0x7fb734003260 con 0x7fb75405fd20 2021-11-15T19:35:56.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb7540aaa80 msgr2=0x7fb7540af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:56.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb7540aaa80 0x7fb7540af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:56.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 >> v1:172.21.2.111:6789/0 conn(0x7fb7540b0830 legacy=0x7fb7540aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:56.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540a9ed0 con 0x7fb75405fd20 2021-11-15T19:35:56.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fb744001660 con 0x7fb75405fd20 2021-11-15T19:35:56.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 >> v1:172.21.2.137:6789/0 conn(0x7fb75405fd20 legacy=0x7fb7540b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:56.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb734003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb734004500 0x7fb734004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb734005020 0x7fb73400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754147cd0 con 0x7fb734004500 2021-11-15T19:35:56.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400be80 con 0x7fb7340037d0 2021-11-15T19:35:56.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400c040 con 0x7fb734005020 2021-11-15T19:35:56.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7597d6700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb7540aaa80 0x7fb7540af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:56.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb734003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:56.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb734005020 msgr2=0x7fb73400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:56.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb734005020 0x7fb73400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:56.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb734004500 msgr2=0x7fb734004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:56.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb734004500 0x7fb734004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:56.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1732645007 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734003260 con 0x7fb7340037d0 2021-11-15T19:35:56.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb734003bf0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fb7540b4db0 tx=0x7fb7540ac030).ready entity=mon.1 client_cookie=1603b614433f77a9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:56.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7440070d0 con 0x7fb7340037d0 2021-11-15T19:35:56.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744007230 con 0x7fb7340037d0 2021-11-15T19:35:56.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7537fe700 1 -- 172.21.2.137:0/1732645007 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb74400c8f0 con 0x7fb7340037d0 2021-11-15T19:35:56.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1732645007 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 msgr2=0x7fb734003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:56.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 --2- 172.21.2.137:0/1732645007 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb734003bf0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fb7540b4db0 tx=0x7fb7540ac030).stop 2021-11-15T19:35:56.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb7597d6700 1 -- 172.21.2.137:0/1732645007 reap_dead start 2021-11-15T19:35:56.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1732645007 shutdown_connections 2021-11-15T19:35:56.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1732645007 >> 172.21.2.137:0/1732645007 conn(0x7fb7540b4e60 msgr2=0x7fb7540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:56.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1732645007 shutdown_connections 2021-11-15T19:35:56.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1732645007 wait complete. 2021-11-15T19:35:56.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 Processor -- start 2021-11-15T19:35:56.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- start start 2021-11-15T19:35:56.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb754142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb754099030 0x7fb754156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb754156b50 0x7fb754099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541422c0 con 0x7fb754156b50 2021-11-15T19:35:56.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754142560 con 0x7fb7340037d0 2021-11-15T19:35:56.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb754142ef0 con 0x7fb754099030 2021-11-15T19:35:56.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb754142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:56.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb754142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41002/0 (socket says 172.21.2.137:41002) 2021-11-15T19:35:56.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1067373763 learned_addr learned my addr 172.21.2.137:0/1067373763 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:56.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb754099030 msgr2=0x7fb754156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:56.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb754099030 0x7fb754156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:56.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb754156b50 msgr2=0x7fb754099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:56.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb754156b50 0x7fb754099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:56.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 -- 172.21.2.137:0/1067373763 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540994b0 con 0x7fb7340037d0 2021-11-15T19:35:56.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb758fd5700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb754142a00 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7fb7540b4db0 tx=0x7fb744013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:56.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb74401a040 con 0x7fb7340037d0 2021-11-15T19:35:56.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744004920 con 0x7fb7340037d0 2021-11-15T19:35:56.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540983b0 con 0x7fb7340037d0 2021-11-15T19:35:56.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb744001b60 con 0x7fb7340037d0 2021-11-15T19:35:56.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754098190 con 0x7fb7340037d0 2021-11-15T19:35:56.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7541479f0 con 0x7fb7340037d0 2021-11-15T19:35:56.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb744010070 con 0x7fb7340037d0 2021-11-15T19:35:56.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb751ffb700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7380536a0 0x7fb738055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:56.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.574+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fb74406c540 con 0x7fb7340037d0 2021-11-15T19:35:56.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.578+0000 7fb753fff700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7380536a0 0x7fb738055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:56.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.578+0000 7fb753fff700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7380536a0 0x7fb738055b60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb73c001fa0 tx=0x7fb73c0077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:56.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.578+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb744043650 con 0x7fb7340037d0 2021-11-15T19:35:56.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:56.662+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7540573d0 con 0x7fb7340037d0 2021-11-15T19:35:57.523 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.510+0000 7fb751ffb700 1 -- 172.21.2.137:0/1067373763 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v143) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb744046c70 con 0x7fb7340037d0 2021-11-15T19:35:57.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7380536a0 msgr2=0x7fb738055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:57.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7380536a0 0x7fb738055b60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb73c001fa0 tx=0x7fb73c0077f0).stop 2021-11-15T19:35:57.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 msgr2=0x7fb754142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:57.525 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb754142a00 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7fb7540b4db0 tx=0x7fb744013000).stop 2021-11-15T19:35:57.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 shutdown_connections 2021-11-15T19:35:57.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb7380536a0 0x7fb738055b60 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:57.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb754156b50 0x7fb754099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:57.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb754099030 0x7fb754156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:57.526 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 --2- 172.21.2.137:0/1067373763 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb7340037d0 0x7fb754142a00 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 >> 172.21.2.137:0/1067373763 conn(0x7fb7540b4e60 msgr2=0x7fb7540b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 shutdown_connections 2021-11-15T19:35:57.527 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.514+0000 7fb75b239700 1 -- 172.21.2.137:0/1067373763 wait complete. 2021-11-15T19:35:57.528 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:35:57.531 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:35:57.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcbae8c700 1 Processor -- start 2021-11-15T19:35:57.587 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcbae8c700 1 -- start start 2021-11-15T19:35:57.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcbae8c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fbcb405fe40 0x7fbcb40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcbae8c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb40b0c80 con 0x7fbcb413f890 2021-11-15T19:35:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcbae8c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb40b0f20 con 0x7fbcb40608f0 2021-11-15T19:35:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcbae8c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb40ad6c0 con 0x7fbcb405fe40 2021-11-15T19:35:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcb8c28700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fbcb40608f0 0x7fbcb40b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59794/0 (socket says 172.21.2.137:59794) 2021-11-15T19:35:57.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.574+0000 7fbcb8c28700 1 -- 172.21.2.137:0/3289717917 learned_addr learned my addr 172.21.2.137:0/3289717917 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858030074 0 0) 0x7fbcb40b0f20 con 0x7fbcb40608f0 2021-11-15T19:35:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca0003260 con 0x7fbcb40608f0 2021-11-15T19:35:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463747894 0 0) 0x7fbca0003260 con 0x7fbcb40608f0 2021-11-15T19:35:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 >> v2:172.21.2.111:3300/0 conn(0x7fbcb405fe40 msgr2=0x7fbcb40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:57.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 --2- 172.21.2.137:0/3289717917 >> v2:172.21.2.111:3300/0 conn(0x7fbcb405fe40 0x7fbcb40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 >> v1:172.21.2.111:6789/0 conn(0x7fbcb413f890 legacy=0x7fbcb405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb40b11c0 con 0x7fbcb40608f0 2021-11-15T19:35:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fbca8001660 con 0x7fbcb40608f0 2021-11-15T19:35:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 >> v1:172.21.2.137:6789/0 conn(0x7fbcb40608f0 legacy=0x7fbcb40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:57.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbca0003820 0x7fbca0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0004500 0x7fbca0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbca0005050 0x7fbca000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40ad6c0 con 0x7fbca0005050 2021-11-15T19:35:57.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca000bf40 con 0x7fbca0003820 2021-11-15T19:35:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca000c100 con 0x7fbca0004500 2021-11-15T19:35:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbca0003820 0x7fbca0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbca0005050 0x7fbca000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 -- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0004500 msgr2=0x7fbca0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0004500 0x7fbca0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 -- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbca0005050 msgr2=0x7fbca000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbca0005050 0x7fbca000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 -- 172.21.2.137:0/3289717917 reap_dead start 2021-11-15T19:35:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 -- 172.21.2.137:0/3289717917 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0003260 con 0x7fbca0003820 2021-11-15T19:35:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbca0003820 0x7fbca0003c20 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fbcb40b3ac0 tx=0x7fbcb40ae010).ready entity=mon.1 client_cookie=bf64f1ebfafc83bb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca80070d0 con 0x7fbca0003820 2021-11-15T19:35:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8007230 con 0x7fbca0003820 2021-11-15T19:35:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb37fe700 1 -- 172.21.2.137:0/3289717917 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca800c8f0 con 0x7fbca0003820 2021-11-15T19:35:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/3289717917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbca0003820 msgr2=0x7fbca0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:57.597 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbca0003820 0x7fbca0003c20 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fbcb40b3ac0 tx=0x7fbcb40ae010).stop 2021-11-15T19:35:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/3289717917 shutdown_connections 2021-11-15T19:35:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/3289717917 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbca0003820 0x7fbca0003c20 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/3289717917 >> 172.21.2.137:0/3289717917 conn(0x7fbcb4063980 msgr2=0x7fbcb4063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/3289717917 shutdown_connections 2021-11-15T19:35:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/3289717917 wait complete. 2021-11-15T19:35:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 Processor -- start 2021-11-15T19:35:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- start start 2021-11-15T19:35:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0003820 0x7fbcb413e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcb413ef20 0x7fbcb4139740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 0x7fbcb4138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb405c630 con 0x7fbcb413ef20 2021-11-15T19:35:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41392e0 con 0x7fbcb405be10 2021-11-15T19:35:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb413f640 con 0x7fbca0003820 2021-11-15T19:35:57.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 0x7fbcb4138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:57.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 0x7fbcb4138150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41024/0 (socket says 172.21.2.137:41024) 2021-11-15T19:35:57.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 -- 172.21.2.137:0/2529163285 learned_addr learned my addr 172.21.2.137:0/2529163285 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:57.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0003820 0x7fbcb413e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 -- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0003820 msgr2=0x7fbcb413e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0003820 0x7fbcb413e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 -- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcb413ef20 msgr2=0x7fbcb4139740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcb413ef20 0x7fbcb4139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 -- 172.21.2.137:0/2529163285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb405c390 con 0x7fbcb405be10 2021-11-15T19:35:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0003820 0x7fbcb413e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb9429700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 0x7fbcb4138150 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fbcb4139620 tx=0x7fbcac008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcac00dee0 con 0x7fbcb405be10 2021-11-15T19:35:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac0106e0 con 0x7fbcb405be10 2021-11-15T19:35:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb4139c30 con 0x7fbcb405be10 2021-11-15T19:35:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcac010a40 con 0x7fbcb405be10 2021-11-15T19:35:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.578+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb4138860 con 0x7fbcb405be10 2021-11-15T19:35:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb4139110 con 0x7fbcb405be10 2021-11-15T19:35:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcac01a030 con 0x7fbcb405be10 2021-11-15T19:35:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcb1ffb700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc940535b0 0x7fbc94055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:57.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5717+0+0 (secure 0 0 0) 0x7fbcac06b5a0 con 0x7fbcb405be10 2021-11-15T19:35:57.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc940535b0 0x7fbc94055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:57.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcb8c28700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc940535b0 0x7fbc94055a70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fbca8006000 tx=0x7fbca8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:57.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.582+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcac0426f0 con 0x7fbcb405be10 2021-11-15T19:35:57.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:57.666+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcb4060cd0 con 0x7fbcb405be10 2021-11-15T19:35:58.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcb1ffb700 1 -- 172.21.2.137:0/2529163285 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v144) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbcac045d10 con 0x7fbcb405be10 2021-11-15T19:35:58.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc940535b0 msgr2=0x7fbc94055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc940535b0 0x7fbc94055a70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fbca8006000 tx=0x7fbca8015000).stop 2021-11-15T19:35:58.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 msgr2=0x7fbcb4138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 0x7fbcb4138150 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fbcb4139620 tx=0x7fbcac008040).stop 2021-11-15T19:35:58.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 shutdown_connections 2021-11-15T19:35:58.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fbc940535b0 0x7fbc94055a70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fbcb405be10 0x7fbcb4138150 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fbcb413ef20 0x7fbcb4139740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:58.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 --2- 172.21.2.137:0/2529163285 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fbca0003820 0x7fbcb413e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 >> 172.21.2.137:0/2529163285 conn(0x7fbcb4063980 msgr2=0x7fbcb413fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:58.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 shutdown_connections 2021-11-15T19:35:58.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.526+0000 7fbcbae8c700 1 -- 172.21.2.137:0/2529163285 wait complete. 2021-11-15T19:35:58.542 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:35:58.546 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T19:35:58.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 Processor -- start 2021-11-15T19:35:58.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 -- start start 2021-11-15T19:35:58.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3c70065730 0x7f3c7013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 0x7f3c7005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c70066270 con 0x7f3c70065b10 2021-11-15T19:35:58.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c70067410 con 0x7f3c70065730 2021-11-15T19:35:58.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.586+0000 7f3c76bf4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c70065fd0 con 0x7f3c700b00a0 2021-11-15T19:35:58.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 0x7f3c7005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 0x7f3c7005bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:42600/0 (socket says 172.21.2.137:42600) 2021-11-15T19:35:58.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 -- 172.21.2.137:0/1186357248 learned_addr learned my addr 172.21.2.137:0/1186357248 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:58.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c74990700 1 --2- 172.21.2.137:0/1186357248 >> v2:172.21.2.111:3300/0 conn(0x7f3c70065730 0x7f3c7013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 -- 172.21.2.137:0/1186357248 >> v2:172.21.2.111:3300/0 conn(0x7f3c70065730 msgr2=0x7f3c7013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:58.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 --2- 172.21.2.137:0/1186357248 >> v2:172.21.2.111:3300/0 conn(0x7f3c70065730 0x7f3c7013c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 -- 172.21.2.137:0/1186357248 >> v1:172.21.2.111:6789/0 conn(0x7f3c70065b10 legacy=0x7f3c7013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 -- 172.21.2.137:0/1186357248 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70066f70 con 0x7f3c700b00a0 2021-11-15T19:35:58.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c74990700 1 --2- 172.21.2.137:0/1186357248 >> v2:172.21.2.111:3300/0 conn(0x7f3c70065730 0x7f3c7013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:35:58.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c75191700 1 --2- 172.21.2.137:0/1186357248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 0x7f3c7005bd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3c680032f0 tx=0x7f3c6800b530).ready entity=mon.2 client_cookie=d5b27c911b59a09a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:58.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c6f7fe700 1 -- 172.21.2.137:0/1186357248 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c680153f0 con 0x7f3c700b00a0 2021-11-15T19:35:58.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c6f7fe700 1 -- 172.21.2.137:0/1186357248 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68015550 con 0x7f3c700b00a0 2021-11-15T19:35:58.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c6f7fe700 1 -- 172.21.2.137:0/1186357248 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c680158b0 con 0x7f3c700b00a0 2021-11-15T19:35:58.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 -- 172.21.2.137:0/1186357248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 msgr2=0x7f3c7005bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/1186357248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 0x7f3c7005bd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3c680032f0 tx=0x7f3c6800b530).stop 2021-11-15T19:35:58.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 -- 172.21.2.137:0/1186357248 shutdown_connections 2021-11-15T19:35:58.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/1186357248 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c700b00a0 0x7f3c7005bd20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/1186357248 >> v2:172.21.2.111:3300/0 conn(0x7f3c70065730 0x7f3c7013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 -- 172.21.2.137:0/1186357248 >> 172.21.2.137:0/1186357248 conn(0x7f3c70060290 msgr2=0x7f3c70060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:58.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 -- 172.21.2.137:0/1186357248 shutdown_connections 2021-11-15T19:35:58.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 -- 172.21.2.137:0/1186357248 wait complete. 2021-11-15T19:35:58.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 Processor -- start 2021-11-15T19:35:58.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.590+0000 7f3c76bf4700 1 -- start start 2021-11-15T19:35:58.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c70065730 0x7f3c701430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c70065b10 0x7f3c7013e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 0x7f3c7013af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700acc20 con 0x7f3c70065730 2021-11-15T19:35:58.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700acec0 con 0x7f3c700b00a0 2021-11-15T19:35:58.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700ad160 con 0x7f3c70065b10 2021-11-15T19:35:58.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 0x7f3c7013af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 0x7f3c7013af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41040/0 (socket says 172.21.2.137:41040) 2021-11-15T19:35:58.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 -- 172.21.2.137:0/307447167 learned_addr learned my addr 172.21.2.137:0/307447167 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:58.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6ffff700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c70065b10 0x7f3c7013e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c74990700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c70065730 0x7f3c701430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 -- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c70065b10 msgr2=0x7f3c7013e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c70065b10 0x7f3c7013e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 -- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c70065730 msgr2=0x7f3c701430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c70065730 0x7f3c701430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 -- 172.21.2.137:0/307447167 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5800b180 con 0x7f3c700b00a0 2021-11-15T19:35:58.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c75191700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 0x7f3c7013af00 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f3c680032f0 tx=0x7f3c68019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:58.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c68009040 con 0x7f3c700b00a0 2021-11-15T19:35:58.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6801c580 con 0x7f3c700b00a0 2021-11-15T19:35:58.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c680153f0 con 0x7f3c700b00a0 2021-11-15T19:35:58.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6800b7d0 con 0x7f3c700b00a0 2021-11-15T19:35:58.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c70141f90 con 0x7f3c700b00a0 2021-11-15T19:35:58.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c700ad320 con 0x7f3c700b00a0 2021-11-15T19:35:58.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c6801c8e0 con 0x7f3c700b00a0 2021-11-15T19:35:58.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6dffb700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3c540536d0 0x7f3c54055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3c6806d370 con 0x7f3c700b00a0 2021-11-15T19:35:58.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.594+0000 7f3c74990700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3c540536d0 0x7f3c54055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.598+0000 7f3c74990700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3c540536d0 0x7f3c54055b90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f3c5800b000 tx=0x7f3c58008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:58.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.598+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c680447b0 con 0x7f3c700b00a0 2021-11-15T19:35:58.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.682+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3c700b0fb0 con 0x7f3c700b00a0 2021-11-15T19:35:58.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c6dffb700 1 -- 172.21.2.137:0/307447167 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3c68047dd0 con 0x7f3c700b00a0 2021-11-15T19:35:58.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3c540536d0 msgr2=0x7f3c54055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3c540536d0 0x7f3c54055b90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f3c5800b000 tx=0x7f3c58008040).stop 2021-11-15T19:35:58.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 msgr2=0x7f3c7013af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 0x7f3c7013af00 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f3c680032f0 tx=0x7f3c68019000).stop 2021-11-15T19:35:58.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 shutdown_connections 2021-11-15T19:35:58.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3c540536d0 0x7f3c54055b90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3c700b00a0 0x7f3c7013af00 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3c70065b10 0x7f3c7013e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 --2- 172.21.2.137:0/307447167 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3c70065730 0x7f3c701430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 >> 172.21.2.137:0/307447167 conn(0x7f3c70060290 msgr2=0x7f3c7013f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:58.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 shutdown_connections 2021-11-15T19:35:58.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.694+0000 7f3c76bf4700 1 -- 172.21.2.137:0/307447167 wait complete. 2021-11-15T19:35:58.712 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-11-15T19:35:58.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.754+0000 7fdf48c42700 1 Processor -- start 2021-11-15T19:35:58.767 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.754+0000 7fdf48c42700 1 -- start start 2021-11-15T19:35:58.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fdf440acab0 0x7fdf440b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.769 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fdf440af2f0 0x7fdf440b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440aecf0 con 0x7fdf440b1180 2021-11-15T19:35:58.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4413f180 con 0x7fdf440acab0 2021-11-15T19:35:58.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440aef20 con 0x7fdf440af2f0 2021-11-15T19:35:58.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf41d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fdf440b1180 0x7fdf44142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59828/0 (socket says 172.21.2.137:59828) 2021-11-15T19:35:58.770 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf41d9b700 1 -- 172.21.2.137:0/2362622839 learned_addr learned my addr 172.21.2.137:0/2362622839 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:58.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- 172.21.2.137:0/2362622839 >> v2:172.21.2.137:3300/0 conn(0x7fdf440af2f0 0x7fdf440b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2362622839 >> v2:172.21.2.111:3300/0 conn(0x7fdf440acab0 msgr2=0x7fdf440b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:58.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- 172.21.2.137:0/2362622839 >> v2:172.21.2.111:3300/0 conn(0x7fdf440acab0 0x7fdf440b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:58.771 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2362622839 >> v1:172.21.2.137:6789/0 conn(0x7fdf440b1180 legacy=0x7fdf44142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2362622839 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440ace90 con 0x7fdf440af2f0 2021-11-15T19:35:58.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- 172.21.2.137:0/2362622839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440af2f0 0x7fdf440b2550 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fdf3c0032f0 tx=0x7fdf3c0091d0).ready entity=mon.1 client_cookie=bdb3193efbb358fc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:58.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf4159a700 1 -- 172.21.2.137:0/2362622839 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf3c009ea0 con 0x7fdf440af2f0 2021-11-15T19:35:58.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf4159a700 1 -- 172.21.2.137:0/2362622839 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00b870 con 0x7fdf440af2f0 2021-11-15T19:35:58.772 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf4159a700 1 -- 172.21.2.137:0/2362622839 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf3c00b9e0 con 0x7fdf440af2f0 2021-11-15T19:35:58.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2362622839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440af2f0 msgr2=0x7fdf440b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2362622839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440af2f0 0x7fdf440b2550 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fdf3c0032f0 tx=0x7fdf3c0091d0).stop 2021-11-15T19:35:58.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2362622839 shutdown_connections 2021-11-15T19:35:58.773 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2362622839 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440af2f0 0x7fdf440b2550 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:58.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2362622839 >> v2:172.21.2.111:3300/0 conn(0x7fdf440acab0 0x7fdf440b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:58.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2362622839 >> 172.21.2.137:0/2362622839 conn(0x7fdf440630f0 msgr2=0x7fdf440634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:58.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2362622839 shutdown_connections 2021-11-15T19:35:58.774 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2362622839 wait complete. 2021-11-15T19:35:58.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 Processor -- start 2021-11-15T19:35:58.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- start start 2021-11-15T19:35:58.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf440acab0 0x7fdf4411b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf440af2f0 0x7fdf441566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 0x7fdf440b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44159c90 con 0x7fdf440acab0 2021-11-15T19:35:58.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4410f8b0 con 0x7fdf440b1180 2021-11-15T19:35:58.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4411bd40 con 0x7fdf440af2f0 2021-11-15T19:35:58.778 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 0x7fdf440b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 0x7fdf440b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41052/0 (socket says 172.21.2.137:41052) 2021-11-15T19:35:58.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2097508425 learned_addr learned my addr 172.21.2.137:0/2097508425 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:58.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf440af2f0 msgr2=0x7fdf441566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf440af2f0 0x7fdf441566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:58.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf440acab0 msgr2=0x7fdf4411b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:58.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf440acab0 0x7fdf4411b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:58.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 -- 172.21.2.137:0/2097508425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009470 con 0x7fdf440b1180 2021-11-15T19:35:58.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf42d9d700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 0x7fdf440b4550 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fdf3c0032f0 tx=0x7fdf3c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:58.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf3c009ea0 con 0x7fdf440b1180 2021-11-15T19:35:58.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c01f5e0 con 0x7fdf440b1180 2021-11-15T19:35:58.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf3c01f940 con 0x7fdf440b1180 2021-11-15T19:35:58.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf44159ec0 con 0x7fdf440b1180 2021-11-15T19:35:58.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.758+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf44156bb0 con 0x7fdf440b1180 2021-11-15T19:35:58.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4415a080 con 0x7fdf440b1180 2021-11-15T19:35:58.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf3c00f070 con 0x7fdf440b1180 2021-11-15T19:35:58.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf3b7fe700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf28053580 0x7fdf28055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:58.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fdf3c06c300 con 0x7fdf440b1180 2021-11-15T19:35:58.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf4259c700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf28053580 0x7fdf28055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:58.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf4259c700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf28053580 0x7fdf28055a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fdf2c002f70 tx=0x7fdf2c006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:58.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.762+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf3c0436f0 con 0x7fdf440b1180 2021-11-15T19:35:58.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:58.874+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fdf440b1820 con 0x7fdf440b1180 2021-11-15T19:35:59.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.526+0000 7fdf3b7fe700 1 -- 172.21.2.137:0/2097508425 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v401) v1 ==== 127+0+0 (secure 0 0 0) 0x7fdf3c0150c0 con 0x7fdf440b1180 2021-11-15T19:35:59.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf28053580 msgr2=0x7fdf28055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:59.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf28053580 0x7fdf28055a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fdf2c002f70 tx=0x7fdf2c006a80).stop 2021-11-15T19:35:59.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 msgr2=0x7fdf440b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:59.540 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 0x7fdf440b4550 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fdf3c0032f0 tx=0x7fdf3c016000).stop 2021-11-15T19:35:59.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 shutdown_connections 2021-11-15T19:35:59.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fdf28053580 0x7fdf28055a40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:59.541 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fdf440b1180 0x7fdf440b4550 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:59.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fdf440af2f0 0x7fdf441566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:59.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 --2- 172.21.2.137:0/2097508425 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fdf440acab0 0x7fdf4411b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:59.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 >> 172.21.2.137:0/2097508425 conn(0x7fdf440630f0 msgr2=0x7fdf440b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:59.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 shutdown_connections 2021-11-15T19:35:59.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.530+0000 7fdf48c42700 1 -- 172.21.2.137:0/2097508425 wait complete. 2021-11-15T19:35:59.547 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T19:35:59.547 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T19:35:59.548 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-11-15T19:35:59.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 Processor -- start 2021-11-15T19:35:59.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- start start 2021-11-15T19:35:59.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8b64147980 0x7f8b640aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b64148190 con 0x7f8b64144610 2021-11-15T19:35:59.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b640b1720 con 0x7f8b640b1340 2021-11-15T19:35:59.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640af800 con 0x7f8b64147980 2021-11-15T19:35:59.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8b640b1340 0x7f8b64143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59838/0 (socket says 172.21.2.137:59838) 2021-11-15T19:35:59.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 -- 172.21.2.137:0/3204764508 learned_addr learned my addr 172.21.2.137:0/3204764508 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:35:59.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933394538 0 0) 0x7f8b640b1720 con 0x7f8b640b1340 2021-11-15T19:35:59.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4c003260 con 0x7f8b640b1340 2021-11-15T19:35:59.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754616254 0 0) 0x7f8b4c003260 con 0x7f8b640b1340 2021-11-15T19:35:59.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6a202700 1 --2- 172.21.2.137:0/3204764508 >> v2:172.21.2.111:3300/0 conn(0x7f8b64147980 0x7f8b640aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:59.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 >> v2:172.21.2.111:3300/0 conn(0x7f8b64147980 msgr2=0x7f8b640aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:59.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 --2- 172.21.2.137:0/3204764508 >> v2:172.21.2.111:3300/0 conn(0x7f8b64147980 0x7f8b640aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:59.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 >> v1:172.21.2.111:6789/0 conn(0x7f8b64144610 legacy=0x7f8b640a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:59.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6405faf0 con 0x7f8b640b1340 2021-11-15T19:35:59.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8b58001660 con 0x7f8b640b1340 2021-11-15T19:35:59.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6a202700 1 --2- 172.21.2.137:0/3204764508 >> v2:172.21.2.111:3300/0 conn(0x7f8b64147980 0x7f8b640aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:35:59.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 >> v1:172.21.2.137:6789/0 conn(0x7f8b640b1340 legacy=0x7f8b64143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:59.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b4c003820 0x7f8b4c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b4c004500 0x7f8b4c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c005050 0x7f8b4c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640af800 con 0x7f8b4c005050 2021-11-15T19:35:59.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c00bfe0 con 0x7f8b4c003820 2021-11-15T19:35:59.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c00c1a0 con 0x7f8b4c004500 2021-11-15T19:35:59.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b4c003820 0x7f8b4c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:59.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 -- 172.21.2.137:0/3204764508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b4c004500 msgr2=0x7f8b4c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:59.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b4c004500 0x7f8b4c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:59.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 -- 172.21.2.137:0/3204764508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c005050 msgr2=0x7f8b4c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:35:59.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c005050 0x7f8b4c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6a202700 1 -- 172.21.2.137:0/3204764508 reap_dead start 2021-11-15T19:35:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 -- 172.21.2.137:0/3204764508 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c003260 con 0x7f8b4c003820 2021-11-15T19:35:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b69a01700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b4c003820 0x7f8b4c003c20 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f8b64062250 tx=0x7f8b6405f9e0).ready entity=mon.1 client_cookie=b2ba174fe3bb71a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b580070d0 con 0x7f8b4c003820 2021-11-15T19:35:59.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b58007230 con 0x7f8b4c003820 2021-11-15T19:35:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b689ff700 1 -- 172.21.2.137:0/3204764508 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5800c8f0 con 0x7f8b4c003820 2021-11-15T19:35:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- 172.21.2.137:0/3204764508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b4c003820 msgr2=0x7f8b4c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b4c003820 0x7f8b4c003c20 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f8b64062250 tx=0x7f8b6405f9e0).stop 2021-11-15T19:35:59.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- 172.21.2.137:0/3204764508 shutdown_connections 2021-11-15T19:35:59.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/3204764508 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b4c003820 0x7f8b4c003c20 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:35:59.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- 172.21.2.137:0/3204764508 >> 172.21.2.137:0/3204764508 conn(0x7f8b640b4e60 msgr2=0x7f8b640b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:35:59.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- 172.21.2.137:0/3204764508 shutdown_connections 2021-11-15T19:35:59.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.590+0000 7f8b6bc65700 1 -- 172.21.2.137:0/3204764508 wait complete. 2021-11-15T19:35:59.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 Processor -- start 2021-11-15T19:35:59.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- start start 2021-11-15T19:35:59.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c003820 0x7f8b6415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b6414a7c0 0x7f8b640aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 0x7f8b64153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64154060 con 0x7f8b4c003820 2021-11-15T19:35:59.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6415aa60 con 0x7f8b641536f0 2021-11-15T19:35:59.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6409a580 con 0x7f8b6414a7c0 2021-11-15T19:35:59.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 0x7f8b64153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:59.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 0x7f8b64153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41072/0 (socket says 172.21.2.137:41072) 2021-11-15T19:35:59.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 -- 172.21.2.137:0/1201051692 learned_addr learned my addr 172.21.2.137:0/1201051692 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:35:59.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 -- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b6414a7c0 msgr2=0x7f8b640aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:59.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b6414a7c0 0x7f8b640aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:59.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 -- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c003820 msgr2=0x7f8b6415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:35:59.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c003820 0x7f8b6415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:35:59.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 -- 172.21.2.137:0/1201051692 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6409a820 con 0x7f8b641536f0 2021-11-15T19:35:59.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6a202700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 0x7f8b64153b70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f8b6415a980 tx=0x7f8b5c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:59.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5c015070 con 0x7f8b641536f0 2021-11-15T19:35:59.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c010580 con 0x7f8b641536f0 2021-11-15T19:35:59.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5c0108e0 con 0x7f8b641536f0 2021-11-15T19:35:59.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b64149a50 con 0x7f8b641536f0 2021-11-15T19:35:59.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b64148430 con 0x7f8b641536f0 2021-11-15T19:35:59.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6409a9b0 con 0x7f8b641536f0 2021-11-15T19:35:59.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b5c010a40 con 0x7f8b641536f0 2021-11-15T19:35:59.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b56ffd700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b44053600 0x7f8b44055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:35:59.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8b5c06b5f0 con 0x7f8b641536f0 2021-11-15T19:35:59.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.594+0000 7f8b69a01700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b44053600 0x7f8b44055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:35:59.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.598+0000 7f8b69a01700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b44053600 0x7f8b44055ac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f8b64062250 tx=0x7f8b58013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:35:59.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.598+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b5c042920 con 0x7f8b641536f0 2021-11-15T19:35:59.720 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:35:59.710+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7f8b640573d0 con 0x7f8b641536f0 2021-11-15T19:36:00.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.530+0000 7f8b56ffd700 1 -- 172.21.2.137:0/1201051692 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v402) v1 ==== 139+0+0 (secure 0 0 0) 0x7f8b5c020250 con 0x7f8b641536f0 2021-11-15T19:36:00.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b44053600 msgr2=0x7f8b44055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b44053600 0x7f8b44055ac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f8b64062250 tx=0x7f8b58013000).stop 2021-11-15T19:36:00.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 msgr2=0x7f8b64153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 0x7f8b64153b70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f8b6415a980 tx=0x7f8b5c008040).stop 2021-11-15T19:36:00.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 shutdown_connections 2021-11-15T19:36:00.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8b44053600 0x7f8b44055ac0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8b641536f0 0x7f8b64153b70 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8b6414a7c0 0x7f8b640aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:00.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 --2- 172.21.2.137:0/1201051692 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8b4c003820 0x7f8b6415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:00.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 >> 172.21.2.137:0/1201051692 conn(0x7f8b640b4e60 msgr2=0x7f8b6413d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:00.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 shutdown_connections 2021-11-15T19:36:00.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.534+0000 7f8b6bc65700 1 -- 172.21.2.137:0/1201051692 wait complete. 2021-11-15T19:36:00.552 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T19:36:00.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 Processor -- start 2021-11-15T19:36:00.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- start start 2021-11-15T19:36:00.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ffba00b67c0 0x7ffba00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b1ee0 0x7ffba00b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba0066410 con 0x7ffba00679a0 2021-11-15T19:36:00.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba0066170 con 0x7ffba00b67c0 2021-11-15T19:36:00.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba005ff00 con 0x7ffba00b1ee0 2021-11-15T19:36:00.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9effd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b1ee0 0x7ffba00b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9f7fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ffba00b67c0 0x7ffba00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9ffff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7ffba00679a0 0x7ffba005bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52356/0 (socket says 172.21.2.137:52356) 2021-11-15T19:36:00.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9ffff700 1 -- 172.21.2.137:0/875968730 learned_addr learned my addr 172.21.2.137:0/875968730 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:00.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9effd700 1 -- 172.21.2.137:0/875968730 >> v2:172.21.2.111:3300/0 conn(0x7ffba00b67c0 msgr2=0x7ffba00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:00.608 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9effd700 1 --2- 172.21.2.137:0/875968730 >> v2:172.21.2.111:3300/0 conn(0x7ffba00b67c0 0x7ffba00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9effd700 1 -- 172.21.2.137:0/875968730 >> v1:172.21.2.111:6789/0 conn(0x7ffba00679a0 legacy=0x7ffba005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9effd700 1 -- 172.21.2.137:0/875968730 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00b05c0 con 0x7ffba00b1ee0 2021-11-15T19:36:00.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9effd700 1 --2- 172.21.2.137:0/875968730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b1ee0 0x7ffba00b00d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ffb90002f70 tx=0x7ffb90006df0).ready entity=mon.2 client_cookie=5e5ab130aee4b28c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:00.609 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9e7fc700 1 -- 172.21.2.137:0/875968730 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000d570 con 0x7ffba00b1ee0 2021-11-15T19:36:00.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9e7fc700 1 -- 172.21.2.137:0/875968730 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb90000e90 con 0x7ffba00b1ee0 2021-11-15T19:36:00.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffb9e7fc700 1 -- 172.21.2.137:0/875968730 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000d8c0 con 0x7ffba00b1ee0 2021-11-15T19:36:00.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- 172.21.2.137:0/875968730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b1ee0 msgr2=0x7ffba00b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 --2- 172.21.2.137:0/875968730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b1ee0 0x7ffba00b00d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ffb90002f70 tx=0x7ffb90006df0).stop 2021-11-15T19:36:00.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- 172.21.2.137:0/875968730 shutdown_connections 2021-11-15T19:36:00.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 --2- 172.21.2.137:0/875968730 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b1ee0 0x7ffba00b00d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 --2- 172.21.2.137:0/875968730 >> v2:172.21.2.111:3300/0 conn(0x7ffba00b67c0 0x7ffba00afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- 172.21.2.137:0/875968730 >> 172.21.2.137:0/875968730 conn(0x7ffba0064420 msgr2=0x7ffba00b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:00.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- 172.21.2.137:0/875968730 shutdown_connections 2021-11-15T19:36:00.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.594+0000 7ffba5b76700 1 -- 172.21.2.137:0/875968730 wait complete. 2021-11-15T19:36:00.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 Processor -- start 2021-11-15T19:36:00.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- start start 2021-11-15T19:36:00.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffba00679a0 0x7ffba00b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 0x7ffba0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b67c0 0x7ffba0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba010f1a0 con 0x7ffba00679a0 2021-11-15T19:36:00.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba010f400 con 0x7ffba00b1ee0 2021-11-15T19:36:00.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01467d0 con 0x7ffba00b67c0 2021-11-15T19:36:00.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 0x7ffba0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 0x7ffba0159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41086/0 (socket says 172.21.2.137:41086) 2021-11-15T19:36:00.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 -- 172.21.2.137:0/2571843816 learned_addr learned my addr 172.21.2.137:0/2571843816 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:00.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9f7fe700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffba00679a0 0x7ffba00b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9ffff700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b67c0 0x7ffba0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 -- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b67c0 msgr2=0x7ffba0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b67c0 0x7ffba0159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 -- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffba00679a0 msgr2=0x7ffba00b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffba00679a0 0x7ffba00b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 -- 172.21.2.137:0/2571843816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9000b180 con 0x7ffba00b1ee0 2021-11-15T19:36:00.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9f7fe700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffba00679a0 0x7ffba00b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:36:00.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9effd700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 0x7ffba0159920 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7ffb90002f70 tx=0x7ffb90014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:00.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90016070 con 0x7ffba00b1ee0 2021-11-15T19:36:00.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9000de40 con 0x7ffba00b1ee0 2021-11-15T19:36:00.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba0146aa0 con 0x7ffba00b1ee0 2021-11-15T19:36:00.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9001e450 con 0x7ffba00b1ee0 2021-11-15T19:36:00.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba015a4a0 con 0x7ffba00b1ee0 2021-11-15T19:36:00.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba00573d0 con 0x7ffba00b1ee0 2021-11-15T19:36:00.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb90025030 con 0x7ffba00b1ee0 2021-11-15T19:36:00.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9cff9700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb840536a0 0x7ffb84055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ffb9006c6d0 con 0x7ffba00b1ee0 2021-11-15T19:36:00.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.598+0000 7ffb9f7fe700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb840536a0 0x7ffb84055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.602+0000 7ffb9f7fe700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb840536a0 0x7ffb84055b60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7ffb88006000 tx=0x7ffb88008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:00.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.602+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb90043b10 con 0x7ffba00b1ee0 2021-11-15T19:36:00.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.686+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffba005db30 con 0x7ffba00b1ee0 2021-11-15T19:36:00.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffb9cff9700 1 -- 172.21.2.137:0/2571843816 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb90023070 con 0x7ffba00b1ee0 2021-11-15T19:36:00.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb840536a0 msgr2=0x7ffb84055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb840536a0 0x7ffb84055b60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7ffb88006000 tx=0x7ffb88008040).stop 2021-11-15T19:36:00.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 msgr2=0x7ffba0159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 0x7ffba0159920 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7ffb90002f70 tx=0x7ffb90014000).stop 2021-11-15T19:36:00.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 shutdown_connections 2021-11-15T19:36:00.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffb840536a0 0x7ffb84055b60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffba00b67c0 0x7ffba0159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffba00b1ee0 0x7ffba0159920 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 --2- 172.21.2.137:0/2571843816 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffba00679a0 0x7ffba00b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 >> 172.21.2.137:0/2571843816 conn(0x7ffba0064420 msgr2=0x7ffba00b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:00.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 shutdown_connections 2021-11-15T19:36:00.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.702+0000 7ffba5b76700 1 -- 172.21.2.137:0/2571843816 wait complete. 2021-11-15T19:36:00.717 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:36:00.717 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:36:00.726 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:36:00.738 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:36:00.752 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:36:00.766 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:36:00.775 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:36:00.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:00.776 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:00.776 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:36:00.818 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T19:36:00.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:36:00.820 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T19:36:00.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:00.821 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:00.821 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:00.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:36:00.834 INFO:teuthology.orchestra.run.gibba018.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T19:36:00.835 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T19:36:00.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:00.836 DEBUG:teuthology.orchestra.run.gibba017:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:00.836 DEBUG:teuthology.orchestra.run.gibba017:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-15T19:36:00.845 INFO:teuthology.orchestra.run.gibba017.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-15T19:36:00.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:36:00.846 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-15T19:36:00.847 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:36:00.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.894+0000 7f8750d4d700 1 Processor -- start 2021-11-15T19:36:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.894+0000 7f8750d4d700 1 -- start start 2021-11-15T19:36:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.894+0000 7f8750d4d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f874c147980 0x7f874c0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.894+0000 7f8750d4d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c148190 con 0x7f874c144610 2021-11-15T19:36:00.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.894+0000 7f8750d4d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c0b1720 con 0x7f874c0b1340 2021-11-15T19:36:00.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.894+0000 7f8750d4d700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0af800 con 0x7f874c147980 2021-11-15T19:36:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874ad9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f874c147980 0x7f874c0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874a59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f874c0b1340 0x7f874c143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59874/0 (socket says 172.21.2.137:59874) 2021-11-15T19:36:00.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874a59c700 1 -- 172.21.2.137:0/1306825043 learned_addr learned my addr 172.21.2.137:0/1306825043 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874ad9d700 1 -- 172.21.2.137:0/1306825043 >> v1:172.21.2.137:6789/0 conn(0x7f874c0b1340 legacy=0x7f874c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874ad9d700 1 -- 172.21.2.137:0/1306825043 >> v1:172.21.2.111:6789/0 conn(0x7f874c144610 legacy=0x7f874c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874ad9d700 1 -- 172.21.2.137:0/1306825043 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c05faf0 con 0x7f874c147980 2021-11-15T19:36:00.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874ad9d700 1 --2- 172.21.2.137:0/1306825043 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c147980 0x7f874c0aa660 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f874c062250 tx=0x7f87440091d0).ready entity=mon.1 client_cookie=eb7171f09c1cc4a9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874959a700 1 -- 172.21.2.137:0/1306825043 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8744009ea0 con 0x7f874c147980 2021-11-15T19:36:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874959a700 1 -- 172.21.2.137:0/1306825043 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874400b860 con 0x7f874c147980 2021-11-15T19:36:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f874959a700 1 -- 172.21.2.137:0/1306825043 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874400b9d0 con 0x7f874c147980 2021-11-15T19:36:00.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/1306825043 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c147980 msgr2=0x7f874c0aa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 --2- 172.21.2.137:0/1306825043 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c147980 0x7f874c0aa660 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f874c062250 tx=0x7f87440091d0).stop 2021-11-15T19:36:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/1306825043 shutdown_connections 2021-11-15T19:36:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 --2- 172.21.2.137:0/1306825043 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c147980 0x7f874c0aa660 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:00.914 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/1306825043 >> 172.21.2.137:0/1306825043 conn(0x7f874c0b4e60 msgr2=0x7f874c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/1306825043 shutdown_connections 2021-11-15T19:36:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/1306825043 wait complete. 2021-11-15T19:36:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 Processor -- start 2021-11-15T19:36:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- start start 2021-11-15T19:36:00.915 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f874c0b1340 0x7f874c141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 0x7f874c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f874c147980 0x7f874c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0995f0 con 0x7f874c0b1340 2021-11-15T19:36:00.916 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0ac2a0 con 0x7f874c144610 2021-11-15T19:36:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0ac540 con 0x7f874c147980 2021-11-15T19:36:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 0x7f874c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 0x7f874c159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41102/0 (socket says 172.21.2.137:41102) 2021-11-15T19:36:00.917 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 -- 172.21.2.137:0/2962058345 learned_addr learned my addr 172.21.2.137:0/2962058345 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 -- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f874c147980 msgr2=0x7f874c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f874c147980 0x7f874c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 -- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f874c0b1340 msgr2=0x7f874c141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f874c0b1340 0x7f874c141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:00.918 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 -- 172.21.2.137:0/2962058345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744009470 con 0x7f874c144610 2021-11-15T19:36:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8749d9b700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 0x7f874c159fd0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f874c0ada90 tx=0x7f873c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873c013460 con 0x7f874c144610 2021-11-15T19:36:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c0ac7e0 con 0x7f874c144610 2021-11-15T19:36:00.919 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c15a9b0 con 0x7f874c144610 2021-11-15T19:36:00.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c0135c0 con 0x7f874c144610 2021-11-15T19:36:00.920 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.898+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873c013920 con 0x7f874c144610 2021-11-15T19:36:00.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c05fd90 con 0x7f874c144610 2021-11-15T19:36:00.921 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f873c01a060 con 0x7f874c144610 2021-11-15T19:36:00.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f87437fe700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f87300536a0 0x7f8730055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:00.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f873c06b080 con 0x7f874c144610 2021-11-15T19:36:00.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f874a59c700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f87300536a0 0x7f8730055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:00.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f874a59c700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f87300536a0 0x7f8730055b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f874c05cfa0 tx=0x7f8734007800).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:00.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.902+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f873c042420 con 0x7f874c144610 2021-11-15T19:36:00.996 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f874c0573d0 con 0x7f874c144610 2021-11-15T19:36:00.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f87437fe700 1 -- 172.21.2.137:0/2962058345 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+28837 (secure 0 0 0) 0x7f873c018020 con 0x7f874c144610 2021-11-15T19:36:00.998 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:00.998 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:36:00.998 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 144, 2021-11-15T19:36:00.999 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:36:00.999 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:36:00.999 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:35:58.519974+0000", 2021-11-15T19:36:00.999 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:36:00.999 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:36:01.000 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:36:01.000 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:36:01.000 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:36:01.000 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:36:01.001 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:36:01.001 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:36:01.001 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:36:01.001 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:01.002 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:36:01.002 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:36:01.002 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:36:01.002 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:36:01.003 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:36:01.003 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 28, 2021-11-15T19:36:01.003 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:36:01.003 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:36:01.004 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:36:01.004 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:36:01.004 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:36:01.004 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.005 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:36:01.005 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:36:01.005 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:36:01.005 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:36:01.005 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:36:01.006 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:36:01.006 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:36:01.006 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:36:01.006 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:36:01.007 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:36:01.007 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:36:01.007 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:36:01.007 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:36:01.007 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:36:01.008 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:36:01.008 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:36:01.008 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:36:01.008 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:36:01.008 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:36:01.009 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:36:01.009 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:36:01.009 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:36:01.009 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:36:01.010 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.010 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:36:01.010 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:36:01.010 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:36:01.011 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:36:01.011 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:36:01.011 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:36:01.011 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:36:01.011 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:36:01.012 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:36:01.012 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:36:01.012 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:36:01.012 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:36:01.013 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:36:01.013 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:36:01.013 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:36:01.013 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:36:01.014 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:36:01.014 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:36:01.014 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:36:01.014 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:36:01.015 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:36:01.015 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:36:01.015 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:36:01.015 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:36:01.015 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:36:01.016 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:36:01.016 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:36:01.016 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.016 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:36:01.017 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:36:01.017 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:36:01.017 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:36:01.017 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:36:01.017 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:36:01.018 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:36:01.018 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:36:01.018 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:36:01.018 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:36:01.019 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:36:01.019 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:36:01.019 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:36:01.019 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.020 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:36:01.020 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:36:01.020 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.020 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.020 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.021 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:36:01.021 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:36:01.021 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:36:01.021 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:36:01.021 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:36:01.022 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:36:01.022 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:36:01.022 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:36:01.022 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:36:01.023 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:36:01.023 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:36:01.023 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:36:01.023 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:36:01.024 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:36:01.024 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:36:01.024 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:36:01.024 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:36:01.024 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:36:01.025 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:36:01.025 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:36:01.025 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:36:01.025 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:36:01.026 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:36:01.026 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.026 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:36:01.026 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:36:01.027 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:36:01.027 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:36:01.027 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:36:01.027 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:36:01.027 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:36:01.028 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:36:01.028 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:36:01.028 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:36:01.028 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:36:01.029 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:36:01.029 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:36:01.029 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:36:01.029 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:36:01.029 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:36:01.030 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:36:01.030 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:36:01.030 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:36:01.030 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:36:01.031 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:36:01.031 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:36:01.031 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:36:01.031 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:36:01.032 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:36:01.032 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:36:01.032 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:36:01.032 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.032 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:36:01.033 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:36:01.033 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:36:01.033 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:36:01.033 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:36:01.033 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:36:01.034 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:36:01.034 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:36:01.034 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:36:01.034 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:36:01.035 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:36:01.035 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:36:01.035 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:36:01.035 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:36:01.035 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.036 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.036 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:01.036 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:36:01.036 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.037 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:36:01.037 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:36:01.037 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.037 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.037 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.038 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.038 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.038 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.038 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.039 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:36:01.039 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.039 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.039 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.039 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.040 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.040 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.040 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:36:01.040 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.041 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.041 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.041 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.041 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:36:01.041 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.042 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.042 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.042 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.042 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.043 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.043 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.043 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.043 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:36:01.043 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.044 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.044 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.044 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.044 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:36:01.045 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.045 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.045 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.045 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.045 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.046 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.046 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.046 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.046 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:36:01.047 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.047 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.047 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.047 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.047 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:36:01.048 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.048 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.048 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.048 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.049 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.049 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.049 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.049 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.049 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:36:01.050 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.050 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.050 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.050 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.051 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:36:01.051 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:01.051 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.051 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.052 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.052 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:36:01.052 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:36:01.052 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:36:01.052 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:36:01.053 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.053 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.053 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.053 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.054 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.054 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.054 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:36:01.054 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:36:01.054 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.055 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.055 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.055 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.055 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.056 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.056 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.056 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:36:01.056 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.056 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.057 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.057 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.057 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.057 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.058 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:36:01.058 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.058 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.058 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.058 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.059 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:36:01.059 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.059 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.059 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.060 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.060 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.060 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.060 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.061 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.061 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:36:01.061 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.061 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.061 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.062 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.062 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:36:01.062 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.062 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.063 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.063 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.063 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.063 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.063 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.064 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.064 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:36:01.064 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.064 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.064 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.065 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.065 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:36:01.065 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.065 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.066 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.066 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.066 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.066 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.067 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.067 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.067 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:36:01.067 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.067 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.068 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.068 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.068 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:36:01.068 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:01.068 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.069 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.069 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.069 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:36:01.069 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:36:01.070 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:36:01.070 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:36:01.070 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.070 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.071 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.071 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.071 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.071 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.071 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:36:01.072 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:36:01.072 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.072 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.072 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.073 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.073 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.073 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.073 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.073 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 137, 2021-11-15T19:36:01.074 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.074 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.074 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.074 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.075 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.075 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.075 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:36:01.075 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.075 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.076 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.076 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.076 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:36:01.076 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.077 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.077 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.077 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.077 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.077 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.078 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.078 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.078 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:36:01.078 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.079 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.079 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.079 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.079 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:36:01.079 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.080 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.080 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.080 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.080 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.081 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.081 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.081 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.081 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:36:01.082 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.082 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.082 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.082 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.082 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:36:01.083 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.083 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.083 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.083 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.084 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.084 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.084 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.084 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.085 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:36:01.085 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.085 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.085 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.086 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.086 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:36:01.086 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:01.086 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.086 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.087 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.087 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:36:01.087 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:36:01.087 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:36:01.088 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:36:01.088 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.088 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.088 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.088 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.089 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.089 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.089 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:36:01.089 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:36:01.090 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.090 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.090 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.090 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.090 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.091 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.091 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.091 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 128, 2021-11-15T19:36:01.091 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.092 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.092 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.092 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.092 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.092 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.093 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:36:01.093 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.093 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.093 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.094 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.094 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:36:01.094 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.094 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.094 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.095 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.095 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.095 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.095 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.096 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.096 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:36:01.096 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.096 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.096 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.097 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.097 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:36:01.097 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.097 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.097 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.098 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.098 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.098 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.098 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.099 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.099 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:36:01.099 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.099 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.099 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.100 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.100 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:36:01.100 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.100 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.101 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.101 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.101 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.101 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.101 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.102 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.102 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:36:01.102 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.102 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.102 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.103 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.103 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:36:01.103 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:01.103 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.104 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.104 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.104 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:36:01.104 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:36:01.104 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:36:01.105 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:36:01.105 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.105 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.105 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.106 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.106 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.106 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.106 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:36:01.106 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:36:01.107 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.107 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.107 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.107 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.108 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.108 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.108 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.108 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 137, 2021-11-15T19:36:01.108 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.109 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.109 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.109 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.109 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.110 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.110 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:36:01.110 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.110 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.110 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.111 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.111 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:36:01.111 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.111 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.112 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.112 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.112 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.112 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.113 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.113 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.113 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:36:01.113 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.114 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.114 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.114 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.114 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:36:01.115 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.115 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.115 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.115 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.115 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.116 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.116 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.116 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.116 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:36:01.117 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.117 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.117 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.117 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.117 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:36:01.118 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.118 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.118 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.118 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.119 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.119 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.119 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.119 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.120 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:36:01.120 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.120 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.120 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.120 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.121 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:36:01.121 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:01.121 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.121 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.122 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.122 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:36:01.122 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:36:01.122 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:36:01.122 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:36:01.123 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.123 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.123 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.123 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.123 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.124 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.124 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:36:01.124 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:36:01.124 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.125 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.125 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.125 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.125 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.125 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.126 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.126 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:36:01.126 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.126 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.127 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.127 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.127 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.127 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.127 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:36:01.128 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.128 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.128 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.128 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.128 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:36:01.129 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.129 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.129 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.129 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.129 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.130 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.130 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.130 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.130 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:36:01.130 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.131 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.131 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.131 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.131 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:36:01.132 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.132 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.132 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.132 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.132 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.133 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.133 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.133 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.133 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:36:01.133 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.134 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.134 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.134 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.134 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:36:01.135 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.135 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.135 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.135 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.135 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.136 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.136 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.136 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.136 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:36:01.137 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.137 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.137 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.137 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.137 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:36:01.138 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:01.138 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.138 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.138 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.139 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:36:01.139 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:36:01.139 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:36:01.139 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:36:01.139 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.140 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.140 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.140 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.140 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.141 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.141 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:36:01.141 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:36:01.141 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.141 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.142 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.142 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.142 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.142 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.143 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.143 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:36:01.143 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.143 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.144 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.144 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.144 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.144 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.144 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:36:01.145 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.145 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.145 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.145 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.146 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:36:01.146 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.146 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.146 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.147 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.147 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.147 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.147 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.148 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.148 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:36:01.148 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.148 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.148 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.149 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.149 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:36:01.149 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.149 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.150 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.150 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.150 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.150 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.151 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.151 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.151 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:36:01.151 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.151 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.152 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.152 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.152 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:36:01.152 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.153 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.153 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.153 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.153 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.153 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.154 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.154 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.154 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:36:01.154 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.155 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.155 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.155 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.155 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:36:01.155 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:01.156 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.156 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.156 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.156 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:36:01.157 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:36:01.157 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:36:01.157 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:36:01.157 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.157 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.158 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.158 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.158 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.158 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.159 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:36:01.159 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:36:01.159 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:01.159 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:01.160 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:01.160 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:01.160 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:01.160 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:01.161 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:01.161 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 138, 2021-11-15T19:36:01.161 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:01.161 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:01.161 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:01.162 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.162 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.162 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.162 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:36:01.163 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.163 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.163 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.163 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.164 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:36:01.164 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.164 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.164 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.164 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.165 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:01.165 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.165 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.165 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.166 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:36:01.166 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.166 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.166 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.167 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.167 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:36:01.167 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.167 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.168 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.168 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.168 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:01.168 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.168 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.169 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.169 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:36:01.169 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.169 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.170 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.170 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.170 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:36:01.170 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.171 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.171 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.171 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.171 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:01.171 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:01.172 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.172 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:01.172 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:36:01.172 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.173 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.173 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.173 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:01.173 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:36:01.173 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:01.174 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.174 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.174 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.174 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:36:01.175 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:36:01.175 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:36:01.175 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:36:01.175 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:01.176 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:01.176 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:01.176 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:01.176 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.176 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:01.177 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:36:01.177 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.177 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:36:01.177 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.178 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.178 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.178 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.178 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.179 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:36:01.179 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.179 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.179 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.180 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:36:01.180 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.180 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.180 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.180 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.181 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.181 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:36:01.181 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.181 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.182 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.182 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:36:01.182 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.182 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.182 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.183 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.183 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.183 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:36:01.183 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.184 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.184 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.184 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:36:01.184 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.185 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.185 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.185 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.185 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.185 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:36:01.186 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.186 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.186 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.186 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:36:01.187 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.187 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.187 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.187 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.187 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.188 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:36:01.188 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.188 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.188 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.189 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:36:01.189 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.189 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.189 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.189 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.190 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.190 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:36:01.190 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.190 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.191 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.191 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:36:01.191 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.191 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.192 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.192 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.192 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.192 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:36:01.192 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.193 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.193 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:01.193 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:36:01.193 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:01.194 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:01.194 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:01.194 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:01.194 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:01.194 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:36:01.195 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:01.195 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.195 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:01.195 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:36:01.196 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:36:01.196 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:36:01.196 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:36:01.196 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": { 2021-11-15T19:36:01.197 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6833/4036717918": "2021-11-16T19:35:54.553077+0000", 2021-11-15T19:36:01.197 INFO:teuthology.orchestra.run.gibba037.stdout: "172.21.2.137:6832/4036717918": "2021-11-16T19:35:54.553077+0000" 2021-11-15T19:36:01.197 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.197 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:36:01.198 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:36:01.198 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:36:01.198 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:36:01.198 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:36:01.198 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:36:01.199 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:36:01.199 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:36:01.199 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:01.199 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:01.200 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:36:01.200 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:36:01.200 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:36:01.200 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:36:01.200 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:36:01.201 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:36:01.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f87300536a0 msgr2=0x7f8730055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f87300536a0 0x7f8730055b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f874c05cfa0 tx=0x7f8734007800).stop 2021-11-15T19:36:01.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 msgr2=0x7f874c159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 0x7f874c159fd0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f874c0ada90 tx=0x7f873c006df0).stop 2021-11-15T19:36:01.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 shutdown_connections 2021-11-15T19:36:01.203 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f87300536a0 0x7f8730055b60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f874c147980 0x7f874c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f874c144610 0x7f874c159fd0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 --2- 172.21.2.137:0/2962058345 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f874c0b1340 0x7f874c141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.204 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 >> 172.21.2.137:0/2962058345 conn(0x7f874c0b4e60 msgr2=0x7f874c145510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:01.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 shutdown_connections 2021-11-15T19:36:01.205 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:00.986+0000 7f8750d4d700 1 -- 172.21.2.137:0/2962058345 wait complete. 2021-11-15T19:36:01.206 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:01.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 Processor -- start 2021-11-15T19:36:01.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- start start 2021-11-15T19:36:01.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa78c0acab0 0x7fa78c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa78c0b1180 0x7fa78c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c0aecf0 con 0x7fa78c0af2f0 2021-11-15T19:36:01.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c13f180 con 0x7fa78c0acab0 2021-11-15T19:36:01.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0aef20 con 0x7fa78c0b1180 2021-11-15T19:36:01.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa78c0b1180 0x7fa78c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa78c0b1180 0x7fa78c0b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41108/0 (socket says 172.21.2.137:41108) 2021-11-15T19:36:01.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 -- 172.21.2.137:0/1463199681 learned_addr learned my addr 172.21.2.137:0/1463199681 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:01.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 -- 172.21.2.137:0/1463199681 >> v2:172.21.2.111:3300/0 conn(0x7fa78c0acab0 msgr2=0x7fa78c0b2060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:01.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 --2- 172.21.2.137:0/1463199681 >> v2:172.21.2.111:3300/0 conn(0x7fa78c0acab0 0x7fa78c0b2060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 -- 172.21.2.137:0/1463199681 >> v1:172.21.2.111:6789/0 conn(0x7fa78c0af2f0 legacy=0x7fa78c142b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:01.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 -- 172.21.2.137:0/1463199681 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0ace90 con 0x7fa78c0b1180 2021-11-15T19:36:01.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78affd700 1 --2- 172.21.2.137:0/1463199681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c0b2550 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fa78c0b2bd0 tx=0x7fa77c006eb0).ready entity=mon.1 client_cookie=71ae95c6b31d9bbb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78a7fc700 1 -- 172.21.2.137:0/1463199681 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa77c00f940 con 0x7fa78c0b1180 2021-11-15T19:36:01.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78a7fc700 1 -- 172.21.2.137:0/1463199681 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c000e90 con 0x7fa78c0b1180 2021-11-15T19:36:01.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa78a7fc700 1 -- 172.21.2.137:0/1463199681 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa77c00fcd0 con 0x7fa78c0b1180 2021-11-15T19:36:01.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- 172.21.2.137:0/1463199681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 msgr2=0x7fa78c0b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 --2- 172.21.2.137:0/1463199681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c0b2550 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fa78c0b2bd0 tx=0x7fa77c006eb0).stop 2021-11-15T19:36:01.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- 172.21.2.137:0/1463199681 shutdown_connections 2021-11-15T19:36:01.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 --2- 172.21.2.137:0/1463199681 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c0b2550 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 --2- 172.21.2.137:0/1463199681 >> v2:172.21.2.111:3300/0 conn(0x7fa78c0acab0 0x7fa78c0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- 172.21.2.137:0/1463199681 >> 172.21.2.137:0/1463199681 conn(0x7fa78c0630f0 msgr2=0x7fa78c0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:01.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- 172.21.2.137:0/1463199681 shutdown_connections 2021-11-15T19:36:01.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.250+0000 7fa792059700 1 -- 172.21.2.137:0/1463199681 wait complete. 2021-11-15T19:36:01.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 Processor -- start 2021-11-15T19:36:01.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- start start 2021-11-15T19:36:01.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa78c0acab0 0x7fa78c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa78c0af2f0 0x7fa78c0661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c152b20 con 0x7fa78c0acab0 2021-11-15T19:36:01.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c152dc0 con 0x7fa78c0b1180 2021-11-15T19:36:01.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c153060 con 0x7fa78c0af2f0 2021-11-15T19:36:01.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41116/0 (socket says 172.21.2.137:41116) 2021-11-15T19:36:01.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 -- 172.21.2.137:0/136569246 learned_addr learned my addr 172.21.2.137:0/136569246 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:01.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 -- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa78c0af2f0 msgr2=0x7fa78c0661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa78c0af2f0 0x7fa78c0661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 -- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa78c0acab0 msgr2=0x7fa78c152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa78c0acab0 0x7fa78c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 -- 172.21.2.137:0/136569246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c00c2f0 con 0x7fa78c0b1180 2021-11-15T19:36:01.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa78bfff700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c155a50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fa784003330 tx=0x7fa784009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa784001520 con 0x7fa78c0b1180 2021-11-15T19:36:01.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784001680 con 0x7fa78c0b1180 2021-11-15T19:36:01.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7840019e0 con 0x7fa78c0b1180 2021-11-15T19:36:01.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c0666e0 con 0x7fa78c0b1180 2021-11-15T19:36:01.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c156160 con 0x7fa78c0b1180 2021-11-15T19:36:01.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c152970 con 0x7fa78c0b1180 2021-11-15T19:36:01.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa784018030 con 0x7fa78c0b1180 2021-11-15T19:36:01.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa788ff9700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa7700536f0 0x7fa770055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.254+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa78406b120 con 0x7fa78c0b1180 2021-11-15T19:36:01.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.258+0000 7fa78b7fe700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa7700536f0 0x7fa770055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.258+0000 7fa78b7fe700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa7700536f0 0x7fa770055bb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fa774002fb0 tx=0x7fa7740069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.258+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa784042500 con 0x7fa78c0b1180 2021-11-15T19:36:01.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa78c153220 con 0x7fa78c0b1180 2021-11-15T19:36:01.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa788ff9700 1 -- 172.21.2.137:0/136569246 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fa784016070 con 0x7fa78c0b1180 2021-11-15T19:36:01.377 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:01.377 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/4033173388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4033173388},{"type":"v1","addr":"172.21.2.137:6833","nonce":4033173388}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[]} 2021-11-15T19:36:01.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa7700536f0 msgr2=0x7fa770055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa7700536f0 0x7fa770055bb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fa774002fb0 tx=0x7fa7740069b0).stop 2021-11-15T19:36:01.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 msgr2=0x7fa78c155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c155a50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7fa784003330 tx=0x7fa784009120).stop 2021-11-15T19:36:01.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 shutdown_connections 2021-11-15T19:36:01.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa7700536f0 0x7fa770055bb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa78c0b1180 0x7fa78c155a50 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa78c0af2f0 0x7fa78c0661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 --2- 172.21.2.137:0/136569246 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa78c0acab0 0x7fa78c152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 >> 172.21.2.137:0/136569246 conn(0x7fa78c0630f0 msgr2=0x7fa78c069680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:01.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 shutdown_connections 2021-11-15T19:36:01.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.366+0000 7fa792059700 1 -- 172.21.2.137:0/136569246 wait complete. 2021-11-15T19:36:01.381 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 76 2021-11-15T19:36:01.384 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:01.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 Processor -- start 2021-11-15T19:36:01.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 -- start start 2021-11-15T19:36:01.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9eac13f890 0x7f9eac0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f9eac05f730 0x7f9eac05fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0b0c80 con 0x7f9eac0608f0 2021-11-15T19:36:01.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0ad6c0 con 0x7f9eac05f730 2021-11-15T19:36:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eb1010700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0b1b50 con 0x7f9eac13f890 2021-11-15T19:36:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9eac13f890 0x7f9eac0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f9eac13f890 0x7f9eac0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41120/0 (socket says 172.21.2.137:41120) 2021-11-15T19:36:01.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 -- 172.21.2.137:0/827787154 learned_addr learned my addr 172.21.2.137:0/827787154 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 -- 172.21.2.137:0/827787154 >> v2:172.21.2.111:3300/0 conn(0x7f9eac05f730 msgr2=0x7f9eac05fb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 --2- 172.21.2.137:0/827787154 >> v2:172.21.2.111:3300/0 conn(0x7f9eac05f730 0x7f9eac05fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 -- 172.21.2.137:0/827787154 >> v1:172.21.2.111:6789/0 conn(0x7f9eac0608f0 legacy=0x7f9eac0b2710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.422+0000 7f9eaa59c700 1 -- 172.21.2.137:0/827787154 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0b0f20 con 0x7f9eac13f890 2021-11-15T19:36:01.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaa59c700 1 --2- 172.21.2.137:0/827787154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac13f890 0x7f9eac0b1660 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f9eac0b3ac0 tx=0x7f9e94006eb0).ready entity=mon.1 client_cookie=a3528f03750ed63b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea9d9b700 1 -- 172.21.2.137:0/827787154 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e9400d5c0 con 0x7f9eac13f890 2021-11-15T19:36:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea9d9b700 1 -- 172.21.2.137:0/827787154 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94000e90 con 0x7f9eac13f890 2021-11-15T19:36:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea9d9b700 1 -- 172.21.2.137:0/827787154 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e9400d910 con 0x7f9eac13f890 2021-11-15T19:36:01.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/827787154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac13f890 msgr2=0x7f9eac0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 --2- 172.21.2.137:0/827787154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac13f890 0x7f9eac0b1660 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f9eac0b3ac0 tx=0x7f9e94006eb0).stop 2021-11-15T19:36:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/827787154 shutdown_connections 2021-11-15T19:36:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 --2- 172.21.2.137:0/827787154 >> v2:172.21.2.111:3300/0 conn(0x7f9eac05f730 0x7f9eac05fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 --2- 172.21.2.137:0/827787154 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac13f890 0x7f9eac0b1660 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/827787154 >> 172.21.2.137:0/827787154 conn(0x7f9eac063980 msgr2=0x7f9eac063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/827787154 shutdown_connections 2021-11-15T19:36:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/827787154 wait complete. 2021-11-15T19:36:01.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 Processor -- start 2021-11-15T19:36:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- start start 2021-11-15T19:36:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 0x7f9eac0aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eac0608f0 0x7f9eac142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eac13f890 0x7f9eac139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac143300 con 0x7f9eac13f890 2021-11-15T19:36:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac143590 con 0x7f9eac05f730 2021-11-15T19:36:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac159e00 con 0x7f9eac0608f0 2021-11-15T19:36:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 0x7f9eac0aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 0x7f9eac0aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41128/0 (socket says 172.21.2.137:41128) 2021-11-15T19:36:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 -- 172.21.2.137:0/1398068477 learned_addr learned my addr 172.21.2.137:0/1398068477 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 -- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eac0608f0 msgr2=0x7f9eac142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eac0608f0 0x7f9eac142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 -- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eac13f890 msgr2=0x7f9eac139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eac13f890 0x7f9eac139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 -- 172.21.2.137:0/1398068477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9400b1e0 con 0x7f9eac05f730 2021-11-15T19:36:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eaad9d700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 0x7f9eac0aeae0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f9e9c002fb0 tx=0x7f9e9c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e9c013460 con 0x7f9eac05f730 2021-11-15T19:36:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0135c0 con 0x7f9eac05f730 2021-11-15T19:36:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac13a490 con 0x7f9eac05f730 2021-11-15T19:36:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e9c013920 con 0x7f9eac05f730 2021-11-15T19:36:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac13d6d0 con 0x7f9eac05f730 2021-11-15T19:36:01.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac159fc0 con 0x7f9eac05f730 2021-11-15T19:36:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.426+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e9c00f070 con 0x7f9eac05f730 2021-11-15T19:36:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.430+0000 7f9ea3fff700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e90053610 0x7f9e90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.430+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9e9c06b110 con 0x7f9eac05f730 2021-11-15T19:36:01.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.430+0000 7f9eaa59c700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e90053610 0x7f9e90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.430+0000 7f9eaa59c700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e90053610 0x7f9e90055ad0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f9eac0b3ac0 tx=0x7f9e94015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.430+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e9c042550 con 0x7f9eac05f730 2021-11-15T19:36:01.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eac0b11c0 con 0x7f9eac05f730 2021-11-15T19:36:01.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9ea3fff700 1 -- 172.21.2.137:0/1398068477 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f9e9c045b70 con 0x7f9eac05f730 2021-11-15T19:36:01.553 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:01.553 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/3700233266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":3700233266},{"type":"v1","addr":"172.21.2.111:6835","nonce":3700233266}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.137:6833/4033173388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":4033173388},{"type":"v1","addr":"172.21.2.137:6833","nonce":4033173388}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[]} 2021-11-15T19:36:01.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e90053610 msgr2=0x7f9e90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e90053610 0x7f9e90055ad0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f9eac0b3ac0 tx=0x7f9e94015000).stop 2021-11-15T19:36:01.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 msgr2=0x7f9eac0aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 0x7f9eac0aeae0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f9e9c002fb0 tx=0x7f9e9c006df0).stop 2021-11-15T19:36:01.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 shutdown_connections 2021-11-15T19:36:01.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f9e90053610 0x7f9e90055ad0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9eac13f890 0x7f9eac139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f9eac0608f0 0x7f9eac142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 --2- 172.21.2.137:0/1398068477 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9eac05f730 0x7f9eac0aeae0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 >> 172.21.2.137:0/1398068477 conn(0x7f9eac063980 msgr2=0x7f9eac13fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:01.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 shutdown_connections 2021-11-15T19:36:01.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.542+0000 7f9eb1010700 1 -- 172.21.2.137:0/1398068477 wait complete. 2021-11-15T19:36:01.557 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 76 2021-11-15T19:36:01.561 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T19:36:01.561 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T19:36:01.561 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T19:36:01.562 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:36:01.562 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T19:36:01.562 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T19:36:01.563 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T19:36:01.563 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T19:36:01.567 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T19:36:01.567 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T19:36:01.569 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T19:36:01.569 DEBUG:teuthology.orchestra.run.gibba011:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T19:36:01.570 INFO:tasks.ceph.mds.a:Started 2021-11-15T19:36:01.571 DEBUG:teuthology.parallel:result is None 2021-11-15T19:36:01.573 INFO:tasks.ceph.mds.b:Started 2021-11-15T19:36:01.573 DEBUG:teuthology.parallel:result is None 2021-11-15T19:36:01.574 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T19:36:01.602 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:36:01.610 INFO:tasks.ceph.mds.b.gibba011.stdout:starting mds.b at 2021-11-15T19:36:01.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 Processor -- start 2021-11-15T19:36:01.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- start start 2021-11-15T19:36:01.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5940147e70 0x7f59400b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59400b0d70 con 0x7f59400b6180 2021-11-15T19:36:01.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59400b5a40 con 0x7f59400b0990 2021-11-15T19:36:01.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59400b5ce0 con 0x7f5940147e70 2021-11-15T19:36:01.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593ed9d700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f5940147e70 0x7f59400b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593e59c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f59400b0990 0x7f59400b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59928/0 (socket says 172.21.2.137:59928) 2021-11-15T19:36:01.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593e59c700 1 -- 172.21.2.137:0/595235488 learned_addr learned my addr 172.21.2.137:0/595235488 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:01.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593ed9d700 1 --2- 172.21.2.137:0/595235488 >> v2:172.21.2.137:3300/0 conn(0x7f5940147e70 0x7f59400b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41150/0 (socket says 172.21.2.137:41150) 2021-11-15T19:36:01.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593ed9d700 1 -- 172.21.2.137:0/595235488 >> v1:172.21.2.137:6789/0 conn(0x7f59400b0990 legacy=0x7f59400b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593ed9d700 1 -- 172.21.2.137:0/595235488 >> v1:172.21.2.111:6789/0 conn(0x7f59400b6180 legacy=0x7f5940147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:01.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593ed9d700 1 -- 172.21.2.137:0/595235488 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400b4a80 con 0x7f5940147e70 2021-11-15T19:36:01.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593ed9d700 1 --2- 172.21.2.137:0/595235488 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5940147e70 0x7f59400b2090 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f5940063210 tx=0x7f59380091d0).ready entity=mon.1 client_cookie=bfb601740d5ddb04 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593d59a700 1 -- 172.21.2.137:0/595235488 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5938009ea0 con 0x7f5940147e70 2021-11-15T19:36:01.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593d59a700 1 -- 172.21.2.137:0/595235488 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593800b860 con 0x7f5940147e70 2021-11-15T19:36:01.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593d59a700 1 -- 172.21.2.137:0/595235488 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593800b9d0 con 0x7f5940147e70 2021-11-15T19:36:01.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- 172.21.2.137:0/595235488 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5940147e70 msgr2=0x7f59400b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/595235488 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5940147e70 0x7f59400b2090 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f5940063210 tx=0x7f59380091d0).stop 2021-11-15T19:36:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- 172.21.2.137:0/595235488 shutdown_connections 2021-11-15T19:36:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/595235488 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f5940147e70 0x7f59400b2090 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- 172.21.2.137:0/595235488 >> 172.21.2.137:0/595235488 conn(0x7f59400623a0 msgr2=0x7f5940062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:01.635 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- 172.21.2.137:0/595235488 shutdown_connections 2021-11-15T19:36:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- 172.21.2.137:0/595235488 wait complete. 2021-11-15T19:36:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 Processor -- start 2021-11-15T19:36:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- start start 2021-11-15T19:36:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59400b0990 0x7f594014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 0x7f5940156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5940147e70 0x7f59400acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5940156470 con 0x7f59400b0990 2021-11-15T19:36:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5940156710 con 0x7f59400b6180 2021-11-15T19:36:01.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f5944d46700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59401569b0 con 0x7f5940147e70 2021-11-15T19:36:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 0x7f5940156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 0x7f5940156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41154/0 (socket says 172.21.2.137:41154) 2021-11-15T19:36:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 -- 172.21.2.137:0/3190967280 learned_addr learned my addr 172.21.2.137:0/3190967280 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 -- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5940147e70 msgr2=0x7f59400acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5940147e70 0x7f59400acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 -- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59400b0990 msgr2=0x7f594014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59400b0990 0x7f594014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.618+0000 7f593dd9b700 1 -- 172.21.2.137:0/3190967280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009470 con 0x7f59400b6180 2021-11-15T19:36:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f593dd9b700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 0x7f5940156e50 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f5930002f90 tx=0x7f5930006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5930013460 con 0x7f59400b6180 2021-11-15T19:36:01.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59300135c0 con 0x7f59400b6180 2021-11-15T19:36:01.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940157340 con 0x7f59400b6180 2021-11-15T19:36:01.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5930013920 con 0x7f59400b6180 2021-11-15T19:36:01.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59400afa70 con 0x7f59400b6180 2021-11-15T19:36:01.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5940145df0 con 0x7f59400b6180 2021-11-15T19:36:01.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f593000f070 con 0x7f59400b6180 2021-11-15T19:36:01.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f591c053640 0x7f591c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:01.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f593006af50 con 0x7f59400b6180 2021-11-15T19:36:01.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f593e59c700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f591c053640 0x7f591c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:01.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f593e59c700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f591c053640 0x7f591c055b00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f59400632b0 tx=0x7f59340077d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:01.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.622+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5930068e90 con 0x7f59400b6180 2021-11-15T19:36:01.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:01.718+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5940156b70 con 0x7f59400b6180 2021-11-15T19:36:02.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f592f7fe700 1 -- 172.21.2.137:0/3190967280 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5930047020 con 0x7f59400b6180 2021-11-15T19:36:02.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f591c053640 msgr2=0x7f591c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f591c053640 0x7f591c055b00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f59400632b0 tx=0x7f59340077d0).stop 2021-11-15T19:36:02.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 msgr2=0x7f5940156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 0x7f5940156e50 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f5930002f90 tx=0x7f5930006df0).stop 2021-11-15T19:36:02.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 shutdown_connections 2021-11-15T19:36:02.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f591c053640 0x7f591c055b00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:02.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f5940147e70 0x7f59400acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f59400b6180 0x7f5940156e50 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:02.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 --2- 172.21.2.137:0/3190967280 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f59400b0990 0x7f594014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 >> 172.21.2.137:0/3190967280 conn(0x7f59400623a0 msgr2=0x7f59400b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:02.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 shutdown_connections 2021-11-15T19:36:02.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.618+0000 7f5944d46700 1 -- 172.21.2.137:0/3190967280 wait complete. 2021-11-15T19:36:02.633 INFO:teuthology.orchestra.run.gibba037.stderr: removed all blacklist entries 2021-11-15T19:36:02.637 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-15T19:36:02.637 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T19:36:02.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 Processor -- start 2021-11-15T19:36:02.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 -- start start 2021-11-15T19:36:02.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f58f80b1340 0x7f58f8147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f58f8143f00 0x7f58f8144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f8148190 con 0x7f58f80a9f50 2021-11-15T19:36:02.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f80b1720 con 0x7f58f80b1340 2021-11-15T19:36:02.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58fc8ca700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f8147e70 con 0x7f58f8143f00 2021-11-15T19:36:02.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58f6d9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f58f80a9f50 0x7f58f80aa3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59948/0 (socket says 172.21.2.137:59948) 2021-11-15T19:36:02.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58f6d9d700 1 -- 172.21.2.137:0/1010667588 learned_addr learned my addr 172.21.2.137:0/1010667588 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:02.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.722+0000 7f58f5d9b700 1 --2- 172.21.2.137:0/1010667588 >> v2:172.21.2.137:3300/0 conn(0x7f58f8143f00 0x7f58f8144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:02.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f5d9b700 1 -- 172.21.2.137:0/1010667588 >> v2:172.21.2.111:3300/0 conn(0x7f58f80b1340 msgr2=0x7f58f8147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:02.739 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f5d9b700 1 --2- 172.21.2.137:0/1010667588 >> v2:172.21.2.111:3300/0 conn(0x7f58f80b1340 0x7f58f8147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f5d9b700 1 -- 172.21.2.137:0/1010667588 >> v1:172.21.2.137:6789/0 conn(0x7f58f80a9f50 legacy=0x7f58f80aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f559a700 1 -- 172.21.2.137:0/1010667588 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182525025 0 0) 0x7f58f0001490 con 0x7f58f80a9f50 2021-11-15T19:36:02.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f5d9b700 1 -- 172.21.2.137:0/1010667588 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80af800 con 0x7f58f8143f00 2021-11-15T19:36:02.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f5d9b700 1 --2- 172.21.2.137:0/1010667588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f8143f00 0x7f58f8144390 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f58e8002f70 tx=0x7f58e8006df0).ready entity=mon.1 client_cookie=bc83cbacef553591 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:02.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f559a700 1 -- 172.21.2.137:0/1010667588 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e800d5c0 con 0x7f58f8143f00 2021-11-15T19:36:02.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f559a700 1 -- 172.21.2.137:0/1010667588 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8000e90 con 0x7f58f8143f00 2021-11-15T19:36:02.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f559a700 1 -- 172.21.2.137:0/1010667588 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e800d950 con 0x7f58f8143f00 2021-11-15T19:36:02.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/1010667588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f8143f00 msgr2=0x7f58f8144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/1010667588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f8143f00 0x7f58f8144390 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f58e8002f70 tx=0x7f58e8006df0).stop 2021-11-15T19:36:02.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/1010667588 shutdown_connections 2021-11-15T19:36:02.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/1010667588 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f8143f00 0x7f58f8144390 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:02.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/1010667588 >> v2:172.21.2.111:3300/0 conn(0x7f58f80b1340 0x7f58f8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/1010667588 >> 172.21.2.137:0/1010667588 conn(0x7f58f80b4e60 msgr2=0x7f58f80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:02.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/1010667588 shutdown_connections 2021-11-15T19:36:02.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/1010667588 wait complete. 2021-11-15T19:36:02.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 Processor -- start 2021-11-15T19:36:02.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- start start 2021-11-15T19:36:02.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 0x7f58f80ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58f80b1340 0x7f58f8097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58f8143f00 0x7f58f80982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80987d0 con 0x7f58f8143f00 2021-11-15T19:36:02.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f814ad20 con 0x7f58f80a9f50 2021-11-15T19:36:02.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f809ab40 con 0x7f58f80b1340 2021-11-15T19:36:02.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 0x7f58f80ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:02.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 0x7f58f80ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41170/0 (socket says 172.21.2.137:41170) 2021-11-15T19:36:02.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 -- 172.21.2.137:0/3666209371 learned_addr learned my addr 172.21.2.137:0/3666209371 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:02.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 -- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58f80b1340 msgr2=0x7f58f8097df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58f80b1340 0x7f58f8097df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 -- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58f8143f00 msgr2=0x7f58f80982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58f8143f00 0x7f58f80982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 -- 172.21.2.137:0/3666209371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e800b180 con 0x7f58f80a9f50 2021-11-15T19:36:02.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58f659c700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 0x7f58f80ae6f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f58e0002ef0 tx=0x7f58e0006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:02.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e0012410 con 0x7f58f80a9f50 2021-11-15T19:36:02.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0012570 con 0x7f58f80a9f50 2021-11-15T19:36:02.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f8149ed0 con 0x7f58f80a9f50 2021-11-15T19:36:02.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e00128d0 con 0x7f58f80a9f50 2021-11-15T19:36:02.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f8149c90 con 0x7f58f80a9f50 2021-11-15T19:36:02.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.726+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f814aee0 con 0x7f58f80a9f50 2021-11-15T19:36:02.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.730+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58e000f030 con 0x7f58f80a9f50 2021-11-15T19:36:02.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.730+0000 7f58ef7fe700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f58dc0536f0 0x7f58dc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.730+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f58e006b470 con 0x7f58f80a9f50 2021-11-15T19:36:02.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.730+0000 7f58f5d9b700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f58dc0536f0 0x7f58dc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:02.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.730+0000 7f58f5d9b700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f58dc0536f0 0x7f58dc055bb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f58e8002f70 tx=0x7f58e8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:02.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.730+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58e00427f0 con 0x7f58f80a9f50 2021-11-15T19:36:02.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f58f80573d0 con 0x7f58f80a9f50 2021-11-15T19:36:02.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58ef7fe700 1 -- 172.21.2.137:0/3666209371 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v42) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f58e0045e10 con 0x7f58f80a9f50 2021-11-15T19:36:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:02.853 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:36:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: "auth_dump": [ 2021-11-15T19:36:02.853 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.a", 2021-11-15T19:36:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhDMweFxAAWB3p+DLn2rA/hkt0U63RDw==", 2021-11-15T19:36:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.854 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:36:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.855 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mds.b", 2021-11-15T19:36:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhXCIeHBAAPpoE5JO6SvXqWSFelkIgEA==", 2021-11-15T19:36:02.856 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:36:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.857 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.0", 2021-11-15T19:36:02.858 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhmkgxExAAcgK9WG+ypfSqca9QkH8oWg==", 2021-11-15T19:36:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.859 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.1", 2021-11-15T19:36:02.860 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh6UkLHxAArogjpnk6hrZxDwYJjqaQ7g==", 2021-11-15T19:36:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.861 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.2", 2021-11-15T19:36:02.862 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJh8ytXKBAAt7agihcbQnGS77BOq+9hyQ==", 2021-11-15T19:36:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.863 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.3", 2021-11-15T19:36:02.864 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBhtJJhUfztNRAA8A/nXHA9NvB9lzyEZZ23hQ==", 2021-11-15T19:36:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.865 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.4", 2021-11-15T19:36:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhYhiILBAAjD0TW7md4SiGBtrY+7n65Q==", 2021-11-15T19:36:02.866 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.867 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.5", 2021-11-15T19:36:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBitJJhkNVuNhAAz9Ze03CAXeCsacwX411s7A==", 2021-11-15T19:36:02.868 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.869 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.6", 2021-11-15T19:36:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhMp55BhAAAlBVECZ/UrdJIZXIUw6AgA==", 2021-11-15T19:36:02.870 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.871 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "osd.7", 2021-11-15T19:36:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBjtJJhK27HDxAAud2GBdKYMwYSy+Kbu/2Xhw==", 2021-11-15T19:36:02.872 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.873 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.0", 2021-11-15T19:36:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhEBn/HhAA76d7SZVzv0lWTMpWjpM+Eg==", 2021-11-15T19:36:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.874 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:36:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:36:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:36:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.875 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.1", 2021-11-15T19:36:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhnFSnIRAAXb5lvOffexZjxhohaNG7KQ==", 2021-11-15T19:36:02.876 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:36:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:36:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:36:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.877 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.2", 2021-11-15T19:36:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhNpK4JBAAUQnhTxMk9EQ8fu5GzkEDag==", 2021-11-15T19:36:02.878 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow", 2021-11-15T19:36:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow r", 2021-11-15T19:36:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T19:36:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.879 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "client.admin", 2021-11-15T19:36:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBftJJhJKS/NxAAv9hYTj+9Q9xb1f/oyQbu0Q==", 2021-11-15T19:36:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.880 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:36:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr": "allow *", 2021-11-15T19:36:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow *", 2021-11-15T19:36:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.881 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.x", 2021-11-15T19:36:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhsZ9qExAAJSR3glxweMXnkdLY51x/Vg==", 2021-11-15T19:36:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.882 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:36:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:36:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:02.883 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "entity": "mgr.y", 2021-11-15T19:36:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "key": "AQBgtJJhkuOVDhAAhzSlFiHOq5jBvJkzz0VVqA==", 2021-11-15T19:36:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "caps": { 2021-11-15T19:36:02.884 INFO:teuthology.orchestra.run.gibba037.stdout: "mds": "allow *", 2021-11-15T19:36:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: "mon": "allow profile mgr", 2021-11-15T19:36:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": "allow *" 2021-11-15T19:36:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:02.885 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:02.886 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:36:02.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f58dc0536f0 msgr2=0x7f58dc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f58dc0536f0 0x7f58dc055bb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f58e8002f70 tx=0x7f58e8014000).stop 2021-11-15T19:36:02.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 msgr2=0x7f58f80ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 0x7f58f80ae6f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f58e0002ef0 tx=0x7f58e0006d50).stop 2021-11-15T19:36:02.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 shutdown_connections 2021-11-15T19:36:02.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f58dc0536f0 0x7f58dc055bb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:02.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f58f8143f00 0x7f58f80982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f58f80b1340 0x7f58f8097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 --2- 172.21.2.137:0/3666209371 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f58f80a9f50 0x7f58f80ae6f0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:02.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 >> 172.21.2.137:0/3666209371 conn(0x7f58f80b4e60 msgr2=0x7f58f813e600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:02.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 shutdown_connections 2021-11-15T19:36:02.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.842+0000 7f58fc8ca700 1 -- 172.21.2.137:0/3666209371 wait complete. 2021-11-15T19:36:02.890 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:36:02.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.938+0000 7ff113da5700 1 Processor -- start 2021-11-15T19:36:02.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.938+0000 7ff113da5700 1 -- start start 2021-11-15T19:36:02.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 0x7ff10c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff10c143f00 0x7ff10c144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff10c0a9f50 0x7ff10c0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c148190 con 0x7ff10c143f00 2021-11-15T19:36:02.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c0b1720 con 0x7ff10c0a9f50 2021-11-15T19:36:02.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c147e70 con 0x7ff10c0b1340 2021-11-15T19:36:02.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff10c0a9f50 0x7ff10c0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:02.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ff10c0a9f50 0x7ff10c0aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41176/0 (socket says 172.21.2.137:41176) 2021-11-15T19:36:02.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/2682875363 learned_addr learned my addr 172.21.2.137:0/2682875363 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:02.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/2682875363 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 msgr2=0x7ff10c147980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:02.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- 172.21.2.137:0/2682875363 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 0x7ff10c147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/2682875363 >> v2:172.21.2.111:3300/0 conn(0x7ff10c143f00 msgr2=0x7ff10c144360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:02.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- 172.21.2.137:0/2682875363 >> v2:172.21.2.111:3300/0 conn(0x7ff10c143f00 0x7ff10c144360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/2682875363 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0af800 con 0x7ff10c0a9f50 2021-11-15T19:36:02.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- 172.21.2.137:0/2682875363 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c0a9f50 0x7ff10c0aa370 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7ff1040032f0 tx=0x7ff104009290).ready entity=mon.1 client_cookie=82d98ff0278dbd23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:02.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff110b3f700 1 -- 172.21.2.137:0/2682875363 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10400b870 con 0x7ff10c0a9f50 2021-11-15T19:36:02.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff110b3f700 1 -- 172.21.2.137:0/2682875363 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400b9d0 con 0x7ff10c0a9f50 2021-11-15T19:36:02.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff110b3f700 1 -- 172.21.2.137:0/2682875363 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10400bb80 con 0x7ff10c0a9f50 2021-11-15T19:36:02.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- 172.21.2.137:0/2682875363 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c0a9f50 msgr2=0x7ff10c0aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:02.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- 172.21.2.137:0/2682875363 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c0a9f50 0x7ff10c0aa370 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7ff1040032f0 tx=0x7ff104009290).stop 2021-11-15T19:36:02.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- 172.21.2.137:0/2682875363 shutdown_connections 2021-11-15T19:36:02.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- 172.21.2.137:0/2682875363 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c0a9f50 0x7ff10c0aa370 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:02.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- 172.21.2.137:0/2682875363 >> v2:172.21.2.111:3300/0 conn(0x7ff10c143f00 0x7ff10c144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- 172.21.2.137:0/2682875363 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 0x7ff10c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- 172.21.2.137:0/2682875363 >> 172.21.2.137:0/2682875363 conn(0x7ff10c0b4e60 msgr2=0x7ff10c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:02.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- 172.21.2.137:0/2682875363 shutdown_connections 2021-11-15T19:36:02.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- 172.21.2.137:0/2682875363 wait complete. 2021-11-15T19:36:02.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 Processor -- start 2021-11-15T19:36:02.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- start start 2021-11-15T19:36:02.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff10c0a9f50 0x7ff10c097df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 0x7ff10c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 0x7ff10c148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c09a6b0 con 0x7ff10c0a9f50 2021-11-15T19:36:02.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c09a950 con 0x7ff10c143f00 2021-11-15T19:36:02.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff113da5700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c1484d0 con 0x7ff10c0b1340 2021-11-15T19:36:02.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 0x7ff10c148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:02.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 0x7ff10c148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41182/0 (socket says 172.21.2.137:41182) 2021-11-15T19:36:02.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/3773285940 learned_addr learned my addr 172.21.2.137:0/3773285940 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:02.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 msgr2=0x7ff10c0b3b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:02.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 0x7ff10c0b3b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff10c0a9f50 msgr2=0x7ff10c097df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:02.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff10c0a9f50 0x7ff10c097df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:02.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.942+0000 7ff112342700 1 -- 172.21.2.137:0/3773285940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009530 con 0x7ff10c143f00 2021-11-15T19:36:02.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff112342700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 0x7ff10c148970 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7ff1040032f0 tx=0x7ff104016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:02.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10400b870 con 0x7ff10c143f00 2021-11-15T19:36:02.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104021630 con 0x7ff10c143f00 2021-11-15T19:36:02.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c09ad20 con 0x7ff10c143f00 2021-11-15T19:36:02.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff104021990 con 0x7ff10c143f00 2021-11-15T19:36:02.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c14b310 con 0x7ff10c143f00 2021-11-15T19:36:02.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c099dd0 con 0x7ff10c143f00 2021-11-15T19:36:02.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff10400f070 con 0x7ff10c143f00 2021-11-15T19:36:02.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff0feffd700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0f40536f0 0x7ff0f4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:02.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff10406cc50 con 0x7ff10c143f00 2021-11-15T19:36:02.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff111b41700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0f40536f0 0x7ff0f4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:02.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.946+0000 7ff111b41700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0f40536f0 0x7ff0f4055bb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff108002ef0 tx=0x7ff108006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:02.968 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:02.950+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff10c099dd0 con 0x7ff10c143f00 2021-11-15T19:36:03.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff10c099dd0 con 0x7ff10c143f00 2021-11-15T19:36:03.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff0feffd700 1 -- 172.21.2.137:0/3773285940 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+13191 (secure 0 0 0) 0x7ff10c099dd0 con 0x7ff10c143f00 2021-11-15T19:36:03.042 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:03.042 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":147,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:02.614296+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:36:03.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0f40536f0 msgr2=0x7ff0f4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.043 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0f40536f0 0x7ff0f4055bb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff108002ef0 tx=0x7ff108006890).stop 2021-11-15T19:36:03.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 msgr2=0x7ff10c148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 0x7ff10c148970 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7ff1040032f0 tx=0x7ff104016000).stop 2021-11-15T19:36:03.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 shutdown_connections 2021-11-15T19:36:03.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff0f40536f0 0x7ff0f4055bb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.044 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff10c143f00 0x7ff10c148970 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff10c0b1340 0x7ff10c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 --2- 172.21.2.137:0/3773285940 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff10c0a9f50 0x7ff10c097df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 >> 172.21.2.137:0/3773285940 conn(0x7ff10c0b4e60 msgr2=0x7ff10c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.045 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 shutdown_connections 2021-11-15T19:36:03.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.030+0000 7ff113da5700 1 -- 172.21.2.137:0/3773285940 wait complete. 2021-11-15T19:36:03.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T19:36:03.050 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:36:03.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1abb4d7700 1 Processor -- start 2021-11-15T19:36:03.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1abb4d7700 1 -- start start 2021-11-15T19:36:03.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1abb4d7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab40b72e0 0x7f1ab40b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1abb4d7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40b76c0 con 0x7f1ab40acd60 2021-11-15T19:36:03.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1abb4d7700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab412a170 con 0x7f1ab40ad320 2021-11-15T19:36:03.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1abb4d7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b3100 con 0x7f1ab40b72e0 2021-11-15T19:36:03.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1ab9a74700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1ab40ad320 0x7f1ab41290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59970/0 (socket says 172.21.2.137:59970) 2021-11-15T19:36:03.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1ab9a74700 1 -- 172.21.2.137:0/995740770 learned_addr learned my addr 172.21.2.137:0/995740770 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:03.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066166367 0 0) 0x7f1ab412a170 con 0x7f1ab40ad320 2021-11-15T19:36:03.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.090+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a9c003260 con 0x7f1ab40ad320 2021-11-15T19:36:03.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335723165 0 0) 0x7f1a9c003260 con 0x7f1ab40ad320 2021-11-15T19:36:03.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab40b72e0 msgr2=0x7f1ab40b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab40b72e0 0x7f1ab40b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 >> v1:172.21.2.111:6789/0 conn(0x7f1ab40acd60 legacy=0x7f1ab40b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40ad8a0 con 0x7f1ab40ad320 2021-11-15T19:36:03.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f1aac0019e0 con 0x7f1ab40ad320 2021-11-15T19:36:03.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 >> v1:172.21.2.137:6789/0 conn(0x7f1ab40ad320 legacy=0x7f1ab41290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0037d0 0x7f1a9c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab40b72e0 0x7f1a9c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c004b40 0x7f1a9c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b3100 con 0x7f1a9c0037d0 2021-11-15T19:36:03.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c00b9b0 con 0x7f1a9c004b40 2021-11-15T19:36:03.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c00bb70 con 0x7f1ab40b72e0 2021-11-15T19:36:03.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c004b40 0x7f1a9c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 -- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab40b72e0 msgr2=0x7f1a9c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab40b72e0 0x7f1a9c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 -- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0037d0 msgr2=0x7f1a9c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c0037d0 0x7f1a9c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 -- 172.21.2.137:0/995740770 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c003260 con 0x7f1a9c004b40 2021-11-15T19:36:03.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c004b40 0x7f1a9c004fc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f1ab4065450 tx=0x7f1ab40ada30).ready entity=mon.1 client_cookie=48fc9f365e7ff92 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aac00cbe0 con 0x7f1a9c004b40 2021-11-15T19:36:03.114 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00cd40 con 0x7f1a9c004b40 2021-11-15T19:36:03.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa3fff700 1 -- 172.21.2.137:0/995740770 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aac005b80 con 0x7f1a9c004b40 2021-11-15T19:36:03.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/995740770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c004b40 msgr2=0x7f1a9c004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/995740770 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1a9c004b40 0x7f1a9c004fc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f1ab4065450 tx=0x7f1ab40ada30).stop 2021-11-15T19:36:03.115 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab9a74700 1 -- 172.21.2.137:0/995740770 reap_dead start 2021-11-15T19:36:03.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/995740770 shutdown_connections 2021-11-15T19:36:03.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/995740770 >> 172.21.2.137:0/995740770 conn(0x7f1ab4064960 msgr2=0x7f1ab4064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/995740770 shutdown_connections 2021-11-15T19:36:03.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/995740770 wait complete. 2021-11-15T19:36:03.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 Processor -- start 2021-11-15T19:36:03.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- start start 2021-11-15T19:36:03.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c004b40 0x7f1ab4155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 0x7f1ab4128160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab4151bf0 0x7f1ab4152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41552c0 con 0x7f1a9c004b40 2021-11-15T19:36:03.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4155560 con 0x7f1ab4146790 2021-11-15T19:36:03.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4155ef0 con 0x7f1ab4151bf0 2021-11-15T19:36:03.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 0x7f1ab4128160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 0x7f1ab4128160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41202/0 (socket says 172.21.2.137:41202) 2021-11-15T19:36:03.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 -- 172.21.2.137:0/3303114562 learned_addr learned my addr 172.21.2.137:0/3303114562 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:03.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 -- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab4151bf0 msgr2=0x7f1ab4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab4151bf0 0x7f1ab4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 -- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c004b40 msgr2=0x7f1ab4155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c004b40 0x7f1ab4155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 -- 172.21.2.137:0/3303114562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4128650 con 0x7f1ab4146790 2021-11-15T19:36:03.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1ab8a72700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 0x7f1ab4128160 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f1ab0000f70 tx=0x7f1ab0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab0013460 con 0x7f1ab4146790 2021-11-15T19:36:03.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00135c0 con 0x7f1ab4146790 2021-11-15T19:36:03.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab4146ef0 con 0x7f1ab4146790 2021-11-15T19:36:03.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab0013920 con 0x7f1ab4146790 2021-11-15T19:36:03.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.094+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab4141f70 con 0x7f1ab4146790 2021-11-15T19:36:03.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab4155720 con 0x7f1ab4146790 2021-11-15T19:36:03.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1ab000f070 con 0x7f1ab4146790 2021-11-15T19:36:03.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1aa27fc700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a94053610 0x7f1a94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.123 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1ab006adc0 con 0x7f1ab4146790 2021-11-15T19:36:03.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1ab9273700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a94053610 0x7f1a94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1ab9273700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a94053610 0x7f1a94055ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f1aa4002f70 tx=0x7f1aa4006a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.124 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.098+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ab0042250 con 0x7f1ab4146790 2021-11-15T19:36:03.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1ab40b3a50 con 0x7f1ab4146790 2021-11-15T19:36:03.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1aa27fc700 1 -- 172.21.2.137:0/3303114562 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v147) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1ab0045870 con 0x7f1ab4146790 2021-11-15T19:36:03.197 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:36:03.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a94053610 msgr2=0x7f1a94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a94053610 0x7f1a94055ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f1aa4002f70 tx=0x7f1aa4006a10).stop 2021-11-15T19:36:03.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 msgr2=0x7f1ab4128160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 0x7f1ab4128160 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f1ab0000f70 tx=0x7f1ab0006df0).stop 2021-11-15T19:36:03.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 shutdown_connections 2021-11-15T19:36:03.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1a94053610 0x7f1a94055ad0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1ab4151bf0 0x7f1ab4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1ab4146790 0x7f1ab4128160 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 --2- 172.21.2.137:0/3303114562 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1a9c004b40 0x7f1ab4155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 >> 172.21.2.137:0/3303114562 conn(0x7f1ab4064960 msgr2=0x7f1ab40b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 shutdown_connections 2021-11-15T19:36:03.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.186+0000 7f1abb4d7700 1 -- 172.21.2.137:0/3303114562 wait complete. 2021-11-15T19:36:03.205 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:36:03.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa256b51700 1 Processor -- start 2021-11-15T19:36:03.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa256b51700 1 -- start start 2021-11-15T19:36:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa256b51700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa2500b0fe0 0x7fa2500afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa256b51700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2500aedf0 con 0x7fa25013f5c0 2021-11-15T19:36:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa256b51700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2500afbd0 con 0x7fa2500acff0 2021-11-15T19:36:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa256b51700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500ad4a0 con 0x7fa2500b0fe0 2021-11-15T19:36:03.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fa2500acff0 0x7fa2500af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:59990/0 (socket says 172.21.2.137:59990) 2021-11-15T19:36:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24ffff700 1 -- 172.21.2.137:0/711770544 learned_addr learned my addr 172.21.2.137:0/711770544 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa2548ed700 1 --2- 172.21.2.137:0/711770544 >> v2:172.21.2.111:3300/0 conn(0x7fa2500b0fe0 0x7fa2500afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115880419 0 0) 0x7fa2500afbd0 con 0x7fa2500acff0 2021-11-15T19:36:03.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa230003260 con 0x7fa2500acff0 2021-11-15T19:36:03.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803713132 0 0) 0x7fa230003260 con 0x7fa2500acff0 2021-11-15T19:36:03.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 >> v2:172.21.2.111:3300/0 conn(0x7fa2500b0fe0 msgr2=0x7fa2500afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 --2- 172.21.2.137:0/711770544 >> v2:172.21.2.111:3300/0 conn(0x7fa2500b0fe0 0x7fa2500afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 >> v1:172.21.2.111:6789/0 conn(0x7fa25013f5c0 legacy=0x7fa25013c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500b13c0 con 0x7fa2500acff0 2021-11-15T19:36:03.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fa238001660 con 0x7fa2500acff0 2021-11-15T19:36:03.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 >> v1:172.21.2.137:6789/0 conn(0x7fa2500acff0 legacy=0x7fa2500af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa230003820 0x7fa230003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.266 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230004500 0x7fa230004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa230004f90 0x7fa23000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000be50 con 0x7fa230004f90 2021-11-15T19:36:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000bfc0 con 0x7fa230003820 2021-11-15T19:36:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000c180 con 0x7fa230004500 2021-11-15T19:36:03.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.246+0000 7fa2548ed700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa230003820 0x7fa230003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2548ed700 1 -- 172.21.2.137:0/711770544 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230004500 msgr2=0x7fa230004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2548ed700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230004500 0x7fa230004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2548ed700 1 -- 172.21.2.137:0/711770544 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa230004f90 msgr2=0x7fa23000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2548ed700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa230004f90 0x7fa23000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2548ed700 1 -- 172.21.2.137:0/711770544 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230003260 con 0x7fa230003820 2021-11-15T19:36:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2550ee700 1 -- 172.21.2.137:0/711770544 reap_dead start 2021-11-15T19:36:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa2548ed700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa230003820 0x7fa230003c40 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fa24000a000 tx=0x7fa240008040).ready entity=mon.1 client_cookie=97dba9a34d501b13 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa240013670 con 0x7fa230003820 2021-11-15T19:36:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400137d0 con 0x7fa230003820 2021-11-15T19:36:03.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24f7fe700 1 -- 172.21.2.137:0/711770544 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa240013b30 con 0x7fa230003820 2021-11-15T19:36:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/711770544 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa230003820 msgr2=0x7fa230003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa230003820 0x7fa230003c40 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fa24000a000 tx=0x7fa240008040).stop 2021-11-15T19:36:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/711770544 shutdown_connections 2021-11-15T19:36:03.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 --2- 172.21.2.137:0/711770544 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa230003820 0x7fa230003c40 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/711770544 >> 172.21.2.137:0/711770544 conn(0x7fa2500b5f50 msgr2=0x7fa2500b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/711770544 shutdown_connections 2021-11-15T19:36:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/711770544 wait complete. 2021-11-15T19:36:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 Processor -- start 2021-11-15T19:36:03.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- start start 2021-11-15T19:36:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230003820 0x7fa250151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 0x7fa250148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa250143560 0x7fa250066f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250152e60 con 0x7fa250143560 2021-11-15T19:36:03.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250063ef0 con 0x7fa2500652c0 2021-11-15T19:36:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500639b0 con 0x7fa230003820 2021-11-15T19:36:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 0x7fa250148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 0x7fa250148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41218/0 (socket says 172.21.2.137:41218) 2021-11-15T19:36:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 -- 172.21.2.137:0/3542445144 learned_addr learned my addr 172.21.2.137:0/3542445144 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:03.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 -- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230003820 msgr2=0x7fa250151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230003820 0x7fa250151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 -- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa250143560 msgr2=0x7fa250066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa250143560 0x7fa250066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 -- 172.21.2.137:0/3542445144 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250063c50 con 0x7fa2500652c0 2021-11-15T19:36:03.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24ffff700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 0x7fa250148760 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fa238001370 tx=0x7fa238001a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238007170 con 0x7fa2500652c0 2021-11-15T19:36:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380072d0 con 0x7fa2500652c0 2021-11-15T19:36:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa250067430 con 0x7fa2500652c0 2021-11-15T19:36:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238004920 con 0x7fa2500652c0 2021-11-15T19:36:03.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.250+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa250067930 con 0x7fa2500652c0 2021-11-15T19:36:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa250066c30 con 0x7fa2500652c0 2021-11-15T19:36:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa238004a80 con 0x7fa2500652c0 2021-11-15T19:36:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa24dffb700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa234053640 0x7fa234055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa23806b2a0 con 0x7fa2500652c0 2021-11-15T19:36:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa2548ed700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa234053640 0x7fa234055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa2548ed700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa234053640 0x7fa234055b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa24000a000 tx=0x7fa240008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.254+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa238042730 con 0x7fa2500652c0 2021-11-15T19:36:03.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2500573d0 con 0x7fa2500652c0 2021-11-15T19:36:03.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa24dffb700 1 -- 172.21.2.137:0/3542445144 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa238045d50 con 0x7fa2500652c0 2021-11-15T19:36:03.351 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:03.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa234053640 msgr2=0x7fa234055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa234053640 0x7fa234055b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa24000a000 tx=0x7fa240008040).stop 2021-11-15T19:36:03.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 msgr2=0x7fa250148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 0x7fa250148760 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fa238001370 tx=0x7fa238001a90).stop 2021-11-15T19:36:03.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 shutdown_connections 2021-11-15T19:36:03.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa234053640 0x7fa234055b00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa250143560 0x7fa250066f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa2500652c0 0x7fa250148760 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 --2- 172.21.2.137:0/3542445144 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa230003820 0x7fa250151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.338+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 >> 172.21.2.137:0/3542445144 conn(0x7fa2500b5f50 msgr2=0x7fa2500b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.342+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 shutdown_connections 2021-11-15T19:36:03.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.342+0000 7fa256b51700 1 -- 172.21.2.137:0/3542445144 wait complete. 2021-11-15T19:36:03.358 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T19:36:03.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 Processor -- start 2021-11-15T19:36:03.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- start start 2021-11-15T19:36:03.413 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffa980608f0 0x7ffa9813f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa9805f730 0x7ffa9805fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa980b1af0 con 0x7ffa980b1660 2021-11-15T19:36:03.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa980ad6c0 con 0x7ffa980608f0 2021-11-15T19:36:03.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98060070 con 0x7ffa9805f730 2021-11-15T19:36:03.414 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa967fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ffa980b1660 0x7ffa980b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60008/0 (socket says 172.21.2.137:60008) 2021-11-15T19:36:03.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa967fc700 1 -- 172.21.2.137:0/428065695 learned_addr learned my addr 172.21.2.137:0/428065695 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:03.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa96ffd700 1 --2- 172.21.2.137:0/428065695 >> v2:172.21.2.137:3300/0 conn(0x7ffa980608f0 0x7ffa9813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa96ffd700 1 -- 172.21.2.137:0/428065695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa9805f730 msgr2=0x7ffa9805fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa96ffd700 1 --2- 172.21.2.137:0/428065695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa9805f730 0x7ffa9805fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa96ffd700 1 -- 172.21.2.137:0/428065695 >> v1:172.21.2.137:6789/0 conn(0x7ffa980b1660 legacy=0x7ffa980b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa96ffd700 1 -- 172.21.2.137:0/428065695 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980b0c80 con 0x7ffa980608f0 2021-11-15T19:36:03.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa96ffd700 1 --2- 172.21.2.137:0/428065695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980608f0 0x7ffa9813f890 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ffa80002f70 tx=0x7ffa80006df0).ready entity=mon.1 client_cookie=3735de160638304a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa95ffb700 1 -- 172.21.2.137:0/428065695 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa8000f970 con 0x7ffa980608f0 2021-11-15T19:36:03.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa95ffb700 1 -- 172.21.2.137:0/428065695 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80000e90 con 0x7ffa980608f0 2021-11-15T19:36:03.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa95ffb700 1 -- 172.21.2.137:0/428065695 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa8000fcc0 con 0x7ffa980608f0 2021-11-15T19:36:03.419 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/428065695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980608f0 msgr2=0x7ffa9813f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/428065695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980608f0 0x7ffa9813f890 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ffa80002f70 tx=0x7ffa80006df0).stop 2021-11-15T19:36:03.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/428065695 shutdown_connections 2021-11-15T19:36:03.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/428065695 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa9805f730 0x7ffa9805fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/428065695 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980608f0 0x7ffa9813f890 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.420 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/428065695 >> 172.21.2.137:0/428065695 conn(0x7ffa98063980 msgr2=0x7ffa98063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/428065695 shutdown_connections 2021-11-15T19:36:03.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/428065695 wait complete. 2021-11-15T19:36:03.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 Processor -- start 2021-11-15T19:36:03.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- start start 2021-11-15T19:36:03.421 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa9805f730 0x7ffa9813a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa980608f0 0x7ffa981268e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 0x7ffa98126dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98140d60 con 0x7ffa9805f730 2021-11-15T19:36:03.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9813acd0 con 0x7ffa980b1660 2021-11-15T19:36:03.422 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa9d2c0700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa981435f0 con 0x7ffa980608f0 2021-11-15T19:36:03.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 0x7ffa98126dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 0x7ffa98126dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41230/0 (socket says 172.21.2.137:41230) 2021-11-15T19:36:03.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 -- 172.21.2.137:0/1889581987 learned_addr learned my addr 172.21.2.137:0/1889581987 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:03.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 -- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa980608f0 msgr2=0x7ffa981268e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:03.423 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa980608f0 0x7ffa981268e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 -- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa9805f730 msgr2=0x7ffa9813a2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:03.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa9805f730 0x7ffa9813a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.402+0000 7ffa977fe700 1 -- 172.21.2.137:0/1889581987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8000b180 con 0x7ffa980b1660 2021-11-15T19:36:03.424 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa977fe700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 0x7ffa98126dd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7ffa9813ed00 tx=0x7ffa900091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa9000d4a0 con 0x7ffa980b1660 2021-11-15T19:36:03.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000d600 con 0x7ffa980b1660 2021-11-15T19:36:03.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa98143890 con 0x7ffa980b1660 2021-11-15T19:36:03.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa9000d960 con 0x7ffa980b1660 2021-11-15T19:36:03.425 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9813a930 con 0x7ffa980b1660 2021-11-15T19:36:03.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa98143a20 con 0x7ffa980b1660 2021-11-15T19:36:03.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa90018030 con 0x7ffa980b1660 2021-11-15T19:36:03.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa7c053580 0x7ffa7c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ffa9006af40 con 0x7ffa980b1660 2021-11-15T19:36:03.426 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa96ffd700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa7c053580 0x7ffa7c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa96ffd700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa7c053580 0x7ffa7c055a40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7ffa80002f70 tx=0x7ffa80017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.427 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.406+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa90042420 con 0x7ffa980b1660 2021-11-15T19:36:03.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa980b0f20 con 0x7ffa980b1660 2021-11-15T19:36:03.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa8ffff700 1 -- 172.21.2.137:0/1889581987 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+143 (secure 0 0 0) 0x7ffa90045a40 con 0x7ffa980b1660 2021-11-15T19:36:03.505 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:03.505 INFO:teuthology.orchestra.run.gibba037.stdout:[ 2021-11-15T19:36:03.505 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:03.505 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 1, 2021-11-15T19:36:03.505 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "device_health_metrics" 2021-11-15T19:36:03.506 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:03.506 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:03.506 INFO:teuthology.orchestra.run.gibba037.stdout: "poolnum": 2, 2021-11-15T19:36:03.506 INFO:teuthology.orchestra.run.gibba037.stdout: "poolname": "rbd" 2021-11-15T19:36:03.507 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:03.507 INFO:teuthology.orchestra.run.gibba037.stdout:] 2021-11-15T19:36:03.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa7c053580 msgr2=0x7ffa7c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa7c053580 0x7ffa7c055a40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7ffa80002f70 tx=0x7ffa80017000).stop 2021-11-15T19:36:03.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 msgr2=0x7ffa98126dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 0x7ffa98126dd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7ffa9813ed00 tx=0x7ffa900091a0).stop 2021-11-15T19:36:03.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 shutdown_connections 2021-11-15T19:36:03.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffa7c053580 0x7ffa7c055a40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffa980b1660 0x7ffa98126dd0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffa980608f0 0x7ffa981268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 --2- 172.21.2.137:0/1889581987 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffa9805f730 0x7ffa9813a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:03.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 >> 172.21.2.137:0/1889581987 conn(0x7ffa98063980 msgr2=0x7ffa9805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 shutdown_connections 2021-11-15T19:36:03.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.494+0000 7ffa9d2c0700 1 -- 172.21.2.137:0/1889581987 wait complete. 2021-11-15T19:36:03.512 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T19:36:03.512 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T19:36:03.564 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 Processor -- start 2021-11-15T19:36:03.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- start start 2021-11-15T19:36:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb0c80b2520 0x7fb0c813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c81402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80b6d40 con 0x7fb0c80b6960 2021-11-15T19:36:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c80b0e50 con 0x7fb0c80b2520 2021-11-15T19:36:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80b10f0 con 0x7fb0c8064e80 2021-11-15T19:36:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cd4f0700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7fb0c80b6960 0x7fb0c8142d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52512/0 (socket says 172.21.2.137:52512) 2021-11-15T19:36:03.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cccef700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb0c80b2520 0x7fb0c813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cd4f0700 1 -- 172.21.2.137:0/963462991 learned_addr learned my addr 172.21.2.137:0/963462991 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:03.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cdcf1700 1 --2- 172.21.2.137:0/963462991 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c81402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cccef700 1 -- 172.21.2.137:0/963462991 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 msgr2=0x7fb0c81402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:03.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cccef700 1 --2- 172.21.2.137:0/963462991 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c81402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cccef700 1 -- 172.21.2.137:0/963462991 >> v1:172.21.2.111:6789/0 conn(0x7fb0c80b6960 legacy=0x7fb0c8142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cccef700 1 -- 172.21.2.137:0/963462991 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c813f940 con 0x7fb0c80b2520 2021-11-15T19:36:03.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cccef700 1 --2- 172.21.2.137:0/963462991 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b2520 0x7fb0c813fde0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fb0b8002f70 tx=0x7fb0b8006df0).ready entity=mon.1 client_cookie=1588cbc439d0cc0b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0b7fff700 1 -- 172.21.2.137:0/963462991 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0b800d570 con 0x7fb0c80b2520 2021-11-15T19:36:03.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0b7fff700 1 -- 172.21.2.137:0/963462991 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8000e90 con 0x7fb0c80b2520 2021-11-15T19:36:03.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0b7fff700 1 -- 172.21.2.137:0/963462991 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0b800d8c0 con 0x7fb0c80b2520 2021-11-15T19:36:03.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- 172.21.2.137:0/963462991 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b2520 msgr2=0x7fb0c813fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 --2- 172.21.2.137:0/963462991 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b2520 0x7fb0c813fde0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fb0b8002f70 tx=0x7fb0b8006df0).stop 2021-11-15T19:36:03.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- 172.21.2.137:0/963462991 shutdown_connections 2021-11-15T19:36:03.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 --2- 172.21.2.137:0/963462991 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c81402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 --2- 172.21.2.137:0/963462991 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b2520 0x7fb0c813fde0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- 172.21.2.137:0/963462991 >> 172.21.2.137:0/963462991 conn(0x7fb0c8064420 msgr2=0x7fb0c80b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:03.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- 172.21.2.137:0/963462991 shutdown_connections 2021-11-15T19:36:03.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 -- 172.21.2.137:0/963462991 wait complete. 2021-11-15T19:36:03.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.554+0000 7fb0cf754700 1 Processor -- start 2021-11-15T19:36:03.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- start start 2021-11-15T19:36:03.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb0c80b2520 0x7fb0c81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 0x7fb0c8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8113460 con 0x7fb0c80b2520 2021-11-15T19:36:03.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8113700 con 0x7fb0c80b6960 2021-11-15T19:36:03.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c81139a0 con 0x7fb0c8064e80 2021-11-15T19:36:03.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 0x7fb0c8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 0x7fb0c8152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41248/0 (socket says 172.21.2.137:41248) 2021-11-15T19:36:03.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 -- 172.21.2.137:0/4159885217 learned_addr learned my addr 172.21.2.137:0/4159885217 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:03.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cccef700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb0c80b2520 0x7fb0c81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cd4f0700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 -- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 msgr2=0x7fb0c810fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c810fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 -- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb0c80b2520 msgr2=0x7fb0c81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:03.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb0c80b2520 0x7fb0c81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:03.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 -- 172.21.2.137:0/4159885217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b800b180 con 0x7fb0c80b6960 2021-11-15T19:36:03.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cccef700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb0c80b2520 0x7fb0c81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:36:03.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cdcf1700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 0x7fb0c8152dc0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fb0c400c000 tx=0x7fb0c4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0c4011750 con 0x7fb0c80b6960 2021-11-15T19:36:03.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c40118b0 con 0x7fb0c80b6960 2021-11-15T19:36:03.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c8111dc0 con 0x7fb0c80b6960 2021-11-15T19:36:03.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0c4011c10 con 0x7fb0c80b6960 2021-11-15T19:36:03.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c8110080 con 0x7fb0c80b6960 2021-11-15T19:36:03.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c81132b0 con 0x7fb0c80b6960 2021-11-15T19:36:03.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0c4011d70 con 0x7fb0c80b6960 2021-11-15T19:36:03.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0b67fc700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb0a8053580 0x7fb0a8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:03.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb0c406b960 con 0x7fb0c80b6960 2021-11-15T19:36:03.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cd4f0700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb0a8053580 0x7fb0a8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:03.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.558+0000 7fb0cd4f0700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb0a8053580 0x7fb0a8055a40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fb0c000d000 tx=0x7fb0c0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:03.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.562+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0c4042df0 con 0x7fb0c80b6960 2021-11-15T19:36:03.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:03.642+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fb0c80573d0 con 0x7fb0c80b6960 2021-11-15T19:36:04.580 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0b67fc700 1 -- 172.21.2.137:0/4159885217 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v148) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb0c4046410 con 0x7fb0c80b6960 2021-11-15T19:36:04.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb0a8053580 msgr2=0x7fb0a8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:04.581 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb0a8053580 0x7fb0a8055a40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fb0c000d000 tx=0x7fb0c0009040).stop 2021-11-15T19:36:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 msgr2=0x7fb0c8152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 0x7fb0c8152dc0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fb0c400c000 tx=0x7fb0c4006df0).stop 2021-11-15T19:36:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 shutdown_connections 2021-11-15T19:36:04.582 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb0a8053580 0x7fb0a8055a40 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb0c80b6960 0x7fb0c8152dc0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb0c80b2520 0x7fb0c81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 --2- 172.21.2.137:0/4159885217 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb0c8064e80 0x7fb0c810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:04.583 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 >> 172.21.2.137:0/4159885217 conn(0x7fb0c8064420 msgr2=0x7fb0c8066fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:04.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 shutdown_connections 2021-11-15T19:36:04.584 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.570+0000 7fb0cf754700 1 -- 172.21.2.137:0/4159885217 wait complete. 2021-11-15T19:36:04.584 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' created 2021-11-15T19:36:04.588 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T19:36:04.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 Processor -- start 2021-11-15T19:36:04.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- start start 2021-11-15T19:36:04.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4a005c770 0x7fe4a00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:04.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 0x7fe4a014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:04.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a005cb50 con 0x7fe4a014aaa0 2021-11-15T19:36:04.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a00b1650 con 0x7fe4a005c770 2021-11-15T19:36:04.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00ad030 con 0x7fe4a00b0550 2021-11-15T19:36:04.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4a005c770 0x7fe4a00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:04.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4a005c770 0x7fe4a00aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41252/0 (socket says 172.21.2.137:41252) 2021-11-15T19:36:04.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 -- 172.21.2.137:0/347665602 learned_addr learned my addr 172.21.2.137:0/347665602 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:04.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 -- 172.21.2.137:0/347665602 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 msgr2=0x7fe4a014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:04.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 --2- 172.21.2.137:0/347665602 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 0x7fe4a014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:04.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 -- 172.21.2.137:0/347665602 >> v1:172.21.2.111:6789/0 conn(0x7fe4a014aaa0 legacy=0x7fe4a0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:04.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 -- 172.21.2.137:0/347665602 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00ad2d0 con 0x7fe4a005c770 2021-11-15T19:36:04.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a5e76700 1 --2- 172.21.2.137:0/347665602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a00aef30 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fe4a00adfd0 tx=0x7fe49c006eb0).ready entity=mon.1 client_cookie=56f165ea28efd511 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:04.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a4e74700 1 -- 172.21.2.137:0/347665602 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49c00d570 con 0x7fe4a005c770 2021-11-15T19:36:04.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a4e74700 1 -- 172.21.2.137:0/347665602 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c000e90 con 0x7fe4a005c770 2021-11-15T19:36:04.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a4e74700 1 -- 172.21.2.137:0/347665602 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49c00d8c0 con 0x7fe4a005c770 2021-11-15T19:36:04.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- 172.21.2.137:0/347665602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 msgr2=0x7fe4a00aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:04.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 --2- 172.21.2.137:0/347665602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a00aef30 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fe4a00adfd0 tx=0x7fe49c006eb0).stop 2021-11-15T19:36:04.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- 172.21.2.137:0/347665602 shutdown_connections 2021-11-15T19:36:04.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 --2- 172.21.2.137:0/347665602 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 0x7fe4a014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:04.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 --2- 172.21.2.137:0/347665602 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a00aef30 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:04.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- 172.21.2.137:0/347665602 >> 172.21.2.137:0/347665602 conn(0x7fe4a00631e0 msgr2=0x7fe4a005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:04.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- 172.21.2.137:0/347665602 shutdown_connections 2021-11-15T19:36:04.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.630+0000 7fe4a80da700 1 -- 172.21.2.137:0/347665602 wait complete. 2021-11-15T19:36:04.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 Processor -- start 2021-11-15T19:36:04.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- start start 2021-11-15T19:36:04.649 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a0149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:04.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 0x7fe4a013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:04.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4a014aaa0 0x7fe4a013f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:04.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0063ba0 con 0x7fe4a014aaa0 2021-11-15T19:36:04.650 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01474a0 con 0x7fe4a005c770 2021-11-15T19:36:04.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a013f990 con 0x7fe4a00b0550 2021-11-15T19:36:04.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a0149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:04.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a0149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41260/0 (socket says 172.21.2.137:41260) 2021-11-15T19:36:04.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 -- 172.21.2.137:0/842825064 learned_addr learned my addr 172.21.2.137:0/842825064 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:04.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 -- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 msgr2=0x7fe4a013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:04.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 0x7fe4a013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:04.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 -- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4a014aaa0 msgr2=0x7fe4a013f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:04.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4a014aaa0 0x7fe4a013f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:04.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 -- 172.21.2.137:0/842825064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c00b1e0 con 0x7fe4a005c770 2021-11-15T19:36:04.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5e76700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a0149e50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fe4a00adfd0 tx=0x7fe49c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:04.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49c002f70 con 0x7fe4a005c770 2021-11-15T19:36:04.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c006b80 con 0x7fe4a005c770 2021-11-15T19:36:04.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a0147940 con 0x7fe4a005c770 2021-11-15T19:36:04.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49c00de20 con 0x7fe4a005c770 2021-11-15T19:36:04.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a0064dc0 con 0x7fe4a005c770 2021-11-15T19:36:04.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a00ae7f0 con 0x7fe4a005c770 2021-11-15T19:36:04.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe49c025030 con 0x7fe4a005c770 2021-11-15T19:36:04.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe48effd700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe480053610 0x7fe480055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:04.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5603+0+0 (secure 0 0 0) 0x7fe49c06cb70 con 0x7fe4a005c770 2021-11-15T19:36:04.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.634+0000 7fe4a5675700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe480053610 0x7fe480055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:04.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.638+0000 7fe4a5675700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe480053610 0x7fe480055ad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe490002f70 tx=0x7fe490006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:04.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.638+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe49c043d90 con 0x7fe4a005c770 2021-11-15T19:36:04.732 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:04.722+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fe4a00573d0 con 0x7fe4a005c770 2021-11-15T19:36:05.586 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.574+0000 7fe48effd700 1 -- 172.21.2.137:0/842825064 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v149) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe49c023020 con 0x7fe4a005c770 2021-11-15T19:36:05.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe480053610 msgr2=0x7fe480055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.588 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe480053610 0x7fe480055ad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe490002f70 tx=0x7fe490006a80).stop 2021-11-15T19:36:05.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 msgr2=0x7fe4a0149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a0149e50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fe4a00adfd0 tx=0x7fe49c015000).stop 2021-11-15T19:36:05.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 shutdown_connections 2021-11-15T19:36:05.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe480053610 0x7fe480055ad0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4a014aaa0 0x7fe4a013f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4a00b0550 0x7fe4a013efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 --2- 172.21.2.137:0/842825064 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4a005c770 0x7fe4a0149e50 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 >> 172.21.2.137:0/842825064 conn(0x7fe4a00631e0 msgr2=0x7fe4a0140cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:05.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 shutdown_connections 2021-11-15T19:36:05.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.578+0000 7fe4a80da700 1 -- 172.21.2.137:0/842825064 wait complete. 2021-11-15T19:36:05.591 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' created 2021-11-15T19:36:05.594 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T19:36:05.647 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.634+0000 7f779b118700 1 Processor -- start 2021-11-15T19:36:05.648 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.634+0000 7f779b118700 1 -- start start 2021-11-15T19:36:05.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f779405fd20 0x7f77940af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f77940b0830 0x7f77940aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7794147f70 con 0x7f77940b10b0 2021-11-15T19:36:05.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7794060100 con 0x7f77940b0830 2021-11-15T19:36:05.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7794147cd0 con 0x7f779405fd20 2021-11-15T19:36:05.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7793fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f77940b10b0 0x7f77940b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60048/0 (socket says 172.21.2.137:60048) 2021-11-15T19:36:05.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7793fff700 1 -- 172.21.2.137:0/664374550 learned_addr learned my addr 172.21.2.137:0/664374550 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:05.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718985711 0 0) 0x7f7794147f70 con 0x7f77940b10b0 2021-11-15T19:36:05.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7774003260 con 0x7f77940b10b0 2021-11-15T19:36:05.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3521588305 0 0) 0x7f7774003260 con 0x7f77940b10b0 2021-11-15T19:36:05.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f779405fd20 msgr2=0x7f77940af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:05.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f779405fd20 0x7f77940af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 >> v2:172.21.2.111:3300/0 conn(0x7f77940b0830 msgr2=0x7f77940aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:05.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 --2- 172.21.2.137:0/664374550 >> v2:172.21.2.111:3300/0 conn(0x7f77940b0830 0x7f77940aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940a9ed0 con 0x7f77940b10b0 2021-11-15T19:36:05.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7784001660 con 0x7f77940b10b0 2021-11-15T19:36:05.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 >> v1:172.21.2.137:6789/0 conn(0x7f77940b10b0 legacy=0x7f77940b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f7774003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7774004500 0x7f7774004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7774005020 0x7f777400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7794060100 con 0x7f7774004500 2021-11-15T19:36:05.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7794147cd0 con 0x7f77740037d0 2021-11-15T19:36:05.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777400bf00 con 0x7f7774005020 2021-11-15T19:36:05.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f7774003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7793fff700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7774004500 0x7f7774004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77996b5700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7774005020 0x7f777400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7774005020 msgr2=0x7f777400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:05.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7774005020 0x7f777400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7774004500 msgr2=0x7f7774004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:05.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7774004500 0x7f7774004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/664374550 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774003260 con 0x7f77740037d0 2021-11-15T19:36:05.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7793fff700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7774004500 0x7f7774004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:05.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77996b5700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7774005020 0x7f777400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:05.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f7774003bf0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f777c002f70 tx=0x7f777c006bf0).ready entity=mon.1 client_cookie=8909f30fb44619a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:05.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777c012450 con 0x7f77740037d0 2021-11-15T19:36:05.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c0125b0 con 0x7f77740037d0 2021-11-15T19:36:05.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77937fe700 1 -- 172.21.2.137:0/664374550 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777c012910 con 0x7f77740037d0 2021-11-15T19:36:05.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- 172.21.2.137:0/664374550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 msgr2=0x7f7774003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 --2- 172.21.2.137:0/664374550 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f7774003bf0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f777c002f70 tx=0x7f777c006bf0).stop 2021-11-15T19:36:05.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f77996b5700 1 -- 172.21.2.137:0/664374550 reap_dead start 2021-11-15T19:36:05.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- 172.21.2.137:0/664374550 shutdown_connections 2021-11-15T19:36:05.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- 172.21.2.137:0/664374550 >> 172.21.2.137:0/664374550 conn(0x7f77940b4e60 msgr2=0x7f77940b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:05.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- 172.21.2.137:0/664374550 shutdown_connections 2021-11-15T19:36:05.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- 172.21.2.137:0/664374550 wait complete. 2021-11-15T19:36:05.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 Processor -- start 2021-11-15T19:36:05.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- start start 2021-11-15T19:36:05.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f77940652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77941445c0 0x7f7794062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7794156800 0x7f7794156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7794063dd0 con 0x7f77941445c0 2021-11-15T19:36:05.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7794062f40 con 0x7f77740037d0 2021-11-15T19:36:05.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f779b118700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7794063180 con 0x7f7794156800 2021-11-15T19:36:05.663 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f77940652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f77940652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41278/0 (socket says 172.21.2.137:41278) 2021-11-15T19:36:05.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/2384742611 learned_addr learned my addr 172.21.2.137:0/2384742611 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:05.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7794156800 msgr2=0x7f7794156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7794156800 0x7f7794156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.664 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77941445c0 msgr2=0x7f7794062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77941445c0 0x7f7794062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.638+0000 7f7798eb4700 1 -- 172.21.2.137:0/2384742611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794063420 con 0x7f77740037d0 2021-11-15T19:36:05.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7798eb4700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f77940652c0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f777c002f70 tx=0x7f777c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:05.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777c012450 con 0x7f77740037d0 2021-11-15T19:36:05.665 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c011e70 con 0x7f77740037d0 2021-11-15T19:36:05.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77941436e0 con 0x7f77740037d0 2021-11-15T19:36:05.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777c01e620 con 0x7f77740037d0 2021-11-15T19:36:05.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7794157170 con 0x7f77740037d0 2021-11-15T19:36:05.666 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794143870 con 0x7f77740037d0 2021-11-15T19:36:05.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f777c024020 con 0x7f77740037d0 2021-11-15T19:36:05.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77780535b0 0x7f7778055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f777c06c800 con 0x7f77740037d0 2021-11-15T19:36:05.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7793fff700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77780535b0 0x7f7778055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7793fff700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77780535b0 0x7f7778055a70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7784008000 tx=0x7f7784009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:05.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.642+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f777c043970 con 0x7f77740037d0 2021-11-15T19:36:05.765 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.754+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7794143870 con 0x7f77740037d0 2021-11-15T19:36:05.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f7791ffb700 1 -- 172.21.2.137:0/2384742611 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v78) v1 ==== 189+0+0 (secure 0 0 0) 0x7f777c046f90 con 0x7f77740037d0 2021-11-15T19:36:05.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77780535b0 msgr2=0x7f7778055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77780535b0 0x7f7778055a70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7784008000 tx=0x7f7784009040).stop 2021-11-15T19:36:05.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 msgr2=0x7f77940652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f77940652c0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f777c002f70 tx=0x7f777c014000).stop 2021-11-15T19:36:05.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 shutdown_connections 2021-11-15T19:36:05.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f77780535b0 0x7f7778055a70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7794156800 0x7f7794156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f77941445c0 0x7f7794062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.783 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 --2- 172.21.2.137:0/2384742611 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f77740037d0 0x7f77940652c0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 >> 172.21.2.137:0/2384742611 conn(0x7f77940b4e60 msgr2=0x7f7794144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:05.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 shutdown_connections 2021-11-15T19:36:05.784 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.770+0000 7f779b118700 1 -- 172.21.2.137:0/2384742611 wait complete. 2021-11-15T19:36:05.784 INFO:teuthology.orchestra.run.gibba037.stderr:new fs with metadata pool 29 and data pool 30 2021-11-15T19:36:05.787 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:36:05.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 Processor -- start 2021-11-15T19:36:05.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 -- start start 2021-11-15T19:36:05.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc4c809c8c0 0x7fc4c809cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c80b3140 0x7fc4c805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc4c809ab00 0x7fc4c8143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c809d190 con 0x7fc4c809ab00 2021-11-15T19:36:05.840 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c8099790 con 0x7fc4c809c8c0 2021-11-15T19:36:05.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cf841700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b2940 con 0x7fc4c80b3140 2021-11-15T19:36:05.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc4c809c8c0 0x7fc4c809cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc4c809c8c0 0x7fc4c809cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41292/0 (socket says 172.21.2.137:41292) 2021-11-15T19:36:05.841 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 -- 172.21.2.137:0/567762404 learned_addr learned my addr 172.21.2.137:0/567762404 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:05.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 -- 172.21.2.137:0/567762404 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c80b3140 msgr2=0x7fc4c805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:05.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 --2- 172.21.2.137:0/567762404 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c80b3140 0x7fc4c805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 -- 172.21.2.137:0/567762404 >> v2:172.21.2.111:3300/0 conn(0x7fc4c809ab00 msgr2=0x7fc4c8143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:05.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 --2- 172.21.2.137:0/567762404 >> v2:172.21.2.111:3300/0 conn(0x7fc4c809ab00 0x7fc4c8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 -- 172.21.2.137:0/567762404 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8099a30 con 0x7fc4c809c8c0 2021-11-15T19:36:05.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4cd5dd700 1 --2- 172.21.2.137:0/567762404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c809c8c0 0x7fc4c809cca0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fc4c4002f70 tx=0x7fc4c4006eb0).ready entity=mon.1 client_cookie=777ca24f511a702 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:05.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4b7fff700 1 -- 172.21.2.137:0/567762404 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c400d570 con 0x7fc4c809c8c0 2021-11-15T19:36:05.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4b7fff700 1 -- 172.21.2.137:0/567762404 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4000e90 con 0x7fc4c809c8c0 2021-11-15T19:36:05.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.826+0000 7fc4b7fff700 1 -- 172.21.2.137:0/567762404 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c400d900 con 0x7fc4c809c8c0 2021-11-15T19:36:05.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/567762404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c809c8c0 msgr2=0x7fc4c809cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- 172.21.2.137:0/567762404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c809c8c0 0x7fc4c809cca0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fc4c4002f70 tx=0x7fc4c4006eb0).stop 2021-11-15T19:36:05.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/567762404 shutdown_connections 2021-11-15T19:36:05.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- 172.21.2.137:0/567762404 >> v2:172.21.2.111:3300/0 conn(0x7fc4c809ab00 0x7fc4c8143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- 172.21.2.137:0/567762404 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c80b3140 0x7fc4c805f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:05.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- 172.21.2.137:0/567762404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c809c8c0 0x7fc4c809cca0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/567762404 >> 172.21.2.137:0/567762404 conn(0x7fc4c80b45b0 msgr2=0x7fc4c805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:05.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/567762404 shutdown_connections 2021-11-15T19:36:05.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/567762404 wait complete. 2021-11-15T19:36:05.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 Processor -- start 2021-11-15T19:36:05.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- start start 2021-11-15T19:36:05.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c809ab00 0x7fc4c8140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4c809c8c0 0x7fc4c805faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 0x7fc4c813e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b6930 con 0x7fc4c809c8c0 2021-11-15T19:36:05.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b6690 con 0x7fc4c80b3140 2021-11-15T19:36:05.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8062c90 con 0x7fc4c809ab00 2021-11-15T19:36:05.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 0x7fc4c813e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 0x7fc4c813e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41302/0 (socket says 172.21.2.137:41302) 2021-11-15T19:36:05.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 -- 172.21.2.137:0/1344694383 learned_addr learned my addr 172.21.2.137:0/1344694383 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:05.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cd5dd700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c809ab00 0x7fc4c8140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4ccddc700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4c809c8c0 0x7fc4c805faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 -- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c809ab00 msgr2=0x7fc4c8140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c809ab00 0x7fc4c8140c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 -- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4c809c8c0 msgr2=0x7fc4c805faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4c809c8c0 0x7fc4c805faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 -- 172.21.2.137:0/1344694383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c400b1e0 con 0x7fc4c80b3140 2021-11-15T19:36:05.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cddde700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 0x7fc4c813e7a0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7fc4c00032f0 tx=0x7fc4c0009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:05.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c000d4a0 con 0x7fc4c80b3140 2021-11-15T19:36:05.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c000d600 con 0x7fc4c80b3140 2021-11-15T19:36:05.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c8063180 con 0x7fc4c80b3140 2021-11-15T19:36:05.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c813ec90 con 0x7fc4c80b3140 2021-11-15T19:36:05.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c000d960 con 0x7fc4c80b3140 2021-11-15T19:36:05.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c80573d0 con 0x7fc4c80b3140 2021-11-15T19:36:05.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc4c0018030 con 0x7fc4c80b3140 2021-11-15T19:36:05.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.830+0000 7fc4b67fc700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc4a80536a0 0x7fc4a8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.834+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc4c006b310 con 0x7fc4c80b3140 2021-11-15T19:36:05.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.834+0000 7fc4cd5dd700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc4a80536a0 0x7fc4a8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:05.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.834+0000 7fc4cd5dd700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc4a80536a0 0x7fc4a8055b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fc4c401c000 tx=0x7fc4c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:05.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.834+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc4c0042390 con 0x7fc4c80b3140 2021-11-15T19:36:05.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4c8062e00 con 0x7fc4c80b3140 2021-11-15T19:36:05.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4b67fc700 1 -- 172.21.2.137:0/1344694383 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fc4c0023ee0 con 0x7fc4c80b3140 2021-11-15T19:36:05.933 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:05.933 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":150,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:05.764460+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:36:03.668546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T19:36:04.747069+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:36:05.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc4a80536a0 msgr2=0x7fc4a8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc4a80536a0 0x7fc4a8055b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fc4c401c000 tx=0x7fc4c4015000).stop 2021-11-15T19:36:05.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 msgr2=0x7fc4c813e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:05.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 0x7fc4c813e7a0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7fc4c00032f0 tx=0x7fc4c0009220).stop 2021-11-15T19:36:05.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 shutdown_connections 2021-11-15T19:36:05.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc4a80536a0 0x7fc4a8055b60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4c80b3140 0x7fc4c813e7a0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4c809c8c0 0x7fc4c805faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 --2- 172.21.2.137:0/1344694383 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4c809ab00 0x7fc4c8140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:05.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 >> 172.21.2.137:0/1344694383 conn(0x7fc4c80b45b0 msgr2=0x7fc4c81450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:05.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 shutdown_connections 2021-11-15T19:36:05.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.922+0000 7fc4cf841700 1 -- 172.21.2.137:0/1344694383 wait complete. 2021-11-15T19:36:05.940 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:36:05.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.978+0000 7ff64453c700 1 Processor -- start 2021-11-15T19:36:05.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.978+0000 7ff64453c700 1 -- start start 2021-11-15T19:36:05.997 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 0x7ff63c142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:05.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c0b63b0 con 0x7ff63c0b6830 2021-11-15T19:36:05.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c147070 con 0x7ff63c0b5fd0 2021-11-15T19:36:05.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c146dd0 con 0x7ff63c13ce00 2021-11-15T19:36:05.998 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff63c0b5fd0 0x7ff63c13c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60090/0 (socket says 172.21.2.137:60090) 2021-11-15T19:36:05.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 -- 172.21.2.137:0/871982190 learned_addr learned my addr 172.21.2.137:0/871982190 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:05.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611223529 0 0) 0x7ff63c147070 con 0x7ff63c0b5fd0 2021-11-15T19:36:05.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff624003260 con 0x7ff63c0b5fd0 2021-11-15T19:36:05.999 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff641ad7700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 0x7ff63c142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201746695 0 0) 0x7ff624003260 con 0x7ff63c0b5fd0 2021-11-15T19:36:06.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 msgr2=0x7ff63c142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:06.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 0x7ff63c142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 >> v1:172.21.2.111:6789/0 conn(0x7ff63c0b6830 legacy=0x7ff63c1433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:06.000 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c143ad0 con 0x7ff63c0b5fd0 2021-11-15T19:36:06.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff6380016b0 con 0x7ff63c0b5fd0 2021-11-15T19:36:06.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 >> v1:172.21.2.137:6789/0 conn(0x7ff63c0b5fd0 legacy=0x7ff63c13c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff624003750 0x7ff624003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.001 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 0x7ff624004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6240049f0 0x7ff624004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c146dd0 con 0x7ff6240049f0 2021-11-15T19:36:06.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400b800 con 0x7ff624003750 2021-11-15T19:36:06.002 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400b9c0 con 0x7ff63c13ce00 2021-11-15T19:36:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff624003750 0x7ff624003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 -- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 msgr2=0x7ff624004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff63c13ce00 0x7ff624004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 -- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6240049f0 msgr2=0x7ff624004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:06.003 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff6240049f0 0x7ff624004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 -- 172.21.2.137:0/871982190 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624003260 con 0x7ff624003750 2021-11-15T19:36:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6422d8700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff624003750 0x7ff624003b50 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7ff624004470 tx=0x7ff63800c3c0).ready entity=mon.1 client_cookie=4ff784b746779c2b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6380070d0 con 0x7ff624003750 2021-11-15T19:36:06.004 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638007230 con 0x7ff624003750 2021-11-15T19:36:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff6412d6700 1 -- 172.21.2.137:0/871982190 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff63800c920 con 0x7ff624003750 2021-11-15T19:36:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- 172.21.2.137:0/871982190 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff624003750 msgr2=0x7ff624003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 --2- 172.21.2.137:0/871982190 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff624003750 0x7ff624003b50 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7ff624004470 tx=0x7ff63800c3c0).stop 2021-11-15T19:36:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff642ad9700 1 -- 172.21.2.137:0/871982190 reap_dead start 2021-11-15T19:36:06.005 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- 172.21.2.137:0/871982190 shutdown_connections 2021-11-15T19:36:06.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- 172.21.2.137:0/871982190 >> 172.21.2.137:0/871982190 conn(0x7ff63c0624b0 msgr2=0x7ff63c062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:06.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- 172.21.2.137:0/871982190 shutdown_connections 2021-11-15T19:36:06.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- 172.21.2.137:0/871982190 wait complete. 2021-11-15T19:36:06.006 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 Processor -- start 2021-11-15T19:36:06.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 -- start start 2021-11-15T19:36:06.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.982+0000 7ff64453c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff624003750 0x7ff63c13d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff63c13f3b0 0x7ff63c13f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.007 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 0x7ff63c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c13fd00 con 0x7ff63c13f3b0 2021-11-15T19:36:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c141be0 con 0x7ff63c1556f0 2021-11-15T19:36:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c13ec60 con 0x7ff624003750 2021-11-15T19:36:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 0x7ff63c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.008 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 0x7ff63c155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41322/0 (socket says 172.21.2.137:41322) 2021-11-15T19:36:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 -- 172.21.2.137:0/96220532 learned_addr learned my addr 172.21.2.137:0/96220532 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff641ad7700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff63c13f3b0 0x7ff63c13f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff6422d8700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff624003750 0x7ff63c13d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.009 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 -- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff624003750 msgr2=0x7ff63c13d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff624003750 0x7ff63c13d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 -- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff63c13f3b0 msgr2=0x7ff63c13f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff63c13f3b0 0x7ff63c13f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.010 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 -- 172.21.2.137:0/96220532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c13e9c0 con 0x7ff63c1556f0 2021-11-15T19:36:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff6422d8700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff624003750 0x7ff63c13d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff642ad9700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 0x7ff63c155b70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7ff6380013c0 tx=0x7ff634007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff634005880 con 0x7ff63c1556f0 2021-11-15T19:36:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6340059e0 con 0x7ff63c1556f0 2021-11-15T19:36:06.011 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c1420d0 con 0x7ff63c1556f0 2021-11-15T19:36:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff634005d80 con 0x7ff63c1556f0 2021-11-15T19:36:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c13dae0 con 0x7ff63c1556f0 2021-11-15T19:36:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c141a40 con 0x7ff63c1556f0 2021-11-15T19:36:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff634010070 con 0x7ff63c1556f0 2021-11-15T19:36:06.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff62b7fe700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff61c0536f0 0x7ff61c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff63406afc0 con 0x7ff63c1556f0 2021-11-15T19:36:06.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff6422d8700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff61c0536f0 0x7ff61c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.986+0000 7ff6422d8700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff61c0536f0 0x7ff61c055bb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ff638016000 tx=0x7ff638015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:06.014 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:05.990+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff63c141a40 con 0x7ff63c1556f0 2021-11-15T19:36:06.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff63c141a40 con 0x7ff63c1556f0 2021-11-15T19:36:06.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff62b7fe700 1 -- 172.21.2.137:0/96220532 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16065 (secure 0 0 0) 0x7ff63c141a40 con 0x7ff63c1556f0 2021-11-15T19:36:06.086 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:06.086 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":150,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:05.764460+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:36:03.668546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T19:36:04.747069+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:36:06.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff61c0536f0 msgr2=0x7ff61c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff61c0536f0 0x7ff61c055bb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ff638016000 tx=0x7ff638015000).stop 2021-11-15T19:36:06.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 msgr2=0x7ff63c155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 0x7ff63c155b70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7ff6380013c0 tx=0x7ff634007e50).stop 2021-11-15T19:36:06.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 shutdown_connections 2021-11-15T19:36:06.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff61c0536f0 0x7ff61c055bb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff63c1556f0 0x7ff63c155b70 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff63c13f3b0 0x7ff63c13f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 --2- 172.21.2.137:0/96220532 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff624003750 0x7ff63c13d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 >> 172.21.2.137:0/96220532 conn(0x7ff63c0624b0 msgr2=0x7ff63c0b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:06.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 shutdown_connections 2021-11-15T19:36:06.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.074+0000 7ff64453c700 1 -- 172.21.2.137:0/96220532 wait complete. 2021-11-15T19:36:06.093 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T19:36:06.146 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 Processor -- start 2021-11-15T19:36:06.147 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 -- start start 2021-11-15T19:36:06.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fd99c0b11b0 0x7fd99c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd99c09a2f0 0x7fd99c09a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99c0a9e50 con 0x7fd99c0608a0 2021-11-15T19:36:06.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99c0b1590 con 0x7fd99c0b11b0 2021-11-15T19:36:06.152 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99bfff700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99c098d50 con 0x7fd99c09a2f0 2021-11-15T19:36:06.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99a7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd99c0608a0 0x7fd99c05c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60112/0 (socket says 172.21.2.137:60112) 2021-11-15T19:36:06.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99a7fc700 1 -- 172.21.2.137:0/2575650278 learned_addr learned my addr 172.21.2.137:0/2575650278 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:06.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99b7fe700 1 --2- 172.21.2.137:0/2575650278 >> v2:172.21.2.137:3300/0 conn(0x7fd99c09a2f0 0x7fd99c09a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99affd700 1 --2- 172.21.2.137:0/2575650278 >> v2:172.21.2.111:3300/0 conn(0x7fd99c0b11b0 0x7fd99c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd999ffb700 1 -- 172.21.2.137:0/2575650278 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149973204 0 0) 0x7fd99c0a9e50 con 0x7fd99c0608a0 2021-11-15T19:36:06.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd999ffb700 1 -- 172.21.2.137:0/2575650278 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd980003260 con 0x7fd99c0608a0 2021-11-15T19:36:06.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd999ffb700 1 -- 172.21.2.137:0/2575650278 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3583840834 0 0) 0x7fd980003260 con 0x7fd99c0608a0 2021-11-15T19:36:06.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99b7fe700 1 -- 172.21.2.137:0/2575650278 >> v2:172.21.2.111:3300/0 conn(0x7fd99c0b11b0 msgr2=0x7fd99c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:06.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99b7fe700 1 --2- 172.21.2.137:0/2575650278 >> v2:172.21.2.111:3300/0 conn(0x7fd99c0b11b0 0x7fd99c0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99b7fe700 1 -- 172.21.2.137:0/2575650278 >> v1:172.21.2.137:6789/0 conn(0x7fd99c0608a0 legacy=0x7fd99c05c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.134+0000 7fd99b7fe700 1 -- 172.21.2.137:0/2575650278 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c0aa080 con 0x7fd99c09a2f0 2021-11-15T19:36:06.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99b7fe700 1 --2- 172.21.2.137:0/2575650278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c09a740 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7fd990001800 tx=0x7fd9940091d0).ready entity=mon.1 client_cookie=c956c6639a9da246 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:06.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd999ffb700 1 -- 172.21.2.137:0/2575650278 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd990001660 con 0x7fd99c09a2f0 2021-11-15T19:36:06.155 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd999ffb700 1 -- 172.21.2.137:0/2575650278 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99400f510 con 0x7fd99c09a2f0 2021-11-15T19:36:06.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd999ffb700 1 -- 172.21.2.137:0/2575650278 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd99400f680 con 0x7fd99c09a2f0 2021-11-15T19:36:06.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2575650278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 msgr2=0x7fd99c09a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2575650278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c09a740 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7fd990001800 tx=0x7fd9940091d0).stop 2021-11-15T19:36:06.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2575650278 shutdown_connections 2021-11-15T19:36:06.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2575650278 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c09a740 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2575650278 >> v2:172.21.2.111:3300/0 conn(0x7fd99c0b11b0 0x7fd99c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2575650278 >> 172.21.2.137:0/2575650278 conn(0x7fd99c0b22b0 msgr2=0x7fd99c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:06.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2575650278 shutdown_connections 2021-11-15T19:36:06.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2575650278 wait complete. 2021-11-15T19:36:06.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 Processor -- start 2021-11-15T19:36:06.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- start start 2021-11-15T19:36:06.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd99c0608a0 0x7fd99c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c0627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99c0b11b0 0x7fd99c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c0b4270 con 0x7fd99c0608a0 2021-11-15T19:36:06.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c156400 con 0x7fd99c09a2f0 2021-11-15T19:36:06.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c0b3fd0 con 0x7fd99c0b11b0 2021-11-15T19:36:06.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c0627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c0627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41334/0 (socket says 172.21.2.137:41334) 2021-11-15T19:36:06.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 -- 172.21.2.137:0/2416078719 learned_addr learned my addr 172.21.2.137:0/2416078719 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:06.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99affd700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd99c0608a0 0x7fd99c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99b7fe700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99c0b11b0 0x7fd99c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 -- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99c0b11b0 msgr2=0x7fd99c1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99c0b11b0 0x7fd99c1567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 -- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd99c0608a0 msgr2=0x7fd99c155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:06.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd99c0608a0 0x7fd99c155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:06.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 -- 172.21.2.137:0/2416078719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994009470 con 0x7fd99c09a2f0 2021-11-15T19:36:06.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99a7fc700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c0627a0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fd99c0ad910 tx=0x7fd990001a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:06.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9900072e0 con 0x7fd99c09a2f0 2021-11-15T19:36:06.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd990007440 con 0x7fd99c09a2f0 2021-11-15T19:36:06.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd990005800 con 0x7fd99c09a2f0 2021-11-15T19:36:06.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99c159590 con 0x7fd99c09a2f0 2021-11-15T19:36:06.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99c0b4940 con 0x7fd99c09a2f0 2021-11-15T19:36:06.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99c159720 con 0x7fd99c09a2f0 2021-11-15T19:36:06.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd990010070 con 0x7fd99c09a2f0 2021-11-15T19:36:06.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd98bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd9780536a0 0x7fd978055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:06.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd99006b2e0 con 0x7fd99c09a2f0 2021-11-15T19:36:06.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.138+0000 7fd99affd700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd9780536a0 0x7fd978055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:06.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.142+0000 7fd99affd700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd9780536a0 0x7fd978055b60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fd98c00b000 tx=0x7fd98c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:06.165 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.142+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd990042440 con 0x7fd99c09a2f0 2021-11-15T19:36:06.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:06.254+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd99c0573d0 con 0x7fd99c09a2f0 2021-11-15T19:36:07.156 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd98bfff700 1 -- 172.21.2.137:0/2416078719 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd990045a60 con 0x7fd99c09a2f0 2021-11-15T19:36:07.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd9780536a0 msgr2=0x7fd978055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd9780536a0 0x7fd978055b60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fd98c00b000 tx=0x7fd98c006df0).stop 2021-11-15T19:36:07.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 msgr2=0x7fd99c0627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c0627a0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fd99c0ad910 tx=0x7fd990001a80).stop 2021-11-15T19:36:07.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 shutdown_connections 2021-11-15T19:36:07.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd9780536a0 0x7fd978055b60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd99c0b11b0 0x7fd99c1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd99c09a2f0 0x7fd99c0627a0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 --2- 172.21.2.137:0/2416078719 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd99c0608a0 0x7fd99c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 >> 172.21.2.137:0/2416078719 conn(0x7fd99c0b22b0 msgr2=0x7fd99c0990b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 shutdown_connections 2021-11-15T19:36:07.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.146+0000 7fd99bfff700 1 -- 172.21.2.137:0/2416078719 wait complete. 2021-11-15T19:36:07.165 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:07.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.202+0000 7fd26edf4700 1 Processor -- start 2021-11-15T19:36:07.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.202+0000 7fd26edf4700 1 -- start start 2021-11-15T19:36:07.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2680acab0 0x7fd2680b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 0x7fd2680b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2680aecf0 con 0x7fd2680af2f0 2021-11-15T19:36:07.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26806a580 con 0x7fd2680acab0 2021-11-15T19:36:07.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26813f180 con 0x7fd2680b1180 2021-11-15T19:36:07.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2680acab0 0x7fd2680b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd2680acab0 0x7fd2680b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41340/0 (socket says 172.21.2.137:41340) 2021-11-15T19:36:07.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/2348636819 learned_addr learned my addr 172.21.2.137:0/2348636819 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:07.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/2348636819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 msgr2=0x7fd2680b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- 172.21.2.137:0/2348636819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 0x7fd2680b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/2348636819 >> v1:172.21.2.111:6789/0 conn(0x7fd2680af2f0 legacy=0x7fd268069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/2348636819 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680aef20 con 0x7fd2680acab0 2021-11-15T19:36:07.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- 172.21.2.137:0/2348636819 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b2060 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fd2680b2bd0 tx=0x7fd258006eb0).ready entity=mon.1 client_cookie=9da0faf270f50ed4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd2677fe700 1 -- 172.21.2.137:0/2348636819 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25800d570 con 0x7fd2680acab0 2021-11-15T19:36:07.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd2677fe700 1 -- 172.21.2.137:0/2348636819 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258000e90 con 0x7fd2680acab0 2021-11-15T19:36:07.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd2677fe700 1 -- 172.21.2.137:0/2348636819 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25800d8c0 con 0x7fd2680acab0 2021-11-15T19:36:07.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/2348636819 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 msgr2=0x7fd2680b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- 172.21.2.137:0/2348636819 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b2060 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fd2680b2bd0 tx=0x7fd258006eb0).stop 2021-11-15T19:36:07.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/2348636819 shutdown_connections 2021-11-15T19:36:07.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- 172.21.2.137:0/2348636819 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 0x7fd2680b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- 172.21.2.137:0/2348636819 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b2060 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/2348636819 >> 172.21.2.137:0/2348636819 conn(0x7fd2680630f0 msgr2=0x7fd2680634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/2348636819 shutdown_connections 2021-11-15T19:36:07.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/2348636819 wait complete. 2021-11-15T19:36:07.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 Processor -- start 2021-11-15T19:36:07.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- start start 2021-11-15T19:36:07.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2680af2f0 0x7fd26813b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 0x7fd26813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26813d860 con 0x7fd2680af2f0 2021-11-15T19:36:07.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26814ebd0 con 0x7fd2680acab0 2021-11-15T19:36:07.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26814ee70 con 0x7fd2680b1180 2021-11-15T19:36:07.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41346/0 (socket says 172.21.2.137:41346) 2021-11-15T19:36:07.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/108180965 learned_addr learned my addr 172.21.2.137:0/108180965 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:07.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 msgr2=0x7fd26813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 0x7fd26813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2680af2f0 msgr2=0x7fd26813b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2680af2f0 0x7fd26813b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 -- 172.21.2.137:0/108180965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25800b1e0 con 0x7fd2680acab0 2021-11-15T19:36:07.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26cb90700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b48d0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fd2680b2bd0 tx=0x7fd258015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd258002f70 con 0x7fd2680acab0 2021-11-15T19:36:07.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800bec0 con 0x7fd2680acab0 2021-11-15T19:36:07.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26813bae0 con 0x7fd2680acab0 2021-11-15T19:36:07.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd25800d8f0 con 0x7fd2680acab0 2021-11-15T19:36:07.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.206+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2680b6040 con 0x7fd2680acab0 2021-11-15T19:36:07.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26814ea30 con 0x7fd2680acab0 2021-11-15T19:36:07.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd258025030 con 0x7fd2680acab0 2021-11-15T19:36:07.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd265ffb700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd248053610 0x7fd248055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd25806cd00 con 0x7fd2680acab0 2021-11-15T19:36:07.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd267fff700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd248053610 0x7fd248055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd267fff700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd248053610 0x7fd248055ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fd25c002f70 tx=0x7fd25c0069f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.210+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd26814ea30 con 0x7fd2680acab0 2021-11-15T19:36:07.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.318+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd26814ea30 con 0x7fd2680acab0 2021-11-15T19:36:07.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd265ffb700 1 -- 172.21.2.137:0/108180965 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fd26814ea30 con 0x7fd2680acab0 2021-11-15T19:36:07.332 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:07.332 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/2020936860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2020936860},{"type":"v1","addr":"172.21.2.111:6835","nonce":2020936860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:36:05.764984+0000","modified":"2021-11-15T19:36:07.143006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8641":{"gid":8641,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/754709113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":754709113},{"type":"v1","addr":"172.21.2.137:6833","nonce":754709113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T19:36:07.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd248053610 msgr2=0x7fd248055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd248053610 0x7fd248055ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fd25c002f70 tx=0x7fd25c0069f0).stop 2021-11-15T19:36:07.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 msgr2=0x7fd2680b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b48d0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fd2680b2bd0 tx=0x7fd258015000).stop 2021-11-15T19:36:07.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 shutdown_connections 2021-11-15T19:36:07.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd248053610 0x7fd248055ad0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd2680b1180 0x7fd26813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd2680af2f0 0x7fd26813b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 --2- 172.21.2.137:0/108180965 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd2680acab0 0x7fd2680b48d0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 >> 172.21.2.137:0/108180965 conn(0x7fd2680630f0 msgr2=0x7fd2680634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 shutdown_connections 2021-11-15T19:36:07.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.322+0000 7fd26edf4700 1 -- 172.21.2.137:0/108180965 wait complete. 2021-11-15T19:36:07.336 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 80 2021-11-15T19:36:07.340 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:36:07.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 Processor -- start 2021-11-15T19:36:07.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 -- start start 2021-11-15T19:36:07.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f2634144610 0x7f2634147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 0x7f26340aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2634148190 con 0x7f26340b1340 2021-11-15T19:36:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26340b1720 con 0x7f2634144610 2021-11-15T19:36:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f263a000700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2634147e70 con 0x7f26340a9f50 2021-11-15T19:36:07.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26337fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f26340b1340 0x7f2634143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60136/0 (socket says 172.21.2.137:60136) 2021-11-15T19:36:07.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26337fe700 1 -- 172.21.2.137:0/3453763884 learned_addr learned my addr 172.21.2.137:0/3453763884 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052121839 0 0) 0x7f261c001110 con 0x7f26340b1340 2021-11-15T19:36:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2614003260 con 0x7f26340b1340 2021-11-15T19:36:07.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f2633fff700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 0x7f26340aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f2632ffd700 1 --2- 172.21.2.137:0/3453763884 >> v2:172.21.2.111:3300/0 conn(0x7f2634144610 0x7f2634147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840037571 0 0) 0x7f2614003260 con 0x7f26340b1340 2021-11-15T19:36:07.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 msgr2=0x7f26340aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 0x7f26340aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 >> v2:172.21.2.111:3300/0 conn(0x7f2634144610 msgr2=0x7f2634147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 --2- 172.21.2.137:0/3453763884 >> v2:172.21.2.111:3300/0 conn(0x7f2634144610 0x7f2634147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340af800 con 0x7f26340b1340 2021-11-15T19:36:07.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f261c001810 con 0x7f26340b1340 2021-11-15T19:36:07.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 >> v1:172.21.2.137:6789/0 conn(0x7f26340b1340 legacy=0x7f2634143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.398 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 0x7f26140037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2614003e00 0x7f2614004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f26140049f0 0x7f2614004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340b1720 con 0x7f2614003e00 2021-11-15T19:36:07.399 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2634147e70 con 0x7f26140049f0 2021-11-15T19:36:07.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261400b8e0 con 0x7f26340a9f50 2021-11-15T19:36:07.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.378+0000 7f2633fff700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f26140049f0 0x7f2614004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 msgr2=0x7f26140037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26340a9f50 0x7f26140037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2614003e00 msgr2=0x7f2614004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2614003e00 0x7f2614004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3453763884 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614003260 con 0x7f26140049f0 2021-11-15T19:36:07.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f26140049f0 0x7f2614004e70 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f262c00a000 tx=0x7f262c008040).ready entity=mon.1 client_cookie=116ad412b367185d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262c00c070 con 0x7f26140049f0 2021-11-15T19:36:07.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00e5f0 con 0x7f26140049f0 2021-11-15T19:36:07.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f26327fc700 1 -- 172.21.2.137:0/3453763884 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262c00e950 con 0x7f26140049f0 2021-11-15T19:36:07.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3453763884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f26140049f0 msgr2=0x7f2614004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 --2- 172.21.2.137:0/3453763884 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f26140049f0 0x7f2614004e70 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f262c00a000 tx=0x7f262c008040).stop 2021-11-15T19:36:07.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3453763884 reap_dead start 2021-11-15T19:36:07.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3453763884 shutdown_connections 2021-11-15T19:36:07.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3453763884 >> 172.21.2.137:0/3453763884 conn(0x7f26340b4e60 msgr2=0x7f26340b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3453763884 shutdown_connections 2021-11-15T19:36:07.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3453763884 wait complete. 2021-11-15T19:36:07.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 Processor -- start 2021-11-15T19:36:07.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- start start 2021-11-15T19:36:07.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26140049f0 0x7f26340b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2634099870 0x7f2634144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 0x7f2634145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263409a5f0 con 0x7f2634099870 2021-11-15T19:36:07.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263409a890 con 0x7f2634099cf0 2021-11-15T19:36:07.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263409ab30 con 0x7f26140049f0 2021-11-15T19:36:07.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 0x7f2634145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.405 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 0x7f2634145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41368/0 (socket says 172.21.2.137:41368) 2021-11-15T19:36:07.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3960343655 learned_addr learned my addr 172.21.2.137:0/3960343655 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:07.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26140049f0 msgr2=0x7f26340b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26140049f0 0x7f26340b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2634099870 msgr2=0x7f2634144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.406 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2632ffd700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2634099870 0x7f2634144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2634099870 0x7f2634144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 -- 172.21.2.137:0/3960343655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634145980 con 0x7f2634099cf0 2021-11-15T19:36:07.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2633fff700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 0x7f2634145490 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f261c001970 tx=0x7f262c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.407 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262c01d410 con 0x7f2634099cf0 2021-11-15T19:36:07.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c01d570 con 0x7f2634099cf0 2021-11-15T19:36:07.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2634147890 con 0x7f2634099cf0 2021-11-15T19:36:07.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262c01d8d0 con 0x7f2634099cf0 2021-11-15T19:36:07.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2634159df0 con 0x7f2634099cf0 2021-11-15T19:36:07.408 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263409acf0 con 0x7f2634099cf0 2021-11-15T19:36:07.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f262c01da30 con 0x7f2634099cf0 2021-11-15T19:36:07.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.382+0000 7f2630ff9700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26180536d0 0x7f2618055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.386+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f262c06bdd0 con 0x7f2634099cf0 2021-11-15T19:36:07.409 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.386+0000 7f26337fe700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26180536d0 0x7f2618055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.386+0000 7f26337fe700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26180536d0 0x7f2618055b90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f261c001520 tx=0x7f26340abfb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.410 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.386+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f262c042f30 con 0x7f2634099cf0 2021-11-15T19:36:07.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f263405faf0 con 0x7f2634099cf0 2021-11-15T19:36:07.480 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f2630ff9700 1 -- 172.21.2.137:0/3960343655 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f262c023090 con 0x7f2634099cf0 2021-11-15T19:36:07.480 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:07.481 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":151,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:06.769531+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:36:03.668546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T19:36:04.747069+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:36:07.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26180536d0 msgr2=0x7f2618055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.482 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26180536d0 0x7f2618055b90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f261c001520 tx=0x7f26340abfb0).stop 2021-11-15T19:36:07.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 msgr2=0x7f2634145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 0x7f2634145490 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f261c001970 tx=0x7f262c008040).stop 2021-11-15T19:36:07.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 shutdown_connections 2021-11-15T19:36:07.483 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f26180536d0 0x7f2618055b90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2634099cf0 0x7f2634145490 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f2634099870 0x7f2634144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 --2- 172.21.2.137:0/3960343655 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f26140049f0 0x7f26340b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 >> 172.21.2.137:0/3960343655 conn(0x7f26340b4e60 msgr2=0x7f26340b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.484 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 shutdown_connections 2021-11-15T19:36:07.485 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.470+0000 7f263a000700 1 -- 172.21.2.137:0/3960343655 wait complete. 2021-11-15T19:36:07.488 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:36:07.542 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc30a093700 1 Processor -- start 2021-11-15T19:36:07.543 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc30a093700 1 -- start start 2021-11-15T19:36:07.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc30a093700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc3040b2350 0x7fc304142700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc30a093700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040ae580 con 0x7fc3040b1f70 2021-11-15T19:36:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc30a093700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040ae7e0 con 0x7fc3040677a0 2021-11-15T19:36:07.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc30a093700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc304142bf0 con 0x7fc3040b2350 2021-11-15T19:36:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc303fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc3040677a0 0x7fc304146460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60154/0 (socket says 172.21.2.137:60154) 2021-11-15T19:36:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc303fff700 1 -- 172.21.2.137:0/4065870516 learned_addr learned my addr 172.21.2.137:0/4065870516 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc302ffd700 1 --2- 172.21.2.137:0/4065870516 >> v2:172.21.2.137:3300/0 conn(0x7fc3040b2350 0x7fc304142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.547 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc302ffd700 1 -- 172.21.2.137:0/4065870516 >> v1:172.21.2.137:6789/0 conn(0x7fc3040677a0 legacy=0x7fc304146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc302ffd700 1 -- 172.21.2.137:0/4065870516 >> v1:172.21.2.111:6789/0 conn(0x7fc3040b1f70 legacy=0x7fc304141ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc302ffd700 1 -- 172.21.2.137:0/4065870516 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040b28a0 con 0x7fc3040b2350 2021-11-15T19:36:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc302ffd700 1 --2- 172.21.2.137:0/4065870516 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc304142700 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fc30406a550 tx=0x7fc2f4006df0).ready entity=mon.1 client_cookie=ef46038dfe14c78 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc3027fc700 1 -- 172.21.2.137:0/4065870516 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f400d570 con 0x7fc3040b2350 2021-11-15T19:36:07.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc3027fc700 1 -- 172.21.2.137:0/4065870516 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4000e90 con 0x7fc3040b2350 2021-11-15T19:36:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.530+0000 7fc3027fc700 1 -- 172.21.2.137:0/4065870516 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f400d8c0 con 0x7fc3040b2350 2021-11-15T19:36:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4065870516 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 msgr2=0x7fc304142700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 --2- 172.21.2.137:0/4065870516 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc304142700 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fc30406a550 tx=0x7fc2f4006df0).stop 2021-11-15T19:36:07.549 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4065870516 shutdown_connections 2021-11-15T19:36:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 --2- 172.21.2.137:0/4065870516 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc304142700 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4065870516 >> 172.21.2.137:0/4065870516 conn(0x7fc3040630f0 msgr2=0x7fc3040634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4065870516 shutdown_connections 2021-11-15T19:36:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4065870516 wait complete. 2021-11-15T19:36:07.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 Processor -- start 2021-11-15T19:36:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- start start 2021-11-15T19:36:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc3040677a0 0x7fc3040b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc3040b1f70 0x7fc3040644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc3041513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304066240 con 0x7fc3040677a0 2021-11-15T19:36:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304066470 con 0x7fc3040b2350 2021-11-15T19:36:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30413d670 con 0x7fc3040b1f70 2021-11-15T19:36:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc3041513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc3041513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41378/0 (socket says 172.21.2.137:41378) 2021-11-15T19:36:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 -- 172.21.2.137:0/4200969246 learned_addr learned my addr 172.21.2.137:0/4200969246 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 -- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc3040b1f70 msgr2=0x7fc3040644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc3040b1f70 0x7fc3040644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 -- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc3040677a0 msgr2=0x7fc3040b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc3040677a0 0x7fc3040b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 -- 172.21.2.137:0/4200969246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f400b180 con 0x7fc3040b2350 2021-11-15T19:36:07.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc303fff700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc3041513d0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fc2fc001550 tx=0x7fc2fc007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc005ba0 con 0x7fc3040b2350 2021-11-15T19:36:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc005d00 con 0x7fc3040b2350 2021-11-15T19:36:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc007300 con 0x7fc3040b2350 2021-11-15T19:36:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3041441a0 con 0x7fc3040b2350 2021-11-15T19:36:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc304066d80 con 0x7fc3040b2350 2021-11-15T19:36:07.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3040aeae0 con 0x7fc3040b2350 2021-11-15T19:36:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc2fc010030 con 0x7fc3040b2350 2021-11-15T19:36:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc300ff9700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2e80535b0 0x7fc2e8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.534+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc2fc06bb00 con 0x7fc3040b2350 2021-11-15T19:36:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.538+0000 7fc3037fe700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2e80535b0 0x7fc2e8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.538+0000 7fc3037fe700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2e80535b0 0x7fc2e8055a70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fc2ec002fb0 tx=0x7fc2ec0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.558 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.538+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2fc042b50 con 0x7fc3040b2350 2021-11-15T19:36:07.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.650+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc3040573d0 con 0x7fc3040b2350 2021-11-15T19:36:07.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc300ff9700 1 -- 172.21.2.137:0/4200969246 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc2fc046170 con 0x7fc3040b2350 2021-11-15T19:36:07.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2e80535b0 msgr2=0x7fc2e8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.675 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2e80535b0 0x7fc2e8055a70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fc2ec002fb0 tx=0x7fc2ec0069b0).stop 2021-11-15T19:36:07.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 msgr2=0x7fc3041513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc3041513d0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fc2fc001550 tx=0x7fc2fc007f00).stop 2021-11-15T19:36:07.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 shutdown_connections 2021-11-15T19:36:07.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc2e80535b0 0x7fc2e8055a70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.676 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc3040b2350 0x7fc3041513d0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc3040b1f70 0x7fc3040644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 --2- 172.21.2.137:0/4200969246 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc3040677a0 0x7fc3040b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 >> 172.21.2.137:0/4200969246 conn(0x7fc3040630f0 msgr2=0x7fc30405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 shutdown_connections 2021-11-15T19:36:07.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.662+0000 7fc30a093700 1 -- 172.21.2.137:0/4200969246 wait complete. 2021-11-15T19:36:07.678 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.0 2021-11-15T19:36:07.681 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:36:07.735 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.722+0000 7f2470a36700 1 Processor -- start 2021-11-15T19:36:07.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.722+0000 7f2470a36700 1 -- start start 2021-11-15T19:36:07.736 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 0x7f246c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f246c0af2f0 0x7f246c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0aecf0 con 0x7f246c0b1180 2021-11-15T19:36:07.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c13f180 con 0x7f246c0af2f0 2021-11-15T19:36:07.737 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0aef20 con 0x7f246c0acab0 2021-11-15T19:36:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2469d9b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f246c0b1180 0x7f246c142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60166/0 (socket says 172.21.2.137:60166) 2021-11-15T19:36:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2469d9b700 1 -- 172.21.2.137:0/2804221164 learned_addr learned my addr 172.21.2.137:0/2804221164 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415926401 0 0) 0x7f246c0aecf0 con 0x7f246c0b1180 2021-11-15T19:36:07.738 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c003260 con 0x7f246c0b1180 2021-11-15T19:36:07.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2601760618 0 0) 0x7f244c003260 con 0x7f246c0b1180 2021-11-15T19:36:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 msgr2=0x7f246c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 0x7f246c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 >> v2:172.21.2.111:3300/0 conn(0x7f246c0af2f0 msgr2=0x7f246c0b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 --2- 172.21.2.137:0/2804221164 >> v2:172.21.2.111:3300/0 conn(0x7f246c0af2f0 0x7f246c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0ace90 con 0x7f246c0b1180 2021-11-15T19:36:07.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f2454001660 con 0x7f246c0b1180 2021-11-15T19:36:07.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 >> v1:172.21.2.137:6789/0 conn(0x7f246c0b1180 legacy=0x7f246c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f244c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 0x7f244c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f244c004bf0 0x7f244c007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c13f180 con 0x7f244c004bf0 2021-11-15T19:36:07.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0aef20 con 0x7f244c0037d0 2021-11-15T19:36:07.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c005300 con 0x7f246c0acab0 2021-11-15T19:36:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f244c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2469d9b700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 0x7f244c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 -- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 msgr2=0x7f244c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c0acab0 0x7f244c004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 -- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f244c004bf0 msgr2=0x7f244c007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f244c004bf0 0x7f244c007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 -- 172.21.2.137:0/2804221164 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c003260 con 0x7f244c0037d0 2021-11-15T19:36:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246a59c700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f244c003bf0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f245c002f70 tx=0x7f245c006ca0).ready entity=mon.1 client_cookie=30b5f585b13cfe5a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c013410 con 0x7f244c0037d0 2021-11-15T19:36:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c013570 con 0x7f244c0037d0 2021-11-15T19:36:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246959a700 1 -- 172.21.2.137:0/2804221164 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c0138d0 con 0x7f244c0037d0 2021-11-15T19:36:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- 172.21.2.137:0/2804221164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 msgr2=0x7f244c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 --2- 172.21.2.137:0/2804221164 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f244c003bf0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f245c002f70 tx=0x7f245c006ca0).stop 2021-11-15T19:36:07.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f246ad9d700 1 -- 172.21.2.137:0/2804221164 reap_dead start 2021-11-15T19:36:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- 172.21.2.137:0/2804221164 shutdown_connections 2021-11-15T19:36:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- 172.21.2.137:0/2804221164 >> 172.21.2.137:0/2804221164 conn(0x7f246c0630f0 msgr2=0x7f246c0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- 172.21.2.137:0/2804221164 shutdown_connections 2021-11-15T19:36:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- 172.21.2.137:0/2804221164 wait complete. 2021-11-15T19:36:07.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 Processor -- start 2021-11-15T19:36:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- start start 2021-11-15T19:36:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f246c0699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f246c10f4e0 0x7f246c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c10ec80 0x7f246c14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1134a0 con 0x7f246c10f4e0 2021-11-15T19:36:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c151400 con 0x7f244c0037d0 2021-11-15T19:36:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.726+0000 7f2470a36700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1516a0 con 0x7f246c10ec80 2021-11-15T19:36:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f246c0699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f246c0699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41400/0 (socket says 172.21.2.137:41400) 2021-11-15T19:36:07.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 -- 172.21.2.137:0/135478833 learned_addr learned my addr 172.21.2.137:0/135478833 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:07.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f2469d9b700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f246c10f4e0 0x7f246c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 -- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c10ec80 msgr2=0x7f246c14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c10ec80 0x7f246c14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 -- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f246c10f4e0 msgr2=0x7f246c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f246c10f4e0 0x7f246c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 -- 172.21.2.137:0/135478833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c1130f0 con 0x7f244c0037d0 2021-11-15T19:36:07.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f246a59c700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f246c0699c0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f245c002f70 tx=0x7f245c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c013410 con 0x7f244c0037d0 2021-11-15T19:36:07.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c012de0 con 0x7f244c0037d0 2021-11-15T19:36:07.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c152030 con 0x7f244c0037d0 2021-11-15T19:36:07.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c021660 con 0x7f244c0037d0 2021-11-15T19:36:07.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c14e490 con 0x7f244c0037d0 2021-11-15T19:36:07.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c1132e0 con 0x7f244c0037d0 2021-11-15T19:36:07.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f245c0217c0 con 0x7f244c0037d0 2021-11-15T19:36:07.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f24637fe700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24500536a0 0x7f2450055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f245c01b040 con 0x7f244c0037d0 2021-11-15T19:36:07.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f2469d9b700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24500536a0 0x7f2450055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.730+0000 7f2469d9b700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24500536a0 0x7f2450055b60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f2454009000 tx=0x7f2454009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.734+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f245c043fd0 con 0x7f244c0037d0 2021-11-15T19:36:07.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.846+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f246c151860 con 0x7f244c0037d0 2021-11-15T19:36:07.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f24637fe700 1 -- 172.21.2.137:0/135478833 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7f245c0475f0 con 0x7f244c0037d0 2021-11-15T19:36:07.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24500536a0 msgr2=0x7f2450055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24500536a0 0x7f2450055b60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f2454009000 tx=0x7f2454009040).stop 2021-11-15T19:36:07.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 msgr2=0x7f246c0699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f246c0699c0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f245c002f70 tx=0x7f245c014000).stop 2021-11-15T19:36:07.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 shutdown_connections 2021-11-15T19:36:07.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f24500536a0 0x7f2450055b60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f246c10ec80 0x7f246c14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f246c10f4e0 0x7f246c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 --2- 172.21.2.137:0/135478833 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f244c0037d0 0x7f246c0699c0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 >> 172.21.2.137:0/135478833 conn(0x7f246c0630f0 msgr2=0x7f246c0b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 shutdown_connections 2021-11-15T19:36:07.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.858+0000 7f2470a36700 1 -- 172.21.2.137:0/135478833 wait complete. 2021-11-15T19:36:07.873 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.1 2021-11-15T19:36:07.876 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T19:36:07.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f709722f700 1 Processor -- start 2021-11-15T19:36:07.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f709722f700 1 -- start start 2021-11-15T19:36:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f709722f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f70900acab0 0x7f70900b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f709722f700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70900aecf0 con 0x7f70900af2f0 2021-11-15T19:36:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f709722f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709013f180 con 0x7f70900b1180 2021-11-15T19:36:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f709722f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709006a580 con 0x7f70900acab0 2021-11-15T19:36:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f708ffff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f70900b1180 0x7f7090142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60188/0 (socket says 172.21.2.137:60188) 2021-11-15T19:36:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f708ffff700 1 -- 172.21.2.137:0/3437380554 learned_addr learned my addr 172.21.2.137:0/3437380554 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:07.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f7094fcb700 1 --2- 172.21.2.137:0/3437380554 >> v2:172.21.2.137:3300/0 conn(0x7f70900acab0 0x7f70900b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f7094fcb700 1 -- 172.21.2.137:0/3437380554 >> v1:172.21.2.137:6789/0 conn(0x7f70900b1180 legacy=0x7f7090142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f7094fcb700 1 -- 172.21.2.137:0/3437380554 >> v1:172.21.2.111:6789/0 conn(0x7f70900af2f0 legacy=0x7f7090069e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f7094fcb700 1 -- 172.21.2.137:0/3437380554 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900aef20 con 0x7f70900acab0 2021-11-15T19:36:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f7094fcb700 1 --2- 172.21.2.137:0/3437380554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900acab0 0x7f70900b2060 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f70900b2bd0 tx=0x7f7084006df0).ready entity=mon.1 client_cookie=940a727ea39e3776 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f708f7fe700 1 -- 172.21.2.137:0/3437380554 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708400d5c0 con 0x7f70900acab0 2021-11-15T19:36:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.918+0000 7f708f7fe700 1 -- 172.21.2.137:0/3437380554 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084000e90 con 0x7f70900acab0 2021-11-15T19:36:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708f7fe700 1 -- 172.21.2.137:0/3437380554 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708400d910 con 0x7f70900acab0 2021-11-15T19:36:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/3437380554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900acab0 msgr2=0x7f70900b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 --2- 172.21.2.137:0/3437380554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900acab0 0x7f70900b2060 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f70900b2bd0 tx=0x7f7084006df0).stop 2021-11-15T19:36:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/3437380554 shutdown_connections 2021-11-15T19:36:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 --2- 172.21.2.137:0/3437380554 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900acab0 0x7f70900b2060 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/3437380554 >> 172.21.2.137:0/3437380554 conn(0x7f70900630f0 msgr2=0x7f70900634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/3437380554 shutdown_connections 2021-11-15T19:36:07.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/3437380554 wait complete. 2021-11-15T19:36:07.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 Processor -- start 2021-11-15T19:36:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- start start 2021-11-15T19:36:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70900acab0 0x7f7090140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70900af2f0 0x7f709013dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 0x7f709013e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709014edb0 con 0x7f70900af2f0 2021-11-15T19:36:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709010fba0 con 0x7f70900b1180 2021-11-15T19:36:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709010ed80 con 0x7f70900acab0 2021-11-15T19:36:07.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 0x7f709013e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 0x7f709013e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41414/0 (socket says 172.21.2.137:41414) 2021-11-15T19:36:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 -- 172.21.2.137:0/1600510650 learned_addr learned my addr 172.21.2.137:0/1600510650 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 -- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70900acab0 msgr2=0x7f7090140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70900acab0 0x7f7090140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 -- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70900af2f0 msgr2=0x7f709013dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70900af2f0 0x7f709013dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 -- 172.21.2.137:0/1600510650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708400b180 con 0x7f70900b1180 2021-11-15T19:36:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f70957cc700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 0x7f709013e4c0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f7090110520 tx=0x7f70880091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7088001520 con 0x7f70900b1180 2021-11-15T19:36:07.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088001680 con 0x7f70900b1180 2021-11-15T19:36:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70880019e0 con 0x7f70900b1180 2021-11-15T19:36:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090157bc0 con 0x7f70900b1180 2021-11-15T19:36:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709010efb0 con 0x7f70900b1180 2021-11-15T19:36:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70900675e0 con 0x7f70900b1180 2021-11-15T19:36:07.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7088018030 con 0x7f70900b1180 2021-11-15T19:36:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708dffb700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7070053610 0x7f7070055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.922+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f708806b4b0 con 0x7f70900b1180 2021-11-15T19:36:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.926+0000 7f7094fcb700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7070053610 0x7f7070055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.926+0000 7f7094fcb700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7070053610 0x7f7070055ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f70900b2bd0 tx=0x7f7084012000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:07.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:07.926+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7088042530 con 0x7f70900b1180 2021-11-15T19:36:08.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.038+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f709014d780 con 0x7f70900b1180 2021-11-15T19:36:08.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f708dffb700 1 -- 172.21.2.137:0/1600510650 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7088045b50 con 0x7f70900b1180 2021-11-15T19:36:08.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7070053610 msgr2=0x7f7070055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7070053610 0x7f7070055ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f70900b2bd0 tx=0x7f7084012000).stop 2021-11-15T19:36:08.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 msgr2=0x7f709013e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 0x7f709013e4c0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f7090110520 tx=0x7f70880091a0).stop 2021-11-15T19:36:08.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 shutdown_connections 2021-11-15T19:36:08.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7070053610 0x7f7070055ad0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f70900b1180 0x7f709013e4c0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f70900af2f0 0x7f709013dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 --2- 172.21.2.137:0/1600510650 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f70900acab0 0x7f7090140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 >> 172.21.2.137:0/1600510650 conn(0x7f70900630f0 msgr2=0x7f70900b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 shutdown_connections 2021-11-15T19:36:08.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.050+0000 7f709722f700 1 -- 172.21.2.137:0/1600510650 wait complete. 2021-11-15T19:36:08.065 INFO:teuthology.orchestra.run.gibba037.stderr:updated caps for client.2 2021-11-15T19:36:08.069 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:08.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8e0d3b700 1 Processor -- start 2021-11-15T19:36:08.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8e0d3b700 1 -- start start 2021-11-15T19:36:08.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8e0d3b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd8dc0acc50 0x7fd8dc0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8e0d3b700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0b2990 con 0x7fd8dc0b1280 2021-11-15T19:36:08.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8e0d3b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0ad030 con 0x7fd8dc0b03f0 2021-11-15T19:36:08.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8e0d3b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc06a580 con 0x7fd8dc0acc50 2021-11-15T19:36:08.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8daffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd8dc0b03f0 0x7fd8dc069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60200/0 (socket says 172.21.2.137:60200) 2021-11-15T19:36:08.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8daffd700 1 -- 172.21.2.137:0/2850322019 learned_addr learned my addr 172.21.2.137:0/2850322019 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:08.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8db7fe700 1 --2- 172.21.2.137:0/2850322019 >> v2:172.21.2.137:3300/0 conn(0x7fd8dc0acc50 0x7fd8dc0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8db7fe700 1 -- 172.21.2.137:0/2850322019 >> v1:172.21.2.137:6789/0 conn(0x7fd8dc0b03f0 legacy=0x7fd8dc069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8db7fe700 1 -- 172.21.2.137:0/2850322019 >> v1:172.21.2.111:6789/0 conn(0x7fd8dc0b1280 legacy=0x7fd8dc0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:08.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8db7fe700 1 -- 172.21.2.137:0/2850322019 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0af430 con 0x7fd8dc0acc50 2021-11-15T19:36:08.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8db7fe700 1 --2- 172.21.2.137:0/2850322019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc0b1d90 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7fd8dc0b2c40 tx=0x7fd8cc006df0).ready entity=mon.1 client_cookie=bbfd45c2f1ebc163 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8da7fc700 1 -- 172.21.2.137:0/2850322019 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc00d5c0 con 0x7fd8dc0acc50 2021-11-15T19:36:08.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8da7fc700 1 -- 172.21.2.137:0/2850322019 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc000e90 con 0x7fd8dc0acc50 2021-11-15T19:36:08.122 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.106+0000 7fd8da7fc700 1 -- 172.21.2.137:0/2850322019 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc00d910 con 0x7fd8dc0acc50 2021-11-15T19:36:08.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/2850322019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 msgr2=0x7fd8dc0b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/2850322019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc0b1d90 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7fd8dc0b2c40 tx=0x7fd8cc006df0).stop 2021-11-15T19:36:08.125 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/2850322019 shutdown_connections 2021-11-15T19:36:08.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/2850322019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc0b1d90 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/2850322019 >> 172.21.2.137:0/2850322019 conn(0x7fd8dc0630f0 msgr2=0x7fd8dc0634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/2850322019 shutdown_connections 2021-11-15T19:36:08.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/2850322019 wait complete. 2021-11-15T19:36:08.126 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 Processor -- start 2021-11-15T19:36:08.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- start start 2021-11-15T19:36:08.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc1466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8dc0b03f0 0x7fd8dc151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.127 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8dc0b1280 0x7fd8dc066f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc143870 con 0x7fd8dc0b03f0 2021-11-15T19:36:08.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc1524b0 con 0x7fd8dc0acc50 2021-11-15T19:36:08.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc152750 con 0x7fd8dc0b1280 2021-11-15T19:36:08.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc1466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc1466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41426/0 (socket says 172.21.2.137:41426) 2021-11-15T19:36:08.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 -- 172.21.2.137:0/4278776753 learned_addr learned my addr 172.21.2.137:0/4278776753 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:08.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8daffd700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8dc0b03f0 0x7fd8dc151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 -- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8dc0b1280 msgr2=0x7fd8dc066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8dc0b1280 0x7fd8dc066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 -- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8dc0b03f0 msgr2=0x7fd8dc151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8dc0b03f0 0x7fd8dc151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 -- 172.21.2.137:0/4278776753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc00b180 con 0x7fd8dc0acc50 2021-11-15T19:36:08.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8db7fe700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc1466d0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fd8dc1465c0 tx=0x7fd8cc012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc002f50 con 0x7fd8dc0acc50 2021-11-15T19:36:08.130 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc013d10 con 0x7fd8dc0acc50 2021-11-15T19:36:08.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc01f640 con 0x7fd8dc0acc50 2021-11-15T19:36:08.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc1529f0 con 0x7fd8dc0acc50 2021-11-15T19:36:08.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc1530b0 con 0x7fd8dc0acc50 2021-11-15T19:36:08.131 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc152b80 con 0x7fd8dc0acc50 2021-11-15T19:36:08.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.110+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8cc026070 con 0x7fd8dc0acc50 2021-11-15T19:36:08.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.114+0000 7fd8d8ff9700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8bc053610 0x7fd8bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.114+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd8cc06c380 con 0x7fd8dc0acc50 2021-11-15T19:36:08.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.114+0000 7fd8daffd700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8bc053610 0x7fd8bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.114+0000 7fd8daffd700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8bc053610 0x7fd8bc055ad0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fd8d0008000 tx=0x7fd8d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.114+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8cc0434e0 con 0x7fd8dc0acc50 2021-11-15T19:36:08.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8dc0ae490 con 0x7fd8dc0acc50 2021-11-15T19:36:08.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8d8ff9700 1 -- 172.21.2.137:0/4278776753 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fd8cc024020 con 0x7fd8dc0acc50 2021-11-15T19:36:08.237 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:08.237 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/2020936860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2020936860},{"type":"v1","addr":"172.21.2.111:6835","nonce":2020936860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:36:05.764984+0000","modified":"2021-11-15T19:36:07.143006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8641":{"gid":8641,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/754709113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":754709113},{"type":"v1","addr":"172.21.2.137:6833","nonce":754709113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T19:36:08.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8bc053610 msgr2=0x7fd8bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8bc053610 0x7fd8bc055ad0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fd8d0008000 tx=0x7fd8d0009040).stop 2021-11-15T19:36:08.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 msgr2=0x7fd8dc1466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc1466d0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fd8dc1465c0 tx=0x7fd8cc012000).stop 2021-11-15T19:36:08.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 shutdown_connections 2021-11-15T19:36:08.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd8bc053610 0x7fd8bc055ad0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd8dc0b1280 0x7fd8dc066f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd8dc0b03f0 0x7fd8dc151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 --2- 172.21.2.137:0/4278776753 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd8dc0acc50 0x7fd8dc1466d0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 >> 172.21.2.137:0/4278776753 conn(0x7fd8dc0630f0 msgr2=0x7fd8dc13f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 shutdown_connections 2021-11-15T19:36:08.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.226+0000 7fd8e0d3b700 1 -- 172.21.2.137:0/4278776753 wait complete. 2021-11-15T19:36:08.241 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 80 2021-11-15T19:36:08.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:36:05.764984+0000', 'modified': '2021-11-15T19:36:07.143006+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8641': {'gid': 8641, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/754709113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 754709113}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 754709113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:36:08.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:36:08.447 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:36:08.511 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":8641,"want_state":"up:active","state":"up:active","rank_uptime":2.7325333930000002,"mdsmap_epoch":80,"osdmap_epoch":152,"osdmap_epoch_barrier":151,"uptime":6.9035633460000003} 2021-11-15T19:36:08.511 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 8641, "mdsmap_epoch": 80, "osdmap_epoch": 152, "osdmap_epoch_barrier": 151, "rank_uptime": 2.732533393, "state": "up:active", "uptime": 6.903563346, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:36:08.512 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:36:08.562 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 Processor -- start 2021-11-15T19:36:08.563 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 -- start start 2021-11-15T19:36:08.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84b40b1340 0x7f84b4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40a9f50 0x7f84b40aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b4148190 con 0x7f84b4143f00 2021-11-15T19:36:08.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40b1720 con 0x7f84b40b1340 2021-11-15T19:36:08.565 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b8bf1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4147e70 con 0x7f84b40a9f50 2021-11-15T19:36:08.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b259c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84b40b1340 0x7f84b4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b259c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f84b40b1340 0x7f84b4147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41432/0 (socket says 172.21.2.137:41432) 2021-11-15T19:36:08.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.550+0000 7f84b259c700 1 -- 172.21.2.137:0/2722491070 learned_addr learned my addr 172.21.2.137:0/2722491070 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:08.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/2722491070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40a9f50 msgr2=0x7f84b40aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:08.566 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- 172.21.2.137:0/2722491070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40a9f50 0x7f84b40aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/2722491070 >> v1:172.21.2.111:6789/0 conn(0x7f84b4143f00 legacy=0x7f84b4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:08.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/2722491070 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40af800 con 0x7f84b40b1340 2021-11-15T19:36:08.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- 172.21.2.137:0/2722491070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40b1340 0x7f84b4147980 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f84b4062250 tx=0x7f84a4006eb0).ready entity=mon.1 client_cookie=741e23127caa5a33 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.567 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b159a700 1 -- 172.21.2.137:0/2722491070 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a400d570 con 0x7f84b40b1340 2021-11-15T19:36:08.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b159a700 1 -- 172.21.2.137:0/2722491070 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4000e90 con 0x7f84b40b1340 2021-11-15T19:36:08.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b159a700 1 -- 172.21.2.137:0/2722491070 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a400d8c0 con 0x7f84b40b1340 2021-11-15T19:36:08.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/2722491070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40b1340 msgr2=0x7f84b4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/2722491070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40b1340 0x7f84b4147980 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f84b4062250 tx=0x7f84a4006eb0).stop 2021-11-15T19:36:08.568 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/2722491070 shutdown_connections 2021-11-15T19:36:08.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/2722491070 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40a9f50 0x7f84b40aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/2722491070 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40b1340 0x7f84b4147980 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/2722491070 >> 172.21.2.137:0/2722491070 conn(0x7f84b40b4e60 msgr2=0x7f84b40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/2722491070 shutdown_connections 2021-11-15T19:36:08.569 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/2722491070 wait complete. 2021-11-15T19:36:08.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 Processor -- start 2021-11-15T19:36:08.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- start start 2021-11-15T19:36:08.572 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 0x7f84b4148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40b1340 0x7f84b4148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b4143f00 0x7f84b413ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41492a0 con 0x7f84b4143f00 2021-11-15T19:36:08.573 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b414a6e0 con 0x7f84b40a9f50 2021-11-15T19:36:08.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40acb10 con 0x7f84b40b1340 2021-11-15T19:36:08.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 0x7f84b4148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 0x7f84b4148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41438/0 (socket says 172.21.2.137:41438) 2021-11-15T19:36:08.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/1308333198 learned_addr learned my addr 172.21.2.137:0/1308333198 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:08.574 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b1d9b700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40b1340 0x7f84b4148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40b1340 msgr2=0x7f84b4148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40b1340 0x7f84b4148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b4143f00 msgr2=0x7f84b413ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b4143f00 0x7f84b413ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.575 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 -- 172.21.2.137:0/1308333198 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a400b1e0 con 0x7f84b40a9f50 2021-11-15T19:36:08.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b1d9b700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40b1340 0x7f84b4148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:08.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b259c700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 0x7f84b4148770 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f84b4062250 tx=0x7f84a4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a4011790 con 0x7f84b40a9f50 2021-11-15T19:36:08.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a40118f0 con 0x7f84b40a9f50 2021-11-15T19:36:08.576 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b414a940 con 0x7f84b40a9f50 2021-11-15T19:36:08.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a4011c50 con 0x7f84b40a9f50 2021-11-15T19:36:08.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.554+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b40ac6e0 con 0x7f84b40a9f50 2021-11-15T19:36:08.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4140810 con 0x7f84b40a9f50 2021-11-15T19:36:08.577 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f84a4025030 con 0x7f84b40a9f50 2021-11-15T19:36:08.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84ab7fe700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84980536f0 0x7f8498055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f84a406cb00 con 0x7f84b40a9f50 2021-11-15T19:36:08.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84b1d9b700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84980536f0 0x7f8498055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84b1d9b700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84980536f0 0x7f8498055bb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f849c008000 tx=0x7f849c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.578 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.558+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84a4043c60 con 0x7f84b40a9f50 2021-11-15T19:36:08.653 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84b4148190 con 0x7f84b40a9f50 2021-11-15T19:36:08.654 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84ab7fe700 1 -- 172.21.2.137:0/1308333198 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f84b4148190 con 0x7f84b40a9f50 2021-11-15T19:36:08.654 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:08.654 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":152,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:07.774435+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:36:03.668546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T19:36:04.747069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:36:08.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84980536f0 msgr2=0x7f8498055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84980536f0 0x7f8498055bb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f849c008000 tx=0x7f849c009040).stop 2021-11-15T19:36:08.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 msgr2=0x7f84b4148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 0x7f84b4148770 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f84b4062250 tx=0x7f84a4015000).stop 2021-11-15T19:36:08.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 shutdown_connections 2021-11-15T19:36:08.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f84980536f0 0x7f8498055bb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f84b4143f00 0x7f84b413ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f84b40b1340 0x7f84b4148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 --2- 172.21.2.137:0/1308333198 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f84b40a9f50 0x7f84b4148770 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 >> 172.21.2.137:0/1308333198 conn(0x7f84b40b4e60 msgr2=0x7f84b40b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 shutdown_connections 2021-11-15T19:36:08.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.642+0000 7f84b8bf1700 1 -- 172.21.2.137:0/1308333198 wait complete. 2021-11-15T19:36:08.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:36:03.668546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:36:04.747069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:36:08.662 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:36:08.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 Processor -- start 2021-11-15T19:36:08.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 -- start start 2021-11-15T19:36:08.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f3f4c0b0550 0x7f3f4c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c05cb50 con 0x7f3f4c05c770 2021-11-15T19:36:08.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c0b1650 con 0x7f3f4c0b0550 2021-11-15T19:36:08.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.702+0000 7f3f53135700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0ad030 con 0x7f3f4c14aaa0 2021-11-15T19:36:08.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f50ed1700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f3f4c05c770 0x7f3f4c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52720/0 (socket says 172.21.2.137:52720) 2021-11-15T19:36:08.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f50ed1700 1 -- 172.21.2.137:0/2450579086 learned_addr learned my addr 172.21.2.137:0/2450579086 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:08.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4bfff700 1 --2- 172.21.2.137:0/2450579086 >> v2:172.21.2.111:3300/0 conn(0x7f3f4c0b0550 0x7f3f4c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f516d2700 1 --2- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4bfff700 1 -- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 msgr2=0x7f3f4c140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:08.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4bfff700 1 --2- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4bfff700 1 -- 172.21.2.137:0/2450579086 >> v1:172.21.2.111:6789/0 conn(0x7f3f4c05c770 legacy=0x7f3f4c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4bfff700 1 -- 172.21.2.137:0/2450579086 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0ad2d0 con 0x7f3f4c0b0550 2021-11-15T19:36:08.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4bfff700 1 --2- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c14a5b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f3f3c002f70 tx=0x7f3f3c006df0).ready entity=mon.0 client_cookie=e964a39876d2151f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4b7fe700 1 -- 172.21.2.137:0/2450579086 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3c00d570 con 0x7f3f4c0b0550 2021-11-15T19:36:08.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4b7fe700 1 -- 172.21.2.137:0/2450579086 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c000e90 con 0x7f3f4c0b0550 2021-11-15T19:36:08.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f4b7fe700 1 -- 172.21.2.137:0/2450579086 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3c00d8c0 con 0x7f3f4c0b0550 2021-11-15T19:36:08.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 -- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c0b0550 msgr2=0x7f3f4c14a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.722 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 --2- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c14a5b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f3f3c002f70 tx=0x7f3f3c006df0).stop 2021-11-15T19:36:08.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 -- 172.21.2.137:0/2450579086 shutdown_connections 2021-11-15T19:36:08.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 --2- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 --2- 172.21.2.137:0/2450579086 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c14a5b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 -- 172.21.2.137:0/2450579086 >> 172.21.2.137:0/2450579086 conn(0x7f3f4c0631e0 msgr2=0x7f3f4c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.723 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 -- 172.21.2.137:0/2450579086 shutdown_connections 2021-11-15T19:36:08.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 -- 172.21.2.137:0/2450579086 wait complete. 2021-11-15T19:36:08.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 Processor -- start 2021-11-15T19:36:08.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 -- start start 2021-11-15T19:36:08.724 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.706+0000 7f3f53135700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c05c770 0x7f3f4c0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c0646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c116800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c066400 con 0x7f3f4c05c770 2021-11-15T19:36:08.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c119470 con 0x7f3f4c0b0550 2021-11-15T19:36:08.725 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c065cc0 con 0x7f3f4c14aaa0 2021-11-15T19:36:08.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c0646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c0646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41454/0 (socket says 172.21.2.137:41454) 2021-11-15T19:36:08.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 -- 172.21.2.137:0/1710680029 learned_addr learned my addr 172.21.2.137:0/1710680029 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:08.726 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f50ed1700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c05c770 0x7f3f4c0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 -- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 msgr2=0x7f3f4c116800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c116800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 -- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c05c770 msgr2=0x7f3f4c0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.727 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c05c770 0x7f3f4c0b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 -- 172.21.2.137:0/1710680029 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c00b180 con 0x7f3f4c0b0550 2021-11-15T19:36:08.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f50ed1700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c05c770 0x7f3f4c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:08.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f4bfff700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c0646f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f3f3c002f70 tx=0x7f3f3c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.728 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3c016070 con 0x7f3f4c0b0550 2021-11-15T19:36:08.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00de40 con 0x7f3f4c0b0550 2021-11-15T19:36:08.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c065f60 con 0x7f3f4c0b0550 2021-11-15T19:36:08.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c118fe0 con 0x7f3f4c0b0550 2021-11-15T19:36:08.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3c01e450 con 0x7f3f4c0b0550 2021-11-15T19:36:08.729 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c1192e0 con 0x7f3f4c0b0550 2021-11-15T19:36:08.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3f3c025030 con 0x7f3f4c0b0550 2021-11-15T19:36:08.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f49ffb700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3f300536a0 0x7f3f30055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3f3c06c9b0 con 0x7f3f4c0b0550 2021-11-15T19:36:08.730 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f50ed1700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3f300536a0 0x7f3f30055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.710+0000 7f3f50ed1700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3f300536a0 0x7f3f30055b60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f3f34008000 tx=0x7f3f34009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.731 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.714+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f3c043a00 con 0x7f3f4c0b0550 2021-11-15T19:36:08.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f4c0660f0 con 0x7f3f4c0b0550 2021-11-15T19:36:08.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f49ffb700 1 -- 172.21.2.137:0/1710680029 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3f3c023020 con 0x7f3f4c0b0550 2021-11-15T19:36:08.809 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:36:08.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3f300536a0 msgr2=0x7f3f30055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3f300536a0 0x7f3f30055b60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f3f34008000 tx=0x7f3f34009040).stop 2021-11-15T19:36:08.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 msgr2=0x7f3f4c0646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c0646f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f3f3c002f70 tx=0x7f3f3c014000).stop 2021-11-15T19:36:08.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 shutdown_connections 2021-11-15T19:36:08.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f3f300536a0 0x7f3f30055b60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f3f4c14aaa0 0x7f3f4c116800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3f4c0b0550 0x7f3f4c0646f0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 --2- 172.21.2.137:0/1710680029 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f3f4c05c770 0x7f3f4c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 >> 172.21.2.137:0/1710680029 conn(0x7f3f4c0631e0 msgr2=0x7f3f4c0b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 shutdown_connections 2021-11-15T19:36:08.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.798+0000 7f3f53135700 1 -- 172.21.2.137:0/1710680029 wait complete. 2021-11-15T19:36:08.816 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:36:08.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 Processor -- start 2021-11-15T19:36:08.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- start start 2021-11-15T19:36:08.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fde2c140aa0 0x7fde2c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2c05cb50 con 0x7fde2c0b0550 2021-11-15T19:36:08.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2c0ad030 con 0x7fde2c05c770 2021-11-15T19:36:08.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2c0b1650 con 0x7fde2c140aa0 2021-11-15T19:36:08.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2b7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fde2c05c770 0x7fde2c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60242/0 (socket says 172.21.2.137:60242) 2021-11-15T19:36:08.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2b7fe700 1 -- 172.21.2.137:0/228388586 learned_addr learned my addr 172.21.2.137:0/228388586 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:08.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2bfff700 1 --2- 172.21.2.137:0/228388586 >> v2:172.21.2.137:3300/0 conn(0x7fde2c140aa0 0x7fde2c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2bfff700 1 -- 172.21.2.137:0/228388586 >> v1:172.21.2.137:6789/0 conn(0x7fde2c05c770 legacy=0x7fde2c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2bfff700 1 -- 172.21.2.137:0/228388586 >> v1:172.21.2.111:6789/0 conn(0x7fde2c0b0550 legacy=0x7fde2c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:08.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2bfff700 1 -- 172.21.2.137:0/228388586 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0ad2d0 con 0x7fde2c140aa0 2021-11-15T19:36:08.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2bfff700 1 --2- 172.21.2.137:0/228388586 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c140aa0 0x7fde2c140f10 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fde2c0aee10 tx=0x7fde240091d0).ready entity=mon.1 client_cookie=ffd93f03200eda16 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2a7fc700 1 -- 172.21.2.137:0/228388586 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde24009ea0 con 0x7fde2c140aa0 2021-11-15T19:36:08.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2a7fc700 1 -- 172.21.2.137:0/228388586 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2400b860 con 0x7fde2c140aa0 2021-11-15T19:36:08.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde2a7fc700 1 -- 172.21.2.137:0/228388586 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2400b9d0 con 0x7fde2c140aa0 2021-11-15T19:36:08.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- 172.21.2.137:0/228388586 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c140aa0 msgr2=0x7fde2c140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 --2- 172.21.2.137:0/228388586 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c140aa0 0x7fde2c140f10 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fde2c0aee10 tx=0x7fde240091d0).stop 2021-11-15T19:36:08.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- 172.21.2.137:0/228388586 shutdown_connections 2021-11-15T19:36:08.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 --2- 172.21.2.137:0/228388586 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c140aa0 0x7fde2c140f10 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- 172.21.2.137:0/228388586 >> 172.21.2.137:0/228388586 conn(0x7fde2c0631e0 msgr2=0x7fde2c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- 172.21.2.137:0/228388586 shutdown_connections 2021-11-15T19:36:08.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- 172.21.2.137:0/228388586 wait complete. 2021-11-15T19:36:08.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 Processor -- start 2021-11-15T19:36:08.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.858+0000 7fde31cf9700 1 -- start start 2021-11-15T19:36:08.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 0x7fde2c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde2c0b0550 0x7fde2c0662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde2c140aa0 0x7fde2c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c1599e0 con 0x7fde2c0b0550 2021-11-15T19:36:08.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c1428f0 con 0x7fde2c05c770 2021-11-15T19:36:08.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c159c10 con 0x7fde2c140aa0 2021-11-15T19:36:08.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 0x7fde2c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 0x7fde2c15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41466/0 (socket says 172.21.2.137:41466) 2021-11-15T19:36:08.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 -- 172.21.2.137:0/2812667050 learned_addr learned my addr 172.21.2.137:0/2812667050 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:08.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 -- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde2c140aa0 msgr2=0x7fde2c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde2c140aa0 0x7fde2c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 -- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde2c0b0550 msgr2=0x7fde2c0662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde2c0b0550 0x7fde2c0662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 -- 172.21.2.137:0/2812667050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24009470 con 0x7fde2c05c770 2021-11-15T19:36:08.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2b7fe700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 0x7fde2c15a350 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fde2c146ae0 tx=0x7fde20007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2000ce20 con 0x7fde2c05c770 2021-11-15T19:36:08.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde200072e0 con 0x7fde2c05c770 2021-11-15T19:36:08.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde20005800 con 0x7fde2c05c770 2021-11-15T19:36:08.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c159eb0 con 0x7fde2c05c770 2021-11-15T19:36:08.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c066790 con 0x7fde2c05c770 2021-11-15T19:36:08.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c15a040 con 0x7fde2c05c770 2021-11-15T19:36:08.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde20010070 con 0x7fde2c05c770 2021-11-15T19:36:08.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde28ff9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde0c053610 0x7fde0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:08.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fde2006b0b0 con 0x7fde2c05c770 2021-11-15T19:36:08.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2affd700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde0c053610 0x7fde0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:08.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.862+0000 7fde2affd700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde0c053610 0x7fde0c055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fde1c002f90 tx=0x7fde1c0069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:08.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.866+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde20042100 con 0x7fde2c05c770 2021-11-15T19:36:08.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.946+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde2c0ae7f0 con 0x7fde2c05c770 2021-11-15T19:36:08.959 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.946+0000 7fde28ff9700 1 -- 172.21.2.137:0/2812667050 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde20018030 con 0x7fde2c05c770 2021-11-15T19:36:08.959 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:08.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde0c053610 msgr2=0x7fde0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde0c053610 0x7fde0c055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fde1c002f90 tx=0x7fde1c0069b0).stop 2021-11-15T19:36:08.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 msgr2=0x7fde2c15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:08.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 0x7fde2c15a350 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fde2c146ae0 tx=0x7fde20007ca0).stop 2021-11-15T19:36:08.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 shutdown_connections 2021-11-15T19:36:08.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fde0c053610 0x7fde0c055ad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fde2c140aa0 0x7fde2c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fde2c0b0550 0x7fde2c0662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:08.962 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 --2- 172.21.2.137:0/2812667050 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fde2c05c770 0x7fde2c15a350 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:08.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 >> 172.21.2.137:0/2812667050 conn(0x7fde2c0631e0 msgr2=0x7fde2c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:08.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 shutdown_connections 2021-11-15T19:36:08.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:08.950+0000 7fde31cf9700 1 -- 172.21.2.137:0/2812667050 wait complete. 2021-11-15T19:36:08.967 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:36:09.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.006+0000 7fc435660700 1 Processor -- start 2021-11-15T19:36:09.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.006+0000 7fc435660700 1 -- start start 2021-11-15T19:36:09.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b2400 0x7fc4300b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.020 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc4300b5330 0x7fc4300b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc4300b3e70 0x7fc4300b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc430146c20 con 0x7fc4300b5330 2021-11-15T19:36:09.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc430142af0 con 0x7fc4300b3e70 2021-11-15T19:36:09.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300b27e0 con 0x7fc4300b2400 2021-11-15T19:36:09.021 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc4300b3e70 0x7fc4300b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc4300b3e70 0x7fc4300b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41476/0 (socket says 172.21.2.137:41476) 2021-11-15T19:36:09.022 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/2258882834 learned_addr learned my addr 172.21.2.137:0/2258882834 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:09.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/2258882834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b2400 msgr2=0x7fc4300b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:09.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- 172.21.2.137:0/2258882834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b2400 0x7fc4300b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/2258882834 >> v2:172.21.2.111:3300/0 conn(0x7fc4300b5330 msgr2=0x7fc4300b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:09.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- 172.21.2.137:0/2258882834 >> v2:172.21.2.111:3300/0 conn(0x7fc4300b5330 0x7fc4300b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/2258882834 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300b4d80 con 0x7fc4300b3e70 2021-11-15T19:36:09.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- 172.21.2.137:0/2258882834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b3e70 0x7fc4300b5ab0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fc4280032f0 tx=0x7fc428009290).ready entity=mon.1 client_cookie=dde74894ff02ae2d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.027 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42dffb700 1 -- 172.21.2.137:0/2258882834 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc42800b870 con 0x7fc4300b3e70 2021-11-15T19:36:09.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42dffb700 1 -- 172.21.2.137:0/2258882834 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800b9d0 con 0x7fc4300b3e70 2021-11-15T19:36:09.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42dffb700 1 -- 172.21.2.137:0/2258882834 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc42800bb40 con 0x7fc4300b3e70 2021-11-15T19:36:09.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/2258882834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b3e70 msgr2=0x7fc4300b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- 172.21.2.137:0/2258882834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b3e70 0x7fc4300b5ab0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fc4280032f0 tx=0x7fc428009290).stop 2021-11-15T19:36:09.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/2258882834 shutdown_connections 2021-11-15T19:36:09.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- 172.21.2.137:0/2258882834 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b3e70 0x7fc4300b5ab0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- 172.21.2.137:0/2258882834 >> v2:172.21.2.111:3300/0 conn(0x7fc4300b5330 0x7fc4300b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- 172.21.2.137:0/2258882834 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b2400 0x7fc4300b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/2258882834 >> 172.21.2.137:0/2258882834 conn(0x7fc4300623a0 msgr2=0x7fc430062780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:09.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/2258882834 shutdown_connections 2021-11-15T19:36:09.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/2258882834 wait complete. 2021-11-15T19:36:09.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 Processor -- start 2021-11-15T19:36:09.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- start start 2021-11-15T19:36:09.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4300b2400 0x7fc430115670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b3e70 0x7fc430115b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 0x7fc43013eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301136d0 con 0x7fc4300b2400 2021-11-15T19:36:09.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc430113970 con 0x7fc4300b5330 2021-11-15T19:36:09.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300afd90 con 0x7fc4300b3e70 2021-11-15T19:36:09.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 0x7fc43013eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 0x7fc43013eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41484/0 (socket says 172.21.2.137:41484) 2021-11-15T19:36:09.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/3241948526 learned_addr learned my addr 172.21.2.137:0/3241948526 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:09.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b3e70 msgr2=0x7fc430115b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b3e70 0x7fc430115b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4300b2400 msgr2=0x7fc430115670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4300b2400 0x7fc430115670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 -- 172.21.2.137:0/3241948526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428009530 con 0x7fc4300b5330 2021-11-15T19:36:09.033 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc42f7fe700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 0x7fc43013eea0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fc4280032f0 tx=0x7fc428016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc42800b870 con 0x7fc4300b5330 2021-11-15T19:36:09.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc428020430 con 0x7fc4300b5330 2021-11-15T19:36:09.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc430112470 con 0x7fc4300b5330 2021-11-15T19:36:09.034 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300afb10 con 0x7fc4300b5330 2021-11-15T19:36:09.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.010+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc428020790 con 0x7fc4300b5330 2021-11-15T19:36:09.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4300573d0 con 0x7fc4300b5330 2021-11-15T19:36:09.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc42800f070 con 0x7fc4300b5330 2021-11-15T19:36:09.035 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc427fff700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc414053660 0x7fc414055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc42806cd50 con 0x7fc4300b5330 2021-11-15T19:36:09.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc42effd700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc414053660 0x7fc414055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc42effd700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc414053660 0x7fc414055b20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fc420002f70 tx=0x7fc420006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.036 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.014+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc428043da0 con 0x7fc4300b5330 2021-11-15T19:36:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc430113ae0 con 0x7fc4300b5330 2021-11-15T19:36:09.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc427fff700 1 -- 172.21.2.137:0/3241948526 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc428015020 con 0x7fc4300b5330 2021-11-15T19:36:09.110 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc414053660 msgr2=0x7fc414055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc414053660 0x7fc414055b20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fc420002f70 tx=0x7fc420006a80).stop 2021-11-15T19:36:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 msgr2=0x7fc43013eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 0x7fc43013eea0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fc4280032f0 tx=0x7fc428016000).stop 2021-11-15T19:36:09.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 shutdown_connections 2021-11-15T19:36:09.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc414053660 0x7fc414055b20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc4300b5330 0x7fc43013eea0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc4300b3e70 0x7fc430115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 --2- 172.21.2.137:0/3241948526 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc4300b2400 0x7fc430115670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 >> 172.21.2.137:0/3241948526 conn(0x7fc4300623a0 msgr2=0x7fc4300b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:09.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 shutdown_connections 2021-11-15T19:36:09.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.098+0000 7fc435660700 1 -- 172.21.2.137:0/3241948526 wait complete. 2021-11-15T19:36:09.117 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:36:09.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 Processor -- start 2021-11-15T19:36:09.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- start start 2021-11-15T19:36:09.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efde005c770 0x7efde00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7efde0140aa0 0x7efde0140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde005cb50 con 0x7efde00b0550 2021-11-15T19:36:09.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00b1650 con 0x7efde0140aa0 2021-11-15T19:36:09.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00ad030 con 0x7efde005c770 2021-11-15T19:36:09.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde4d93700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7efde00b0550 0x7efde014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60270/0 (socket says 172.21.2.137:60270) 2021-11-15T19:36:09.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde4d93700 1 -- 172.21.2.137:0/3618236460 learned_addr learned my addr 172.21.2.137:0/3618236460 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:09.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde5594700 1 --2- 172.21.2.137:0/3618236460 >> v2:172.21.2.137:3300/0 conn(0x7efde005c770 0x7efde00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde5594700 1 -- 172.21.2.137:0/3618236460 >> v2:172.21.2.111:3300/0 conn(0x7efde0140aa0 msgr2=0x7efde0140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:09.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde5594700 1 --2- 172.21.2.137:0/3618236460 >> v2:172.21.2.111:3300/0 conn(0x7efde0140aa0 0x7efde0140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde5594700 1 -- 172.21.2.137:0/3618236460 >> v1:172.21.2.137:6789/0 conn(0x7efde00b0550 legacy=0x7efde014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efdd3fff700 1 -- 172.21.2.137:0/3618236460 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970337542 0 0) 0x7efde005cb50 con 0x7efde00b0550 2021-11-15T19:36:09.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde5594700 1 -- 172.21.2.137:0/3618236460 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00ad2d0 con 0x7efde005c770 2021-11-15T19:36:09.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde5594700 1 --2- 172.21.2.137:0/3618236460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde00aef30 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7efddc002f70 tx=0x7efddc006df0).ready entity=mon.1 client_cookie=f4b29d7ba23b8555 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efdd3fff700 1 -- 172.21.2.137:0/3618236460 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efddc00d5c0 con 0x7efde005c770 2021-11-15T19:36:09.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efdd3fff700 1 -- 172.21.2.137:0/3618236460 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc000e90 con 0x7efde005c770 2021-11-15T19:36:09.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efdd3fff700 1 -- 172.21.2.137:0/3618236460 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efddc00d910 con 0x7efde005c770 2021-11-15T19:36:09.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- 172.21.2.137:0/3618236460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 msgr2=0x7efde00aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 --2- 172.21.2.137:0/3618236460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde00aef30 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7efddc002f70 tx=0x7efddc006df0).stop 2021-11-15T19:36:09.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- 172.21.2.137:0/3618236460 shutdown_connections 2021-11-15T19:36:09.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 --2- 172.21.2.137:0/3618236460 >> v2:172.21.2.111:3300/0 conn(0x7efde0140aa0 0x7efde0140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 --2- 172.21.2.137:0/3618236460 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde00aef30 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- 172.21.2.137:0/3618236460 >> 172.21.2.137:0/3618236460 conn(0x7efde00631e0 msgr2=0x7efde005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:09.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- 172.21.2.137:0/3618236460 shutdown_connections 2021-11-15T19:36:09.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.158+0000 7efde77f8700 1 -- 172.21.2.137:0/3618236460 wait complete. 2021-11-15T19:36:09.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 Processor -- start 2021-11-15T19:36:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- start start 2021-11-15T19:36:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde01438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efde00b0550 0x7efde014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efde0140aa0 0x7efde0066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00657a0 con 0x7efde0140aa0 2021-11-15T19:36:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00659a0 con 0x7efde005c770 2021-11-15T19:36:09.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0065c40 con 0x7efde00b0550 2021-11-15T19:36:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde01438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde01438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41498/0 (socket says 172.21.2.137:41498) 2021-11-15T19:36:09.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 -- 172.21.2.137:0/3966142883 learned_addr learned my addr 172.21.2.137:0/3966142883 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 -- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efde00b0550 msgr2=0x7efde014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efde00b0550 0x7efde014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 -- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efde0140aa0 msgr2=0x7efde0066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efde0140aa0 0x7efde0066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 -- 172.21.2.137:0/3966142883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc00b180 con 0x7efde005c770 2021-11-15T19:36:09.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde5594700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde01438e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7efde01426e0 tx=0x7efddc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efddc016070 con 0x7efde005c770 2021-11-15T19:36:09.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00de90 con 0x7efde005c770 2021-11-15T19:36:09.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde0065ee0 con 0x7efde005c770 2021-11-15T19:36:09.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0159930 con 0x7efde005c770 2021-11-15T19:36:09.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efddc01e450 con 0x7efde005c770 2021-11-15T19:36:09.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde00ae7f0 con 0x7efde005c770 2021-11-15T19:36:09.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efddc025030 con 0x7efde005c770 2021-11-15T19:36:09.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efdd27fc700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efdc00536a0 0x7efdc0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7efddc06cb50 con 0x7efde005c770 2021-11-15T19:36:09.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.162+0000 7efde4d93700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efdc00536a0 0x7efdc0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.166+0000 7efde4d93700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efdc00536a0 0x7efdc0055b60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7efdd4000bc0 tx=0x7efdd40011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.166+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efddc043cb0 con 0x7efde005c770 2021-11-15T19:36:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.246+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efde00573d0 con 0x7efde005c770 2021-11-15T19:36:09.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.246+0000 7efdd27fc700 1 -- 172.21.2.137:0/3966142883 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7efddc023020 con 0x7efde005c770 2021-11-15T19:36:09.260 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efdc00536a0 msgr2=0x7efdc0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efdc00536a0 0x7efdc0055b60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7efdd4000bc0 tx=0x7efdd40011a0).stop 2021-11-15T19:36:09.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 msgr2=0x7efde01438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde01438e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7efde01426e0 tx=0x7efddc014000).stop 2021-11-15T19:36:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 shutdown_connections 2021-11-15T19:36:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efdc00536a0 0x7efdc0055b60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.262 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efde0140aa0 0x7efde0066640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efde00b0550 0x7efde014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 --2- 172.21.2.137:0/3966142883 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efde005c770 0x7efde01438e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 >> 172.21.2.137:0/3966142883 conn(0x7efde00631e0 msgr2=0x7efde013ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 shutdown_connections 2021-11-15T19:36:09.263 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.250+0000 7efde77f8700 1 -- 172.21.2.137:0/3966142883 wait complete. 2021-11-15T19:36:09.267 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:36:09.267 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:09.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 Processor -- start 2021-11-15T19:36:09.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 -- start start 2021-11-15T19:36:09.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009c8c0 0x7f0c4009cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f0c400b3140 0x7f0c4005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0c4009ab00 0x7f0c40143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4009d190 con 0x7f0c400b3140 2021-11-15T19:36:09.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c40099790 con 0x7f0c4009ab00 2021-11-15T19:36:09.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c45a74700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400b2940 con 0x7f0c4009c8c0 2021-11-15T19:36:09.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0c4009ab00 0x7f0c40143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0c4009ab00 0x7f0c40143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41506/0 (socket says 172.21.2.137:41506) 2021-11-15T19:36:09.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 -- 172.21.2.137:0/1303758191 learned_addr learned my addr 172.21.2.137:0/1303758191 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:09.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 -- 172.21.2.137:0/1303758191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009c8c0 msgr2=0x7f0c4009cca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:09.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 --2- 172.21.2.137:0/1303758191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009c8c0 0x7f0c4009cca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 -- 172.21.2.137:0/1303758191 >> v2:172.21.2.111:3300/0 conn(0x7f0c400b3140 msgr2=0x7f0c4005f730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:09.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 --2- 172.21.2.137:0/1303758191 >> v2:172.21.2.111:3300/0 conn(0x7f0c400b3140 0x7f0c4005f730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 -- 172.21.2.137:0/1303758191 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40099a30 con 0x7f0c4009ab00 2021-11-15T19:36:09.325 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3ffff700 1 --2- 172.21.2.137:0/1303758191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009ab00 0x7f0c40143260 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f0c380032f0 tx=0x7f0c38009290).ready entity=mon.1 client_cookie=6ee89f9b98ec6f75 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.306+0000 7f0c3e7fc700 1 -- 172.21.2.137:0/1303758191 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c3800b870 con 0x7f0c4009ab00 2021-11-15T19:36:09.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3e7fc700 1 -- 172.21.2.137:0/1303758191 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3800b9d0 con 0x7f0c4009ab00 2021-11-15T19:36:09.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3e7fc700 1 -- 172.21.2.137:0/1303758191 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c3800bb80 con 0x7f0c4009ab00 2021-11-15T19:36:09.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/1303758191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009ab00 msgr2=0x7f0c40143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- 172.21.2.137:0/1303758191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009ab00 0x7f0c40143260 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f0c380032f0 tx=0x7f0c38009290).stop 2021-11-15T19:36:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/1303758191 shutdown_connections 2021-11-15T19:36:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- 172.21.2.137:0/1303758191 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009ab00 0x7f0c40143260 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- 172.21.2.137:0/1303758191 >> v2:172.21.2.111:3300/0 conn(0x7f0c400b3140 0x7f0c4005f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- 172.21.2.137:0/1303758191 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009c8c0 0x7f0c4009cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/1303758191 >> 172.21.2.137:0/1303758191 conn(0x7f0c400b45b0 msgr2=0x7f0c4005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/1303758191 shutdown_connections 2021-11-15T19:36:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/1303758191 wait complete. 2021-11-15T19:36:09.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 Processor -- start 2021-11-15T19:36:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- start start 2021-11-15T19:36:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009ab00 0x7f0c40097f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 0x7f0c40159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c400b3140 0x7f0c4013ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40061cd0 con 0x7f0c400b3140 2021-11-15T19:36:09.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40159d60 con 0x7f0c4009c8c0 2021-11-15T19:36:09.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40159f80 con 0x7f0c4009ab00 2021-11-15T19:36:09.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 0x7f0c40159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 0x7f0c40159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41508/0 (socket says 172.21.2.137:41508) 2021-11-15T19:36:09.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 -- 172.21.2.137:0/3047097735 learned_addr learned my addr 172.21.2.137:0/3047097735 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:09.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 -- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009ab00 msgr2=0x7f0c40097f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:09.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009ab00 0x7f0c40097f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 -- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c400b3140 msgr2=0x7f0c4013ac40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:09.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c400b3140 0x7f0c4013ac40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 -- 172.21.2.137:0/3047097735 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38009530 con 0x7f0c4009c8c0 2021-11-15T19:36:09.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3effd700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 0x7f0c40159870 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f0c30000ed0 tx=0x7f0c30006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c30009e00 con 0x7f0c4009c8c0 2021-11-15T19:36:09.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30012410 con 0x7f0c4009c8c0 2021-11-15T19:36:09.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4015a220 con 0x7f0c4009c8c0 2021-11-15T19:36:09.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c30012770 con 0x7f0c4009c8c0 2021-11-15T19:36:09.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40062780 con 0x7f0c4009c8c0 2021-11-15T19:36:09.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c400573d0 con 0x7f0c4009c8c0 2021-11-15T19:36:09.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c3000f030 con 0x7f0c4009c8c0 2021-11-15T19:36:09.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3cff9700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c200536f0 0x7f0c20055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:09.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.310+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0c3006b5b0 con 0x7f0c4009c8c0 2021-11-15T19:36:09.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.314+0000 7f0c3f7fe700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c200536f0 0x7f0c20055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:09.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.314+0000 7f0c3f7fe700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c200536f0 0x7f0c20055bb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f0c34002fb0 tx=0x7f0c34006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:09.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.314+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c30042600 con 0x7f0c4009c8c0 2021-11-15T19:36:09.433 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c40142df0 con 0x7f0c4009c8c0 2021-11-15T19:36:09.434 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c3cff9700 1 -- 172.21.2.137:0/3047097735 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f0c30045c20 con 0x7f0c4009c8c0 2021-11-15T19:36:09.434 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:09.434 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/2020936860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2020936860},{"type":"v1","addr":"172.21.2.111:6835","nonce":2020936860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:36:05.764984+0000","modified":"2021-11-15T19:36:07.143006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8641":{"gid":8641,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/754709113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":754709113},{"type":"v1","addr":"172.21.2.137:6833","nonce":754709113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T19:36:09.435 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c200536f0 msgr2=0x7f0c20055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c200536f0 0x7f0c20055bb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f0c34002fb0 tx=0x7f0c34006930).stop 2021-11-15T19:36:09.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 msgr2=0x7f0c40159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:09.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 0x7f0c40159870 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f0c30000ed0 tx=0x7f0c30006d60).stop 2021-11-15T19:36:09.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 shutdown_connections 2021-11-15T19:36:09.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0c200536f0 0x7f0c20055bb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0c400b3140 0x7f0c4013ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0c4009c8c0 0x7f0c40159870 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:09.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 --2- 172.21.2.137:0/3047097735 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0c4009ab00 0x7f0c40097f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:09.437 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 >> 172.21.2.137:0/3047097735 conn(0x7f0c400b45b0 msgr2=0x7f0c4013ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:09.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 shutdown_connections 2021-11-15T19:36:09.438 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:09.422+0000 7f0c45a74700 1 -- 172.21.2.137:0/3047097735 wait complete. 2021-11-15T19:36:09.438 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 80 2021-11-15T19:36:09.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:36:05.764984+0000', 'modified': '2021-11-15T19:36:07.143006+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8641': {'gid': 8641, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/754709113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 754709113}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 754709113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:36:09.643 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:36:09.643 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:36:09.708 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":8641,"want_state":"up:active","state":"up:active","rank_uptime":3.9294351550000002,"mdsmap_epoch":80,"osdmap_epoch":152,"osdmap_epoch_barrier":151,"uptime":8.1004653819999994} 2021-11-15T19:36:09.708 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 8641, "mdsmap_epoch": 80, "osdmap_epoch": 152, "osdmap_epoch_barrier": 151, "rank_uptime": 3.929435155, "state": "up:active", "uptime": 8.100465382, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:36:09.709 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:36:09.709 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T19:36:09.709 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba031.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T19:36:09.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:09.710 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:36:09.721 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:36:09.772 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:36:09.773 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:36:09.779 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:36:09.779 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:36:09.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:09.781 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:36:09.785 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:36:09.785 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:36:09.827 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:36:09.837 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:36:09.838 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:36:09.843 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:36:09.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:36:09.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:09.845 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:36:09.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:2021-11-15T19:36:09.862+0000 7fd264891080 -1 init, newargv = 0x55f1306cda30 newargc=9 2021-11-15T19:36:09.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15432]: starting ceph client 2021-11-15T19:36:09.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba031.stderr:ceph-fuse[15432]: starting fuse 2021-11-15T19:36:10.973 DEBUG:teuthology.orchestra.run.gibba031:> sudo modprobe fuse 2021-11-15T19:36:10.985 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:36:10.986 DEBUG:teuthology.orchestra.run.gibba031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:36:11.038 INFO:teuthology.orchestra.run.gibba031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:36:11.039 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:36:11.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:11.040 DEBUG:teuthology.orchestra.run.gibba031:> ls /sys/fs/fuse/connections 2021-11-15T19:36:11.046 INFO:teuthology.orchestra.run.gibba031.stdout:52 2021-11-15T19:36:11.047 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:36:11.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:11.048 DEBUG:teuthology.orchestra.run.gibba031:> sudo python3 -c ' 2021-11-15T19:36:11.049 DEBUG:teuthology.orchestra.run.gibba031:> import glob 2021-11-15T19:36:11.050 DEBUG:teuthology.orchestra.run.gibba031:> import re 2021-11-15T19:36:11.051 DEBUG:teuthology.orchestra.run.gibba031:> import os 2021-11-15T19:36:11.051 DEBUG:teuthology.orchestra.run.gibba031:> import subprocess 2021-11-15T19:36:11.052 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:36:11.053 DEBUG:teuthology.orchestra.run.gibba031:> def find_socket(client_name): 2021-11-15T19:36:11.053 DEBUG:teuthology.orchestra.run.gibba031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T19:36:11.054 DEBUG:teuthology.orchestra.run.gibba031:> files = glob.glob(asok_path) 2021-11-15T19:36:11.054 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:36:11.055 DEBUG:teuthology.orchestra.run.gibba031:> # Given a non-glob path, it better be there 2021-11-15T19:36:11.056 DEBUG:teuthology.orchestra.run.gibba031:> if "*" not in asok_path: 2021-11-15T19:36:11.056 DEBUG:teuthology.orchestra.run.gibba031:> assert(len(files) == 1) 2021-11-15T19:36:11.056 DEBUG:teuthology.orchestra.run.gibba031:> return files[0] 2021-11-15T19:36:11.057 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:36:11.057 DEBUG:teuthology.orchestra.run.gibba031:> for f in files: 2021-11-15T19:36:11.058 DEBUG:teuthology.orchestra.run.gibba031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:36:11.058 DEBUG:teuthology.orchestra.run.gibba031:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:36:11.059 DEBUG:teuthology.orchestra.run.gibba031:> return f 2021-11-15T19:36:11.059 DEBUG:teuthology.orchestra.run.gibba031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:36:11.060 DEBUG:teuthology.orchestra.run.gibba031:> 2021-11-15T19:36:11.060 DEBUG:teuthology.orchestra.run.gibba031:> print(find_socket("client.0")) 2021-11-15T19:36:11.061 DEBUG:teuthology.orchestra.run.gibba031:> ' 2021-11-15T19:36:11.095 INFO:teuthology.orchestra.run.gibba031.stdout:/var/run/ceph/ceph-client.0.15432.asok 2021-11-15T19:36:11.098 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15432.asok 2021-11-15T19:36:11.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:11.099 DEBUG:teuthology.orchestra.run.gibba031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15432.asok status 2021-11-15T19:36:11.202 INFO:teuthology.orchestra.run.gibba031.stdout:{ 2021-11-15T19:36:11.203 INFO:teuthology.orchestra.run.gibba031.stdout: "metadata": { 2021-11-15T19:36:11.203 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:36:11.203 INFO:teuthology.orchestra.run.gibba031.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:36:11.204 INFO:teuthology.orchestra.run.gibba031.stdout: "entity_id": "0", 2021-11-15T19:36:11.204 INFO:teuthology.orchestra.run.gibba031.stdout: "hostname": "gibba031", 2021-11-15T19:36:11.204 INFO:teuthology.orchestra.run.gibba031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T19:36:11.204 INFO:teuthology.orchestra.run.gibba031.stdout: "pid": "15432", 2021-11-15T19:36:11.204 INFO:teuthology.orchestra.run.gibba031.stdout: "root": "/" 2021-11-15T19:36:11.205 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:36:11.205 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_count": 0, 2021-11-15T19:36:11.205 INFO:teuthology.orchestra.run.gibba031.stdout: "dentry_pinned_count": 0, 2021-11-15T19:36:11.205 INFO:teuthology.orchestra.run.gibba031.stdout: "id": 5667, 2021-11-15T19:36:11.205 INFO:teuthology.orchestra.run.gibba031.stdout: "inst": { 2021-11-15T19:36:11.206 INFO:teuthology.orchestra.run.gibba031.stdout: "name": { 2021-11-15T19:36:11.206 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "client", 2021-11-15T19:36:11.206 INFO:teuthology.orchestra.run.gibba031.stdout: "num": 5667 2021-11-15T19:36:11.206 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:36:11.207 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:36:11.207 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:36:11.207 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:36:11.207 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1084588585 2021-11-15T19:36:11.207 INFO:teuthology.orchestra.run.gibba031.stdout: } 2021-11-15T19:36:11.208 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:36:11.208 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": { 2021-11-15T19:36:11.208 INFO:teuthology.orchestra.run.gibba031.stdout: "type": "v1", 2021-11-15T19:36:11.208 INFO:teuthology.orchestra.run.gibba031.stdout: "addr": "172.21.2.131:0", 2021-11-15T19:36:11.209 INFO:teuthology.orchestra.run.gibba031.stdout: "nonce": 1084588585 2021-11-15T19:36:11.209 INFO:teuthology.orchestra.run.gibba031.stdout: }, 2021-11-15T19:36:11.209 INFO:teuthology.orchestra.run.gibba031.stdout: "inst_str": "client.5667 172.21.2.131:0/1084588585", 2021-11-15T19:36:11.209 INFO:teuthology.orchestra.run.gibba031.stdout: "addr_str": "172.21.2.131:0/1084588585", 2021-11-15T19:36:11.209 INFO:teuthology.orchestra.run.gibba031.stdout: "inode_count": 1, 2021-11-15T19:36:11.210 INFO:teuthology.orchestra.run.gibba031.stdout: "mds_epoch": 80, 2021-11-15T19:36:11.210 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch": 152, 2021-11-15T19:36:11.210 INFO:teuthology.orchestra.run.gibba031.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:36:11.210 INFO:teuthology.orchestra.run.gibba031.stdout: "blacklisted": false, 2021-11-15T19:36:11.211 INFO:teuthology.orchestra.run.gibba031.stdout: "fs_name": "cephfs" 2021-11-15T19:36:11.211 INFO:teuthology.orchestra.run.gibba031.stdout:} 2021-11-15T19:36:11.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:11.213 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:11.213 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:36:11.219 INFO:teuthology.orchestra.run.gibba031.stdout:fuseblk 2021-11-15T19:36:11.219 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T19:36:11.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:11.220 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:36:11.227 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T19:36:11.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 Processor -- start 2021-11-15T19:36:11.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 -- start start 2021-11-15T19:36:11.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff304147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff304143f00 0x7ff304144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff304148190 con 0x7ff3040a9f50 2021-11-15T19:36:11.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3040b1720 con 0x7ff304143f00 2021-11-15T19:36:11.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff309c26700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304147e70 con 0x7ff3040b1340 2021-11-15T19:36:11.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff3037fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff304147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff3037fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff304147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:43088/0 (socket says 172.21.2.137:43088) 2021-11-15T19:36:11.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff3037fe700 1 -- 172.21.2.137:0/2992210322 learned_addr learned my addr 172.21.2.137:0/2992210322 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.270+0000 7ff302ffd700 1 --2- 172.21.2.137:0/2992210322 >> v2:172.21.2.111:3300/0 conn(0x7ff304143f00 0x7ff304144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3037fe700 1 -- 172.21.2.137:0/2992210322 >> v2:172.21.2.111:3300/0 conn(0x7ff304143f00 msgr2=0x7ff304144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3037fe700 1 --2- 172.21.2.137:0/2992210322 >> v2:172.21.2.111:3300/0 conn(0x7ff304143f00 0x7ff304144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3037fe700 1 -- 172.21.2.137:0/2992210322 >> v1:172.21.2.111:6789/0 conn(0x7ff3040a9f50 legacy=0x7ff3040aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3037fe700 1 -- 172.21.2.137:0/2992210322 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040af800 con 0x7ff3040b1340 2021-11-15T19:36:11.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff302ffd700 1 --2- 172.21.2.137:0/2992210322 >> v2:172.21.2.111:3300/0 conn(0x7ff304143f00 0x7ff304144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T19:36:11.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3037fe700 1 --2- 172.21.2.137:0/2992210322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff304147980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec006eb0).ready entity=mon.2 client_cookie=ee3a968957fba6bf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3027fc700 1 -- 172.21.2.137:0/2992210322 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec00d570 con 0x7ff3040b1340 2021-11-15T19:36:11.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3027fc700 1 -- 172.21.2.137:0/2992210322 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec000e90 con 0x7ff3040b1340 2021-11-15T19:36:11.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff3027fc700 1 -- 172.21.2.137:0/2992210322 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec00d900 con 0x7ff3040b1340 2021-11-15T19:36:11.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- 172.21.2.137:0/2992210322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 msgr2=0x7ff304147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 --2- 172.21.2.137:0/2992210322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff304147980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec006eb0).stop 2021-11-15T19:36:11.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- 172.21.2.137:0/2992210322 shutdown_connections 2021-11-15T19:36:11.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 --2- 172.21.2.137:0/2992210322 >> v2:172.21.2.111:3300/0 conn(0x7ff304143f00 0x7ff304144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 --2- 172.21.2.137:0/2992210322 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff304147980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- 172.21.2.137:0/2992210322 >> 172.21.2.137:0/2992210322 conn(0x7ff3040b4e60 msgr2=0x7ff3040b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- 172.21.2.137:0/2992210322 shutdown_connections 2021-11-15T19:36:11.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- 172.21.2.137:0/2992210322 wait complete. 2021-11-15T19:36:11.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 Processor -- start 2021-11-15T19:36:11.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- start start 2021-11-15T19:36:11.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff3040a9f50 0x7ff304157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff30414a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 0x7ff3040ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304157640 con 0x7ff3040a9f50 2021-11-15T19:36:11.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304149ea0 con 0x7ff304143f00 2021-11-15T19:36:11.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff309c26700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30413ff90 con 0x7ff3040b1340 2021-11-15T19:36:11.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 0x7ff3040ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 0x7ff3040ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41524/0 (socket says 172.21.2.137:41524) 2021-11-15T19:36:11.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 -- 172.21.2.137:0/2450014415 learned_addr learned my addr 172.21.2.137:0/2450014415 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 -- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 msgr2=0x7ff30414a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff30414a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 -- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff3040a9f50 msgr2=0x7ff304157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff3040a9f50 0x7ff304157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 -- 172.21.2.137:0/2450014415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f400b180 con 0x7ff304143f00 2021-11-15T19:36:11.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.274+0000 7ff303fff700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 0x7ff3040ad200 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7ff30405cfa0 tx=0x7ff2fc007f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc00f470 con 0x7ff304143f00 2021-11-15T19:36:11.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00f5d0 con 0x7ff304143f00 2021-11-15T19:36:11.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc00f930 con 0x7ff304143f00 2021-11-15T19:36:11.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec00b1e0 con 0x7ff304143f00 2021-11-15T19:36:11.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3040af3c0 con 0x7ff304143f00 2021-11-15T19:36:11.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3040573d0 con 0x7ff304143f00 2021-11-15T19:36:11.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2fc019030 con 0x7ff304143f00 2021-11-15T19:36:11.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e8053610 0x7ff2e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff2fc06b0d0 con 0x7ff304143f00 2021-11-15T19:36:11.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff3037fe700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e8053610 0x7ff2e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff3037fe700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e8053610 0x7ff2e8055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.278+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2fc042120 con 0x7ff304143f00 2021-11-15T19:36:11.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3041403a0 con 0x7ff304143f00 2021-11-15T19:36:11.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff300ff9700 1 -- 172.21.2.137:0/2450014415 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16052 (secure 0 0 0) 0x7ff2fc045740 con 0x7ff304143f00 2021-11-15T19:36:11.375 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:11.376 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":152,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:07.774435+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T19:36:03.668546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T19:36:04.747069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T19:36:11.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e8053610 msgr2=0x7ff2e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.377 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e8053610 0x7ff2e8055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec015000).stop 2021-11-15T19:36:11.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 msgr2=0x7ff3040ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 0x7ff3040ad200 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7ff30405cfa0 tx=0x7ff2fc007f50).stop 2021-11-15T19:36:11.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 shutdown_connections 2021-11-15T19:36:11.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2e8053610 0x7ff2e8055ad0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff304143f00 0x7ff3040ad200 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.362+0000 7ff309c26700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff3040b1340 0x7ff30414a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.366+0000 7ff309c26700 1 --2- 172.21.2.137:0/2450014415 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff3040a9f50 0x7ff304157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.366+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 >> 172.21.2.137:0/2450014415 conn(0x7ff3040b4e60 msgr2=0x7ff3040b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.366+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 shutdown_connections 2021-11-15T19:36:11.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.366+0000 7ff309c26700 1 -- 172.21.2.137:0/2450014415 wait complete. 2021-11-15T19:36:11.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T19:26:43.362687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T19:26:51.213620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T19:36:03.668546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T19:36:04.747069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T19:36:11.383 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T19:36:11.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.422+0000 7f01d9319700 1 Processor -- start 2021-11-15T19:36:11.436 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.422+0000 7f01d9319700 1 -- start start 2021-11-15T19:36:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d405c770 0x7f01d40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f01d40b0550 0x7f01d414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d405cb50 con 0x7f01d414aaa0 2021-11-15T19:36:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40b1650 con 0x7f01d40b0550 2021-11-15T19:36:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40ad030 con 0x7f01d405c770 2021-11-15T19:36:11.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d37fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f01d414aaa0 0x7f01d4140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60316/0 (socket says 172.21.2.137:60316) 2021-11-15T19:36:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d37fe700 1 -- 172.21.2.137:0/2279609772 learned_addr learned my addr 172.21.2.137:0/2279609772 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d27fc700 1 --2- 172.21.2.137:0/2279609772 >> v2:172.21.2.137:3300/0 conn(0x7f01d40b0550 0x7f01d414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d27fc700 1 -- 172.21.2.137:0/2279609772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d405c770 msgr2=0x7f01d40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d27fc700 1 --2- 172.21.2.137:0/2279609772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d405c770 0x7f01d40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d27fc700 1 -- 172.21.2.137:0/2279609772 >> v1:172.21.2.137:6789/0 conn(0x7f01d414aaa0 legacy=0x7f01d4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d1ffb700 1 -- 172.21.2.137:0/2279609772 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438699693 0 0) 0x7f01d405cb50 con 0x7f01d414aaa0 2021-11-15T19:36:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d27fc700 1 -- 172.21.2.137:0/2279609772 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40ad2d0 con 0x7f01d40b0550 2021-11-15T19:36:11.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d27fc700 1 --2- 172.21.2.137:0/2279609772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d40b0550 0x7f01d414a5b0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f01c8002f70 tx=0x7f01c8006df0).ready entity=mon.1 client_cookie=cfba5abbe84fd3e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d1ffb700 1 -- 172.21.2.137:0/2279609772 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01c800d570 con 0x7f01d40b0550 2021-11-15T19:36:11.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d1ffb700 1 -- 172.21.2.137:0/2279609772 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8000e90 con 0x7f01d40b0550 2021-11-15T19:36:11.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d1ffb700 1 -- 172.21.2.137:0/2279609772 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01c800d8c0 con 0x7f01d40b0550 2021-11-15T19:36:11.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2279609772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d40b0550 msgr2=0x7f01d414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.443 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- 172.21.2.137:0/2279609772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d40b0550 0x7f01d414a5b0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f01c8002f70 tx=0x7f01c8006df0).stop 2021-11-15T19:36:11.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2279609772 shutdown_connections 2021-11-15T19:36:11.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- 172.21.2.137:0/2279609772 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d40b0550 0x7f01d414a5b0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- 172.21.2.137:0/2279609772 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d405c770 0x7f01d40aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2279609772 >> 172.21.2.137:0/2279609772 conn(0x7f01d40631e0 msgr2=0x7f01d405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2279609772 shutdown_connections 2021-11-15T19:36:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2279609772 wait complete. 2021-11-15T19:36:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 Processor -- start 2021-11-15T19:36:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- start start 2021-11-15T19:36:11.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 0x7f01d41497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01d40b0550 0x7f01d41424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d414aaa0 0x7f01d41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40638f0 con 0x7f01d40b0550 2021-11-15T19:36:11.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4142b90 con 0x7f01d405c770 2021-11-15T19:36:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4142e30 con 0x7f01d414aaa0 2021-11-15T19:36:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 0x7f01d41497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 0x7f01d41497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41536/0 (socket says 172.21.2.137:41536) 2021-11-15T19:36:11.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 -- 172.21.2.137:0/2065383158 learned_addr learned my addr 172.21.2.137:0/2065383158 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 -- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d414aaa0 msgr2=0x7f01d41598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d414aaa0 0x7f01d41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 -- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01d40b0550 msgr2=0x7f01d41424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01d40b0550 0x7f01d41424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 -- 172.21.2.137:0/2065383158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c800b180 con 0x7f01d405c770 2021-11-15T19:36:11.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d2ffd700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 0x7f01d41497d0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f01d4147100 tx=0x7f01c4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01c4013460 con 0x7f01d405c770 2021-11-15T19:36:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c40135c0 con 0x7f01d405c770 2021-11-15T19:36:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d41432c0 con 0x7f01d405c770 2021-11-15T19:36:11.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01c4013920 con 0x7f01d405c770 2021-11-15T19:36:11.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.426+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4063d20 con 0x7f01d405c770 2021-11-15T19:36:11.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d41429e0 con 0x7f01d405c770 2021-11-15T19:36:11.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f01c401a060 con 0x7f01d405c770 2021-11-15T19:36:11.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01c3fff700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01b00536a0 0x7f01b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f01c406b4b0 con 0x7f01d405c770 2021-11-15T19:36:11.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01d27fc700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01b00536a0 0x7f01b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01d27fc700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01b00536a0 0x7f01b0055b60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f01c8002f70 tx=0x7f01c8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.430+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01c4042500 con 0x7f01d405c770 2021-11-15T19:36:11.528 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f01d40ae7f0 con 0x7f01d405c770 2021-11-15T19:36:11.529 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01c3fff700 1 -- 172.21.2.137:0/2065383158 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7f01c4018020 con 0x7f01d405c770 2021-11-15T19:36:11.529 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 1 2021-11-15T19:36:11.530 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01b00536a0 msgr2=0x7f01b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01b00536a0 0x7f01b0055b60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f01c8002f70 tx=0x7f01c8015000).stop 2021-11-15T19:36:11.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 msgr2=0x7f01d41497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 0x7f01d41497d0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f01d4147100 tx=0x7f01c4006ec0).stop 2021-11-15T19:36:11.531 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 shutdown_connections 2021-11-15T19:36:11.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f01b00536a0 0x7f01b0055b60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f01d414aaa0 0x7f01d41598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f01d40b0550 0x7f01d41424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 --2- 172.21.2.137:0/2065383158 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f01d405c770 0x7f01d41497d0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 >> 172.21.2.137:0/2065383158 conn(0x7f01d40631e0 msgr2=0x7f01d4140cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 shutdown_connections 2021-11-15T19:36:11.533 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.518+0000 7f01d9319700 1 -- 172.21.2.137:0/2065383158 wait complete. 2021-11-15T19:36:11.536 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T19:36:11.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 Processor -- start 2021-11-15T19:36:11.590 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- start start 2021-11-15T19:36:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fe75405c770 0x7fe7540aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe754140aa0 0x7fe754140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.591 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75405cb50 con 0x7fe7540b0550 2021-11-15T19:36:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7540b1650 con 0x7fe75405c770 2021-11-15T19:36:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7540ad030 con 0x7fe754140aa0 2021-11-15T19:36:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe754140aa0 0x7fe754140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe754140aa0 0x7fe754140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41544/0 (socket says 172.21.2.137:41544) 2021-11-15T19:36:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 -- 172.21.2.137:0/2614080541 learned_addr learned my addr 172.21.2.137:0/2614080541 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 -- 172.21.2.137:0/2614080541 >> v2:172.21.2.111:3300/0 conn(0x7fe75405c770 msgr2=0x7fe7540aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 --2- 172.21.2.137:0/2614080541 >> v2:172.21.2.111:3300/0 conn(0x7fe75405c770 0x7fe7540aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 -- 172.21.2.137:0/2614080541 >> v1:172.21.2.111:6789/0 conn(0x7fe7540b0550 legacy=0x7fe75414a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 -- 172.21.2.137:0/2614080541 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540ad2d0 con 0x7fe754140aa0 2021-11-15T19:36:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe7599b9700 1 --2- 172.21.2.137:0/2614080541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754140ef0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7fe7540aee10 tx=0x7fe74c009290).ready entity=mon.1 client_cookie=555c8c9c08b5d740 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe743fff700 1 -- 172.21.2.137:0/2614080541 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c00b830 con 0x7fe754140aa0 2021-11-15T19:36:11.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe743fff700 1 -- 172.21.2.137:0/2614080541 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00b990 con 0x7fe754140aa0 2021-11-15T19:36:11.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe743fff700 1 -- 172.21.2.137:0/2614080541 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c00bb40 con 0x7fe754140aa0 2021-11-15T19:36:11.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- 172.21.2.137:0/2614080541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 msgr2=0x7fe754140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 --2- 172.21.2.137:0/2614080541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754140ef0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7fe7540aee10 tx=0x7fe74c009290).stop 2021-11-15T19:36:11.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- 172.21.2.137:0/2614080541 shutdown_connections 2021-11-15T19:36:11.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 --2- 172.21.2.137:0/2614080541 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754140ef0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 --2- 172.21.2.137:0/2614080541 >> v2:172.21.2.111:3300/0 conn(0x7fe75405c770 0x7fe7540aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- 172.21.2.137:0/2614080541 >> 172.21.2.137:0/2614080541 conn(0x7fe7540631e0 msgr2=0x7fe75405bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- 172.21.2.137:0/2614080541 shutdown_connections 2021-11-15T19:36:11.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- 172.21.2.137:0/2614080541 wait complete. 2021-11-15T19:36:11.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 Processor -- start 2021-11-15T19:36:11.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.578+0000 7fe75b41c700 1 -- start start 2021-11-15T19:36:11.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe75405c770 0x7fe754144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7540b0550 0x7fe754145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754157000 con 0x7fe7540b0550 2021-11-15T19:36:11.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541572a0 con 0x7fe754140aa0 2021-11-15T19:36:11.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe754066520 con 0x7fe75405c770 2021-11-15T19:36:11.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41554/0 (socket says 172.21.2.137:41554) 2021-11-15T19:36:11.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 -- 172.21.2.137:0/1916499962 learned_addr learned my addr 172.21.2.137:0/1916499962 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 -- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe75405c770 msgr2=0x7fe754144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe75405c770 0x7fe754144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 -- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7540b0550 msgr2=0x7fe754145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7540b0550 0x7fe754145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 -- 172.21.2.137:0/1916499962 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c009530 con 0x7fe754140aa0 2021-11-15T19:36:11.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7599b9700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754142c10 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7fe7540aee10 tx=0x7fe74c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c00b830 con 0x7fe754140aa0 2021-11-15T19:36:11.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c0107a0 con 0x7fe754140aa0 2021-11-15T19:36:11.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7541416f0 con 0x7fe754140aa0 2021-11-15T19:36:11.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c010b00 con 0x7fe754140aa0 2021-11-15T19:36:11.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe754143100 con 0x7fe754140aa0 2021-11-15T19:36:11.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe754156e30 con 0x7fe754140aa0 2021-11-15T19:36:11.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe74c029070 con 0x7fe754140aa0 2021-11-15T19:36:11.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7427fc700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe734053640 0x7fe734055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe74c06c9c0 con 0x7fe754140aa0 2021-11-15T19:36:11.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7591b8700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe734053640 0x7fe734055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.582+0000 7fe7591b8700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe734053640 0x7fe734055b00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fe750002fb0 tx=0x7fe7500069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.586+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe74c043b20 con 0x7fe754140aa0 2021-11-15T19:36:11.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.666+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7540573d0 con 0x7fe754140aa0 2021-11-15T19:36:11.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe7427fc700 1 -- 172.21.2.137:0/1916499962 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe74c015070 con 0x7fe754140aa0 2021-11-15T19:36:11.681 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:11.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe734053640 msgr2=0x7fe734055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe734053640 0x7fe734055b00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fe750002fb0 tx=0x7fe7500069b0).stop 2021-11-15T19:36:11.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 msgr2=0x7fe754142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754142c10 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7fe7540aee10 tx=0x7fe74c016000).stop 2021-11-15T19:36:11.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 shutdown_connections 2021-11-15T19:36:11.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe734053640 0x7fe734055b00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe754140aa0 0x7fe754142c10 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe7540b0550 0x7fe754145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 --2- 172.21.2.137:0/1916499962 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe75405c770 0x7fe754144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 >> 172.21.2.137:0/1916499962 conn(0x7fe7540631e0 msgr2=0x7fe75413de40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 shutdown_connections 2021-11-15T19:36:11.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.670+0000 7fe75b41c700 1 -- 172.21.2.137:0/1916499962 wait complete. 2021-11-15T19:36:11.687 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T19:36:11.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 Processor -- start 2021-11-15T19:36:11.740 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- start start 2021-11-15T19:36:11.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c05c770 0x7f788c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f788c140aa0 0x7f788c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.742 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c05cb50 con 0x7f788c0b0550 2021-11-15T19:36:11.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c0b1650 con 0x7f788c140aa0 2021-11-15T19:36:11.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0ad030 con 0x7f788c05c770 2021-11-15T19:36:11.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788a7fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f788c0b0550 0x7f788c14a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60344/0 (socket says 172.21.2.137:60344) 2021-11-15T19:36:11.743 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788a7fc700 1 -- 172.21.2.137:0/823173053 learned_addr learned my addr 172.21.2.137:0/823173053 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:11.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213084462 0 0) 0x7f788c05cb50 con 0x7f788c0b0550 2021-11-15T19:36:11.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7870003260 con 0x7f788c0b0550 2021-11-15T19:36:11.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189489917 0 0) 0x7f7870003260 con 0x7f788c0b0550 2021-11-15T19:36:11.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c05c770 msgr2=0x7f788c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.744 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c05c770 0x7f788c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 >> v2:172.21.2.111:3300/0 conn(0x7f788c140aa0 msgr2=0x7f788c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 --2- 172.21.2.137:0/823173053 >> v2:172.21.2.111:3300/0 conn(0x7f788c140aa0 0x7f788c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0ad2d0 con 0x7f788c0b0550 2021-11-15T19:36:11.745 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7880001660 con 0x7f788c0b0550 2021-11-15T19:36:11.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 >> v1:172.21.2.137:6789/0 conn(0x7f788c0b0550 legacy=0x7f788c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f7870003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c05c770 0x7f7870004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7870004bf0 0x7f787000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0b1650 con 0x7f7870004bf0 2021-11-15T19:36:11.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0ad030 con 0x7f78700037d0 2021-11-15T19:36:11.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7870005300 con 0x7f788c05c770 2021-11-15T19:36:11.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f7870003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.747 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 -- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c05c770 msgr2=0x7f7870004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c05c770 0x7f7870004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 -- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7870004bf0 msgr2=0x7f787000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7870004bf0 0x7f787000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 -- 172.21.2.137:0/823173053 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870003260 con 0x7f78700037d0 2021-11-15T19:36:11.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788affd700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f7870003bf0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f787c002f70 tx=0x7f787c006ca0).ready entity=mon.1 client_cookie=fc63cd79870266a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.752 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c012410 con 0x7f78700037d0 2021-11-15T19:36:11.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c012570 con 0x7f78700037d0 2021-11-15T19:36:11.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f7889ffb700 1 -- 172.21.2.137:0/823173053 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c0128d0 con 0x7f78700037d0 2021-11-15T19:36:11.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- 172.21.2.137:0/823173053 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 msgr2=0x7f7870003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 --2- 172.21.2.137:0/823173053 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f7870003bf0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f787c002f70 tx=0x7f787c006ca0).stop 2021-11-15T19:36:11.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f788b7fe700 1 -- 172.21.2.137:0/823173053 reap_dead start 2021-11-15T19:36:11.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- 172.21.2.137:0/823173053 shutdown_connections 2021-11-15T19:36:11.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- 172.21.2.137:0/823173053 >> 172.21.2.137:0/823173053 conn(0x7f788c0631e0 msgr2=0x7f788c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- 172.21.2.137:0/823173053 shutdown_connections 2021-11-15T19:36:11.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 -- 172.21.2.137:0/823173053 wait complete. 2021-11-15T19:36:11.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.730+0000 7f789160e700 1 Processor -- start 2021-11-15T19:36:11.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- start start 2021-11-15T19:36:11.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f788c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c14a460 0x7f788c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f788c1495e0 0x7f788c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c143e50 con 0x7f788c1495e0 2021-11-15T19:36:11.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c156320 con 0x7f78700037d0 2021-11-15T19:36:11.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c14aa90 con 0x7f788c14a460 2021-11-15T19:36:11.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f788c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f788c0b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41570/0 (socket says 172.21.2.137:41570) 2021-11-15T19:36:11.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 -- 172.21.2.137:0/3580968069 learned_addr learned my addr 172.21.2.137:0/3580968069 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 -- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c14a460 msgr2=0x7f788c156760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:11.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c14a460 0x7f788c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 -- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f788c1495e0 msgr2=0x7f788c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f788c1495e0 0x7f788c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 -- 172.21.2.137:0/3580968069 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c14ad30 con 0x7f78700037d0 2021-11-15T19:36:11.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788affd700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f788c0b52b0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f788c14b350 tx=0x7f787c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c012410 con 0x7f78700037d0 2021-11-15T19:36:11.759 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c011e00 con 0x7f78700037d0 2021-11-15T19:36:11.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c14afd0 con 0x7f78700037d0 2021-11-15T19:36:11.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c01d600 con 0x7f78700037d0 2021-11-15T19:36:11.760 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c065210 con 0x7f78700037d0 2021-11-15T19:36:11.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c14a8f0 con 0x7f78700037d0 2021-11-15T19:36:11.761 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f787c01a030 con 0x7f78700037d0 2021-11-15T19:36:11.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f787bfff700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7868053640 0x7f7868055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f787c06c940 con 0x7f78700037d0 2021-11-15T19:36:11.762 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.734+0000 7f788a7fc700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7868053640 0x7f7868055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.738+0000 7f788a7fc700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7868053640 0x7f7868055b00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f7880001370 tx=0x7f788c146fe0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.763 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.738+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f788c14a8f0 con 0x7f78700037d0 2021-11-15T19:36:11.832 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f788c14a8f0 con 0x7f78700037d0 2021-11-15T19:36:11.833 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f787bfff700 1 -- 172.21.2.137:0/3580968069 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7f788c14a8f0 con 0x7f78700037d0 2021-11-15T19:36:11.833 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:11.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7868053640 msgr2=0x7f7868055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.834 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7868053640 0x7f7868055b00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f7880001370 tx=0x7f788c146fe0).stop 2021-11-15T19:36:11.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 msgr2=0x7f788c0b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f788c0b52b0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f788c14b350 tx=0x7f787c015000).stop 2021-11-15T19:36:11.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 shutdown_connections 2021-11-15T19:36:11.835 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7868053640 0x7f7868055b00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f788c1495e0 0x7f788c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f788c14a460 0x7f788c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 --2- 172.21.2.137:0/3580968069 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f78700037d0 0x7f788c0b52b0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.836 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 >> 172.21.2.137:0/3580968069 conn(0x7f788c0631e0 msgr2=0x7f788c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 shutdown_connections 2021-11-15T19:36:11.837 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.822+0000 7f789160e700 1 -- 172.21.2.137:0/3580968069 wait complete. 2021-11-15T19:36:11.840 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T19:36:11.899 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 Processor -- start 2021-11-15T19:36:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- start start 2021-11-15T19:36:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07005c770 0x7fc0700aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.900 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc0700b0550 0x7fc07014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc07014aaa0 0x7fc070140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700b1650 con 0x7fc0700b0550 2021-11-15T19:36:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07005cb50 con 0x7fc07014aaa0 2021-11-15T19:36:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700ad030 con 0x7fc07005c770 2021-11-15T19:36:11.901 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc07014aaa0 0x7fc070140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc07014aaa0 0x7fc070140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41578/0 (socket says 172.21.2.137:41578) 2021-11-15T19:36:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 -- 172.21.2.137:0/874916499 learned_addr learned my addr 172.21.2.137:0/874916499 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 -- 172.21.2.137:0/874916499 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07005c770 msgr2=0x7fc0700aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.902 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 --2- 172.21.2.137:0/874916499 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07005c770 0x7fc0700aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 -- 172.21.2.137:0/874916499 >> v2:172.21.2.111:3300/0 conn(0x7fc0700b0550 msgr2=0x7fc07014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:11.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 --2- 172.21.2.137:0/874916499 >> v2:172.21.2.111:3300/0 conn(0x7fc0700b0550 0x7fc07014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 -- 172.21.2.137:0/874916499 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700ad2d0 con 0x7fc07014aaa0 2021-11-15T19:36:11.903 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06ffff700 1 --2- 172.21.2.137:0/874916499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc07014aaa0 0x7fc070140aa0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7fc0680032f0 tx=0x7fc068009290).ready entity=mon.1 client_cookie=cb154d091a974067 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06e7fc700 1 -- 172.21.2.137:0/874916499 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06800b870 con 0x7fc07014aaa0 2021-11-15T19:36:11.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06e7fc700 1 -- 172.21.2.137:0/874916499 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06800b9d0 con 0x7fc07014aaa0 2021-11-15T19:36:11.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc06e7fc700 1 -- 172.21.2.137:0/874916499 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06800bb40 con 0x7fc07014aaa0 2021-11-15T19:36:11.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- 172.21.2.137:0/874916499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc07014aaa0 msgr2=0x7fc070140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.904 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- 172.21.2.137:0/874916499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc07014aaa0 0x7fc070140aa0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7fc0680032f0 tx=0x7fc068009290).stop 2021-11-15T19:36:11.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- 172.21.2.137:0/874916499 shutdown_connections 2021-11-15T19:36:11.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- 172.21.2.137:0/874916499 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc07014aaa0 0x7fc070140aa0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- 172.21.2.137:0/874916499 >> v2:172.21.2.111:3300/0 conn(0x7fc0700b0550 0x7fc07014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 --2- 172.21.2.137:0/874916499 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07005c770 0x7fc0700aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- 172.21.2.137:0/874916499 >> 172.21.2.137:0/874916499 conn(0x7fc0700631e0 msgr2=0x7fc07005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- 172.21.2.137:0/874916499 shutdown_connections 2021-11-15T19:36:11.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.882+0000 7fc075ab2700 1 -- 172.21.2.137:0/874916499 wait complete. 2021-11-15T19:36:11.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 Processor -- start 2021-11-15T19:36:11.906 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- start start 2021-11-15T19:36:11.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc07005c770 0x7fc070143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 0x7fc070142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07014aaa0 0x7fc070142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.907 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070143310 con 0x7fc07005c770 2021-11-15T19:36:11.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070156890 con 0x7fc0700b0550 2021-11-15T19:36:11.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070156b30 con 0x7fc07014aaa0 2021-11-15T19:36:11.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 0x7fc070142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 0x7fc070142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41584/0 (socket says 172.21.2.137:41584) 2021-11-15T19:36:11.908 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 -- 172.21.2.137:0/3408085616 learned_addr learned my addr 172.21.2.137:0/3408085616 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:11.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 -- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07014aaa0 msgr2=0x7fc070142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07014aaa0 0x7fc070142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 -- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc07005c770 msgr2=0x7fc070143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.909 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc07005c770 0x7fc070143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 -- 172.21.2.137:0/3408085616 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068009530 con 0x7fc0700b0550 2021-11-15T19:36:11.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06effd700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 0x7fc070142930 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fc070143450 tx=0x7fc060006da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc060012410 con 0x7fc0700b0550 2021-11-15T19:36:11.910 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060012570 con 0x7fc0700b0550 2021-11-15T19:36:11.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0600128d0 con 0x7fc0700b0550 2021-11-15T19:36:11.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc070156dd0 con 0x7fc0700b0550 2021-11-15T19:36:11.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0701564a0 con 0x7fc0700b0550 2021-11-15T19:36:11.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070156f60 con 0x7fc0700b0550 2021-11-15T19:36:11.911 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc06000f030 con 0x7fc0700b0550 2021-11-15T19:36:11.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06cff9700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0540536a0 0x7fc054055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:11.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc06006b5f0 con 0x7fc0700b0550 2021-11-15T19:36:11.912 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.886+0000 7fc06f7fe700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0540536a0 0x7fc054055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:11.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.890+0000 7fc06f7fe700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0540536a0 0x7fc054055b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fc058002f70 tx=0x7fc0580069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:11.913 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.890+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc060042750 con 0x7fc0700b0550 2021-11-15T19:36:11.985 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.970+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0700ae7f0 con 0x7fc0700b0550 2021-11-15T19:36:11.986 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc06cff9700 1 -- 172.21.2.137:0/3408085616 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc060045d70 con 0x7fc0700b0550 2021-11-15T19:36:11.986 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-11-15T19:36:11.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0540536a0 msgr2=0x7fc054055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.988 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0540536a0 0x7fc054055b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fc058002f70 tx=0x7fc0580069e0).stop 2021-11-15T19:36:11.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 msgr2=0x7fc070142930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:11.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 0x7fc070142930 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fc070143450 tx=0x7fc060006da0).stop 2021-11-15T19:36:11.989 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 shutdown_connections 2021-11-15T19:36:11.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc0540536a0 0x7fc054055b60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.990 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc07014aaa0 0x7fc070142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc0700b0550 0x7fc070142930 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:11.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 --2- 172.21.2.137:0/3408085616 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc07005c770 0x7fc070143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:11.991 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 >> 172.21.2.137:0/3408085616 conn(0x7fc0700631e0 msgr2=0x7fc07005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:11.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 shutdown_connections 2021-11-15T19:36:11.992 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:11.974+0000 7fc075ab2700 1 -- 172.21.2.137:0/3408085616 wait complete. 2021-11-15T19:36:11.994 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T19:36:11.995 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:12.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 Processor -- start 2021-11-15T19:36:12.046 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 -- start start 2021-11-15T19:36:12.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f28d00b1340 0x7f28d0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:12.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 0x7f28d0144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:12.047 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d0148190 con 0x7f28d00a9f50 2021-11-15T19:36:12.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00b1720 con 0x7f28d00b1340 2021-11-15T19:36:12.048 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28d5aac700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0147e70 con 0x7f28d0143f00 2021-11-15T19:36:12.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28cf7fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f28d00b1340 0x7f28d0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:12.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.034+0000 7f28ceffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 0x7f28d0144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:12.049 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28cf7fe700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f28d00b1340 0x7f28d0147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:48818/0 (socket says 172.21.2.137:48818) 2021-11-15T19:36:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28cffff700 1 --1- >> v1:172.21.2.111:6789/0 conn(0x7f28d00a9f50 0x7f28d00aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.111:6789/0 says I am v1:172.21.2.137:52866/0 (socket says 172.21.2.137:52866) 2021-11-15T19:36:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ceffd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 0x7f28d0144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:43162/0 (socket says 172.21.2.137:43162) 2021-11-15T19:36:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28cf7fe700 1 -- 172.21.2.137:0/39191178 learned_addr learned my addr 172.21.2.137:0/39191178 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:12.050 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ceffd700 1 -- 172.21.2.137:0/39191178 >> v2:172.21.2.111:3300/0 conn(0x7f28d00b1340 msgr2=0x7f28d0147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ceffd700 1 --2- 172.21.2.137:0/39191178 >> v2:172.21.2.111:3300/0 conn(0x7f28d00b1340 0x7f28d0147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ceffd700 1 -- 172.21.2.137:0/39191178 >> v1:172.21.2.111:6789/0 conn(0x7f28d00a9f50 legacy=0x7f28d00aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ceffd700 1 -- 172.21.2.137:0/39191178 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00af800 con 0x7f28d0143f00 2021-11-15T19:36:12.051 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ceffd700 1 --2- 172.21.2.137:0/39191178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 0x7f28d0144360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28b8002f70 tx=0x7f28b8006df0).ready entity=mon.2 client_cookie=33b3f17306925c93 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:12.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ce7fc700 1 -- 172.21.2.137:0/39191178 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b800d570 con 0x7f28d0143f00 2021-11-15T19:36:12.054 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ce7fc700 1 -- 172.21.2.137:0/39191178 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8000e90 con 0x7f28d0143f00 2021-11-15T19:36:12.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28ce7fc700 1 -- 172.21.2.137:0/39191178 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b800d8c0 con 0x7f28d0143f00 2021-11-15T19:36:12.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 -- 172.21.2.137:0/39191178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 msgr2=0x7f28d0144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:12.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 --2- 172.21.2.137:0/39191178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 0x7f28d0144360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28b8002f70 tx=0x7f28b8006df0).stop 2021-11-15T19:36:12.055 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 -- 172.21.2.137:0/39191178 shutdown_connections 2021-11-15T19:36:12.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 --2- 172.21.2.137:0/39191178 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d0143f00 0x7f28d0144360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 --2- 172.21.2.137:0/39191178 >> v2:172.21.2.111:3300/0 conn(0x7f28d00b1340 0x7f28d0147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 -- 172.21.2.137:0/39191178 >> 172.21.2.137:0/39191178 conn(0x7f28d00b4e60 msgr2=0x7f28d00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:12.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 -- 172.21.2.137:0/39191178 shutdown_connections 2021-11-15T19:36:12.056 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 -- 172.21.2.137:0/39191178 wait complete. 2021-11-15T19:36:12.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 Processor -- start 2021-11-15T19:36:12.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 -- start start 2021-11-15T19:36:12.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d00a9f50 0x7f28d01401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:12.057 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 0x7f28d013d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:12.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.038+0000 7f28d5aac700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28d0143f00 0x7f28d013dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:12.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28d5aac700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d009a370 con 0x7f28d0143f00 2021-11-15T19:36:12.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28d5aac700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00ac850 con 0x7f28d00b1340 2021-11-15T19:36:12.058 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28d5aac700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00acaf0 con 0x7f28d00a9f50 2021-11-15T19:36:12.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 0x7f28d013d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:12.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 0x7f28d013d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41598/0 (socket says 172.21.2.137:41598) 2021-11-15T19:36:12.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 -- 172.21.2.137:0/3368229557 learned_addr learned my addr 172.21.2.137:0/3368229557 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:12.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28cffff700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28d0143f00 0x7f28d013dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:12.059 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28cf7fe700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d00a9f50 0x7f28d01401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:12.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 -- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d00a9f50 msgr2=0x7f28d01401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:12.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d00a9f50 0x7f28d01401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.060 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 -- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28d0143f00 msgr2=0x7f28d013dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:12.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28d0143f00 0x7f28d013dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 -- 172.21.2.137:0/3368229557 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b800b180 con 0x7f28d00b1340 2021-11-15T19:36:12.061 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28cf7fe700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d00a9f50 0x7f28d01401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:12.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ceffd700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 0x7f28d013d7a0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f28d00ae6f0 tx=0x7f28b8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:12.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b8016070 con 0x7f28d00b1340 2021-11-15T19:36:12.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800de40 con 0x7f28d00b1340 2021-11-15T19:36:12.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b801e450 con 0x7f28d00b1340 2021-11-15T19:36:12.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d0099780 con 0x7f28d00b1340 2021-11-15T19:36:12.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d013e180 con 0x7f28d00b1340 2021-11-15T19:36:12.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d009a9c0 con 0x7f28d00b1340 2021-11-15T19:36:12.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28b8025030 con 0x7f28d00b1340 2021-11-15T19:36:12.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ccff9700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b40535d0 0x7f28b4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:12.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f28b806caf0 con 0x7f28d00b1340 2021-11-15T19:36:12.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.042+0000 7f28cf7fe700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b40535d0 0x7f28b4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:12.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.046+0000 7f28cf7fe700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b40535d0 0x7f28b4055a90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f28c0008000 tx=0x7f28c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:12.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.046+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28d009a9c0 con 0x7f28d00b1340 2021-11-15T19:36:12.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d009a9c0 con 0x7f28d00b1340 2021-11-15T19:36:12.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28ccff9700 1 -- 172.21.2.137:0/3368229557 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f28d009a9c0 con 0x7f28d00b1340 2021-11-15T19:36:12.165 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:12.165 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/2020936860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2020936860},{"type":"v1","addr":"172.21.2.111:6835","nonce":2020936860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:36:05.764984+0000","modified":"2021-11-15T19:36:07.143006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8641":{"gid":8641,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/754709113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":754709113},{"type":"v1","addr":"172.21.2.137:6833","nonce":754709113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T19:36:12.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b40535d0 msgr2=0x7f28b4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:12.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b40535d0 0x7f28b4055a90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f28c0008000 tx=0x7f28c0008040).stop 2021-11-15T19:36:12.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 msgr2=0x7f28d013d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:12.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 0x7f28d013d7a0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f28d00ae6f0 tx=0x7f28b8014000).stop 2021-11-15T19:36:12.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 shutdown_connections 2021-11-15T19:36:12.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f28b40535d0 0x7f28b4055a90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f28d0143f00 0x7f28d013dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f28d00b1340 0x7f28d013d7a0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 --2- 172.21.2.137:0/3368229557 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f28d00a9f50 0x7f28d01401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:12.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 >> 172.21.2.137:0/3368229557 conn(0x7f28d00b4e60 msgr2=0x7f28d00afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:12.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 shutdown_connections 2021-11-15T19:36:12.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:12.154+0000 7f28d5aac700 1 -- 172.21.2.137:0/3368229557 wait complete. 2021-11-15T19:36:12.169 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 80 2021-11-15T19:36:12.374 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T19:36:05.764984+0000', 'modified': '2021-11-15T19:36:07.143006+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8641': {'gid': 8641, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.137:6833/754709113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6832', 'nonce': 754709113}, {'type': 'v1', 'addr': '172.21.2.137:6833', 'nonce': 754709113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T19:36:12.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T19:36:12.375 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T19:36:12.444 INFO:teuthology.orchestra.run.gibba037.stdout:{"cluster_fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","whoami":0,"id":8641,"want_state":"up:active","state":"up:active","rank_uptime":6.6652472960000004,"mdsmap_epoch":80,"osdmap_epoch":152,"osdmap_epoch_barrier":151,"uptime":10.836277066999999} 2021-11-15T19:36:12.444 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", "id": 8641, "mdsmap_epoch": 80, "osdmap_epoch": 152, "osdmap_epoch_barrier": 151, "rank_uptime": 6.665247296, "state": "up:active", "uptime": 10.836277067, "want_state": "up:active", "whoami": 0 } 2021-11-15T19:36:12.445 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T19:36:12.445 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T19:36:12.445 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba018.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T19:36:12.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:12.446 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:12.457 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:36:12.469 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:36:12.469 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:36:12.519 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:36:12.520 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:36:12.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:12.521 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:36:12.526 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T19:36:12.527 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:12.529 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:36:12.538 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:36:12.538 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:36:12.543 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:36:12.544 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:36:12.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:12.545 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:36:12.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:2021-11-15T19:36:12.564+0000 7fad69c39080 -1 init, newargv = 0x555dc6cc2a90 newargc=9 2021-11-15T19:36:12.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14884]: starting ceph client 2021-11-15T19:36:12.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14884]: starting fuse 2021-11-15T19:36:13.671 DEBUG:teuthology.orchestra.run.gibba018:> sudo modprobe fuse 2021-11-15T19:36:13.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T19:36:13.684 DEBUG:teuthology.orchestra.run.gibba018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T19:36:13.731 INFO:teuthology.orchestra.run.gibba018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T19:36:13.732 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T19:36:13.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.733 DEBUG:teuthology.orchestra.run.gibba018:> ls /sys/fs/fuse/connections 2021-11-15T19:36:13.738 INFO:teuthology.orchestra.run.gibba018.stdout:52 2021-11-15T19:36:13.739 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T19:36:13.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.740 DEBUG:teuthology.orchestra.run.gibba018:> sudo python3 -c ' 2021-11-15T19:36:13.740 DEBUG:teuthology.orchestra.run.gibba018:> import glob 2021-11-15T19:36:13.741 DEBUG:teuthology.orchestra.run.gibba018:> import re 2021-11-15T19:36:13.741 DEBUG:teuthology.orchestra.run.gibba018:> import os 2021-11-15T19:36:13.741 DEBUG:teuthology.orchestra.run.gibba018:> import subprocess 2021-11-15T19:36:13.742 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:36:13.742 DEBUG:teuthology.orchestra.run.gibba018:> def find_socket(client_name): 2021-11-15T19:36:13.743 DEBUG:teuthology.orchestra.run.gibba018:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T19:36:13.743 DEBUG:teuthology.orchestra.run.gibba018:> files = glob.glob(asok_path) 2021-11-15T19:36:13.744 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:36:13.744 DEBUG:teuthology.orchestra.run.gibba018:> # Given a non-glob path, it better be there 2021-11-15T19:36:13.744 DEBUG:teuthology.orchestra.run.gibba018:> if "*" not in asok_path: 2021-11-15T19:36:13.745 DEBUG:teuthology.orchestra.run.gibba018:> assert(len(files) == 1) 2021-11-15T19:36:13.745 DEBUG:teuthology.orchestra.run.gibba018:> return files[0] 2021-11-15T19:36:13.746 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:36:13.746 DEBUG:teuthology.orchestra.run.gibba018:> for f in files: 2021-11-15T19:36:13.747 DEBUG:teuthology.orchestra.run.gibba018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T19:36:13.747 DEBUG:teuthology.orchestra.run.gibba018:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T19:36:13.747 DEBUG:teuthology.orchestra.run.gibba018:> return f 2021-11-15T19:36:13.748 DEBUG:teuthology.orchestra.run.gibba018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T19:36:13.748 DEBUG:teuthology.orchestra.run.gibba018:> 2021-11-15T19:36:13.749 DEBUG:teuthology.orchestra.run.gibba018:> print(find_socket("client.1")) 2021-11-15T19:36:13.749 DEBUG:teuthology.orchestra.run.gibba018:> ' 2021-11-15T19:36:13.776 INFO:teuthology.orchestra.run.gibba018.stdout:/var/run/ceph/ceph-client.1.14884.asok 2021-11-15T19:36:13.778 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14884.asok 2021-11-15T19:36:13.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.779 DEBUG:teuthology.orchestra.run.gibba018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14884.asok status 2021-11-15T19:36:13.882 INFO:teuthology.orchestra.run.gibba018.stdout:{ 2021-11-15T19:36:13.883 INFO:teuthology.orchestra.run.gibba018.stdout: "metadata": { 2021-11-15T19:36:13.883 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T19:36:13.883 INFO:teuthology.orchestra.run.gibba018.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T19:36:13.884 INFO:teuthology.orchestra.run.gibba018.stdout: "entity_id": "1", 2021-11-15T19:36:13.884 INFO:teuthology.orchestra.run.gibba018.stdout: "hostname": "gibba018", 2021-11-15T19:36:13.885 INFO:teuthology.orchestra.run.gibba018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T19:36:13.885 INFO:teuthology.orchestra.run.gibba018.stdout: "pid": "14884", 2021-11-15T19:36:13.885 INFO:teuthology.orchestra.run.gibba018.stdout: "root": "/" 2021-11-15T19:36:13.886 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:36:13.886 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_count": 0, 2021-11-15T19:36:13.887 INFO:teuthology.orchestra.run.gibba018.stdout: "dentry_pinned_count": 0, 2021-11-15T19:36:13.887 INFO:teuthology.orchestra.run.gibba018.stdout: "id": 5688, 2021-11-15T19:36:13.888 INFO:teuthology.orchestra.run.gibba018.stdout: "inst": { 2021-11-15T19:36:13.888 INFO:teuthology.orchestra.run.gibba018.stdout: "name": { 2021-11-15T19:36:13.889 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "client", 2021-11-15T19:36:13.889 INFO:teuthology.orchestra.run.gibba018.stdout: "num": 5688 2021-11-15T19:36:13.889 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:36:13.890 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:36:13.890 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:36:13.891 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:36:13.891 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 3720785769 2021-11-15T19:36:13.892 INFO:teuthology.orchestra.run.gibba018.stdout: } 2021-11-15T19:36:13.892 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:36:13.892 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": { 2021-11-15T19:36:13.893 INFO:teuthology.orchestra.run.gibba018.stdout: "type": "v1", 2021-11-15T19:36:13.893 INFO:teuthology.orchestra.run.gibba018.stdout: "addr": "172.21.2.118:0", 2021-11-15T19:36:13.894 INFO:teuthology.orchestra.run.gibba018.stdout: "nonce": 3720785769 2021-11-15T19:36:13.894 INFO:teuthology.orchestra.run.gibba018.stdout: }, 2021-11-15T19:36:13.895 INFO:teuthology.orchestra.run.gibba018.stdout: "inst_str": "client.5688 172.21.2.118:0/3720785769", 2021-11-15T19:36:13.895 INFO:teuthology.orchestra.run.gibba018.stdout: "addr_str": "172.21.2.118:0/3720785769", 2021-11-15T19:36:13.896 INFO:teuthology.orchestra.run.gibba018.stdout: "inode_count": 1, 2021-11-15T19:36:13.896 INFO:teuthology.orchestra.run.gibba018.stdout: "mds_epoch": 80, 2021-11-15T19:36:13.896 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch": 152, 2021-11-15T19:36:13.897 INFO:teuthology.orchestra.run.gibba018.stdout: "osd_epoch_barrier": 0, 2021-11-15T19:36:13.897 INFO:teuthology.orchestra.run.gibba018.stdout: "blacklisted": false, 2021-11-15T19:36:13.898 INFO:teuthology.orchestra.run.gibba018.stdout: "fs_name": "cephfs" 2021-11-15T19:36:13.898 INFO:teuthology.orchestra.run.gibba018.stdout:} 2021-11-15T19:36:13.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.901 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:13.902 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:13.908 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:36:13.909 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:36:13.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.910 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:13.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.919 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:13.920 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:13.965 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:36:13.966 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:36:13.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.967 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:13.968 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:13.973 INFO:teuthology.orchestra.run.gibba018.stdout:fuseblk 2021-11-15T19:36:13.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T19:36:13.975 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba018.front.sepia.ceph.com... 2021-11-15T19:36:13.975 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T19:36:13.976 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:13.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba018.stderr:ceph-fuse[14884]: fuse finished with error 0 and tester_r 0 2021-11-15T19:36:13.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:13.988 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:13.988 DEBUG:teuthology.orchestra.run.gibba018:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:14.037 INFO:teuthology.orchestra.run.gibba018.stdout:ext2/ext3 2021-11-15T19:36:14.039 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T19:36:14.039 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T19:36:20.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T19:36:20.142 DEBUG:teuthology.orchestra.run.gibba018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T19:36:20.150 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T19:36:20.150 DEBUG:teuthology.orchestra.run.gibba031:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-11-15T19:36:20.168 INFO:teuthology.orchestra.run.gibba031.stdout: File: "." 2021-11-15T19:36:20.168 INFO:teuthology.orchestra.run.gibba031.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-11-15T19:36:20.168 INFO:teuthology.orchestra.run.gibba031.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-11-15T19:36:20.169 INFO:teuthology.orchestra.run.gibba031.stdout:Blocks: Total: 80930 Free: 80930 Available: 80930 2021-11-15T19:36:20.169 INFO:teuthology.orchestra.run.gibba031.stdout:Inodes: Total: 1 Free: 0 2021-11-15T19:36:20.170 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T19:36:20.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 Processor -- start 2021-11-15T19:36:20.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 -- start start 2021-11-15T19:36:20.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f05b0144610 0x7f05b0147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f05b00a9f50 0x7f05b00aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b0148190 con 0x7f05b00b1340 2021-11-15T19:36:20.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00b1720 con 0x7f05b00a9f50 2021-11-15T19:36:20.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.214+0000 7f05b7fe8700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b0147e70 con 0x7f05b0144610 2021-11-15T19:36:20.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f05b0144610 0x7f05b0147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f05b0144610 0x7f05b0147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41606/0 (socket says 172.21.2.137:41606) 2021-11-15T19:36:20.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 -- 172.21.2.137:0/1575218776 learned_addr learned my addr 172.21.2.137:0/1575218776 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:20.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 -- 172.21.2.137:0/1575218776 >> v2:172.21.2.111:3300/0 conn(0x7f05b00a9f50 msgr2=0x7f05b00aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:20.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 --2- 172.21.2.137:0/1575218776 >> v2:172.21.2.111:3300/0 conn(0x7f05b00a9f50 0x7f05b00aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 -- 172.21.2.137:0/1575218776 >> v1:172.21.2.111:6789/0 conn(0x7f05b00b1340 legacy=0x7f05b0143f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:20.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 -- 172.21.2.137:0/1575218776 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00af800 con 0x7f05b0144610 2021-11-15T19:36:20.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b5583700 1 --2- 172.21.2.137:0/1575218776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b0147980 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f05b0062250 tx=0x7f05a0006eb0).ready entity=mon.1 client_cookie=a75215f3def8abb4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b4d82700 1 -- 172.21.2.137:0/1575218776 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a000d5c0 con 0x7f05b0144610 2021-11-15T19:36:20.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b4d82700 1 -- 172.21.2.137:0/1575218776 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0000e90 con 0x7f05b0144610 2021-11-15T19:36:20.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b4d82700 1 -- 172.21.2.137:0/1575218776 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a000d910 con 0x7f05b0144610 2021-11-15T19:36:20.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/1575218776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 msgr2=0x7f05b0147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/1575218776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b0147980 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f05b0062250 tx=0x7f05a0006eb0).stop 2021-11-15T19:36:20.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/1575218776 shutdown_connections 2021-11-15T19:36:20.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/1575218776 >> v2:172.21.2.111:3300/0 conn(0x7f05b00a9f50 0x7f05b00aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/1575218776 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b0147980 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/1575218776 >> 172.21.2.137:0/1575218776 conn(0x7f05b00b4e60 msgr2=0x7f05b00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:20.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/1575218776 shutdown_connections 2021-11-15T19:36:20.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/1575218776 wait complete. 2021-11-15T19:36:20.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 Processor -- start 2021-11-15T19:36:20.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- start start 2021-11-15T19:36:20.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f05b00a9f50 0x7f05b0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f05b00b1340 0x7f05b00ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.237 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b01499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00ad000 con 0x7f05b00b1340 2021-11-15T19:36:20.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00ad2a0 con 0x7f05b0144610 2021-11-15T19:36:20.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0149e90 con 0x7f05b00a9f50 2021-11-15T19:36:20.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b01499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.238 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b01499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41614/0 (socket says 172.21.2.137:41614) 2021-11-15T19:36:20.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 -- 172.21.2.137:0/549616729 learned_addr learned my addr 172.21.2.137:0/549616729 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:20.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 -- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f05b00a9f50 msgr2=0x7f05b0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f05b00a9f50 0x7f05b0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.239 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 -- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f05b00b1340 msgr2=0x7f05b00ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f05b00b1340 0x7f05b00ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 -- 172.21.2.137:0/549616729 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a000b1e0 con 0x7f05b0144610 2021-11-15T19:36:20.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b6585700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b01499a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f05a8003270 tx=0x7f05a80090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a800d4a0 con 0x7f05b0144610 2021-11-15T19:36:20.240 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800d600 con 0x7f05b0144610 2021-11-15T19:36:20.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b0148ae0 con 0x7f05b0144610 2021-11-15T19:36:20.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a800d9a0 con 0x7f05b0144610 2021-11-15T19:36:20.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.218+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b014a370 con 0x7f05b0144610 2021-11-15T19:36:20.241 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b00b0b80 con 0x7f05b0144610 2021-11-15T19:36:20.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f05a8018030 con 0x7f05b0144610 2021-11-15T19:36:20.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f059effd700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0590053640 0x7f0590055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f05a806b2f0 con 0x7f05b0144610 2021-11-15T19:36:20.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f05b5d84700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0590053640 0x7f0590055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.242 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f05b5d84700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0590053640 0x7f0590055b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f05ac002ef0 tx=0x7f05ac006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.243 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.222+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05b00b0b80 con 0x7f05b0144610 2021-11-15T19:36:20.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.306+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f05b00b0b80 con 0x7f05b0144610 2021-11-15T19:36:20.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.306+0000 7f059effd700 1 -- 172.21.2.137:0/549616729 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f05a8028390 con 0x7f05b0144610 2021-11-15T19:36:20.319 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:20.320 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T19:36:20.320 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 152, 2021-11-15T19:36:20.320 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "83e72b0f-d369-4e28-ba83-5e0d7df7d510", 2021-11-15T19:36:20.320 INFO:teuthology.orchestra.run.gibba037.stdout: "created": "2021-11-15T19:26:40.920178+0000", 2021-11-15T19:36:20.320 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "2021-11-15T19:36:07.774435+0000", 2021-11-15T19:36:20.321 INFO:teuthology.orchestra.run.gibba037.stdout: "last_up_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:36:20.321 INFO:teuthology.orchestra.run.gibba037.stdout: "last_in_change": "2021-11-15T19:26:46.168796+0000", 2021-11-15T19:36:20.321 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T19:36:20.321 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_num": 5799936, 2021-11-15T19:36:20.322 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_set": [ 2021-11-15T19:36:20.322 INFO:teuthology.orchestra.run.gibba037.stdout: "pglog_hardlimit", 2021-11-15T19:36:20.322 INFO:teuthology.orchestra.run.gibba037.stdout: "purged_snapdirs", 2021-11-15T19:36:20.322 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_deletes", 2021-11-15T19:36:20.322 INFO:teuthology.orchestra.run.gibba037.stdout: "sortbitwise" 2021-11-15T19:36:20.323 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:20.323 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_version": 4, 2021-11-15T19:36:20.323 INFO:teuthology.orchestra.run.gibba037.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T19:36:20.323 INFO:teuthology.orchestra.run.gibba037.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T19:36:20.324 INFO:teuthology.orchestra.run.gibba037.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T19:36:20.324 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_snapshot": "", 2021-11-15T19:36:20.324 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_max": 30, 2021-11-15T19:36:20.324 INFO:teuthology.orchestra.run.gibba037.stdout: "max_osd": 8, 2021-11-15T19:36:20.324 INFO:teuthology.orchestra.run.gibba037.stdout: "require_min_compat_client": "jewel", 2021-11-15T19:36:20.325 INFO:teuthology.orchestra.run.gibba037.stdout: "min_compat_client": "jewel", 2021-11-15T19:36:20.325 INFO:teuthology.orchestra.run.gibba037.stdout: "require_osd_release": "octopus", 2021-11-15T19:36:20.325 INFO:teuthology.orchestra.run.gibba037.stdout: "pools": [ 2021-11-15T19:36:20.325 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.325 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 1, 2021-11-15T19:36:20.326 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "device_health_metrics", 2021-11-15T19:36:20.326 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:43.362687+0000", 2021-11-15T19:36:20.326 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:36:20.326 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:36:20.327 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:36:20.327 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:36:20.327 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:36:20.327 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:36:20.328 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:36:20.328 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:36:20.328 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 1, 2021-11-15T19:36:20.328 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 1, 2021-11-15T19:36:20.329 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 1, 2021-11-15T19:36:20.329 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 1, 2021-11-15T19:36:20.329 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 1, 2021-11-15T19:36:20.329 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:36:20.329 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:36:20.330 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:36:20.330 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:36:20.330 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:36:20.330 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:36:20.331 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:36:20.331 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.331 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "15", 2021-11-15T19:36:20.331 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:36:20.332 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:36:20.332 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:36:20.332 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:36:20.332 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:36:20.332 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:36:20.333 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:36:20.333 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:36:20.333 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:36:20.333 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:36:20.333 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:36:20.334 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:36:20.334 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:36:20.334 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:36:20.334 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:36:20.335 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:36:20.335 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:36:20.335 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:36:20.335 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:36:20.335 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:36:20.336 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:36:20.336 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:36:20.336 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:36:20.336 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:36:20.336 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:36:20.337 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:36:20.337 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.337 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:36:20.337 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:36:20.338 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:36:20.338 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:36:20.338 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:36:20.338 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:36:20.338 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:36:20.339 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:36:20.339 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:36:20.339 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:36:20.339 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:36:20.340 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:36:20.340 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 1 2021-11-15T19:36:20.340 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.340 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:36:20.340 INFO:teuthology.orchestra.run.gibba037.stdout: "mgr_devicehealth": {} 2021-11-15T19:36:20.341 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.341 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.341 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.341 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 2, 2021-11-15T19:36:20.341 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "rbd", 2021-11-15T19:36:20.342 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:26:51.213620+0000", 2021-11-15T19:36:20.342 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:36:20.342 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:36:20.342 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:36:20.343 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:36:20.343 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:36:20.343 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:36:20.343 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:36:20.343 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:36:20.344 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:36:20.344 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:36:20.344 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:36:20.344 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:36:20.344 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:36:20.345 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:36:20.345 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:36:20.345 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:36:20.345 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:36:20.345 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:36:20.346 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:36:20.346 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:36:20.346 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.346 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "18", 2021-11-15T19:36:20.346 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:36:20.347 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:36:20.347 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:36:20.347 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:36:20.347 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:36:20.348 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:36:20.348 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:36:20.348 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:36:20.348 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:36:20.348 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:36:20.349 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:36:20.349 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:36:20.349 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:36:20.349 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:36:20.350 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:36:20.350 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:36:20.350 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:36:20.350 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:36:20.350 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:36:20.351 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:36:20.351 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:36:20.351 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:36:20.351 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:36:20.352 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:36:20.352 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:36:20.352 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:36:20.352 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.352 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:36:20.353 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:36:20.353 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:36:20.353 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:36:20.353 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:36:20.353 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:36:20.354 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:36:20.354 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:36:20.354 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:36:20.354 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:36:20.354 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:36:20.355 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:36:20.355 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:36:20.355 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd": {} 2021-11-15T19:36:20.355 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.356 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.356 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.356 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 29, 2021-11-15T19:36:20.356 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_metadata", 2021-11-15T19:36:20.356 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:36:03.668546+0000", 2021-11-15T19:36:20.357 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:36:20.357 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:36:20.357 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:36:20.357 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:36:20.358 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:36:20.358 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:36:20.358 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:36:20.358 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:36:20.358 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:36:20.359 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:36:20.359 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:36:20.359 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:36:20.359 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:36:20.360 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:36:20.360 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:36:20.360 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:36:20.360 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:36:20.360 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:36:20.361 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:36:20.361 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:36:20.361 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.361 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "150", 2021-11-15T19:36:20.362 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:36:20.362 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:36:20.362 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:36:20.362 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:36:20.362 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:36:20.363 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:36:20.363 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:36:20.363 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:36:20.363 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:36:20.364 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:36:20.364 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:36:20.364 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:36:20.364 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:36:20.364 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:36:20.365 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:36:20.365 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:36:20.365 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:36:20.365 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:36:20.366 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:36:20.366 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:36:20.366 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:36:20.366 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:36:20.366 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:36:20.367 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:36:20.367 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:36:20.367 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:36:20.367 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.368 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:36:20.368 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:36:20.368 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:36:20.368 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:36:20.368 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:36:20.369 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:36:20.369 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:36:20.369 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:36:20.369 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:36:20.369 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:36:20.370 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:36:20.370 INFO:teuthology.orchestra.run.gibba037.stdout: "options": { 2021-11-15T19:36:20.370 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_bias": 4, 2021-11-15T19:36:20.370 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_min": 16, 2021-11-15T19:36:20.370 INFO:teuthology.orchestra.run.gibba037.stdout: "recovery_priority": 5 2021-11-15T19:36:20.371 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.371 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:36:20.371 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:36:20.371 INFO:teuthology.orchestra.run.gibba037.stdout: "metadata": "cephfs" 2021-11-15T19:36:20.372 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.372 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.372 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.372 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.372 INFO:teuthology.orchestra.run.gibba037.stdout: "pool": 30, 2021-11-15T19:36:20.373 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": "cephfs_data", 2021-11-15T19:36:20.373 INFO:teuthology.orchestra.run.gibba037.stdout: "create_time": "2021-11-15T19:36:04.747069+0000", 2021-11-15T19:36:20.373 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-11-15T19:36:20.373 INFO:teuthology.orchestra.run.gibba037.stdout: "flags_names": "hashpspool", 2021-11-15T19:36:20.374 INFO:teuthology.orchestra.run.gibba037.stdout: "type": 1, 2021-11-15T19:36:20.374 INFO:teuthology.orchestra.run.gibba037.stdout: "size": 2, 2021-11-15T19:36:20.374 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": 1, 2021-11-15T19:36:20.374 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_rule": 0, 2021-11-15T19:36:20.375 INFO:teuthology.orchestra.run.gibba037.stdout: "object_hash": 2, 2021-11-15T19:36:20.375 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_autoscale_mode": "off", 2021-11-15T19:36:20.375 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": 8, 2021-11-15T19:36:20.375 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num": 8, 2021-11-15T19:36:20.376 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_placement_num_target": 8, 2021-11-15T19:36:20.376 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_target": 8, 2021-11-15T19:36:20.376 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num_pending": 8, 2021-11-15T19:36:20.376 INFO:teuthology.orchestra.run.gibba037.stdout: "last_pg_merge_meta": { 2021-11-15T19:36:20.377 INFO:teuthology.orchestra.run.gibba037.stdout: "source_pgid": "0.0", 2021-11-15T19:36:20.377 INFO:teuthology.orchestra.run.gibba037.stdout: "ready_epoch": 0, 2021-11-15T19:36:20.377 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_started": 0, 2021-11-15T19:36:20.377 INFO:teuthology.orchestra.run.gibba037.stdout: "last_epoch_clean": 0, 2021-11-15T19:36:20.377 INFO:teuthology.orchestra.run.gibba037.stdout: "source_version": "0'0", 2021-11-15T19:36:20.378 INFO:teuthology.orchestra.run.gibba037.stdout: "target_version": "0'0" 2021-11-15T19:36:20.378 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.378 INFO:teuthology.orchestra.run.gibba037.stdout: "last_change": "152", 2021-11-15T19:36:20.378 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend": "0", 2021-11-15T19:36:20.379 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T19:36:20.379 INFO:teuthology.orchestra.run.gibba037.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T19:36:20.379 INFO:teuthology.orchestra.run.gibba037.stdout: "auid": 0, 2021-11-15T19:36:20.379 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_mode": "selfmanaged", 2021-11-15T19:36:20.380 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_seq": 0, 2021-11-15T19:36:20.380 INFO:teuthology.orchestra.run.gibba037.stdout: "snap_epoch": 0, 2021-11-15T19:36:20.380 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_snaps": [], 2021-11-15T19:36:20.380 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps": "[]", 2021-11-15T19:36:20.380 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_bytes": 0, 2021-11-15T19:36:20.381 INFO:teuthology.orchestra.run.gibba037.stdout: "quota_max_objects": 0, 2021-11-15T19:36:20.381 INFO:teuthology.orchestra.run.gibba037.stdout: "tiers": [], 2021-11-15T19:36:20.381 INFO:teuthology.orchestra.run.gibba037.stdout: "tier_of": -1, 2021-11-15T19:36:20.381 INFO:teuthology.orchestra.run.gibba037.stdout: "read_tier": -1, 2021-11-15T19:36:20.382 INFO:teuthology.orchestra.run.gibba037.stdout: "write_tier": -1, 2021-11-15T19:36:20.382 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_mode": "none", 2021-11-15T19:36:20.382 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_bytes": 0, 2021-11-15T19:36:20.382 INFO:teuthology.orchestra.run.gibba037.stdout: "target_max_objects": 0, 2021-11-15T19:36:20.383 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T19:36:20.383 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T19:36:20.383 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T19:36:20.383 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_flush_age": 0, 2021-11-15T19:36:20.384 INFO:teuthology.orchestra.run.gibba037.stdout: "cache_min_evict_age": 0, 2021-11-15T19:36:20.384 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profile": "", 2021-11-15T19:36:20.384 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_params": { 2021-11-15T19:36:20.384 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "none" 2021-11-15T19:36:20.384 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.385 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_period": 0, 2021-11-15T19:36:20.385 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_count": 0, 2021-11-15T19:36:20.385 INFO:teuthology.orchestra.run.gibba037.stdout: "use_gmt_hitset": true, 2021-11-15T19:36:20.385 INFO:teuthology.orchestra.run.gibba037.stdout: "min_read_recency_for_promote": 0, 2021-11-15T19:36:20.386 INFO:teuthology.orchestra.run.gibba037.stdout: "min_write_recency_for_promote": 0, 2021-11-15T19:36:20.386 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T19:36:20.386 INFO:teuthology.orchestra.run.gibba037.stdout: "hit_set_search_last_n": 0, 2021-11-15T19:36:20.386 INFO:teuthology.orchestra.run.gibba037.stdout: "grade_table": [], 2021-11-15T19:36:20.386 INFO:teuthology.orchestra.run.gibba037.stdout: "stripe_width": 0, 2021-11-15T19:36:20.387 INFO:teuthology.orchestra.run.gibba037.stdout: "expected_num_objects": 0, 2021-11-15T19:36:20.387 INFO:teuthology.orchestra.run.gibba037.stdout: "fast_read": false, 2021-11-15T19:36:20.387 INFO:teuthology.orchestra.run.gibba037.stdout: "options": {}, 2021-11-15T19:36:20.387 INFO:teuthology.orchestra.run.gibba037.stdout: "application_metadata": { 2021-11-15T19:36:20.388 INFO:teuthology.orchestra.run.gibba037.stdout: "cephfs": { 2021-11-15T19:36:20.388 INFO:teuthology.orchestra.run.gibba037.stdout: "data": "cephfs" 2021-11-15T19:36:20.388 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.388 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.389 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.389 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:20.389 INFO:teuthology.orchestra.run.gibba037.stdout: "osds": [ 2021-11-15T19:36:20.389 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.389 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:36:20.390 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "ab1f21b4-4df4-4fd6-9920-85e4abe60cd5", 2021-11-15T19:36:20.390 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.390 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.390 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.391 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.391 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.391 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.391 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.391 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 149, 2021-11-15T19:36:20.392 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.392 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.392 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.392 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.393 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.393 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.393 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6800", 2021-11-15T19:36:20.393 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.394 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.394 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.394 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.394 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6801", 2021-11-15T19:36:20.394 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.395 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.395 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.395 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.395 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.396 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.396 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.396 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.396 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6802", 2021-11-15T19:36:20.396 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.397 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.397 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.397 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.397 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6803", 2021-11-15T19:36:20.398 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.398 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.398 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.398 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.398 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.399 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.399 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.399 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.399 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6806", 2021-11-15T19:36:20.400 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.400 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.400 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.400 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.400 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6807", 2021-11-15T19:36:20.401 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.401 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.401 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.401 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.401 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.402 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.402 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.402 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.402 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6804", 2021-11-15T19:36:20.403 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.403 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.403 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.403 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.403 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6805", 2021-11-15T19:36:20.404 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14742 2021-11-15T19:36:20.404 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.404 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.404 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.405 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6801/14742", 2021-11-15T19:36:20.405 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6803/14742", 2021-11-15T19:36:20.405 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6807/14742", 2021-11-15T19:36:20.405 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6805/14742", 2021-11-15T19:36:20.405 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.406 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.406 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.406 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.406 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.407 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.407 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:36:20.407 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a44e77ff-9cd6-4440-8f88-f256328291e5", 2021-11-15T19:36:20.407 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.407 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.408 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.408 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.408 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.408 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.408 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.409 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 148, 2021-11-15T19:36:20.409 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.409 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.409 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.409 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.410 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.410 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.410 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6808", 2021-11-15T19:36:20.410 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.411 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.411 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.411 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.411 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6809", 2021-11-15T19:36:20.411 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.412 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.412 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.412 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.412 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.413 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.413 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.413 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.413 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6810", 2021-11-15T19:36:20.413 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.414 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.414 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.414 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.414 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6811", 2021-11-15T19:36:20.415 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.415 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.415 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.415 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.415 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.416 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.416 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.416 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.416 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6814", 2021-11-15T19:36:20.417 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.417 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.417 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.417 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.417 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6815", 2021-11-15T19:36:20.418 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.418 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.418 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.418 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.419 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.419 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.419 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.419 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.420 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6812", 2021-11-15T19:36:20.420 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.420 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.420 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.420 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.421 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6813", 2021-11-15T19:36:20.421 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14743 2021-11-15T19:36:20.421 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.421 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.421 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.422 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6809/14743", 2021-11-15T19:36:20.422 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6811/14743", 2021-11-15T19:36:20.422 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6815/14743", 2021-11-15T19:36:20.422 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6813/14743", 2021-11-15T19:36:20.423 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.423 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.423 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.423 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.424 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.424 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.424 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:36:20.424 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "5939bbcb-c02f-4a97-8e42-d014b81745c1", 2021-11-15T19:36:20.424 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.425 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.425 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.425 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.425 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.426 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.426 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.426 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 149, 2021-11-15T19:36:20.426 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.426 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.427 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.427 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.427 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.427 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.428 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6816", 2021-11-15T19:36:20.428 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.428 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.428 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.428 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.429 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6817", 2021-11-15T19:36:20.429 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.429 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.429 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.430 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.430 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.430 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.430 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.431 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.431 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6818", 2021-11-15T19:36:20.431 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.431 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.431 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.432 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.432 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6819", 2021-11-15T19:36:20.432 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.432 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.433 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.433 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.433 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.433 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.433 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.434 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.434 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6822", 2021-11-15T19:36:20.434 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.434 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.435 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.435 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.435 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6823", 2021-11-15T19:36:20.435 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.436 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.436 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.436 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.436 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.436 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.437 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.437 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.437 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6820", 2021-11-15T19:36:20.437 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.438 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.438 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.438 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.438 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6821", 2021-11-15T19:36:20.439 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14744 2021-11-15T19:36:20.439 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.439 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.439 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.439 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6817/14744", 2021-11-15T19:36:20.440 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6819/14744", 2021-11-15T19:36:20.440 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6823/14744", 2021-11-15T19:36:20.440 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6821/14744", 2021-11-15T19:36:20.440 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.441 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.441 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.441 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.441 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.441 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.442 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:36:20.442 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "584801ab-fe8b-41cb-a22e-bb8327c9a7ce", 2021-11-15T19:36:20.442 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.442 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.443 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.443 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.443 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.443 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.444 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.444 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 150, 2021-11-15T19:36:20.444 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.444 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.444 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.445 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.445 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.445 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.445 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-11-15T19:36:20.446 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.446 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.446 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.446 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.447 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-11-15T19:36:20.447 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.447 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.447 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.447 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.448 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.448 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.448 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.448 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.448 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6826", 2021-11-15T19:36:20.449 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.449 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.449 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.449 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.450 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6827", 2021-11-15T19:36:20.450 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.450 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.450 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.451 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.451 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.451 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.451 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.452 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.452 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6830", 2021-11-15T19:36:20.452 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.452 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.452 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.453 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.453 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6831", 2021-11-15T19:36:20.453 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.453 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.453 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.454 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.454 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.454 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.454 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.455 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.455 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6828", 2021-11-15T19:36:20.455 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.455 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.455 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.456 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.456 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6829", 2021-11-15T19:36:20.456 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14753 2021-11-15T19:36:20.456 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.456 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.457 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.457 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.137:6825/14753", 2021-11-15T19:36:20.457 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.137:6827/14753", 2021-11-15T19:36:20.457 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.137:6831/14753", 2021-11-15T19:36:20.458 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.137:6829/14753", 2021-11-15T19:36:20.458 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.458 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.458 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.458 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.459 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.459 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.459 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:36:20.459 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "db3bc207-56dd-423a-ae61-e28931277fe2", 2021-11-15T19:36:20.460 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.460 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.460 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.460 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.460 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.461 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.461 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.461 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 148, 2021-11-15T19:36:20.461 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.462 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.462 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.462 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.462 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.462 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.463 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6800", 2021-11-15T19:36:20.463 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.463 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.463 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.464 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.464 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6801", 2021-11-15T19:36:20.464 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.464 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.464 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.465 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.465 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.465 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.465 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.466 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.466 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6802", 2021-11-15T19:36:20.466 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.466 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.467 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.467 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.467 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6803", 2021-11-15T19:36:20.467 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.467 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.468 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.468 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.468 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.468 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.468 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.469 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.469 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6806", 2021-11-15T19:36:20.469 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.469 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.470 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.470 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.470 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6807", 2021-11-15T19:36:20.470 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.471 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.471 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.471 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.471 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.471 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.472 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.472 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.472 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6804", 2021-11-15T19:36:20.472 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.472 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.473 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.473 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.473 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6805", 2021-11-15T19:36:20.473 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14921 2021-11-15T19:36:20.474 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.474 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.474 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.474 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6801/14921", 2021-11-15T19:36:20.475 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6803/14921", 2021-11-15T19:36:20.475 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6807/14921", 2021-11-15T19:36:20.475 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6805/14921", 2021-11-15T19:36:20.475 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.475 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.476 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:36:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "7e901196-37bd-4748-8503-79c358da8431", 2021-11-15T19:36:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.477 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.478 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 149, 2021-11-15T19:36:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.479 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6808", 2021-11-15T19:36:20.480 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6809", 2021-11-15T19:36:20.481 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.482 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6810", 2021-11-15T19:36:20.483 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.484 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6811", 2021-11-15T19:36:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.485 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.486 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6814", 2021-11-15T19:36:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.487 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6815", 2021-11-15T19:36:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.488 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.489 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6812", 2021-11-15T19:36:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.490 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6813", 2021-11-15T19:36:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14922 2021-11-15T19:36:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.491 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6809/14922", 2021-11-15T19:36:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6811/14922", 2021-11-15T19:36:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6815/14922", 2021-11-15T19:36:20.492 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6813/14922", 2021-11-15T19:36:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.493 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:36:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "dd9023bb-1799-4c2a-9d08-0abc1d2b27ee", 2021-11-15T19:36:20.494 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.495 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 149, 2021-11-15T19:36:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.496 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.497 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6816", 2021-11-15T19:36:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.498 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6817", 2021-11-15T19:36:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.499 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.500 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6818", 2021-11-15T19:36:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.501 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6819", 2021-11-15T19:36:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.502 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.503 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6822", 2021-11-15T19:36:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.504 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6823", 2021-11-15T19:36:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.505 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.506 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6820", 2021-11-15T19:36:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.507 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6821", 2021-11-15T19:36:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14923 2021-11-15T19:36:20.508 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6817/14923", 2021-11-15T19:36:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6819/14923", 2021-11-15T19:36:20.509 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6823/14923", 2021-11-15T19:36:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6821/14923", 2021-11-15T19:36:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.510 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:36:20.511 INFO:teuthology.orchestra.run.gibba037.stdout: "uuid": "a483fa91-357c-4a8e-b313-b5cc41ce4b3a", 2021-11-15T19:36:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "up": 1, 2021-11-15T19:36:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "in": 1, 2021-11-15T19:36:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "weight": 1, 2021-11-15T19:36:20.512 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_affinity": 1, 2021-11-15T19:36:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_begin": 0, 2021-11-15T19:36:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "last_clean_end": 0, 2021-11-15T19:36:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "up_from": 13, 2021-11-15T19:36:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "up_thru": 149, 2021-11-15T19:36:20.513 INFO:teuthology.orchestra.run.gibba037.stdout: "down_at": 0, 2021-11-15T19:36:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "lost_at": 0, 2021-11-15T19:36:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addrs": { 2021-11-15T19:36:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.514 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6824", 2021-11-15T19:36:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.515 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6825", 2021-11-15T19:36:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.516 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addrs": { 2021-11-15T19:36:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.517 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6826", 2021-11-15T19:36:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.518 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6827", 2021-11-15T19:36:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.519 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addrs": { 2021-11-15T19:36:20.520 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6830", 2021-11-15T19:36:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.521 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6831", 2021-11-15T19:36:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.522 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addrs": { 2021-11-15T19:36:20.523 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-11-15T19:36:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-11-15T19:36:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6828", 2021-11-15T19:36:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.524 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-11-15T19:36:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.111:6829", 2021-11-15T19:36:20.525 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14924 2021-11-15T19:36:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.526 INFO:teuthology.orchestra.run.gibba037.stdout: "public_addr": "172.21.2.111:6825/14924", 2021-11-15T19:36:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "cluster_addr": "172.21.2.111:6827/14924", 2021-11-15T19:36:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_back_addr": "172.21.2.111:6831/14924", 2021-11-15T19:36:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "heartbeat_front_addr": "172.21.2.111:6829/14924", 2021-11-15T19:36:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "state": [ 2021-11-15T19:36:20.527 INFO:teuthology.orchestra.run.gibba037.stdout: "exists", 2021-11-15T19:36:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: "up" 2021-11-15T19:36:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-11-15T19:36:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.528 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "osd_xinfo": [ 2021-11-15T19:36:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 0, 2021-11-15T19:36:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.529 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.530 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.263259+0000", 2021-11-15T19:36:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 1, 2021-11-15T19:36:20.531 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.532 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.259824+0000", 2021-11-15T19:36:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.533 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 2, 2021-11-15T19:36:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.534 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.188994+0000", 2021-11-15T19:36:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.535 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 3, 2021-11-15T19:36:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.536 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.243084+0000", 2021-11-15T19:36:20.537 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 4, 2021-11-15T19:36:20.538 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.539 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.196753+0000", 2021-11-15T19:36:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.540 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 5, 2021-11-15T19:36:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.541 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.191082+0000", 2021-11-15T19:36:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.542 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 6, 2021-11-15T19:36:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.543 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.199145+0000", 2021-11-15T19:36:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.544 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-11-15T19:36:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "osd": 7, 2021-11-15T19:36:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "down_stamp": "0.000000", 2021-11-15T19:36:20.545 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_probability": 0, 2021-11-15T19:36:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "laggy_interval": 0, 2021-11-15T19:36:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "features": 4540138292840890367, 2021-11-15T19:36:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "old_weight": 0, 2021-11-15T19:36:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "last_purged_snaps_scrub": "2021-11-15T19:26:44.235826+0000", 2021-11-15T19:36:20.546 INFO:teuthology.orchestra.run.gibba037.stdout: "dead_epoch": 0 2021-11-15T19:36:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-11-15T19:36:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap": [], 2021-11-15T19:36:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_upmap_items": [], 2021-11-15T19:36:20.547 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_temp": [], 2021-11-15T19:36:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "primary_temp": [], 2021-11-15T19:36:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "blacklist": {}, 2021-11-15T19:36:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "erasure_code_profiles": { 2021-11-15T19:36:20.548 INFO:teuthology.orchestra.run.gibba037.stdout: "default": { 2021-11-15T19:36:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-failure-domain": "osd", 2021-11-15T19:36:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "k": "2", 2021-11-15T19:36:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "m": "1", 2021-11-15T19:36:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "plugin": "jerasure", 2021-11-15T19:36:20.549 INFO:teuthology.orchestra.run.gibba037.stdout: "ruleset-failure-domain": "osd", 2021-11-15T19:36:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "technique": "reed_sol_van" 2021-11-15T19:36:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-11-15T19:36:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-11-15T19:36:20.550 INFO:teuthology.orchestra.run.gibba037.stdout: "removed_snaps_queue": [], 2021-11-15T19:36:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: "new_removed_snaps": [], 2021-11-15T19:36:20.551 INFO:teuthology.orchestra.run.gibba037.stdout: "new_purged_snaps": [], 2021-11-15T19:36:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_node_flags": {}, 2021-11-15T19:36:20.552 INFO:teuthology.orchestra.run.gibba037.stdout: "device_class_flags": {} 2021-11-15T19:36:20.552 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T19:36:20.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.306+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0590053640 msgr2=0x7f0590055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.554 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.306+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0590053640 0x7f0590055b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f05ac002ef0 tx=0x7f05ac006910).stop 2021-11-15T19:36:20.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.306+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 msgr2=0x7f05b01499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.306+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b01499a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f05a8003270 tx=0x7f05a80090f0).stop 2021-11-15T19:36:20.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 shutdown_connections 2021-11-15T19:36:20.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0590053640 0x7f0590055b00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.555 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f05b0144610 0x7f05b01499a0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f05b00b1340 0x7f05b00ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 --2- 172.21.2.137:0/549616729 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f05b00a9f50 0x7f05b0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 >> 172.21.2.137:0/549616729 conn(0x7f05b00b4e60 msgr2=0x7f05b00af990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:20.556 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 shutdown_connections 2021-11-15T19:36:20.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.310+0000 7f05b7fe8700 1 -- 172.21.2.137:0/549616729 wait complete. 2021-11-15T19:36:20.557 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:20.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 Processor -- start 2021-11-15T19:36:20.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- start start 2021-11-15T19:36:20.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1d98144610 0x7f1d98147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f1d980a9f50 0x7f1d980aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d98148190 con 0x7f1d980b1340 2021-11-15T19:36:20.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980b1720 con 0x7f1d980a9f50 2021-11-15T19:36:20.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d98147e70 con 0x7f1d98144610 2021-11-15T19:36:20.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1d98144610 0x7f1d98147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.631 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d977fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f1d980b1340 0x7f1d98143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60400/0 (socket says 172.21.2.137:60400) 2021-11-15T19:36:20.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d977fe700 1 -- 172.21.2.137:0/2754374375 learned_addr learned my addr 172.21.2.137:0/2754374375 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:20.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f1d98144610 0x7f1d98147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41620/0 (socket says 172.21.2.137:41620) 2021-11-15T19:36:20.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 -- 172.21.2.137:0/2754374375 >> v2:172.21.2.111:3300/0 conn(0x7f1d980a9f50 msgr2=0x7f1d980aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:20.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 --2- 172.21.2.137:0/2754374375 >> v2:172.21.2.111:3300/0 conn(0x7f1d980a9f50 0x7f1d980aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 -- 172.21.2.137:0/2754374375 >> v1:172.21.2.137:6789/0 conn(0x7f1d980b1340 legacy=0x7f1d98143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 -- 172.21.2.137:0/2754374375 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980af800 con 0x7f1d98144610 2021-11-15T19:36:20.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d96ffd700 1 --2- 172.21.2.137:0/2754374375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d98144610 0x7f1d98147980 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f1d80002f70 tx=0x7f1d80006df0).ready entity=mon.1 client_cookie=65cee722ce172825 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d967fc700 1 -- 172.21.2.137:0/2754374375 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8000d5c0 con 0x7f1d98144610 2021-11-15T19:36:20.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d967fc700 1 -- 172.21.2.137:0/2754374375 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80000e90 con 0x7f1d98144610 2021-11-15T19:36:20.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d967fc700 1 -- 172.21.2.137:0/2754374375 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8000d950 con 0x7f1d98144610 2021-11-15T19:36:20.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- 172.21.2.137:0/2754374375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d98144610 msgr2=0x7f1d98147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.634 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 --2- 172.21.2.137:0/2754374375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d98144610 0x7f1d98147980 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f1d80002f70 tx=0x7f1d80006df0).stop 2021-11-15T19:36:20.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- 172.21.2.137:0/2754374375 shutdown_connections 2021-11-15T19:36:20.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 --2- 172.21.2.137:0/2754374375 >> v2:172.21.2.111:3300/0 conn(0x7f1d980a9f50 0x7f1d980aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 --2- 172.21.2.137:0/2754374375 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d98144610 0x7f1d98147980 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- 172.21.2.137:0/2754374375 >> 172.21.2.137:0/2754374375 conn(0x7f1d980b4e60 msgr2=0x7f1d980b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:20.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- 172.21.2.137:0/2754374375 shutdown_connections 2021-11-15T19:36:20.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- 172.21.2.137:0/2754374375 wait complete. 2021-11-15T19:36:20.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 Processor -- start 2021-11-15T19:36:20.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.618+0000 7f1d9e165700 1 -- start start 2021-11-15T19:36:20.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 0x7f1d980ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d980b1340 0x7f1d98142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d98144610 0x7f1d98142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980996a0 con 0x7f1d98144610 2021-11-15T19:36:20.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98143040 con 0x7f1d980a9f50 2021-11-15T19:36:20.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9814ac70 con 0x7f1d980b1340 2021-11-15T19:36:20.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 0x7f1d980ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 0x7f1d980ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41624/0 (socket says 172.21.2.137:41624) 2021-11-15T19:36:20.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 -- 172.21.2.137:0/1146726940 learned_addr learned my addr 172.21.2.137:0/1146726940 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:20.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 -- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d980b1340 msgr2=0x7f1d98142660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:20.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d980b1340 0x7f1d98142660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 -- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d98144610 msgr2=0x7f1d98142b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:20.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d98144610 0x7f1d98142b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.640 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 -- 172.21.2.137:0/1146726940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8000b180 con 0x7f1d980a9f50 2021-11-15T19:36:20.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d977fe700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 0x7f1d980ae6f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f1d98062250 tx=0x7f1d88007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8800ce30 con 0x7f1d980a9f50 2021-11-15T19:36:20.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88007320 con 0x7f1d980a9f50 2021-11-15T19:36:20.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9814af10 con 0x7f1d980a9f50 2021-11-15T19:36:20.641 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d98097df0 con 0x7f1d980a9f50 2021-11-15T19:36:20.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d88005220 con 0x7f1d980a9f50 2021-11-15T19:36:20.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9805faf0 con 0x7f1d980a9f50 2021-11-15T19:36:20.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d8801b070 con 0x7f1d980a9f50 2021-11-15T19:36:20.642 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d94ff9700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d7c053690 0x7f1d7c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1d8806ad50 con 0x7f1d980a9f50 2021-11-15T19:36:20.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.622+0000 7f1d96ffd700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d7c053690 0x7f1d7c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.643 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.626+0000 7f1d96ffd700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d7c053690 0x7f1d7c055b50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1d80002f70 tx=0x7f1d80014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.644 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.626+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d88041da0 con 0x7f1d980a9f50 2021-11-15T19:36:20.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d98148190 con 0x7f1d980a9f50 2021-11-15T19:36:20.746 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d94ff9700 1 -- 172.21.2.137:0/1146726940 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f1d98148190 con 0x7f1d980a9f50 2021-11-15T19:36:20.747 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:20.747 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/2020936860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2020936860},{"type":"v1","addr":"172.21.2.111:6835","nonce":2020936860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:36:05.764984+0000","modified":"2021-11-15T19:36:07.143006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8641":{"gid":8641,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.2.137:6833/754709113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6832","nonce":754709113},{"type":"v1","addr":"172.21.2.137:6833","nonce":754709113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T19:36:20.748 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d7c053690 msgr2=0x7f1d7c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d7c053690 0x7f1d7c055b50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1d80002f70 tx=0x7f1d80014000).stop 2021-11-15T19:36:20.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 msgr2=0x7f1d980ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 0x7f1d980ae6f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f1d98062250 tx=0x7f1d88007c60).stop 2021-11-15T19:36:20.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 shutdown_connections 2021-11-15T19:36:20.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f1d7c053690 0x7f1d7c055b50 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f1d98144610 0x7f1d98142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f1d980b1340 0x7f1d98142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.750 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 --2- 172.21.2.137:0/1146726940 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f1d980a9f50 0x7f1d980ae6f0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.734+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 >> 172.21.2.137:0/1146726940 conn(0x7f1d980b4e60 msgr2=0x7f1d9813eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:20.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.738+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 shutdown_connections 2021-11-15T19:36:20.751 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.738+0000 7f1d9e165700 1 -- 172.21.2.137:0/1146726940 wait complete. 2021-11-15T19:36:20.751 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 80 2021-11-15T19:36:20.754 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T19:36:20.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 Processor -- start 2021-11-15T19:36:20.805 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 -- start start 2021-11-15T19:36:20.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f454805c770 0x7f45480aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 0x7f4548140f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.807 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454805cb50 con 0x7f45480b0550 2021-11-15T19:36:20.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45480b1650 con 0x7f454805c770 2021-11-15T19:36:20.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ef26700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45480ad030 con 0x7f4548140aa0 2021-11-15T19:36:20.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f45480b0550 0x7f454814a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60416/0 (socket says 172.21.2.137:60416) 2021-11-15T19:36:20.808 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 -- 172.21.2.137:0/3545924996 learned_addr learned my addr 172.21.2.137:0/3545924996 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:20.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ccc2700 1 --2- 172.21.2.137:0/3545924996 >> v2:172.21.2.111:3300/0 conn(0x7f454805c770 0x7f45480aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454d4c3700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 0x7f4548140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184880593 0 0) 0x7f454805cb50 con 0x7f45480b0550 2021-11-15T19:36:20.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4534003260 con 0x7f45480b0550 2021-11-15T19:36:20.809 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599589310 0 0) 0x7f4534003260 con 0x7f45480b0550 2021-11-15T19:36:20.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 msgr2=0x7f4548140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:20.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 0x7f4548140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 >> v2:172.21.2.111:3300/0 conn(0x7f454805c770 msgr2=0x7f45480aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:20.810 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 --2- 172.21.2.137:0/3545924996 >> v2:172.21.2.111:3300/0 conn(0x7f454805c770 0x7f45480aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480ad2d0 con 0x7f45480b0550 2021-11-15T19:36:20.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f453c001660 con 0x7f45480b0550 2021-11-15T19:36:20.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 >> v1:172.21.2.137:6789/0 conn(0x7f45480b0550 legacy=0x7f454814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45340037d0 0x7f4534003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.811 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4534004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 0x7f4534004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480b1650 con 0x7f45340037d0 2021-11-15T19:36:20.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480ad030 con 0x7f4534004500 2021-11-15T19:36:20.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453400b7d0 con 0x7f4548140aa0 2021-11-15T19:36:20.812 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4534004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.816 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ccc2700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45340037d0 0x7f4534003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 -- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 msgr2=0x7f4534004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:20.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454d4c3700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 0x7f4534004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548140aa0 0x7f4534004e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.817 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 -- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45340037d0 msgr2=0x7f4534003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:20.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45340037d0 0x7f4534003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:20.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 -- 172.21.2.137:0/3545924996 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534003260 con 0x7f4534004500 2021-11-15T19:36:20.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f454ccc2700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45340037d0 0x7f4534003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:20.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f4547fff700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4534004980 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f4534004470 tx=0x7f453c001d80).ready entity=mon.1 client_cookie=753a34102b793ec3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.818 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453c0070d0 con 0x7f4534004500 2021-11-15T19:36:20.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c007230 con 0x7f4534004500 2021-11-15T19:36:20.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.794+0000 7f45477fe700 1 -- 172.21.2.137:0/3545924996 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453c00c8b0 con 0x7f4534004500 2021-11-15T19:36:20.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3545924996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 msgr2=0x7f4534004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 --2- 172.21.2.137:0/3545924996 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4534004980 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f4534004470 tx=0x7f453c001d80).stop 2021-11-15T19:36:20.819 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454d4c3700 1 -- 172.21.2.137:0/3545924996 reap_dead start 2021-11-15T19:36:20.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3545924996 shutdown_connections 2021-11-15T19:36:20.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3545924996 >> 172.21.2.137:0/3545924996 conn(0x7f45480631e0 msgr2=0x7f454805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:20.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3545924996 shutdown_connections 2021-11-15T19:36:20.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3545924996 wait complete. 2021-11-15T19:36:20.820 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 Processor -- start 2021-11-15T19:36:20.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- start start 2021-11-15T19:36:20.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4548065360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548139d70 0x7f45480b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45480640d0 0x7f45481562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.821 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4548063760 con 0x7f45480640d0 2021-11-15T19:36:20.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4548063990 con 0x7f4534004500 2021-11-15T19:36:20.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4548063c30 con 0x7f4548139d70 2021-11-15T19:36:20.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4548065360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4548065360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41644/0 (socket says 172.21.2.137:41644) 2021-11-15T19:36:20.822 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 -- 172.21.2.137:0/3373248561 learned_addr learned my addr 172.21.2.137:0/3373248561 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:20.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 -- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548139d70 msgr2=0x7f45480b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548139d70 0x7f45480b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 -- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45480640d0 msgr2=0x7f45481562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:20.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45480640d0 0x7f45481562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:20.823 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 -- 172.21.2.137:0/3373248561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548064560 con 0x7f4534004500 2021-11-15T19:36:20.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ccc2700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4548065360 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f453800b000 tx=0x7f4538008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4538017070 con 0x7f4534004500 2021-11-15T19:36:20.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538000e90 con 0x7f4534004500 2021-11-15T19:36:20.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4538011980 con 0x7f4534004500 2021-11-15T19:36:20.824 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4548064d30 con 0x7f4534004500 2021-11-15T19:36:20.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45481569c0 con 0x7f4534004500 2021-11-15T19:36:20.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4548063df0 con 0x7f4534004500 2021-11-15T19:36:20.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.798+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4538011ae0 con 0x7f4534004500 2021-11-15T19:36:20.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.802+0000 7f4545ffb700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4528053720 0x7f4528055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:20.825 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.802+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f453806bac0 con 0x7f4534004500 2021-11-15T19:36:20.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.802+0000 7f4547fff700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4528053720 0x7f4528055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:20.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.802+0000 7f4547fff700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4528053720 0x7f4528055be0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f4534004470 tx=0x7f453c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:20.826 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.802+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4538042c20 con 0x7f4534004500 2021-11-15T19:36:20.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:20.910+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f45480ae7f0 con 0x7f4534004500 2021-11-15T19:36:21.193 INFO:tasks.ceph.mon.b.gibba011.stderr:2021-11-15T19:36:21.189+0000 7fd9abd7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T19:36:21.206 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.194+0000 7f4545ffb700 1 -- 172.21.2.137:0/3373248561 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4538046240 con 0x7f4534004500 2021-11-15T19:36:21.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.194+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4528053720 msgr2=0x7f4528055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.194+0000 7f454ef26700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4528053720 0x7f4528055be0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f4534004470 tx=0x7f453c015000).stop 2021-11-15T19:36:21.208 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.194+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 msgr2=0x7f4548065360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.194+0000 7f454ef26700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4548065360 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f453800b000 tx=0x7f4538008040).stop 2021-11-15T19:36:21.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 shutdown_connections 2021-11-15T19:36:21.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4528053720 0x7f4528055be0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:21.209 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f45480640d0 0x7f45481562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f4548139d70 0x7f45480b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 --2- 172.21.2.137:0/3373248561 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f4534004500 0x7f4548065360 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:21.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 >> 172.21.2.137:0/3373248561 conn(0x7f45480631e0 msgr2=0x7f454805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:21.210 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 shutdown_connections 2021-11-15T19:36:21.211 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.198+0000 7f454ef26700 1 -- 172.21.2.137:0/3373248561 wait complete. 2021-11-15T19:36:21.211 INFO:teuthology.orchestra.run.gibba037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T19:36:21.215 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T19:36:21.219 INFO:tasks.ceph.mds.a.gibba037.stdout:starting mds.a at 2021-11-15T19:36:21.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 Processor -- start 2021-11-15T19:36:21.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 -- start start 2021-11-15T19:36:21.271 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e40ac3c0 0x7fb4e40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb4e40b2d50 0x7fb4e41440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e4097c50 con 0x7fb4e41445b0 2021-11-15T19:36:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40ac120 con 0x7fb4e40b2d50 2021-11-15T19:36:21.272 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4eb827700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4061100 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4e8dc2700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb4e40b2d50 0x7fb4e41440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4e9dc4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fb4e41445b0 0x7fb4e405f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60448/0 (socket says 172.21.2.137:60448) 2021-11-15T19:36:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4e9dc4700 1 -- 172.21.2.137:0/4175160325 learned_addr learned my addr 172.21.2.137:0/4175160325 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:21.273 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.254+0000 7fb4e8dc2700 1 --2- 172.21.2.137:0/4175160325 >> v2:172.21.2.137:3300/0 conn(0x7fb4e40b2d50 0x7fb4e41440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41668/0 (socket says 172.21.2.137:41668) 2021-11-15T19:36:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e8dc2700 1 -- 172.21.2.137:0/4175160325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e40ac3c0 msgr2=0x7fb4e40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e8dc2700 1 --2- 172.21.2.137:0/4175160325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e40ac3c0 0x7fb4e40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e8dc2700 1 -- 172.21.2.137:0/4175160325 >> v1:172.21.2.137:6789/0 conn(0x7fb4e41445b0 legacy=0x7fb4e405f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.274 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e8dc2700 1 -- 172.21.2.137:0/4175160325 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40979b0 con 0x7fb4e40b2d50 2021-11-15T19:36:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e8dc2700 1 --2- 172.21.2.137:0/4175160325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40b2d50 0x7fb4e41440c0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7fb4dc001490 tx=0x7fb4d8006df0).ready entity=mon.1 client_cookie=875ede6a2d3edf0a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d7fff700 1 -- 172.21.2.137:0/4175160325 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d800d570 con 0x7fb4e40b2d50 2021-11-15T19:36:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d7fff700 1 -- 172.21.2.137:0/4175160325 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8000e90 con 0x7fb4e40b2d50 2021-11-15T19:36:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d7fff700 1 -- 172.21.2.137:0/4175160325 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d800d8c0 con 0x7fb4e40b2d50 2021-11-15T19:36:21.275 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/4175160325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40b2d50 msgr2=0x7fb4e41440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 --2- 172.21.2.137:0/4175160325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40b2d50 0x7fb4e41440c0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7fb4dc001490 tx=0x7fb4d8006df0).stop 2021-11-15T19:36:21.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/4175160325 shutdown_connections 2021-11-15T19:36:21.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 --2- 172.21.2.137:0/4175160325 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40b2d50 0x7fb4e41440c0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:21.276 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 --2- 172.21.2.137:0/4175160325 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e40ac3c0 0x7fb4e40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/4175160325 >> 172.21.2.137:0/4175160325 conn(0x7fb4e40b7070 msgr2=0x7fb4e40b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:21.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/4175160325 shutdown_connections 2021-11-15T19:36:21.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/4175160325 wait complete. 2021-11-15T19:36:21.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 Processor -- start 2021-11-15T19:36:21.277 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- start start 2021-11-15T19:36:21.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 0x7fb4e40672f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e41445b0 0x7fb4e4157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4e40966c0 0x7fb4e4064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4156a50 con 0x7fb4e40966c0 2021-11-15T19:36:21.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4156cf0 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4156f90 con 0x7fb4e41445b0 2021-11-15T19:36:21.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 0x7fb4e40672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:21.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 0x7fb4e40672f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41670/0 (socket says 172.21.2.137:41670) 2021-11-15T19:36:21.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 -- 172.21.2.137:0/1069145121 learned_addr learned my addr 172.21.2.137:0/1069145121 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:21.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 -- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e41445b0 msgr2=0x7fb4e4157430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:21.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e41445b0 0x7fb4e4157430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 -- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4e40966c0 msgr2=0x7fb4e4064920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:21.280 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4e40966c0 0x7fb4e4064920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 -- 172.21.2.137:0/1069145121 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d800b180 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4e95c3700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 0x7fb4e40672f0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fb4e0002f70 tx=0x7fb4e0006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:21.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4e0013460 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00135c0 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.281 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e4157920 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4e0013920 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e40ae3e0 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e4157150 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb4e001a060 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d67fc700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4c40536a0 0x7fb4c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.258+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6155+0+0 (secure 0 0 0) 0x7fb4e006b380 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.262+0000 7fb4e8dc2700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4c40536a0 0x7fb4c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:21.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.262+0000 7fb4e8dc2700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4c40536a0 0x7fb4c4055b60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fb4dc001490 tx=0x7fb4d8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:21.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.262+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4e0042490 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.370+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4e4067c60 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.370+0000 7fb4d67fc700 1 -- 172.21.2.137:0/1069145121 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fb4e0045ab0 con 0x7fb4e40ac3c0 2021-11-15T19:36:21.384 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T19:36:21.384 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.111:6835/2020936860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6834","nonce":2020936860},{"type":"v1","addr":"172.21.2.111:6835","nonce":2020936860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T19:36:05.764984+0000","modified":"2021-11-15T19:36:21.190783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":153,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T19:36:21.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4c40536a0 msgr2=0x7fb4c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4c40536a0 0x7fb4c4055b60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fb4dc001490 tx=0x7fb4d8014000).stop 2021-11-15T19:36:21.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 msgr2=0x7fb4e40672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 0x7fb4e40672f0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fb4e0002f70 tx=0x7fb4e0006e20).stop 2021-11-15T19:36:21.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 shutdown_connections 2021-11-15T19:36:21.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb4c40536a0 0x7fb4c4055b60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:21.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb4e40966c0 0x7fb4e4064920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb4e41445b0 0x7fb4e4157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 --2- 172.21.2.137:0/1069145121 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb4e40ac3c0 0x7fb4e40672f0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:21.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 >> 172.21.2.137:0/1069145121 conn(0x7fb4e40b7070 msgr2=0x7fb4e4097de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:21.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 shutdown_connections 2021-11-15T19:36:21.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.374+0000 7fb4eb827700 1 -- 172.21.2.137:0/1069145121 wait complete. 2021-11-15T19:36:21.388 INFO:teuthology.orchestra.run.gibba037.stderr:dumped fsmap epoch 81 2021-11-15T19:36:21.391 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T19:36:21.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 Processor -- start 2021-11-15T19:36:21.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 -- start start 2021-11-15T19:36:21.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c0b0550 0x7eff4c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff4c14aaa0 0x7eff4c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c05cb50 con 0x7eff4c05c770 2021-11-15T19:36:21.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c0b1650 con 0x7eff4c14aaa0 2021-11-15T19:36:21.444 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff51ef7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0ad030 con 0x7eff4c0b0550 2021-11-15T19:36:21.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff4c14aaa0 0x7eff4c140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:21.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7eff4c14aaa0 0x7eff4c140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41682/0 (socket says 172.21.2.137:41682) 2021-11-15T19:36:21.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 -- 172.21.2.137:0/1478847722 learned_addr learned my addr 172.21.2.137:0/1478847722 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:21.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 -- 172.21.2.137:0/1478847722 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c0b0550 msgr2=0x7eff4c14a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:21.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 --2- 172.21.2.137:0/1478847722 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c0b0550 0x7eff4c14a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 -- 172.21.2.137:0/1478847722 >> v1:172.21.2.111:6789/0 conn(0x7eff4c05c770 legacy=0x7eff4c0aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T19:36:21.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 -- 172.21.2.137:0/1478847722 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0ad2d0 con 0x7eff4c14aaa0 2021-11-15T19:36:21.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4bfff700 1 --2- 172.21.2.137:0/1478847722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c14aaa0 0x7eff4c140aa0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7eff4c0adfd0 tx=0x7eff44009290).ready entity=mon.1 client_cookie=4ea83e1154663cd7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:21.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4a7fc700 1 -- 172.21.2.137:0/1478847722 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff4400b860 con 0x7eff4c14aaa0 2021-11-15T19:36:21.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4a7fc700 1 -- 172.21.2.137:0/1478847722 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400b9c0 con 0x7eff4c14aaa0 2021-11-15T19:36:21.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.430+0000 7eff4a7fc700 1 -- 172.21.2.137:0/1478847722 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff4400bb70 con 0x7eff4c14aaa0 2021-11-15T19:36:21.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/1478847722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c14aaa0 msgr2=0x7eff4c140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:21.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 --2- 172.21.2.137:0/1478847722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c14aaa0 0x7eff4c140aa0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7eff4c0adfd0 tx=0x7eff44009290).stop 2021-11-15T19:36:21.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/1478847722 shutdown_connections 2021-11-15T19:36:21.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 --2- 172.21.2.137:0/1478847722 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c14aaa0 0x7eff4c140aa0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:21.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 --2- 172.21.2.137:0/1478847722 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c0b0550 0x7eff4c14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/1478847722 >> 172.21.2.137:0/1478847722 conn(0x7eff4c0631e0 msgr2=0x7eff4c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:21.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/1478847722 shutdown_connections 2021-11-15T19:36:21.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/1478847722 wait complete. 2021-11-15T19:36:21.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 Processor -- start 2021-11-15T19:36:21.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- start start 2021-11-15T19:36:21.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff4c05c770 0x7eff4c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 0x7eff4c14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c14aaa0 0x7eff4c145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c147750 con 0x7eff4c05c770 2021-11-15T19:36:21.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1479f0 con 0x7eff4c0b0550 2021-11-15T19:36:21.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c147c90 con 0x7eff4c14aaa0 2021-11-15T19:36:21.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 0x7eff4c14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:21.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 0x7eff4c14a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41688/0 (socket says 172.21.2.137:41688) 2021-11-15T19:36:21.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 -- 172.21.2.137:0/2095232394 learned_addr learned my addr 172.21.2.137:0/2095232394 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:21.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 -- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c14aaa0 msgr2=0x7eff4c145e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:21.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c14aaa0 0x7eff4c145e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 -- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff4c05c770 msgr2=0x7eff4c066e00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T19:36:21.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff4c05c770 0x7eff4c066e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:21.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 -- 172.21.2.137:0/2095232394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009530 con 0x7eff4c0b0550 2021-11-15T19:36:21.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff4affd700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 0x7eff4c14a070 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7eff34002fb0 tx=0x7eff34006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:21.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff34013460 con 0x7eff4c0b0550 2021-11-15T19:36:21.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340135c0 con 0x7eff4c0b0550 2021-11-15T19:36:21.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff34013920 con 0x7eff4c0b0550 2021-11-15T19:36:21.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c1473d0 con 0x7eff4c0b0550 2021-11-15T19:36:21.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c064eb0 con 0x7eff4c0b0550 2021-11-15T19:36:21.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c0ae7f0 con 0x7eff4c0b0550 2021-11-15T19:36:21.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff3400f070 con 0x7eff4c0b0550 2021-11-15T19:36:21.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff48ff9700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff30053580 0x7eff30055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:21.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.434+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6155+0+0 (secure 0 0 0) 0x7eff3406b110 con 0x7eff4c0b0550 2021-11-15T19:36:21.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.438+0000 7eff4b7fe700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff30053580 0x7eff30055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:21.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.438+0000 7eff4b7fe700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff30053580 0x7eff30055a40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7eff3c002ef0 tx=0x7eff3c006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:21.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.438+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff34042220 con 0x7eff4c0b0550 2021-11-15T19:36:21.557 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:21.546+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff4c0573d0 con 0x7eff4c0b0550 2021-11-15T19:36:22.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff48ff9700 1 -- 172.21.2.137:0/2095232394 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff34018070 con 0x7eff4c0b0550 2021-11-15T19:36:22.214 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff30053580 msgr2=0x7eff30055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff30053580 0x7eff30055a40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7eff3c002ef0 tx=0x7eff3c006890).stop 2021-11-15T19:36:22.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 msgr2=0x7eff4c14a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 0x7eff4c14a070 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7eff34002fb0 tx=0x7eff34006df0).stop 2021-11-15T19:36:22.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 shutdown_connections 2021-11-15T19:36:22.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7eff30053580 0x7eff30055a40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.216 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7eff4c14aaa0 0x7eff4c145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:22.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7eff4c0b0550 0x7eff4c14a070 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 --2- 172.21.2.137:0/2095232394 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7eff4c05c770 0x7eff4c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T19:36:22.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 >> 172.21.2.137:0/2095232394 conn(0x7eff4c0631e0 msgr2=0x7eff4c1484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:22.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 shutdown_connections 2021-11-15T19:36:22.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.202+0000 7eff51ef7700 1 -- 172.21.2.137:0/2095232394 wait complete. 2021-11-15T19:36:22.222 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T19:36:22.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff2177eb700 1 Processor -- start 2021-11-15T19:36:22.279 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff2177eb700 1 -- start start 2021-11-15T19:36:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff2177eb700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff2100b0830 0x7ff2100af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff2177eb700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210147f70 con 0x7ff21005fd20 2021-11-15T19:36:22.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff2177eb700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210060100 con 0x7ff2100b10b0 2021-11-15T19:36:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff2177eb700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff210147cd0 con 0x7ff2100b0830 2021-11-15T19:36:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff215d88700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff2100b10b0 0x7ff2100aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60478/0 (socket says 172.21.2.137:60478) 2021-11-15T19:36:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.266+0000 7ff215d88700 1 -- 172.21.2.137:0/1837817702 learned_addr learned my addr 172.21.2.137:0/1837817702 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293913509 0 0) 0x7ff210060100 con 0x7ff2100b10b0 2021-11-15T19:36:22.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f8003260 con 0x7ff2100b10b0 2021-11-15T19:36:22.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff214d86700 1 --2- 172.21.2.137:0/1837817702 >> v2:172.21.2.111:3300/0 conn(0x7ff2100b0830 0x7ff2100af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118044147 0 0) 0x7ff1f8003260 con 0x7ff2100b10b0 2021-11-15T19:36:22.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 >> v2:172.21.2.111:3300/0 conn(0x7ff2100b0830 msgr2=0x7ff2100af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:22.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 --2- 172.21.2.137:0/1837817702 >> v2:172.21.2.111:3300/0 conn(0x7ff2100b0830 0x7ff2100af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 >> v1:172.21.2.111:6789/0 conn(0x7ff21005fd20 legacy=0x7ff2100b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100a9ed0 con 0x7ff2100b10b0 2021-11-15T19:36:22.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff2080019e0 con 0x7ff2100b10b0 2021-11-15T19:36:22.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 >> v1:172.21.2.137:6789/0 conn(0x7ff2100b10b0 legacy=0x7ff2100aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f8003820 0x7ff1f8003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8004500 0x7ff1f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f8004f90 0x7ff1f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210147cd0 con 0x7ff1f8004500 2021-11-15T19:36:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f800be80 con 0x7ff1f8003820 2021-11-15T19:36:22.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f800c040 con 0x7ff1f8004f90 2021-11-15T19:36:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f8003820 0x7ff1f8003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff214d86700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8004500 0x7ff1f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f8004f90 0x7ff1f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 -- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f8004f90 msgr2=0x7ff1f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:22.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff1f8004f90 0x7ff1f800b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 -- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8004500 msgr2=0x7ff1f8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8004500 0x7ff1f8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 -- 172.21.2.137:0/1837817702 reap_dead start 2021-11-15T19:36:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 -- 172.21.2.137:0/1837817702 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8003260 con 0x7ff1f8003820 2021-11-15T19:36:22.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f8003820 0x7ff1f8003c40 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7ff2100b4db0 tx=0x7ff20c007a00).ready entity=mon.1 client_cookie=7bbac1ed553a5e50 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:22.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20c007d10 con 0x7ff1f8003820 2021-11-15T19:36:22.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c007030 con 0x7ff1f8003820 2021-11-15T19:36:22.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff203fff700 1 -- 172.21.2.137:0/1837817702 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20c007390 con 0x7ff1f8003820 2021-11-15T19:36:22.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/1837817702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f8003820 msgr2=0x7ff1f8003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f8003820 0x7ff1f8003c40 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7ff2100b4db0 tx=0x7ff20c007a00).stop 2021-11-15T19:36:22.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/1837817702 shutdown_connections 2021-11-15T19:36:22.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 --2- 172.21.2.137:0/1837817702 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff1f8003820 0x7ff1f8003c40 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/1837817702 >> 172.21.2.137:0/1837817702 conn(0x7ff2100b4e60 msgr2=0x7ff2100b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:22.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/1837817702 shutdown_connections 2021-11-15T19:36:22.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/1837817702 wait complete. 2021-11-15T19:36:22.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 Processor -- start 2021-11-15T19:36:22.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- start start 2021-11-15T19:36:22.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8003820 0x7ff2100990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff210065310 0x7ff2101435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 0x7ff210156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100631e0 con 0x7ff1f8003820 2021-11-15T19:36:22.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210062890 con 0x7ff210144510 2021-11-15T19:36:22.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210143ab0 con 0x7ff210065310 2021-11-15T19:36:22.294 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 0x7ff210156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 0x7ff210156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41708/0 (socket says 172.21.2.137:41708) 2021-11-15T19:36:22.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 -- 172.21.2.137:0/2886722512 learned_addr learned my addr 172.21.2.137:0/2886722512 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:22.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215587700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8003820 0x7ff2100990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff214d86700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff210065310 0x7ff2101435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.295 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 -- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff210065310 msgr2=0x7ff2101435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff210065310 0x7ff2101435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 -- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8003820 msgr2=0x7ff2100990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:22.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8003820 0x7ff2100990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:22.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 -- 172.21.2.137:0/2886722512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210062e60 con 0x7ff210144510 2021-11-15T19:36:22.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff214d86700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff210065310 0x7ff2101435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T19:36:22.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff215d88700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 0x7ff210156ad0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7ff20c000f50 tx=0x7ff208009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:22.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff208004ab0 con 0x7ff210144510 2021-11-15T19:36:22.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208004c10 con 0x7ff210144510 2021-11-15T19:36:22.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210156fc0 con 0x7ff210144510 2021-11-15T19:36:22.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff208007030 con 0x7ff210144510 2021-11-15T19:36:22.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.270+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21015a020 con 0x7ff210144510 2021-11-15T19:36:22.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff210063350 con 0x7ff210144510 2021-11-15T19:36:22.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff208007190 con 0x7ff210144510 2021-11-15T19:36:22.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff2027fc700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1f00536d0 0x7ff1f0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:22.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6155+0+0 (secure 0 0 0) 0x7ff20806b8f0 con 0x7ff210144510 2021-11-15T19:36:22.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff215587700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1f00536d0 0x7ff1f0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:22.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff215587700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1f00536d0 0x7ff1f0055b90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ff20c01a000 tx=0x7ff20c013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:22.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.274+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff210063350 con 0x7ff210144510 2021-11-15T19:36:22.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:22.358+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff210063350 con 0x7ff210144510 2021-11-15T19:36:23.217 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2027fc700 1 -- 172.21.2.137:0/2886722512 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff210063350 con 0x7ff210144510 2021-11-15T19:36:23.218 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1f00536d0 msgr2=0x7ff1f0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1f00536d0 0x7ff1f0055b90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ff20c01a000 tx=0x7ff20c013000).stop 2021-11-15T19:36:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 msgr2=0x7ff210156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 0x7ff210156ad0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7ff20c000f50 tx=0x7ff208009040).stop 2021-11-15T19:36:23.219 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 shutdown_connections 2021-11-15T19:36:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff1f00536d0 0x7ff1f0055b90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff210144510 0x7ff210156ad0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff210065310 0x7ff2101435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 --2- 172.21.2.137:0/2886722512 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff1f8003820 0x7ff2100990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 >> 172.21.2.137:0/2886722512 conn(0x7ff2100b4e60 msgr2=0x7ff2100af800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 shutdown_connections 2021-11-15T19:36:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.206+0000 7ff2177eb700 1 -- 172.21.2.137:0/2886722512 wait complete. 2021-11-15T19:36:23.221 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_metadata' removed 2021-11-15T19:36:23.225 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T19:36:23.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 Processor -- start 2021-11-15T19:36:23.278 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 -- start start 2021-11-15T19:36:23.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 0x7f93200af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.282 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f93200b10b0 0x7f93200b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9320147f70 con 0x7f93200b0610 2021-11-15T19:36:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9320060100 con 0x7f93200b10b0 2021-11-15T19:36:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f9324c6a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320147cd0 con 0x7f932005fd20 2021-11-15T19:36:23.283 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931ed9d700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f93200b0610 0x7f93200aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60498/0 (socket says 172.21.2.137:60498) 2021-11-15T19:36:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931ed9d700 1 -- 172.21.2.137:0/224410447 learned_addr learned my addr 172.21.2.137:0/224410447 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T19:36:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564703700 0 0) 0x7f9320147f70 con 0x7f93200b0610 2021-11-15T19:36:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9304003260 con 0x7f93200b0610 2021-11-15T19:36:23.284 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931e59c700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 0x7f93200af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931dd9b700 1 --2- 172.21.2.137:0/224410447 >> v2:172.21.2.111:3300/0 conn(0x7f93200b10b0 0x7f93200b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3738327032 0 0) 0x7f9304003260 con 0x7f93200b0610 2021-11-15T19:36:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 msgr2=0x7f93200af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:23.285 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 0x7f93200af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 >> v2:172.21.2.111:3300/0 conn(0x7f93200b10b0 msgr2=0x7f93200b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 --2- 172.21.2.137:0/224410447 >> v2:172.21.2.111:3300/0 conn(0x7f93200b10b0 0x7f93200b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200a9ed0 con 0x7f93200b0610 2021-11-15T19:36:23.286 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f93180019e0 con 0x7f93200b0610 2021-11-15T19:36:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.266+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 >> v1:172.21.2.137:6789/0 conn(0x7f93200b0610 legacy=0x7f93200aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 0x7f93040037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9304003e00 0x7f9304004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93040049f0 0x7f9304004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.287 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320060100 con 0x7f93040049f0 2021-11-15T19:36:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320147cd0 con 0x7f9304003e00 2021-11-15T19:36:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930400b8e0 con 0x7f932005fd20 2021-11-15T19:36:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9304003e00 0x7f9304004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.288 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93040049f0 0x7f9304004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931e59c700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 0x7f93040037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 -- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 msgr2=0x7f93040037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932005fd20 0x7f93040037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 -- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93040049f0 msgr2=0x7f9304004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T19:36:23.289 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f93040049f0 0x7f9304004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 -- 172.21.2.137:0/224410447 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304003260 con 0x7f9304003e00 2021-11-15T19:36:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9304003e00 0x7f9304004500 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f931000a000 tx=0x7f9310008040).ready entity=mon.1 client_cookie=e66b06795f438876 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9310013670 con 0x7f9304003e00 2021-11-15T19:36:23.290 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100137d0 con 0x7f9304003e00 2021-11-15T19:36:23.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931d59a700 1 -- 172.21.2.137:0/224410447 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9310013b30 con 0x7f9304003e00 2021-11-15T19:36:23.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/224410447 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9304003e00 msgr2=0x7f9304004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:23.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 --2- 172.21.2.137:0/224410447 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9304003e00 0x7f9304004500 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f931000a000 tx=0x7f9310008040).stop 2021-11-15T19:36:23.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 -- 172.21.2.137:0/224410447 reap_dead start 2021-11-15T19:36:23.291 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/224410447 shutdown_connections 2021-11-15T19:36:23.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/224410447 >> 172.21.2.137:0/224410447 conn(0x7f93200b4e60 msgr2=0x7f93200b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:23.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/224410447 shutdown_connections 2021-11-15T19:36:23.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/224410447 wait complete. 2021-11-15T19:36:23.292 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 Processor -- start 2021-11-15T19:36:23.293 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- start start 2021-11-15T19:36:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9304003e00 0x7f9320146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932009a190 0x7f932009a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 0x7f9320159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.296 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200997f0 con 0x7f9304003e00 2021-11-15T19:36:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932015a4c0 con 0x7f9320159b40 2021-11-15T19:36:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320099a50 con 0x7f932009a190 2021-11-15T19:36:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 0x7f9320159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.297 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 0x7f9320159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41728/0 (socket says 172.21.2.137:41728) 2021-11-15T19:36:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 -- 172.21.2.137:0/3927931304 learned_addr learned my addr 172.21.2.137:0/3927931304 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T19:36:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931e59c700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9304003e00 0x7f9320146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932009a190 0x7f932009a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.298 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 -- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932009a190 msgr2=0x7f932009a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932009a190 0x7f932009a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 -- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9304003e00 msgr2=0x7f9320146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9304003e00 0x7f9320146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 -- 172.21.2.137:0/3927931304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320099cf0 con 0x7f9320159b40 2021-11-15T19:36:23.299 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931dd9b700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932009a190 0x7f932009a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T19:36:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f931ed9d700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 0x7f9320159fd0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f9318001210 tx=0x7f93200b5e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9318010710 con 0x7f9320159b40 2021-11-15T19:36:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318010870 con 0x7f9320159b40 2021-11-15T19:36:23.300 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9318010bd0 con 0x7f9320159b40 2021-11-15T19:36:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93201447a0 con 0x7f9320159b40 2021-11-15T19:36:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.270+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9320148480 con 0x7f9320159b40 2021-11-15T19:36:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932009ab00 con 0x7f9320159b40 2021-11-15T19:36:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9318010d30 con 0x7f9320159b40 2021-11-15T19:36:23.301 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f930f7fe700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92fc053640 0x7f92fc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T19:36:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5717+0+0 (secure 0 0 0) 0x7f931806b680 con 0x7f9320159b40 2021-11-15T19:36:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f931e59c700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92fc053640 0x7f92fc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T19:36:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f931e59c700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92fc053640 0x7f92fc055b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f9314009000 tx=0x7f9314008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T19:36:23.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.274+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9318042940 con 0x7f9320159b40 2021-11-15T19:36:23.370 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:23.358+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93200b0a70 con 0x7f9320159b40 2021-11-15T19:36:24.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.218+0000 7f930f7fe700 1 -- 172.21.2.137:0/3927931304 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9318045f60 con 0x7f9320159b40 2021-11-15T19:36:24.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92fc053640 msgr2=0x7f92fc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:24.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92fc053640 0x7f92fc055b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f9314009000 tx=0x7f9314008040).stop 2021-11-15T19:36:24.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 msgr2=0x7f9320159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T19:36:24.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 0x7f9320159fd0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f9318001210 tx=0x7f93200b5e40).stop 2021-11-15T19:36:24.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 shutdown_connections 2021-11-15T19:36:24.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f92fc053640 0x7f92fc055b00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:24.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f9320159b40 0x7f9320159fd0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:24.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f932009a190 0x7f932009a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:24.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 --2- 172.21.2.137:0/3927931304 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f9304003e00 0x7f9320146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T19:36:24.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 >> 172.21.2.137:0/3927931304 conn(0x7f93200b4e60 msgr2=0x7f9320144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T19:36:24.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 shutdown_connections 2021-11-15T19:36:24.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T19:36:24.222+0000 7f9324c6a700 1 -- 172.21.2.137:0/3927931304 wait complete. 2021-11-15T19:36:24.236 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'cephfs_data' removed 2021-11-15T19:36:24.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-15T19:36:24.240 DEBUG:teuthology.orchestra.run.gibba031:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-11-15T19:36:24.730 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:24.732 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:24.736 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:24.739 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:24.742 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:54.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:36:54.346 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:36:54.347 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:36:54.806 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:54.889 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:54.892 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:54.896 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:36:54.899 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:24.247 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T19:37:24.251 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T19:37:24.955 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:24.959 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:24.963 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:24.966 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:24.970 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:55.012 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:55.017 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:55.021 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:55.024 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:37:55.028 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:25.071 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:25.076 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:25.079 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:25.083 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:25.087 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:55.161 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:55.165 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:55.168 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:55.172 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:38:55.175 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:25.258 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:25.262 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:25.266 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:25.270 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:25.274 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:55.318 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:55.322 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:55.326 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:55.329 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:39:55.333 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:25.395 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:25.399 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:25.402 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:25.405 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:25.409 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:55.481 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:55.485 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:55.489 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:55.492 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:40:55.496 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:25.556 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:25.562 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:25.566 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:25.571 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:25.574 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:55.617 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:55.621 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:55.624 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:55.628 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:41:55.631 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:25.677 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:25.681 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:25.684 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:25.687 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:25.690 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:55.748 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:55.753 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:55.756 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:55.759 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:42:55.763 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:25.847 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:25.851 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:25.854 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:25.858 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:25.861 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:55.906 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:55.911 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:55.914 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:55.918 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:43:55.922 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:25.968 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:25.972 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:25.976 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:25.979 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:25.982 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:56.025 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:56.030 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:56.033 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:56.036 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:44:56.040 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:26.094 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:26.098 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:26.101 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:26.105 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:26.108 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:56.175 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:56.179 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:56.183 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:56.186 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:45:56.189 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:26.248 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:26.252 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:26.256 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:26.260 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:26.263 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:56.306 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:56.311 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:56.314 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:56.318 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:46:56.322 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:26.391 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:26.395 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:26.399 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:26.402 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:26.409 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:56.495 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:56.499 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:56.502 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:56.506 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:47:56.509 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:26.563 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:26.566 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:26.570 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:26.573 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:26.576 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:56.614 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:56.618 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:56.621 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:56.625 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:48:56.628 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:26.774 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:26.778 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:26.782 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:26.785 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:26.789 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:56.845 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:56.849 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:56.852 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:56.855 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:49:56.858 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:26.916 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:26.920 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:26.923 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:26.926 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:26.930 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:56.998 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:57.006 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:57.009 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:57.013 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:50:57.016 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:27.078 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:27.083 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:27.087 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:27.090 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:27.094 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:54.353 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T19:51:54.355 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T19:51:54.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T19:51:54.361 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T19:51:54.361 DEBUG:teuthology.orchestra.run.gibba011:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:51:54.374 DEBUG:teuthology.orchestra.run.gibba017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:51:54.388 DEBUG:teuthology.orchestra.run.gibba018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:51:54.401 DEBUG:teuthology.orchestra.run.gibba031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:51:54.414 DEBUG:teuthology.orchestra.run.gibba037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T19:51:54.427 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T19:51:54.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T19:51:54.428 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T19:51:54.428 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T19:51:57.144 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:57.149 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:57.154 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:57.158 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:51:57.161 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:27.203 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:27.208 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:27.211 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:27.215 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:27.218 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:57.314 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:57.319 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:57.323 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:57.326 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:52:57.329 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:27.379 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:27.383 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:27.387 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:27.390 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:27.394 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:57.442 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:57.446 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:57.450 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:57.453 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:53:57.457 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:27.509 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:27.513 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:27.517 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:27.521 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:27.524 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:57.579 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:57.583 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:57.586 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:57.590 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:54:57.593 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:27.651 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:27.655 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:27.659 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:27.662 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:27.666 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:57.727 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:57.732 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:57.735 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:57.739 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:55:57.743 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:27.824 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:27.828 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:27.831 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:27.835 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:27.838 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:57.885 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:57.889 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:57.893 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:57.896 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:56:57.900 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:27.939 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:27.943 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:27.947 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:27.950 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:27.953 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:58.012 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:58.016 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:58.020 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:58.023 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:57:58.027 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:28.076 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:28.079 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:28.082 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:28.086 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:28.089 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:58.140 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:58.143 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:58.147 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:58.150 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:58:58.153 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:28.202 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:28.206 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:28.209 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:28.213 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:28.216 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:58.263 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:58.267 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:58.270 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:58.273 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T19:59:58.277 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:28.400 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:28.405 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:28.408 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:28.411 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:28.415 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:58.485 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:58.489 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:58.493 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:58.496 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:00:58.499 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:28.546 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:28.551 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:28.555 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:28.559 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:28.563 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:58.639 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:58.643 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:58.647 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:58.651 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:01:58.655 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:28.700 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:28.703 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:28.707 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:28.710 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:28.714 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:58.767 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:58.772 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:58.776 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:58.781 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:02:58.787 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:28.873 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:28.877 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:28.880 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:28.884 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:28.887 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:58.942 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:58.946 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:58.950 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:58.953 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:03:58.957 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:29.033 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:29.037 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:29.041 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:29.044 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:29.048 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:59.091 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:59.095 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:59.098 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:59.102 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:04:59.105 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:29.230 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:29.234 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:29.238 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:29.241 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:29.244 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:59.317 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:59.320 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:59.324 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:59.327 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:05:59.331 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:29.377 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:29.381 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:29.385 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:29.389 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:29.392 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:54.432 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T20:06:54.433 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T20:06:54.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:06:54.438 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-11-15T20:06:54.439 INFO:tasks.cephfs_test_runner:ERROR 2021-11-15T20:06:54.440 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.440 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T20:06:54.440 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T20:06:54.441 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T20:06:54.441 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.441 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T20:06:54.442 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T20:06:54.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T20:06:54.442 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T20:06:54.442 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T20:06:54.443 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.443 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T20:06:54.443 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.444 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-11-15T20:06:54.444 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-11-15T20:06:54.444 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-11-15T20:06:54.445 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-11-15T20:06:54.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T20:06:54.445 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T20:06:54.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T20:06:54.446 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T20:06:54.446 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T20:06:54.447 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T20:06:54.447 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T20:06:54.447 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T20:06:54.447 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T20:06:54.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T20:06:54.448 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T20:06:54.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T20:06:54.448 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T20:06:54.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T20:06:54.449 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T20:06:54.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T20:06:54.449 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T20:06:54.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T20:06:54.450 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T20:06:54.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T20:06:54.451 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T20:06:54.451 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T20:06:54.451 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.452 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T20:06:54.452 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T20:06:54.452 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T20:06:54.453 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T20:06:54.453 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T20:06:54.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T20:06:54.454 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T20:06:54.454 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T20:06:54.454 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.455 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T20:06:54.455 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.455 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-11-15T20:06:54.456 INFO:tasks.cephfs_test_runner: m.teardown() 2021-11-15T20:06:54.456 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-11-15T20:06:54.456 INFO:tasks.cephfs_test_runner: self.umount() 2021-11-15T20:06:54.456 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-11-15T20:06:54.457 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-11-15T20:06:54.457 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T20:06:54.457 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T20:06:54.457 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T20:06:54.458 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T20:06:54.458 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T20:06:54.458 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T20:06:54.459 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T20:06:54.459 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T20:06:54.459 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T20:06:54.460 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T20:06:54.460 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T20:06:54.460 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T20:06:54.460 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T20:06:54.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T20:06:54.461 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T20:06:54.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T20:06:54.462 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T20:06:54.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T20:06:54.462 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T20:06:54.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T20:06:54.463 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T20:06:54.463 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T20:06:54.463 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.464 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T20:06:54.464 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2380.827s 2021-11-15T20:06:54.464 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.464 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-11-15T20:06:54.465 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.465 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T20:06:54.465 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T20:06:54.466 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T20:06:54.466 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.466 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T20:06:54.466 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T20:06:54.467 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T20:06:54.467 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T20:06:54.467 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T20:06:54.468 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.468 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T20:06:54.468 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.468 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.469 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-11-15T20:06:54.469 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-11-15T20:06:54.469 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-11-15T20:06:54.469 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-11-15T20:06:54.470 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T20:06:54.470 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T20:06:54.470 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T20:06:54.471 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T20:06:54.471 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T20:06:54.471 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T20:06:54.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T20:06:54.472 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T20:06:54.472 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T20:06:54.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T20:06:54.472 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T20:06:54.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T20:06:54.473 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T20:06:54.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T20:06:54.473 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T20:06:54.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T20:06:54.474 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T20:06:54.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T20:06:54.475 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T20:06:54.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T20:06:54.475 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T20:06:54.475 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T20:06:54.476 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.476 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T20:06:54.476 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T20:06:54.477 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T20:06:54.477 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T20:06:54.477 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T20:06:54.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T20:06:54.478 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T20:06:54.478 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T20:06:54.478 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.479 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T20:06:54.479 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.479 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T20:06:54.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-11-15T20:06:54.480 INFO:tasks.cephfs_test_runner: m.teardown() 2021-11-15T20:06:54.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-11-15T20:06:54.480 INFO:tasks.cephfs_test_runner: self.umount() 2021-11-15T20:06:54.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-11-15T20:06:54.481 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-11-15T20:06:54.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T20:06:54.481 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T20:06:54.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T20:06:54.482 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T20:06:54.482 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T20:06:54.482 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T20:06:54.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T20:06:54.483 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T20:06:54.483 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T20:06:54.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T20:06:54.484 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T20:06:54.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T20:06:54.484 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T20:06:54.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T20:06:54.485 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T20:06:54.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T20:06:54.486 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T20:06:54.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T20:06:54.486 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T20:06:54.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T20:06:54.487 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T20:06:54.487 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T20:06:54.487 INFO:tasks.cephfs_test_runner: 2021-11-15T20:06:54.488 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T20:06:54.583 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d689ee09ab3f4009ad45bc890f9f1ba2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T20:06:54.584 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-11-15T20:06:54.596 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-11-15T20:06:54.724 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-11-15T20:06:54.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T20:06:54.725 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T20:06:54.725 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T20:06:59.450 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:59.454 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:59.457 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:59.460 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:06:59.464 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:29.504 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:29.509 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:29.512 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:29.516 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:29.519 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:59.586 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:59.591 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:59.594 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:59.598 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:07:59.601 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:29.655 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:29.659 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:29.663 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:29.666 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:29.670 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:59.707 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:59.712 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:59.715 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:59.719 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:08:59.722 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:29.872 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:29.877 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:29.881 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:29.884 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:29.887 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:59.943 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:59.948 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:59.951 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:59.955 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:09:59.959 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:10:30.014 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:10:30.017 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:10:30.020 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:10:30.022 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:10:30.025 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:00.140 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:00.144 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:00.146 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:00.149 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:00.152 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:30.210 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:30.214 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:30.217 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:30.221 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:11:30.224 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:00.286 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:00.291 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:00.294 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:00.298 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:00.301 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:30.349 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:30.352 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:30.355 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:30.359 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:12:30.362 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:00.442 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:00.446 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:00.450 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:00.453 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:00.456 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:30.502 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:30.506 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:30.509 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:30.513 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:13:30.516 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:00.562 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:00.566 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:00.570 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:00.573 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:00.577 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:30.635 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:30.640 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:30.643 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:30.647 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:14:30.651 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:00.723 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:00.727 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:00.731 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:00.735 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:00.738 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:30.807 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:30.811 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:30.815 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:30.818 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:15:30.822 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:00.890 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:00.895 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:00.899 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:00.902 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:00.906 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:30.948 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:30.952 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:30.956 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:30.959 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:16:30.963 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:01.010 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:01.015 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:01.018 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:01.022 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:01.026 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:31.078 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:31.082 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:31.086 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:31.089 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:17:31.093 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:01.150 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:01.155 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:01.158 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:01.162 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:01.166 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:31.219 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:31.223 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:31.226 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:31.230 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:18:31.233 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:01.304 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:01.308 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:01.311 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:01.315 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:01.319 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:31.358 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:31.363 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:31.366 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:31.370 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:19:31.373 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:01.417 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:01.421 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:01.425 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:01.428 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:01.431 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:31.500 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:31.504 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:31.507 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:31.511 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:20:31.514 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:01.574 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:01.579 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:01.582 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:01.585 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:01.589 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:31.642 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:31.647 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:31.651 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:31.655 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:31.659 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:21:54.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:21:54.738 INFO:teuthology.orchestra.run.gibba031.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Connection timed out 2021-11-15T20:21:54.740 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T20:21:54.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T20:21:54.742 DEBUG:teuthology.orchestra.run.gibba031:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T20:21:54.742 DEBUG:teuthology.orchestra.run.gibba031:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T20:22:01.712 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:01.717 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:01.721 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:01.725 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:01.728 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:31.783 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:31.787 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:31.791 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:31.794 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:22:31.798 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:01.864 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:01.869 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:01.873 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:01.876 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:01.880 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:31.926 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:31.930 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:31.933 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:31.937 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:23:31.941 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:01.983 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:01.989 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:01.993 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:01.997 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:02.002 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:32.127 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:32.131 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:32.134 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:32.138 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:24:32.141 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:02.185 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:02.190 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:02.193 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:02.197 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:02.201 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:32.243 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:32.248 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:32.251 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:32.255 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:25:32.259 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:02.317 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:02.321 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:02.324 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:02.328 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:02.331 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:32.382 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:32.386 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:32.390 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:32.394 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:26:32.397 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:02.477 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:02.481 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:02.484 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:02.488 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:02.491 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:32.539 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:32.543 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:32.547 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:32.550 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:27:32.554 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:02.599 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:02.603 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:02.606 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:02.610 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:02.613 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:32.674 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:32.679 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:32.683 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:32.686 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:28:32.690 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:02.734 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:02.739 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:02.742 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:02.746 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:02.749 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:32.903 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:32.907 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:32.911 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:32.914 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:29:32.918 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:02.952 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:02.956 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:02.959 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:02.963 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:02.966 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:33.036 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:33.040 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:33.043 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:33.046 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:30:33.050 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:03.149 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:03.153 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:03.157 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:03.161 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:03.164 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:33.216 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:33.220 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:33.223 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:33.226 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:31:33.230 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:03.332 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:03.337 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:03.340 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:03.344 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:03.347 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:33.390 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:33.395 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:33.398 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:33.402 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:32:33.405 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:03.461 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:03.466 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:03.470 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:03.473 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:03.477 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:33.525 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:33.529 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:33.533 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:33.537 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:33:33.540 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:03.600 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:03.604 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:03.607 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:03.611 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:03.615 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:33.776 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:33.780 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:33.785 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:33.788 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:34:33.792 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:03.875 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:03.880 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:03.883 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:03.887 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:03.891 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:33.953 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:33.958 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:33.962 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:33.965 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:35:33.969 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:04.025 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:04.029 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:04.033 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:04.037 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:04.040 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:34.085 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:34.088 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:34.092 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:34.095 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:34.098 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:36:54.748 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T20:36:54.764 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T20:36:54.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:36:54.768 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T20:36:54.783 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-11-15T20:36:54.794 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-11-15T20:36:54.796 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T20:36:54.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 Processor -- start 2021-11-15T20:36:54.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 -- start start 2021-11-15T20:36:54.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40b1340 0x7efbf4147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:54.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efbf4143f00 0x7efbf4144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:54.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf4148190 con 0x7efbf40a9f50 2021-11-15T20:36:54.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf40b1720 con 0x7efbf4143f00 2021-11-15T20:36:54.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbfa7e1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf4147e70 con 0x7efbf40b1340 2021-11-15T20:36:54.874 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbf37fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efbf4143f00 0x7efbf4144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:54.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbf37fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7efbf4143f00 0x7efbf4144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41790/0 (socket says 172.21.2.137:41790) 2021-11-15T20:36:54.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbf37fe700 1 -- 172.21.2.137:0/1180271058 learned_addr learned my addr 172.21.2.137:0/1180271058 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:54.875 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.863+0000 7efbf3fff700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40b1340 0x7efbf4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:54.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/1180271058 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40b1340 msgr2=0x7efbf4147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:54.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40b1340 0x7efbf4147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/1180271058 >> v1:172.21.2.111:6789/0 conn(0x7efbf40a9f50 legacy=0x7efbf40aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:54.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/1180271058 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf40af800 con 0x7efbf4143f00 2021-11-15T20:36:54.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf3fff700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40b1340 0x7efbf4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T20:36:54.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf4143f00 0x7efbf4144360 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7efbf405cfa0 tx=0x7efbe4006eb0).ready entity=mon.1 client_cookie=362610cd219a7d19 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:54.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf2ffd700 1 -- 172.21.2.137:0/1180271058 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe400d570 con 0x7efbf4143f00 2021-11-15T20:36:54.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf2ffd700 1 -- 172.21.2.137:0/1180271058 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4000e90 con 0x7efbf4143f00 2021-11-15T20:36:54.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf2ffd700 1 -- 172.21.2.137:0/1180271058 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe400d8c0 con 0x7efbf4143f00 2021-11-15T20:36:54.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/1180271058 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf4143f00 msgr2=0x7efbf4144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:54.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf4143f00 0x7efbf4144360 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7efbf405cfa0 tx=0x7efbe4006eb0).stop 2021-11-15T20:36:54.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/1180271058 shutdown_connections 2021-11-15T20:36:54.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf4143f00 0x7efbf4144360 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/1180271058 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40b1340 0x7efbf4147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/1180271058 >> 172.21.2.137:0/1180271058 conn(0x7efbf40b4e60 msgr2=0x7efbf40b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:54.880 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/1180271058 shutdown_connections 2021-11-15T20:36:54.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/1180271058 wait complete. 2021-11-15T20:36:54.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 Processor -- start 2021-11-15T20:36:54.881 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- start start 2021-11-15T20:36:54.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40a9f50 0x7efbf409a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:54.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 0x7efbf40ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:54.882 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efbf4143f00 0x7efbf40aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:54.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf4141ec0 con 0x7efbf4143f00 2021-11-15T20:36:54.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf41416a0 con 0x7efbf40b1340 2021-11-15T20:36:54.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf4141980 con 0x7efbf40a9f50 2021-11-15T20:36:54.883 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 0x7efbf40ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:54.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 0x7efbf40ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41796/0 (socket says 172.21.2.137:41796) 2021-11-15T20:36:54.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/504000597 learned_addr learned my addr 172.21.2.137:0/504000597 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:54.884 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf8d7e700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efbf4143f00 0x7efbf40aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:54.885 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf3fff700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40a9f50 0x7efbf409a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:54.886 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40a9f50 msgr2=0x7efbf409a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:54.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40a9f50 0x7efbf409a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efbf4143f00 msgr2=0x7efbf40aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:54.887 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efbf4143f00 0x7efbf40aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 -- 172.21.2.137:0/504000597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe400b1e0 con 0x7efbf40b1340 2021-11-15T20:36:54.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf8d7e700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efbf4143f00 0x7efbf40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T20:36:54.888 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf37fe700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 0x7efbf40ae630 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7efbf405cfa0 tx=0x7efbe4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:54.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe40118f0 con 0x7efbf40b1340 2021-11-15T20:36:54.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4011a50 con 0x7efbf40b1340 2021-11-15T20:36:54.889 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf4141c20 con 0x7efbf40b1340 2021-11-15T20:36:54.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe4011db0 con 0x7efbf40b1340 2021-11-15T20:36:54.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf4159d50 con 0x7efbf40b1340 2021-11-15T20:36:54.890 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.867+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf40ae370 con 0x7efbf40b1340 2021-11-15T20:36:54.891 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.871+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efbe4025030 con 0x7efbf40b1340 2021-11-15T20:36:54.893 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.871+0000 7efbf17fa700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbd8053720 0x7efbd8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.871+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efbe406c950 con 0x7efbf40b1340 2021-11-15T20:36:54.894 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.871+0000 7efbf3fff700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbd8053720 0x7efbd8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:54.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.871+0000 7efbf3fff700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbd8053720 0x7efbd8055be0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7efbdc00b000 tx=0x7efbdc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:54.895 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.871+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efbf40ae370 con 0x7efbf40b1340 2021-11-15T20:36:54.960 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efbf4148190 con 0x7efbf40b1340 2021-11-15T20:36:54.961 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbf17fa700 1 -- 172.21.2.137:0/504000597 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13318 (secure 0 0 0) 0x7efbf4148190 con 0x7efbf40b1340 2021-11-15T20:36:54.961 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T20:36:54.962 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":155,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:24.213951+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.137:6833/754709113":"2021-11-16T19:36:20.922664+0000","172.21.2.137:6832/754709113":"2021-11-16T19:36:20.922664+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T20:36:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbd8053720 msgr2=0x7efbd8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:54.963 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbd8053720 0x7efbd8055be0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7efbdc00b000 tx=0x7efbdc008040).stop 2021-11-15T20:36:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 msgr2=0x7efbf40ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 0x7efbf40ae630 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7efbf405cfa0 tx=0x7efbe4015000).stop 2021-11-15T20:36:54.964 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 shutdown_connections 2021-11-15T20:36:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7efbd8053720 0x7efbd8055be0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7efbf4143f00 0x7efbf40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.965 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7efbf40b1340 0x7efbf40ae630 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 --2- 172.21.2.137:0/504000597 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7efbf40a9f50 0x7efbf409a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 >> 172.21.2.137:0/504000597 conn(0x7efbf40b4e60 msgr2=0x7efbf4145b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:54.966 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 shutdown_connections 2021-11-15T20:36:54.967 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:54.955+0000 7efbfa7e1700 1 -- 172.21.2.137:0/504000597 wait complete. 2021-11-15T20:36:54.969 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T20:36:55.062 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.055+0000 7fd5954bd700 1 Processor -- start 2021-11-15T20:36:55.063 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.055+0000 7fd5954bd700 1 -- start start 2021-11-15T20:36:55.064 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd59005fb80 0x7fd59009a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5900b1130 0x7fd590143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd590141bc0 con 0x7fd59009ab80 2021-11-15T20:36:55.065 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd590097ff0 con 0x7fd59005fb80 2021-11-15T20:36:55.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59009a1f0 con 0x7fd5900b1130 2021-11-15T20:36:55.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58f7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fd59009ab80 0x7fd590144440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60586/0 (socket says 172.21.2.137:60586) 2021-11-15T20:36:55.066 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58f7fe700 1 -- 172.21.2.137:0/4099817276 learned_addr learned my addr 172.21.2.137:0/4099817276 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:55.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58effd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fd59005fb80 0x7fd59009a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:55.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58effd700 1 -- 172.21.2.137:0/4099817276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5900b1130 msgr2=0x7fd590143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:55.067 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58effd700 1 --2- 172.21.2.137:0/4099817276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5900b1130 0x7fd590143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58effd700 1 -- 172.21.2.137:0/4099817276 >> v1:172.21.2.137:6789/0 conn(0x7fd59009ab80 legacy=0x7fd590144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58effd700 1 -- 172.21.2.137:0/4099817276 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900b1660 con 0x7fd59005fb80 2021-11-15T20:36:55.068 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58effd700 1 --2- 172.21.2.137:0/4099817276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd59005fb80 0x7fd59009a690 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fd580002f70 tx=0x7fd580006df0).ready entity=mon.1 client_cookie=c6490af2b1ba9d7a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:55.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58dffb700 1 -- 172.21.2.137:0/4099817276 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58000d570 con 0x7fd59005fb80 2021-11-15T20:36:55.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58dffb700 1 -- 172.21.2.137:0/4099817276 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580000e90 con 0x7fd59005fb80 2021-11-15T20:36:55.069 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58dffb700 1 -- 172.21.2.137:0/4099817276 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58000d8c0 con 0x7fd59005fb80 2021-11-15T20:36:55.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- 172.21.2.137:0/4099817276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd59005fb80 msgr2=0x7fd59009a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- 172.21.2.137:0/4099817276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd59005fb80 0x7fd59009a690 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fd580002f70 tx=0x7fd580006df0).stop 2021-11-15T20:36:55.070 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- 172.21.2.137:0/4099817276 shutdown_connections 2021-11-15T20:36:55.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- 172.21.2.137:0/4099817276 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd5900b1130 0x7fd590143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- 172.21.2.137:0/4099817276 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd59005fb80 0x7fd59009a690 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:55.071 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- 172.21.2.137:0/4099817276 >> 172.21.2.137:0/4099817276 conn(0x7fd5900b4e60 msgr2=0x7fd5900b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:55.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- 172.21.2.137:0/4099817276 shutdown_connections 2021-11-15T20:36:55.072 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- 172.21.2.137:0/4099817276 wait complete. 2021-11-15T20:36:55.074 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 Processor -- start 2021-11-15T20:36:55.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- start start 2021-11-15T20:36:55.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd59005fb80 0x7fd590066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd59009ab80 0x7fd590066fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 0x7fd5900ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590150b60 con 0x7fd59009ab80 2021-11-15T20:36:55.076 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590150d90 con 0x7fd5900b1130 2021-11-15T20:36:55.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd5954bd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590151030 con 0x7fd59005fb80 2021-11-15T20:36:55.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 0x7fd5900ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:55.077 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58f7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 0x7fd5900ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41812/0 (socket says 172.21.2.137:41812) 2021-11-15T20:36:55.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.059+0000 7fd58f7fe700 1 -- 172.21.2.137:0/3653705845 learned_addr learned my addr 172.21.2.137:0/3653705845 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:55.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58f7fe700 1 -- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd59005fb80 msgr2=0x7fd590066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.078 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58f7fe700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd59005fb80 0x7fd590066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58f7fe700 1 -- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd59009ab80 msgr2=0x7fd590066fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58f7fe700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd59009ab80 0x7fd590066fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58f7fe700 1 -- 172.21.2.137:0/3653705845 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58000b180 con 0x7fd5900b1130 2021-11-15T20:36:55.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58f7fe700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 0x7fd5900ad230 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fd590063290 tx=0x7fd588007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:55.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd588005ba0 con 0x7fd5900b1130 2021-11-15T20:36:55.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588005d00 con 0x7fd5900b1130 2021-11-15T20:36:55.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5880072c0 con 0x7fd5900b1130 2021-11-15T20:36:55.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590097880 con 0x7fd5900b1130 2021-11-15T20:36:55.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd590062fe0 con 0x7fd5900b1130 2021-11-15T20:36:55.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd590066ce0 con 0x7fd5900b1130 2021-11-15T20:36:55.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd588010070 con 0x7fd5900b1130 2021-11-15T20:36:55.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd574057990 0x7fd574059e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd58806aee0 con 0x7fd5900b1130 2021-11-15T20:36:55.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58effd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd574057990 0x7fd574059e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:55.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd58effd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd574057990 0x7fd574059e50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fd580002f70 tx=0x7fd580015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:55.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.063+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5880422c0 con 0x7fd5900b1130 2021-11-15T20:36:55.151 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.147+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5900b56e0 con 0x7fd574057990 2021-11-15T20:36:55.154 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.147+0000 7fd587fff700 1 -- 172.21.2.137:0/3653705845 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66357 (secure 0 0 0) 0x7fd5900b56e0 con 0x7fd574057990 2021-11-15T20:36:55.156 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T20:36:55.157 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd574057990 msgr2=0x7fd574059e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd574057990 0x7fd574059e50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fd580002f70 tx=0x7fd580015000).stop 2021-11-15T20:36:55.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 msgr2=0x7fd5900ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.158 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 0x7fd5900ad230 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fd590063290 tx=0x7fd588007f00).stop 2021-11-15T20:36:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 shutdown_connections 2021-11-15T20:36:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fd574057990 0x7fd574059e50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:55.159 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fd5900b1130 0x7fd5900ad230 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fd59009ab80 0x7fd590066fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 --2- 172.21.2.137:0/3653705845 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fd59005fb80 0x7fd590066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.160 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 >> 172.21.2.137:0/3653705845 conn(0x7fd5900b4e60 msgr2=0x7fd5900b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 shutdown_connections 2021-11-15T20:36:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.151+0000 7fd5954bd700 1 -- 172.21.2.137:0/3653705845 wait complete. 2021-11-15T20:36:55.161 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-11-15T20:36:55.162 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":2251,"stamp":"2021-11-15T20:36:53.270659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":704299008,"kb_used":6103484,"kb_used_data":698195524,"kb_used_omap":27887,"kb_used_meta":0,"kb_avail":698195524,"statfs":{"total":721202184192,"available":714952216576,"internally_reserved":0,"allocated":714952216576,"data_stored":714952216576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28556886,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005167"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":139,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.362586+0000","last_change":"2021-11-15T19:26:47.204497+0000","last_active":"2021-11-15T19:36:23.362586+0000","last_peered":"2021-11-15T19:36:23.362586+0000","last_clean":"2021-11-15T19:36:23.362586+0000","last_became_active":"2021-11-15T19:26:47.204269+0000","last_became_peered":"2021-11-15T19:26:47.204269+0000","last_unstale":"2021-11-15T19:36:23.362586+0000","last_undegraded":"2021-11-15T19:36:23.362586+0000","last_fullsized":"2021-11-15T19:36:23.362586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_clean_scrub_stamp":"2021-11-15T19:26:44.160636+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.213787+0000","last_change":"2021-11-15T19:26:52.880420+0000","last_active":"2021-11-15T19:36:23.213787+0000","last_peered":"2021-11-15T19:36:23.213787+0000","last_clean":"2021-11-15T19:36:23.213787+0000","last_became_active":"2021-11-15T19:26:52.880242+0000","last_became_peered":"2021-11-15T19:26:52.880242+0000","last_unstale":"2021-11-15T19:36:23.213787+0000","last_undegraded":"2021-11-15T19:36:23.213787+0000","last_fullsized":"2021-11-15T19:36:23.213787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.362559+0000","last_change":"2021-11-15T19:26:52.880490+0000","last_active":"2021-11-15T19:36:23.362559+0000","last_peered":"2021-11-15T19:36:23.362559+0000","last_clean":"2021-11-15T19:36:23.362559+0000","last_became_active":"2021-11-15T19:26:52.880321+0000","last_became_peered":"2021-11-15T19:26:52.880321+0000","last_unstale":"2021-11-15T19:36:23.362559+0000","last_undegraded":"2021-11-15T19:36:23.362559+0000","last_fullsized":"2021-11-15T19:36:23.362559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.492598+0000","last_change":"2021-11-15T19:26:53.132775+0000","last_active":"2021-11-15T19:36:23.492598+0000","last_peered":"2021-11-15T19:36:23.492598+0000","last_clean":"2021-11-15T19:36:23.492598+0000","last_became_active":"2021-11-15T19:26:53.132568+0000","last_became_peered":"2021-11-15T19:26:53.132568+0000","last_unstale":"2021-11-15T19:36:23.492598+0000","last_undegraded":"2021-11-15T19:36:23.492598+0000","last_fullsized":"2021-11-15T19:36:23.492598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":143,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.213779+0000","last_change":"2021-11-15T19:26:52.880321+0000","last_active":"2021-11-15T19:36:23.213779+0000","last_peered":"2021-11-15T19:36:23.213779+0000","last_clean":"2021-11-15T19:36:23.213779+0000","last_became_active":"2021-11-15T19:26:52.880159+0000","last_became_peered":"2021-11-15T19:26:52.880159+0000","last_unstale":"2021-11-15T19:36:23.213779+0000","last_undegraded":"2021-11-15T19:36:23.213779+0000","last_fullsized":"2021-11-15T19:36:23.213779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.356073+0000","last_change":"2021-11-15T19:26:52.876890+0000","last_active":"2021-11-15T19:36:23.356073+0000","last_peered":"2021-11-15T19:36:23.356073+0000","last_clean":"2021-11-15T19:36:23.356073+0000","last_became_active":"2021-11-15T19:26:52.876703+0000","last_became_peered":"2021-11-15T19:26:52.876703+0000","last_unstale":"2021-11-15T19:36:23.356073+0000","last_undegraded":"2021-11-15T19:36:23.356073+0000","last_fullsized":"2021-11-15T19:36:23.356073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.362717+0000","last_change":"2021-11-15T19:26:52.878547+0000","last_active":"2021-11-15T19:36:23.362717+0000","last_peered":"2021-11-15T19:36:23.362717+0000","last_clean":"2021-11-15T19:36:23.362717+0000","last_became_active":"2021-11-15T19:26:52.878380+0000","last_became_peered":"2021-11-15T19:26:52.878380+0000","last_unstale":"2021-11-15T19:36:23.362717+0000","last_undegraded":"2021-11-15T19:36:23.362717+0000","last_fullsized":"2021-11-15T19:36:23.362717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.356338+0000","last_change":"2021-11-15T19:26:52.876645+0000","last_active":"2021-11-15T19:36:23.356338+0000","last_peered":"2021-11-15T19:36:23.356338+0000","last_clean":"2021-11-15T19:36:23.356338+0000","last_became_active":"2021-11-15T19:26:52.876454+0000","last_became_peered":"2021-11-15T19:26:52.876454+0000","last_unstale":"2021-11-15T19:36:23.356338+0000","last_undegraded":"2021-11-15T19:36:23.356338+0000","last_fullsized":"2021-11-15T19:36:23.356338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":135,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.363081+0000","last_change":"2021-11-15T19:26:52.879038+0000","last_active":"2021-11-15T19:36:23.363081+0000","last_peered":"2021-11-15T19:36:23.363081+0000","last_clean":"2021-11-15T19:36:23.363081+0000","last_became_active":"2021-11-15T19:26:52.878904+0000","last_became_peered":"2021-11-15T19:26:52.878904+0000","last_unstale":"2021-11-15T19:36:23.363081+0000","last_undegraded":"2021-11-15T19:36:23.363081+0000","last_fullsized":"2021-11-15T19:36:23.363081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575693,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3647,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3734984,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2509999999999999,"15min":1.232},"min":{"1min":1.105,"5min":0.48999999999999999,"15min":0.36899999999999999},"max":{"1min":1.6850000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.125},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2150000000000001,"15min":1.198},"min":{"1min":0.75800000000000001,"5min":0.44700000000000001,"15min":0.38800000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.794},"last":1.147}]},{"osd":1,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.331,"15min":1.288},"min":{"1min":0.78200000000000003,"5min":0.50600000000000001,"15min":0.42699999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.298,"15min":1.2689999999999999},"min":{"1min":0.84999999999999998,"5min":0.46300000000000002,"15min":0.42099999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.849},"last":1.21}]},{"osd":2,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.173,"15min":1.1799999999999999},"min":{"1min":0.88400000000000001,"5min":0.54000000000000004,"15min":0.39800000000000002},"max":{"1min":1.4550000000000001,"5min":1.5920000000000001,"15min":1.7210000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.2929999999999999,"15min":1.2529999999999999},"min":{"1min":0.82399999999999995,"5min":0.51500000000000001,"15min":0.38400000000000001},"max":{"1min":1.639,"5min":1.673,"15min":1.766},"last":1.1639999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.2949999999999999,"15min":1.2549999999999999},"min":{"1min":0.97999999999999998,"5min":0.55500000000000005,"15min":0.41399999999999998},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.111},{"interface":"front","average":{"1min":1.337,"5min":1.3160000000000001,"15min":1.2969999999999999},"min":{"1min":1.0309999999999999,"5min":0.52500000000000002,"15min":0.40600000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.2350000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.54800000000000004,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.28,"5min":1.321,"15min":1.6890000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.875,"15min":0.85899999999999999},"min":{"1min":0.57299999999999995,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":1.1240000000000001,"5min":1.252,"15min":1.3939999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89400000000000002,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.24199999999999999,"15min":0.17899999999999999},"max":{"1min":1.514,"5min":1.548,"15min":1.645},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.91600000000000004},"min":{"1min":0.63600000000000001,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":1.3540000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0840000000000001}]},{"osd":6,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0149999999999999,"15min":1.008},"min":{"1min":0.70899999999999996,"5min":0.30299999999999999,"15min":0.20899999999999999},"max":{"1min":1.466,"5min":1.5269999999999999,"15min":1.639},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.048,"15min":1.0169999999999999},"min":{"1min":0.72999999999999998,"5min":0.248,"15min":0.20399999999999999},"max":{"1min":1.403,"5min":1.6870000000000001,"15min":1.7010000000000001},"last":0.96999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575691,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":4048,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4145700,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.282,"15min":1.2390000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.27600000000000002},"max":{"1min":1.7170000000000001,"5min":1.76,"15min":1.76},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.266,"15min":1.232},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.315},"max":{"1min":1.655,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2310000000000001}]},{"osd":1,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.24,"15min":1.1890000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.32600000000000001},"max":{"1min":1.399,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.173},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2689999999999999,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.252},"max":{"1min":1.587,"5min":1.677,"15min":1.722},"last":1.3959999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3460000000000001,"15min":1.2949999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.246},"max":{"1min":1.7250000000000001,"5min":2.012,"15min":2.012},"last":1.369},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.28,"15min":1.228},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.28999999999999998},"max":{"1min":1.6830000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.319}]},{"osd":3,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3660000000000001,"15min":1.302},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.28599999999999998},"max":{"1min":1.6850000000000001,"5min":1.867,"15min":1.867},"last":1.292},{"interface":"front","average":{"1min":1.252,"5min":1.3140000000000001,"15min":1.284},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.34799999999999998},"max":{"1min":1.512,"5min":1.7509999999999999,"15min":1.8540000000000001},"last":1.2669999999999999}]},{"osd":4,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.87,"15min":0.88800000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.21199999999999999},"max":{"1min":1.224,"5min":1.323,"15min":1.579},"last":1.079},{"interface":"front","average":{"1min":0.87,"5min":0.92900000000000005,"15min":0.91500000000000004},"min":{"1min":0.254,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":1.143,"5min":1.581,"15min":1.831},"last":0.747}]},{"osd":5,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.27800000000000002,"5min":0.252,"15min":0.20499999999999999},"max":{"1min":1.389,"5min":1.421,"15min":1.714},"last":1.125},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.88800000000000001},"min":{"1min":0.26300000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.55,"5min":1.55,"15min":1.7769999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.373,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":1.3080000000000001,"5min":1.4870000000000001,"15min":1.696},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0429999999999999,"15min":1.028},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.252},"max":{"1min":1.2789999999999999,"5min":1.554,"15min":1.78},"last":0.98899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575693,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":2734,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2799957,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.248,"15min":1.24},"min":{"1min":0.77300000000000002,"5min":0.47999999999999998,"15min":0.26600000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.335},{"interface":"front","average":{"1min":1.228,"5min":1.2669999999999999,"15min":1.268},"min":{"1min":0.84899999999999998,"5min":0.55900000000000005,"15min":0.32700000000000001},"max":{"1min":1.5489999999999999,"5min":1.746,"15min":1.7929999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.96799999999999997,"5min":0.51700000000000002,"15min":0.31},"max":{"1min":1.5820000000000001,"5min":1.603,"15min":1.7609999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.99199999999999999,"5min":0.42599999999999999,"15min":0.317},"max":{"1min":1.7170000000000001,"5min":1.742,"15min":1.8300000000000001},"last":1.2989999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2689999999999999,"15min":1.2350000000000001},"min":{"1min":1.0720000000000001,"5min":0.41799999999999998,"15min":0.33700000000000002},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.2150000000000001,"15min":1.2},"min":{"1min":0.69899999999999995,"5min":0.49099999999999999,"15min":0.22500000000000001},"max":{"1min":1.615,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.266}]},{"osd":3,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3029999999999999,"15min":1.258},"min":{"1min":1.0269999999999999,"5min":0.54900000000000004,"15min":0.28299999999999997},"max":{"1min":1.3919999999999999,"5min":1.706,"15min":1.7090000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.82099999999999995,"5min":0.435,"15min":0.26100000000000001},"max":{"1min":1.4370000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0620000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.84599999999999997,"15min":0.83899999999999997},"min":{"1min":0.41699999999999998,"5min":0.23699999999999999,"15min":0.214},"max":{"1min":1.294,"5min":1.6699999999999999,"15min":1.7849999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.89400000000000002},"min":{"1min":0.44600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":1.032,"5min":1.518,"15min":1.518},"last":1.02}]},{"osd":6,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.90700000000000003},"min":{"1min":0.46800000000000003,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.2070000000000001,"5min":1.468,"15min":1.8069999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.497,"5min":0.25600000000000001,"15min":0.20100000000000001},"max":{"1min":1.214,"5min":1.4179999999999999,"15min":1.556},"last":1.153}]},{"osd":7,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.48299999999999998,"5min":0.249,"15min":0.214},"max":{"1min":1.125,"5min":1.502,"15min":1.573},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.026,"15min":0.999},"min":{"1min":0.51800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1679999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575692,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762824,"kb_used_data":87274552,"kb_used_omap":3471,"kb_used_meta":0,"kb_avail":87274552,"statfs":{"total":90150273024,"available":89369141248,"internally_reserved":0,"allocated":89369141248,"data_stored":89369141248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3555326,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1910000000000001,"15min":1.1919999999999999},"min":{"1min":0.64900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.4099999999999999,"5min":1.6819999999999999,"15min":1.8080000000000001},"last":1.335},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1910000000000001,"15min":1.238},"min":{"1min":0.69399999999999995,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":1.4239999999999999,"5min":1.6499999999999999,"15min":1.9039999999999999},"last":1.2390000000000001}]},{"osd":1,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.67900000000000005,"5min":0.376,"15min":0.29199999999999998},"max":{"1min":1.514,"5min":1.772,"15min":1.835},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.65300000000000002,"5min":0.36899999999999999,"15min":0.35499999999999998},"max":{"1min":1.484,"5min":1.6899999999999999,"15min":1.843},"last":1.173}]},{"osd":2,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.66400000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.653,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1759999999999999,"15min":1.1919999999999999},"min":{"1min":0.66200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4039999999999999,"5min":1.577,"15min":1.859},"last":1.2829999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.22,"15min":1.2450000000000001},"min":{"1min":0.70499999999999996,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4019999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.22,"15min":1.2549999999999999},"min":{"1min":0.63200000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.5529999999999999,"5min":1.7869999999999999,"15min":1.8149999999999999},"last":1.085}]},{"osd":5,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1339999999999999,"5min":1.4490000000000001,"15min":1.619},"last":0.999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.3129999999999999,"5min":1.863,"15min":1.863},"last":1.1080000000000001}]},{"osd":6,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.90900000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.224},"max":{"1min":1.29,"5min":1.5900000000000001,"15min":1.7010000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.89900000000000002,"15min":0.91300000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":1.149,"5min":1.383,"15min":1.569},"last":1.2}]},{"osd":7,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92000000000000004,"15min":0.95299999999999996},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.266,"5min":1.5780000000000001,"15min":1.6639999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":1.0029999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.486,"5min":1.4990000000000001,"15min":1.7430000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762948,"kb_used_data":87274428,"kb_used_omap":3428,"kb_used_meta":0,"kb_avail":87274428,"statfs":{"total":90150273024,"available":89369014272,"internally_reserved":0,"allocated":89369014272,"data_stored":89369014272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3511049,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.22700000000000001,"15min":0.20699999999999999},"max":{"1min":1.0649999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20799999999999999},"max":{"1min":0.875,"5min":1.246,"15min":1.2549999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.19600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.371},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.1850000000000001,"5min":1.2050000000000001,"15min":1.339},"last":0.94399999999999995}]},{"osd":2,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.19800000000000001},"max":{"1min":1.1739999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82999999999999996,"15min":0.84299999999999997},"min":{"1min":0.22,"5min":0.22,"15min":0.219},"max":{"1min":1.157,"5min":1.3500000000000001,"15min":1.488},"last":1.0800000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.302,"15min":1.3100000000000001},"min":{"1min":0.78400000000000003,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":1.7350000000000001,"5min":1.766,"15min":1.8779999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.76600000000000001,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":1.6890000000000001,"5min":1.847,"15min":1.861},"last":1.4550000000000001}]},{"osd":5,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.347,"15min":1.349},"min":{"1min":0.81999999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.5549999999999999,"5min":1.827,"15min":2.1970000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2769999999999999,"15min":1.3},"min":{"1min":0.77300000000000002,"5min":0.40400000000000003,"15min":0.34699999999999998},"max":{"1min":1.6060000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.377}]},{"osd":6,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.321,"15min":1.3360000000000001},"min":{"1min":0.79100000000000004,"5min":0.316,"15min":0.316},"max":{"1min":1.764,"5min":1.835,"15min":1.96},"last":1.488},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.343,"15min":1.357},"min":{"1min":0.74299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.724,"5min":1.8200000000000001,"15min":1.9910000000000001},"last":1.345}]},{"osd":7,"last update":"Mon Nov 15 20:35:50 2021","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.3460000000000001},"min":{"1min":0.755,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.6739999999999999,"5min":1.925,"15min":1.9550000000000001},"last":1.421},{"interface":"front","average":{"1min":1.333,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.80000000000000004,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.6859999999999999,"5min":1.829,"15min":1.853},"last":1.5369999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575692,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":2831,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2899556,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.25600000000000001,"5min":0.24099999999999999,"15min":0.193},"max":{"1min":1.0089999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.18099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.2},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.27000000000000002,"5min":0.25700000000000001,"15min":0.20899999999999999},"max":{"1min":1.1080000000000001,"5min":1.296,"15min":1.298},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.20899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.755},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.20200000000000001},"max":{"1min":1.032,"5min":1.073,"15min":1.073},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.318,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":1.1850000000000001,"5min":1.367,"15min":1.367},"last":0.95999999999999996}]},{"osd":4,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3129999999999999,"15min":1.3600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.48899999999999999},"max":{"1min":1.6060000000000001,"5min":1.768,"15min":1.8520000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.3839999999999999},"min":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.36499999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.923},"last":1.6020000000000001}]},{"osd":5,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.333,"15min":1.3779999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.978},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.355,"15min":1.367},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.38200000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.9430000000000001},"last":1.6910000000000001}]},{"osd":6,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.35099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":2.0049999999999999},"last":1.506},{"interface":"front","average":{"1min":1.321,"5min":1.351,"15min":1.3839999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.42299999999999999},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.8819999999999999},"last":1.6359999999999999}]},{"osd":7,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3540000000000001,"15min":1.389},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.45500000000000002},"max":{"1min":1.7470000000000001,"5min":1.8440000000000001,"15min":1.986},"last":1.667},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.409},"min":{"1min":0.72499999999999998,"5min":0.67300000000000004,"15min":0.39000000000000001},"max":{"1min":1.671,"5min":1.8420000000000001,"15min":2.0870000000000002},"last":1.538}]}]},{"osd":1,"up_from":13,"seq":55834575691,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3920,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4014618,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.95799999999999996,"5min":1.125,"15min":1.484},"last":0.315},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.746},"min":{"1min":0.32800000000000001,"5min":0.25900000000000001,"15min":0.23899999999999999},"max":{"1min":1.006,"5min":1.0149999999999999,"15min":1.1759999999999999},"last":0.35199999999999998}]},{"osd":2,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.79600000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.224},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.333},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89300000000000002,"15min":0.88400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":1.0609999999999999,"5min":1.294,"15min":1.4299999999999999},"last":0.435}]},{"osd":3,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82899999999999996},"min":{"1min":0.252,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.3979999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.86599999999999999,"15min":0.83699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23300000000000001},"max":{"1min":1.0880000000000001,"5min":1.3100000000000001,"15min":1.3149999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.387,"15min":1.3680000000000001},"min":{"1min":0.77800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.76,"5min":1.8360000000000001,"15min":1.875},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.385,"15min":1.359},"min":{"1min":0.80100000000000005,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":1.6619999999999999,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.3220000000000001},"min":{"1min":0.79000000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.546,"5min":1.6439999999999999,"15min":1.7789999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3979999999999999,"15min":1.3660000000000001},"min":{"1min":0.84499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6839999999999999,"5min":1.7430000000000001,"15min":1.8700000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3660000000000001,"15min":1.3520000000000001},"min":{"1min":0.83099999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.9590000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.339,"5min":1.343,"15min":1.3240000000000001},"min":{"1min":0.81100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5569999999999999,"5min":1.7629999999999999,"15min":1.9390000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.876,"5min":0.437,"15min":0.437},"max":{"1min":1.599,"5min":1.8029999999999999,"15min":1.8680000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.381,"15min":1.3740000000000001},"min":{"1min":0.82199999999999995,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.748,"5min":1.8169999999999999,"15min":2.0259999999999998},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575692,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3804,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3895696,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.625,"15min":0.64000000000000001},"min":{"1min":0.20899999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.02,"5min":1.1479999999999999,"15min":1.21},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.22700000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.1180000000000001,"5min":1.278,"15min":1.411},"last":1.0609999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.80700000000000005},"min":{"1min":0.23899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.103,"5min":1.1599999999999999,"15min":1.464},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66800000000000004,"15min":0.69499999999999995},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.21199999999999999},"max":{"1min":0.92700000000000005,"5min":1.093,"15min":1.2370000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.74099999999999999},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.20100000000000001},"max":{"1min":0.96399999999999997,"5min":1.639,"15min":1.873},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.151},"last":0.95299999999999996}]},{"osd":4,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.298,"15min":1.3109999999999999},"min":{"1min":0.627,"5min":0.39100000000000001,"15min":0.34200000000000003},"max":{"1min":1.6830000000000001,"5min":1.7010000000000001,"15min":1.915},"last":1.266},{"interface":"front","average":{"1min":1.347,"5min":1.3160000000000001,"15min":1.355},"min":{"1min":0.65100000000000002,"5min":0.35999999999999999,"15min":0.30499999999999999},"max":{"1min":1.716,"5min":1.833,"15min":1.9219999999999999},"last":1.423}]},{"osd":5,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2470000000000001,"15min":1.276},"min":{"1min":0.63300000000000001,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":1.4850000000000001,"5min":1.6339999999999999,"15min":1.7170000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2869999999999999,"15min":1.3080000000000001},"min":{"1min":0.65800000000000003,"5min":0.41999999999999998,"15min":0.32800000000000001},"max":{"1min":1.591,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.395}]},{"osd":6,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3169999999999999,"15min":1.347},"min":{"1min":0.63800000000000001,"5min":0.40400000000000003,"15min":0.34699999999999998},"max":{"1min":1.696,"5min":1.8009999999999999,"15min":2.1120000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.2849999999999999,"15min":1.3480000000000001},"min":{"1min":0.66100000000000003,"5min":0.373,"15min":0.33900000000000002},"max":{"1min":1.768,"5min":1.8540000000000001,"15min":2.294},"last":1.639}]},{"osd":7,"last update":"Mon Nov 15 20:35:49 2021","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.355,"15min":1.3879999999999999},"min":{"1min":0.62,"5min":0.38700000000000001,"15min":0.33500000000000002},"max":{"1min":1.76,"5min":1.9199999999999999,"15min":2.109},"last":1.589},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.64400000000000002,"5min":0.437,"15min":0.35299999999999998},"max":{"1min":1.673,"5min":1.857,"15min":1.881},"last":1.3380000000000001}]}]}]}} 2021-11-15T20:36:55.165 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T20:36:55.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 Processor -- start 2021-11-15T20:36:55.215 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- start start 2021-11-15T20:36:55.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f150c144610 0x7f150c147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c0a9f50 0x7f150c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.220 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c148190 con 0x7f150c0b1340 2021-11-15T20:36:55.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c0b1720 con 0x7f150c144610 2021-11-15T20:36:55.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c147e70 con 0x7f150c0a9f50 2021-11-15T20:36:55.221 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f150c144610 0x7f150c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:55.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f150c144610 0x7f150c147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41818/0 (socket says 172.21.2.137:41818) 2021-11-15T20:36:55.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/3994143800 learned_addr learned my addr 172.21.2.137:0/3994143800 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:55.222 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/3994143800 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c0a9f50 msgr2=0x7f150c0aa3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:55.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- 172.21.2.137:0/3994143800 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c0a9f50 0x7f150c0aa3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/3994143800 >> v1:172.21.2.137:6789/0 conn(0x7f150c0b1340 legacy=0x7f150c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.223 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/3994143800 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0af800 con 0x7f150c144610 2021-11-15T20:36:55.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- 172.21.2.137:0/3994143800 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c144610 0x7f150c147980 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f14f4002f70 tx=0x7f14f4006eb0).ready entity=mon.1 client_cookie=21d92389e5f44843 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:55.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1509ffb700 1 -- 172.21.2.137:0/3994143800 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f400d5c0 con 0x7f150c144610 2021-11-15T20:36:55.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1509ffb700 1 -- 172.21.2.137:0/3994143800 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f4000e90 con 0x7f150c144610 2021-11-15T20:36:55.224 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1509ffb700 1 -- 172.21.2.137:0/3994143800 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f400d950 con 0x7f150c144610 2021-11-15T20:36:55.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- 172.21.2.137:0/3994143800 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c144610 msgr2=0x7f150c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- 172.21.2.137:0/3994143800 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c144610 0x7f150c147980 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f14f4002f70 tx=0x7f14f4006eb0).stop 2021-11-15T20:36:55.225 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- 172.21.2.137:0/3994143800 shutdown_connections 2021-11-15T20:36:55.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- 172.21.2.137:0/3994143800 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c144610 0x7f150c147980 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:55.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- 172.21.2.137:0/3994143800 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c0a9f50 0x7f150c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- 172.21.2.137:0/3994143800 >> 172.21.2.137:0/3994143800 conn(0x7f150c0b4e60 msgr2=0x7f150c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:55.226 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- 172.21.2.137:0/3994143800 shutdown_connections 2021-11-15T20:36:55.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- 172.21.2.137:0/3994143800 wait complete. 2021-11-15T20:36:55.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 Processor -- start 2021-11-15T20:36:55.227 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- start start 2021-11-15T20:36:55.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f150c0a9f50 0x7f150c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 0x7f150c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.228 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c144610 0x7f150c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b3910 con 0x7f150c0a9f50 2021-11-15T20:36:55.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b3b70 con 0x7f150c0b1340 2021-11-15T20:36:55.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f1511506700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b3e10 con 0x7f150c144610 2021-11-15T20:36:55.229 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 0x7f150c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:55.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 0x7f150c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41822/0 (socket says 172.21.2.137:41822) 2021-11-15T20:36:55.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/1198756560 learned_addr learned my addr 172.21.2.137:0/1198756560 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:55.230 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c144610 msgr2=0x7f150c0aea40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:55.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c144610 0x7f150c0aea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f150c0a9f50 msgr2=0x7f150c14a470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:55.231 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f150c0a9f50 0x7f150c14a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 -- 172.21.2.137:0/1198756560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f400b1e0 con 0x7f150c0b1340 2021-11-15T20:36:55.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.211+0000 7f150a7fc700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 0x7f150c15a660 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f14f4002f70 tx=0x7f14f4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:55.232 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f4011930 con 0x7f150c0b1340 2021-11-15T20:36:55.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f4011a90 con 0x7f150c0b1340 2021-11-15T20:36:55.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c15ab50 con 0x7f150c0b1340 2021-11-15T20:36:55.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f4011df0 con 0x7f150c0b1340 2021-11-15T20:36:55.233 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c0af0d0 con 0x7f150c0b1340 2021-11-15T20:36:55.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c0b3fd0 con 0x7f150c0b1340 2021-11-15T20:36:55.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14f4025030 con 0x7f150c0b1340 2021-11-15T20:36:55.234 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14f0053720 0x7f14f0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:55.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f14f406c9d0 con 0x7f150c0b1340 2021-11-15T20:36:55.235 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f150affd700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14f0053720 0x7f14f0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:55.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f150affd700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14f0053720 0x7f14f0055be0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f150c062250 tx=0x7f14fc007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:55.236 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.215+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14f4043e10 con 0x7f150c0b1340 2021-11-15T20:36:55.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.299+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f150c0573d0 con 0x7f150c0b1340 2021-11-15T20:36:55.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.299+0000 7f1503fff700 1 -- 172.21.2.137:0/1198756560 <== mon.1 v2:172.21.2.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13318 (secure 0 0 0) 0x7f14f4047430 con 0x7f150c0b1340 2021-11-15T20:36:55.306 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T20:36:55.307 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":155,"fsid":"83e72b0f-d369-4e28-ba83-5e0d7df7d510","created":"2021-11-15T19:26:40.920178+0000","modified":"2021-11-15T19:36:24.213951+0000","last_up_change":"2021-11-15T19:26:46.168796+0000","last_in_change":"2021-11-15T19:26:46.168796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T19:26:43.362687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T19:26:51.213620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab1f21b4-4df4-4fd6-9920-85e4abe60cd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14742},{"type":"v1","addr":"172.21.2.137:6801","nonce":14742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14742},{"type":"v1","addr":"172.21.2.137:6803","nonce":14742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14742},{"type":"v1","addr":"172.21.2.137:6807","nonce":14742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14742},{"type":"v1","addr":"172.21.2.137:6805","nonce":14742}]},"public_addr":"172.21.2.137:6801/14742","cluster_addr":"172.21.2.137:6803/14742","heartbeat_back_addr":"172.21.2.137:6807/14742","heartbeat_front_addr":"172.21.2.137:6805/14742","state":["exists","up"]},{"osd":1,"uuid":"a44e77ff-9cd6-4440-8f88-f256328291e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14743},{"type":"v1","addr":"172.21.2.137:6809","nonce":14743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14743},{"type":"v1","addr":"172.21.2.137:6811","nonce":14743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14743},{"type":"v1","addr":"172.21.2.137:6815","nonce":14743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14743},{"type":"v1","addr":"172.21.2.137:6813","nonce":14743}]},"public_addr":"172.21.2.137:6809/14743","cluster_addr":"172.21.2.137:6811/14743","heartbeat_back_addr":"172.21.2.137:6815/14743","heartbeat_front_addr":"172.21.2.137:6813/14743","state":["exists","up"]},{"osd":2,"uuid":"5939bbcb-c02f-4a97-8e42-d014b81745c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14744},{"type":"v1","addr":"172.21.2.137:6817","nonce":14744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14744},{"type":"v1","addr":"172.21.2.137:6819","nonce":14744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14744},{"type":"v1","addr":"172.21.2.137:6823","nonce":14744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14744},{"type":"v1","addr":"172.21.2.137:6821","nonce":14744}]},"public_addr":"172.21.2.137:6817/14744","cluster_addr":"172.21.2.137:6819/14744","heartbeat_back_addr":"172.21.2.137:6823/14744","heartbeat_front_addr":"172.21.2.137:6821/14744","state":["exists","up"]},{"osd":3,"uuid":"584801ab-fe8b-41cb-a22e-bb8327c9a7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14753},{"type":"v1","addr":"172.21.2.137:6825","nonce":14753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6826","nonce":14753},{"type":"v1","addr":"172.21.2.137:6827","nonce":14753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6830","nonce":14753},{"type":"v1","addr":"172.21.2.137:6831","nonce":14753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6828","nonce":14753},{"type":"v1","addr":"172.21.2.137:6829","nonce":14753}]},"public_addr":"172.21.2.137:6825/14753","cluster_addr":"172.21.2.137:6827/14753","heartbeat_back_addr":"172.21.2.137:6831/14753","heartbeat_front_addr":"172.21.2.137:6829/14753","state":["exists","up"]},{"osd":4,"uuid":"db3bc207-56dd-423a-ae61-e28931277fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6800","nonce":14921},{"type":"v1","addr":"172.21.2.111:6801","nonce":14921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6802","nonce":14921},{"type":"v1","addr":"172.21.2.111:6803","nonce":14921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6806","nonce":14921},{"type":"v1","addr":"172.21.2.111:6807","nonce":14921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6804","nonce":14921},{"type":"v1","addr":"172.21.2.111:6805","nonce":14921}]},"public_addr":"172.21.2.111:6801/14921","cluster_addr":"172.21.2.111:6803/14921","heartbeat_back_addr":"172.21.2.111:6807/14921","heartbeat_front_addr":"172.21.2.111:6805/14921","state":["exists","up"]},{"osd":5,"uuid":"7e901196-37bd-4748-8503-79c358da8431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6808","nonce":14922},{"type":"v1","addr":"172.21.2.111:6809","nonce":14922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6810","nonce":14922},{"type":"v1","addr":"172.21.2.111:6811","nonce":14922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6814","nonce":14922},{"type":"v1","addr":"172.21.2.111:6815","nonce":14922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6812","nonce":14922},{"type":"v1","addr":"172.21.2.111:6813","nonce":14922}]},"public_addr":"172.21.2.111:6809/14922","cluster_addr":"172.21.2.111:6811/14922","heartbeat_back_addr":"172.21.2.111:6815/14922","heartbeat_front_addr":"172.21.2.111:6813/14922","state":["exists","up"]},{"osd":6,"uuid":"dd9023bb-1799-4c2a-9d08-0abc1d2b27ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6816","nonce":14923},{"type":"v1","addr":"172.21.2.111:6817","nonce":14923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6818","nonce":14923},{"type":"v1","addr":"172.21.2.111:6819","nonce":14923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6822","nonce":14923},{"type":"v1","addr":"172.21.2.111:6823","nonce":14923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6820","nonce":14923},{"type":"v1","addr":"172.21.2.111:6821","nonce":14923}]},"public_addr":"172.21.2.111:6817/14923","cluster_addr":"172.21.2.111:6819/14923","heartbeat_back_addr":"172.21.2.111:6823/14923","heartbeat_front_addr":"172.21.2.111:6821/14923","state":["exists","up"]},{"osd":7,"uuid":"a483fa91-357c-4a8e-b313-b5cc41ce4b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6824","nonce":14924},{"type":"v1","addr":"172.21.2.111:6825","nonce":14924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6826","nonce":14924},{"type":"v1","addr":"172.21.2.111:6827","nonce":14924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6830","nonce":14924},{"type":"v1","addr":"172.21.2.111:6831","nonce":14924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.111:6828","nonce":14924},{"type":"v1","addr":"172.21.2.111:6829","nonce":14924}]},"public_addr":"172.21.2.111:6825/14924","cluster_addr":"172.21.2.111:6827/14924","heartbeat_back_addr":"172.21.2.111:6831/14924","heartbeat_front_addr":"172.21.2.111:6829/14924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.263259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.259824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.188994+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.243084+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.196753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.191082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.199145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T19:26:44.235826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.137:6833/754709113":"2021-11-16T19:36:20.922664+0000","172.21.2.137:6832/754709113":"2021-11-16T19:36:20.922664+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T20:36:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.299+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14f0053720 msgr2=0x7f14f0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.308 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14f0053720 0x7f14f0055be0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f150c062250 tx=0x7f14fc007810).stop 2021-11-15T20:36:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 msgr2=0x7f150c15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 0x7f150c15a660 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f14f4002f70 tx=0x7f14f4015000).stop 2021-11-15T20:36:55.309 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 shutdown_connections 2021-11-15T20:36:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f14f0053720 0x7f14f0055be0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f150c144610 0x7f150c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.310 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f150c0b1340 0x7f150c15a660 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 --2- 172.21.2.137:0/1198756560 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f150c0a9f50 0x7f150c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 >> 172.21.2.137:0/1198756560 conn(0x7f150c0b4e60 msgr2=0x7f150c13e590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 shutdown_connections 2021-11-15T20:36:55.311 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:55.303+0000 7f1511506700 1 -- 172.21.2.137:0/1198756560 wait complete. 2021-11-15T20:36:56.314 INFO:tasks.ceph:Scrubbing osd.0 2021-11-15T20:36:56.315 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:56.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 Processor -- start 2021-11-15T20:36:56.373 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- start start 2021-11-15T20:36:56.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30440988b0 0x7f304413ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.374 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3044140f60 con 0x7f3044140400 2021-11-15T20:36:56.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440b1440 con 0x7f304405fb80 2021-11-15T20:36:56.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30440990f0 con 0x7f30440988b0 2021-11-15T20:36:56.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f30427fc700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f30440988b0 0x7f304413ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3042ffd700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f304405fb80 0x7f304409a620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60612/0 (socket says 172.21.2.137:60612) 2021-11-15T20:36:56.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3042ffd700 1 -- 172.21.2.137:0/2014778189 learned_addr learned my addr 172.21.2.137:0/2014778189 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:56.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f30427fc700 1 -- 172.21.2.137:0/2014778189 >> v1:172.21.2.137:6789/0 conn(0x7f304405fb80 legacy=0x7f304409a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f30427fc700 1 -- 172.21.2.137:0/2014778189 >> v1:172.21.2.111:6789/0 conn(0x7f3044140400 legacy=0x7f3044140850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f30427fc700 1 -- 172.21.2.137:0/2014778189 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440b16e0 con 0x7f30440988b0 2021-11-15T20:36:56.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f30427fc700 1 --2- 172.21.2.137:0/2014778189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30440988b0 0x7f304413ff10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f3044062250 tx=0x7f3038006df0).ready entity=mon.1 client_cookie=bdeccc0912dea741 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3041ffb700 1 -- 172.21.2.137:0/2014778189 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303800d5c0 con 0x7f30440988b0 2021-11-15T20:36:56.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3041ffb700 1 -- 172.21.2.137:0/2014778189 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038000e90 con 0x7f30440988b0 2021-11-15T20:36:56.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3041ffb700 1 -- 172.21.2.137:0/2014778189 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303800d910 con 0x7f30440988b0 2021-11-15T20:36:56.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- 172.21.2.137:0/2014778189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30440988b0 msgr2=0x7f304413ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 --2- 172.21.2.137:0/2014778189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30440988b0 0x7f304413ff10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f3044062250 tx=0x7f3038006df0).stop 2021-11-15T20:36:56.383 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- 172.21.2.137:0/2014778189 shutdown_connections 2021-11-15T20:36:56.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 --2- 172.21.2.137:0/2014778189 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f30440988b0 0x7f304413ff10 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- 172.21.2.137:0/2014778189 >> 172.21.2.137:0/2014778189 conn(0x7f30440b4e60 msgr2=0x7f30440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- 172.21.2.137:0/2014778189 shutdown_connections 2021-11-15T20:36:56.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.367+0000 7f3049720700 1 -- 172.21.2.137:0/2014778189 wait complete. 2021-11-15T20:36:56.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 Processor -- start 2021-11-15T20:36:56.385 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- start start 2021-11-15T20:36:56.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f304405fb80 0x7f3044066e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30440988b0 0x7f3044155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.386 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3044140400 0x7f30441560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440abda0 con 0x7f30440988b0 2021-11-15T20:36:56.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304408f750 con 0x7f3044140400 2021-11-15T20:36:56.387 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304408f9f0 con 0x7f304405fb80 2021-11-15T20:36:56.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3044140400 0x7f30441560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3044140400 0x7f30441560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41838/0 (socket says 172.21.2.137:41838) 2021-11-15T20:36:56.388 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 -- 172.21.2.137:0/2924085237 learned_addr learned my addr 172.21.2.137:0/2924085237 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 -- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f304405fb80 msgr2=0x7f3044066e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:56.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f304405fb80 0x7f3044066e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.389 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 -- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30440988b0 msgr2=0x7f3044155bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:56.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f30440988b0 0x7f3044155bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 -- 172.21.2.137:0/2924085237 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303800b180 con 0x7f3044140400 2021-11-15T20:36:56.390 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30437fe700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3044140400 0x7f30441560a0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f303c003330 tx=0x7f303c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303c001520 con 0x7f3044140400 2021-11-15T20:36:56.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c001680 con 0x7f3044140400 2021-11-15T20:36:56.391 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304408fc90 con 0x7f3044140400 2021-11-15T20:36:56.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3044143d60 con 0x7f3044140400 2021-11-15T20:36:56.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303c0019e0 con 0x7f3044140400 2021-11-15T20:36:56.392 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f304409a180 con 0x7f3044140400 2021-11-15T20:36:56.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f303c018030 con 0x7f3044140400 2021-11-15T20:36:56.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30200536f0 0x7f3020055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f303c06b980 con 0x7f3044140400 2021-11-15T20:36:56.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f3020059ef0 0x7f302005c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 --> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f302005c8d0 con 0x7f3020059ef0 2021-11-15T20:36:56.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303c06bc90 con 0x7f3044140400 2021-11-15T20:36:56.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30427fc700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f3020059ef0 0x7f302005c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f30427fc700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f3020059ef0 0x7f302005c310 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.395 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3042ffd700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30200536f0 0x7f3020055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.371+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== osd.0 v2:172.21.2.137:6800/14742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f302005c8d0 con 0x7f3020059ef0 2021-11-15T20:36:56.396 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.375+0000 7f3042ffd700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30200536f0 0x7f3020055bb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f30440b4db0 tx=0x7f30340077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 --> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3044156850 con 0x7f3020059ef0 2021-11-15T20:36:56.397 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3033fff700 1 -- 172.21.2.137:0/2924085237 <== osd.0 v2:172.21.2.137:6800/14742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3044156850 con 0x7f3020059ef0 2021-11-15T20:36:56.398 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:56.398 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:56.399 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:56.400 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f3020059ef0 msgr2=0x7f302005c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:6800/14742,v1:172.21.2.137:6801/14742] conn(0x7f3020059ef0 0x7f302005c310 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30200536f0 msgr2=0x7f3020055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f30200536f0 0x7f3020055bb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f30440b4db0 tx=0x7f30340077f0).stop 2021-11-15T20:36:56.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3044140400 msgr2=0x7f30441560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 --2- 172.21.2.137:0/2924085237 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f3044140400 0x7f30441560a0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f303c003330 tx=0x7f303c0091a0).stop 2021-11-15T20:36:56.402 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f30437fe700 1 -- 172.21.2.137:0/2924085237 reap_dead start 2021-11-15T20:36:56.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 shutdown_connections 2021-11-15T20:36:56.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 >> 172.21.2.137:0/2924085237 conn(0x7f30440b4e60 msgr2=0x7f3044140830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.403 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 shutdown_connections 2021-11-15T20:36:56.404 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.379+0000 7f3049720700 1 -- 172.21.2.137:0/2924085237 wait complete. 2021-11-15T20:36:56.404 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-11-15T20:36:56.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 Processor -- start 2021-11-15T20:36:56.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- start start 2021-11-15T20:36:56.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f11d00acff0 0x7f11d013c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00aedf0 con 0x7f11d00afde0 2021-11-15T20:36:56.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00afbd0 con 0x7f11d00b0fe0 2021-11-15T20:36:56.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00ae070 con 0x7f11d00acff0 2021-11-15T20:36:56.459 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cf7fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f11d00b0fe0 0x7f11d00af4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60628/0 (socket says 172.21.2.137:60628) 2021-11-15T20:36:56.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cf7fe700 1 -- 172.21.2.137:0/3116951019 learned_addr learned my addr 172.21.2.137:0/3116951019 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:56.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cffff700 1 --2- 172.21.2.137:0/3116951019 >> v2:172.21.2.137:3300/0 conn(0x7f11d00acff0 0x7f11d013c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cffff700 1 -- 172.21.2.137:0/3116951019 >> v1:172.21.2.137:6789/0 conn(0x7f11d00b0fe0 legacy=0x7f11d00af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cffff700 1 -- 172.21.2.137:0/3116951019 >> v1:172.21.2.111:6789/0 conn(0x7f11d00afde0 legacy=0x7f11d013f5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:56.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cffff700 1 -- 172.21.2.137:0/3116951019 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00ad440 con 0x7f11d00acff0 2021-11-15T20:36:56.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11cffff700 1 --2- 172.21.2.137:0/3116951019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00acff0 0x7f11d013c640 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f11d00aec90 tx=0x7f11c80091d0).ready entity=mon.1 client_cookie=7ee78453a7a506b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11ce7fc700 1 -- 172.21.2.137:0/3116951019 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c8009ea0 con 0x7f11d00acff0 2021-11-15T20:36:56.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11ce7fc700 1 -- 172.21.2.137:0/3116951019 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c800b860 con 0x7f11d00acff0 2021-11-15T20:36:56.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11ce7fc700 1 -- 172.21.2.137:0/3116951019 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c800b9d0 con 0x7f11d00acff0 2021-11-15T20:36:56.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- 172.21.2.137:0/3116951019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00acff0 msgr2=0x7f11d013c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 --2- 172.21.2.137:0/3116951019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00acff0 0x7f11d013c640 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f11d00aec90 tx=0x7f11c80091d0).stop 2021-11-15T20:36:56.463 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- 172.21.2.137:0/3116951019 shutdown_connections 2021-11-15T20:36:56.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 --2- 172.21.2.137:0/3116951019 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00acff0 0x7f11d013c640 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- 172.21.2.137:0/3116951019 >> 172.21.2.137:0/3116951019 conn(0x7f11d00b5f50 msgr2=0x7f11d00b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.464 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- 172.21.2.137:0/3116951019 shutdown_connections 2021-11-15T20:36:56.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- 172.21.2.137:0/3116951019 wait complete. 2021-11-15T20:36:56.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 Processor -- start 2021-11-15T20:36:56.465 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.451+0000 7f11d5dac700 1 -- start start 2021-11-15T20:36:56.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f11d00acff0 0x7f11d0112870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 0x7f11d005bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.468 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f11d00b0fe0 0x7f11d0156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0111340 con 0x7f11d00acff0 2021-11-15T20:36:56.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d013d6a0 con 0x7f11d00afde0 2021-11-15T20:36:56.469 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d005c8d0 con 0x7f11d00b0fe0 2021-11-15T20:36:56.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 0x7f11d005bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 0x7f11d005bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41854/0 (socket says 172.21.2.137:41854) 2021-11-15T20:36:56.470 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 -- 172.21.2.137:0/1430167404 learned_addr learned my addr 172.21.2.137:0/1430167404 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 -- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f11d00b0fe0 msgr2=0x7f11d0156b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:56.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f11d00b0fe0 0x7f11d0156b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.471 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 -- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f11d00acff0 msgr2=0x7f11d0112870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:56.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f11d00acff0 0x7f11d0112870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 -- 172.21.2.137:0/1430167404 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009470 con 0x7f11d00afde0 2021-11-15T20:36:56.472 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ceffd700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 0x7f11d005bd20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f11c0002fb0 tx=0x7f11c0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c0013460 con 0x7f11d00afde0 2021-11-15T20:36:56.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00135c0 con 0x7f11d00afde0 2021-11-15T20:36:56.473 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c0013920 con 0x7f11d00afde0 2021-11-15T20:36:56.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d0067440 con 0x7f11d00afde0 2021-11-15T20:36:56.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d0156350 con 0x7f11d00afde0 2021-11-15T20:36:56.474 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d00ad690 con 0x7f11d00afde0 2021-11-15T20:36:56.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f11c000f070 con 0x7f11d00afde0 2021-11-15T20:36:56.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ccff9700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f11b4053610 0x7f11b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.475 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f11c006ae90 con 0x7f11d00afde0 2021-11-15T20:36:56.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.455+0000 7f11cf7fe700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f11b4053610 0x7f11b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.459+0000 7f11cf7fe700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f11b4053610 0x7f11b4055ad0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f11d00b04d0 tx=0x7f11b80077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.476 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.459+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11c00421c0 con 0x7f11d00afde0 2021-11-15T20:36:56.546 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d0159920 con 0x7f11b4053610 2021-11-15T20:36:56.548 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11ccff9700 1 -- 172.21.2.137:0/1430167404 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f11b8007e50 con 0x7f11b4053610 2021-11-15T20:36:56.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f11b4053610 msgr2=0x7f11b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f11b4053610 0x7f11b4055ad0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f11d00b04d0 tx=0x7f11b80077f0).stop 2021-11-15T20:36:56.550 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 msgr2=0x7f11d005bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 0x7f11d005bd20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f11c0002fb0 tx=0x7f11c0006df0).stop 2021-11-15T20:36:56.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 shutdown_connections 2021-11-15T20:36:56.551 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f11b4053610 0x7f11b4055ad0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f11d00b0fe0 0x7f11d0156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f11d00afde0 0x7f11d005bd20 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 --2- 172.21.2.137:0/1430167404 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f11d00acff0 0x7f11d0112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.552 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 >> 172.21.2.137:0/1430167404 conn(0x7f11d00b5f50 msgr2=0x7f11d005fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 shutdown_connections 2021-11-15T20:36:56.553 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.543+0000 7f11d5dac700 1 -- 172.21.2.137:0/1430167404 wait complete. 2021-11-15T20:36:56.554 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 0 to deep-scrub 2021-11-15T20:36:56.556 INFO:tasks.ceph:Scrubbing osd.1 2021-11-15T20:36:56.557 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:56.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.603+0000 7f674d3ae700 1 Processor -- start 2021-11-15T20:36:56.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.603+0000 7f674d3ae700 1 -- start start 2021-11-15T20:36:56.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67480600f0 0x7f6748146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480621d0 con 0x7f6748062600 2021-11-15T20:36:56.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6748147130 con 0x7f6748146860 2021-11-15T20:36:56.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67480b2bb0 con 0x7f67480600f0 2021-11-15T20:36:56.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67480600f0 0x7f6748146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f67480600f0 0x7f6748146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41862/0 (socket says 172.21.2.137:41862) 2021-11-15T20:36:56.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 -- 172.21.2.137:0/1805413838 learned_addr learned my addr 172.21.2.137:0/1805413838 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f6746ffd700 1 --1- 172.21.2.137:0/1805413838 >> v1:172.21.2.137:6789/0 conn(0x7f6748146860 0x7f674805f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60640/0 (socket says 172.21.2.137:60640) 2021-11-15T20:36:56.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 -- 172.21.2.137:0/1805413838 >> v1:172.21.2.137:6789/0 conn(0x7f6748146860 legacy=0x7f674805f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 -- 172.21.2.137:0/1805413838 >> v1:172.21.2.111:6789/0 conn(0x7f6748062600 legacy=0x7f67480ad520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:56.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 -- 172.21.2.137:0/1805413838 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748060540 con 0x7f67480600f0 2021-11-15T20:36:56.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67477fe700 1 --2- 172.21.2.137:0/1805413838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67480600f0 0x7f6748146c40 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f67480b7e10 tx=0x7f6740009290).ready entity=mon.1 client_cookie=1c0c01944047d0d9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f6745ffb700 1 -- 172.21.2.137:0/1805413838 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674000b860 con 0x7f67480600f0 2021-11-15T20:36:56.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f6745ffb700 1 -- 172.21.2.137:0/1805413838 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674000b9c0 con 0x7f67480600f0 2021-11-15T20:36:56.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f6745ffb700 1 -- 172.21.2.137:0/1805413838 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674000bb30 con 0x7f67480600f0 2021-11-15T20:36:56.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/1805413838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67480600f0 msgr2=0x7f6748146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 --2- 172.21.2.137:0/1805413838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67480600f0 0x7f6748146c40 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f67480b7e10 tx=0x7f6740009290).stop 2021-11-15T20:36:56.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/1805413838 shutdown_connections 2021-11-15T20:36:56.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 --2- 172.21.2.137:0/1805413838 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f67480600f0 0x7f6748146c40 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/1805413838 >> 172.21.2.137:0/1805413838 conn(0x7f67480b7070 msgr2=0x7f67480b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/1805413838 shutdown_connections 2021-11-15T20:36:56.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/1805413838 wait complete. 2021-11-15T20:36:56.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 Processor -- start 2021-11-15T20:36:56.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- start start 2021-11-15T20:36:56.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67480600f0 0x7f674809cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.622 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6748062600 0x7f67480b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6748146860 0x7f67481432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480b0120 con 0x7f67480600f0 2021-11-15T20:36:56.623 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481563a0 con 0x7f6748062600 2021-11-15T20:36:56.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6748156870 con 0x7f6748146860 2021-11-15T20:36:56.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6748062600 0x7f67480b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6748062600 0x7f67480b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41866/0 (socket says 172.21.2.137:41866) 2021-11-15T20:36:56.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 -- 172.21.2.137:0/957139861 learned_addr learned my addr 172.21.2.137:0/957139861 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 -- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6748146860 msgr2=0x7f67481432d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:56.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f6748146860 0x7f67481432d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 -- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67480600f0 msgr2=0x7f674809cac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:56.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f67480600f0 0x7f674809cac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 -- 172.21.2.137:0/957139861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009530 con 0x7f6748062600 2021-11-15T20:36:56.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f67467fc700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6748062600 0x7f67480b1180 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f6730002fb0 tx=0x7f6730006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6730013460 con 0x7f6748062600 2021-11-15T20:36:56.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300135c0 con 0x7f6748062600 2021-11-15T20:36:56.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67481565d0 con 0x7f6748062600 2021-11-15T20:36:56.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6730013920 con 0x7f6748062600 2021-11-15T20:36:56.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674809c270 con 0x7f6748062600 2021-11-15T20:36:56.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f674809c4f0 con 0x7f6748062600 2021-11-15T20:36:56.628 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.607+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f673000f070 con 0x7f6748062600 2021-11-15T20:36:56.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f673ffff700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f672c053580 0x7f672c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f673006b910 con 0x7f6748062600 2021-11-15T20:36:56.629 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f673ffff700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7f672c059d00 0x7f672c05c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 --> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f672c05c780 con 0x7f672c059d00 2021-11-15T20:36:56.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f673006bcf0 con 0x7f6748062600 2021-11-15T20:36:56.630 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f67477fe700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7f672c059d00 0x7f672c05c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f67477fe700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7f672c059d00 0x7f672c05c120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f6746ffd700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f672c053580 0x7f672c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.632 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== osd.1 v2:172.21.2.137:6808/14743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f672c05c780 con 0x7f672c059d00 2021-11-15T20:36:56.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.611+0000 7f6746ffd700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f672c053580 0x7f672c055a40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f67480b7eb0 tx=0x7f67380077a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 --> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f67480b5160 con 0x7f672c059d00 2021-11-15T20:36:56.633 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f673ffff700 1 -- 172.21.2.137:0/957139861 <== osd.1 v2:172.21.2.137:6808/14743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f67480b5160 con 0x7f672c059d00 2021-11-15T20:36:56.634 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:56.634 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:56.634 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:56.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7f672c059d00 msgr2=0x7f672c05c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.636 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:6808/14743,v1:172.21.2.137:6809/14743] conn(0x7f672c059d00 0x7f672c05c120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f672c053580 msgr2=0x7f672c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f672c053580 0x7f672c055a40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f67480b7eb0 tx=0x7f67380077a0).stop 2021-11-15T20:36:56.637 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6748062600 msgr2=0x7f67480b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 --2- 172.21.2.137:0/957139861 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f6748062600 0x7f67480b1180 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f6730002fb0 tx=0x7f6730006df0).stop 2021-11-15T20:36:56.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f67477fe700 1 -- 172.21.2.137:0/957139861 reap_dead start 2021-11-15T20:36:56.638 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 shutdown_connections 2021-11-15T20:36:56.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 >> 172.21.2.137:0/957139861 conn(0x7f67480b7070 msgr2=0x7f67480b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 shutdown_connections 2021-11-15T20:36:56.639 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.619+0000 7f674d3ae700 1 -- 172.21.2.137:0/957139861 wait complete. 2021-11-15T20:36:56.640 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-11-15T20:36:56.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 Processor -- start 2021-11-15T20:36:56.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- start start 2021-11-15T20:36:56.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7ff2cc05c770 0x7ff2cc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc0b0550 0x7ff2cc14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc05cb50 con 0x7ff2cc14aaa0 2021-11-15T20:36:56.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc0b1650 con 0x7ff2cc05c770 2021-11-15T20:36:56.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0ad030 con 0x7ff2cc0b0550 2021-11-15T20:36:56.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7ff2cc14aaa0 0x7ff2cc140aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60658/0 (socket says 172.21.2.137:60658) 2021-11-15T20:36:56.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 -- 172.21.2.137:0/767761124 learned_addr learned my addr 172.21.2.137:0/767761124 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:56.698 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678382530 0 0) 0x7ff2cc05cb50 con 0x7ff2cc14aaa0 2021-11-15T20:36:56.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac003260 con 0x7ff2cc14aaa0 2021-11-15T20:36:56.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037165131 0 0) 0x7ff2ac003260 con 0x7ff2cc14aaa0 2021-11-15T20:36:56.699 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc0b0550 msgr2=0x7ff2cc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:56.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc0b0550 0x7ff2cc14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 >> v2:172.21.2.111:3300/0 conn(0x7ff2cc05c770 msgr2=0x7ff2cc0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:56.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 --2- 172.21.2.137:0/767761124 >> v2:172.21.2.111:3300/0 conn(0x7ff2cc05c770 0x7ff2cc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0ad2d0 con 0x7ff2cc14aaa0 2021-11-15T20:36:56.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7ff2c40019e0 con 0x7ff2cc14aaa0 2021-11-15T20:36:56.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 >> v1:172.21.2.137:6789/0 conn(0x7ff2cc14aaa0 legacy=0x7ff2cc140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc0b0550 0x7ff2ac003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac003e10 0x7ff2ac004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2ac004b10 0x7ff2ac004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0b1650 con 0x7ff2ac003e10 2021-11-15T20:36:56.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0ad030 con 0x7ff2ac004b10 2021-11-15T20:36:56.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac00b9e0 con 0x7ff2cc0b0550 2021-11-15T20:36:56.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2ac004b10 0x7ff2ac004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 -- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc0b0550 msgr2=0x7ff2ac003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:56.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc0b0550 0x7ff2ac003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 -- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac003e10 msgr2=0x7ff2ac004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:56.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac003e10 0x7ff2ac004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 -- 172.21.2.137:0/767761124 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac003260 con 0x7ff2ac004b10 2021-11-15T20:36:56.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2ac004b10 0x7ff2ac004f90 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7ff2c40016f0 tx=0x7ff2c40021d0).ready entity=mon.1 client_cookie=1c589ca389c5507d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c400cc50 con 0x7ff2ac004b10 2021-11-15T20:36:56.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c400cdb0 con 0x7ff2ac004b10 2021-11-15T20:36:56.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2caffd700 1 -- 172.21.2.137:0/767761124 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c4005b80 con 0x7ff2ac004b10 2021-11-15T20:36:56.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- 172.21.2.137:0/767761124 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2ac004b10 msgr2=0x7ff2ac004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 --2- 172.21.2.137:0/767761124 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2ac004b10 0x7ff2ac004f90 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7ff2c40016f0 tx=0x7ff2c40021d0).stop 2021-11-15T20:36:56.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d08d2700 1 -- 172.21.2.137:0/767761124 reap_dead start 2021-11-15T20:36:56.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- 172.21.2.137:0/767761124 shutdown_connections 2021-11-15T20:36:56.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- 172.21.2.137:0/767761124 >> 172.21.2.137:0/767761124 conn(0x7ff2cc0631e0 msgr2=0x7ff2cc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- 172.21.2.137:0/767761124 shutdown_connections 2021-11-15T20:36:56.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.687+0000 7ff2d2335700 1 -- 172.21.2.137:0/767761124 wait complete. 2021-11-15T20:36:56.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 Processor -- start 2021-11-15T20:36:56.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- start start 2021-11-15T20:36:56.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac004b10 0x7ff2cc149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 0x7ff2cc141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.710 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc14ccd0 0x7ff2cc142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc063e20 con 0x7ff2ac004b10 2021-11-15T20:36:56.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0638e0 con 0x7ff2cc1561f0 2021-11-15T20:36:56.711 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc063b80 con 0x7ff2cc14ccd0 2021-11-15T20:36:56.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 0x7ff2cc141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 0x7ff2cc141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41888/0 (socket says 172.21.2.137:41888) 2021-11-15T20:36:56.712 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 -- 172.21.2.137:0/73945028 learned_addr learned my addr 172.21.2.137:0/73945028 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 -- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc14ccd0 msgr2=0x7ff2cc142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc14ccd0 0x7ff2cc142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.713 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 -- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac004b10 msgr2=0x7ff2cc149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac004b10 0x7ff2cc149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 -- 172.21.2.137:0/73945028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0675e0 con 0x7ff2cc1561f0 2021-11-15T20:36:56.714 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cb7fe700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 0x7ff2cc141e10 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7ff2cc14ca00 tx=0x7ff2bc006e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2bc013460 con 0x7ff2cc1561f0 2021-11-15T20:36:56.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0135c0 con 0x7ff2cc1561f0 2021-11-15T20:36:56.715 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2bc013920 con 0x7ff2cc1561f0 2021-11-15T20:36:56.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc1427f0 con 0x7ff2cc1561f0 2021-11-15T20:36:56.716 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc159ac0 con 0x7ff2cc1561f0 2021-11-15T20:36:56.717 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc149c70 con 0x7ff2cc1561f0 2021-11-15T20:36:56.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2bc00f070 con 0x7ff2cc1561f0 2021-11-15T20:36:56.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2c97fa700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2b00536a0 0x7ff2b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.718 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff2bc06aea0 con 0x7ff2cc1561f0 2021-11-15T20:36:56.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.691+0000 7ff2cbfff700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2b00536a0 0x7ff2b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.695+0000 7ff2cbfff700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2b00536a0 0x7ff2b0055b60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7ff2b4002f70 tx=0x7ff2b4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.719 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.695+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2bc068e90 con 0x7ff2cc1561f0 2021-11-15T20:36:56.785 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.779+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2cc063740 con 0x7ff2b00536a0 2021-11-15T20:36:56.786 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.779+0000 7ff2c97fa700 1 -- 172.21.2.137:0/73945028 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2cc063740 con 0x7ff2b00536a0 2021-11-15T20:36:56.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2b00536a0 msgr2=0x7ff2b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.787 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2b00536a0 0x7ff2b0055b60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7ff2b4002f70 tx=0x7ff2b4006a80).stop 2021-11-15T20:36:56.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 msgr2=0x7ff2cc141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.788 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 0x7ff2cc141e10 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7ff2cc14ca00 tx=0x7ff2bc006e70).stop 2021-11-15T20:36:56.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 shutdown_connections 2021-11-15T20:36:56.789 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ff2b00536a0 0x7ff2b0055b60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ff2cc14ccd0 0x7ff2cc142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ff2cc1561f0 0x7ff2cc141e10 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.790 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 --2- 172.21.2.137:0/73945028 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ff2ac004b10 0x7ff2cc149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 >> 172.21.2.137:0/73945028 conn(0x7ff2cc0631e0 msgr2=0x7ff2cc143fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 shutdown_connections 2021-11-15T20:36:56.791 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.783+0000 7ff2d2335700 1 -- 172.21.2.137:0/73945028 wait complete. 2021-11-15T20:36:56.792 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 1 to deep-scrub 2021-11-15T20:36:56.794 INFO:tasks.ceph:Scrubbing osd.2 2021-11-15T20:36:56.795 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:56.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 Processor -- start 2021-11-15T20:36:56.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- start start 2021-11-15T20:36:56.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f500405fd20 0x7f50040af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f50040b10b0 0x7f50040b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5004147f70 con 0x7f50040b0610 2021-11-15T20:36:56.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5004060100 con 0x7f50040b10b0 2021-11-15T20:36:56.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5004147cd0 con 0x7f500405fd20 2021-11-15T20:36:56.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f50090f4700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f50040b0610 0x7f50040aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60678/0 (socket says 172.21.2.137:60678) 2021-11-15T20:36:56.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f50090f4700 1 -- 172.21.2.137:0/2621337705 learned_addr learned my addr 172.21.2.137:0/2621337705 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:56.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f5003fff700 1 --2- 172.21.2.137:0/2621337705 >> v2:172.21.2.137:3300/0 conn(0x7f50040b10b0 0x7f50040b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f5003fff700 1 -- 172.21.2.137:0/2621337705 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f500405fd20 msgr2=0x7f50040af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:56.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f5003fff700 1 --2- 172.21.2.137:0/2621337705 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f500405fd20 0x7f50040af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f5003fff700 1 -- 172.21.2.137:0/2621337705 >> v1:172.21.2.137:6789/0 conn(0x7f50040b0610 legacy=0x7f50040aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f5003fff700 1 -- 172.21.2.137:0/2621337705 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040a9ed0 con 0x7f50040b10b0 2021-11-15T20:36:56.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f50037fe700 1 -- 172.21.2.137:0/2621337705 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163624122 0 0) 0x7f5004147f70 con 0x7f50040b0610 2021-11-15T20:36:56.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f5003fff700 1 --2- 172.21.2.137:0/2621337705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b10b0 0x7f50040b0120 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f4fec002f70 tx=0x7f4fec006df0).ready entity=mon.1 client_cookie=47f4d13213d25edc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f50037fe700 1 -- 172.21.2.137:0/2621337705 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fec00d570 con 0x7f50040b10b0 2021-11-15T20:36:56.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f50037fe700 1 -- 172.21.2.137:0/2621337705 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec000e90 con 0x7f50040b10b0 2021-11-15T20:36:56.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f50037fe700 1 -- 172.21.2.137:0/2621337705 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fec00d8c0 con 0x7f50040b10b0 2021-11-15T20:36:56.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- 172.21.2.137:0/2621337705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b10b0 msgr2=0x7f50040b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 --2- 172.21.2.137:0/2621337705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b10b0 0x7f50040b0120 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f4fec002f70 tx=0x7f4fec006df0).stop 2021-11-15T20:36:56.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- 172.21.2.137:0/2621337705 shutdown_connections 2021-11-15T20:36:56.859 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 --2- 172.21.2.137:0/2621337705 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b10b0 0x7f50040b0120 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 --2- 172.21.2.137:0/2621337705 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f500405fd20 0x7f50040af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- 172.21.2.137:0/2621337705 >> 172.21.2.137:0/2621337705 conn(0x7f50040b4e60 msgr2=0x7f50040b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- 172.21.2.137:0/2621337705 shutdown_connections 2021-11-15T20:36:56.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.843+0000 7f500ab57700 1 -- 172.21.2.137:0/2621337705 wait complete. 2021-11-15T20:36:56.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 Processor -- start 2021-11-15T20:36:56.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- start start 2021-11-15T20:36:56.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f500405fd20 0x7f5004159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b0610 0x7f5004143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f50040b10b0 0x7f5004143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50040ae630 con 0x7f500405fd20 2021-11-15T20:36:56.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500415abc0 con 0x7f50040b0610 2021-11-15T20:36:56.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5004144a00 con 0x7f50040b10b0 2021-11-15T20:36:56.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b0610 0x7f5004143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b0610 0x7f5004143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41902/0 (socket says 172.21.2.137:41902) 2021-11-15T20:36:56.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 -- 172.21.2.137:0/3559031784 learned_addr learned my addr 172.21.2.137:0/3559031784 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 -- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f50040b10b0 msgr2=0x7f5004143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f50040b10b0 0x7f5004143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 -- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f500405fd20 msgr2=0x7f5004159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.865 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f500405fd20 0x7f5004159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 -- 172.21.2.137:0/3559031784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec00b180 con 0x7f50040b0610 2021-11-15T20:36:56.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5003fff700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b0610 0x7f5004143910 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f4fec002f70 tx=0x7f4fec015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.866 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fec0119d0 con 0x7f50040b0610 2021-11-15T20:36:56.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec011b30 con 0x7f50040b0610 2021-11-15T20:36:56.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fec011e90 con 0x7f50040b0610 2021-11-15T20:36:56.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50040acc00 con 0x7f50040b0610 2021-11-15T20:36:56.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50041442f0 con 0x7f50040b0610 2021-11-15T20:36:56.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5004097f90 con 0x7f50040b0610 2021-11-15T20:36:56.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4fec01a040 con 0x7f50040b0610 2021-11-15T20:36:56.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fe80536a0 0x7f4fe8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f4fec06c640 con 0x7f50040b0610 2021-11-15T20:36:56.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f4fe8059cb0 0x7f4fe805c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 --> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fe805c690 con 0x7f4fe8059cb0 2021-11-15T20:36:56.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fec06ecd0 con 0x7f50040b0610 2021-11-15T20:36:56.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f50090f4700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f4fe8059cb0 0x7f4fe805c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f50090f4700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f4fe8059cb0 0x7f4fe805c0d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.847+0000 7f50088f3700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fe80536a0 0x7f4fe8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.871 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.851+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== osd.2 v2:172.21.2.137:6816/14744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f4fe805c690 con 0x7f4fe8059cb0 2021-11-15T20:36:56.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.851+0000 7f50088f3700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fe80536a0 0x7f4fe8055b60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f4ff4002f70 tx=0x7f4ff4006a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.872 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.855+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 --> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f50040acd90 con 0x7f4fe8059cb0 2021-11-15T20:36:56.873 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f5001ffb700 1 -- 172.21.2.137:0/3559031784 <== osd.2 v2:172.21.2.137:6816/14744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f50040acd90 con 0x7f4fe8059cb0 2021-11-15T20:36:56.873 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:56.874 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:56.874 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:56.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f4fe8059cb0 msgr2=0x7f4fe805c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:6816/14744,v1:172.21.2.137:6817/14744] conn(0x7f4fe8059cb0 0x7f4fe805c0d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.876 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fe80536a0 msgr2=0x7f4fe8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f4fe80536a0 0x7f4fe8055b60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f4ff4002f70 tx=0x7f4ff4006a80).stop 2021-11-15T20:36:56.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b0610 msgr2=0x7f5004143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.877 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 --2- 172.21.2.137:0/3559031784 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f50040b0610 0x7f5004143910 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f4fec002f70 tx=0x7f4fec015000).stop 2021-11-15T20:36:56.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f50090f4700 1 -- 172.21.2.137:0/3559031784 reap_dead start 2021-11-15T20:36:56.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 shutdown_connections 2021-11-15T20:36:56.878 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 >> 172.21.2.137:0/3559031784 conn(0x7f50040b4e60 msgr2=0x7f50040b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 shutdown_connections 2021-11-15T20:36:56.879 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.859+0000 7f500ab57700 1 -- 172.21.2.137:0/3559031784 wait complete. 2021-11-15T20:36:56.879 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-11-15T20:36:56.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 Processor -- start 2021-11-15T20:36:56.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 -- start start 2021-11-15T20:36:56.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54005c770 0x7fb5400aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fb5400b0550 0x7fb54014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb54014aaa0 0x7fb540140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400b1650 con 0x7fb5400b0550 2021-11-15T20:36:56.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54005cb50 con 0x7fb54014aaa0 2021-11-15T20:36:56.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb546d68700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400ad030 con 0x7fb54005c770 2021-11-15T20:36:56.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb545305700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb54014aaa0 0x7fb540140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb545305700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fb54014aaa0 0x7fb540140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41910/0 (socket says 172.21.2.137:41910) 2021-11-15T20:36:56.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.927+0000 7fb545305700 1 -- 172.21.2.137:0/1897902400 learned_addr learned my addr 172.21.2.137:0/1897902400 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb545305700 1 -- 172.21.2.137:0/1897902400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54005c770 msgr2=0x7fb5400aef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:56.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb545305700 1 --2- 172.21.2.137:0/1897902400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54005c770 0x7fb5400aef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb545305700 1 -- 172.21.2.137:0/1897902400 >> v2:172.21.2.111:3300/0 conn(0x7fb5400b0550 msgr2=0x7fb54014a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:56.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb545305700 1 --2- 172.21.2.137:0/1897902400 >> v2:172.21.2.111:3300/0 conn(0x7fb5400b0550 0x7fb54014a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb545305700 1 -- 172.21.2.137:0/1897902400 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400ad2d0 con 0x7fb54014aaa0 2021-11-15T20:36:56.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb545305700 1 --2- 172.21.2.137:0/1897902400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54014aaa0 0x7fb540140aa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fb5380032f0 tx=0x7fb538009290).ready entity=mon.1 client_cookie=240416188080ea5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53f7fe700 1 -- 172.21.2.137:0/1897902400 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53800b870 con 0x7fb54014aaa0 2021-11-15T20:36:56.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53f7fe700 1 -- 172.21.2.137:0/1897902400 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800b9d0 con 0x7fb54014aaa0 2021-11-15T20:36:56.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53f7fe700 1 -- 172.21.2.137:0/1897902400 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53800bb80 con 0x7fb54014aaa0 2021-11-15T20:36:56.944 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1897902400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54014aaa0 msgr2=0x7fb540140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- 172.21.2.137:0/1897902400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54014aaa0 0x7fb540140aa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fb5380032f0 tx=0x7fb538009290).stop 2021-11-15T20:36:56.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1897902400 shutdown_connections 2021-11-15T20:36:56.945 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- 172.21.2.137:0/1897902400 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54014aaa0 0x7fb540140aa0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:56.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- 172.21.2.137:0/1897902400 >> v2:172.21.2.111:3300/0 conn(0x7fb5400b0550 0x7fb54014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- 172.21.2.137:0/1897902400 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54005c770 0x7fb5400aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.946 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1897902400 >> 172.21.2.137:0/1897902400 conn(0x7fb5400631e0 msgr2=0x7fb54005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:56.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1897902400 shutdown_connections 2021-11-15T20:36:56.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1897902400 wait complete. 2021-11-15T20:36:56.947 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 Processor -- start 2021-11-15T20:36:56.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- start start 2021-11-15T20:36:56.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 0x7fb540147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.948 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5400b0550 0x7fb540063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54014aaa0 0x7fb540063c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400656e0 con 0x7fb5400b0550 2021-11-15T20:36:56.949 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540064eb0 con 0x7fb54005c770 2021-11-15T20:36:56.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5401567b0 con 0x7fb54014aaa0 2021-11-15T20:36:56.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 0x7fb540147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.950 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 0x7fb540147350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41918/0 (socket says 172.21.2.137:41918) 2021-11-15T20:36:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 -- 172.21.2.137:0/1960856373 learned_addr learned my addr 172.21.2.137:0/1960856373 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 -- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54014aaa0 msgr2=0x7fb540063c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.951 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54014aaa0 0x7fb540063c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 -- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5400b0550 msgr2=0x7fb540063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:56.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5400b0550 0x7fb540063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:56.952 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 -- 172.21.2.137:0/1960856373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538009530 con 0x7fb54005c770 2021-11-15T20:36:56.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb544b04700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 0x7fb540147350 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fb528002ef0 tx=0x7fb528006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528009ea0 con 0x7fb54005c770 2021-11-15T20:36:56.953 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb528002320 con 0x7fb54005c770 2021-11-15T20:36:56.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528002680 con 0x7fb54005c770 2021-11-15T20:36:56.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb540156ab0 con 0x7fb54005c770 2021-11-15T20:36:56.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401564a0 con 0x7fb54005c770 2021-11-15T20:36:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5400ae7f0 con 0x7fb54005c770 2021-11-15T20:36:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb52800f030 con 0x7fb54005c770 2021-11-15T20:36:56.955 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53dffb700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb524053610 0x7fb524055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.931+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb52806b2f0 con 0x7fb54005c770 2021-11-15T20:36:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.935+0000 7fb53ffff700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb524053610 0x7fb524055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:56.956 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.935+0000 7fb53ffff700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb524053610 0x7fb524055ad0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb530002ef0 tx=0x7fb530006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:56.957 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:56.935+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb528042620 con 0x7fb54005c770 2021-11-15T20:36:57.025 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.019+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb540156ef0 con 0x7fb524053610 2021-11-15T20:36:57.026 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb53dffb700 1 -- 172.21.2.137:0/1960856373 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb53000bed0 con 0x7fb524053610 2021-11-15T20:36:57.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb524053610 msgr2=0x7fb524055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.028 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb524053610 0x7fb524055ad0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb530002ef0 tx=0x7fb530006910).stop 2021-11-15T20:36:57.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 msgr2=0x7fb540147350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 0x7fb540147350 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fb528002ef0 tx=0x7fb528006d50).stop 2021-11-15T20:36:57.029 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 shutdown_connections 2021-11-15T20:36:57.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fb524053610 0x7fb524055ad0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.030 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fb54014aaa0 0x7fb540063c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fb5400b0550 0x7fb540063760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 --2- 172.21.2.137:0/1960856373 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fb54005c770 0x7fb540147350 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.031 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 >> 172.21.2.137:0/1960856373 conn(0x7fb5400631e0 msgr2=0x7fb5400b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 shutdown_connections 2021-11-15T20:36:57.032 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.023+0000 7fb546d68700 1 -- 172.21.2.137:0/1960856373 wait complete. 2021-11-15T20:36:57.033 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 2 to deep-scrub 2021-11-15T20:36:57.034 INFO:tasks.ceph:Scrubbing osd.3 2021-11-15T20:36:57.035 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:57.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 Processor -- start 2021-11-15T20:36:57.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 -- start start 2021-11-15T20:36:57.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa9c80b1180 0x7fa9c8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fa9c80af2f0 0x7fa9c8143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c80aecf0 con 0x7fa9c80acab0 2021-11-15T20:36:57.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c813f180 con 0x7fa9c80af2f0 2021-11-15T20:36:57.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9ce055700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c80aef20 con 0x7fa9c80b1180 2021-11-15T20:36:57.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa9c80b1180 0x7fa9c8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fa9c80b1180 0x7fa9c8142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41928/0 (socket says 172.21.2.137:41928) 2021-11-15T20:36:57.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 -- 172.21.2.137:0/1737964764 learned_addr learned my addr 172.21.2.137:0/1737964764 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 -- 172.21.2.137:0/1737964764 >> v2:172.21.2.111:3300/0 conn(0x7fa9c80af2f0 msgr2=0x7fa9c8143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 --2- 172.21.2.137:0/1737964764 >> v2:172.21.2.111:3300/0 conn(0x7fa9c80af2f0 0x7fa9c8143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 -- 172.21.2.137:0/1737964764 >> v1:172.21.2.111:6789/0 conn(0x7fa9c80acab0 legacy=0x7fa9c80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 -- 172.21.2.137:0/1737964764 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80b2770 con 0x7fa9c80b1180 2021-11-15T20:36:57.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c6ffd700 1 --2- 172.21.2.137:0/1737964764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8142b80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fa9c80b2bd0 tx=0x7fa9b0006eb0).ready entity=mon.1 client_cookie=6b0f1e782ef7ecbf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.095 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c67fc700 1 -- 172.21.2.137:0/1737964764 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b000d5c0 con 0x7fa9c80b1180 2021-11-15T20:36:57.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c67fc700 1 -- 172.21.2.137:0/1737964764 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b0000e90 con 0x7fa9c80b1180 2021-11-15T20:36:57.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.083+0000 7fa9c67fc700 1 -- 172.21.2.137:0/1737964764 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b000d910 con 0x7fa9c80b1180 2021-11-15T20:36:57.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/1737964764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 msgr2=0x7fa9c8142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 --2- 172.21.2.137:0/1737964764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8142b80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fa9c80b2bd0 tx=0x7fa9b0006eb0).stop 2021-11-15T20:36:57.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/1737964764 shutdown_connections 2021-11-15T20:36:57.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 --2- 172.21.2.137:0/1737964764 >> v2:172.21.2.111:3300/0 conn(0x7fa9c80af2f0 0x7fa9c8143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 --2- 172.21.2.137:0/1737964764 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8142b80 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/1737964764 >> 172.21.2.137:0/1737964764 conn(0x7fa9c80630f0 msgr2=0x7fa9c80634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/1737964764 shutdown_connections 2021-11-15T20:36:57.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/1737964764 wait complete. 2021-11-15T20:36:57.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 Processor -- start 2021-11-15T20:36:57.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- start start 2021-11-15T20:36:57.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9c80acab0 0x7fa9c81333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9c80af2f0 0x7fa9c81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8067730 con 0x7fa9c80af2f0 2021-11-15T20:36:57.103 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c815a660 con 0x7fa9c80b1180 2021-11-15T20:36:57.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8141920 con 0x7fa9c80acab0 2021-11-15T20:36:57.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.104 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41934/0 (socket says 172.21.2.137:41934) 2021-11-15T20:36:57.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 -- 172.21.2.137:0/379240522 learned_addr learned my addr 172.21.2.137:0/379240522 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 -- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9c80acab0 msgr2=0x7fa9c81333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fa9c80acab0 0x7fa9c81333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 -- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9c80af2f0 msgr2=0x7fa9c81564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fa9c80af2f0 0x7fa9c81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 -- 172.21.2.137:0/379240522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b000b1e0 con 0x7fa9c80b1180 2021-11-15T20:36:57.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c7fff700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8137470 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fa9c00032f0 tx=0x7fa9c0009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c000d580 con 0x7fa9c80b1180 2021-11-15T20:36:57.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c000d6e0 con 0x7fa9c80b1180 2021-11-15T20:36:57.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c81569c0 con 0x7fa9c80b1180 2021-11-15T20:36:57.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c000da40 con 0x7fa9c80b1180 2021-11-15T20:36:57.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c8064790 con 0x7fa9c80b1180 2021-11-15T20:36:57.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9c815a4e0 con 0x7fa9c80b1180 2021-11-15T20:36:57.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9c000dba0 con 0x7fa9c80b1180 2021-11-15T20:36:57.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9ac0536f0 0x7fa9ac055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.109 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa9c006b9b0 con 0x7fa9c80b1180 2021-11-15T20:36:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7fa9ac059e70 0x7fa9ac05c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 --> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9ac05c850 con 0x7fa9ac059e70 2021-11-15T20:36:57.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9c0070240 con 0x7fa9c80b1180 2021-11-15T20:36:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.087+0000 7fa9c6ffd700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7fa9ac059e70 0x7fa9ac05c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.091+0000 7fa9c6ffd700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7fa9ac059e70 0x7fa9ac05c290 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.111 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.091+0000 7fa9c77fe700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9ac0536f0 0x7fa9ac055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.091+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== osd.3 v2:172.21.2.137:6824/14753 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fa9ac05c850 con 0x7fa9ac059e70 2021-11-15T20:36:57.112 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.091+0000 7fa9c77fe700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9ac0536f0 0x7fa9ac055bb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fa9b8002f90 tx=0x7fa9b80069b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 --> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa9c8137c20 con 0x7fa9ac059e70 2021-11-15T20:36:57.113 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9c4ff9700 1 -- 172.21.2.137:0/379240522 <== osd.3 v2:172.21.2.137:6824/14753 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa9c8137c20 con 0x7fa9ac059e70 2021-11-15T20:36:57.114 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:57.114 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:57.115 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:57.116 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7fa9ac059e70 msgr2=0x7fa9ac05c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:6824/14753,v1:172.21.2.137:6825/14753] conn(0x7fa9ac059e70 0x7fa9ac05c290 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9ac0536f0 msgr2=0x7fa9ac055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fa9ac0536f0 0x7fa9ac055bb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fa9b8002f90 tx=0x7fa9b80069b0).stop 2021-11-15T20:36:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 msgr2=0x7fa9c8137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 --2- 172.21.2.137:0/379240522 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fa9c80b1180 0x7fa9c8137470 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fa9c00032f0 tx=0x7fa9c0009220).stop 2021-11-15T20:36:57.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9c7fff700 1 -- 172.21.2.137:0/379240522 reap_dead start 2021-11-15T20:36:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 shutdown_connections 2021-11-15T20:36:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 >> 172.21.2.137:0/379240522 conn(0x7fa9c80630f0 msgr2=0x7fa9c8136970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 shutdown_connections 2021-11-15T20:36:57.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.099+0000 7fa9ce055700 1 -- 172.21.2.137:0/379240522 wait complete. 2021-11-15T20:36:57.120 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-11-15T20:36:57.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 Processor -- start 2021-11-15T20:36:57.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 -- start start 2021-11-15T20:36:57.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 0x7f8d8813c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f8d88065b10 0x7f8d8813c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d88066270 con 0x7f8d880b00a0 2021-11-15T20:36:57.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d88067410 con 0x7f8d88065b10 2021-11-15T20:36:57.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d8d400700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88065fd0 con 0x7f8d88065730 2021-11-15T20:36:57.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d877fe700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f8d880b00a0 0x7f8d8805bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60726/0 (socket says 172.21.2.137:60726) 2021-11-15T20:36:57.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d877fe700 1 -- 172.21.2.137:0/1401089930 learned_addr learned my addr 172.21.2.137:0/1401089930 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:57.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802085764 0 0) 0x7f8d88066270 con 0x7f8d880b00a0 2021-11-15T20:36:57.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d6c003260 con 0x7f8d880b00a0 2021-11-15T20:36:57.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d867fc700 1 --2- 172.21.2.137:0/1401089930 >> v2:172.21.2.111:3300/0 conn(0x7f8d88065b10 0x7f8d8813c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 0x7f8d8813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3660152 0 0) 0x7f8d6c003260 con 0x7f8d880b00a0 2021-11-15T20:36:57.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 msgr2=0x7f8d8813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 0x7f8d8813c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 >> v2:172.21.2.111:3300/0 conn(0x7f8d88065b10 msgr2=0x7f8d8813c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 --2- 172.21.2.137:0/1401089930 >> v2:172.21.2.111:3300/0 conn(0x7f8d88065b10 0x7f8d8813c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88066f70 con 0x7f8d880b00a0 2021-11-15T20:36:57.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f8d80001a00 con 0x7f8d880b00a0 2021-11-15T20:36:57.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 >> v1:172.21.2.137:6789/0 conn(0x7f8d880b00a0 legacy=0x7f8d8805bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d6c003750 0x7f8d6c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 0x7f8d6c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c0049f0 0x7f8d6c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88067410 con 0x7f8d6c0049f0 2021-11-15T20:36:57.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88065fd0 con 0x7f8d6c003750 2021-11-15T20:36:57.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c00b7a0 con 0x7f8d88065730 2021-11-15T20:36:57.186 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d6c003750 0x7f8d6c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d877fe700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c0049f0 0x7f8d6c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d867fc700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 0x7f8d6c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.187 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 -- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 msgr2=0x7f8d6c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88065730 0x7f8d6c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 -- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c0049f0 msgr2=0x7f8d6c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.188 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c0049f0 0x7f8d6c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 -- 172.21.2.137:0/1401089930 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c003260 con 0x7f8d6c003750 2021-11-15T20:36:57.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d6c003750 0x7f8d6c003b70 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f8d7800c000 tx=0x7f8d78006ea0).ready entity=mon.1 client_cookie=6987fac196a134ed server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.189 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7800fa10 con 0x7f8d6c003750 2021-11-15T20:36:57.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7800fb70 con 0x7f8d6c003750 2021-11-15T20:36:57.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.167+0000 7f8d85ffb700 1 -- 172.21.2.137:0/1401089930 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78011450 con 0x7f8d6c003750 2021-11-15T20:36:57.190 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1401089930 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d6c003750 msgr2=0x7f8d6c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1401089930 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d6c003750 0x7f8d6c003b70 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f8d7800c000 tx=0x7f8d78006ea0).stop 2021-11-15T20:36:57.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d877fe700 1 -- 172.21.2.137:0/1401089930 reap_dead start 2021-11-15T20:36:57.191 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1401089930 shutdown_connections 2021-11-15T20:36:57.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1401089930 >> 172.21.2.137:0/1401089930 conn(0x7f8d88060290 msgr2=0x7f8d88060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1401089930 shutdown_connections 2021-11-15T20:36:57.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1401089930 wait complete. 2021-11-15T20:36:57.192 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 Processor -- start 2021-11-15T20:36:57.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- start start 2021-11-15T20:36:57.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c003750 0x7f8d880b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.193 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 0x7f8d881569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88156ed0 0x7f8d880aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880ade50 con 0x7f8d6c003750 2021-11-15T20:36:57.194 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88156440 con 0x7f8d880b52d0 2021-11-15T20:36:57.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88157690 con 0x7f8d88156ed0 2021-11-15T20:36:57.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 0x7f8d881569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.195 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 0x7f8d881569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41952/0 (socket says 172.21.2.137:41952) 2021-11-15T20:36:57.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 -- 172.21.2.137:0/1487410090 learned_addr learned my addr 172.21.2.137:0/1487410090 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 -- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88156ed0 msgr2=0x7f8d880aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.196 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88156ed0 0x7f8d880aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 -- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c003750 msgr2=0x7f8d880b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c003750 0x7f8d880b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.197 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 -- 172.21.2.137:0/1487410090 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880ac910 con 0x7f8d880b52d0 2021-11-15T20:36:57.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d867fc700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 0x7f8d881569e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f8d7c00c000 tx=0x7f8d7c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7c00ebc0 con 0x7f8d880b52d0 2021-11-15T20:36:57.198 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00ed20 con 0x7f8d880b52d0 2021-11-15T20:36:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d880acbb0 con 0x7f8d880b52d0 2021-11-15T20:36:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d88157380 con 0x7f8d880b52d0 2021-11-15T20:36:57.199 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7c012620 con 0x7f8d880b52d0 2021-11-15T20:36:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d880ad4b0 con 0x7f8d880b52d0 2021-11-15T20:36:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d7c018030 con 0x7f8d880b52d0 2021-11-15T20:36:57.200 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d77fff700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8d640536d0 0x7f8d64055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8d7c06bc70 con 0x7f8d880b52d0 2021-11-15T20:36:57.201 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.171+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8d640536d0 0x7f8d64055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.175+0000 7f8d86ffd700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8d640536d0 0x7f8d64055b90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f8d7800c000 tx=0x7f8d78006ea0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.202 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.175+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d7c042fa0 con 0x7f8d880b52d0 2021-11-15T20:36:57.264 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.259+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d880573d0 con 0x7f8d640536d0 2021-11-15T20:36:57.265 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.259+0000 7f8d77fff700 1 -- 172.21.2.137:0/1487410090 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8d880573d0 con 0x7f8d640536d0 2021-11-15T20:36:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8d640536d0 msgr2=0x7f8d64055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.267 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8d640536d0 0x7f8d64055b90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f8d7800c000 tx=0x7f8d78006ea0).stop 2021-11-15T20:36:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 msgr2=0x7f8d881569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 0x7f8d881569e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f8d7c00c000 tx=0x7f8d7c008040).stop 2021-11-15T20:36:57.268 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 shutdown_connections 2021-11-15T20:36:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f8d640536d0 0x7f8d64055b90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f8d88156ed0 0x7f8d880aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f8d880b52d0 0x7f8d881569e0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.269 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 --2- 172.21.2.137:0/1487410090 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f8d6c003750 0x7f8d880b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 >> 172.21.2.137:0/1487410090 conn(0x7f8d88060290 msgr2=0x7f8d88138990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 shutdown_connections 2021-11-15T20:36:57.270 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.263+0000 7f8d8d400700 1 -- 172.21.2.137:0/1487410090 wait complete. 2021-11-15T20:36:57.271 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 3 to deep-scrub 2021-11-15T20:36:57.273 INFO:tasks.ceph:Scrubbing osd.4 2021-11-15T20:36:57.274 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:57.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 Processor -- start 2021-11-15T20:36:57.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- start start 2021-11-15T20:36:57.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d3c0b0830 0x7f7d3c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c147f70 con 0x7f7d3c05fd20 2021-11-15T20:36:57.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c060100 con 0x7f7d3c0b10b0 2021-11-15T20:36:57.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c147cd0 con 0x7f7d3c0b0830 2021-11-15T20:36:57.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f7d3c0b10b0 0x7f7d3c0aa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60742/0 (socket says 172.21.2.137:60742) 2021-11-15T20:36:57.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 -- 172.21.2.137:0/2184924202 learned_addr learned my addr 172.21.2.137:0/2184924202 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:57.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824208063 0 0) 0x7f7d3c060100 con 0x7f7d3c0b10b0 2021-11-15T20:36:57.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d24003260 con 0x7f7d3c0b10b0 2021-11-15T20:36:57.337 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347701454 0 0) 0x7f7d24003260 con 0x7f7d3c0b10b0 2021-11-15T20:36:57.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d3c0b0830 msgr2=0x7f7d3c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d3c0b0830 0x7f7d3c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 >> v1:172.21.2.111:6789/0 conn(0x7f7d3c05fd20 legacy=0x7f7d3c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.338 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0a9ed0 con 0x7f7d3c0b10b0 2021-11-15T20:36:57.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7f7d340019e0 con 0x7f7d3c0b10b0 2021-11-15T20:36:57.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 >> v1:172.21.2.137:6789/0 conn(0x7f7d3c0b10b0 legacy=0x7f7d3c0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.339 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d240037d0 0x7f7d24003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d24004500 0x7f7d24004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d24005070 0x7f7d2400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.340 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c147cd0 con 0x7f7d24004500 2021-11-15T20:36:57.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2400be80 con 0x7f7d24005070 2021-11-15T20:36:57.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2400c040 con 0x7f7d240037d0 2021-11-15T20:36:57.341 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d24005070 0x7f7d2400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 -- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d240037d0 msgr2=0x7f7d24003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d240037d0 0x7f7d24003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.342 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 -- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d24004500 msgr2=0x7f7d24004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d24004500 0x7f7d24004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 -- 172.21.2.137:0/2184924202 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24003260 con 0x7f7d24005070 2021-11-15T20:36:57.343 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d24005070 0x7f7d2400b750 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f7d3c060740 tx=0x7f7d3c0b5e40).ready entity=mon.1 client_cookie=d57f11ddbce32fa8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d3400cbb0 con 0x7f7d24005070 2021-11-15T20:36:57.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400cd10 con 0x7f7d24005070 2021-11-15T20:36:57.344 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d2ffff700 1 -- 172.21.2.137:0/2184924202 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d34005b80 con 0x7f7d24005070 2021-11-15T20:36:57.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- 172.21.2.137:0/2184924202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d24005070 msgr2=0x7f7d2400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.345 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 --2- 172.21.2.137:0/2184924202 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d24005070 0x7f7d2400b750 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f7d3c060740 tx=0x7f7d3c0b5e40).stop 2021-11-15T20:36:57.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d418ca700 1 -- 172.21.2.137:0/2184924202 reap_dead start 2021-11-15T20:36:57.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- 172.21.2.137:0/2184924202 shutdown_connections 2021-11-15T20:36:57.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- 172.21.2.137:0/2184924202 >> 172.21.2.137:0/2184924202 conn(0x7f7d3c0b4e60 msgr2=0x7f7d3c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- 172.21.2.137:0/2184924202 shutdown_connections 2021-11-15T20:36:57.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.323+0000 7f7d4332d700 1 -- 172.21.2.137:0/2184924202 wait complete. 2021-11-15T20:36:57.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 Processor -- start 2021-11-15T20:36:57.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- start start 2021-11-15T20:36:57.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d24005070 0x7f7d3c149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d3c0acad0 0x7f7d3c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d3c157080 0x7f7d3c0ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c157530 con 0x7f7d24005070 2021-11-15T20:36:57.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c149130 con 0x7f7d3c0acad0 2021-11-15T20:36:57.349 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c1493d0 con 0x7f7d3c157080 2021-11-15T20:36:57.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d3c0acad0 0x7f7d3c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d3c0acad0 0x7f7d3c1569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41976/0 (socket says 172.21.2.137:41976) 2021-11-15T20:36:57.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 -- 172.21.2.137:0/2914392786 learned_addr learned my addr 172.21.2.137:0/2914392786 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 -- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d3c157080 msgr2=0x7f7d3c0ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f7d3c157080 0x7f7d3c0ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 -- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d24005070 msgr2=0x7f7d3c149870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f7d24005070 0x7f7d3c149870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 -- 172.21.2.137:0/2914392786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c148e50 con 0x7f7d3c0acad0 2021-11-15T20:36:57.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d408c8700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d3c0acad0 0x7f7d3c1569f0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f7d38002f70 tx=0x7f7d38006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d38009e80 con 0x7f7d3c0acad0 2021-11-15T20:36:57.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38013460 con 0x7f7d3c0acad0 2021-11-15T20:36:57.353 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d380137c0 con 0x7f7d3c0acad0 2021-11-15T20:36:57.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c0ad5f0 con 0x7f7d3c0acad0 2021-11-15T20:36:57.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c0adaa0 con 0x7f7d3c0acad0 2021-11-15T20:36:57.354 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d3c149590 con 0x7f7d3c0acad0 2021-11-15T20:36:57.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d3800f070 con 0x7f7d3c0acad0 2021-11-15T20:36:57.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d1c053580 0x7f7d1c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.355 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7d3806aec0 con 0x7f7d3c0acad0 2021-11-15T20:36:57.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f7d1c059d00 0x7f7d1c05c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 --> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d1c05c780 con 0x7f7d1c059d00 2021-11-15T20:36:57.356 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d380422a0 con 0x7f7d3c0acad0 2021-11-15T20:36:57.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d410c9700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d1c053580 0x7f7d1c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.327+0000 7f7d418ca700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f7d1c059d00 0x7f7d1c05c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.331+0000 7f7d418ca700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f7d1c059d00 0x7f7d1c05c120 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.357 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.331+0000 7f7d410c9700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d1c053580 0x7f7d1c055a40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f7d30000f70 tx=0x7f7d30006930).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.358 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.331+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== osd.4 v2:172.21.2.111:6800/14921 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f7d1c05c780 con 0x7f7d1c059d00 2021-11-15T20:36:57.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 --> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7d3c0573d0 con 0x7f7d1c059d00 2021-11-15T20:36:57.359 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d2e7fc700 1 -- 172.21.2.137:0/2914392786 <== osd.4 v2:172.21.2.111:6800/14921 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7d3c0573d0 con 0x7f7d1c059d00 2021-11-15T20:36:57.359 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:57.360 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:57.360 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:57.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f7d1c059d00 msgr2=0x7f7d1c05c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.362 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6800/14921,v1:172.21.2.111:6801/14921] conn(0x7f7d1c059d00 0x7f7d1c05c120 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d1c053580 msgr2=0x7f7d1c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f7d1c053580 0x7f7d1c055a40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f7d30000f70 tx=0x7f7d30006930).stop 2021-11-15T20:36:57.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d3c0acad0 msgr2=0x7f7d3c1569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 --2- 172.21.2.137:0/2914392786 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f7d3c0acad0 0x7f7d3c1569f0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f7d38002f70 tx=0x7f7d38006db0).stop 2021-11-15T20:36:57.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d418ca700 1 -- 172.21.2.137:0/2914392786 reap_dead start 2021-11-15T20:36:57.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 shutdown_connections 2021-11-15T20:36:57.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 >> 172.21.2.137:0/2914392786 conn(0x7f7d3c0b4e60 msgr2=0x7f7d3c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 shutdown_connections 2021-11-15T20:36:57.365 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.339+0000 7f7d4332d700 1 -- 172.21.2.137:0/2914392786 wait complete. 2021-11-15T20:36:57.366 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-15T20:36:57.439 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 Processor -- start 2021-11-15T20:36:57.440 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 -- start start 2021-11-15T20:36:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80acd60 0x7f75e80b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f75e80b4680 0x7f75e81290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.441 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e80b76c0 con 0x7f75e80b72e0 2021-11-15T20:36:57.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80b3100 con 0x7f75e80b4680 2021-11-15T20:36:57.442 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75eefb4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80b20c0 con 0x7f75e80acd60 2021-11-15T20:36:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75e7fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80acd60 0x7f75e80b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.445 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75e7fff700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80acd60 0x7f75e80b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:43556/0 (socket says 172.21.2.137:43556) 2021-11-15T20:36:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75e7fff700 1 -- 172.21.2.137:0/83110360 learned_addr learned my addr 172.21.2.137:0/83110360 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75ed551700 1 --2- 172.21.2.137:0/83110360 >> v2:172.21.2.111:3300/0 conn(0x7f75e80b4680 0x7f75e81290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.446 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75ed551700 1 -- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80acd60 msgr2=0x7f75e80b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75ed551700 1 --2- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80acd60 0x7f75e80b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75ed551700 1 -- 172.21.2.137:0/83110360 >> v1:172.21.2.111:6789/0 conn(0x7f75e80b72e0 legacy=0x7f75e80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.447 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75ed551700 1 -- 172.21.2.137:0/83110360 --> v2:172.21.2.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e812a170 con 0x7f75e80b4680 2021-11-15T20:36:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.435+0000 7f75ed551700 1 --2- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 0x7f75e81290c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f75e80b7850 tx=0x7f75e00091d0).ready entity=mon.0 client_cookie=4c635feceed1d9d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e77fe700 1 -- 172.21.2.137:0/83110360 <== mon.0 v2:172.21.2.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e000b680 con 0x7f75e80b4680 2021-11-15T20:36:57.448 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e77fe700 1 -- 172.21.2.137:0/83110360 <== mon.0 v2:172.21.2.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e000b7e0 con 0x7f75e80b4680 2021-11-15T20:36:57.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e77fe700 1 -- 172.21.2.137:0/83110360 <== mon.0 v2:172.21.2.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e000b950 con 0x7f75e80b4680 2021-11-15T20:36:57.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 msgr2=0x7f75e81290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.449 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 --2- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 0x7f75e81290c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f75e80b7850 tx=0x7f75e00091d0).stop 2021-11-15T20:36:57.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/83110360 shutdown_connections 2021-11-15T20:36:57.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 --2- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 0x7f75e81290c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.450 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 --2- 172.21.2.137:0/83110360 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80acd60 0x7f75e80b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/83110360 >> 172.21.2.137:0/83110360 conn(0x7f75e8064960 msgr2=0x7f75e8064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/83110360 shutdown_connections 2021-11-15T20:36:57.451 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/83110360 wait complete. 2021-11-15T20:36:57.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 Processor -- start 2021-11-15T20:36:57.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- start start 2021-11-15T20:36:57.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 0x7f75e80ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.452 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 0x7f75e8142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80b72e0 0x7f75e80b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8146ef0 con 0x7f75e80b4680 2021-11-15T20:36:57.453 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8146ba0 con 0x7f75e80acd60 2021-11-15T20:36:57.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8128db0 con 0x7f75e80b72e0 2021-11-15T20:36:57.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 0x7f75e80ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.454 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 0x7f75e80ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41990/0 (socket says 172.21.2.137:41990) 2021-11-15T20:36:57.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 -- 172.21.2.137:0/501855482 learned_addr learned my addr 172.21.2.137:0/501855482 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 -- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80b72e0 msgr2=0x7f75e80b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.455 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80b72e0 0x7f75e80b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 -- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 msgr2=0x7f75e8142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 0x7f75e8142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.456 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 -- 172.21.2.137:0/501855482 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0009470 con 0x7f75e80acd60 2021-11-15T20:36:57.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75ecd50700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 0x7f75e80ae3d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f75e80ad1d0 tx=0x7f75d8007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d8007030 con 0x7f75e80acd60 2021-11-15T20:36:57.457 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8007190 con 0x7f75e80acd60 2021-11-15T20:36:57.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e8145030 con 0x7f75e80acd60 2021-11-15T20:36:57.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d8006510 con 0x7f75e80acd60 2021-11-15T20:36:57.458 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e8142710 con 0x7f75e80acd60 2021-11-15T20:36:57.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e8144cc0 con 0x7f75e80acd60 2021-11-15T20:36:57.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75d8010030 con 0x7f75e80acd60 2021-11-15T20:36:57.460 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e5ffb700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75cc053540 0x7f75cc055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.439+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f75d806b3c0 con 0x7f75e80acd60 2021-11-15T20:36:57.461 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.443+0000 7f75e7fff700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75cc053540 0x7f75cc055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.443+0000 7f75e7fff700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75cc053540 0x7f75cc055a00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f75d000c000 tx=0x7f75d0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.462 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.443+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75d80426f0 con 0x7f75e80acd60 2021-11-15T20:36:57.532 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.527+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f75e80b3a50 con 0x7f75cc053540 2021-11-15T20:36:57.534 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.527+0000 7f75e5ffb700 1 -- 172.21.2.137:0/501855482 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f75e80b3a50 con 0x7f75cc053540 2021-11-15T20:36:57.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75cc053540 msgr2=0x7f75cc055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.535 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75cc053540 0x7f75cc055a00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f75d000c000 tx=0x7f75d0008040).stop 2021-11-15T20:36:57.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 msgr2=0x7f75e80ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.536 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 0x7f75e80ae3d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f75e80ad1d0 tx=0x7f75d8007c00).stop 2021-11-15T20:36:57.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 shutdown_connections 2021-11-15T20:36:57.537 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f75cc053540 0x7f75cc055a00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f75e80b72e0 0x7f75e80b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f75e80b4680 0x7f75e8142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.538 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 --2- 172.21.2.137:0/501855482 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f75e80acd60 0x7f75e80ae3d0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 >> 172.21.2.137:0/501855482 conn(0x7f75e8064960 msgr2=0x7f75e8122cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 shutdown_connections 2021-11-15T20:36:57.539 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.531+0000 7f75eefb4700 1 -- 172.21.2.137:0/501855482 wait complete. 2021-11-15T20:36:57.540 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 4 to deep-scrub 2021-11-15T20:36:57.542 INFO:tasks.ceph:Scrubbing osd.5 2021-11-15T20:36:57.543 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:57.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 Processor -- start 2021-11-15T20:36:57.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- start start 2021-11-15T20:36:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc524097260 0x7fc524097640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.598 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc5240b2c30 0x7fc5240990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7fc5240969e0 0x7fc5240995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240ad150 con 0x7fc5240969e0 2021-11-15T20:36:57.599 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240aca80 con 0x7fc5240b2c30 2021-11-15T20:36:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240accb0 con 0x7fc524097260 2021-11-15T20:36:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc5240b2c30 0x7fc5240990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.600 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fc5240b2c30 0x7fc5240990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:41996/0 (socket says 172.21.2.137:41996) 2021-11-15T20:36:57.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 -- 172.21.2.137:0/668267412 learned_addr learned my addr 172.21.2.137:0/668267412 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 -- 172.21.2.137:0/668267412 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc524097260 msgr2=0x7fc524097640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:57.601 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 --2- 172.21.2.137:0/668267412 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc524097260 0x7fc524097640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 -- 172.21.2.137:0/668267412 >> v2:172.21.2.111:3300/0 conn(0x7fc5240969e0 msgr2=0x7fc5240995d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:57.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 --2- 172.21.2.137:0/668267412 >> v2:172.21.2.111:3300/0 conn(0x7fc5240969e0 0x7fc5240995d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 -- 172.21.2.137:0/668267412 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc524097c50 con 0x7fc5240b2c30 2021-11-15T20:36:57.602 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc5237fe700 1 --2- 172.21.2.137:0/668267412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240b2c30 0x7fc5240990e0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fc518002f70 tx=0x7fc518006eb0).ready entity=mon.1 client_cookie=7b1bd44353abac89 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc522ffd700 1 -- 172.21.2.137:0/668267412 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51800d570 con 0x7fc5240b2c30 2021-11-15T20:36:57.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc522ffd700 1 -- 172.21.2.137:0/668267412 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518000e90 con 0x7fc5240b2c30 2021-11-15T20:36:57.603 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc522ffd700 1 -- 172.21.2.137:0/668267412 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51800d8c0 con 0x7fc5240b2c30 2021-11-15T20:36:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- 172.21.2.137:0/668267412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240b2c30 msgr2=0x7fc5240990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- 172.21.2.137:0/668267412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240b2c30 0x7fc5240990e0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fc518002f70 tx=0x7fc518006eb0).stop 2021-11-15T20:36:57.604 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- 172.21.2.137:0/668267412 shutdown_connections 2021-11-15T20:36:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- 172.21.2.137:0/668267412 >> v2:172.21.2.111:3300/0 conn(0x7fc5240969e0 0x7fc5240995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- 172.21.2.137:0/668267412 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240b2c30 0x7fc5240990e0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.605 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 --2- 172.21.2.137:0/668267412 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc524097260 0x7fc524097640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- 172.21.2.137:0/668267412 >> 172.21.2.137:0/668267412 conn(0x7fc5240b7070 msgr2=0x7fc5240b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- 172.21.2.137:0/668267412 shutdown_connections 2021-11-15T20:36:57.606 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- 172.21.2.137:0/668267412 wait complete. 2021-11-15T20:36:57.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 Processor -- start 2021-11-15T20:36:57.607 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.591+0000 7fc52a351700 1 -- start start 2021-11-15T20:36:57.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240969e0 0x7fc5240af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.610 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc524097260 0x7fc524094e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5240b2c30 0x7fc524095360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc524096220 con 0x7fc524097260 2021-11-15T20:36:57.611 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240939d0 con 0x7fc5240969e0 2021-11-15T20:36:57.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240b0b70 con 0x7fc5240b2c30 2021-11-15T20:36:57.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240969e0 0x7fc5240af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.612 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240969e0 0x7fc5240af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42002/0 (socket says 172.21.2.137:42002) 2021-11-15T20:36:57.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 -- 172.21.2.137:0/1386180014 learned_addr learned my addr 172.21.2.137:0/1386180014 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 -- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5240b2c30 msgr2=0x7fc524095360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc5240b2c30 0x7fc524095360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.613 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 -- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc524097260 msgr2=0x7fc524094e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc524097260 0x7fc524094e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 -- 172.21.2.137:0/1386180014 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51800b1e0 con 0x7fc5240969e0 2021-11-15T20:36:57.614 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc523fff700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240969e0 0x7fc5240af380 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fc514002fb0 tx=0x7fc514006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc514013460 con 0x7fc5240969e0 2021-11-15T20:36:57.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140135c0 con 0x7fc5240969e0 2021-11-15T20:36:57.615 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc514013920 con 0x7fc5240969e0 2021-11-15T20:36:57.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc524067b60 con 0x7fc5240969e0 2021-11-15T20:36:57.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc524094010 con 0x7fc5240969e0 2021-11-15T20:36:57.616 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5240960a0 con 0x7fc5240969e0 2021-11-15T20:36:57.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc51400f070 con 0x7fc5240969e0 2021-11-15T20:36:57.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5040536a0 0x7fc504055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc51401a2a0 con 0x7fc5240969e0 2021-11-15T20:36:57.617 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fc504059e20 0x7fc50405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 --> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc50405c800 con 0x7fc504059e20 2021-11-15T20:36:57.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5140421d0 con 0x7fc5240969e0 2021-11-15T20:36:57.618 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5237fe700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5040536a0 0x7fc504055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5288ee700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fc504059e20 0x7fc50405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5288ee700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fc504059e20 0x7fc50405c240 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.619 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.595+0000 7fc5237fe700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5040536a0 0x7fc504055b60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fc518002f70 tx=0x7fc518015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.620 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.599+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== osd.5 v2:172.21.2.111:6808/14922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fc50405c800 con 0x7fc504059e20 2021-11-15T20:36:57.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 --> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc524093850 con 0x7fc504059e20 2021-11-15T20:36:57.621 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc5217fa700 1 -- 172.21.2.137:0/1386180014 <== osd.5 v2:172.21.2.111:6808/14922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc51c0098b0 con 0x7fc504059e20 2021-11-15T20:36:57.621 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:57.622 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:57.622 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:57.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fc504059e20 msgr2=0x7fc50405c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6808/14922,v1:172.21.2.111:6809/14922] conn(0x7fc504059e20 0x7fc50405c240 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.624 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5040536a0 msgr2=0x7fc504055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc5040536a0 0x7fc504055b60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fc518002f70 tx=0x7fc518015000).stop 2021-11-15T20:36:57.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240969e0 msgr2=0x7fc5240af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.625 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 --2- 172.21.2.137:0/1386180014 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc5240969e0 0x7fc5240af380 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fc514002fb0 tx=0x7fc514006df0).stop 2021-11-15T20:36:57.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc5288ee700 1 -- 172.21.2.137:0/1386180014 reap_dead start 2021-11-15T20:36:57.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 shutdown_connections 2021-11-15T20:36:57.626 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 >> 172.21.2.137:0/1386180014 conn(0x7fc5240b7070 msgr2=0x7fc524141530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 shutdown_connections 2021-11-15T20:36:57.627 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.607+0000 7fc52a351700 1 -- 172.21.2.137:0/1386180014 wait complete. 2021-11-15T20:36:57.627 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-11-15T20:36:57.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 Processor -- start 2021-11-15T20:36:57.687 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- start start 2021-11-15T20:36:57.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0a9c0b0550 0x7f0a9c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.689 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c14aaa0 0x7f0a9c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c05cb50 con 0x7f0a9c05c770 2021-11-15T20:36:57.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b1650 con 0x7f0a9c0b0550 2021-11-15T20:36:57.690 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0ad030 con 0x7f0a9c14aaa0 2021-11-15T20:36:57.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa1e2b700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f0a9c05c770 0x7f0a9c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60794/0 (socket says 172.21.2.137:60794) 2021-11-15T20:36:57.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa1e2b700 1 -- 172.21.2.137:0/2623702207 learned_addr learned my addr 172.21.2.137:0/2623702207 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:57.691 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- 172.21.2.137:0/2623702207 >> v2:172.21.2.137:3300/0 conn(0x7f0a9c0b0550 0x7f0a9c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2623702207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c14aaa0 msgr2=0x7f0a9c140aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T20:36:57.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- 172.21.2.137:0/2623702207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c14aaa0 0x7f0a9c140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.692 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2623702207 >> v1:172.21.2.137:6789/0 conn(0x7f0a9c05c770 legacy=0x7f0a9c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2623702207 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0ad2d0 con 0x7f0a9c0b0550 2021-11-15T20:36:57.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- 172.21.2.137:0/2623702207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c14a5b0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f0a98002f70 tx=0x7f0a98006df0).ready entity=mon.1 client_cookie=c13396c7bf1502d5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.693 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa0e29700 1 -- 172.21.2.137:0/2623702207 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9800d570 con 0x7f0a9c0b0550 2021-11-15T20:36:57.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa0e29700 1 -- 172.21.2.137:0/2623702207 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98000e90 con 0x7f0a9c0b0550 2021-11-15T20:36:57.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa0e29700 1 -- 172.21.2.137:0/2623702207 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9800d900 con 0x7f0a9c0b0550 2021-11-15T20:36:57.694 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2623702207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 msgr2=0x7f0a9c14a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2623702207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c14a5b0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f0a98002f70 tx=0x7f0a98006df0).stop 2021-11-15T20:36:57.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2623702207 shutdown_connections 2021-11-15T20:36:57.695 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2623702207 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c14a5b0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2623702207 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c14aaa0 0x7f0a9c140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2623702207 >> 172.21.2.137:0/2623702207 conn(0x7f0a9c0631e0 msgr2=0x7f0a9c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.696 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2623702207 shutdown_connections 2021-11-15T20:36:57.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2623702207 wait complete. 2021-11-15T20:36:57.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 Processor -- start 2021-11-15T20:36:57.697 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- start start 2021-11-15T20:36:57.700 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c05c770 0x7f0a9c066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c14aaa0 0x7f0a9c142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.701 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1564a0 con 0x7f0a9c14aaa0 2021-11-15T20:36:57.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c156690 con 0x7f0a9c0b0550 2021-11-15T20:36:57.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c141870 con 0x7f0a9c05c770 2021-11-15T20:36:57.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.702 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42020/0 (socket says 172.21.2.137:42020) 2021-11-15T20:36:57.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2999585619 learned_addr learned my addr 172.21.2.137:0/2999585619 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c05c770 msgr2=0x7f0a9c066a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.703 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c05c770 0x7f0a9c066a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c14aaa0 msgr2=0x7f0a9c142200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c14aaa0 0x7f0a9c142200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.704 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 -- 172.21.2.137:0/2999585619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9800b180 con 0x7f0a9c0b0550 2021-11-15T20:36:57.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa162a700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c141d10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f0a98002f70 tx=0x7f0a98015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a98006aa0 con 0x7f0a9c0b0550 2021-11-15T20:36:57.705 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9800de60 con 0x7f0a9c0b0550 2021-11-15T20:36:57.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c1575d0 con 0x7f0a9c0b0550 2021-11-15T20:36:57.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9801e460 con 0x7f0a9c0b0550 2021-11-15T20:36:57.706 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.683+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c142bc0 con 0x7f0a9c0b0550 2021-11-15T20:36:57.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c141a30 con 0x7f0a9c0b0550 2021-11-15T20:36:57.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a98025030 con 0x7f0a9c0b0550 2021-11-15T20:36:57.707 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0a8effd700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0536a0 0x7f0a7c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0a9806ca20 con 0x7f0a9c0b0550 2021-11-15T20:36:57.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0aa1e2b700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0536a0 0x7f0a7c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.708 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0aa1e2b700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0536a0 0x7f0a7c055b60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f0a9c0620e0 tx=0x7f0a900077f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.709 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.687+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a98043d50 con 0x7f0a9c0b0550 2021-11-15T20:36:57.775 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.771+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a9c1567d0 con 0x7f0a7c0536a0 2021-11-15T20:36:57.777 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.771+0000 7f0a8effd700 1 -- 172.21.2.137:0/2999585619 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0a9c1567d0 con 0x7f0a7c0536a0 2021-11-15T20:36:57.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0536a0 msgr2=0x7f0a7c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0536a0 0x7f0a7c055b60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f0a9c0620e0 tx=0x7f0a900077f0).stop 2021-11-15T20:36:57.779 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 msgr2=0x7f0a9c141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c141d10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f0a98002f70 tx=0x7f0a98015000).stop 2021-11-15T20:36:57.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 shutdown_connections 2021-11-15T20:36:57.780 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0a7c0536a0 0x7f0a7c055b60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0a9c14aaa0 0x7f0a9c142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0a9c0b0550 0x7f0a9c141d10 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.781 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 --2- 172.21.2.137:0/2999585619 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0a9c05c770 0x7f0a9c066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 >> 172.21.2.137:0/2999585619 conn(0x7f0a9c0631e0 msgr2=0x7f0a9c05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 shutdown_connections 2021-11-15T20:36:57.782 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.775+0000 7f0aa408f700 1 -- 172.21.2.137:0/2999585619 wait complete. 2021-11-15T20:36:57.783 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 5 to deep-scrub 2021-11-15T20:36:57.785 INFO:tasks.ceph:Scrubbing osd.6 2021-11-15T20:36:57.786 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 Processor -- start 2021-11-15T20:36:57.839 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- start start 2021-11-15T20:36:57.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f15fc0b0830 0x7f15fc0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.843 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7f15fc0b10b0 0x7f15fc0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15fc147f70 con 0x7f15fc05fd20 2021-11-15T20:36:57.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15fc060100 con 0x7f15fc0b10b0 2021-11-15T20:36:57.844 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15fc147cd0 con 0x7f15fc0b0830 2021-11-15T20:36:57.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7f15fc05fd20 0x7f15fc0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60806/0 (socket says 172.21.2.137:60806) 2021-11-15T20:36:57.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1600d36700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f15fc0b0830 0x7f15fc0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 -- 172.21.2.137:0/1212660854 learned_addr learned my addr 172.21.2.137:0/1212660854 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:57.845 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1600d36700 1 -- 172.21.2.137:0/1212660854 >> v2:172.21.2.111:3300/0 conn(0x7f15fc0b10b0 msgr2=0x7f15fc0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1600d36700 1 --2- 172.21.2.137:0/1212660854 >> v2:172.21.2.111:3300/0 conn(0x7f15fc0b10b0 0x7f15fc0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1600d36700 1 -- 172.21.2.137:0/1212660854 >> v1:172.21.2.137:6789/0 conn(0x7f15fc05fd20 legacy=0x7f15fc0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.846 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1600d36700 1 -- 172.21.2.137:0/1212660854 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0a9ed0 con 0x7f15fc0b0830 2021-11-15T20:36:57.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1600d36700 1 --2- 172.21.2.137:0/1212660854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc0b0830 0x7f15fc0af800 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f15f8002f70 tx=0x7f15f8006df0).ready entity=mon.1 client_cookie=129f10a647805862 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f15effff700 1 -- 172.21.2.137:0/1212660854 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15f800d5c0 con 0x7f15fc0b0830 2021-11-15T20:36:57.847 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f15effff700 1 -- 172.21.2.137:0/1212660854 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8000e90 con 0x7f15fc0b0830 2021-11-15T20:36:57.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f15effff700 1 -- 172.21.2.137:0/1212660854 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15f800d910 con 0x7f15fc0b0830 2021-11-15T20:36:57.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- 172.21.2.137:0/1212660854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc0b0830 msgr2=0x7f15fc0af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.848 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- 172.21.2.137:0/1212660854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc0b0830 0x7f15fc0af800 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f15f8002f70 tx=0x7f15f8006df0).stop 2021-11-15T20:36:57.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- 172.21.2.137:0/1212660854 shutdown_connections 2021-11-15T20:36:57.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- 172.21.2.137:0/1212660854 >> v2:172.21.2.111:3300/0 conn(0x7f15fc0b10b0 0x7f15fc0aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.849 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- 172.21.2.137:0/1212660854 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc0b0830 0x7f15fc0af800 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- 172.21.2.137:0/1212660854 >> 172.21.2.137:0/1212660854 conn(0x7f15fc0b4e60 msgr2=0x7f15fc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- 172.21.2.137:0/1212660854 shutdown_connections 2021-11-15T20:36:57.850 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- 172.21.2.137:0/1212660854 wait complete. 2021-11-15T20:36:57.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 Processor -- start 2021-11-15T20:36:57.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- start start 2021-11-15T20:36:57.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc05fd20 0x7f15fc067040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.851 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f15fc0b0830 0x7f15fc0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f15fc0b10b0 0x7f15fc0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc140a00 con 0x7f15fc0b10b0 2021-11-15T20:36:57.852 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc064900 con 0x7f15fc05fd20 2021-11-15T20:36:57.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f160379b700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc0ad100 con 0x7f15fc0b0830 2021-11-15T20:36:57.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc05fd20 0x7f15fc067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.853 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc05fd20 0x7f15fc067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42030/0 (socket says 172.21.2.137:42030) 2021-11-15T20:36:57.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 -- 172.21.2.137:0/1120873801 learned_addr learned my addr 172.21.2.137:0/1120873801 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.854 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 -- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f15fc0b0830 msgr2=0x7f15fc0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f15fc0b0830 0x7f15fc0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 -- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f15fc0b10b0 msgr2=0x7f15fc0af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.855 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f15fc0b10b0 0x7f15fc0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.835+0000 7f1601537700 1 -- 172.21.2.137:0/1120873801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f800b180 con 0x7f15fc05fd20 2021-11-15T20:36:57.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f1601537700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc05fd20 0x7f15fc067040 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f15fc0b4db0 tx=0x7f15f0007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.856 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15f000ce30 con 0x7f15fc05fd20 2021-11-15T20:36:57.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f00072e0 con 0x7f15fc05fd20 2021-11-15T20:36:57.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc0ad3a0 con 0x7f15fc05fd20 2021-11-15T20:36:57.857 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15f0005800 con 0x7f15fc05fd20 2021-11-15T20:36:57.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc064580 con 0x7f15fc05fd20 2021-11-15T20:36:57.858 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15fc0ad530 con 0x7f15fc05fd20 2021-11-15T20:36:57.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f15f0010070 con 0x7f15fc05fd20 2021-11-15T20:36:57.860 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f15dc053600 0x7f15dc055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f15f006ad00 con 0x7f15fc05fd20 2021-11-15T20:36:57.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f15dc059d80 0x7f15dc05c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.861 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 --> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15dc05c800 con 0x7f15dc059d80 2021-11-15T20:36:57.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f006d310 con 0x7f15fc05fd20 2021-11-15T20:36:57.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f1600d36700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f15dc053600 0x7f15dc055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f1601d38700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f15dc059d80 0x7f15dc05c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.862 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f1600d36700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f15dc053600 0x7f15dc055ac0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f15f8002f70 tx=0x7f15f8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.839+0000 7f1601d38700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f15dc059d80 0x7f15dc05c1a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.843+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== osd.6 v2:172.21.2.111:6816/14923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f15dc05c800 con 0x7f15dc059d80 2021-11-15T20:36:57.863 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 --> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15fc0677d0 con 0x7f15dc059d80 2021-11-15T20:36:57.864 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f15ee7fc700 1 -- 172.21.2.137:0/1120873801 <== osd.6 v2:172.21.2.111:6816/14923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f15fc0677d0 con 0x7f15dc059d80 2021-11-15T20:36:57.864 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:57.865 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:57.865 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:57.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f15dc059d80 msgr2=0x7f15dc05c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6816/14923,v1:172.21.2.111:6817/14923] conn(0x7f15dc059d80 0x7f15dc05c1a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.867 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f15dc053600 msgr2=0x7f15dc055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f15dc053600 0x7f15dc055ac0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f15f8002f70 tx=0x7f15f8014000).stop 2021-11-15T20:36:57.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc05fd20 msgr2=0x7f15fc067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.868 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 --2- 172.21.2.137:0/1120873801 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f15fc05fd20 0x7f15fc067040 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f15fc0b4db0 tx=0x7f15f0007c40).stop 2021-11-15T20:36:57.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f1601d38700 1 -- 172.21.2.137:0/1120873801 reap_dead start 2021-11-15T20:36:57.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 shutdown_connections 2021-11-15T20:36:57.869 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 >> 172.21.2.137:0/1120873801 conn(0x7f15fc0b4e60 msgr2=0x7f15fc0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 shutdown_connections 2021-11-15T20:36:57.870 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.851+0000 7f160379b700 1 -- 172.21.2.137:0/1120873801 wait complete. 2021-11-15T20:36:57.871 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-11-15T20:36:57.922 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 Processor -- start 2021-11-15T20:36:57.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 -- start start 2021-11-15T20:36:57.923 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da00b0550 0x7f0da014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0da014aaa0 0x7f0da0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da005cb50 con 0x7f0da005c770 2021-11-15T20:36:57.924 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00b1650 con 0x7f0da014aaa0 2021-11-15T20:36:57.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da83da700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00ad030 con 0x7f0da00b0550 2021-11-15T20:36:57.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0da014aaa0 0x7f0da0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.925 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f0da014aaa0 0x7f0da0140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42044/0 (socket says 172.21.2.137:42044) 2021-11-15T20:36:57.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 -- 172.21.2.137:0/3265147054 learned_addr learned my addr 172.21.2.137:0/3265147054 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 -- 172.21.2.137:0/3265147054 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da00b0550 msgr2=0x7f0da014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.926 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 --2- 172.21.2.137:0/3265147054 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da00b0550 0x7f0da014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 -- 172.21.2.137:0/3265147054 >> v1:172.21.2.111:6789/0 conn(0x7f0da005c770 legacy=0x7f0da00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:57.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.915+0000 7f0da6977700 1 -- 172.21.2.137:0/3265147054 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00ad2d0 con 0x7f0da014aaa0 2021-11-15T20:36:57.927 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da6977700 1 --2- 172.21.2.137:0/3265147054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da014aaa0 0x7f0da0140aa0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f0da00adfd0 tx=0x7f0d98009290).ready entity=mon.1 client_cookie=590fba5c4aea9631 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.930 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5174700 1 -- 172.21.2.137:0/3265147054 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9800b860 con 0x7f0da014aaa0 2021-11-15T20:36:57.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5174700 1 -- 172.21.2.137:0/3265147054 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800b9c0 con 0x7f0da014aaa0 2021-11-15T20:36:57.931 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5174700 1 -- 172.21.2.137:0/3265147054 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9800bb70 con 0x7f0da014aaa0 2021-11-15T20:36:57.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/3265147054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da014aaa0 msgr2=0x7f0da0140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:57.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 --2- 172.21.2.137:0/3265147054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da014aaa0 0x7f0da0140aa0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f0da00adfd0 tx=0x7f0d98009290).stop 2021-11-15T20:36:57.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/3265147054 shutdown_connections 2021-11-15T20:36:57.932 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 --2- 172.21.2.137:0/3265147054 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da014aaa0 0x7f0da0140aa0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:57.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 --2- 172.21.2.137:0/3265147054 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da00b0550 0x7f0da014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/3265147054 >> 172.21.2.137:0/3265147054 conn(0x7f0da00631e0 msgr2=0x7f0da005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:57.933 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/3265147054 shutdown_connections 2021-11-15T20:36:57.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/3265147054 wait complete. 2021-11-15T20:36:57.934 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 Processor -- start 2021-11-15T20:36:57.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- start start 2021-11-15T20:36:57.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0da005c770 0x7f0da015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 0x7f0da013fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.935 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da014aaa0 0x7f0da0140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da015a640 con 0x7f0da005c770 2021-11-15T20:36:57.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da015ad60 con 0x7f0da00b0550 2021-11-15T20:36:57.936 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da015a880 con 0x7f0da014aaa0 2021-11-15T20:36:57.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 0x7f0da013fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 0x7f0da013fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42046/0 (socket says 172.21.2.137:42046) 2021-11-15T20:36:57.937 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 -- 172.21.2.137:0/897119289 learned_addr learned my addr 172.21.2.137:0/897119289 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:57.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 -- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da014aaa0 msgr2=0x7f0da0140370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da014aaa0 0x7f0da0140370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.938 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 -- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0da005c770 msgr2=0x7f0da015a150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:57.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0da005c770 0x7f0da015a150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:57.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 -- 172.21.2.137:0/897119289 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98009530 con 0x7f0da00b0550 2021-11-15T20:36:57.939 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da5975700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 0x7f0da013fe80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f0d90002f70 tx=0x7f0d90006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d90013460 con 0x7f0da00b0550 2021-11-15T20:36:57.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900135c0 con 0x7f0da00b0550 2021-11-15T20:36:57.940 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da0140860 con 0x7f0da00b0550 2021-11-15T20:36:57.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d90013920 con 0x7f0da00b0550 2021-11-15T20:36:57.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da0067480 con 0x7f0da00b0550 2021-11-15T20:36:57.941 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d9001a060 con 0x7f0da00b0550 2021-11-15T20:36:57.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da00ae7f0 con 0x7f0da00b0550 2021-11-15T20:36:57.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0d9f7fe700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d80053610 0x7f0d80055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:57.942 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.919+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0d9006b120 con 0x7f0da00b0550 2021-11-15T20:36:57.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.923+0000 7f0da6176700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d80053610 0x7f0d80055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:57.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.923+0000 7f0da6176700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d80053610 0x7f0d80055ad0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f0d94002ef0 tx=0x7f0d94006890).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:57.943 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:57.923+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d90042560 con 0x7f0da00b0550 2021-11-15T20:36:58.012 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.007+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0da00573d0 con 0x7f0d80053610 2021-11-15T20:36:58.013 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.007+0000 7f0d9f7fe700 1 -- 172.21.2.137:0/897119289 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0da00573d0 con 0x7f0d80053610 2021-11-15T20:36:58.015 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d80053610 msgr2=0x7f0d80055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d80053610 0x7f0d80055ad0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f0d94002ef0 tx=0x7f0d94006890).stop 2021-11-15T20:36:58.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 msgr2=0x7f0da013fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.016 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 0x7f0da013fe80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f0d90002f70 tx=0x7f0d90006ec0).stop 2021-11-15T20:36:58.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 shutdown_connections 2021-11-15T20:36:58.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f0d80053610 0x7f0d80055ad0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.017 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f0da014aaa0 0x7f0da0140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f0da00b0550 0x7f0da013fe80 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 --2- 172.21.2.137:0/897119289 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f0da005c770 0x7f0da015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.018 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 >> 172.21.2.137:0/897119289 conn(0x7f0da00631e0 msgr2=0x7f0da014a170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 shutdown_connections 2021-11-15T20:36:58.019 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.011+0000 7f0da83da700 1 -- 172.21.2.137:0/897119289 wait complete. 2021-11-15T20:36:58.020 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 6 to deep-scrub 2021-11-15T20:36:58.021 INFO:tasks.ceph:Scrubbing osd.7 2021-11-15T20:36:58.022 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-11-15T20:36:58.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 Processor -- start 2021-11-15T20:36:58.075 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- start start 2021-11-15T20:36:58.079 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7fe4e00aaa80 0x7fe4e00af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e0147f70 con 0x7fe4e00b0830 2021-11-15T20:36:58.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e0060100 con 0x7fe4e005fd20 2021-11-15T20:36:58.080 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e0147cd0 con 0x7fe4e00aaa80 2021-11-15T20:36:58.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e5c1c700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fe4e005fd20 0x7fe4e00b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60836/0 (socket says 172.21.2.137:60836) 2021-11-15T20:36:58.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e5c1c700 1 -- 172.21.2.137:0/3433523024 learned_addr learned my addr 172.21.2.137:0/3433523024 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:36:58.081 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e641d700 1 --2- 172.21.2.137:0/3433523024 >> v2:172.21.2.137:3300/0 conn(0x7fe4e00aaa80 0x7fe4e00af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e4c1a700 1 -- 172.21.2.137:0/3433523024 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800285016 0 0) 0x7fe4e0060100 con 0x7fe4e005fd20 2021-11-15T20:36:58.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e4c1a700 1 -- 172.21.2.137:0/3433523024 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c8003260 con 0x7fe4e005fd20 2021-11-15T20:36:58.082 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e641d700 1 -- 172.21.2.137:0/3433523024 >> v1:172.21.2.137:6789/0 conn(0x7fe4e005fd20 legacy=0x7fe4e00b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e641d700 1 -- 172.21.2.137:0/3433523024 >> v1:172.21.2.111:6789/0 conn(0x7fe4e00b0830 legacy=0x7fe4e00aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:58.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e641d700 1 -- 172.21.2.137:0/3433523024 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00a9ed0 con 0x7fe4e00aaa80 2021-11-15T20:36:58.083 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e641d700 1 --2- 172.21.2.137:0/3433523024 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e00aaa80 0x7fe4e00af800 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fe4e00b4db0 tx=0x7fe4d80091d0).ready entity=mon.1 client_cookie=ab5e75a0df822083 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e4c1a700 1 -- 172.21.2.137:0/3433523024 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d800b680 con 0x7fe4e00aaa80 2021-11-15T20:36:58.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e4c1a700 1 -- 172.21.2.137:0/3433523024 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800b7e0 con 0x7fe4e00aaa80 2021-11-15T20:36:58.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e4c1a700 1 -- 172.21.2.137:0/3433523024 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d800b950 con 0x7fe4e00aaa80 2021-11-15T20:36:58.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3433523024 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e00aaa80 msgr2=0x7fe4e00af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 --2- 172.21.2.137:0/3433523024 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e00aaa80 0x7fe4e00af800 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fe4e00b4db0 tx=0x7fe4d80091d0).stop 2021-11-15T20:36:58.085 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3433523024 shutdown_connections 2021-11-15T20:36:58.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 --2- 172.21.2.137:0/3433523024 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e00aaa80 0x7fe4e00af800 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3433523024 >> 172.21.2.137:0/3433523024 conn(0x7fe4e00b4e60 msgr2=0x7fe4e00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.086 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3433523024 shutdown_connections 2021-11-15T20:36:58.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3433523024 wait complete. 2021-11-15T20:36:58.087 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 Processor -- start 2021-11-15T20:36:58.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- start start 2021-11-15T20:36:58.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e005fd20 0x7fe4e00ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.088 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4e00aaa80 0x7fe4e0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4e00b0830 0x7fe4e014cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00ac8d0 con 0x7fe4e00aaa80 2021-11-15T20:36:58.089 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e015a130 con 0x7fe4e005fd20 2021-11-15T20:36:58.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e7e80700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e015a3d0 con 0x7fe4e00b0830 2021-11-15T20:36:58.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e5c1c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e005fd20 0x7fe4e00ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.090 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e5c1c700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e005fd20 0x7fe4e00ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42060/0 (socket says 172.21.2.137:42060) 2021-11-15T20:36:58.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.071+0000 7fe4e5c1c700 1 -- 172.21.2.137:0/3273511448 learned_addr learned my addr 172.21.2.137:0/3273511448 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:58.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e5c1c700 1 -- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4e00b0830 msgr2=0x7fe4e014cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.091 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e5c1c700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fe4e00b0830 0x7fe4e014cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e5c1c700 1 -- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4e00aaa80 msgr2=0x7fe4e0156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e5c1c700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fe4e00aaa80 0x7fe4e0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e5c1c700 1 -- 172.21.2.137:0/3273511448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009470 con 0x7fe4e005fd20 2021-11-15T20:36:58.092 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e5c1c700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e005fd20 0x7fe4e00ac2a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fe4d4001110 tx=0x7fe4d4007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d40072e0 con 0x7fe4e005fd20 2021-11-15T20:36:58.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4007440 con 0x7fe4e005fd20 2021-11-15T20:36:58.093 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d4005800 con 0x7fe4e005fd20 2021-11-15T20:36:58.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e0157050 con 0x7fe4e005fd20 2021-11-15T20:36:58.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e014d660 con 0x7fe4e005fd20 2021-11-15T20:36:58.094 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4e015a590 con 0x7fe4e005fd20 2021-11-15T20:36:58.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4d4010070 con 0x7fe4e005fd20 2021-11-15T20:36:58.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4c0053580 0x7fe4c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.096 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe4d406ada0 con 0x7fe4e005fd20 2021-11-15T20:36:58.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7fe4c0059d00 0x7fe4c005c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 --> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4c005c780 con 0x7fe4c0059d00 2021-11-15T20:36:58.097 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4d406d430 con 0x7fe4e005fd20 2021-11-15T20:36:58.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e541b700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4c0053580 0x7fe4c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e641d700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7fe4c0059d00 0x7fe4c005c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.098 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e641d700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7fe4c0059d00 0x7fe4c005c120 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.075+0000 7fe4e541b700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4c0053580 0x7fe4c0055a40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fe4dc002ef0 tx=0x7fe4dc006910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.099 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.079+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== osd.7 v2:172.21.2.111:6824/14924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fe4c005c780 con 0x7fe4c0059d00 2021-11-15T20:36:58.101 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.095+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 --> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe4e01479f0 con 0x7fe4c0059d00 2021-11-15T20:36:58.102 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.095+0000 7fe4d2ffd700 1 -- 172.21.2.137:0/3273511448 <== osd.7 v2:172.21.2.111:6824/14924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe4e01479f0 con 0x7fe4c0059d00 2021-11-15T20:36:58.103 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-11-15T20:36:58.103 INFO:teuthology.orchestra.run.gibba037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T20:36:58.103 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-11-15T20:36:58.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7fe4c0059d00 msgr2=0x7fe4c005c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6824/14924,v1:172.21.2.111:6825/14924] conn(0x7fe4c0059d00 0x7fe4c005c120 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.105 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4c0053580 msgr2=0x7fe4c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fe4c0053580 0x7fe4c0055a40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fe4dc002ef0 tx=0x7fe4dc006910).stop 2021-11-15T20:36:58.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e005fd20 msgr2=0x7fe4e00ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.106 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 --2- 172.21.2.137:0/3273511448 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fe4e005fd20 0x7fe4e00ac2a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fe4d4001110 tx=0x7fe4d4007ad0).stop 2021-11-15T20:36:58.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e641d700 1 -- 172.21.2.137:0/3273511448 reap_dead start 2021-11-15T20:36:58.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 shutdown_connections 2021-11-15T20:36:58.107 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 >> 172.21.2.137:0/3273511448 conn(0x7fe4e00b4e60 msgr2=0x7fe4e0144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 shutdown_connections 2021-11-15T20:36:58.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.099+0000 7fe4e7e80700 1 -- 172.21.2.137:0/3273511448 wait complete. 2021-11-15T20:36:58.109 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-11-15T20:36:58.161 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 Processor -- start 2021-11-15T20:36:58.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 -- start start 2021-11-15T20:36:58.162 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7facf40b0fe0 0x7facf40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf40aedf0 con 0x7facf40acff0 2021-11-15T20:36:58.163 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 -- --> v2:172.21.2.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf40ad4a0 con 0x7facf40b0fe0 2021-11-15T20:36:58.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf95c3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40ae070 con 0x7facf413f5c0 2021-11-15T20:36:58.167 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf2ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7facf40b0fe0 0x7facf40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf413fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3301/0 says I am v2:172.21.2.137:43644/0 (socket says 172.21.2.137:43644) 2021-11-15T20:36:58.168 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf2ffd700 1 --2- >> v2:172.21.2.111:3300/0 conn(0x7facf40b0fe0 0x7facf40afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.111:3300/0 says I am v2:172.21.2.137:49300/0 (socket says 172.21.2.137:49300) 2021-11-15T20:36:58.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 -- 172.21.2.137:0/1342925082 learned_addr learned my addr 172.21.2.137:0/1342925082 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:58.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 -- 172.21.2.137:0/1342925082 >> v2:172.21.2.111:3300/0 conn(0x7facf40b0fe0 msgr2=0x7facf40afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:58.169 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 --2- 172.21.2.137:0/1342925082 >> v2:172.21.2.111:3300/0 conn(0x7facf40b0fe0 0x7facf40afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 -- 172.21.2.137:0/1342925082 >> v1:172.21.2.111:6789/0 conn(0x7facf40acff0 legacy=0x7facf40af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 -- 172.21.2.137:0/1342925082 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40afbd0 con 0x7facf413f5c0 2021-11-15T20:36:58.170 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.155+0000 7facf37fe700 1 --2- 172.21.2.137:0/1342925082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf413fa30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7face4002f70 tx=0x7face4006d70).ready entity=mon.2 client_cookie=2f0b71a074a526 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf1ffb700 1 -- 172.21.2.137:0/1342925082 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face4012070 con 0x7facf413f5c0 2021-11-15T20:36:58.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf1ffb700 1 -- 172.21.2.137:0/1342925082 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4000e90 con 0x7facf413f5c0 2021-11-15T20:36:58.171 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf1ffb700 1 -- 172.21.2.137:0/1342925082 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face400fc00 con 0x7facf413f5c0 2021-11-15T20:36:58.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/1342925082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 msgr2=0x7facf413fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 --2- 172.21.2.137:0/1342925082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf413fa30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7face4002f70 tx=0x7face4006d70).stop 2021-11-15T20:36:58.172 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/1342925082 shutdown_connections 2021-11-15T20:36:58.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 --2- 172.21.2.137:0/1342925082 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf413fa30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 --2- 172.21.2.137:0/1342925082 >> v2:172.21.2.111:3300/0 conn(0x7facf40b0fe0 0x7facf40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.173 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/1342925082 >> 172.21.2.137:0/1342925082 conn(0x7facf40b5f50 msgr2=0x7facf40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/1342925082 shutdown_connections 2021-11-15T20:36:58.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/1342925082 wait complete. 2021-11-15T20:36:58.174 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 Processor -- start 2021-11-15T20:36:58.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- start start 2021-11-15T20:36:58.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 0x7facf405fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.175 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facf40b0fe0 0x7facf414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf4064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4065150 con 0x7facf40b0fe0 2021-11-15T20:36:58.176 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4151380 con 0x7facf40acff0 2021-11-15T20:36:58.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf4060250 con 0x7facf413f5c0 2021-11-15T20:36:58.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 0x7facf405fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf2ffd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 0x7facf405fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42076/0 (socket says 172.21.2.137:42076) 2021-11-15T20:36:58.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf2ffd700 1 -- 172.21.2.137:0/3629090405 learned_addr learned my addr 172.21.2.137:0/3629090405 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:58.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf4064920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf27fc700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facf40b0fe0 0x7facf414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 -- 172.21.2.137:0/3629090405 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 msgr2=0x7facf405fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 0x7facf405fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 -- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facf40b0fe0 msgr2=0x7facf414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facf40b0fe0 0x7facf414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 -- 172.21.2.137:0/3629090405 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face400d660 con 0x7facf413f5c0 2021-11-15T20:36:58.180 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf2ffd700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 0x7facf405fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T20:36:58.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf37fe700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf4064920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7face4002f70 tx=0x7face401a000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mon.2 v2:172.21.2.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face4009080 con 0x7facf413f5c0 2021-11-15T20:36:58.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mon.2 v2:172.21.2.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face40068b0 con 0x7facf413f5c0 2021-11-15T20:36:58.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf414e120 con 0x7facf413f5c0 2021-11-15T20:36:58.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf4151820 con 0x7facf413f5c0 2021-11-15T20:36:58.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mon.2 v2:172.21.2.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face4016d40 con 0x7facf413f5c0 2021-11-15T20:36:58.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4151190 con 0x7facf413f5c0 2021-11-15T20:36:58.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.159+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mon.2 v2:172.21.2.111:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7face402c460 con 0x7facf413f5c0 2021-11-15T20:36:58.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.163+0000 7face3fff700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facd00536f0 0x7facd0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.163+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mon.2 v2:172.21.2.111:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7face4071370 con 0x7facf413f5c0 2021-11-15T20:36:58.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.163+0000 7facf2ffd700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facd00536f0 0x7facd0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.163+0000 7facf2ffd700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facd00536f0 0x7facd0055bb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7face800b000 tx=0x7face8006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.167+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mon.2 v2:172.21.2.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7face4048640 con 0x7facf413f5c0 2021-11-15T20:36:58.254 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.247+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7facf4151580 con 0x7facd00536f0 2021-11-15T20:36:58.255 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7face3fff700 1 -- 172.21.2.137:0/3629090405 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7face8011b80 con 0x7facd00536f0 2021-11-15T20:36:58.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facd00536f0 msgr2=0x7facd0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.257 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facd00536f0 0x7facd0055bb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7face800b000 tx=0x7face8006df0).stop 2021-11-15T20:36:58.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 msgr2=0x7facf4064920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf4064920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7face4002f70 tx=0x7face401a000).stop 2021-11-15T20:36:58.258 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 shutdown_connections 2021-11-15T20:36:58.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7facd00536f0 0x7facd0055bb0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7facf413f5c0 0x7facf4064920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.259 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7facf40b0fe0 0x7facf414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 --2- 172.21.2.137:0/3629090405 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7facf40acff0 0x7facf405fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 >> 172.21.2.137:0/3629090405 conn(0x7facf40b5f50 msgr2=0x7facf40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.260 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 shutdown_connections 2021-11-15T20:36:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.251+0000 7facf95c3700 1 -- 172.21.2.137:0/3629090405 wait complete. 2021-11-15T20:36:58.261 INFO:teuthology.orchestra.run.gibba037.stderr:instructed osd(s) 7 to deep-scrub 2021-11-15T20:36:58.263 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T20:36:58.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 Processor -- start 2021-11-15T20:36:58.314 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 -- start start 2021-11-15T20:36:58.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 0x7ffad0142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.316 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffad00b6830 0x7ffad01433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00b63b0 con 0x7ffad00b5fd0 2021-11-15T20:36:58.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad0147070 con 0x7ffad00b6830 2021-11-15T20:36:58.317 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.307+0000 7ffad67ea700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0146dd0 con 0x7ffad013ce00 2021-11-15T20:36:58.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffad00b6830 0x7ffad01433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7ffad00b6830 0x7ffad01433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42088/0 (socket says 172.21.2.137:42088) 2021-11-15T20:36:58.318 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 -- 172.21.2.137:0/2605479925 learned_addr learned my addr 172.21.2.137:0/2605479925 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:58.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 -- 172.21.2.137:0/2605479925 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 msgr2=0x7ffad0142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:58.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 --2- 172.21.2.137:0/2605479925 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 0x7ffad0142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.319 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 -- 172.21.2.137:0/2605479925 >> v1:172.21.2.111:6789/0 conn(0x7ffad00b5fd0 legacy=0x7ffad013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:36:58.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 -- 172.21.2.137:0/2605479925 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0146af0 con 0x7ffad00b6830 2021-11-15T20:36:58.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad4d87700 1 --2- 172.21.2.137:0/2605479925 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad01433c0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7ffad013d200 tx=0x7ffac8009290).ready entity=mon.1 client_cookie=b4aa31e650be26a3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.320 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffaceffd700 1 -- 172.21.2.137:0/2605479925 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac800b860 con 0x7ffad00b6830 2021-11-15T20:36:58.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffaceffd700 1 -- 172.21.2.137:0/2605479925 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800b9c0 con 0x7ffad00b6830 2021-11-15T20:36:58.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffaceffd700 1 -- 172.21.2.137:0/2605479925 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac800bb70 con 0x7ffad00b6830 2021-11-15T20:36:58.321 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/2605479925 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 msgr2=0x7ffad01433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 --2- 172.21.2.137:0/2605479925 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad01433c0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7ffad013d200 tx=0x7ffac8009290).stop 2021-11-15T20:36:58.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/2605479925 shutdown_connections 2021-11-15T20:36:58.322 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 --2- 172.21.2.137:0/2605479925 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad01433c0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 --2- 172.21.2.137:0/2605479925 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 0x7ffad0142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/2605479925 >> 172.21.2.137:0/2605479925 conn(0x7ffad00624b0 msgr2=0x7ffad0062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.323 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/2605479925 shutdown_connections 2021-11-15T20:36:58.324 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/2605479925 wait complete. 2021-11-15T20:36:58.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 Processor -- start 2021-11-15T20:36:58.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- start start 2021-11-15T20:36:58.326 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad00b5fd0 0x7ffad013b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad0155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 0x7ffad0140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.327 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad013d770 con 0x7ffad00b5fd0 2021-11-15T20:36:58.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad013da10 con 0x7ffad00b6830 2021-11-15T20:36:58.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0140880 con 0x7ffad013ce00 2021-11-15T20:36:58.328 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad0155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad0155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42092/0 (socket says 172.21.2.137:42092) 2021-11-15T20:36:58.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 -- 172.21.2.137:0/1960821696 learned_addr learned my addr 172.21.2.137:0/1960821696 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:36:58.329 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 -- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 msgr2=0x7ffad0140d20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:58.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 0x7ffad0140d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.330 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 -- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad00b5fd0 msgr2=0x7ffad013b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T20:36:58.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad00b5fd0 0x7ffad013b7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 -- 172.21.2.137:0/1960821696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8009530 con 0x7ffad00b6830 2021-11-15T20:36:58.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacf7fe700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad0155b90 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7ffac0002f70 tx=0x7ffac0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.331 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac0013460 con 0x7ffad00b6830 2021-11-15T20:36:58.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac00135c0 con 0x7ffad00b6830 2021-11-15T20:36:58.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad013f270 con 0x7ffad00b6830 2021-11-15T20:36:58.332 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac0013920 con 0x7ffad00b6830 2021-11-15T20:36:58.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad013e2b0 con 0x7ffad00b6830 2021-11-15T20:36:58.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00afff0 con 0x7ffad00b6830 2021-11-15T20:36:58.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.311+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffac001a060 con 0x7ffad00b6830 2021-11-15T20:36:58.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.315+0000 7ffacd7fa700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab40536a0 0x7ffab4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:36:58.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.315+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ffac006b070 con 0x7ffad00b6830 2021-11-15T20:36:58.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.315+0000 7ffacffff700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab40536a0 0x7ffab4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:36:58.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.315+0000 7ffacffff700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab40536a0 0x7ffab4055b60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7ffab8002f40 tx=0x7ffab8006880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:36:58.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.315+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffac00424b0 con 0x7ffad00b6830 2021-11-15T20:36:58.401 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.395+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffad00573d0 con 0x7ffab40536a0 2021-11-15T20:36:58.412 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffacd7fa700 1 -- 172.21.2.137:0/1960821696 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66522 (secure 0 0 0) 0x7ffad00573d0 con 0x7ffab40536a0 2021-11-15T20:36:58.414 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T20:36:58.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab40536a0 msgr2=0x7ffab4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.415 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab40536a0 0x7ffab4055b60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7ffab8002f40 tx=0x7ffab8006880).stop 2021-11-15T20:36:58.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 msgr2=0x7ffad0155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:36:58.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad0155b90 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7ffac0002f70 tx=0x7ffac0006ec0).stop 2021-11-15T20:36:58.416 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 shutdown_connections 2021-11-15T20:36:58.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7ffab40536a0 0x7ffab4055b60 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7ffad013ce00 0x7ffad0140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7ffad00b6830 0x7ffad0155b90 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:36:58.417 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 --2- 172.21.2.137:0/1960821696 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7ffad00b5fd0 0x7ffad013b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:36:58.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 >> 172.21.2.137:0/1960821696 conn(0x7ffad00624b0 msgr2=0x7ffad013c670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:36:58.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 shutdown_connections 2021-11-15T20:36:58.418 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:36:58.407+0000 7ffad67ea700 1 -- 172.21.2.137:0/1960821696 wait complete. 2021-11-15T20:36:58.419 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-11-15T20:36:58.420 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":2253,"stamp":"2021-11-15T20:36:57.272338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":704299008,"kb_used":6103484,"kb_used_data":698195524,"kb_used_omap":27887,"kb_used_meta":0,"kb_avail":698195524,"statfs":{"total":721202184192,"available":714952216576,"internally_reserved":0,"allocated":714952216576,"data_stored":714952216576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28556886,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004939"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":139,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.362586+0000","last_change":"2021-11-15T19:26:47.204497+0000","last_active":"2021-11-15T19:36:23.362586+0000","last_peered":"2021-11-15T19:36:23.362586+0000","last_clean":"2021-11-15T19:36:23.362586+0000","last_became_active":"2021-11-15T19:26:47.204269+0000","last_became_peered":"2021-11-15T19:26:47.204269+0000","last_unstale":"2021-11-15T19:36:23.362586+0000","last_undegraded":"2021-11-15T19:36:23.362586+0000","last_fullsized":"2021-11-15T19:36:23.362586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:44.160636+0000","last_clean_scrub_stamp":"2021-11-15T19:26:44.160636+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.213787+0000","last_change":"2021-11-15T19:26:52.880420+0000","last_active":"2021-11-15T19:36:23.213787+0000","last_peered":"2021-11-15T19:36:23.213787+0000","last_clean":"2021-11-15T19:36:23.213787+0000","last_became_active":"2021-11-15T19:26:52.880242+0000","last_became_peered":"2021-11-15T19:26:52.880242+0000","last_unstale":"2021-11-15T19:36:23.213787+0000","last_undegraded":"2021-11-15T19:36:23.213787+0000","last_fullsized":"2021-11-15T19:36:23.213787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.362559+0000","last_change":"2021-11-15T19:26:52.880490+0000","last_active":"2021-11-15T19:36:23.362559+0000","last_peered":"2021-11-15T19:36:23.362559+0000","last_clean":"2021-11-15T19:36:23.362559+0000","last_became_active":"2021-11-15T19:26:52.880321+0000","last_became_peered":"2021-11-15T19:26:52.880321+0000","last_unstale":"2021-11-15T19:36:23.362559+0000","last_undegraded":"2021-11-15T19:36:23.362559+0000","last_fullsized":"2021-11-15T19:36:23.362559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.492598+0000","last_change":"2021-11-15T19:26:53.132775+0000","last_active":"2021-11-15T19:36:23.492598+0000","last_peered":"2021-11-15T19:36:23.492598+0000","last_clean":"2021-11-15T19:36:23.492598+0000","last_became_active":"2021-11-15T19:26:53.132568+0000","last_became_peered":"2021-11-15T19:26:53.132568+0000","last_unstale":"2021-11-15T19:36:23.492598+0000","last_undegraded":"2021-11-15T19:36:23.492598+0000","last_fullsized":"2021-11-15T19:36:23.492598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":143,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.213779+0000","last_change":"2021-11-15T19:26:52.880321+0000","last_active":"2021-11-15T19:36:23.213779+0000","last_peered":"2021-11-15T19:36:23.213779+0000","last_clean":"2021-11-15T19:36:23.213779+0000","last_became_active":"2021-11-15T19:26:52.880159+0000","last_became_peered":"2021-11-15T19:26:52.880159+0000","last_unstale":"2021-11-15T19:36:23.213779+0000","last_undegraded":"2021-11-15T19:36:23.213779+0000","last_fullsized":"2021-11-15T19:36:23.213779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.356073+0000","last_change":"2021-11-15T19:26:52.876890+0000","last_active":"2021-11-15T19:36:23.356073+0000","last_peered":"2021-11-15T19:36:23.356073+0000","last_clean":"2021-11-15T19:36:23.356073+0000","last_became_active":"2021-11-15T19:26:52.876703+0000","last_became_peered":"2021-11-15T19:26:52.876703+0000","last_unstale":"2021-11-15T19:36:23.356073+0000","last_undegraded":"2021-11-15T19:36:23.356073+0000","last_fullsized":"2021-11-15T19:36:23.356073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.362717+0000","last_change":"2021-11-15T19:26:52.878547+0000","last_active":"2021-11-15T19:36:23.362717+0000","last_peered":"2021-11-15T19:36:23.362717+0000","last_clean":"2021-11-15T19:36:23.362717+0000","last_became_active":"2021-11-15T19:26:52.878380+0000","last_became_peered":"2021-11-15T19:26:52.878380+0000","last_unstale":"2021-11-15T19:36:23.362717+0000","last_undegraded":"2021-11-15T19:36:23.362717+0000","last_fullsized":"2021-11-15T19:36:23.362717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.356338+0000","last_change":"2021-11-15T19:26:52.876645+0000","last_active":"2021-11-15T19:36:23.356338+0000","last_peered":"2021-11-15T19:36:23.356338+0000","last_clean":"2021-11-15T19:36:23.356338+0000","last_became_active":"2021-11-15T19:26:52.876454+0000","last_became_peered":"2021-11-15T19:26:52.876454+0000","last_unstale":"2021-11-15T19:36:23.356338+0000","last_undegraded":"2021-11-15T19:36:23.356338+0000","last_fullsized":"2021-11-15T19:36:23.356338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":135,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-11-15T19:36:23.363081+0000","last_change":"2021-11-15T19:26:52.879038+0000","last_active":"2021-11-15T19:36:23.363081+0000","last_peered":"2021-11-15T19:36:23.363081+0000","last_clean":"2021-11-15T19:36:23.363081+0000","last_became_active":"2021-11-15T19:26:52.878904+0000","last_became_peered":"2021-11-15T19:26:52.878904+0000","last_unstale":"2021-11-15T19:36:23.363081+0000","last_undegraded":"2021-11-15T19:36:23.363081+0000","last_fullsized":"2021-11-15T19:36:23.363081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T19:26:51.860300+0000","last_clean_scrub_stamp":"2021-11-15T19:26:51.860300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575693,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3647,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3734984,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2509999999999999,"15min":1.232},"min":{"1min":1.105,"5min":0.48999999999999999,"15min":0.36899999999999999},"max":{"1min":1.6850000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.125},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2150000000000001,"15min":1.198},"min":{"1min":0.75800000000000001,"5min":0.44700000000000001,"15min":0.38800000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.794},"last":1.147}]},{"osd":1,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.331,"15min":1.288},"min":{"1min":0.78200000000000003,"5min":0.50600000000000001,"15min":0.42699999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.298,"15min":1.2689999999999999},"min":{"1min":0.84999999999999998,"5min":0.46300000000000002,"15min":0.42099999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.849},"last":1.21}]},{"osd":2,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.173,"15min":1.1799999999999999},"min":{"1min":0.88400000000000001,"5min":0.54000000000000004,"15min":0.39800000000000002},"max":{"1min":1.4550000000000001,"5min":1.5920000000000001,"15min":1.7210000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.2929999999999999,"15min":1.2529999999999999},"min":{"1min":0.82399999999999995,"5min":0.51500000000000001,"15min":0.38400000000000001},"max":{"1min":1.639,"5min":1.673,"15min":1.766},"last":1.1639999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.2949999999999999,"15min":1.2549999999999999},"min":{"1min":0.97999999999999998,"5min":0.55500000000000005,"15min":0.41399999999999998},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.111},{"interface":"front","average":{"1min":1.337,"5min":1.3160000000000001,"15min":1.2969999999999999},"min":{"1min":1.0309999999999999,"5min":0.52500000000000002,"15min":0.40600000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.2350000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.54800000000000004,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.28,"5min":1.321,"15min":1.6890000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.875,"15min":0.85899999999999999},"min":{"1min":0.57299999999999995,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":1.1240000000000001,"5min":1.252,"15min":1.3939999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89400000000000002,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.24199999999999999,"15min":0.17899999999999999},"max":{"1min":1.514,"5min":1.548,"15min":1.645},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.91600000000000004},"min":{"1min":0.63600000000000001,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":1.3540000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0840000000000001}]},{"osd":6,"last update":"Mon Nov 15 20:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0149999999999999,"15min":1.008},"min":{"1min":0.70899999999999996,"5min":0.30299999999999999,"15min":0.20899999999999999},"max":{"1min":1.466,"5min":1.5269999999999999,"15min":1.639},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.048,"15min":1.0169999999999999},"min":{"1min":0.72999999999999998,"5min":0.248,"15min":0.20399999999999999},"max":{"1min":1.403,"5min":1.6870000000000001,"15min":1.7010000000000001},"last":0.96999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575692,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":4048,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4145700,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.282,"15min":1.2390000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.27600000000000002},"max":{"1min":1.7170000000000001,"5min":1.76,"15min":1.76},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.266,"15min":1.232},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.315},"max":{"1min":1.655,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2310000000000001}]},{"osd":1,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.24,"15min":1.1890000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.32600000000000001},"max":{"1min":1.399,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.173},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2689999999999999,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.252},"max":{"1min":1.587,"5min":1.677,"15min":1.722},"last":1.3959999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3460000000000001,"15min":1.2949999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.246},"max":{"1min":1.7250000000000001,"5min":2.012,"15min":2.012},"last":1.369},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.28,"15min":1.228},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.28999999999999998},"max":{"1min":1.6830000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.319}]},{"osd":3,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3660000000000001,"15min":1.302},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.28599999999999998},"max":{"1min":1.6850000000000001,"5min":1.867,"15min":1.867},"last":1.292},{"interface":"front","average":{"1min":1.252,"5min":1.3140000000000001,"15min":1.284},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.34799999999999998},"max":{"1min":1.512,"5min":1.7509999999999999,"15min":1.8540000000000001},"last":1.2669999999999999}]},{"osd":4,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.87,"15min":0.88800000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.21199999999999999},"max":{"1min":1.224,"5min":1.323,"15min":1.579},"last":1.079},{"interface":"front","average":{"1min":0.87,"5min":0.92900000000000005,"15min":0.91500000000000004},"min":{"1min":0.254,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":1.143,"5min":1.581,"15min":1.831},"last":0.747}]},{"osd":5,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.27800000000000002,"5min":0.252,"15min":0.20499999999999999},"max":{"1min":1.389,"5min":1.421,"15min":1.714},"last":1.125},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.88800000000000001},"min":{"1min":0.26300000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.55,"5min":1.55,"15min":1.7769999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Nov 15 20:36:04 2021","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.373,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":1.3080000000000001,"5min":1.4870000000000001,"15min":1.696},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0429999999999999,"15min":1.028},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.252},"max":{"1min":1.2789999999999999,"5min":1.554,"15min":1.78},"last":0.98899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575693,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":2734,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2799957,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.248,"15min":1.24},"min":{"1min":0.77300000000000002,"5min":0.47999999999999998,"15min":0.26600000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.335},{"interface":"front","average":{"1min":1.228,"5min":1.2669999999999999,"15min":1.268},"min":{"1min":0.84899999999999998,"5min":0.55900000000000005,"15min":0.32700000000000001},"max":{"1min":1.5489999999999999,"5min":1.746,"15min":1.7929999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.96799999999999997,"5min":0.51700000000000002,"15min":0.31},"max":{"1min":1.5820000000000001,"5min":1.603,"15min":1.7609999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.99199999999999999,"5min":0.42599999999999999,"15min":0.317},"max":{"1min":1.7170000000000001,"5min":1.742,"15min":1.8300000000000001},"last":1.2989999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2689999999999999,"15min":1.2350000000000001},"min":{"1min":1.0720000000000001,"5min":0.41799999999999998,"15min":0.33700000000000002},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.2150000000000001,"15min":1.2},"min":{"1min":0.69899999999999995,"5min":0.49099999999999999,"15min":0.22500000000000001},"max":{"1min":1.615,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.266}]},{"osd":3,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3029999999999999,"15min":1.258},"min":{"1min":1.0269999999999999,"5min":0.54900000000000004,"15min":0.28299999999999997},"max":{"1min":1.3919999999999999,"5min":1.706,"15min":1.7090000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.82099999999999995,"5min":0.435,"15min":0.26100000000000001},"max":{"1min":1.4370000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0620000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.84599999999999997,"15min":0.83899999999999997},"min":{"1min":0.41699999999999998,"5min":0.23699999999999999,"15min":0.214},"max":{"1min":1.294,"5min":1.6699999999999999,"15min":1.7849999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.89400000000000002},"min":{"1min":0.44600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":1.032,"5min":1.518,"15min":1.518},"last":1.02}]},{"osd":6,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.90700000000000003},"min":{"1min":0.46800000000000003,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.2070000000000001,"5min":1.468,"15min":1.8069999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.497,"5min":0.25600000000000001,"15min":0.20100000000000001},"max":{"1min":1.214,"5min":1.4179999999999999,"15min":1.556},"last":1.153}]},{"osd":7,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.48299999999999998,"5min":0.249,"15min":0.214},"max":{"1min":1.125,"5min":1.502,"15min":1.573},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.026,"15min":0.999},"min":{"1min":0.51800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1679999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575692,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762824,"kb_used_data":87274552,"kb_used_omap":3471,"kb_used_meta":0,"kb_avail":87274552,"statfs":{"total":90150273024,"available":89369141248,"internally_reserved":0,"allocated":89369141248,"data_stored":89369141248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3555326,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1910000000000001,"15min":1.1919999999999999},"min":{"1min":0.64900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.4099999999999999,"5min":1.6819999999999999,"15min":1.8080000000000001},"last":1.335},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1910000000000001,"15min":1.238},"min":{"1min":0.69399999999999995,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":1.4239999999999999,"5min":1.6499999999999999,"15min":1.9039999999999999},"last":1.2390000000000001}]},{"osd":1,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.67900000000000005,"5min":0.376,"15min":0.29199999999999998},"max":{"1min":1.514,"5min":1.772,"15min":1.835},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.65300000000000002,"5min":0.36899999999999999,"15min":0.35499999999999998},"max":{"1min":1.484,"5min":1.6899999999999999,"15min":1.843},"last":1.173}]},{"osd":2,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.66400000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.653,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1759999999999999,"15min":1.1919999999999999},"min":{"1min":0.66200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4039999999999999,"5min":1.577,"15min":1.859},"last":1.2829999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.22,"15min":1.2450000000000001},"min":{"1min":0.70499999999999996,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4019999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.22,"15min":1.2549999999999999},"min":{"1min":0.63200000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.5529999999999999,"5min":1.7869999999999999,"15min":1.8149999999999999},"last":1.085}]},{"osd":5,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1339999999999999,"5min":1.4490000000000001,"15min":1.619},"last":0.999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.3129999999999999,"5min":1.863,"15min":1.863},"last":1.1080000000000001}]},{"osd":6,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.90900000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.224},"max":{"1min":1.29,"5min":1.5900000000000001,"15min":1.7010000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.89900000000000002,"15min":0.91300000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":1.149,"5min":1.383,"15min":1.569},"last":1.2}]},{"osd":7,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92000000000000004,"15min":0.95299999999999996},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.266,"5min":1.5780000000000001,"15min":1.6639999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":1.0029999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.486,"5min":1.4990000000000001,"15min":1.7430000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762948,"kb_used_data":87274428,"kb_used_omap":3428,"kb_used_meta":0,"kb_avail":87274428,"statfs":{"total":90150273024,"available":89369014272,"internally_reserved":0,"allocated":89369014272,"data_stored":89369014272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3511049,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.69799999999999995,"15min":0.72499999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20699999999999999},"max":{"1min":0.84799999999999998,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.22700000000000001,"5min":0.20999999999999999,"15min":0.20799999999999999},"max":{"1min":0.86599999999999999,"5min":1.246,"15min":1.2549999999999999},"last":0.26800000000000002}]},{"osd":1,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.24099999999999999,"5min":0.21199999999999999,"15min":0.19600000000000001},"max":{"1min":1.0269999999999999,"5min":1.214,"15min":1.371},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.29399999999999998,"5min":0.214,"15min":0.214},"max":{"1min":1.0880000000000001,"5min":1.1850000000000001,"15min":1.339},"last":0.26000000000000001}]},{"osd":2,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.26200000000000001,"5min":0.223,"15min":0.19800000000000001},"max":{"1min":1.095,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81999999999999995,"15min":0.83899999999999997},"min":{"1min":0.311,"5min":0.22,"15min":0.219},"max":{"1min":1.1000000000000001,"5min":1.3500000000000001,"15min":1.488},"last":0.25}]},{"osd":4,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2789999999999999,"15min":1.3089999999999999},"min":{"1min":0.60799999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.71,"5min":1.766,"15min":1.847},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.278,"5min":1.302,"15min":1.337},"min":{"1min":0.68899999999999995,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":1.6990000000000001,"5min":1.7909999999999999,"15min":1.861},"last":0.91300000000000003}]},{"osd":5,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3120000000000001,"15min":1.341},"min":{"1min":0.65100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.7010000000000001,"5min":1.827,"15min":2.1970000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.24,"15min":1.292},"min":{"1min":0.63900000000000001,"5min":0.40400000000000003,"15min":0.34699999999999998},"max":{"1min":1.607,"5min":1.6859999999999999,"15min":1.8700000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3049999999999999,"15min":1.3300000000000001},"min":{"1min":0.70499999999999996,"5min":0.316,"15min":0.316},"max":{"1min":1.665,"5min":1.835,"15min":1.96},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.3560000000000001},"min":{"1min":0.67400000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.667,"5min":1.8200000000000001,"15min":1.9910000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":0.63300000000000001,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.9550000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2929999999999999,"15min":1.3300000000000001},"min":{"1min":0.72099999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.853},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575693,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":2831,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2899556,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.25600000000000001,"5min":0.24099999999999999,"15min":0.193},"max":{"1min":1.0089999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.18099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.2},"last":0.68999999999999995}]},{"osd":1,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.27000000000000002,"5min":0.25700000000000001,"15min":0.20899999999999999},"max":{"1min":1.1080000000000001,"5min":1.296,"15min":1.298},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.20899999999999999},"max":{"1min":1.2010000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.171}]},{"osd":3,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.755},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.20200000000000001},"max":{"1min":1.032,"5min":1.073,"15min":1.073},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.318,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":1.1850000000000001,"5min":1.367,"15min":1.367},"last":0.95499999999999996}]},{"osd":4,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3129999999999999,"15min":1.3600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.48899999999999999},"max":{"1min":1.6060000000000001,"5min":1.768,"15min":1.8520000000000001},"last":1.147},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.3839999999999999},"min":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.36499999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.923},"last":1.0269999999999999}]},{"osd":5,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.333,"15min":1.3779999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.978},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.355,"15min":1.367},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.38200000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.9430000000000001},"last":1.071}]},{"osd":6,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.381,"15min":1.3959999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.35099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":2.0049999999999999},"last":1.391},{"interface":"front","average":{"1min":1.321,"5min":1.351,"15min":1.3839999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.42299999999999999},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.8819999999999999},"last":1.109}]},{"osd":7,"last update":"Mon Nov 15 20:35:55 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3540000000000001,"15min":1.389},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.45500000000000002},"max":{"1min":1.7470000000000001,"5min":1.8440000000000001,"15min":1.986},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.409},"min":{"1min":0.72499999999999998,"5min":0.67300000000000004,"15min":0.39000000000000001},"max":{"1min":1.671,"5min":1.8420000000000001,"15min":2.0870000000000002},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575692,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3920,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4014618,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.95799999999999996,"5min":1.125,"15min":1.484},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.746},"min":{"1min":0.32800000000000001,"5min":0.25900000000000001,"15min":0.23899999999999999},"max":{"1min":1.006,"5min":1.0149999999999999,"15min":1.1759999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.79600000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.224},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.333},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89300000000000002,"15min":0.88400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":1.0609999999999999,"5min":1.294,"15min":1.4299999999999999},"last":0.92800000000000005}]},{"osd":3,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82899999999999996},"min":{"1min":0.252,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.3979999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.86599999999999999,"15min":0.83699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23300000000000001},"max":{"1min":1.0880000000000001,"5min":1.3100000000000001,"15min":1.3149999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.387,"15min":1.3680000000000001},"min":{"1min":0.77800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.76,"5min":1.8360000000000001,"15min":1.875},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.385,"15min":1.359},"min":{"1min":0.80100000000000005,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":1.6619999999999999,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.343}]},{"osd":5,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.3220000000000001},"min":{"1min":0.79000000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.546,"5min":1.6439999999999999,"15min":1.7789999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3979999999999999,"15min":1.3660000000000001},"min":{"1min":0.84499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6839999999999999,"5min":1.7430000000000001,"15min":1.8700000000000001},"last":1.383}]},{"osd":6,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3660000000000001,"15min":1.3520000000000001},"min":{"1min":0.83099999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.9590000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.343,"15min":1.3240000000000001},"min":{"1min":0.81100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5569999999999999,"5min":1.7629999999999999,"15min":1.9390000000000001},"last":1.2989999999999999}]},{"osd":7,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.876,"5min":0.437,"15min":0.437},"max":{"1min":1.599,"5min":1.8029999999999999,"15min":1.8680000000000001},"last":1.262},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.381,"15min":1.3740000000000001},"min":{"1min":0.82199999999999995,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.748,"5min":1.8169999999999999,"15min":2.0259999999999998},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834575693,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3804,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3895696,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61599999999999999,"15min":0.64200000000000002},"min":{"1min":0.27400000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.76100000000000001,"5min":1.1479999999999999,"15min":1.21},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72399999999999998,"15min":0.76000000000000001},"min":{"1min":0.28999999999999998,"5min":0.217,"15min":0.217},"max":{"1min":1.0609999999999999,"5min":1.278,"15min":1.411},"last":0.73799999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.754,"15min":0.80900000000000005},"min":{"1min":0.34499999999999997,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.997,"5min":1.1579999999999999,"15min":1.464},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.66900000000000004,"15min":0.69899999999999995},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.21199999999999999},"max":{"1min":1.034,"5min":1.093,"15min":1.2370000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.22800000000000001,"15min":0.22500000000000001},"max":{"1min":1.002,"5min":1.639,"15min":1.873},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.28999999999999998,"5min":0.216,"15min":0.216},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.78800000000000003}]},{"osd":4,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.288,"15min":1.3120000000000001},"min":{"1min":0.80900000000000005,"5min":0.39100000000000001,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.7010000000000001,"15min":1.915},"last":1.46},{"interface":"front","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.3580000000000001},"min":{"1min":0.90900000000000003,"5min":0.35999999999999999,"15min":0.30499999999999999},"max":{"1min":1.6839999999999999,"5min":1.833,"15min":1.9219999999999999},"last":1.6100000000000001}]},{"osd":5,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.232,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7170000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.284,"15min":1.3129999999999999},"min":{"1min":0.85199999999999998,"5min":0.41999999999999998,"15min":0.32800000000000001},"max":{"1min":1.6599999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.6599999999999999}]},{"osd":6,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.306,"15min":1.3480000000000001},"min":{"1min":0.83599999999999997,"5min":0.40400000000000003,"15min":0.34699999999999998},"max":{"1min":1.5780000000000001,"5min":1.8009999999999999,"15min":2.1120000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.294,"15min":1.351},"min":{"1min":0.86399999999999999,"5min":0.373,"15min":0.33900000000000002},"max":{"1min":1.704,"5min":1.8540000000000001,"15min":2.294},"last":1.704}]},{"osd":7,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3460000000000001,"15min":1.3859999999999999},"min":{"1min":0.89600000000000002,"5min":0.38700000000000001,"15min":0.33500000000000002},"max":{"1min":1.6120000000000001,"5min":1.9199999999999999,"15min":2.109},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.333,"15min":1.3700000000000001},"min":{"1min":0.92400000000000004,"5min":0.437,"15min":0.35299999999999998},"max":{"1min":1.667,"5min":1.7609999999999999,"15min":1.881},"last":1.5620000000000001}]}]}]}} 2021-11-15T20:36:58.424 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-11-15T19:26:44.160636+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=44, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.425 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.426 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.426 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.427 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.428 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.428 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.429 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.430 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-11-15T19:26:51.860300+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=19, tm_min=26, tm_sec=51, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=20, tm_min=36, tm_sec=55, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T20:36:58.430 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-11-15T20:37:04.157 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:04.160 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:04.163 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:04.167 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:04.170 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:18.432 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T20:37:18.490 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.483+0000 7f239adfe700 1 Processor -- start 2021-11-15T20:37:18.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- start start 2021-11-15T20:37:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23940b1340 0x7f2394147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2394143f00 0x7f2394144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.493 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2394148190 con 0x7f23940a9f50 2021-11-15T20:37:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- --> v2:172.21.2.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940b1720 con 0x7f2394143f00 2021-11-15T20:37:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2394147e70 con 0x7f23940b1340 2021-11-15T20:37:18.494 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2394143f00 0x7f2394144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 --2- >> v2:172.21.2.137:3300/0 conn(0x7f2394143f00 0x7f2394144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42100/0 (socket says 172.21.2.137:42100) 2021-11-15T20:37:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 -- 172.21.2.137:0/3621282514 learned_addr learned my addr 172.21.2.137:0/3621282514 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:37:18.495 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 -- 172.21.2.137:0/3621282514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23940b1340 msgr2=0x7f2394147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:37:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 --2- 172.21.2.137:0/3621282514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23940b1340 0x7f2394147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 -- 172.21.2.137:0/3621282514 >> v1:172.21.2.111:6789/0 conn(0x7f23940a9f50 legacy=0x7f23940aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:37:18.496 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 -- 172.21.2.137:0/3621282514 --> v2:172.21.2.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940af800 con 0x7f2394143f00 2021-11-15T20:37:18.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f2393fff700 1 --2- 172.21.2.137:0/3621282514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2394143f00 0x7f2394144360 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f239405cfa0 tx=0x7f2388006eb0).ready entity=mon.1 client_cookie=2b9d0fcbfa7ca501 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:37:18.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f23937fe700 1 -- 172.21.2.137:0/3621282514 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238800d570 con 0x7f2394143f00 2021-11-15T20:37:18.497 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f23937fe700 1 -- 172.21.2.137:0/3621282514 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388000e90 con 0x7f2394143f00 2021-11-15T20:37:18.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f23937fe700 1 -- 172.21.2.137:0/3621282514 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238800d8c0 con 0x7f2394143f00 2021-11-15T20:37:18.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- 172.21.2.137:0/3621282514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2394143f00 msgr2=0x7f2394144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.498 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- 172.21.2.137:0/3621282514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2394143f00 0x7f2394144360 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f239405cfa0 tx=0x7f2388006eb0).stop 2021-11-15T20:37:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- 172.21.2.137:0/3621282514 shutdown_connections 2021-11-15T20:37:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- 172.21.2.137:0/3621282514 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f2394143f00 0x7f2394144360 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- 172.21.2.137:0/3621282514 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f23940b1340 0x7f2394147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- 172.21.2.137:0/3621282514 >> 172.21.2.137:0/3621282514 conn(0x7f23940b4e60 msgr2=0x7f23940b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:37:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- 172.21.2.137:0/3621282514 shutdown_connections 2021-11-15T20:37:18.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- 172.21.2.137:0/3621282514 wait complete. 2021-11-15T20:37:18.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 Processor -- start 2021-11-15T20:37:18.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- start start 2021-11-15T20:37:18.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23940a9f50 0x7f23940b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 0x7f2394148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2394143f00 0x7f23941567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23941485b0 con 0x7f23940a9f50 2021-11-15T20:37:18.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394148850 con 0x7f23940b1340 2021-11-15T20:37:18.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.487+0000 7f239adfe700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239414b280 con 0x7f2394143f00 2021-11-15T20:37:18.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 0x7f2394148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 0x7f2394148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42108/0 (socket says 172.21.2.137:42108) 2021-11-15T20:37:18.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 -- 172.21.2.137:0/3036614227 learned_addr learned my addr 172.21.2.137:0/3036614227 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:37:18.506 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 -- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2394143f00 msgr2=0x7f23941567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2394143f00 0x7f23941567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 -- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23940a9f50 msgr2=0x7f23940b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.507 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23940a9f50 0x7f23940b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 -- 172.21.2.137:0/3036614227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238800b1e0 con 0x7f23940b1340 2021-11-15T20:37:18.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2393fff700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 0x7f2394148cf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f239405cfa0 tx=0x7f2388015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:37:18.508 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2388006be0 con 0x7f23940b1340 2021-11-15T20:37:18.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388002f70 con 0x7f23940b1340 2021-11-15T20:37:18.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238800de20 con 0x7f23940b1340 2021-11-15T20:37:18.509 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23940aea80 con 0x7f23940b1340 2021-11-15T20:37:18.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2394149380 con 0x7f23940b1340 2021-11-15T20:37:18.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940aad50 con 0x7f23940b1340 2021-11-15T20:37:18.510 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2388025030 con 0x7f23940b1340 2021-11-15T20:37:18.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2391ffb700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23740536d0 0x7f2374055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f238806c910 con 0x7f23940b1340 2021-11-15T20:37:18.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2398b9a700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23740536d0 0x7f2374055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.511 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.491+0000 7f2398b9a700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23740536d0 0x7f2374055b90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f23840069e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:37:18.512 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.495+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2388043c40 con 0x7f23940b1340 2021-11-15T20:37:18.579 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.575+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 --> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2394148430 con 0x7f23740536d0 2021-11-15T20:37:18.589 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.583+0000 7f2391ffb700 1 -- 172.21.2.137:0/3036614227 <== mgr.4105 v2:172.21.2.111:6832/14547 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66564 (secure 0 0 0) 0x7f2384012450 con 0x7f23740536d0 2021-11-15T20:37:18.591 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-11-15T20:37:18.592 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23740536d0 msgr2=0x7f2374055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23740536d0 0x7f2374055b90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f23840069e0).stop 2021-11-15T20:37:18.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 msgr2=0x7f2394148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.593 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 0x7f2394148cf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f239405cfa0 tx=0x7f2388015000).stop 2021-11-15T20:37:18.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 shutdown_connections 2021-11-15T20:37:18.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7f23740536d0 0x7f2374055b90 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.594 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7f2394143f00 0x7f23941567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7f23940b1340 0x7f2394148cf0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 --2- 172.21.2.137:0/3036614227 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7f23940a9f50 0x7f23940b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.595 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 >> 172.21.2.137:0/3036614227 conn(0x7f23940b4e60 msgr2=0x7f2394145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:37:18.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 shutdown_connections 2021-11-15T20:37:18.596 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.587+0000 7f239adfe700 1 -- 172.21.2.137:0/3036614227 wait complete. 2021-11-15T20:37:18.596 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-11-15T20:37:18.597 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":2263,"stamp":"2021-11-15T20:37:17.282087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9846,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":704299008,"kb_used":6103492,"kb_used_data":698195524,"kb_used_omap":27911,"kb_used_meta":0,"kb_avail":698195516,"statfs":{"total":721202184192,"available":714952208384,"internally_reserved":8192,"allocated":714952216576,"data_stored":714952216576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28581632,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005776"},"pg_stats":[{"pgid":"1.0","version":"155'4","reported_seq":144,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:00.203648+0000","last_change":"2021-11-15T20:37:00.203706+0000","last_active":"2021-11-15T20:37:00.203648+0000","last_peered":"2021-11-15T20:37:00.203648+0000","last_clean":"2021-11-15T20:37:00.203648+0000","last_became_active":"2021-11-15T19:26:47.204269+0000","last_became_peered":"2021-11-15T19:26:47.204269+0000","last_unstale":"2021-11-15T20:37:00.203648+0000","last_undegraded":"2021-11-15T20:37:00.203648+0000","last_fullsized":"2021-11-15T20:37:00.203648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'4","last_scrub_stamp":"2021-11-15T20:37:00.203648+0000","last_deep_scrub":"155'4","last_deep_scrub_stamp":"2021-11-15T20:37:00.203648+0000","last_clean_scrub_stamp":"2021-11-15T20:37:00.203648+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9846,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:02.823716+0000","last_change":"2021-11-15T20:37:02.823848+0000","last_active":"2021-11-15T20:37:02.823716+0000","last_peered":"2021-11-15T20:37:02.823716+0000","last_clean":"2021-11-15T20:37:02.823716+0000","last_became_active":"2021-11-15T19:26:52.880242+0000","last_became_peered":"2021-11-15T19:26:52.880242+0000","last_unstale":"2021-11-15T20:37:02.823716+0000","last_undegraded":"2021-11-15T20:37:02.823716+0000","last_fullsized":"2021-11-15T20:37:02.823716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:02.823715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:02.823715+0000","last_clean_scrub_stamp":"2021-11-15T20:37:02.823715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:06.241536+0000","last_change":"2021-11-15T20:37:06.241663+0000","last_active":"2021-11-15T20:37:06.241536+0000","last_peered":"2021-11-15T20:37:06.241536+0000","last_clean":"2021-11-15T20:37:06.241536+0000","last_became_active":"2021-11-15T19:26:52.880321+0000","last_became_peered":"2021-11-15T19:26:52.880321+0000","last_unstale":"2021-11-15T20:37:06.241536+0000","last_undegraded":"2021-11-15T20:37:06.241536+0000","last_fullsized":"2021-11-15T20:37:06.241536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:06.241535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:06.241535+0000","last_clean_scrub_stamp":"2021-11-15T20:37:06.241535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:05.107782+0000","last_change":"2021-11-15T20:37:05.107957+0000","last_active":"2021-11-15T20:37:05.107782+0000","last_peered":"2021-11-15T20:37:05.107782+0000","last_clean":"2021-11-15T20:37:05.107782+0000","last_became_active":"2021-11-15T19:26:53.132568+0000","last_became_peered":"2021-11-15T19:26:53.132568+0000","last_unstale":"2021-11-15T20:37:05.107782+0000","last_undegraded":"2021-11-15T20:37:05.107782+0000","last_fullsized":"2021-11-15T20:37:05.107782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:05.107781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:05.107781+0000","last_clean_scrub_stamp":"2021-11-15T20:37:05.107781+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:00.833730+0000","last_change":"2021-11-15T20:37:00.833856+0000","last_active":"2021-11-15T20:37:00.833730+0000","last_peered":"2021-11-15T20:37:00.833730+0000","last_clean":"2021-11-15T20:37:00.833730+0000","last_became_active":"2021-11-15T19:26:52.880159+0000","last_became_peered":"2021-11-15T19:26:52.880159+0000","last_unstale":"2021-11-15T20:37:00.833730+0000","last_undegraded":"2021-11-15T20:37:00.833730+0000","last_fullsized":"2021-11-15T20:37:00.833730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:00.833729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:00.833729+0000","last_clean_scrub_stamp":"2021-11-15T20:37:00.833729+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:03.387577+0000","last_change":"2021-11-15T20:37:03.387708+0000","last_active":"2021-11-15T20:37:03.387577+0000","last_peered":"2021-11-15T20:37:03.387577+0000","last_clean":"2021-11-15T20:37:03.387577+0000","last_became_active":"2021-11-15T19:26:52.876703+0000","last_became_peered":"2021-11-15T19:26:52.876703+0000","last_unstale":"2021-11-15T20:37:03.387577+0000","last_undegraded":"2021-11-15T20:37:03.387577+0000","last_fullsized":"2021-11-15T20:37:03.387577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:03.387576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:03.387576+0000","last_clean_scrub_stamp":"2021-11-15T20:37:03.387576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:09.301608+0000","last_change":"2021-11-15T20:37:09.301782+0000","last_active":"2021-11-15T20:37:09.301608+0000","last_peered":"2021-11-15T20:37:09.301608+0000","last_clean":"2021-11-15T20:37:09.301608+0000","last_became_active":"2021-11-15T19:26:52.878380+0000","last_became_peered":"2021-11-15T19:26:52.878380+0000","last_unstale":"2021-11-15T20:37:09.301608+0000","last_undegraded":"2021-11-15T20:37:09.301608+0000","last_fullsized":"2021-11-15T20:37:09.301608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:09.301607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:09.301607+0000","last_clean_scrub_stamp":"2021-11-15T20:37:09.301607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:05.346266+0000","last_change":"2021-11-15T20:37:05.346299+0000","last_active":"2021-11-15T20:37:05.346266+0000","last_peered":"2021-11-15T20:37:05.346266+0000","last_clean":"2021-11-15T20:37:05.346266+0000","last_became_active":"2021-11-15T19:26:52.876454+0000","last_became_peered":"2021-11-15T19:26:52.876454+0000","last_unstale":"2021-11-15T20:37:05.346266+0000","last_undegraded":"2021-11-15T20:37:05.346266+0000","last_fullsized":"2021-11-15T20:37:05.346266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:05.346266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:05.346266+0000","last_clean_scrub_stamp":"2021-11-15T20:37:05.346266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-11-15T20:37:05.365531+0000","last_change":"2021-11-15T20:37:05.365566+0000","last_active":"2021-11-15T20:37:05.365531+0000","last_peered":"2021-11-15T20:37:05.365531+0000","last_clean":"2021-11-15T20:37:05.365531+0000","last_became_active":"2021-11-15T19:26:52.878904+0000","last_became_peered":"2021-11-15T19:26:52.878904+0000","last_unstale":"2021-11-15T20:37:05.365531+0000","last_undegraded":"2021-11-15T20:37:05.365531+0000","last_fullsized":"2021-11-15T20:37:05.365531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T20:37:05.365530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T20:37:05.365530+0000","last_clean_scrub_stamp":"2021-11-15T20:37:05.365530+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9846,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575697,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762960,"kb_used_data":87274424,"kb_used_omap":3653,"kb_used_meta":0,"kb_avail":87274416,"statfs":{"total":90150273024,"available":89369001984,"internally_reserved":8192,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3741393,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2470000000000001,"15min":1.232},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.36899999999999999},"max":{"1min":1.6279999999999999,"5min":1.6850000000000001,"15min":1.7929999999999999},"last":1.359},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2230000000000001,"15min":1.1990000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.38800000000000001},"max":{"1min":1.4910000000000001,"5min":1.73,"15min":1.794},"last":1.093}]},{"osd":1,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3129999999999999,"15min":1.286},"min":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.42699999999999999},"max":{"1min":1.5800000000000001,"5min":1.802,"15min":1.802},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.29,"15min":1.27},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.42099999999999999},"max":{"1min":1.5800000000000001,"5min":1.7150000000000001,"15min":1.849},"last":1.177}]},{"osd":2,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.163,"15min":1.1759999999999999},"min":{"1min":0.73099999999999998,"5min":0.65300000000000002,"15min":0.39800000000000002},"max":{"1min":1.4179999999999999,"5min":1.5920000000000001,"15min":1.7210000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2909999999999999,"15min":1.2549999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.38400000000000001},"max":{"1min":1.6479999999999999,"5min":1.673,"15min":1.766},"last":1.121}]},{"osd":3,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.254},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.41399999999999998},"max":{"1min":1.649,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.282},{"interface":"front","average":{"1min":1.278,"5min":1.3,"15min":1.294},"min":{"1min":0.83999999999999997,"5min":0.67000000000000004,"15min":0.40600000000000003},"max":{"1min":1.728,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.2390000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.82599999999999996,"15min":0.81599999999999995},"min":{"1min":0.68000000000000005,"5min":0.31900000000000001,"15min":0.20200000000000001},"max":{"1min":1.2949999999999999,"5min":1.321,"15min":1.6890000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.89600000000000002,"15min":0.86599999999999999},"min":{"1min":0.81599999999999995,"5min":0.26900000000000002,"15min":0.20300000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3939999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.90700000000000003,"15min":0.873},"min":{"1min":0.64200000000000002,"5min":0.24199999999999999,"15min":0.17899999999999999},"max":{"1min":1.4390000000000001,"5min":1.548,"15min":1.645},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.97999999999999998,"15min":0.92700000000000005},"min":{"1min":0.77200000000000002,"5min":0.29999999999999999,"15min":0.217},"max":{"1min":1.49,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0129999999999999}]},{"osd":6,"last update":"Mon Nov 15 20:37:08 2021","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0329999999999999,"15min":1.014},"min":{"1min":0.83599999999999997,"5min":0.32900000000000001,"15min":0.20899999999999999},"max":{"1min":1.4119999999999999,"5min":1.494,"15min":1.6060000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0609999999999999,"15min":1.02},"min":{"1min":0.77800000000000002,"5min":0.28299999999999997,"15min":0.20399999999999999},"max":{"1min":1.4239999999999999,"5min":1.6870000000000001,"15min":1.7010000000000001},"last":1.0549999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575696,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":4050,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4148035,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2330000000000001,"15min":1.23},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.27600000000000002},"max":{"1min":1.5960000000000001,"5min":1.7170000000000001,"15min":1.76},"last":1.452},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2370000000000001,"15min":1.2290000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.315},"max":{"1min":1.583,"5min":1.655,"15min":1.7390000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.214,"15min":1.1859999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.32600000000000001},"max":{"1min":1.4470000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.238,"15min":1.2210000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.252},"max":{"1min":1.3959999999999999,"5min":1.677,"15min":1.722},"last":1.498}]},{"osd":2,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3200000000000001,"15min":1.286},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.246},"max":{"1min":1.6339999999999999,"5min":2.012,"15min":2.012},"last":1.323},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2549999999999999,"15min":1.22},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.28999999999999998},"max":{"1min":1.54,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.339}]},{"osd":3,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3240000000000001,"15min":1.3009999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":1.6779999999999999,"5min":1.74,"15min":1.867},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.34799999999999998},"max":{"1min":1.5549999999999999,"5min":1.7509999999999999,"15min":1.8540000000000001},"last":1.3839999999999999}]},{"osd":4,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84199999999999997,"15min":0.88100000000000001},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.21199999999999999},"max":{"1min":1.097,"5min":1.323,"15min":1.579},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.88900000000000001,"15min":0.90600000000000003},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":1.446,"5min":1.5700000000000001,"15min":1.581},"last":1.0089999999999999}]},{"osd":5,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.94499999999999995,"15min":0.94899999999999995},"min":{"1min":0.316,"5min":0.252,"15min":0.20499999999999999},"max":{"1min":1.1850000000000001,"5min":1.389,"15min":1.603},"last":1.097},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.26500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.302,"5min":1.55,"15min":1.7769999999999999},"last":1.1200000000000001}]},{"osd":7,"last update":"Mon Nov 15 20:37:04 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.27200000000000002,"5min":0.26800000000000002,"15min":0.24399999999999999},"max":{"1min":1.1970000000000001,"5min":1.3080000000000001,"15min":1.696},"last":1.292},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.999,"15min":1.0189999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.252},"max":{"1min":1.3779999999999999,"5min":1.554,"15min":1.6679999999999999},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575697,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":2736,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2802219,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.248,"15min":1.24},"min":{"1min":0.77300000000000002,"5min":0.47999999999999998,"15min":0.26600000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.349},{"interface":"front","average":{"1min":1.228,"5min":1.2669999999999999,"15min":1.268},"min":{"1min":0.84899999999999998,"5min":0.55900000000000005,"15min":0.32700000000000001},"max":{"1min":1.5489999999999999,"5min":1.746,"15min":1.7929999999999999},"last":1.4359999999999999}]},{"osd":1,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2709999999999999,"15min":1.272},"min":{"1min":0.96799999999999997,"5min":0.51700000000000002,"15min":0.31},"max":{"1min":1.5820000000000001,"5min":1.603,"15min":1.7609999999999999},"last":1.544},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.99199999999999999,"5min":0.42599999999999999,"15min":0.317},"max":{"1min":1.7170000000000001,"5min":1.742,"15min":1.8300000000000001},"last":1.4850000000000001}]},{"osd":2,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2689999999999999,"15min":1.2350000000000001},"min":{"1min":1.0720000000000001,"5min":0.41799999999999998,"15min":0.33700000000000002},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.2150000000000001,"15min":1.2},"min":{"1min":0.69899999999999995,"5min":0.49099999999999999,"15min":0.22500000000000001},"max":{"1min":1.615,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3029999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3029999999999999,"15min":1.258},"min":{"1min":1.0269999999999999,"5min":0.54900000000000004,"15min":0.28299999999999997},"max":{"1min":1.3919999999999999,"5min":1.706,"15min":1.7090000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2709999999999999,"15min":1.284},"min":{"1min":0.82099999999999995,"5min":0.435,"15min":0.26100000000000001},"max":{"1min":1.4370000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.3680000000000001}]},{"osd":4,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.84599999999999997,"15min":0.83899999999999997},"min":{"1min":0.41699999999999998,"5min":0.23699999999999999,"15min":0.214},"max":{"1min":1.294,"5min":1.6699999999999999,"15min":1.7849999999999999},"last":1.135},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.89400000000000002},"min":{"1min":0.44600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":1.032,"5min":1.518,"15min":1.518},"last":0.94899999999999995}]},{"osd":6,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.90700000000000003},"min":{"1min":0.46800000000000003,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.2070000000000001,"5min":1.468,"15min":1.8069999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.497,"5min":0.25600000000000001,"15min":0.20100000000000001},"max":{"1min":1.214,"5min":1.4179999999999999,"15min":1.556},"last":1.2410000000000001}]},{"osd":7,"last update":"Mon Nov 15 20:36:12 2021","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.48299999999999998,"5min":0.249,"15min":0.214},"max":{"1min":1.125,"5min":1.502,"15min":1.573},"last":1.2},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.026,"15min":0.999},"min":{"1min":0.51800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1679999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.069}]}]},{"osd":4,"up_from":13,"seq":55834575696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762824,"kb_used_data":87274552,"kb_used_omap":3471,"kb_used_meta":0,"kb_avail":87274552,"statfs":{"total":90150273024,"available":89369141248,"internally_reserved":0,"allocated":89369141248,"data_stored":89369141248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3555326,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1910000000000001,"15min":1.1919999999999999},"min":{"1min":0.64900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.4099999999999999,"5min":1.6819999999999999,"15min":1.8080000000000001},"last":1.361},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1910000000000001,"15min":1.238},"min":{"1min":0.69399999999999995,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":1.4239999999999999,"5min":1.6499999999999999,"15min":1.9039999999999999},"last":1.1739999999999999}]},{"osd":1,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.67900000000000005,"5min":0.376,"15min":0.29199999999999998},"max":{"1min":1.514,"5min":1.772,"15min":1.835},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.65300000000000002,"5min":0.36899999999999999,"15min":0.35499999999999998},"max":{"1min":1.484,"5min":1.6899999999999999,"15min":1.843},"last":1.2789999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2410000000000001,"15min":1.2529999999999999},"min":{"1min":0.66400000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.653,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.345},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1759999999999999,"15min":1.1919999999999999},"min":{"1min":0.66200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4039999999999999,"5min":1.577,"15min":1.859},"last":1.4199999999999999}]},{"osd":3,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.22,"15min":1.2450000000000001},"min":{"1min":0.70499999999999996,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4019999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.25},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.22,"15min":1.2549999999999999},"min":{"1min":0.63200000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.5529999999999999,"5min":1.7869999999999999,"15min":1.8149999999999999},"last":1.383}]},{"osd":5,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1339999999999999,"5min":1.4490000000000001,"15min":1.619},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.3129999999999999,"5min":1.863,"15min":1.863},"last":1.0389999999999999}]},{"osd":6,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.90900000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.224},"max":{"1min":1.29,"5min":1.5900000000000001,"15min":1.7010000000000001},"last":1.125},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.89900000000000002,"15min":0.91300000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":1.149,"5min":1.383,"15min":1.569},"last":0.89400000000000002}]},{"osd":7,"last update":"Mon Nov 15 20:36:21 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92000000000000004,"15min":0.95299999999999996},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.266,"5min":1.5780000000000001,"15min":1.6639999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":1.0029999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.486,"5min":1.4990000000000001,"15min":1.7430000000000001},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762948,"kb_used_data":87274428,"kb_used_omap":3429,"kb_used_meta":0,"kb_avail":87274428,"statfs":{"total":90150273024,"available":89369014272,"internally_reserved":0,"allocated":89369014272,"data_stored":89369014272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3512278,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.69799999999999995,"15min":0.72499999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20699999999999999},"max":{"1min":0.84799999999999998,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.22700000000000001,"5min":0.20999999999999999,"15min":0.20799999999999999},"max":{"1min":0.86599999999999999,"5min":1.246,"15min":1.2549999999999999},"last":0.76400000000000001}]},{"osd":1,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.24099999999999999,"5min":0.21199999999999999,"15min":0.19600000000000001},"max":{"1min":1.0269999999999999,"5min":1.214,"15min":1.371},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.29399999999999998,"5min":0.214,"15min":0.214},"max":{"1min":1.0880000000000001,"5min":1.1850000000000001,"15min":1.339},"last":0.82899999999999996}]},{"osd":2,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.26200000000000001,"5min":0.223,"15min":0.19800000000000001},"max":{"1min":1.095,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81999999999999995,"15min":0.83899999999999997},"min":{"1min":0.311,"5min":0.22,"15min":0.219},"max":{"1min":1.1000000000000001,"5min":1.3500000000000001,"15min":1.488},"last":0.97799999999999998}]},{"osd":4,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2789999999999999,"15min":1.3089999999999999},"min":{"1min":0.60799999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.71,"5min":1.766,"15min":1.847},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.302,"15min":1.337},"min":{"1min":0.68899999999999995,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":1.6990000000000001,"5min":1.7909999999999999,"15min":1.861},"last":1.643}]},{"osd":5,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3120000000000001,"15min":1.341},"min":{"1min":0.65100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":1.7010000000000001,"5min":1.827,"15min":2.1970000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.24,"15min":1.292},"min":{"1min":0.63900000000000001,"5min":0.40400000000000003,"15min":0.34699999999999998},"max":{"1min":1.607,"5min":1.6859999999999999,"15min":1.8700000000000001},"last":1.3320000000000001}]},{"osd":6,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3049999999999999,"15min":1.3300000000000001},"min":{"1min":0.70499999999999996,"5min":0.316,"15min":0.316},"max":{"1min":1.665,"5min":1.835,"15min":1.96},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.3560000000000001},"min":{"1min":0.67400000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.667,"5min":1.8200000000000001,"15min":1.9910000000000001},"last":1.3680000000000001}]},{"osd":7,"last update":"Mon Nov 15 20:36:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":0.63300000000000001,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.9550000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2929999999999999,"15min":1.3300000000000001},"min":{"1min":0.72099999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.853},"last":1.4970000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575697,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":2833,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2901941,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.193},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.433,"5min":0.25,"15min":0.18099999999999999},"max":{"1min":0.89100000000000001,"5min":1.0469999999999999,"15min":1.143},"last":0.78300000000000003}]},{"osd":1,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.79300000000000004},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.98999999999999999,"5min":1.296,"15min":1.298},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80600000000000005,"15min":0.78700000000000003},"min":{"1min":0.41699999999999998,"5min":0.27800000000000002,"15min":0.20899999999999999},"max":{"1min":1.171,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.92900000000000005}]},{"osd":3,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.309,"5min":0.24399999999999999,"15min":0.20200000000000001},"max":{"1min":0.97599999999999998,"5min":1.073,"15min":1.073},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.84699999999999998,"15min":0.83199999999999996},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.23200000000000001},"max":{"1min":0.98999999999999999,"5min":1.367,"15min":1.367},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.3520000000000001,"15min":1.3640000000000001},"min":{"1min":1.0800000000000001,"5min":0.54200000000000004,"15min":0.48899999999999999},"max":{"1min":1.845,"5min":1.845,"15min":1.8520000000000001},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3879999999999999,"15min":1.377},"min":{"1min":1.008,"5min":0.67800000000000005,"15min":0.36499999999999999},"max":{"1min":1.6719999999999999,"5min":1.8280000000000001,"15min":1.923},"last":1.597}]},{"osd":5,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.349,"15min":1.375},"min":{"1min":0.98999999999999999,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":1.706,"5min":1.7769999999999999,"15min":1.978},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.385,"15min":1.3660000000000001},"min":{"1min":1.056,"5min":0.63100000000000001,"15min":0.38200000000000001},"max":{"1min":1.75,"5min":1.7849999999999999,"15min":1.9430000000000001},"last":1.5029999999999999}]},{"osd":6,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3999999999999999,"15min":1.395},"min":{"1min":1.028,"5min":0.58599999999999997,"15min":0.35099999999999998},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":2.0049999999999999},"last":1.7589999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.371,"15min":1.3779999999999999},"min":{"1min":1.0700000000000001,"5min":0.61199999999999999,"15min":0.42299999999999999},"max":{"1min":1.768,"5min":1.7969999999999999,"15min":1.8819999999999999},"last":1.5580000000000001}]},{"osd":7,"last update":"Mon Nov 15 20:36:57 2021","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.371,"15min":1.381},"min":{"1min":0.94499999999999995,"5min":0.73999999999999999,"15min":0.45500000000000002},"max":{"1min":1.6899999999999999,"5min":1.8440000000000001,"15min":1.986},"last":1.861},{"interface":"front","average":{"1min":1.478,"5min":1.4219999999999999,"15min":1.411},"min":{"1min":1.0940000000000001,"5min":0.67300000000000004,"15min":0.39000000000000001},"max":{"1min":1.913,"5min":1.913,"15min":2.0870000000000002},"last":1.46}]}]},{"osd":1,"up_from":13,"seq":55834575696,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3925,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4019288,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.95799999999999996,"5min":1.125,"15min":1.484},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.746},"min":{"1min":0.32800000000000001,"5min":0.25900000000000001,"15min":0.23899999999999999},"max":{"1min":1.006,"5min":1.0149999999999999,"15min":1.1759999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.79600000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.224},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.333},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89300000000000002,"15min":0.88400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.25600000000000001},"max":{"1min":1.0609999999999999,"5min":1.294,"15min":1.4299999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82899999999999996},"min":{"1min":0.252,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.3979999999999999},"last":0.749},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.86599999999999999,"15min":0.83699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23300000000000001},"max":{"1min":1.0880000000000001,"5min":1.3100000000000001,"15min":1.3149999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.387,"15min":1.3680000000000001},"min":{"1min":0.77800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.76,"5min":1.8360000000000001,"15min":1.875},"last":1.349},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.385,"15min":1.359},"min":{"1min":0.80100000000000005,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":1.6619999999999999,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.5429999999999999}]},{"osd":5,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.3220000000000001},"min":{"1min":0.79000000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.546,"5min":1.6439999999999999,"15min":1.7789999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3979999999999999,"15min":1.3660000000000001},"min":{"1min":0.84499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6839999999999999,"5min":1.7430000000000001,"15min":1.8700000000000001},"last":1.6359999999999999}]},{"osd":6,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3660000000000001,"15min":1.3520000000000001},"min":{"1min":0.83099999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.9590000000000001},"last":1.286},{"interface":"front","average":{"1min":1.339,"5min":1.343,"15min":1.3240000000000001},"min":{"1min":0.81100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5569999999999999,"5min":1.7629999999999999,"15min":1.9390000000000001},"last":1.591}]},{"osd":7,"last update":"Mon Nov 15 20:36:16 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.876,"5min":0.437,"15min":0.437},"max":{"1min":1.599,"5min":1.8029999999999999,"15min":1.8680000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.381,"15min":1.3740000000000001},"min":{"1min":0.82199999999999995,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.748,"5min":1.8169999999999999,"15min":2.0259999999999998},"last":1.4239999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575697,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":762952,"kb_used_data":87274424,"kb_used_omap":3809,"kb_used_meta":0,"kb_avail":87274424,"statfs":{"total":90150273024,"available":89369010176,"internally_reserved":0,"allocated":89369010176,"data_stored":89369010176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3901152,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61599999999999999,"15min":0.64200000000000002},"min":{"1min":0.27400000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.76100000000000001,"5min":1.1479999999999999,"15min":1.21},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72399999999999998,"15min":0.76000000000000001},"min":{"1min":0.28999999999999998,"5min":0.217,"15min":0.217},"max":{"1min":1.0609999999999999,"5min":1.278,"15min":1.411},"last":0.86699999999999999}]},{"osd":2,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.754,"15min":0.80900000000000005},"min":{"1min":0.34499999999999997,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.997,"5min":1.1579999999999999,"15min":1.464},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.66900000000000004,"15min":0.69899999999999995},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.21199999999999999},"max":{"1min":1.034,"5min":1.093,"15min":1.2370000000000001},"last":0.72499999999999998}]},{"osd":3,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.22800000000000001,"15min":0.22500000000000001},"max":{"1min":1.002,"5min":1.639,"15min":1.873},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.28999999999999998,"5min":0.216,"15min":0.216},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.79600000000000004}]},{"osd":4,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.288,"15min":1.3120000000000001},"min":{"1min":0.80900000000000005,"5min":0.39100000000000001,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.7010000000000001,"15min":1.915},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.3580000000000001},"min":{"1min":0.90900000000000003,"5min":0.35999999999999999,"15min":0.30499999999999999},"max":{"1min":1.6839999999999999,"5min":1.833,"15min":1.9219999999999999},"last":1.2250000000000001}]},{"osd":5,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.232,"15min":1.2769999999999999},"min":{"1min":0.82299999999999995,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7170000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.284,"15min":1.3129999999999999},"min":{"1min":0.85199999999999998,"5min":0.41999999999999998,"15min":0.32800000000000001},"max":{"1min":1.6599999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.26}]},{"osd":6,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.306,"15min":1.3480000000000001},"min":{"1min":0.83599999999999997,"5min":0.40400000000000003,"15min":0.34699999999999998},"max":{"1min":1.5780000000000001,"5min":1.8009999999999999,"15min":2.1120000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.294,"15min":1.351},"min":{"1min":0.86399999999999999,"5min":0.373,"15min":0.33900000000000002},"max":{"1min":1.704,"5min":1.8540000000000001,"15min":2.294},"last":1.284}]},{"osd":7,"last update":"Mon Nov 15 20:36:52 2021","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3460000000000001,"15min":1.3859999999999999},"min":{"1min":0.89600000000000002,"5min":0.38700000000000001,"15min":0.33500000000000002},"max":{"1min":1.6120000000000001,"5min":1.9199999999999999,"15min":2.109},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.333,"15min":1.3700000000000001},"min":{"1min":0.92400000000000004,"5min":0.437,"15min":0.35299999999999998},"max":{"1min":1.667,"5min":1.7609999999999999,"15min":1.881},"last":1.091}]}]}]}} 2021-11-15T20:37:18.600 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-11-15T20:37:18.651 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc76d8dd700 1 Processor -- start 2021-11-15T20:37:18.652 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc76d8dd700 1 -- start start 2021-11-15T20:37:18.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc76d8dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 0x7fc76813c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc76d8dd700 1 -- --> v1:172.21.2.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc768066270 con 0x7fc768065730 2021-11-15T20:37:18.655 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc76d8dd700 1 -- --> v1:172.21.2.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc768065fd0 con 0x7fc768065b10 2021-11-15T20:37:18.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc76d8dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc768067410 con 0x7fc7680b00a0 2021-11-15T20:37:18.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc7667fc700 1 --1- >> v1:172.21.2.137:6789/0 conn(0x7fc768065b10 0x7fc76805bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.137:6789/0 says I am v1:172.21.2.137:60896/0 (socket says 172.21.2.137:60896) 2021-11-15T20:37:18.656 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc7667fc700 1 -- 172.21.2.137:0/1312049282 learned_addr learned my addr 172.21.2.137:0/1312049282 (peer_addr_for_me v1:172.21.2.137:0/0) 2021-11-15T20:37:18.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 <== mon.1 v1:172.21.2.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026228015 0 0) 0x7fc768065fd0 con 0x7fc768065b10 2021-11-15T20:37:18.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 --> v1:172.21.2.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc748003260 con 0x7fc768065b10 2021-11-15T20:37:18.657 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 <== mon.1 v1:172.21.2.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263015259 0 0) 0x7fc748003260 con 0x7fc768065b10 2021-11-15T20:37:18.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 msgr2=0x7fc76813c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:37:18.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 0x7fc76813c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.658 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 >> v1:172.21.2.111:6789/0 conn(0x7fc768065730 legacy=0x7fc76813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:37:18.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 --> v1:172.21.2.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768066f70 con 0x7fc768065b10 2021-11-15T20:37:18.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 <== mon.1 v1:172.21.2.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2310214247 0 0) 0x7fc758001660 con 0x7fc768065b10 2021-11-15T20:37:18.659 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 >> v1:172.21.2.137:6789/0 conn(0x7fc768065b10 legacy=0x7fc76805bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc748003750 0x7fc748003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 0x7fc748004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.660 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc748004b10 0x7fc748004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768067410 con 0x7fc748004b10 2021-11-15T20:37:18.661 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800c9f0 con 0x7fc748003750 2021-11-15T20:37:18.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800cbb0 con 0x7fc7680b00a0 2021-11-15T20:37:18.662 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc748003750 0x7fc748003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc7677fe700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc748004b10 0x7fc748004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.668 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc7667fc700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 0x7fc748004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 -- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 msgr2=0x7fc748004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:37:18.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 0x7fc748004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.669 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 -- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc748004b10 msgr2=0x7fc748004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T20:37:18.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc748004b10 0x7fc748004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 -- 172.21.2.137:0/1312049282 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748003260 con 0x7fc748003750 2021-11-15T20:37:18.670 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc7677fe700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc748004b10 0x7fc748004f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T20:37:18.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc7667fc700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680b00a0 0x7fc748004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T20:37:18.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc766ffd700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc748003750 0x7fc748003b50 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fc750001fa0 tx=0x7fc750007a00).ready entity=mon.1 client_cookie=340508031c8e9286 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:37:18.671 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc750007070 con 0x7fc748003750 2021-11-15T20:37:18.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7500071d0 con 0x7fc748003750 2021-11-15T20:37:18.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.647+0000 7fc765ffb700 1 -- 172.21.2.137:0/1312049282 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc750006510 con 0x7fc748003750 2021-11-15T20:37:18.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/1312049282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc748003750 msgr2=0x7fc748003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.672 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/1312049282 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc748003750 0x7fc748003b50 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fc750001fa0 tx=0x7fc750007a00).stop 2021-11-15T20:37:18.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 -- 172.21.2.137:0/1312049282 reap_dead start 2021-11-15T20:37:18.673 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/1312049282 shutdown_connections 2021-11-15T20:37:18.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/1312049282 >> 172.21.2.137:0/1312049282 conn(0x7fc768060290 msgr2=0x7fc768060670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:37:18.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/1312049282 shutdown_connections 2021-11-15T20:37:18.674 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/1312049282 wait complete. 2021-11-15T20:37:18.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 Processor -- start 2021-11-15T20:37:18.677 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- start start 2021-11-15T20:37:18.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 --2- >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680ad0f0 0x7fc768137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 --2- >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc76813d9e0 0x7fc768138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.678 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 0x7fc7681526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- --> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680ad4d0 con 0x7fc76813d9e0 2021-11-15T20:37:18.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680af6c0 con 0x7fc768152220 2021-11-15T20:37:18.679 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- --> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76813e460 con 0x7fc7680ad0f0 2021-11-15T20:37:18.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 0x7fc7681526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 --2- >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 0x7fc7681526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.137:3300/0 says I am v2:172.21.2.137:42128/0 (socket says 172.21.2.137:42128) 2021-11-15T20:37:18.680 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 -- 172.21.2.137:0/2517140228 learned_addr learned my addr 172.21.2.137:0/2517140228 (peer_addr_for_me v2:172.21.2.137:0/0) 2021-11-15T20:37:18.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7667fc700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc76813d9e0 0x7fc768138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 -- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680ad0f0 msgr2=0x7fc768137f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.681 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680ad0f0 0x7fc768137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 -- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc76813d9e0 msgr2=0x7fc768138440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc76813d9e0 0x7fc768138440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.682 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 -- 172.21.2.137:0/2517140228 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76813e700 con 0x7fc768152220 2021-11-15T20:37:18.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc7677fe700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 0x7fc7681526a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fc7580018c0 tx=0x7fc760008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:37:18.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc760012470 con 0x7fc768152220 2021-11-15T20:37:18.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc768138930 con 0x7fc768152220 2021-11-15T20:37:18.683 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600125d0 con 0x7fc768152220 2021-11-15T20:37:18.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc760012930 con 0x7fc768152220 2021-11-15T20:37:18.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76813eba0 con 0x7fc768152220 2021-11-15T20:37:18.684 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7680af4d0 con 0x7fc768152220 2021-11-15T20:37:18.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc760019030 con 0x7fc768152220 2021-11-15T20:37:18.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc75ffff700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc74c053570 0x7fc74c055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T20:37:18.685 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc76006b0c0 con 0x7fc768152220 2021-11-15T20:37:18.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.651+0000 7fc766ffd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc74c053570 0x7fc74c055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T20:37:18.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.655+0000 7fc766ffd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc74c053570 0x7fc74c055a30 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fc750001fa0 tx=0x7fc750015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T20:37:18.686 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.655+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc7600423f0 con 0x7fc768152220 2021-11-15T20:37:18.741 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.735+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 --> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc7680b0fb0 con 0x7fc768152220 2021-11-15T20:37:18.749 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.743+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7600423f0 con 0x7fc768152220 2021-11-15T20:37:18.753 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.747+0000 7fc75ffff700 1 -- 172.21.2.137:0/2517140228 <== mon.1 v2:172.21.2.137:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc760045a10 con 0x7fc768152220 2021-11-15T20:37:18.754 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc74c053570 msgr2=0x7fc74c055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc74c053570 0x7fc74c055a30 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fc750001fa0 tx=0x7fc750015000).stop 2021-11-15T20:37:18.755 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 msgr2=0x7fc7681526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T20:37:18.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 0x7fc7681526a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fc7580018c0 tx=0x7fc760008040).stop 2021-11-15T20:37:18.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 shutdown_connections 2021-11-15T20:37:18.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:6832/14547,v1:172.21.2.111:6833/14547] conn(0x7fc74c053570 0x7fc74c055a30 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.756 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] conn(0x7fc768152220 0x7fc7681526a0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3300/0,v1:172.21.2.111:6789/0] conn(0x7fc76813d9e0 0x7fc768138440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T20:37:18.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 --2- 172.21.2.137:0/2517140228 >> [v2:172.21.2.111:3301/0,v1:172.21.2.111:6790/0] conn(0x7fc7680ad0f0 0x7fc768137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T20:37:18.757 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 >> 172.21.2.137:0/2517140228 conn(0x7fc768060290 msgr2=0x7fc76805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T20:37:18.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 shutdown_connections 2021-11-15T20:37:18.758 INFO:teuthology.orchestra.run.gibba037.stderr:2021-11-15T20:37:18.751+0000 7fc76d8dd700 1 -- 172.21.2.137:0/2517140228 wait complete. 2021-11-15T20:37:18.761 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T20:37:18.764 INFO:teuthology.misc:Shutting down mds daemons... 2021-11-15T20:37:18.765 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T20:37:18.766 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.771 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T20:37:18.772 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T20:37:18.773 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.779 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T20:37:18.780 INFO:teuthology.misc:Shutting down osd daemons... 2021-11-15T20:37:18.780 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-11-15T20:37:18.781 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.788 INFO:tasks.ceph.osd.0:Stopped 2021-11-15T20:37:18.790 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-11-15T20:37:18.791 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.842 INFO:tasks.ceph.osd.1:Stopped 2021-11-15T20:37:18.843 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-11-15T20:37:18.843 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.849 INFO:tasks.ceph.osd.2:Stopped 2021-11-15T20:37:18.850 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-11-15T20:37:18.851 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.858 INFO:tasks.ceph.osd.3:Stopped 2021-11-15T20:37:18.858 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-11-15T20:37:18.859 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.887 INFO:tasks.ceph.osd.4:Stopped 2021-11-15T20:37:18.888 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-11-15T20:37:18.889 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.958 INFO:tasks.ceph.osd.5:Stopped 2021-11-15T20:37:18.959 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-11-15T20:37:18.960 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2021-11-15T20:37:18.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2021-11-15T20:37:18.983 INFO:tasks.ceph.osd.6:Stopped 2021-11-15T20:37:18.984 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-11-15T20:37:18.985 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:18.999 INFO:tasks.ceph.osd.7:Stopped 2021-11-15T20:37:19.000 INFO:teuthology.misc:Shutting down mgr daemons... 2021-11-15T20:37:19.001 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-11-15T20:37:19.002 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:19.034 INFO:tasks.ceph.mgr.y:Stopped 2021-11-15T20:37:19.035 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-11-15T20:37:19.036 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:19.049 INFO:tasks.ceph.mgr.x:Stopped 2021-11-15T20:37:19.049 INFO:teuthology.misc:Shutting down mon daemons... 2021-11-15T20:37:19.050 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-11-15T20:37:19.051 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:19.059 INFO:tasks.ceph.mon.a:Stopped 2021-11-15T20:37:19.060 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-11-15T20:37:19.061 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:19.130 INFO:tasks.ceph.mon.b:Stopped 2021-11-15T20:37:19.131 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-11-15T20:37:19.131 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T20:37:19.143 INFO:tasks.ceph.mon.c:Stopped 2021-11-15T20:37:19.143 INFO:tasks.ceph:Checking cluster log for badness... 2021-11-15T20:37:19.144 DEBUG:teuthology.orchestra.run.gibba037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-11-15T20:37:19.158 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T20:37:19.159 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-11-15T20:37:19.416 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T20:37:19.417 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-15T20:37:19.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T20:37:19.589 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-11-15T20:37:19.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T20:37:19.730 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-11-15T20:37:19.888 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T20:37:19.889 DEBUG:teuthology.orchestra.run.gibba011:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-11-15T20:37:20.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T20:37:20.106 DEBUG:teuthology.orchestra.run.gibba011:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-11-15T20:37:20.304 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T20:37:20.305 DEBUG:teuthology.orchestra.run.gibba011:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-11-15T20:37:20.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T20:37:20.501 DEBUG:teuthology.orchestra.run.gibba011:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-11-15T20:37:20.625 INFO:tasks.ceph:Archiving mon data... 2021-11-15T20:37:20.627 DEBUG:teuthology.misc:Transferring archived files from gibba037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/data/mon.a.tgz 2021-11-15T20:37:20.628 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-11-15T20:37:20.638 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.68BuJef9vC 2021-11-15T20:37:20.638 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.68BuJef9vC 2021-11-15T20:37:20.803 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.68BuJef9vC 2021-11-15T20:37:20.814 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.68BuJef9vC is 431KB 2021-11-15T20:37:20.873 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.68BuJef9vC 2021-11-15T20:37:20.883 DEBUG:teuthology.misc:Transferring archived files from gibba011:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/data/mon.b.tgz 2021-11-15T20:37:20.883 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T20:37:20.893 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.kUdTAnfnB6 2021-11-15T20:37:20.893 DEBUG:teuthology.orchestra.run.gibba011:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kUdTAnfnB6 2021-11-15T20:37:21.014 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.kUdTAnfnB6 2021-11-15T20:37:21.030 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.kUdTAnfnB6 is 417KB 2021-11-15T20:37:21.047 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.kUdTAnfnB6 2021-11-15T20:37:21.055 DEBUG:teuthology.misc:Transferring archived files from gibba011:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/data/mon.c.tgz 2021-11-15T20:37:21.055 DEBUG:teuthology.orchestra.run.gibba011:> mktemp 2021-11-15T20:37:21.106 INFO:teuthology.orchestra.run.gibba011.stdout:/tmp/tmp.eueoaljgFc 2021-11-15T20:37:21.106 DEBUG:teuthology.orchestra.run.gibba011:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eueoaljgFc 2021-11-15T20:37:21.223 DEBUG:teuthology.orchestra.run.gibba011:> sudo chmod 0666 /tmp/tmp.eueoaljgFc 2021-11-15T20:37:21.235 DEBUG:teuthology.orchestra.remote:gibba011:/tmp/tmp.eueoaljgFc is 431KB 2021-11-15T20:37:21.296 DEBUG:teuthology.orchestra.run.gibba011:> rm -fr /tmp/tmp.eueoaljgFc 2021-11-15T20:37:21.306 INFO:tasks.ceph:Cleaning ceph cluster... 2021-11-15T20:37:21.307 DEBUG:teuthology.orchestra.run.gibba011:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T20:37:21.352 DEBUG:teuthology.orchestra.run.gibba017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T20:37:21.356 DEBUG:teuthology.orchestra.run.gibba018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T20:37:21.360 DEBUG:teuthology.orchestra.run.gibba031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T20:37:21.365 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T20:37:21.377 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-11-15T20:37:21.378 DEBUG:teuthology.orchestra.run.gibba037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T20:37:21.420 DEBUG:teuthology.orchestra.run.gibba011:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T20:37:21.423 DEBUG:teuthology.orchestra.run.gibba031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T20:37:21.426 DEBUG:teuthology.orchestra.run.gibba018:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T20:37:21.428 DEBUG:teuthology.orchestra.run.gibba017:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T20:37:21.432 INFO:teuthology.orchestra.run.gibba037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T20:37:21.444 INFO:teuthology.orchestra.run.gibba011.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T20:37:21.445 INFO:teuthology.orchestra.run.gibba031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T20:37:21.446 INFO:teuthology.orchestra.run.gibba017.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T20:37:21.453 INFO:teuthology.orchestra.run.gibba018.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T20:37:21.464 INFO:tasks.ceph:Archiving crash dumps... 2021-11-15T20:37:21.467 DEBUG:teuthology.misc:Transferring archived files from gibba037:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba037/crash 2021-11-15T20:37:21.468 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T20:37:21.495 DEBUG:teuthology.misc:Transferring archived files from gibba011:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba011/crash 2021-11-15T20:37:21.497 DEBUG:teuthology.orchestra.run.gibba011:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T20:37:21.510 DEBUG:teuthology.misc:Transferring archived files from gibba031:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba031/crash 2021-11-15T20:37:21.511 DEBUG:teuthology.orchestra.run.gibba031:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T20:37:21.524 DEBUG:teuthology.misc:Transferring archived files from gibba018:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba018/crash 2021-11-15T20:37:21.526 DEBUG:teuthology.orchestra.run.gibba018:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T20:37:21.539 DEBUG:teuthology.misc:Transferring archived files from gibba017:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba017/crash 2021-11-15T20:37:21.541 DEBUG:teuthology.orchestra.run.gibba017:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T20:37:21.567 INFO:tasks.ceph:Shutting down logrotate 2021-11-15T20:37:21.567 DEBUG:teuthology.orchestra.run.gibba011:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.570 DEBUG:teuthology.orchestra.run.gibba017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.574 DEBUG:teuthology.orchestra.run.gibba018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.584 DEBUG:teuthology.orchestra.run.gibba031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.586 DEBUG:teuthology.orchestra.run.gibba037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.637 DEBUG:teuthology.orchestra.run.gibba011:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.658 DEBUG:teuthology.orchestra.run.gibba017:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.681 DEBUG:teuthology.orchestra.run.gibba018:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.702 DEBUG:teuthology.orchestra.run.gibba031:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.714 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T20:37:21.735 INFO:tasks.ceph:Compressing logs... 2021-11-15T20:37:21.736 DEBUG:teuthology.orchestra.run.gibba011:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:21.740 DEBUG:teuthology.orchestra.run.gibba017:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:21.743 DEBUG:teuthology.orchestra.run.gibba018:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:21.748 DEBUG:teuthology.orchestra.run.gibba031:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:21.760 DEBUG:teuthology.orchestra.run.gibba037:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:23.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2021-11-15T20:37:23.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2021-11-15T20:37:29.596 INFO:tasks.ceph:Archiving logs... 2021-11-15T20:37:29.597 DEBUG:teuthology.misc:Transferring archived files from gibba037:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba037/log 2021-11-15T20:37:29.599 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T20:37:31.675 DEBUG:teuthology.misc:Transferring archived files from gibba011:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba011/log 2021-11-15T20:37:31.677 DEBUG:teuthology.orchestra.run.gibba011:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T20:37:32.835 DEBUG:teuthology.misc:Transferring archived files from gibba031:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba031/log 2021-11-15T20:37:32.836 DEBUG:teuthology.orchestra.run.gibba031:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T20:37:33.122 DEBUG:teuthology.misc:Transferring archived files from gibba018:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba018/log 2021-11-15T20:37:33.124 DEBUG:teuthology.orchestra.run.gibba018:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T20:37:33.149 DEBUG:teuthology.misc:Transferring archived files from gibba017:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba017/log 2021-11-15T20:37:33.150 DEBUG:teuthology.orchestra.run.gibba017:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T20:37:33.164 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-11-15T20:37:33.178 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T20:37:33.181 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-11-15T20:37:33.182 DEBUG:teuthology.orchestra.run.gibba011:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T20:37:33.186 DEBUG:teuthology.orchestra.run.gibba017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T20:37:33.189 DEBUG:teuthology.orchestra.run.gibba018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T20:37:33.192 DEBUG:teuthology.orchestra.run.gibba031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T20:37:33.196 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T20:37:33.332 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-11-15T20:37:33.344 INFO:teuthology.task.clock:Checking final clock skew... 2021-11-15T20:37:33.345 DEBUG:teuthology.orchestra.run.gibba037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T20:37:33.367 INFO:teuthology.orchestra.run.gibba037.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T20:37:33.367 INFO:teuthology.orchestra.run.gibba037.stdout:============================================================================== 2021-11-15T20:37:33.368 INFO:teuthology.orchestra.run.gibba037.stdout:-hv01.front.sepi 216.240.36.24 3 u 39 64 377 0.144 11.819 0.169 2021-11-15T20:37:33.368 INFO:teuthology.orchestra.run.gibba037.stdout:*hv02.front.sepi 163.237.218.18 2 u 21 64 377 0.125 2.569 0.333 2021-11-15T20:37:33.368 INFO:teuthology.orchestra.run.gibba037.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 377 0.121 1.324 0.270 2021-11-15T20:37:33.369 INFO:teuthology.orchestra.run.gibba037.stdout:+hv04.front.sepi 144.172.126.201 3 u 29 64 377 0.108 1.644 0.276 2021-11-15T20:37:33.369 DEBUG:teuthology.orchestra.run.gibba011:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T20:37:33.392 INFO:teuthology.orchestra.run.gibba011.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T20:37:33.392 INFO:teuthology.orchestra.run.gibba011.stdout:============================================================================== 2021-11-15T20:37:33.393 INFO:teuthology.orchestra.run.gibba011.stdout:-hv01.front.sepi 216.240.36.24 3 u 210 256 377 0.237 9.869 0.247 2021-11-15T20:37:33.393 INFO:teuthology.orchestra.run.gibba011.stdout:*hv02.front.sepi 163.237.218.18 2 u 17 256 377 0.253 0.991 0.254 2021-11-15T20:37:33.393 INFO:teuthology.orchestra.run.gibba011.stdout:+hv03.front.sepi 74.6.168.72 3 u 220 256 377 0.225 -0.265 0.248 2021-11-15T20:37:33.394 INFO:teuthology.orchestra.run.gibba011.stdout:+hv04.front.sepi 144.172.126.201 3 u 222 256 377 0.215 -0.116 0.135 2021-11-15T20:37:33.394 DEBUG:teuthology.orchestra.run.gibba031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T20:37:33.416 INFO:teuthology.orchestra.run.gibba031.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T20:37:33.417 INFO:teuthology.orchestra.run.gibba031.stdout:============================================================================== 2021-11-15T20:37:33.417 INFO:teuthology.orchestra.run.gibba031.stdout:-hv01.front.sepi 216.240.36.24 3 u 58 128 377 0.238 9.978 0.143 2021-11-15T20:37:33.418 INFO:teuthology.orchestra.run.gibba031.stdout:*hv02.front.sepi 163.237.218.18 2 u 67 128 377 0.265 1.311 0.146 2021-11-15T20:37:33.418 INFO:teuthology.orchestra.run.gibba031.stdout:+hv03.front.sepi 74.6.168.72 3 u 78 128 377 0.285 -0.192 0.081 2021-11-15T20:37:33.418 INFO:teuthology.orchestra.run.gibba031.stdout:+hv04.front.sepi 144.172.126.201 3 u 23 128 377 0.260 0.068 0.183 2021-11-15T20:37:33.419 DEBUG:teuthology.orchestra.run.gibba018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T20:37:33.440 INFO:teuthology.orchestra.run.gibba018.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T20:37:33.441 INFO:teuthology.orchestra.run.gibba018.stdout:============================================================================== 2021-11-15T20:37:33.441 INFO:teuthology.orchestra.run.gibba018.stdout:-hv01.front.sepi 216.240.36.24 3 u 29 256 377 0.266 7.916 0.241 2021-11-15T20:37:33.441 INFO:teuthology.orchestra.run.gibba018.stdout:*hv02.front.sepi 163.237.218.18 2 u 60 256 377 0.271 -0.699 0.086 2021-11-15T20:37:33.442 INFO:teuthology.orchestra.run.gibba018.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 256 377 0.278 -2.179 0.135 2021-11-15T20:37:33.442 INFO:teuthology.orchestra.run.gibba018.stdout:+hv04.front.sepi 144.172.126.201 3 u 54 256 377 0.258 -1.928 0.109 2021-11-15T20:37:33.443 DEBUG:teuthology.orchestra.run.gibba017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T20:37:33.464 INFO:teuthology.orchestra.run.gibba017.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T20:37:33.465 INFO:teuthology.orchestra.run.gibba017.stdout:============================================================================== 2021-11-15T20:37:33.465 INFO:teuthology.orchestra.run.gibba017.stdout:-hv01.front.sepi 216.240.36.24 3 u 58 256 377 0.266 7.500 0.521 2021-11-15T20:37:33.465 INFO:teuthology.orchestra.run.gibba017.stdout:*hv02.front.sepi 163.237.218.18 2 u 82 256 377 0.240 -0.852 0.270 2021-11-15T20:37:33.466 INFO:teuthology.orchestra.run.gibba017.stdout:+hv03.front.sepi 74.6.168.72 3 u 56 256 377 0.280 -2.037 0.509 2021-11-15T20:37:33.466 INFO:teuthology.orchestra.run.gibba017.stdout:+hv04.front.sepi 144.172.126.201 3 u 118 128 377 0.236 -2.099 0.274 2021-11-15T20:37:33.466 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-11-15T20:37:33.479 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-11-15T20:37:33.479 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-11-15T20:37:33.505 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-11-15T20:37:33.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-11-15T20:37:33.621 INFO:teuthology.task.internal:Duration was 4601.217914 seconds 2021-11-15T20:37:33.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-11-15T20:37:33.693 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-15T20:37:33.693 DEBUG:teuthology.orchestra.run.gibba011:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T20:37:33.697 DEBUG:teuthology.orchestra.run.gibba017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T20:37:33.701 DEBUG:teuthology.orchestra.run.gibba018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T20:37:33.705 DEBUG:teuthology.orchestra.run.gibba031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T20:37:33.709 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T20:37:33.742 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-11-15T20:37:33.742 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba037.front.sepia.ceph.com 2021-11-15T20:37:33.743 DEBUG:teuthology.orchestra.run.gibba037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T20:37:33.786 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba011.front.sepia.ceph.com 2021-11-15T20:37:33.787 DEBUG:teuthology.orchestra.run.gibba011:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T20:37:33.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba031.front.sepia.ceph.com 2021-11-15T20:37:33.801 DEBUG:teuthology.orchestra.run.gibba031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T20:37:33.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba018.front.sepia.ceph.com 2021-11-15T20:37:33.812 DEBUG:teuthology.orchestra.run.gibba018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T20:37:33.823 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba017.front.sepia.ceph.com 2021-11-15T20:37:33.824 DEBUG:teuthology.orchestra.run.gibba017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T20:37:33.835 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-11-15T20:37:33.835 DEBUG:teuthology.orchestra.run.gibba011:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:33.838 DEBUG:teuthology.orchestra.run.gibba017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:33.840 DEBUG:teuthology.orchestra.run.gibba018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:33.843 DEBUG:teuthology.orchestra.run.gibba031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:33.856 DEBUG:teuthology.orchestra.run.gibba037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T20:37:33.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-11-15T20:37:33.892 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-11-15T20:37:33.893 DEBUG:teuthology.orchestra.run.gibba011:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T20:37:33.902 DEBUG:teuthology.orchestra.run.gibba017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T20:37:33.911 DEBUG:teuthology.orchestra.run.gibba018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T20:37:33.922 DEBUG:teuthology.orchestra.run.gibba031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T20:37:33.931 DEBUG:teuthology.orchestra.run.gibba037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T20:37:33.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-11-15T20:37:33.954 DEBUG:teuthology.orchestra.run.gibba011:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:33.957 DEBUG:teuthology.orchestra.run.gibba017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:33.961 DEBUG:teuthology.orchestra.run.gibba018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:33.968 DEBUG:teuthology.orchestra.run.gibba031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:33.971 DEBUG:teuthology.orchestra.run.gibba037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:33.973 INFO:teuthology.orchestra.run.gibba017.stdout:kernel.core_pattern = core 2021-11-15T20:37:33.974 INFO:teuthology.orchestra.run.gibba011.stdout:kernel.core_pattern = core 2021-11-15T20:37:33.979 INFO:teuthology.orchestra.run.gibba037.stdout:kernel.core_pattern = core 2021-11-15T20:37:33.982 INFO:teuthology.orchestra.run.gibba031.stdout:kernel.core_pattern = core 2021-11-15T20:37:33.984 INFO:teuthology.orchestra.run.gibba018.stdout:kernel.core_pattern = core 2021-11-15T20:37:34.003 DEBUG:teuthology.orchestra.run.gibba037:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:34.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:37:34.046 DEBUG:teuthology.orchestra.run.gibba011:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:34.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:37:34.052 DEBUG:teuthology.orchestra.run.gibba031:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:34.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:37:34.058 DEBUG:teuthology.orchestra.run.gibba018:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:34.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:37:34.063 DEBUG:teuthology.orchestra.run.gibba017:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T20:37:34.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T20:37:34.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-11-15T20:37:34.087 INFO:teuthology.task.internal:Transferring archived files... 2021-11-15T20:37:34.088 DEBUG:teuthology.misc:Transferring archived files from gibba037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba037 2021-11-15T20:37:34.089 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T20:37:34.122 DEBUG:teuthology.misc:Transferring archived files from gibba011:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba011 2021-11-15T20:37:34.123 DEBUG:teuthology.orchestra.run.gibba011:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T20:37:34.156 DEBUG:teuthology.misc:Transferring archived files from gibba031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba031 2021-11-15T20:37:34.156 DEBUG:teuthology.orchestra.run.gibba031:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T20:37:34.174 DEBUG:teuthology.misc:Transferring archived files from gibba018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba018 2021-11-15T20:37:34.174 DEBUG:teuthology.orchestra.run.gibba018:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T20:37:34.192 DEBUG:teuthology.misc:Transferring archived files from gibba017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498820/remote/gibba017 2021-11-15T20:37:34.193 DEBUG:teuthology.orchestra.run.gibba017:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T20:37:34.210 INFO:teuthology.task.internal:Removing archive directory... 2021-11-15T20:37:34.211 DEBUG:teuthology.orchestra.run.gibba011:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T20:37:34.213 DEBUG:teuthology.orchestra.run.gibba017:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T20:37:34.216 DEBUG:teuthology.orchestra.run.gibba018:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T20:37:34.231 DEBUG:teuthology.orchestra.run.gibba031:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T20:37:34.235 DEBUG:teuthology.orchestra.run.gibba037:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T20:37:34.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-11-15T20:37:34.258 INFO:teuthology.task.internal:Not uploading archives. 2021-11-15T20:37:34.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-11-15T20:37:34.291 INFO:teuthology.task.internal:Tidying up after the test... 2021-11-15T20:37:34.292 DEBUG:teuthology.orchestra.run.gibba011:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T20:37:34.296 DEBUG:teuthology.orchestra.run.gibba017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T20:37:34.299 DEBUG:teuthology.orchestra.run.gibba018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T20:37:34.303 DEBUG:teuthology.orchestra.run.gibba031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T20:37:34.304 INFO:teuthology.orchestra.run.gibba011.stdout: 655395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 20:37 /home/ubuntu/cephtest 2021-11-15T20:37:34.306 INFO:teuthology.orchestra.run.gibba017.stdout: 655402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 20:37 /home/ubuntu/cephtest 2021-11-15T20:37:34.307 DEBUG:teuthology.orchestra.run.gibba037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T20:37:34.310 INFO:teuthology.orchestra.run.gibba018.stdout: 655401 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 20:37 /home/ubuntu/cephtest 2021-11-15T20:37:34.318 INFO:teuthology.orchestra.run.gibba037.stdout: 655403 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 20:37 /home/ubuntu/cephtest 2021-11-16T05:39:01.783 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-11-16T05:39:01.819 DEBUG:teuthology.task.console_log:Killing console logger for gibba037 2021-11-16T05:39:01.820 DEBUG:teuthology.task.console_log:Killing console logger for gibba011 2021-11-16T05:39:01.821 DEBUG:teuthology.task.console_log:Killing console logger for gibba031 2021-11-16T05:39:01.821 DEBUG:teuthology.task.console_log:Killing console logger for gibba018 2021-11-16T05:39:01.822 DEBUG:teuthology.task.console_log:Killing console logger for gibba017 2021-11-16T05:39:01.822 DEBUG:teuthology.task.console_log:Killing console logger for gibba037 2021-11-16T05:39:01.826 DEBUG:teuthology.task.console_log:Killing console logger for gibba011 2021-11-16T05:39:01.826 DEBUG:teuthology.task.console_log:Killing console logger for gibba031 2021-11-16T05:39:01.829 DEBUG:teuthology.task.console_log:Killing console logger for gibba018 2021-11-16T05:39:01.830 DEBUG:teuthology.task.console_log:Killing console logger for gibba017 2021-11-16T05:39:01.830 DEBUG:teuthology.exit:Finished running handlers